Open evaluating sentiment analysis systems in Russian

In this paper we describe our experience in conducting the first open sentiment analysis evaluations in Russian within ROMIP 2011–2012. Several train collections were created for such tasks as sentiment classification in blogs and newswire, opinion retrieval. The paper describes the state of the art in sentiment analysis in Russian, collection characteristics, track tasks and evaluation metrics.