RIRES: Russian Information Retrieval Evaluation Seminar

 Call for participation 
 General principles 
 Test collections 
 Relevance tables 



Here is detailed information about the ROMIP'2006 seminar: Results and ROMIP'2006 participants reports are available in the Publications section.


20 March 2006
Official start of ROMIP'06. The call for participation was published.
5 May 2006
List of ROMIP'2006 participants was published.
5 May 2006
Tracks description was published.
29 June 2006
The results submission deadlines for the QA and news clustering tracks were moved to the July 13th and July 6th respectively.
13 September 2006
The paper submission deadline is prolonged to the September 28th (submission style guide in Russian).
The evaluation results for the text retrieval and classification tracks are sent to the participants.
9 October 2006
Announced that ROMIP'2006 workshop would be collocated with the RCDL'2006 and would take place on the 19th of October in Suzdal. The program of ROMIP'2006 (in Russian) was published.
17 October 2006
Proceedings of ROMIP'2006 (in Russian) were published.
20 October 2006
Workshop was attended by more than 50 people. 12 of 14 planned presentations were given at the ROMIP workshop in Suzdal by the participants. They told about their results and experiences made during the current cycle of seminar.

After the official part of the workshop and its host conference RCDL'06 we had a round-table discussion about ROMIP future. During this two hours discussion we talked about creating and using new data collections for text retrieval evaluation, defining new tracks, lowering the entrance barrier for new potential participants, improving the website, and a number of other important topics.

20 October 2006
Slides from ROMIP workshop in Suzdal are available.

Organizing Committee

  • Mikhail Ageev (Moscow State University)
  • Pavel Braslavski (Yandex, Moscow)
  • Maxim Gubin (
  • Boris Dobrov (UIS RUSSIA, Moscow)
  • Igor Kuralenok (Yandex, St. Petersburg)
  • Igor Nekrestyanov (Sun Microsystems, St. Petersburg)
  • Vladimir Pleshko (Garant-Park-Internet, Moscow)
  • Ilya Segalovich (Yandex, Moscow)
  • Vlad Shabanov (Rambler, Moscow)


  • ACK
    Research project. The aim of our experiments is to evaluate the efficiency of text retrieval and document annotation when using our contextual-associative model for natural language texts.

  • Atlas-Alpha

  • ClusterRetrieve2006

  • Exactus

  • Extragon

  • Galaktika-Zoom

  • Kallimachos

  • Kodeks
    Commercial document processing system includes storage and search engine, text analysis modules, etc. The system is developed by Legal Information Consortium Kodeks and is used in popular legal and technical regulation information systems, document management systems.


  • RCO

  • SearchInform
    SearchInform uses very fast indexing algorithms (up to 30Gb per hour), still the system offers its users a wide range of search features.

  • Specs

  • Stocona
    Stocona Search provides classical text retrieval and question answering facilities. The system performs syntax and semantic analysis of the text documents in the collection.

  • ThematicSearch2006


  • Yandex
    One of the most popular Web search engines in Russia.

  • Zolushka
    Research project of the Information Retrieval Group at the St.Petersburg State University.