Similar Documents Search Track
The purpose of this track is to evaluate methods of document retrieval which use feedback from the user. In the context of this track we evaluate methods of search of similar documents by a sample document.
For this track the standard procedure is used.
Test CollectionThe source dataset is a union of Narod.ru and legal documents (2004) collections.
Documents located in all the archives narod.*, legal.* and *_training.* are included in the dataset.
Task Description for Participating Systems
Each participant is granted access to the collections and a set of tasks. Each task is a (query, relevant document) pair. The tasks are based on the set of queries used in the previous ROMIP workshops (2004-2005). Evaluation is based on strong relevance criteria, i.e. a document is considered relevant if all of the assessors mark it as relevant.
Expected result is an ordered list of document URLs. Maximum list size is 100 per (query, relevant document) pair.