LongEval 2025 CORE Retrieval Train Collection

This collection consists of queries and documents extracted from the CORE scholarly literature search engine (https://core.ac.uk/). The queries in this collection were issued by CORE users, and a specific pipeline was designed to capture user queries, their corresponding search results, and user interactions. Using this pipeline, the dataset for this task was extracted, consisting of two main components: 

1. Search Information – includes unique (anonymous) identifiers for individual user sessions, search queries, and the returned results. 

1. Click Information – includes unique (anonymous) identifiers for individual user sessions, the links clicked within the results list, and the positions of the clicked links. 

The documents in the collection were selected based on the search results of user queries. In addition to these selected documents, the collection also contains randomly chosen documents from the CORE index. 

The training data were collected from November to December 2024. In total, the collection comprises 393 training queries with 4262 relevance assessments derived from a click model. The document set consists of 2014265 downloaded, cleaned, and filtered scholarly articles. 

This collection serves as the official training dataset for the 2025 LongEval Information Retrieval Lab (https://clef-longeval.github.io/), organized at CLEF.