Extended overview of the CLEF 2024 LongEval Lab on Longitudinal Evaluation of Model Performance
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F24%3A10492841" target="_blank" >RIV/00216208:11320/24:10492841 - isvavai.cz</a>
Result on the web
<a href="https://ceur-ws.org/Vol-3740/paper-213.pdf" target="_blank" >https://ceur-ws.org/Vol-3740/paper-213.pdf</a>
DOI - Digital Object Identifier
—
Alternative languages
Result language
angličtina
Original language name
Extended overview of the CLEF 2024 LongEval Lab on Longitudinal Evaluation of Model Performance
Original language description
We describe the second edition of the LongEval CLEF 2024 shared task. This lab evaluates the temporal persistence of Information Retrieval (IR) systems and Text Classifiers. Task 1 requires IR systems to run on corpora acquired at several timestamps, and evaluates the drop in system quality (NDCG) along these timestamps. Task 2 tackles binary sentiment classification at different points in time, and evaluates the performance drop for different temporal gaps. Overall, 37 teams registered for Task 1 and 25 for Task 2. Ultimately, 14 and 4 teams participated in Task 1 and Task 2, respectively.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
<a href="/en/project/LM2023062" target="_blank" >LM2023062: Digital Research Infrastructure for Language Technologies, Arts and Humanities</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace
Others
Publication year
2024
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Working Notes of CLEF 2024 - Conference and Labs of the Evaluation Forum
ISBN
—
ISSN
1613-0073
e-ISSN
—
Number of pages
23
Pages from-to
2267-2289
Publisher name
CEUR-WS
Place of publication
Aachen, Germany
Event location
Grenoble, France
Event date
Sep 9, 2024
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—