LongEval: Longitudinal Evaluation of Model Performance at CLEF 2024
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F24%3A10492843" target="_blank" >RIV/00216208:11320/24:10492843 - isvavai.cz</a>
Alternative codes found
RIV/00216208:11320/25:5SSSF78Q
Result on the web
<a href="https://link.springer.com/chapter/10.1007/978-3-031-56072-9_8" target="_blank" >https://link.springer.com/chapter/10.1007/978-3-031-56072-9_8</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1007/978-3-031-56072-9_8" target="_blank" >10.1007/978-3-031-56072-9_8</a>
Alternative languages
Result language
angličtina
Original language name
LongEval: Longitudinal Evaluation of Model Performance at CLEF 2024
Original language description
This paper introduces the planned second LongEval Lab, part of the CLEF 2024 conference. The aim of the lab's two tasks is to give researchers test data for addressing temporal effectiveness persistence challenges in both information retrieval and text classification, motivated by the fact that model performance degrades as the test data becomes temporally distant from the training data. LongEval distinguishes itself from traditional IR and classification tasks by emphasizing the evaluation of models designed to mitigate performance drop over time using evolving data. The second LongEval edition will further engage the IR community and NLP researchers in addressing the crucial challenge of temporal persistence in models, exploring the factors that enable or hinder it, and identifying potential solutions along with their limitations.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
<a href="/en/project/LM2023062" target="_blank" >LM2023062: Digital Research Infrastructure for Language Technologies, Arts and Humanities</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace
Others
Publication year
2024
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Advances in Information Retrieval, 46th European Conference on Information Retrieval, ECIR 2024, Part VI
ISBN
978-3-031-56071-2
ISSN
0302-9743
e-ISSN
—
Number of pages
7
Pages from-to
60-66
Publisher name
Springer Nature Switzerland
Place of publication
Cham, Switzerland
Event location
Glasgow, UK
Event date
Mar 24, 2024
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
001211836300008