Overview of ELOQUENT 2025: Shared Tasks for Evaluating Generative Language Model Quality
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F25%3A10511598" target="_blank" >RIV/00216208:11320/25:10511598 - isvavai.cz</a>
Result on the web
<a href="https://link.springer.com/chapter/10.1007/978-3-032-04354-2_14#citeas" target="_blank" >https://link.springer.com/chapter/10.1007/978-3-032-04354-2_14#citeas</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1007/978-3-032-04354-2_14" target="_blank" >10.1007/978-3-032-04354-2_14</a>
Alternative languages
Result language
angličtina
Original language name
Overview of ELOQUENT 2025: Shared Tasks for Evaluating Generative Language Model Quality
Original language description
ELOQUENT is a CLEF lab for evaluating generative language model quality with a focus on such aspects of quality that do not come to the fore with current standard test suites and test collections and to develop and promote new test regimes and methods that fit a multilingual application scenario for generative artificial intelligence. This year is the second year of ELOQUENT. This year's experiment tracks have evolved from the first year: this year we continue challenging the capability of classifiers to distinguish machine-generated from human-authored text; we explore how consistent language models are in responding to value-oriented questions across languages and system settings; we test how accurately language models are able to predict human preferences between variants of generated material; and we investigate how well language models are able provide sensible topical quizzes to fit given target texts.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
<a href="/en/project/EH23_020%2F0008518" target="_blank" >EH23_020/0008518: Linguistics, Artificial Intelligence and Language and Speech Technologies: from Research to Applications</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace
Others
Publication year
2025
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Sixteenth International Conference of the CLEF Association (CLEF 2025)
ISBN
978-3-032-04354-2
ISSN
1611-3349
e-ISSN
—
Number of pages
18
Pages from-to
224-241
Publisher name
Springer
Place of publication
Cham, Switzerland
Event location
Madrid, Spain
Event date
Sep 9, 2025
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—