Findings of the WMT24 General Machine Translation Shared Task: The LLM Era is Here but MT is Not Solved Yet
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F24%3A10492873" target="_blank" >RIV/00216208:11320/24:10492873 - isvavai.cz</a>
Result on the web
<a href="https://aclanthology.org/2024.wmt-1.1.pdf" target="_blank" >https://aclanthology.org/2024.wmt-1.1.pdf</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.18653/v1/2024.wmt-1.1" target="_blank" >10.18653/v1/2024.wmt-1.1</a>
Alternative languages
Result language
angličtina
Original language name
Findings of the WMT24 General Machine Translation Shared Task: The LLM Era is Here but MT is Not Solved Yet
Original language description
This overview paper presents the results of the General Machine Translation Task organised as part of the 2024 Conference on Machine Translation (WMT). In the general MT task, participants were asked to build machine translation systems for any of 11 language pairs, to be evaluated on test sets consisting of three to five different domains. In addition to participating systems, we collected translations from 8 different large language models (LLMs) and 4 online translation providers. We evaluate system outputs with professional human annotators using a new protocol called Error Span Annotations (ESA).
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
Result was created during the realization of more than one project. More information in the Projects tab.
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2024
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Proceedings of the Ninth Conference on Machine Translation
ISBN
979-8-89176-179-7
ISSN
—
e-ISSN
—
Number of pages
46
Pages from-to
1-46
Publisher name
Association for Computational Linguistics
Place of publication
Kerrville, TX, USA
Event location
Miami, FL, USA
Event date
Nov 15, 2024
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—