MTEQA at WMT21 Metrics Shared Task
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F21%3A10440548" target="_blank" >RIV/00216208:11320/21:10440548 - isvavai.cz</a>
Result on the web
<a href="https://aclanthology.org/2021.wmt-1.pdf" target="_blank" >https://aclanthology.org/2021.wmt-1.pdf</a>
DOI - Digital Object Identifier
—
Alternative languages
Result language
angličtina
Original language name
MTEQA at WMT21 Metrics Shared Task
Original language description
In this paper, we describe our submission to the WMT 2021 Metrics Shared Task. We use the automatically-generated questions and answers to evaluate the quality of Machine Translation (MT) systems. Our submission builds upon the recently proposed MTEQA framework. Experiments on WMT20 evaluation datasets show that at the system-level the MTEQA metric achieves performance comparable with other state-of-the-art solutions, while considering only a certain amount of information from the whole translation.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
—
Continuities
R - Projekt Ramcoveho programu EK
Others
Publication year
2021
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Proceedings of the Sixth Conference on Machine Translation
ISBN
978-1-954085-94-7
ISSN
—
e-ISSN
—
Number of pages
6
Pages from-to
1024-1029
Publisher name
Association for Computational Linguistics
Place of publication
Online
Event location
Online
Event date
Nov 10, 2021
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—