Results of the WMT14 Metrics Shared Task
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F14%3A10289390" target="_blank" >RIV/00216208:11320/14:10289390 - isvavai.cz</a>
Result on the web
<a href="http://www.statmt.org/wmt14/pdf/W14-3336.pdf" target="_blank" >http://www.statmt.org/wmt14/pdf/W14-3336.pdf</a>
DOI - Digital Object Identifier
—
Alternative languages
Result language
angličtina
Original language name
Results of the WMT14 Metrics Shared Task
Original language description
This paper presents the results of the WMT14 Metrics Shared Task. We asked participants of this task to score the outputs of the MT systems involved in WMT14 Shared Translation Task. We col- lected scores of 23 metrics from 12 re- search groups. In addition to that we com- puted scores of 6 standard metrics (BLEU, NIST, WER, PER, TER and CDER) as baselines. The collected scores were eval- uated in terms of system level correlation (how well each metric's scores correlate with WMT14 official manual ranking of systems) and in terms of segment level correlation (how often a metric agrees with humans in comparing two translations of a particular sentence).
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
IN - Informatics
OECD FORD branch
—
Result continuities
Project
—
Continuities
S - Specificky vyzkum na vysokych skolach
Others
Publication year
2014
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Proceedings of the Ninth Workshop on Statistical Machine Translation
ISBN
978-1-941643-17-4
ISSN
—
e-ISSN
—
Number of pages
9
Pages from-to
293-301
Publisher name
Association for Computational Linguistics
Place of publication
Baltimore, MD, USA
Event location
Baltimore, MD, USA
Event date
Jun 26, 2014
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—