Visualization-based improvement of neural machine translation

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F22%3AHXGZLLZY" target="_blank" >RIV/00216208:11320/22:HXGZLLZY - isvavai.cz</a>

Result on the web

<a href="https://www.sciencedirect.com/science/article/pii/S0097849321002594" target="_blank" >https://www.sciencedirect.com/science/article/pii/S0097849321002594</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1016/j.cag.2021.12.003" target="_blank" >10.1016/j.cag.2021.12.003</a>

Result language

angličtina

Original language name

Visualization-based improvement of neural machine translation

Original language description

We introduce a novel visual-interactive approach for analyzing, understanding, and correcting neural machine translation. Our system supports users in automatically translating documents using neural machine translation and identifying and correcting possible erroneous translations. User corrections can then be used to fine-tune the neural machine translation model and automatically improve the whole document. While translation results of neural machine translation can be impressive, there are still many challenges such as over- and under-translation, domain-specific terminology, and handling long sentences, making it necessary for users to verify translation results. Our system aims at supporting users in this task. Our visual analytics approach combines several visualization techniques in an interactive system. A parallel coordinates plot with multiple metrics related to translation quality can be used to find, filter, and select translations that might contain errors. An interactive beam search visualization and graph- or matrix-based visualizations for attention weights can be used for post-editing and understanding machine-generated translations. The machine translation model is updated from user corrections to improve the translation quality of the whole document. We designed our approach for an LSTM-based translation model and extended it to also include the Transformer architecture. We show for representative examples possible mistranslations and how to use our system to deal with them. A user study revealed that many participants favor such a system over manual text-based translation, especially for translating large documents. Furthermore, we performed quantitative computer-based experiments that show that our system can be used to improve translation quality and reduce post-editing efforts for domain-specific documents.

Czech name

—

Czech description

—

Type

J_imp - Article in a specialist periodical, which is included in the Web of Science database

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

—

Publication year

2022

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Name of the periodical

Computers and Graphics

ISSN

0097-8493

e-ISSN

1873-7684

Volume of the periodical

103

Issue of the periodical within the volume

2022-4-1

Country of publishing house

GB - UNITED KINGDOM

Number of pages

16

Pages from-to

45-60

UT code for WoS article

000797510600003

EID of the result in the Scopus database

2-s2.0-85123427775