Pre-training neural machine translation with alignment information via optimal transport

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F23%3AU7CVNATW" target="_blank" >RIV/00216208:11320/23:U7CVNATW - isvavai.cz</a>

Výsledek na webu

<a href="https://www.webofscience.com/wos/woscc/summary/e0b8ef34-8e6b-412a-9b8f-87607433ed44-bb92f483/relevance/1" target="_blank" >https://www.webofscience.com/wos/woscc/summary/e0b8ef34-8e6b-412a-9b8f-87607433ed44-bb92f483/relevance/1</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1007/s11042-023-17479-z" target="_blank" >10.1007/s11042-023-17479-z</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Pre-training neural machine translation with alignment information via optimal transport

Popis výsledku v původním jazyce

"With the rapid development of globalization, the demand for translation between different languages is also increasing. Although pre-training has achieved excellent results in neural machine translation, the existing neural machine translation has almost no high-quality suitable for specific fields. Alignment information, so this paper proposes a pre-training neural machine translation with alignment information via optimal transport. First, this paper narrows the representation gap between different languages by using OTAP to generate domain-specific data for information alignment, and learns richer semantic information. Secondly, this paper proposes a lightweight model DR-Reformer, which uses Reformer as the backbone network, adds Dropout layers and Reduction layers, reduces model parameters without losing accuracy, and improves computational efficiency. Experiments on the Chinese and English datasets of AI Challenger 2018 and WMT-17 show that the proposed algorithm has better performance than existing algorithms."

Název v anglickém jazyce

Pre-training neural machine translation with alignment information via optimal transport

Popis výsledku anglicky

"With the rapid development of globalization, the demand for translation between different languages is also increasing. Although pre-training has achieved excellent results in neural machine translation, the existing neural machine translation has almost no high-quality suitable for specific fields. Alignment information, so this paper proposes a pre-training neural machine translation with alignment information via optimal transport. First, this paper narrows the representation gap between different languages by using OTAP to generate domain-specific data for information alignment, and learns richer semantic information. Secondly, this paper proposes a lightweight model DR-Reformer, which uses Reformer as the backbone network, adds Dropout layers and Reduction layers, reduces model parameters without losing accuracy, and improves computational efficiency. Experiments on the Chinese and English datasets of AI Challenger 2018 and WMT-17 show that the proposed algorithm has better performance than existing algorithms."

Druh

J_ost - Ostatní články v recenzovaných periodicích

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

—

Návaznosti

—

Rok uplatnění

2023

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

"MULTIMEDIA TOOLS AND APPLICATIONS"

ISSN

1380-7501

e-ISSN

—

Svazek periodika

""

Číslo periodika v rámci svazku

2023-11-2

Stát vydavatele periodika

US - Spojené státy americké

Počet stran výsledku

21

Strana od-do

1-21

Kód UT WoS článku

001096936900014

EID výsledku v databázi Scopus

—