Variable Mini-Batch Sizing and Pre-Trained Embeddings

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F17%3A10372132" target="_blank" >RIV/00216208:11320/17:10372132 - isvavai.cz</a>

Result on the web

<a href="http://www.statmt.org/wmt17/pdf/WMT80.pdf" target="_blank" >http://www.statmt.org/wmt17/pdf/WMT80.pdf</a>

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

Variable Mini-Batch Sizing and Pre-Trained Embeddings

Original language description

This paper describes our submission to the WMT 2017 Neural MT Training Task. We modified the provided NMT system in order to allow for interrupting and con- tinuing the training of models. This al- lowed mid-training batch size decremen- tation and incrementation at variable rates. In addition to the models with variable batch size, we tried different setups with pre-trained word2vec embeddings. Aside from batch size incrementation, all our ex- periments performed below the baseline

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

S - Specificky vyzkum na vysokych skolach<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year

2017

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers

ISBN

978-1-945626-96-8

ISSN

—

e-ISSN

neuvedeno

Number of pages

7

Pages from-to

680-686

Publisher name

Association for Computational Linguistics

Place of publication

Stroudsburg, PA, USA

Event location

København, Denmark

Event date

Sep 7, 2017

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—