Reading Comprehension in Czech via Machine Translation and Cross-lingual Transfer
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F20%3A10415122" target="_blank" >RIV/00216208:11320/20:10415122 - isvavai.cz</a>
Alternative codes found
RIV/00216208:11320/20:10424477
Result on the web
<a href="https://doi.org/10.1007/978-3-030-58323-1_18" target="_blank" >https://doi.org/10.1007/978-3-030-58323-1_18</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1007/978-3-030-58323-1_18" target="_blank" >10.1007/978-3-030-58323-1_18</a>
Alternative languages
Result language
angličtina
Original language name
Reading Comprehension in Czech via Machine Translation and Cross-lingual Transfer
Original language description
Reading comprehension is a well studied task, with huge training datasets in English. This work focuses on building reading comprehension systems for Czech, without requiring any manually annotated Czech training data. First of all, we automatically translated SQuAD 1.1 and SQuAD 2.0 datasets to Czech to create training and development data, which we release at http://hdl.handle.net/11234/1-3249. We then trained and evaluated several BERT and XLM-RoBERTa baseline models. However, our main focus lies in cross-lingual transfer models. We report that a XLM-RoBERTa model trained on English data and evaluated on Czech achieves very competitive performance, only approximately 2% points worse than a model trained on the translated Czech data. This result is extremely good, considering the fact that the model has not seen any Czech data during training. The cross-lingual transfer approach is very flexible and provides a reading comprehension in any language, for which we have enough monolingual raw texts.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
Result was created during the realization of more than one project. More information in the Projects tab.
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2020
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Text, Speech, and Dialogue. TSD 2020
ISBN
978-3-030-58322-4
ISSN
0302-9743
e-ISSN
—
Number of pages
9
Pages from-to
171-179
Publisher name
Springer
Place of publication
Cham
Event location
Brno
Event date
Sep 8, 2020
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—