CUNI System for the Building Educational Applications 2019 Shared Task: Grammatical Error Correction

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F19%3A10405589" target="_blank" >RIV/00216208:11320/19:10405589 - isvavai.cz</a>

Result on the web

<a href="https://www.aclweb.org/anthology/W19-4419/" target="_blank" >https://www.aclweb.org/anthology/W19-4419/</a>

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

CUNI System for the Building Educational Applications 2019 Shared Task: Grammatical Error Correction

Original language description

In this paper, we describe our systems submitted to the Building Educational Applications (BEA) 2019 Shared Task (Bryant et al., 2019). We participated in all three tracks. Our models are NMT systems based on the Transformer model, which we improve by incorporating several enhancements: applying dropout to whole source and target words, weighting target subwords, averaging model checkpoints, and using the trained model iteratively for correcting the intermediate translations. The system in the Restricted Track is trained on the provided corpora with oversampled &quot;cleaner&quot; sentences and reaches 59.39 F0.5 score on the test set. The system in the Low-Resource Track is trained from Wikipedia revision histories and reaches 44.13 F0.5 score. Finally, we finetune the system from the Low-Resource Track on restricted data and achieve 64.55 F0.5 score, placing third in the Unrestricted Track.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

Result was created during the realization of more than one project. More information in the Projects tab.

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>S - Specificky vyzkum na vysokych skolach

Publication year

2019

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications

ISBN

978-1-950737-34-5

ISSN

—

e-ISSN

—

Number of pages

8

Pages from-to

183-190

Publisher name

Association for Computational Linguistics

Place of publication

Stroudsburg, PA, USA

Event location

Firenze, Italy

Event date

Aug 2, 2019

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—