Combining Textual and Speech Features in the NLI Task Using State-of-the-Art Machine Learning Techniques

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F17%3A10372153" target="_blank" >RIV/00216208:11320/17:10372153 - isvavai.cz</a>

Výsledek na webu

<a href="http://www.aclweb.org/anthology/W/W17/W17-5021.pdf" target="_blank" >http://www.aclweb.org/anthology/W/W17/W17-5021.pdf</a>

DOI - Digital Object Identifier

—

Jazyk výsledku

angličtina

Název v původním jazyce

Combining Textual and Speech Features in the NLI Task Using State-of-the-Art Machine Learning Techniques

Popis výsledku v původním jazyce

We summarize the involvement of our CEMI team in the Native Language Identification shared task, NLI Shared Task~2017, which deals with both textual and speech input data. We submitted the results achieved by using three different system architectures; each of them combines multiple supervised learning models trained on various feature sets. As expected, better results are achieved with the systems that use both the textual data and the spoken responses. Combining the input data of two different modalities led to a rather dramatic improvement in classification performance. Our best performing method is based on a set of feed-forward neural networks whose hidden-layer outputs are combined together using a softmax layer. We achieved a macro-averaged F1 score of 0.9257 on the evaluation (unseen) test set and our team placed first in the main task together with other three teams.

Název v anglickém jazyce

Combining Textual and Speech Features in the NLI Task Using State-of-the-Art Machine Learning Techniques

Popis výsledku anglicky

We summarize the involvement of our CEMI team in the Native Language Identification shared task, NLI Shared Task~2017, which deals with both textual and speech input data. We submitted the results achieved by using three different system architectures; each of them combines multiple supervised learning models trained on various feature sets. As expected, better results are achieved with the systems that use both the textual data and the spoken responses. Combining the input data of two different modalities led to a rather dramatic improvement in classification performance. Our best performing method is based on a set of feed-forward neural networks whose hidden-layer outputs are combined together using a softmax layer. We achieved a macro-averaged F1 score of 0.9257 on the evaluation (unseen) test set and our team placed first in the main task together with other three teams.

Druh

D - Stať ve sborníku

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

Výsledek vznikl pri realizaci vícero projektů. Více informací v záložce Projekty.

Návaznosti

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Rok uplatnění

2017

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název statě ve sborníku

The 12th Workshop on Innovative Use of NLP for Building Educational Applications

ISBN

978-1-945626-00-5

ISSN

—

e-ISSN

neuvedeno

Počet stran výsledku

12

Strana od-do

198-209

Název nakladatele

The Association for Computational Linguistics

Místo vydání

Stroudsburg, PA, USA

Místo konání akce

København, Denmark

Datum konání akce

8. 9. 2017

Typ akce podle státní příslušnosti

WRD - Celosvětová akce

Kód UT WoS článku

—