Corpus Annotation Pipeline for Non-standard Texts

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14330%2F18%3A00104585" target="_blank" >RIV/00216224:14330/18:00104585 - isvavai.cz</a>

Výsledek na webu

<a href="http://dx.doi.org/10.1007/978-3-030-00794-2_32" target="_blank" >http://dx.doi.org/10.1007/978-3-030-00794-2_32</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1007/978-3-030-00794-2_32" target="_blank" >10.1007/978-3-030-00794-2_32</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Corpus Annotation Pipeline for Non-standard Texts

Popis výsledku v původním jazyce

According to some estimations (e.g. [9]), web corpora contain over 6% of foreign material (borrowings, language mixing, named entities). Since annotation pipelines are usually built upon standard and correct data, the resulting annotation of web corpora often contains serious errors. We studied in depth annotation errors of the web corpus czTenTen 12 and proposed an extension to the tagger desamb that had been used for czTenTen annotation. First, the subcorpus was made using the most problematic documents from czTenTen. Second, measures were established for the most frequent annotation errors. Third, we established several experiments in which we extended the annotation pipeline so it could annotate foreign material and multi-word expressions. Finally, we compared the new annotations of the subcorpus with the original ones.

Název v anglickém jazyce

Corpus Annotation Pipeline for Non-standard Texts

Popis výsledku anglicky

According to some estimations (e.g. [9]), web corpora contain over 6% of foreign material (borrowings, language mixing, named entities). Since annotation pipelines are usually built upon standard and correct data, the resulting annotation of web corpora often contains serious errors. We studied in depth annotation errors of the web corpus czTenTen 12 and proposed an extension to the tagger desamb that had been used for czTenTen annotation. First, the subcorpus was made using the most problematic documents from czTenTen. Second, measures were established for the most frequent annotation errors. Third, we established several experiments in which we extended the annotation pipeline so it could annotate foreign material and multi-word expressions. Finally, we compared the new annotations of the subcorpus with the original ones.

Druh

D - Stať ve sborníku

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

—

Návaznosti

S - Specificky vyzkum na vysokych skolach

Rok uplatnění

2018

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název statě ve sborníku

Text, Speech, and Dialogue, 21st International Conference, TSD 2018

ISBN

9783030007942

ISSN

—

e-ISSN

—

Počet stran výsledku

9

Strana od-do

304-312

Název nakladatele

Springer International Publishing

Místo vydání

Switzerland

Místo konání akce

Brno, Czech Republic

Datum konání akce

1. 1. 2018

Typ akce podle státní příslušnosti

WRD - Celosvětová akce

Kód UT WoS článku

000611532300032