Corpus Annotation Pipeline for Non-standard Texts
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14330%2F18%3A00104585" target="_blank" >RIV/00216224:14330/18:00104585 - isvavai.cz</a>
Result on the web
<a href="http://dx.doi.org/10.1007/978-3-030-00794-2_32" target="_blank" >http://dx.doi.org/10.1007/978-3-030-00794-2_32</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1007/978-3-030-00794-2_32" target="_blank" >10.1007/978-3-030-00794-2_32</a>
Alternative languages
Result language
angličtina
Original language name
Corpus Annotation Pipeline for Non-standard Texts
Original language description
According to some estimations (e.g. [9]), web corpora contain over 6% of foreign material (borrowings, language mixing, named entities). Since annotation pipelines are usually built upon standard and correct data, the resulting annotation of web corpora often contains serious errors. We studied in depth annotation errors of the web corpus czTenTen 12 and proposed an extension to the tagger desamb that had been used for czTenTen annotation. First, the subcorpus was made using the most problematic documents from czTenTen. Second, measures were established for the most frequent annotation errors. Third, we established several experiments in which we extended the annotation pipeline so it could annotate foreign material and multi-word expressions. Finally, we compared the new annotations of the subcorpus with the original ones.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
—
Continuities
S - Specificky vyzkum na vysokych skolach
Others
Publication year
2018
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Text, Speech, and Dialogue, 21st International Conference, TSD 2018
ISBN
9783030007942
ISSN
—
e-ISSN
—
Number of pages
9
Pages from-to
304-312
Publisher name
Springer International Publishing
Place of publication
Switzerland
Event location
Brno, Czech Republic
Event date
Jan 1, 2018
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
000611532300032