Improvements to Korektor: A case study with native and non-native Czech
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F15%3A10318156" target="_blank" >RIV/00216208:11320/15:10318156 - isvavai.cz</a>
Alternative codes found
RIV/00216208:11210/15:10318156
Result on the web
—
DOI - Digital Object Identifier
—
Alternative languages
Result language
angličtina
Original language name
Improvements to Korektor: A case study with native and non-native Czech
Original language description
We present recent developments of Korektor, a statistical spell checking system. In addition to lexicon, Korektor uses language models to find real-word errors, detectable only in context. The models and error probabilities, learned from error corpora, are also used to suggest the most likely corrections. Korektor was originally trained on a small error corpus and used language models extracted from an in-house corpus WebColl. We show two recent improvements: . We built new language models from freely avail- able (shuffled) versions of the Czech National Corpus and show that these perform consistently better on texts produced both by native speakers and non-native learners of Czech. . We trained new error models on a manually annotated learner corpus and show that they perform better than the standard error model (in error detection) not only for the learners' texts, but also for our standard eval- uation data of native Czech. For error correction, the standard error model outperformed
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
IN - Informatics
OECD FORD branch
—
Result continuities
Project
Result was created during the realization of more than one project. More information in the Projects tab.
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2015
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Proceedings of the 15th conference ITAT 2015: Slovenskočeský NLP workshop (SloNLP 2015)
ISBN
978-1-5151-2065-0
ISSN
1613-0073
e-ISSN
—
Number of pages
8
Pages from-to
73-80
Publisher name
CreateSpace Independent Publishing Platform
Place of publication
Praha, Czechia
Event location
Smižany, Slovakia
Event date
Sep 20, 2015
Type of event by nationality
CST - Celostátní akce
UT code for WoS article
—