A High-Quality Web Corpus of Czech

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F12%3A10130097" target="_blank" >RIV/00216208:11320/12:10130097 - isvavai.cz</a>

Výsledek na webu

<a href="http://www.lrec-conf.org/proceedings/lrec2012/pdf/120_Paper.pdf" target="_blank" >http://www.lrec-conf.org/proceedings/lrec2012/pdf/120_Paper.pdf</a>

DOI - Digital Object Identifier

—

Jazyk výsledku

angličtina

Název v původním jazyce

A High-Quality Web Corpus of Czech

Popis výsledku v původním jazyce

In our paper, we present main results of the Czech grant project Internet as a Language Corpus, whose aim was to build a corpus of Czech web texts and to develop and publicly release related software tools. Our corpus may not be the largest web corpus ofCzech, but it maintains very good language quality due to high portion of human work involved in the corpus development process. We describe the corpus contents (2.65 billions of words divided into three parts -- 450 millions of words from news and magazines articles, 1 billion of words from blogs, diaries and other non-reviewed literary units, 1.1 billion of words from discussions messages), particular steps of the corpus creation (crawling, HTML and boilerplate removal, near duplicates removal, language filtering) and its automatic language annotation (POS tagging, syntactic parsing). We also describe our software tools being released under an open source license, especially a fast linear-time module for removing near-duplicates on a

Název v anglickém jazyce

A High-Quality Web Corpus of Czech

Popis výsledku anglicky

In our paper, we present main results of the Czech grant project Internet as a Language Corpus, whose aim was to build a corpus of Czech web texts and to develop and publicly release related software tools. Our corpus may not be the largest web corpus ofCzech, but it maintains very good language quality due to high portion of human work involved in the corpus development process. We describe the corpus contents (2.65 billions of words divided into three parts -- 450 millions of words from news and magazines articles, 1 billion of words from blogs, diaries and other non-reviewed literary units, 1.1 billion of words from discussions messages), particular steps of the corpus creation (crawling, HTML and boilerplate removal, near duplicates removal, language filtering) and its automatic language annotation (POS tagging, syntactic parsing). We also describe our software tools being released under an open source license, especially a fast linear-time module for removing near-duplicates on a

Druh

D - Stať ve sborníku

CEP obor

IN - Informatika

OECD FORD obor

—

Projekt

Výsledek vznikl pri realizaci vícero projektů. Více informací v záložce Projekty.

Návaznosti

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Rok uplatnění

2012

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název statě ve sborníku

Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC 2012)

ISBN

978-2-9517408-7-7

ISSN

—

e-ISSN

—

Počet stran výsledku

5

Strana od-do

311-315

Název nakladatele

European Language Resources Association

Místo vydání

?stanbul, Turkey

Místo konání akce

?stanbul, Turkey

Datum konání akce

21. 5. 2012

Typ akce podle státní příslušnosti

CST - Celostátní akce

Kód UT WoS článku

—