Slovak Language Models for Basic Preprocessing Tasks in Python
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F23%3ASV3PYY48" target="_blank" >RIV/00216208:11320/23:SV3PYY48 - isvavai.cz</a>
Result on the web
<a href="https://www.ceeol.com/search/article-detail?id=1191258" target="_blank" >https://www.ceeol.com/search/article-detail?id=1191258</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.2478/jazcas-2023-0049" target="_blank" >10.2478/jazcas-2023-0049</a>
Alternative languages
Result language
angličtina
Original language name
Slovak Language Models for Basic Preprocessing Tasks in Python
Original language description
"We propose a Slovak language model for the spaCy library in Python. These models are easy-to-use for basic natural language processing tasks in a single package. The package contains several components for basic preprocessing tasks, such as tokenization, sentence boundary detection, syntactic parsing, lemmatization, named entity recognition, morphology analysis, and word vectors. It is based on the state-of-the-art monolingual SlovakBERT model. Named entity recognition is trained on a separate, publicly available WikiAnn database. The other statistical classifiers use a Slovak Dependency Treebank corpus. Morphological tags are compatible with the conventions of the Slovak National Corpus. The part of speech tags use conventions of the Universal Dependencies framework. We trained a separate word vector model on a web-based corpus. The training uses fastText with Floret modification. We present a series of experiments that confirm that the model performs similarly to other languages for all tasks. Training scripts and data are publicly available."
Czech name
—
Czech description
—
Classification
Type
J<sub>ost</sub> - Miscellaneous article in a specialist periodical
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
—
Continuities
—
Others
Publication year
2023
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Name of the periodical
"Jazykovednỳ časopis"
ISSN
0021-5597
e-ISSN
—
Volume of the periodical
2023
Issue of the periodical within the volume
74
Country of publishing house
US - UNITED STATES
Number of pages
10
Pages from-to
323-332
UT code for WoS article
—
EID of the result in the Scopus database
—