Is it Possible to Re-educate RoBERTa? Expert-driven Machine Learning for Punctuation Correction.
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F49777513%3A23520%2F23%3A43969896" target="_blank" >RIV/49777513:23520/23:43969896 - isvavai.cz</a>
Alternative codes found
RIV/00216224:14210/23:00131927
Result on the web
<a href="https://doi.org/10.2478/jazcas-2023-0052" target="_blank" >https://doi.org/10.2478/jazcas-2023-0052</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.2478/jazcas-2023-0052" target="_blank" >10.2478/jazcas-2023-0052</a>
Alternative languages
Result language
angličtina
Original language name
Is it Possible to Re-educate RoBERTa? Expert-driven Machine Learning for Punctuation Correction.
Original language description
Although Czech rule-based tools for automatic punctuation insertion rely on extensive grammar and achieve respectable precision, the pre-trained Transformers outperform rule-based systems in precision and recall (Machura et al. 2022). The Czech pre-trained RoBERTa model achieves excellent results, yet a certain level of phenomena is ignored, and the model partially makes errors. This paper aims to investigate whether it ispossible to retrain the RoBERTa language model to increase the number of sentence commas the model correctly detects. We have chosen a very specific and narrow type of sentence comma, namely the sentence comma delimiting vocative phrases, which is clearly defined in the grammar and is very often omitted by writers. The chosen approaches were further tested and evaluated on different types of texts.
Czech name
—
Czech description
—
Classification
Type
J<sub>SC</sub> - Article in a specialist periodical, which is included in the SCOPUS database
CEP classification
—
OECD FORD branch
20205 - Automation and control systems
Result continuities
Project
<a href="/en/project/GA22-27800S" target="_blank" >GA22-27800S: Transformers of multiple modalities for more natural spoken dialog</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2023
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Name of the periodical
Journal of Linguistics
ISSN
0021-5597
e-ISSN
1338-4287
Volume of the periodical
74
Issue of the periodical within the volume
1
Country of publishing house
PL - POLAND
Number of pages
12
Pages from-to
357-368
UT code for WoS article
—
EID of the result in the Scopus database
2-s2.0-85181757325