Modelling crosslinguistic n-gram correspondence in typologically different languages

Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11210%2F21%3A10435726" target="_blank" >RIV/00216208:11210/21:10435726 - isvavai.cz</a>
Result on the web
<a href="https://verso.is.cuni.cz/pub/verso.fpl?fname=obd_publikace_handle&handle=b8z1vkGq4D" target="_blank" >https://verso.is.cuni.cz/pub/verso.fpl?fname=obd_publikace_handle&handle=b8z1vkGq4D</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1075/lic.19018.mil" target="_blank" >10.1075/lic.19018.mil</a>

Result language
angličtina
Original language name
Modelling crosslinguistic n-gram correspondence in typologically different languages
Original language description
N-gram analysis (popularized e.g. by Biber et al., 1999) has become a popular method for the identification of recurrent language patterns. Although the extraction of n-grams from a corpus may seem straightforward, it proves to be very challenging when applied cross-linguistically (cf. e.g. Ebeling and Ebeling, 2013; Granger and Lefer, 2013; Cermakova and Chlumska, 2017). The major issue is that the quantities of n-grams of a certain length in typologically different languages do not correspond. Consequently, n-grams of a given length may function differently across languages, rendering a direct comparison inadequate. Our paper introduces a function capable of modelling the relation between the quantities of n-grams in typologically distant languages, using the example of Czech and English (and some other language pairs). Based on our model, we can suggest what n-gram lengths should be contrasted to better reflect the size of n-gram inventories in each language. The correspondence may not be intuitive (e.g. a Czech 2-gram may best correspond to an English 2.5-gram), but it still provides researchers with a general guide as to what might be useful to include in their analysis (e.g. in this case 2-grams in Czech and 2- and 3-grams in English).
Czech name
—
Czech description
—

Type
J<sub>imp</sub> - Article in a specialist periodical, which is included in the Web of Science database
CEP classification
—
OECD FORD branch
60203 - Linguistics

Project
<a href="/en/project/LM2018137" target="_blank" >LM2018137: Czech National Corpus</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year
2021
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Similar results(10)