Modelling crosslinguistic n-gram correspondence in typologically different languages

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11210%2F21%3A10435726" target="_blank" >RIV/00216208:11210/21:10435726 - isvavai.cz</a>

Výsledek na webu

<a href="https://verso.is.cuni.cz/pub/verso.fpl?fname=obd_publikace_handle&handle=b8z1vkGq4D" target="_blank" >https://verso.is.cuni.cz/pub/verso.fpl?fname=obd_publikace_handle&handle=b8z1vkGq4D</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1075/lic.19018.mil" target="_blank" >10.1075/lic.19018.mil</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Modelling crosslinguistic n-gram correspondence in typologically different languages

Popis výsledku v původním jazyce

N-gram analysis (popularized e.g. by Biber et al., 1999) has become a popular method for the identification of recurrent language patterns. Although the extraction of n-grams from a corpus may seem straightforward, it proves to be very challenging when applied cross-linguistically (cf. e.g. Ebeling and Ebeling, 2013; Granger and Lefer, 2013; Cermakova and Chlumska, 2017). The major issue is that the quantities of n-grams of a certain length in typologically different languages do not correspond. Consequently, n-grams of a given length may function differently across languages, rendering a direct comparison inadequate. Our paper introduces a function capable of modelling the relation between the quantities of n-grams in typologically distant languages, using the example of Czech and English (and some other language pairs). Based on our model, we can suggest what n-gram lengths should be contrasted to better reflect the size of n-gram inventories in each language. The correspondence may not be intuitive (e.g. a Czech 2-gram may best correspond to an English 2.5-gram), but it still provides researchers with a general guide as to what might be useful to include in their analysis (e.g. in this case 2-grams in Czech and 2- and 3-grams in English).

Název v anglickém jazyce

Modelling crosslinguistic n-gram correspondence in typologically different languages

Popis výsledku anglicky

N-gram analysis (popularized e.g. by Biber et al., 1999) has become a popular method for the identification of recurrent language patterns. Although the extraction of n-grams from a corpus may seem straightforward, it proves to be very challenging when applied cross-linguistically (cf. e.g. Ebeling and Ebeling, 2013; Granger and Lefer, 2013; Cermakova and Chlumska, 2017). The major issue is that the quantities of n-grams of a certain length in typologically different languages do not correspond. Consequently, n-grams of a given length may function differently across languages, rendering a direct comparison inadequate. Our paper introduces a function capable of modelling the relation between the quantities of n-grams in typologically distant languages, using the example of Czech and English (and some other language pairs). Based on our model, we can suggest what n-gram lengths should be contrasted to better reflect the size of n-gram inventories in each language. The correspondence may not be intuitive (e.g. a Czech 2-gram may best correspond to an English 2.5-gram), but it still provides researchers with a general guide as to what might be useful to include in their analysis (e.g. in this case 2-grams in Czech and 2- and 3-grams in English).

Druh

J_imp - Článek v periodiku v databázi Web of Science

CEP obor

—

OECD FORD obor

60203 - Linguistics

Projekt

<a href="/cs/project/LM2018137" target="_blank" >LM2018137: Český národní korpus</a><br>

Návaznosti

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Rok uplatnění

2021

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

Languages in Contrast

ISSN

1387-6759

e-ISSN

—

Svazek periodika

21

Číslo periodika v rámci svazku

2

Stát vydavatele periodika

NL - Nizozemsko

Počet stran výsledku

33

Strana od-do

217-249

Kód UT WoS článku

000686565100003

EID výsledku v databázi Scopus

2-s2.0-85113778418