Word segmentation granularity in Korean

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F25%3ACMFHJXTI" target="_blank" >RIV/00216208:11320/25:CMFHJXTI - isvavai.cz</a>

Výsledek na webu

<a href="https://www.scopus.com/inward/record.uri?eid=2-s2.0-85195386895&doi=10.1075%2fkl.00008.par&partnerID=40&md5=fe58e6b966d2ec9d5f7f568c0855842b" target="_blank" >https://www.scopus.com/inward/record.uri?eid=2-s2.0-85195386895&doi=10.1075%2fkl.00008.par&partnerID=40&md5=fe58e6b966d2ec9d5f7f568c0855842b</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1075/kl.00008.par" target="_blank" >10.1075/kl.00008.par</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Word segmentation granularity in Korean

Popis výsledku v původním jazyce

This paper describes word segmentation granularity in Korean language processing. From a word separated by blank space, which is termed an eojeol, to a sequence of morphemes in Korean, there are multiple possible levels of word segmentation granularity in Korean. For specific language processing and corpus annotation tasks, several different granularity levels have been proposed and utilized, because the agglutinative languages including Korean language have a one-to-one mapping between functional morpheme and syntactic category. Thus, we analyze these different granularity levels, presenting the examples of Korean language processing systems for future reference. Interestingly, the granularity by separating only functional morphemes including case markers and verbal endings, and keeping other suffixes for morphological derivation results in the optimal performance for phrase structure parsing. This contradicts previous best practices for Korean language processing, which has been the de facto standard for various applications that require separating all morphemes. © 2024 John Benjamins Publishing Company. All rights reserved.

Název v anglickém jazyce

Word segmentation granularity in Korean

Popis výsledku anglicky

This paper describes word segmentation granularity in Korean language processing. From a word separated by blank space, which is termed an eojeol, to a sequence of morphemes in Korean, there are multiple possible levels of word segmentation granularity in Korean. For specific language processing and corpus annotation tasks, several different granularity levels have been proposed and utilized, because the agglutinative languages including Korean language have a one-to-one mapping between functional morpheme and syntactic category. Thus, we analyze these different granularity levels, presenting the examples of Korean language processing systems for future reference. Interestingly, the granularity by separating only functional morphemes including case markers and verbal endings, and keeping other suffixes for morphological derivation results in the optimal performance for phrase structure parsing. This contradicts previous best practices for Korean language processing, which has been the de facto standard for various applications that require separating all morphemes. © 2024 John Benjamins Publishing Company. All rights reserved.

Druh

J_SC - Článek v periodiku v databázi SCOPUS

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

—

Návaznosti

—

Rok uplatnění

2024

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

Korean Linguistics

ISSN

0257-3784

e-ISSN

—

Svazek periodika

20

Číslo periodika v rámci svazku

1

Stát vydavatele periodika

US - Spojené státy americké

Počet stran výsledku

31

Strana od-do

82-112

Kód UT WoS článku

—

EID výsledku v databázi Scopus

2-s2.0-85195386895