CreoleVal: Multilingual Multitask Benchmarks for Creoles

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F25%3A4AM97JXG" target="_blank" >RIV/00216208:11320/25:4AM97JXG - isvavai.cz</a>

Výsledek na webu

<a href="https://www.scopus.com/inward/record.uri?eid=2-s2.0-85203430113&doi=10.1162%2ftacl_a_00682&partnerID=40&md5=53db0ff5a7f31e8c509dabb0d9600870" target="_blank" >https://www.scopus.com/inward/record.uri?eid=2-s2.0-85203430113&doi=10.1162%2ftacl_a_00682&partnerID=40&md5=53db0ff5a7f31e8c509dabb0d9600870</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1162/tacl_a_00682" target="_blank" >10.1162/tacl_a_00682</a>

Jazyk výsledku

angličtina

Název v původním jazyce

CreoleVal: Multilingual Multitask Benchmarks for Creoles

Popis výsledku v původním jazyce

Creoles represent an under-explored and marginalized group of languages, with few available resources for NLP research. While the genealogical ties between Creoles and a number of highly resourced languages imply a significant potential for transfer learning, this potential is hampered due to this lack of anno-tated data. In this work we present CREOLEVAL, a collection of benchmark datasets spanning 8 different NLP tasks, covering up to 28 Creole languages; it is an aggregate of novel development datasets for reading comprehension relation classification, and machine translation for Creoles, in addition to a practical gateway to a handful of preexisting benchmarks. For each benchmark, we conduct baseline experiments in a zero-shot setting in order to further ascertain the capabilities and limitations of transfer learning for Creoles. Ultimately, we see CREOLEVAL as an opportunity to empower research on Creoles in NLP and computational linguistics, and in general, a step towards more equitable language technology around the globe. © 2024 Association for Computational Linguistics.

Název v anglickém jazyce

CreoleVal: Multilingual Multitask Benchmarks for Creoles

Popis výsledku anglicky

Creoles represent an under-explored and marginalized group of languages, with few available resources for NLP research. While the genealogical ties between Creoles and a number of highly resourced languages imply a significant potential for transfer learning, this potential is hampered due to this lack of anno-tated data. In this work we present CREOLEVAL, a collection of benchmark datasets spanning 8 different NLP tasks, covering up to 28 Creole languages; it is an aggregate of novel development datasets for reading comprehension relation classification, and machine translation for Creoles, in addition to a practical gateway to a handful of preexisting benchmarks. For each benchmark, we conduct baseline experiments in a zero-shot setting in order to further ascertain the capabilities and limitations of transfer learning for Creoles. Ultimately, we see CREOLEVAL as an opportunity to empower research on Creoles in NLP and computational linguistics, and in general, a step towards more equitable language technology around the globe. © 2024 Association for Computational Linguistics.

Druh

J_SC - Článek v periodiku v databázi SCOPUS

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

—

Návaznosti

—

Rok uplatnění

2024

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

Transactions of the Association for Computational Linguistics

ISSN

2307-387X

e-ISSN

—

Svazek periodika

12

Číslo periodika v rámci svazku

2024

Stát vydavatele periodika

US - Spojené státy americké

Počet stran výsledku

29

Strana od-do

950-978

Kód UT WoS článku

—

EID výsledku v databázi Scopus

2-s2.0-85203430113