CreoleVal: Multilingual Multitask Benchmarks for Creoles
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F25%3A4AM97JXG" target="_blank" >RIV/00216208:11320/25:4AM97JXG - isvavai.cz</a>
Result on the web
<a href="https://www.scopus.com/inward/record.uri?eid=2-s2.0-85203430113&doi=10.1162%2ftacl_a_00682&partnerID=40&md5=53db0ff5a7f31e8c509dabb0d9600870" target="_blank" >https://www.scopus.com/inward/record.uri?eid=2-s2.0-85203430113&doi=10.1162%2ftacl_a_00682&partnerID=40&md5=53db0ff5a7f31e8c509dabb0d9600870</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1162/tacl_a_00682" target="_blank" >10.1162/tacl_a_00682</a>
Alternative languages
Result language
angličtina
Original language name
CreoleVal: Multilingual Multitask Benchmarks for Creoles
Original language description
Creoles represent an under-explored and marginalized group of languages, with few available resources for NLP research. While the genealogical ties between Creoles and a number of highly resourced languages imply a significant potential for transfer learning, this potential is hampered due to this lack of anno-tated data. In this work we present CREOLEVAL, a collection of benchmark datasets spanning 8 different NLP tasks, covering up to 28 Creole languages; it is an aggregate of novel development datasets for reading comprehension relation classification, and machine translation for Creoles, in addition to a practical gateway to a handful of preexisting benchmarks. For each benchmark, we conduct baseline experiments in a zero-shot setting in order to further ascertain the capabilities and limitations of transfer learning for Creoles. Ultimately, we see CREOLEVAL as an opportunity to empower research on Creoles in NLP and computational linguistics, and in general, a step towards more equitable language technology around the globe. © 2024 Association for Computational Linguistics.
Czech name
—
Czech description
—
Classification
Type
J<sub>SC</sub> - Article in a specialist periodical, which is included in the SCOPUS database
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
—
Continuities
—
Others
Publication year
2024
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Name of the periodical
Transactions of the Association for Computational Linguistics
ISSN
2307-387X
e-ISSN
—
Volume of the periodical
12
Issue of the periodical within the volume
2024
Country of publishing house
US - UNITED STATES
Number of pages
29
Pages from-to
950-978
UT code for WoS article
—
EID of the result in the Scopus database
2-s2.0-85203430113