Understanding Cross-Lingual Alignment-A Survey
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F24%3A10492862" target="_blank" >RIV/00216208:11320/24:10492862 - isvavai.cz</a>
Result on the web
<a href="https://aclanthology.org/2024.findings-acl.649" target="_blank" >https://aclanthology.org/2024.findings-acl.649</a>
DOI - Digital Object Identifier
—
Alternative languages
Result language
angličtina
Original language name
Understanding Cross-Lingual Alignment-A Survey
Original language description
Cross-lingual alignment, the meaningful similarity of representations across languages in multilingual language models, has been an active field of research in recent years. We survey the literature of techniques to improve cross-lingual alignment, providing a taxonomy of methods and summarising insights from throughout the field. We present different understandings of cross-lingual alignment and their limitations. We provide a qualitative summary of results from a number of surveyed papers. Finally, we discuss how these insights may be applied not only to encoder models, where this topic has been heavily studied, but also to encoder-decoder or even decoder-only models, and argue that an effective trade-off between language-neutral and language-specific information is key.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
—
Continuities
I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace
Others
Publication year
2024
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Findings of the Association for Computational Linguistics: ACL 2024
ISBN
979-8-89176-099-8
ISSN
—
e-ISSN
—
Number of pages
22
Pages from-to
10922-10943
Publisher name
Association for Computational Linguistics
Place of publication
Kerrville, TX, USA
Event location
Bangkok, Thailand
Event date
Aug 11, 2024
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—