UniBridge: A Unified Approach to Cross-Lingual Transfer Learning for Low-Resource Languages

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F25%3AARKZNLT4" target="_blank" >RIV/00216208:11320/25:ARKZNLT4 - isvavai.cz</a>

Result on the web

<a href="https://www.scopus.com/inward/record.uri?eid=2-s2.0-85204446981&partnerID=40&md5=60d08b526cff45135fc753ab24a2c97b" target="_blank" >https://www.scopus.com/inward/record.uri?eid=2-s2.0-85204446981&partnerID=40&md5=60d08b526cff45135fc753ab24a2c97b</a>

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

UniBridge: A Unified Approach to Cross-Lingual Transfer Learning for Low-Resource Languages

Original language description

In this paper, we introduce UniBridge (Cross-Lingual Transfer Learning with Optimized Embeddings and Vocabulary), a comprehensive approach developed to improve the effectiveness of Cross-Lingual Transfer Learning, particularly in languages with limited resources. Our approach tackles two essential elements of a language model: the initialization of embeddings and the optimal vocabulary size. Specifically, we propose a novel embedding initialization method that leverages both lexical and semantic alignment for a language. In addition, we present a method for systematically searching for the optimal vocabulary size, ensuring a balance between model complexity and linguistic coverage. Our experiments across multilingual datasets show that our approach greatly improves the F1-Score in several languages. UniBridge is a robust and adaptable solution for cross-lingual systems in various languages, highlighting the significance of initializing embeddings and choosing the right vocabulary size in cross-lingual environments. © 2024 Association for Computational Linguistics.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

—

Publication year

2024

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

Proc. Annu. Meet. Assoc. Comput Linguist.

ISBN

979-889176094-3

ISSN

0736-587X

e-ISSN

—

Number of pages

17

Pages from-to

3168-3184

Publisher name

Association for Computational Linguistics (ACL)

Place of publication

—

Event location

Bangkok

Event date

Jan 1, 2025

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—