Subword-based Cross-lingual Transfer of Embeddings from Hindi to Marathi and Nepali

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F22%3A10456922" target="_blank" >RIV/00216208:11320/22:10456922 - isvavai.cz</a>

Result on the web

<a href="https://aclanthology.org/2022.sigmorphon-1.pdf" target="_blank" >https://aclanthology.org/2022.sigmorphon-1.pdf</a>

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

Subword-based Cross-lingual Transfer of Embeddings from Hindi to Marathi and Nepali

Original language description

Word embeddings are growing to be a crucial resource in the field of NLP for any language. This work introduces a novel technique for static subword embeddings transfer for Indic languages from a relatively higher resource language to a genealogically related low resource language. We primarily work with Hindi-Marathi, simulating a low-resource scenario for Marathi, and confirm observed trends on Nepali. We demonstrate the consistent benefits of unsupervised morphemic segmentation on both source and target sides over the treatment performed by fastText. Our best-performing approach uses an EM-style approach to learning bilingual subword embeddings; we also show, for the first time, that a trivial &quot;copy- and-paste&quot; embeddings transfer based on even perfect bilingual lexicons is inadequate in capturing language-specific relationships. We find that our approach substantially outperforms the fastText baselines for both Marathi and Nepali on the Word Similarity task as well as WordNet-Based Synonymy Tests;

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year

2022

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

19th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology

ISBN

978-1-955917-82-7

ISSN

—

e-ISSN

—

Number of pages

11

Pages from-to

61-71

Publisher name

Association for Computational Linguistics

Place of publication

Stroudsburg, PA, USA

Event location

Seattle, WA, USA

Event date

Jul 14, 2022

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—