ÚFAL LatinPipe at EvaLatin 2024: Morphosyntactic Analysis of Latin
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F24%3A10492908" target="_blank" >RIV/00216208:11320/24:10492908 - isvavai.cz</a>
Alternative codes found
RIV/00216208:11320/25:ZZFKGWA8
Result on the web
<a href="https://aclanthology.org/2024.lt4hala-1.24.pdf" target="_blank" >https://aclanthology.org/2024.lt4hala-1.24.pdf</a>
DOI - Digital Object Identifier
—
Alternative languages
Result language
angličtina
Original language name
ÚFAL LatinPipe at EvaLatin 2024: Morphosyntactic Analysis of Latin
Original language description
We present LatinPipe, the winning submission to the EvaLatin 2024 Dependency Parsing shared task. Our system consists of a fine-tuned concatenation of base and large pre-trained LMs, with a dot-product attention head for parsing and softmax classification heads for morphology to jointly learn both dependency parsing and morphological analysis. It is trained by sampling from seven publicly available Latin corpora, utilizing additional harmonization of annotations to achieve a more unified annotation style. Before fine-tuning, we train the system for a few initial epochs with frozen weights. We also add additional local relative contextualization by stacking the BiLSTM layers on top of the Transformer(s). Finally, we ensemble output probability distributions from seven randomly instantiated networks for the final submission. The code is available at https://github.com/ufal/evalatin2024-latinpipe.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
<a href="/en/project/GX20-16819X" target="_blank" >GX20-16819X: Language Understanding: from Syntax to Discourse</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2024
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Proceedings of the Third Workshop on Language Technologies for Historical and Ancient Languages (LT4HALA) @ LREC-COLING-2024
ISBN
978-2-493-81446-3
ISSN
2522-2686
e-ISSN
—
Number of pages
8
Pages from-to
207-214
Publisher name
ELRA and ICCL
Place of publication
Torino, Italia
Event location
Torino, Italy
Event date
May 25, 2024
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—