CUNI-NL@IWSLT 2025: End-to-end Offline Speech Translation and Instruction Following with LLMs

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F25%3A10511622" target="_blank" >RIV/00216208:11320/25:10511622 - isvavai.cz</a>

Result on the web

<a href="https://aclanthology.org/2025.iwslt-1.28/" target="_blank" >https://aclanthology.org/2025.iwslt-1.28/</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.18653/v1/2025.iwslt-1.28" target="_blank" >10.18653/v1/2025.iwslt-1.28</a>

Result language

angličtina

Original language name

CUNI-NL@IWSLT 2025: End-to-end Offline Speech Translation and Instruction Following with LLMs

Original language description

This paper describes the CUNI-NL team&apos;s submission to the IWSLT 2025 Offline Speech Translation and Instruction Following tasks, focusing on transcribing the English audio and translating the English audio to German text. Our systems follow the end-to-end approach, where each system consists of a pretrained, frozen speech encoder, along with a medium-sized large language model fine-tuned with LoRA on three tasks: 1) transcribing the English audio; 2) directly translating the English audio to German text; and 3) a combination of the above two tasks, i.e., simultaneously transcribing the English audio and translating the English audio to German text.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

<a href="/en/project/EH23_020%2F0008518" target="_blank" >EH23_020/0008518: Linguistics, Artificial Intelligence and Language and Speech Technologies: from Research to Applications</a><br>

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year

2025

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

Proceedings of the 22nd International Conference on Spoken Language Translation (IWSLT 2025)

ISBN

979-8-89176-272-5

ISSN

—

e-ISSN

—

Number of pages

7

Pages from-to

282-288

Publisher name

Association for Computational Linguistics

Place of publication

Kerrville, TX, USA

Event location

Wien, Austria

Event date

Jul 31, 2025

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—