When Multilingual Models Compete with Monolingual Domain-Specific Models in Clinical Question Answering

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F25%3A10511613" target="_blank" >RIV/00216208:11320/25:10511613 - isvavai.cz</a>

Result on the web

<a href="https://aclanthology.org/2025.cl4health-1.6/" target="_blank" >https://aclanthology.org/2025.cl4health-1.6/</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.18653/v1/2025.cl4health-1.6" target="_blank" >10.18653/v1/2025.cl4health-1.6</a>

Result language

angličtina

Original language name

When Multilingual Models Compete with Monolingual Domain-Specific Models in Clinical Question Answering

Original language description

This paper explores the performance of multilingual models in the general domain on the clinical Question Answering (QA) task to observe their potential medical support for languages that do not benefit from the existence of clinically trained models. In order to improve the model’s performance, we exploit multilingual data augmentation by translating an English clinical QA dataset into six other languages. We propose a translation pipeline including projection of the evidences (answers) into the target languages and thoroughly evaluate several multilingual models fine-tuned on the augmented data, both in mono- and multilingual settings. We find that the translation itself and the subsequent QA experiments present a differently challenging problem for each of the languages. Finally, we compare the performance of multilingual models with pretrained medical domain-specific English models on the original clinical English test set. Contrary to expectations, we find that monolingual domain-specific pretrai

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

S - Specificky vyzkum na vysokych skolach<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year

2025

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

Proceedings of the Second Workshop on Patient-Oriented Language Processing (CL4Health)

ISBN

979-8-89176-238-1

ISSN

—

e-ISSN

—

Number of pages

14

Pages from-to

69-82

Publisher name

Association for Computational Linguistics

Place of publication

Kerrville, TX, USA

Event location

Albuquerque, NM, USA

Event date

May 4, 2025

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—