“You’ll be a nurse, my son!” Automatically assessing gender biases in autoregressive language models in French and Italian

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F26%3AZH9U529Q" target="_blank" >RIV/00216208:11320/26:ZH9U529Q - isvavai.cz</a>

Result on the web

<a href="http://dx.doi.org/10.1007/s10579-024-09780-6" target="_blank" >http://dx.doi.org/10.1007/s10579-024-09780-6</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1007/s10579-024-09780-6" target="_blank" >10.1007/s10579-024-09780-6</a>

Result language

angličtina

Original language name

“You’ll be a nurse, my son!” Automatically assessing gender biases in autoregressive language models in French and Italian

Original language description

Language models are now massively used for a variety of tasks, including open-ended generation and writing assistance. However, generated texts can encapsulate biases and harm users. A variety of articles aim at detecting, measuring and mitigating stereotypical biases, but focus mainly on English and on pre-training tasks. Thus, we propose a framework to automatically measure gender biases generated by language models in inflected languages, in a practical setting. Herein, we report experiments using this framework on seven autoregressive language models used to generate more than 52,000 cover letters in French, addressing 203 industry and sectors, and over 4100 cover letters in Italian, on 55 sectors. Associations between occupation and gender are studied using a system that we introduce to automatically identify morpho-syntactic gender markers in text. Results suggest that all models are strongly biased towards the generation of texts containing masculine gender markers. Overall, generated texts contain twice as many masculine (vs. feminine) markers in French, and eight times as many in Italian. Models also exacerbate gender stereotypes that are evidenced in social science studies and associate feminine inflections with occupations related to care, children and physical appearance, whereas occupations that require physical, technical and manual skills are strongly associated with masculine markers. © The Author(s), under exclusive licence to Springer Nature B.V. 2024.

Czech name

—

Czech description

—

Type

J_SC - Article in a specialist periodical, which is included in the SCOPUS database

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

—

Publication year

2025

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Name of the periodical

Language Resources and Evaluation

ISSN

1574-020X

e-ISSN

—

Volume of the periodical

59

Issue of the periodical within the volume

2

Country of publishing house

US - UNITED STATES

Number of pages

29

Pages from-to

1495-1523

UT code for WoS article

—

EID of the result in the Scopus database

2-s2.0-85207686245