Can ChatGPT recognize impoliteness? An exploratory study of the pragmatic awareness of a large language model

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F26%3APLQ7NVRF" target="_blank" >RIV/00216208:11320/26:PLQ7NVRF - isvavai.cz</a>

Výsledek na webu

<a href="https://www.sciencedirect.com/science/article/pii/S0378216625000323" target="_blank" >https://www.sciencedirect.com/science/article/pii/S0378216625000323</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1016/j.pragma.2025.02.001" target="_blank" >10.1016/j.pragma.2025.02.001</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Can ChatGPT recognize impoliteness? An exploratory study of the pragmatic awareness of a large language model

Popis výsledku v původním jazyce

The practical potential of Large Language Models (LLMs) depends in part on their ability to accurately interpret pragmatic functions. In this article, we assess ChatGPT 3.5’s ability to identify and interpret linguistic impoliteness across a series of text examples. We provided ChatGPT 3.5 with instances of implicational, metalinguistic, and explicit impoliteness, alongside sarcasm, unpalatable questions, erotic talk, and unmarked impolite linguistic behavior, asking (i) whether impoliteness was present, and (ii) its source. We then further tested the bot’s ability to identify impoliteness by asking it to remove it from a series of text examples. ChatGPT 3.5 generally performed well, recognizing both conventionalized lexicogrammatical forms and context-sensitive cases. However, it struggled to account for all impoliteness. In some cases, the model was more sensitive to potentially offensive expressions than humans are, as a result of its design, training and/or inability to sufficiently determine the situational context of the examples. We also found that the model had difficulties sometimes in interpreting impoliteness generated through implicature. Given that impoliteness is a complex and multi-functional phenomenon, we consider our findings to contribute to increasing public awareness not only about the use of AI technologies but also about improving their safety, transparency, and reliability.

Název v anglickém jazyce

Can ChatGPT recognize impoliteness? An exploratory study of the pragmatic awareness of a large language model

Popis výsledku anglicky

The practical potential of Large Language Models (LLMs) depends in part on their ability to accurately interpret pragmatic functions. In this article, we assess ChatGPT 3.5’s ability to identify and interpret linguistic impoliteness across a series of text examples. We provided ChatGPT 3.5 with instances of implicational, metalinguistic, and explicit impoliteness, alongside sarcasm, unpalatable questions, erotic talk, and unmarked impolite linguistic behavior, asking (i) whether impoliteness was present, and (ii) its source. We then further tested the bot’s ability to identify impoliteness by asking it to remove it from a series of text examples. ChatGPT 3.5 generally performed well, recognizing both conventionalized lexicogrammatical forms and context-sensitive cases. However, it struggled to account for all impoliteness. In some cases, the model was more sensitive to potentially offensive expressions than humans are, as a result of its design, training and/or inability to sufficiently determine the situational context of the examples. We also found that the model had difficulties sometimes in interpreting impoliteness generated through implicature. Given that impoliteness is a complex and multi-functional phenomenon, we consider our findings to contribute to increasing public awareness not only about the use of AI technologies but also about improving their safety, transparency, and reliability.

Druh

J_ost - Ostatní články v recenzovaných periodicích

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

—

Návaznosti

—

Rok uplatnění

2025

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

Journal of Pragmatics

ISSN

0378-2166

e-ISSN

—

Svazek periodika

239

Číslo periodika v rámci svazku

2025-04-01

Stát vydavatele periodika

US - Spojené státy americké

Počet stran výsledku

21

Strana od-do

16-36

Kód UT WoS článku

—

EID výsledku v databázi Scopus

—