Beyond transparency and explainability. On the need for adequate and contextualized user guidelines for LLM use

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F67985955%3A_____%2F24%3A00601236" target="_blank" >RIV/67985955:_____/24:00601236 - isvavai.cz</a>

Výsledek na webu

<a href="https://doi.org/10.1007/s10676-024-09778-2" target="_blank" >https://doi.org/10.1007/s10676-024-09778-2</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1007/s10676-024-09778-2" target="_blank" >10.1007/s10676-024-09778-2</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Beyond transparency and explainability. On the need for adequate and contextualized user guidelines for LLM use

Popis výsledku v původním jazyce

Large language models (LLMs) such as ChatGPT present immense opportunities, but without proper training for users (and potentially oversight), they carry risks of misuse as well. We argue that current approaches focusing predominantly on transparency and explainability fall short in addressing the diverse needs and concerns of various user groups. We highlight the limitations of existing methodologies and propose a framework anchored on user-centric guidelines. In particular, we argue that LLM users should be given guidelines on what tasks LLMs can do well and which they cannot, which tasks require further guidance or refinement by the user, and context-specific heuristics. We further argue that (some) users should be taught to refine and elaborate adequate prompts, be provided with good procedures for prompt iteration, and be taught efficient ways to verify outputs. We suggest that for users, shifting away from looking at the technology itself, but rather looking at the usage of it within contextualized sociotechnical systems, can help solve many issues related to LLMs. We further emphasize the role of real-world case studies in shaping these guidelines, ensuring they are grounded in practical, applicable strategies. Like any technology, risks of misuse can be managed through education, regulation, and responsible development.

Název v anglickém jazyce

Beyond transparency and explainability. On the need for adequate and contextualized user guidelines for LLM use

Popis výsledku anglicky

Large language models (LLMs) such as ChatGPT present immense opportunities, but without proper training for users (and potentially oversight), they carry risks of misuse as well. We argue that current approaches focusing predominantly on transparency and explainability fall short in addressing the diverse needs and concerns of various user groups. We highlight the limitations of existing methodologies and propose a framework anchored on user-centric guidelines. In particular, we argue that LLM users should be given guidelines on what tasks LLMs can do well and which they cannot, which tasks require further guidance or refinement by the user, and context-specific heuristics. We further argue that (some) users should be taught to refine and elaborate adequate prompts, be provided with good procedures for prompt iteration, and be taught efficient ways to verify outputs. We suggest that for users, shifting away from looking at the technology itself, but rather looking at the usage of it within contextualized sociotechnical systems, can help solve many issues related to LLMs. We further emphasize the role of real-world case studies in shaping these guidelines, ensuring they are grounded in practical, applicable strategies. Like any technology, risks of misuse can be managed through education, regulation, and responsible development.

Druh

J_imp - Článek v periodiku v databázi Web of Science

CEP obor

—

OECD FORD obor

60302 - Ethics (except ethics related to specific subfields)

Projekt

<a href="/cs/project/GN24-12638I" target="_blank" >GN24-12638I: Etické a právní aspekty autonomních zbraňových systémů</a><br>

Návaznosti

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Rok uplatnění

2024

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

Ethics and Information Technology

ISSN

1388-1957

e-ISSN

1572-8439

Svazek periodika

26

Číslo periodika v rámci svazku

3

Stát vydavatele periodika

NL - Nizozemsko

Počet stran výsledku

12

Strana od-do

47

Kód UT WoS článku

001270569000001

EID výsledku v databázi Scopus

2-s2.0-85198733365