Beyond transparency and explainability. On the need for adequate and contextualized user guidelines for LLM use

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F67985955%3A_____%2F24%3A00601236" target="_blank" >RIV/67985955:_____/24:00601236 - isvavai.cz</a>

Result on the web

<a href="https://doi.org/10.1007/s10676-024-09778-2" target="_blank" >https://doi.org/10.1007/s10676-024-09778-2</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1007/s10676-024-09778-2" target="_blank" >10.1007/s10676-024-09778-2</a>

Result language

angličtina

Original language name

Beyond transparency and explainability. On the need for adequate and contextualized user guidelines for LLM use

Original language description

Large language models (LLMs) such as ChatGPT present immense opportunities, but without proper training for users (and potentially oversight), they carry risks of misuse as well. We argue that current approaches focusing predominantly on transparency and explainability fall short in addressing the diverse needs and concerns of various user groups. We highlight the limitations of existing methodologies and propose a framework anchored on user-centric guidelines. In particular, we argue that LLM users should be given guidelines on what tasks LLMs can do well and which they cannot, which tasks require further guidance or refinement by the user, and context-specific heuristics. We further argue that (some) users should be taught to refine and elaborate adequate prompts, be provided with good procedures for prompt iteration, and be taught efficient ways to verify outputs. We suggest that for users, shifting away from looking at the technology itself, but rather looking at the usage of it within contextualized sociotechnical systems, can help solve many issues related to LLMs. We further emphasize the role of real-world case studies in shaping these guidelines, ensuring they are grounded in practical, applicable strategies. Like any technology, risks of misuse can be managed through education, regulation, and responsible development.

Czech name

—

Czech description

—

Type

J_imp - Article in a specialist periodical, which is included in the Web of Science database

CEP classification

—

OECD FORD branch

60302 - Ethics (except ethics related to specific subfields)

Project

<a href="/en/project/GN24-12638I" target="_blank" >GN24-12638I: Ethical and Legal Aspects of Autonomous Weapon Systems</a><br>

Continuities

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year

2024

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Name of the periodical

Ethics and Information Technology

ISSN

1388-1957

e-ISSN

1572-8439

Volume of the periodical

26

Issue of the periodical within the volume

3

Country of publishing house

NL - THE KINGDOM OF THE NETHERLANDS

Number of pages

12

Pages from-to

47

UT code for WoS article

001270569000001

EID of the result in the Scopus database

2-s2.0-85198733365