The Problem of AI Hallucination and How to Solve It

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11410%2F24%3A10491287" target="_blank" >RIV/00216208:11410/24:10491287 - isvavai.cz</a>

Alternative codes found

RIV/00216208:11320/24:10491287

Result on the web

—

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

The Problem of AI Hallucination and How to Solve It

Original language description

AI in education is a topic that has been researched for the last 70 years. However, the last two years have seen very significant changes. These changes relate to the introduction of OpenAI&apos;s ChatGPT chatbot in November 2022. The GPT (Generative Pre-trained Transformer) language model has dramatically influenced how the public approaches artificial intelligence. For many, generative language models have become synonymous with AI and have come uncritically viewed as a universal source of answers to most questions. However, it soon became apparent that even generative language models had their limits. Among the main problems that emerged was hallucination (providing answers containing false or misleading information), which is expected in all language models. The main problem of hallucination is that this information is difficult to distinguish from other information, and AI language models are very persuasive in presenting it. The risks of this phenomenon are much more substantial when using language modules to support learning, where the learner cannot distinguish correct information from incorrect information. The proposed paper focuses on the area of AI hallucination in mathematics education. It will first show how AI chatbots hallucinate in mathematics and then present one possible solution to counter this hallucination. The presented solution was created for the AI chatbot Edu-AI and designed to tutor students in mathematics. Usually, the problem is approached so that the system verifies the correctness of the output offered by the chatbot. Within the Edu-AI, checking responses is not implemented, but checking inputs is. If an input containing a factual query is recorded, it is redirected, and the answer is traced to authorised knowledge sources and study materials. If a relevant answer cannot be traced in these sources, a redirect to a natural person who will address the question is offered. In addition to describing the technical solution, the article includes concrete examples of how the system works. This solution has been developed for the educational domain but applies to all domains where users must be provided with relevant information.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

50301 - Education, general; including training, pedagogy, didactics [and education systems]

Project

<a href="/en/project/TL05000236" target="_blank" >TL05000236: AI assistant for students and teachers</a><br>

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Publication year

2024

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

Proceedings of the European Conference on e-Learning, ECEL

ISBN

—

ISSN

2048-8637

e-ISSN

2048-8645

Number of pages

7

Pages from-to

122-128

Publisher name

Academic Conferences and Publishing International Limited

Place of publication

Portugal

Event location

Porto

Event date

Oct 24, 2024

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—