Beyond Traditional Learning: The LLM Revolution in BPM Education at University

Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F60461373%3A22340%2F24%3A43930385" target="_blank" >RIV/60461373:22340/24:43930385 - isvavai.cz</a>
Result on the web
<a href="https://link.springer.com/book/10.1007/978-3-031-70445-1" target="_blank" >https://link.springer.com/book/10.1007/978-3-031-70445-1</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1007/978-3-031-70445-1_29" target="_blank" >10.1007/978-3-031-70445-1_29</a>

Result language
angličtina
Original language name
Beyond Traditional Learning: The LLM Revolution in BPM Education at University
Original language description
Large Language Models (LLMs) significantly impact higher education, requiring changes in educational processes, especially in Business Process Management (BPM) practical exercises. The research aims to evaluate the effectiveness of LLMs in BPM education to determine if LLMs can supplement educators. The study involved 33 master's degree students. Students' works were manually evaluated and compared to LLM-generated responses. Results highlight the effectiveness and limitations of LLMs in supporting BPM education, revealing discrepancies between human and AI assessments. Our findings indicate that LLMs like ChatGPT-3.5 and ChatGPT-4o can aid BPM education, but their performance and reliability differ from traditional human grading. The findings underscore LLMs' potential to offer additional perspectives and reduce educators' workload. However, LLMs should be supplementary tools, not replacements for traditional methods. This exploration contributes to understanding the transformative role of LLMs in reshaping educational methodologies. Future research should consider larger samples and a broader range of tasks to validate and extend these findings.
Czech name
—
Czech description
—

Project
—
Continuities
I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year
2024
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection
BUSINESS PROCESS MANAGEMENT: BLOCKCHAIN, ROBOTIC PROCESS AUTOMATION, CENTRAL AND EASTERN EUROPEAN, EDUCATORS AND INDUSTRY FORUM: BPM 2024 BLOCKCHAIN, RPA, CEE, EDUCATORS AND INDUSTRY FORUM
ISBN
978-3-031-70444-4
ISSN
1865-1348
e-ISSN
1865-1356
Number of pages
10
Pages from-to
406-415
Publisher name
Springer Cham
Place of publication
Cham
Event location
AGH Univ Krakow
Event date
Sep 1, 2024
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
001338400200029

Similar results(10)