Comparative Analysis of Chatbots Using Large Language Models for Web Development Tasks

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F61989100%3A27230%2F24%3A10255960" target="_blank" >RIV/61989100:27230/24:10255960 - isvavai.cz</a>

Výsledek na webu

<a href="https://www.mdpi.com/2076-3417/14/21/10048" target="_blank" >https://www.mdpi.com/2076-3417/14/21/10048</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.3390/app142110048" target="_blank" >10.3390/app142110048</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Comparative Analysis of Chatbots Using Large Language Models for Web Development Tasks

Popis výsledku v původním jazyce

In this study, we compare the performance of five chatbots using large language models (LLMs) in handling web development tasks. Three human testers asked each chatbot nine predefined questions related to creating a simple website with a dynamic form and database integration. The questions covered tasks such as generating a web document structure, designing a layout, creating a form, and implementing database queries. The chatbots&apos; outputs were ranked based on accuracy, completeness, creativity, and security. The experiment reveals that conversational chatbots are adept at managing complex tasks, while programming assistants require more precisely formulated tasks or the ability to generate new responses to address irrelevant outputs. The findings suggest that conversational chatbots are more capable of handling a broader range of web development tasks with minimal supervision, whereas programming assistants need more precise task definitions to achieve comparable results. This study contributes to understanding the strengths and limitations of various LLM-based chatbots in practical coding scenarios, offering insights for their application in web development.

Název v anglickém jazyce

Comparative Analysis of Chatbots Using Large Language Models for Web Development Tasks

Popis výsledku anglicky

In this study, we compare the performance of five chatbots using large language models (LLMs) in handling web development tasks. Three human testers asked each chatbot nine predefined questions related to creating a simple website with a dynamic form and database integration. The questions covered tasks such as generating a web document structure, designing a layout, creating a form, and implementing database queries. The chatbots&apos; outputs were ranked based on accuracy, completeness, creativity, and security. The experiment reveals that conversational chatbots are adept at managing complex tasks, while programming assistants require more precisely formulated tasks or the ability to generate new responses to address irrelevant outputs. The findings suggest that conversational chatbots are more capable of handling a broader range of web development tasks with minimal supervision, whereas programming assistants need more precise task definitions to achieve comparable results. This study contributes to understanding the strengths and limitations of various LLM-based chatbots in practical coding scenarios, offering insights for their application in web development.

Druh

J_imp - Článek v periodiku v databázi Web of Science

CEP obor

—

OECD FORD obor

20301 - Mechanical engineering

Projekt

—

Návaznosti

S - Specificky vyzkum na vysokych skolach

Rok uplatnění

2024

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

Applied Sciences

ISSN

2076-3417

e-ISSN

2076-3417

Svazek periodika

14

Číslo periodika v rámci svazku

21

Stát vydavatele periodika

CH - Švýcarská konfederace

Počet stran výsledku

16

Strana od-do

—

Kód UT WoS článku

001350975200001

EID výsledku v databázi Scopus

2-s2.0-85208599764