Comparative Analysis of Chatbots Using Large Language Models for Web Development Tasks

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F61989100%3A27230%2F24%3A10255960" target="_blank" >RIV/61989100:27230/24:10255960 - isvavai.cz</a>

Result on the web

<a href="https://www.mdpi.com/2076-3417/14/21/10048" target="_blank" >https://www.mdpi.com/2076-3417/14/21/10048</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.3390/app142110048" target="_blank" >10.3390/app142110048</a>

Result language

angličtina

Original language name

Comparative Analysis of Chatbots Using Large Language Models for Web Development Tasks

Original language description

In this study, we compare the performance of five chatbots using large language models (LLMs) in handling web development tasks. Three human testers asked each chatbot nine predefined questions related to creating a simple website with a dynamic form and database integration. The questions covered tasks such as generating a web document structure, designing a layout, creating a form, and implementing database queries. The chatbots&apos; outputs were ranked based on accuracy, completeness, creativity, and security. The experiment reveals that conversational chatbots are adept at managing complex tasks, while programming assistants require more precisely formulated tasks or the ability to generate new responses to address irrelevant outputs. The findings suggest that conversational chatbots are more capable of handling a broader range of web development tasks with minimal supervision, whereas programming assistants need more precise task definitions to achieve comparable results. This study contributes to understanding the strengths and limitations of various LLM-based chatbots in practical coding scenarios, offering insights for their application in web development.

Czech name

—

Czech description

—

Type

J_imp - Article in a specialist periodical, which is included in the Web of Science database

CEP classification

—

OECD FORD branch

20301 - Mechanical engineering

Project

—

Continuities

S - Specificky vyzkum na vysokych skolach

Publication year

2024

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Name of the periodical

Applied Sciences

ISSN

2076-3417

e-ISSN

2076-3417

Volume of the periodical

14

Issue of the periodical within the volume

21

Country of publishing house

CH - SWITZERLAND

Number of pages

16

Pages from-to

—

UT code for WoS article

001350975200001

EID of the result in the Scopus database

2-s2.0-85208599764