C-Pack of IPAs: A C90 Program Benchmark of Introductory Programming Assignments

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21730%2F24%3A00379759" target="_blank" >RIV/68407700:21730/24:00379759 - isvavai.cz</a>

Výsledek na webu

<a href="https://doi.org/10.1145/3643788.3648010" target="_blank" >https://doi.org/10.1145/3643788.3648010</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1145/3643788.3648010" target="_blank" >10.1145/3643788.3648010</a>

Jazyk výsledku

angličtina

Název v původním jazyce

C-Pack of IPAs: A C90 Program Benchmark of Introductory Programming Assignments

Popis výsledku v původním jazyce

Given the vast number of students enrolled in Massive Open Online Courses (MOOCs), there has been a notable surge in automated program repair techniques tailored for introductory programming assignments (IPAs). These techniques leverage correct student implementations to provide automated, comprehensive, and personalized feedback to the students. This paper presents C-Pack-IPAs, a publicly available benchmark comprising student-program submissions for 25 distinct IPAs. CPack-IPAs contains semantically correct, semantically incorrect, and syntactically incorrect programs, along with a dedicated test suite for each IPA. Hence, C-Pack-IPAs serves as a valuable resource for evaluating the progress of novel automated program repair frameworks, addressing both semantic and syntactic aspects, with a specific focus on providing feedback to novice programmers. Notably, some semantically incorrect programs in C-Pack-IPAs have been manually fixed and annotated with diverse program features, enhancing their utility for the development of various program analysis frameworks. Moreover, we conducted evaluations on C-Pack-IPAs using two leading semantic program repair tools tailored for IPAs, Clara and Verifix.

Název v anglickém jazyce

C-Pack of IPAs: A C90 Program Benchmark of Introductory Programming Assignments

Popis výsledku anglicky

Given the vast number of students enrolled in Massive Open Online Courses (MOOCs), there has been a notable surge in automated program repair techniques tailored for introductory programming assignments (IPAs). These techniques leverage correct student implementations to provide automated, comprehensive, and personalized feedback to the students. This paper presents C-Pack-IPAs, a publicly available benchmark comprising student-program submissions for 25 distinct IPAs. CPack-IPAs contains semantically correct, semantically incorrect, and syntactically incorrect programs, along with a dedicated test suite for each IPA. Hence, C-Pack-IPAs serves as a valuable resource for evaluating the progress of novel automated program repair frameworks, addressing both semantic and syntactic aspects, with a specific focus on providing feedback to novice programmers. Notably, some semantically incorrect programs in C-Pack-IPAs have been manually fixed and annotated with diverse program features, enhancing their utility for the development of various program analysis frameworks. Moreover, we conducted evaluations on C-Pack-IPAs using two leading semantic program repair tools tailored for IPAs, Clara and Verifix.

Druh

D - Stať ve sborníku

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

Výsledek vznikl pri realizaci vícero projektů. Více informací v záložce Projekty.

Návaznosti

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Rok uplatnění

2024

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název statě ve sborníku

ACM/IEEE International Workshop on Automated Program Repair

ISBN

979-8-3503-5302-0

ISSN

—

e-ISSN

—

Počet stran výsledku

8

Strana od-do

14-21

Název nakladatele

Association for Computing Machinery

Místo vydání

New York

Místo konání akce

Lisabon

Datum konání akce

14. 4. 2024

Typ akce podle státní příslušnosti

WRD - Celosvětová akce

Kód UT WoS článku

001310055600004