C-Pack of IPAs: A C90 Program Benchmark of Introductory Programming Assignments

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21730%2F24%3A00379759" target="_blank" >RIV/68407700:21730/24:00379759 - isvavai.cz</a>

Result on the web

<a href="https://doi.org/10.1145/3643788.3648010" target="_blank" >https://doi.org/10.1145/3643788.3648010</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1145/3643788.3648010" target="_blank" >10.1145/3643788.3648010</a>

Result language

angličtina

Original language name

C-Pack of IPAs: A C90 Program Benchmark of Introductory Programming Assignments

Original language description

Given the vast number of students enrolled in Massive Open Online Courses (MOOCs), there has been a notable surge in automated program repair techniques tailored for introductory programming assignments (IPAs). These techniques leverage correct student implementations to provide automated, comprehensive, and personalized feedback to the students. This paper presents C-Pack-IPAs, a publicly available benchmark comprising student-program submissions for 25 distinct IPAs. CPack-IPAs contains semantically correct, semantically incorrect, and syntactically incorrect programs, along with a dedicated test suite for each IPA. Hence, C-Pack-IPAs serves as a valuable resource for evaluating the progress of novel automated program repair frameworks, addressing both semantic and syntactic aspects, with a specific focus on providing feedback to novice programmers. Notably, some semantically incorrect programs in C-Pack-IPAs have been manually fixed and annotated with diverse program features, enhancing their utility for the development of various program analysis frameworks. Moreover, we conducted evaluations on C-Pack-IPAs using two leading semantic program repair tools tailored for IPAs, Clara and Verifix.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

Result was created during the realization of more than one project. More information in the Projects tab.

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Publication year

2024

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

ACM/IEEE International Workshop on Automated Program Repair

ISBN

979-8-3503-5302-0

ISSN

—

e-ISSN

—

Number of pages

8

Pages from-to

14-21

Publisher name

Association for Computing Machinery

Place of publication

New York

Event location

Lisabon

Event date

Apr 14, 2024

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

001310055600004