Evaluating the Impact of Combinatorial Interaction Testing on Test Automation: A Case Study from Industry

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21230%2F25%3A00384431" target="_blank" >RIV/68407700:21230/25:00384431 - isvavai.cz</a>

Výsledek na webu

<a href="https://doi.org/10.1007/978-3-031-75201-8_7" target="_blank" >https://doi.org/10.1007/978-3-031-75201-8_7</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1007/978-3-031-75201-8_7" target="_blank" >10.1007/978-3-031-75201-8_7</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Evaluating the Impact of Combinatorial Interaction Testing on Test Automation: A Case Study from Industry

Popis výsledku v původním jazyce

Software testing regularly involves numerous setups and user inputs, leading to a combinatorial explosion of test cases. While Combinatorial Interaction Testing (CIT) has been theoretically investigated, its effectiveness in real-world scenarios remains unclear [1]. This research fills that gap by utilizing CIT in some live software projects. We led two studies: the first focuses on optimizing user input testing in jTrac, and the second focused on managing system configurations in Redmine, a comparative web application. We looked at CIT to customary testing strategies, breaking down components like test design time, test automation, test execution, suite size, and defect detection. The investigation gave valuable insights into enhancing CIT execution and reception. The results are promising. With CIT, the number of required test cases is significantly reduced, but at the same time, defect detection is improved. In the first study, the average time to detect a defect was 1.40 h (design, automation, execution, and evaluation) compared to 0.35 hwith CIT. Similar patterns emerged in the second study. These findings have important implications for both researchers and organizations. They highlight CIT's promise for software testing, including decreasing test case burden and perhaps improving defect detection rates. This study provides practical evidence for organizations and testers looking to improve their testing procedures.

Název v anglickém jazyce

Evaluating the Impact of Combinatorial Interaction Testing on Test Automation: A Case Study from Industry

Popis výsledku anglicky

Software testing regularly involves numerous setups and user inputs, leading to a combinatorial explosion of test cases. While Combinatorial Interaction Testing (CIT) has been theoretically investigated, its effectiveness in real-world scenarios remains unclear [1]. This research fills that gap by utilizing CIT in some live software projects. We led two studies: the first focuses on optimizing user input testing in jTrac, and the second focused on managing system configurations in Redmine, a comparative web application. We looked at CIT to customary testing strategies, breaking down components like test design time, test automation, test execution, suite size, and defect detection. The investigation gave valuable insights into enhancing CIT execution and reception. The results are promising. With CIT, the number of required test cases is significantly reduced, but at the same time, defect detection is improved. In the first study, the average time to detect a defect was 1.40 h (design, automation, execution, and evaluation) compared to 0.35 hwith CIT. Similar patterns emerged in the second study. These findings have important implications for both researchers and organizations. They highlight CIT's promise for software testing, including decreasing test case burden and perhaps improving defect detection rates. This study provides practical evidence for organizations and testers looking to improve their testing procedures.

Druh

D - Stať ve sborníku

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

—

Návaznosti

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Rok uplatnění

2025

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název statě ve sborníku

Communications in Computer and Information Science

ISBN

978-3-031-75200-1

ISSN

1865-0929

e-ISSN

1865-0937

Počet stran výsledku

15

Strana od-do

85-99

Název nakladatele

Springer

Místo vydání

Wien

Místo konání akce

San Diego

Datum konání akce

21. 10. 2024

Typ akce podle státní příslušnosti

WRD - Celosvětová akce

Kód UT WoS článku

001441619700007