Evaluating the Impact of Combinatorial Interaction Testing on Test Automation: A Case Study from Industry

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21230%2F25%3A00384431" target="_blank" >RIV/68407700:21230/25:00384431 - isvavai.cz</a>

Result on the web

<a href="https://doi.org/10.1007/978-3-031-75201-8_7" target="_blank" >https://doi.org/10.1007/978-3-031-75201-8_7</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1007/978-3-031-75201-8_7" target="_blank" >10.1007/978-3-031-75201-8_7</a>

Result language

angličtina

Original language name

Evaluating the Impact of Combinatorial Interaction Testing on Test Automation: A Case Study from Industry

Original language description

Software testing regularly involves numerous setups and user inputs, leading to a combinatorial explosion of test cases. While Combinatorial Interaction Testing (CIT) has been theoretically investigated, its effectiveness in real-world scenarios remains unclear [1]. This research fills that gap by utilizing CIT in some live software projects. We led two studies: the first focuses on optimizing user input testing in jTrac, and the second focused on managing system configurations in Redmine, a comparative web application. We looked at CIT to customary testing strategies, breaking down components like test design time, test automation, test execution, suite size, and defect detection. The investigation gave valuable insights into enhancing CIT execution and reception. The results are promising. With CIT, the number of required test cases is significantly reduced, but at the same time, defect detection is improved. In the first study, the average time to detect a defect was 1.40 h (design, automation, execution, and evaluation) compared to 0.35 hwith CIT. Similar patterns emerged in the second study. These findings have important implications for both researchers and organizations. They highlight CIT's promise for software testing, including decreasing test case burden and perhaps improving defect detection rates. This study provides practical evidence for organizations and testers looking to improve their testing procedures.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year

2025

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

Communications in Computer and Information Science

ISBN

978-3-031-75200-1

ISSN

1865-0929

e-ISSN

1865-0937

Number of pages

15

Pages from-to

85-99

Publisher name

Springer

Place of publication

Wien

Event location

San Diego

Event date

Oct 21, 2024

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

001441619700007