On the Effectiveness of Combinatorial Interaction Testing: A Case Study

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21230%2F17%3A00315774" target="_blank" >RIV/68407700:21230/17:00315774 - isvavai.cz</a>

Result on the web

<a href="http://ieeexplore.ieee.org/document/8004296/keywords" target="_blank" >http://ieeexplore.ieee.org/document/8004296/keywords</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1109/QRS-C.2017.20" target="_blank" >10.1109/QRS-C.2017.20</a>

Result language

angličtina

Original language name

On the Effectiveness of Combinatorial Interaction Testing: A Case Study

Original language description

Combinatorial interaction testing (CIT) stands as one of the efficient testing techniques that have been used in different applications recently. The technique is useful when there is a need to take the interaction of input parameters into consideration for testing a system. The key insight the technique is that not every single parameter may contribute to the failure of the system and there could be interactions among these parameters. Hence, there must be combinations of these input parameters based on the interaction strength. This technique has been used in many applications to assess its effectiveness. In this paper, we are addressing the effectiveness of CIT for a real-world case study using model-based mutation testing experiments. The contribution of the paper is threefold: First we introduce an effective testing application for CIT; Second, we address the effectiveness of increasing the interaction strength beyond the pairwise (i.e., interaction of more than two parameters); Third, model-based mutation testing is used to mutate the input model of the program in contrast to the traditional code-based mutation testing process. Experimental results showed that CIT is an effective testing technique for this kind of application. In addition, the results also showed the usefulness of model-based mutation testing to assess CIT applications. For the subject of this case study, the results also indicate that 3-way test suite (i.e., interaction of three parameters) could detect new faults that can not be detected by pairwise.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year

2017

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

Proceedings of 2017 IEEE International Conference on Software Quality, Reliability and Security Companion

ISBN

978-1-5386-2072-4

ISSN

—

e-ISSN

—

Number of pages

8

Pages from-to

69-76

Publisher name

IEEE Reliability Society

Place of publication

—

Event location

Praha

Event date

Jul 25, 2017

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

000426819400010