Brunel University Research Archive (BURA) >
University >
Publications >

Please use this identifier to cite or link to this item:

Title: Mutation testing on an object-oriented framework: An experience report
Authors: Segura, S
Hierons, RM
Benavides, D
Ruiz-Cortes, A
Keywords: Mutation testing
Test adequacy
Test data generation
Automated analysis
Feature models
Publication Date: 2011
Publisher: Elsevier
Citation: Information and Software Technology 53(10): 1124 - 1136, Oct 2011
Abstract: Context The increasing presence of Object-Oriented (OO) programs in industrial systems is progressively drawing the attention of mutation researchers toward this paradigm. However, while the number of research contributions in this topic is plentiful, the number of empirical results is still marginal and mostly provided by researchers rather than practitioners. Objective This article reports our experience using mutation testing to measure the effectiveness of an automated test data generator from a user perspective. Method In our study, we applied both traditional and class-level mutation operators to FaMa, an open source Java framework currently being used for research and commercial purposes. We also compared and contrasted our results with the data obtained from some motivating faults found in the literature and two real tools for the analysis of feature models, FaMa and SPLOT. Results Our results are summarized in a number of lessons learned supporting previous isolated results as well as new findings that hopefully will motivate further research in the field. Conclusion We conclude that mutation testing is an effective and affordable technique to measure the effectiveness of test mechanisms in OO systems. We found, however, several practical limitations in current tool support that should be addressed to facilitate the work of testers. We also missed specific techniques and tools to apply mutation testing at the system level.
Description: This is the preprint version of the article - Copyright @ 2011 Elsevier
Sponsorship: This work has been partially supported by the European Commission (FEDER) and Spanish Government under CICYT Project SETI (TIN2009-07366) and the Andalusian Government Projects ISABEL (TIC-2533) and THEOS (TIC-5906).
ISSN: 0950-5849
Appears in Collections:Publications
Computer Science
Dept of Computer Science Research Papers

Files in This Item:

File Description SizeFormat
segura10-IST_final.pdf418.51 kBAdobe PDFView/Open

Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.