Please use this identifier to cite or link to this item:
Title: Mutation testing on an object-oriented framework: An experience report
Authors: Segura, S
Hierons, RM
Benavides, D
Ruiz-Cortes, A
Keywords: Mutation testing;Test adequacy;Test data generation;Automated analysis;Feature models
Issue Date: 2011
Publisher: Elsevier
Citation: Information and Software Technology 53(10): 1124 - 1136, Oct 2011
Abstract: Context The increasing presence of Object-Oriented (OO) programs in industrial systems is progressively drawing the attention of mutation researchers toward this paradigm. However, while the number of research contributions in this topic is plentiful, the number of empirical results is still marginal and mostly provided by researchers rather than practitioners. Objective This article reports our experience using mutation testing to measure the effectiveness of an automated test data generator from a user perspective. Method In our study, we applied both traditional and class-level mutation operators to FaMa, an open source Java framework currently being used for research and commercial purposes. We also compared and contrasted our results with the data obtained from some motivating faults found in the literature and two real tools for the analysis of feature models, FaMa and SPLOT. Results Our results are summarized in a number of lessons learned supporting previous isolated results as well as new findings that hopefully will motivate further research in the field. Conclusion We conclude that mutation testing is an effective and affordable technique to measure the effectiveness of test mechanisms in OO systems. We found, however, several practical limitations in current tool support that should be addressed to facilitate the work of testers. We also missed specific techniques and tools to apply mutation testing at the system level.
Description: This is the preprint version of the article - Copyright @ 2011 Elsevier
ISSN: 0950-5849
Appears in Collections:Publications
Computer Science
Dept of Computer Science Research Papers

Files in This Item:
File Description SizeFormat 
segura10-IST_final.pdf418.51 kBAdobe PDFView/Open

Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.