Brunel University Research Archive (BURA) >
University >
Publications >

Please use this identifier to cite or link to this item: http://bura.brunel.ac.uk/handle/2438/5643

Title: Automated metamorphic testing on the analyses of feature models
Authors: Segura, S
Hierons, RM
Benavides, D
Ruiz-Cortes, A
Keywords: Metamorphic testing
Test data generation
Mutation testing
Feature models
Automated analysis
Product lines
Publication Date: 2011
Publisher: Elsevier Science BV
Citation: Information and Software Technology, 53(3), 245-258, 2011
Abstract: Context: A feature model (FM) represents the valid combinations of features in a domain. The automated extraction of information from FMs is a complex task that involves numerous analysis operations, techniques and tools. Current testing methods in this context are manual and rely on the ability of the tester to decide whether the output of an analysis is correct. However, this is acknowledged to be time-consuming, error-prone and in most cases infeasible due to the combinatorial complexity of the analyses, this is known as the oracle problem.Objective: In this paper, we propose using metamorphic testing to automate the generation of test data for feature model analysis tools overcoming the oracle problem. An automated test data generator is presented and evaluated to show the feasibility of our approach.Method: We present a set of relations (so-called metamorphic relations) between input FMs and the set of products they represent. Based on these relations and given a FM and its known set of products, a set of neighbouring FMs together with their corresponding set of products are automatically generated and used for testing multiple analyses. Complex FMs representing millions of products can be efficiently created by applying this process iteratively.Results: Our evaluation results using mutation testing and real faults reveal that most faults can be automatically detected within a few seconds. Two defects were found in FaMa and another two in SPLOT, two real tools for the automated analysis of feature models. Also, we show how our generator outperforms a related manual suite for the automated analysis of feature models and how this suite can be used to guide the automated generation of test cases obtaining important gains in efficiency.Conclusion: Our results show that the application of metamorphic testing in the domain of automated analysis of feature models is efficient and effective in detecting most faults in a few seconds without the need for a human oracle.
Description: Copyright © 2010 Elsevier B.V. All rights reserved.
Sponsorship: This work has been partially supported by the European Commission(FEDER)and Spanish Government under CICYT project SETI(TIN2009-07366)and the Andalusian Government project ISABEL(TIC-2533).
URI: http://www.sciencedirect.com/science/article/pii/S0950584910001904
http://bura.brunel.ac.uk/handle/2438/5643
DOI: http://dx.doi.org/10.1016/j.infsof.2010.11.002
ISSN: 0950-5849
Appears in Collections:School of Information Systems, Computing and Mathematics Research Papers
Publications
Computer Science

Files in This Item:

File Description SizeFormat
Fulltext.pdf348.06 kBAdobe PDFView/Open

Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.

 


Library (c) Brunel University.    Powered By: DSpace
Send us your
Feedback. Last Updated: September 14, 2010.
Managed by:
Hassan Bhuiyan