Please use this identifier to cite or link to this item:
http://bura.brunel.ac.uk/handle/2438/14618
Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Fucci, D | - |
dc.contributor.author | Turhan, B | - |
dc.date.accessioned | 2017-05-26T12:09:07Z | - |
dc.date.available | 2014 | - |
dc.date.available | 2017-05-26T12:09:07Z | - |
dc.date.issued | 2014 | - |
dc.identifier.citation | Empirical Software Engineering, 19(2): pp. 277 - 302, (2014) | en_US |
dc.identifier.issn | 1382-3256 | - |
dc.identifier.uri | http://bura.brunel.ac.uk/handle/2438/14618 | - |
dc.description.abstract | Background: Test-Driven Development (TDD) is claimed to have positive effects on external code quality and programmers’ productivity. The main driver for these possible improvements is the tests enforced by the test-first nature of TDD as previously investigated in a controlled experiment (i.e. the original study). Aim: Our goal is to examine the nature of the relationship between tests and external code quality as well as programmers’ productivity in order to verify/ refute the results of the original study. Method: We conducted a differentiated and partial replication of the original setting and the related analyses, with a focus on the role of tests. Specifically, while the original study compared test-first vs. test-last, our replication employed the test-first treatment only. The replication involved 30 students, working in pairs or as individuals, in the context of a graduate course, and resulted in 16 software artifacts developed. We performed linear regression to test the original study’s hypotheses, and analyses of covariance to test the additional hypotheses imposed by the changes in the replication settings. Results: We found significant correlation (Spearman coefficient = 0.66, with p-value = 0.004) between the number of tests and productivity, and a positive regression coefficient (p-value = 0.011). We found no significant correlation (Spearman coefficient = 0.41 with p-value = 0.11) between the number of tests and external code quality (regression coefficient p-value = 0.0513). For both cases we observed no statistically significant interaction caused by the subject units being individuals or pairs. Further, our results are consistent with the original study although there were changes in the timing constraints for finishing the task and the enforced development processes. Conclusions: This replication study confirms the results of the original study concerning the relationship between the number of tests vs. external code quality and programmer productivity. Moreover, this replication allows us to identify additional context variables, for which the original results still hold; namely the subject unit, timing constraint and isolation of test-first process. Based on our findings, we recommend practitioners to implement as many tests as possible in order to achieve higher baselines for quality and productivity. | en_US |
dc.description.sponsorship | This research is supported in part by the Finnish Funding Agency for Technology and Innovation (TEKES) under Cloud Software Program and the Academy of Finland with Grant Decision No. 260871. The authors would like to thank Hakan Erdogmus, Maurizio Morisio and Marco Torchiano for providing valuable insights along with the materials needed to conduct this replication. Authors also acknowledge the anonymous reviewers whose suggestions have significantly improved the earlier versions of the manuscript. | en_US |
dc.format.extent | 277 - 302 | - |
dc.language | English | - |
dc.language.iso | en | en_US |
dc.publisher | Springer | en_US |
dc.subject | Test-driven development | en_US |
dc.subject | Software quality | en_US |
dc.subject | Productivity | en_US |
dc.subject | Software testing | en_US |
dc.subject | Replication | en_US |
dc.title | On the role of tests in test-driven development: a differentiated and partial replication | en_US |
dc.type | Article | en_US |
dc.identifier.doi | http://dx.doi.org/10.1007/s10664-013-9259-7 | - |
dc.relation.isPartOf | Empirical Software Engineering | - |
pubs.notes | interhash: 605ada3f926e8042534ba30063f4db64 intrahash: 34903a082b28b0e9373e646a7ebbfb47 | - |
pubs.volume | 19 | - |
Appears in Collections: | Dept of Computer Science Research Papers |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
FullText.pdf | 5.51 MB | Adobe PDF | View/Open |
Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.