Abstract
Systematic software reuse is proposed to increase productivity and software quality and lead to economic benefits. Reports of successful software reuse programs in industry have been published. However, there has been little effort to organize the evidence systematically and appraise it. This review aims to assess the effects of software reuse in industrial contexts. Journals and major conferences between 1994 and 2005 were searched to find observational studies and experiments conducted in industry, returning eleven papers of observational type. Systematic software reuse is significantly related to lower problem (defect, fault or error) density in five studies and to decreased effort spent on correcting problems in three studies. The review found evidence for significant gains in apparent productivity in three studies. Other significant benefits of software reuse were reported in single studies or the results were inconsistent. Evidence from industry is sparse and combining results was done by vote-counting. Researchers should pay more attention to using comparable metrics, performing longitudinal studies, and explaining the results and impact on industry. For industry, evaluating reuse of COTS or OSS components, integrating reuse activities in software processes, better data collection and evaluating return on investment are major challenges.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Baldassarre MT, Bianch A, Caivano D, Vissaggio G (2005) An industrial case study on reuse oriented development. In: Proc. 21st IEEE Int’l Conf. on Software Maintenance (ICSM’05), pp 283–292
Basili VR (1990) Viewing maintenance as reuse-oriented software development. IEEE Softw 7(1):19–25
Basili VR, Briand LC, Melo WL (1996) How software reuse influences productivity in object-oriented systems. Commun ACM 39(10):104–116
Birk A, Dingsøyr T, Stålhane T (2002) Postmortem: never leave a project without it. IEEE Softw 19(3):43–45
Boehm B, Brown W, Madachy R, Yang Y (2004) Software product line cycle cost estimation model. In: Proc. 2004 ACM-IEEE Int’l Symposium on Empirical Software Engineering (ISESE’04), pp 156–164
Conradi R, Li J, Slyngstad OPN, Kampenes VB, Bunse C, Morisio M, Torchiano M (2005) Reflections on conducting an international survey of Software Engineering. In: Proc. 4th International Symposium on Empirical Software Engineering (ISESE’05), pp 214–223
Coverty http://scan.coverity.com/, visited in April 2006
Dedrick J, Gurbaxani V, Kraemer KL (2003) Information technology and economic performance: a critical review of the empirical evidence. ACM Comput Surv 35(1):1–28
Dybå T, Kitchenham BA, Jørgensen M (2005) Evidence-based software engineering for practitioners. IEEE Softw 22(1):58–65
Dybå T, Kampenes VB, Sjøberg D (2006) A systematic review of statistical power in software engineering experiments. Inf Softw Technol 48(8):745–755
Fenton N, Krause P, Neil M (2002) Software measurement: uncertainty and causal modeling. IEEE Softw 19(4):116–122
Fitzgerald B, Kenny T (2004) Developing an information system infrastructure with open source software. IEEE Softw 21(1):50–55
Frakes WB, Kang K (2005) Software reuse research: status and future. IEEE Trans Softw Eng 31(7):529–536
Frakes WB, Succi G (2001) An industrial study of reuse, quality and productivity. J Syst Softw 57(2001):99–106
Frakes WB, Terry C (1996) Software reuse: metrics and models. ACM Comput Surv 28(2):415–435
Gigerenzer G (2004) Mindless statistics. J Socio-Econ 33(2004):587–606
Glass RL (1997) Telling good numbers from bad ones. IEEE Softw 14(4):15–16, 19
Glass RL (2002) In search of meaning (a tale of two words). IEEE Softw 19(4):136, 134–135
Gregor S (2002) A theory of theories in information science. In: Gregor S, Hart D (eds) Information systems foundations: building the theoretical base. Australian National University, Canberra, pp 1–20
Hallsteinsen S, Paci M (eds) (1997) Experiences in software evolution and reuse. Springer
Karlsson E-A (ed) (1995) Software reuse, a holistic approach. John Wiley & Sons
Kitchenham BA (2004) Procedures for performing systematic reviews. Joint technical report, Keele University Technical Report TR/SE-0401 and National ICT Australia Technical Report 0400011T.1
Kitchenham BA, Pickard LM (1998) Evaluating software eng. methods and tools—part 10: designing and running a quantitative case study. ACM Sigsoft Softw Eng Notes 23(3):20–22
Kitchenham BA, Pfleeger SL, Hoaglin DC, El Emam K, Rosenberg J (2002) Preliminary guidelines for empirical research in software engineering. IEEE Trans Softw Eng 28(8):721–734
Krueger C (2002) Eliminating the adoption barrier. IEEE Softw 19(4):29–31
Lee AS, Baskerville RL (2003) Generalizing generalizability in information systems research. Inf Syst Res 14(3):221–243
Li M, Smidts CS (2003) A ranking of software engineering measures based on expert opinion. IEEE Trans Softw Eng 29(9):811–824
Lim WC (1994) Effect of reuse on quality, productivity and economics. IEEE Softw 11(5):23–30
Lim WC (1996) Reuse economics: a comparison of seventeen models and directions for future research. In: Proc. 4th Int’l Conf. on Software Reuse (ICSR’96), pp 41–50
Madanmohan TR, Dé R (2004) Open source reuse in commercial firms. IEEE Softw 21(6):62–69
Mohagheghi P, Conradi R (2006) Vote-counting for combining quantitative evidence from empirical studies—an example. In: Proc. 5th ACM-IEEE Int’l Symposium on Empirical Software Engineering (ISESE’06), pp 24–26
Mohagheghi P, Conradi R (2007) An empirical investigation of software reuse benefits in a large telecom product. ACM Transactions of Software Engineering Methodology (TOSEM) (in press)
Mohagheghi P, Conradi R, Killi OM, Schwarz H (2004) An empirical study of software reuse vs. defect-density and stability. In: Proc. 26th Int’l Conf. on Software Engineering (ICSE’04), pp 282–292
Mohagheghi P, Conradi R, Børretzen JA (2006) Revisiting the problem of using problem reports for quality assessment. In: Proc. 6th Workshop on Software Quality (WoSQ’06)—as part of Proc. 28th International Conference on Software Engineering & Co-Located Workshops, pp 45–50
Morad S, Kuflik T (2005) Conventional and open source software reuse at Orbotech—an industrial experience. In: Proc. IEEE Int’l Conf. on Software-Science, Technology & Engineering (SwSTE’05), 8 p
Morisio M, Tully C, Ezran M (2000) Diversity in reuse processes. IEEE Softw 17(4):56–63
Morisio M, Romano D, Stamelos I (2002) Quality, productivity, and learning in framework-based development: an exploratory case study. IEEE Trans Softw Eng 28(9):876–888
Norris JS (2004) Mission-critical development with open source software: lessons learned. IEEE Softw 21(1):42–49
Pfleeger SH (1996) When the pursuit of quality destroys value. IEEE Softw 13(3):93–95
Pfleeger SH (2005) Soup or art? The role of evidential force in empirical software engineering. IEEE Softw 22(1):66–73
Pickard LM, Kitchenham BA, Jones PW (1998) Combining empirical results in software engineering. Inf Softw Technol 40(1998):811–821
Ramachandran M, Fleischer W (1996) Design for large scale software reuse: an industrial case study. Proc. 4th Int’l Conf. on Software Reuse (ICSR’96), pp 104–111
Schneidewind NF (1992) Methodology for validating software metrics. IEEE Trans Softw Eng 18(5):410–422
Selby W (2005) Enabling reuse-based software development of large-scale systems. IEEE Trans Softw Eng 31(6):495–510
SEVO (2006) http://www.idi.ntnu.no/grupper/su/sevo/index.html
Shadish WR, Cook TD, Campbell DT (2001) Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin Company
Sommerseth M (2006) Component based system development in the Norwegian software industry. NTNU master thesis. http://www.idi.ntnu.no/grupper/su/su-diploma-2006/sommerseth-dipl06.pdf
Succi G, Benedicenti L, Vernazza T (2001) Analysis of the effects of software reuse on customer satisfaction in an RPG environment. IEEE Trans Softw Eng 27(5):473–479
Szyperski C (with Gruntz D, Murer S) (2002) Component software, beyond object-oriented programming, 2nd edn. Addison Wesley
Thomas WM, Delis A, Basili VR (1997) An analysis of errors in a reuse-oriented development environment. J Syst Softw 38(3):211–224
Tomer A, Goldin L, Kuflik T, Kimchi E, Schach SR (2004) Evaluating software reuse alternatives: a model and its application to an industrial case study. IEEE Trans Softw Eng 30(9):601–612
Wang C (1993) Sense and nonsense of statistical inference: controversy, misuse, and subtlety. Marcel Dekker
Webster J, Watson RT (2002) Analyzing the past to prepare for the future: writing a literature review. MIS Quarterly 26(2):xiii–xxiii
Wohlin C, Runeseon P, Höst M, Ohlsson MC, Regnell B, Wesslén A (2000) Experimentation in software engineering. Kluwer
Yin RK (2003) Case study research, design and methods. Sage
Zannier C, Melnik G, Maurer F (2006) On the success of empirical studies in the International Conference on Software Engineering. In: Proc. 28th Int’l Conf. on Software Engineering (ICSE’06), pp 341–350
Zelkowitz MV, Wallace DR (1998) Experimental models for validating technology. IEEE Computer 31(5):23–31
Zhang W, Jarzabek S (2005) Reuse without compromising performance: industrial experience from RPG software product line for mobile devices. In: Proc. 9th Int’l Software Product Line Conf. (SPLC’05), pp 57–69
Acknowledgement
This review was done in the SEVO (Software EVOlution in component-based software engineering) project (SEVO 2006), which is a Norwegian R&D project for 2004–2008 with contract number 159916/V30. We thank Marco Torchiano for his comments on the first version of this review. We also thank the anonymous reviewers for their valuable comments and suggestions.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix
Appendix
Appendix
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Mohagheghi, P., Conradi, R. Quality, productivity and economic benefits of software reuse: a review of industrial studies. Empir Software Eng 12, 471–516 (2007). https://doi.org/10.1007/s10664-007-9040-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10664-007-9040-x