article

A qualitative study of DevOps usage in practice

Authors:

F. M. A. Erich,

M. DanevaAuthors Info & Claims

Journal of Software: Evolution and Process, Volume 29, Issue 6

Page n/a

https://doi.org/10.1002/smr.1885

Published: 01 June 2017 Publication History

Abstract

Organizations are introducing agile and lean software development techniques in operations to increase the pace of their software development process and to improve the quality of their software. They use the term DevOps, a portmanteau of development and operations, as an umbrella term to describe their efforts. In this paper, we describe the ways in which organizations implement DevOps and the outcomes they experience. We first summarize the results of a systematic literature review that we performed to discover what researchers have written about DevOps. We then describe the results of an exploratory interview-based study involving 6 organizations of various sizes that are active in various industries. As part of our findings, we observed that all organizations were positive about their experiences and only minor problems were encountered while adopting DevOps.

References

[1]

Susarla A, Barua A, Whinston AB. A transaction cost perspective of the" software as a service" business model. J Manage Inf Syst. 2009 ;Volume 26 Issue 2: pp.205-240.

[2]

Fox A, Patterson D. Engineering software as a service: An agile approach using cloud computing. India: Strawberry Canyon LLC; 2014.

[3]

Dyck A, Penners R, Lichter H. Towards Definitions for Release Engineering and Devops. In: Proceedings of the IEEE/ACM 3rd International Workshop on Release Engineering, Florence: 2015 :Volume 3.

[4]

Debois. Opening Statement. Cutter IT J. 2011 ;Volume 24 Issue 8: pp.3-5.

[5]

Bass L, Weber I, Zhu L. Devops: A software architect's perspective. New Jersey: Addison-Wesley Professional; 2015.

[6]

Rowe M, Marshall P. The business case for collaborative devops. Available from: "https://www.ibm.com/developerworks/mydeveloperworks/blogs/invisiblethread/entry/the_business_case_for_collaborative_devops"; 2012; Accessed June 13, 2017.

[7]

Loukides M. What is DevOps?. Sebastopol, CA: O'Reilly Media; 2012.

[8]

Allspaw J. 10+ Deploys Per Day: Dev and Ops Cooperation at Flickr. "http://www.slideshare.net/jallspaw/10-deploys-per-day-dev-and-ops-cooperation-at-flickr/"; 2009; Accessed February 21, 2016.

[9]

Rembetsy M, McDonnell P. Continuously deploying culture: Scaling culture at etsy. "http://www.slideshare.net/mcdonnps/continuously-deploying-culture-scaling-culture-at-etsy-14588485"; 2012; Accessed March 11, 2016.

[10]

Erich F, Amrit C, Daneva M. Cooperation between information system development and operations: A literature review. In: Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement; Torino 2014: pp.69.

[11]

Erich F, Amrit C, Daneva M. A mapping study on cooperation between information system development and operations. In: Proceedings of the 15th International Conference on Product-Focused Software Process Improvement, Lecture Notes in Computer Science, Helsinki, vol. 8892. Berlin: Springer; 2014: pp.277-280.

[12]

Erich F, Amrit C, Daneva M. Technical Report of the University of Twente. Available from: "http://www.utwente.nl/mb/iebis/staff/amrit/devopsreport.pdf"; 2014; Accessed June 13, 2017.

[13]

Cruzes DS, Dyba T. Recommended steps for thematic synthesis in software engineering. In: Proceedings of the 5th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, Banff; 2011: pp.275-284.

Digital Library

[14]

Petersen K, Feldt R, Mujtaba S, Mattsson M. Systematic mapping studies in software engineering. In: Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering, Bari; 2008: pp.68-77.

[15]

Charmaz K. Constructing Grounded Theory Introducing Qualitative Methods Series. 2nd ed.Thousand Oaks: SAGE Publications; 2014.

[16]

Merton RK, Kendall PL. The Focused Interview. Am J Sociology. 1946 ;Volume 51 Issue 6: pp.541-557.

[17]

Kvale S. Doing Interviews. Thousand Oaks: SAGE Publications, Inc; 2008.

[18]

Yin RK. Case Study Research: Design and Methods Applied Social Research Methods. 4th ed.Thousand Oaks: Sage Publications; 2008.

[19]

Glaser BG, Strauss AL. The Discovery of Grounded Theory: Strategies for Qualitative Research. New York, NY: Aldine de Gruyter; 1967.

[20]

XMind. Xmind mind mapping software. Available from: "http://www.xmind.net/". Accessed June 13, 2017

[21]

Bang SK, Chung S, Choh Y, Dupuis M. A grounded theory analysis of modern web applications: Knowledge, skills, and abilities for DevOps. In: Proceedings of the 2nd Annual Conference on Research in Information Technology; 2013; Orlando, FL: pp.61-62.

[22]

Hosono S, Shimomura Y. Application lifecycle kit for mass customization on PaaS platforms. In: Proceedings - 2012 IEEE 8th World Congress on Services 2012; 2012; Honolulu, HI: pp.397-398.

Digital Library

[23]

Cukier D. DevOps patterns to scale web applications using cloud services. In: Proceedings of the 2013 Companion Publication for Conference on Systems, Programming, & Applications: Software for Humanity, <bookSeriesTitle>Proceedings - SPLASH '13</bookSeriesTitle>; 2013; Indianapolis, Indiana, USA: pp.143-152.

[24]

Ambler SW. Disciplined agile delivery and collaborative DevOps. Cutter IT J. 2011 ;Volume 24 Issue 12: pp.18-23.

[25]

Spinellis D. Don't install software by hand. IEEE Softw. 2012 ;Volume 29 Issue 4: pp.86-87.

[26]

Phifer B. Next-generation process integration: CMMI and ITIL do DevOps. Cutter IT J. 2011 ;Volume 24 Issue 8: pp.28-33.

[27]

Feitelson DG, Frachtenberg E, Beck KL. Development and deployment at Facebook. IEEE Internet Comput. 2013 ;Volume 17 Issue 4: pp.8-17.

[28]

DeGrandis D. Devops: So you say you want a revolution?. Cutter IT J. 2011 ;Volume 24 Issue 8: pp.34-39.

[29]

Fitzpatrick L, Dillon M. The business case for DevOps: A five-year retrospective. Cutter IT J. 2011 ;Volume 24 Issue 8: pp.19-27.

[30]

Humble J, Molesky J. Why enterprises must adopt DevOps to enable continuous delivery. Cutter IT J. 2011 ;Volume 24 Issue 8: pp.6-12.

[31]

Walls M. Building a DevOps Culture. Sebastopol, CA: O'Reilly Media; 2013.

[32]

Roche J. Adopting DevOps practices in Quality Assurance. Commun ACM. 2013 ;Volume 56 Issue 11: pp.38-43.

[33]

Shamow E. DevOps at advance internet: How we got in the door. Cutter IT J. 2011 ;Volume 24 Issue 8: pp.13-18.

[34]

Akerele O, Ramachandran M, Dixon M. System dynamics modelling of agile continuous delivery process. In: Proceedings of the 2013 Agile Conference, Nashville; 2013: pp.60-63.

[35]

Corbin RD, Dunbar CB, Zhu Q. A three-tier knowledge management scheme for software engineering support and innovation. J Syst Softw. 2007 ;Volume 80 Issue 9: pp.1494-1505.

[36]

Mueller E. DevOps and the people who practice it: Winning their hearts and minds. Cutter IT J. 2011 ;Volume 24 Issue 12: pp.6-11.

[37]

Neely S, Stolt S. Continuous delivery? easy! just change everything well, maybe it is not that easy. In: Proceedings of the 2013 Agile Conference, Nashville; 2013: pp.121-128.

[38]

Tessem B, Iden J. Cooperation between developers and operations in software engineering projects. In: Proceedings of the 2008 International Conference on Software Engineering, Leipzig; 2008: pp.105-108.

[39]

Le-Quoc A. Metrics-driven DevOps. Cutter IT J. 2011 ;Volume 24 Issue 12: pp.24-29.

[40]

Stuckenberg S, Fielt E, Loser T. The impact of software-as-a-service on business models of leading software vendors: Experiences from three exploratory case studies. In: Proceedings of the 15th Pacific Asia Conference on Information Systems: Quality Research in Pacific, Brisbane; 2011 :184.

[41]

Schaefer A, Reichenbach M, Fey D. Continuous integration and automation for DevOps. Transactions on Engineering Technologies, Vol.170 of the series Lecture Notes in Electrical Engineering. 2012; pp.345-358.

[42]

Shang W. Bridging the divide between software developers and operators using logs. In: Proceedings of the 2013 International Conference on Software Engineering, Zuerich; 2013: pp.1583-1586.

[43]

Gohil K, Alapati N, Joglekar S. Towards behavior driven operations BDOps. In: Proceedings of the 2011 International Conference on Advances in Recent Technologies in Communication and Computing; 2011; Bangalore: pp.262-264.

[44]

Keyworth B. Where is IT operations within DevOps?. Cutter IT J. 2011 ;Volume 24 Issue 12: pp.12-17.

[45]

Bass L, Jeffery R, Wada H, Weber I, Zhu L. Eliciting operations requirements for applications. In: Proceedings of the 1st International Workshop on Release Engineering, RELENG 2013; 2013; San Francisco, CA: pp.5-8.

[46]

Bahrs P. Adopting the IBM DevOps approach for continuous software delivery; 2013 "https://www.ibm.com/developerworks/library/d-adoption-paths/index.html"; Accessed on 22nd February 2016

[47]

Raymond ES. The Cathedral & the Bazaar. Sebastopol: O'Reilly Media; 1999.

[48]

Miles MB, Huberman AM. Qualitative Data Analysis. 2nd ed.Thousand Oaks: SAGE Publications, Inc; 1994.

[49]

Willis J. What devops means to me. "http://www.slideshare.net/ jezhumble/devops-and-agile-release-management"; 2010. Accessed February 22, 2016

[50]

Humble J. DevOps and Agile Release Management. "http://www.slideshare.net/ jezhumble/devops-and-agile-release-management"; 2010. Accessed February 22, 2016

[51]

Lwakatare L, Kuvaja P, Oivo M. Dimensions of devops. In: Proceedings of the 2015 XP Conference Helsinki; 2015: pp.212-217.

[52]

Wieringa R. Design Science Methodology for Information Systems and Software Engineering. Berlin: Springer; 2014.

[53]

Kitchenham B, Charters S. Guidelines for performing Systematic Literature Reviews in Software Engineering; Jul 2007.

[54]

<familyNamePrefix>van</familyNamePrefix>Steenis M, Verschure R, Zschuschen E. Radicale versnelling van het software voortbrengingsproces door middel van continuous delivery; 2014. Available from: "https://xebia.com/downloads/ continuous-delivery-andagile-transformations-dutch-only.pdf". Accessed February 22, 2016

Cited By

Azad NHyrynsalmi S(2024)Multivocal Literature Review on DevOps Critical Success FactorsProceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering10.1145/3661167.3661236(520-527)Online publication date: 18-Jun-2024
https://dl.acm.org/doi/10.1145/3661167.3661236
Bedekar MMussbacher GCombemale BWimmer MChechik MEgyed A(2024)A Multi-Platform Specification Language and Dataset for the Analysis of DevOps PipelinesProceedings of the ACM/IEEE 27th International Conference on Model Driven Engineering Languages and Systems10.1145/3652620.3686247(264-274)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3652620.3686247
Bosch J(2024)The Future Is Already HereIEEE Software10.1109/MS.2024.335841741:3(26-32)Online publication date: 25-Jan-2024
https://dl.acm.org/doi/10.1109/MS.2024.3358417
Show More Cited By

Recommendations

Assessing the Maturity of DevOps Practices in Software Industry: An Empirical Study of HELENA2 Dataset
EASE '22: Proceedings of the 26th International Conference on Evaluation and Assessment in Software Engineering

Currently, the software development organizations are adopting DevOps practices in order to develop quality product. Due to the lack of definition of DevOps, the principles, practices, and methods adopted in DevOps to determine success have changed ...
Systematic literature review on agile practices in global software development
Abstract Context
Developing software in distributed development environments exhibits coordination, control and communication challenges. Agile practices, which demand frequent communication and self-organization between remote sites, are increasingly ...
CMMI guided process improvement for DevOps projects: an exploratory case study
ICSSP '16: Proceedings of the International Conference on Software and Systems Process

Very recently, an increasing number of software companies adopted DevOps to adapt themselves to the ever-changing business environment. While it is important to mature adoption of the DevOps for these companies, no dedicated maturity models for DevOps ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal of Software: Evolution and Process

Journal of Software: Evolution and Process Volume 29, Issue 6

June 2017

ISSN:2047-7473

EISSN:2047-7481

Issue’s Table of Contents

Publisher

John Wiley & Sons, Inc.

United States

Publication History

Published: 01 June 2017

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Azad NHyrynsalmi S(2024)Multivocal Literature Review on DevOps Critical Success FactorsProceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering10.1145/3661167.3661236(520-527)Online publication date: 18-Jun-2024
https://dl.acm.org/doi/10.1145/3661167.3661236
Bedekar MMussbacher GCombemale BWimmer MChechik MEgyed A(2024)A Multi-Platform Specification Language and Dataset for the Analysis of DevOps PipelinesProceedings of the ACM/IEEE 27th International Conference on Model Driven Engineering Languages and Systems10.1145/3652620.3686247(264-274)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3652620.3686247
Bosch J(2024)The Future Is Already HereIEEE Software10.1109/MS.2024.335841741:3(26-32)Online publication date: 25-Jan-2024
https://dl.acm.org/doi/10.1109/MS.2024.3358417
Ribeiro ERestivo AFerreira HDias J(2024)WASMICOJournal of Systems and Software10.1016/j.jss.2024.112081214:COnline publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1016/j.jss.2024.112081
Dakkak ABosch JHolmstrom Olsson H(2024)Towards AIOps enabled services in continuously evolving software‐intensive embedded systemsJournal of Software: Evolution and Process10.1002/smr.259236:5Online publication date: 25-Apr-2024
https://dl.acm.org/doi/10.1002/smr.2592
Faaiz SKhan SHussain SWang WIbrahim N(2023)A Study on Management Challenges and Practices in DevOpsProceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering10.1145/3593434.3594240(430-437)Online publication date: 14-Jun-2023
https://dl.acm.org/doi/10.1145/3593434.3594240
Ferino SFernandes MCirilo EAgnez LBatista BKulesza UAranha ETreude CHaiduc SSchneider J(2023)Overcoming Challenges in DevOps Education through Teaching MethodsProceedings of the 45th International Conference on Software Engineering: Software Engineering Education and Training10.1109/ICSE-SEET58685.2023.00022(166-178)Online publication date: 17-May-2023
https://dl.acm.org/doi/10.1109/ICSE-SEET58685.2023.00022
Tanzil MSarker MUddin GIqbal A(2023)A mixed method study of DevOps challengesInformation and Software Technology10.1016/j.infsof.2023.107244161:COnline publication date: 1-Sep-2023
https://dl.acm.org/doi/10.1016/j.infsof.2023.107244
Amaro RPereira Rda Silva M(2023)Capabilities and metrics in DevOpsInformation and Management10.1016/j.im.2023.10380960:5Online publication date: 1-Jul-2023
https://dl.acm.org/doi/10.1016/j.im.2023.103809
Grande RVizcaíno AGarcía F(2023)Is it worth adopting DevOps practices in Global Software Engineering? Possible challenges and benefitsComputer Standards & Interfaces10.1016/j.csi.2023.10376787:COnline publication date: 17-Oct-2023
https://dl.acm.org/doi/10.1016/j.csi.2023.103767
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents