research-article

CMMI guided process improvement for DevOps projects: an exploratory case study

Authors:

Dong ShaoAuthors Info & Claims

ICSSP '16: Proceedings of the International Conference on Software and Systems Process

Pages 76 - 85

https://doi.org/10.1145/2904354.2904372

Published: 14 May 2016 Publication History

Abstract

Very recently, an increasing number of software companies adopted DevOps to adapt themselves to the ever-changing business environment. While it is important to mature adoption of the DevOps for these companies, no dedicated maturity models for DevOps exist. Meanwhile, maturity models such as CMMI models have demonstrated their effects in the traditional paradigm of software industry, however, it is not clear whether the CMMI models could guide the improvements with the context of DevOps. This paper reports a case study aiming at evaluating the feasibility to apply the CMMI models to guide process improvement for DevOps projects and identifying possible gaps. Using a structured method(i.e., SCAMPI C), we conducted a case study by interviewing four employees from one DevOps project. Based on evidence we collected in the case study, we managed to characterize the maturity/capability of the DevOps project, which implies the possibility to use the CMMI models to appraise the current processes in this DevOps project and guide future improvements. Meanwhile, several gaps also are identified between the CMMI models and the DevOps mode. In this sense, the CMMI models could be taken as a good foundation to design suitable maturity models so as to guide process improvement for projects adopting the DevOps.

References

[1]

S. Alex and F. Eileen. Using CMMI-DEV and CMMI-SVC together Where "build stuff" happens in CMMI-SVC, 2012. http:/https://resources.sei.cmu.edu/asset_files/Presentation/2012_017_001_22930.pdf.

[2]

D. J. Anderson. Stretching agile to fit CMMI level 3-the story of creating msf for CMMI® process improvement at microsoft corporation. In Agile Conference, 2005. Proceedings, pages 193--201. IEEE, 2005.

Digital Library

[3]

B. Barafort, B. Di Renzo, and O. Merlan. Benefits resulting from the combined use of ISO/IEC 15504 with the information technology infrastructure library (itil). In Product Focused Software Process Improvement, pages 314--325. Springer, 2002.

Digital Library

[4]

V. R. Basili. Software modeling and measurement: the goal/question/metric paradigm. 1992.

[5]

V. R. Basili. Applying the goal/question/metric paradigm in the experience factory. Software Quality Assurance and Measurement: A Worldwide Perspective, pages 21--44, 1993.

[6]

B. Boehm and R. Turner. Balancing agility and discipline: Evaluating and integrating agile and plan-driven methods. In Proceedings of the 26th international Conference on Software Engineering, pages 718--719. IEEE Computer Society, 2004.

Digital Library

[7]

J. Diaz, J. Garbajosa, and J. A. Calvo-Manzano. Mapping CMMI level 2 to scrum practices: An experience report. In Software Process Improvement, pages 93--104. Springer, 2009.

[8]

F. Eileen. CMMI for services Current state, 2012. http://www.sei.cmu.edu/library/abstracts/presentations/CMMI-for-Services-Overview.cfm.

[9]

K. El-Emam and I. Garro. ISO/IEC 15504. International Organization for Standardization, 1999.

[10]

M. Ernest, W. James, G. Karthik, and K. Peco. What is devops?, 2011. http://theagileadmin.com/what-is-devops/.

[11]

M. Fritzsche and P. Keil. Agile methods and cmmi: compatibility or conflict? e-Informatica, 1(1):9--26, 2007.

[12]

R. Janessa and M. Rob Van der. Gartner says by 2016, devops will evolve from a niche to a mainstream strategy employed by 25 percent of global 2000 organizations, 2015. http://www.gartner.com/newsroom/id/2999017.

[13]

G. Kim, K. Behr, and G. Spafford. The phoenix project: A novel about IT, DevOps, and helping your business win. IT Revolution, 2014.

Digital Library

[14]

P. Labs. 2015 state of DevOps report. Technical report, Puppet Labs, 2015. https://puppetlabs.com/2015-devops-report.

[15]

J. Martinsson. Maturing xp through the cmm. In Extreme Programming and Agile Processes in Software Engineering, pages 80--87. Springer, 2003.

Digital Library

[16]

A. L. Mesquida, A. Mas, E. Amengual, and J. A. Calvo-Manzano. It service management process improvement based on iso/iec 15504: A systematic review. Information and Software Technology, 54(3):239--247, 2012.

Digital Library

[17]

Y. Monden. Toyota production system: practical approach to production management. Engineering & Management Press, 1983.

[18]

M. C. Paulk. Extreme programming from a cmm perspective. Software, IEEE, 18(6): 19--26, 2001.

Digital Library

[19]

M. C. Paulk. Agile methodologies and process discipline. Institute for Software Research, page 3, 2002.

[20]

M. Pikkarainen and A. Mantyniemi. An approach for using CMMI in agile software development assessments: experiences from three case studies. 2006.

[21]

T. P. Rout and A. Tuffley. Harmonizing iso/iec 15504 and cmmi. Software Process: Improvement and Practice, 12(4):361--371, 2007.

Digital Library

[22]

P. Runeson and M. Höst. Guidelines for conducting and reporting case study research in software engineering. Empirical software engineering, 14(2):131--164, 2009.

Digital Library

[23]

J. Smeds, K. Nybom, and I. Porres. Devops: A definition and perceived adoption impediments. In Agile Processes, in Software Engineering, and Extreme Programming, pages 166--177. Springer, 2015.

[24]

J. Sutherland, C. R. Jakobsen, and K. Johnson. Scrum and CMMI level 5: The magic potion for code warriors. In Hawaii International Conference on System Sciences, Proceedings of the 41st Annual, pages 466--466. IEEE, 2008.

Digital Library

[25]

C. P. Team. CMMI® for Acquisition Version 1.3. Lulu, com, 2010.

[26]

C. P. Team. CMMI® for development, version 1.3, improving processes for developing better products and services, no. CMU/SEI-2010-TR-033. Software Engineering Institute, 2010.

[27]

C. P. Team. CMMI® for Services Version 1.3. Lulu. com, 2010.

[28]

S. U. Team. Standard CMMI appraisal method for process improvement (SCAMPI) A, version 1.3: Method definition document. 2011.

Cited By

Jayakody JWijayanayake W(2024)DevOps Maturity; A Systematic Literature Review2024 International Research Conference on Smart Computing and Systems Engineering (SCSE)10.1109/SCSE61872.2024.10550493(1-6)Online publication date: 4-Apr-2024
https://doi.org/10.1109/SCSE61872.2024.10550493
Jayakody JWijayanayake W(2023)Process Improvement Framework for DevOps Adoption in Software Development2023 International Research Conference on Smart Computing and Systems Engineering (SCSE)10.1109/SCSE59836.2023.10214992(1-7)Online publication date: 29-Jun-2023
https://doi.org/10.1109/SCSE59836.2023.10214992
Morales JYasar HVolkmann A(2022)Weaving Security into DevOps Practices in Highly Regulated EnvironmentsResearch Anthology on Agile Software, Software Development, and Testing10.4018/978-1-6684-3702-5.ch059(1177-1201)Online publication date: 2022
https://doi.org/10.4018/978-1-6684-3702-5.ch059
Show More Cited By

Recommendations

Challenges in Combining Agile Development and CMMI: A Systematic Literature Review
ICSCA '21: Proceedings of the 2021 10th International Conference on Software and Computer Applications

Recently, Agile Development has emerged as an alternative approach in software engineering. The Agile Software Development (ASD) process provides the ability to cope with ever-changing requirements. On the other hand, the Capability Maturity Model ...
Towards Process Improvement in DevOps: A Systematic Literature Review
EASE '20: Proceedings of the 24th International Conference on Evaluation and Assessment in Software Engineering

In recent years, the software release cost has been reduced dramatically due to the alteration from traditional shrink-wrapped software to software as a service. Organizations that can deliver their services continuously and with a high frequency have a ...
Business-oriented software process improvement based on CMMI using QFD

Software Process Improvement (SPI) has become the key to the survival of many software development organizations. As a follow-up of a previous paper on SPI for the CMM using Quality Function Deployment (QFD), a new SPI framework integrating QFD with the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSSP '16: Proceedings of the International Conference on Software and Systems Process

May 2016

120 pages

ISBN:9781450341882

DOI:10.1145/2904354

General Chairs:
Dewayne E. Perry,
David Raffo

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ACM: Association for Computing Machinery
SIGSOFT: ACM Special Interest Group on Software Engineering
IEEE-CS\DATC: IEEE Computer Society
TCSE: IEEE Computer Society's Tech. Council on Software Engin.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE '16

Sponsor:

ACM
SIGSOFT
IEEE-CS\DATC
TCSE

ICSE '16: 38th International Conference on Software Engineering

May 14 - 22, 2016

Texas, Austin

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
1,104
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)4

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jayakody JWijayanayake W(2024)DevOps Maturity; A Systematic Literature Review2024 International Research Conference on Smart Computing and Systems Engineering (SCSE)10.1109/SCSE61872.2024.10550493(1-6)Online publication date: 4-Apr-2024
https://doi.org/10.1109/SCSE61872.2024.10550493
Jayakody JWijayanayake W(2023)Process Improvement Framework for DevOps Adoption in Software Development2023 International Research Conference on Smart Computing and Systems Engineering (SCSE)10.1109/SCSE59836.2023.10214992(1-7)Online publication date: 29-Jun-2023
https://doi.org/10.1109/SCSE59836.2023.10214992
Morales JYasar HVolkmann A(2022)Weaving Security into DevOps Practices in Highly Regulated EnvironmentsResearch Anthology on Agile Software, Software Development, and Testing10.4018/978-1-6684-3702-5.ch059(1177-1201)Online publication date: 2022
https://doi.org/10.4018/978-1-6684-3702-5.ch059
Orozco-Garcés CPardo-Calvache CSuescún-Monsalve E(2022)Metrics Model to Complement the Evaluation of DevOps in Software CompaniesRevista Facultad de Ingeniería10.19053/01211129.v31.n62.2022.1476631:62(e14766)Online publication date: 4-Oct-2022
https://doi.org/10.19053/01211129.v31.n62.2022.14766
Orozco-Garcés CPardo-Calvache CSalazar-Mondragón Y(2022)What is There About DevOps Assessment? A Systematic MappingRevista Facultad de Ingeniería10.19053/01211129.v31.n59.2022.1389631:59(e13896)Online publication date: 14-Mar-2022
https://doi.org/10.19053/01211129.v31.n59.2022.13896
Faustino JAdriano DAmaro RPereira Rda Silva M(2022) DevOps benefits: A systematic literature review Software: Practice and Experience10.1002/spe.309652:9(1905-1926)Online publication date: 11-May-2022
https://doi.org/10.1002/spe.3096
de Aguiar Monteiro LJuristo N(2021)A proposal to systematize introducing DevOps into the software development processProceedings of the 43rd International Conference on Software Engineering: Companion Proceedings10.1109/ICSE-Companion52605.2021.00124(269-271)Online publication date: 25-May-2021
https://dl.acm.org/doi/10.1109/ICSE-Companion52605.2021.00124
Rafi SYu WAkbar MMahmood SAlsanad AGumaei A(2021)Readiness model for DevOps implementation in software organizationsJournal of Software: Evolution and Process10.1002/smr.232333:4Online publication date: 1-Apr-2021
https://dl.acm.org/doi/10.1002/smr.2323
Teixeira DPereira RHenriques TSilva MFaustino J(2020)A Systematic Literature Review on DevOps Capabilities and AreasInternational Journal of Human Capital and Information Technology Professionals10.4018/IJHCITP.202007010111:3(1-22)Online publication date: 1-Jul-2020
https://doi.org/10.4018/IJHCITP.2020070101
Teixeira DPereira RHenriques TSilva MFaustino J(2020)A Systematic Literature Review on DevOps Capabilities and AreasInternational Journal of Human Capital and Information Technology Professionals10.4018/IJHCITP.202004010111:2(1-22)Online publication date: 1-Apr-2020
https://doi.org/10.4018/IJHCITP.2020040101
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents