research-article

A Meta-Model for Information Systems Quality: A Mixed Study of the Financial Sector

Authors:

Paolo Ciancarini,

Tommaso Falasconi,

Massimo TomasiAuthors Info & Claims

ACM Transactions on Management Information Systems (TMIS), Volume 9, Issue 3

Article No.: 11, Pages 1 - 38

https://doi.org/10.1145/3230713

Published: 26 September 2018 Publication History

Abstract

Information Systems Quality (ISQ) is a critical source of competitive advantages for organizations. In a scenario of increasing competition on digital services, ISQ is a competitive differentiation asset. In this regard, managing, maintaining, and evolving IT infrastructures have become a primary concern of organizations. Thus, a technical perspective on ISQ provides useful guidance to meet current challenges. The financial sector is paradigmatic, since it is a traditional business, with highly complex business-critical legacy systems, facing a tremendous change due to market and regulation drivers. We carried out a Mixed-Methods study, performing a Delphi-like study on the financial sector. We developed a specific research framework to pursue this vertical study. Data were collected in four phases starting with a high-level randomly stratified panel of 13 senior managers and then a target panel of 124 carefully selected and well-informed domain experts. We have identified and dealt with several quality factors; they were discussed in a comprehensive model inspired by the ISO 25010, 42010, and 12207 standards, corresponding to software quality, software architecture, and software process, respectively. Our results suggest that the relationship among quality, architecture, and process is a valuable technical perspective to explain the quality of an information system. Thus, we introduce and illustrate a novel meta-model, named SQuAP (Software Quality, Architecture, Process), which is intended to give a comprehensive picture of ISQ by abstracting and connecting detailed individual ISO models.

References

[1]

European Banking Authority. 2017. Regulatory Technical Standards on Strong Customer Authentication and Secure Communication under PSD2, Author=European Banking Authority. Final Draft. EBA/RTS/2017/02.

[2]

European Parliament and of the Council. 2007. Directive 2007/64/EC. Retrieved from http://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:02007L0064-20091207.

[3]

European Parliament and of the Council. 2015. Directive 2015/2366/EU. Retrieved from http://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32015L2366.

[4]

G. Abowd, G. Bass, P. Clements, R. Kazman, and L. Northrop. 1997. Recommended Best Industrial Practice for Software Architecture Evaluation. Technical Report. Software Engineering Institute.

[5]

A. T. M. Aerts, J. B. M. Goossenaerts, D. K. Hammer, and J. C. Wortmann. 2004. Architectures in context: On the evolution of business, application software, and ICT platform architectures. Information 8 Management 41, 6 (2004), 781--794.

Digital Library

[6]

S. Aier, B. Gleichauf, and R. Winter. 2011. Understanding enterprise architecture management design -- An empirical analysis. In Proc. 10th Int. Conf. Wirtschaftsinformatik.

[7]

A. April and F. Coallier. 1995. Q. Bell Canada, “trillium: A model for the assessment of telecom software system development and maintenance capability.” In Proc. Software Engineering Standards Sym.

Digital Library

[8]

M. A. Babar, A. W. Brown, and I. Mistrík. 2013. Agile Software Architecture: Aligning Agile Processes and Software Architectures. Newnes.

Digital Library

[9]

M. A. Babar, L. Zhu, and R. Jeffery. 2004. A framework for classifying and comparing software architecture evaluation methods. In Proc. Australian Software Engineering Conference. IEEE, 309--318.

Digital Library

[10]

R. D. Banker, I. Bardhan, and O. Asdemir. 2006. Understanding the impact of collaboration software on product design and development. Information Systems Research 17, 4 (2006), 352--373.

Digital Library

[11]

R. Baskerville and M. D. Myers. 2004. Special issue on action research in information systems: Making IS research relevant to practice: Foreword. MIS Quarterly 8, 3 (2004), 329--335.

Digital Library

[12]

L. Bass, P. Clemens, and R. Kazman. 2012. Software Architecture in Practice (3rd ed.). Addison-Wesley.

Digital Library

[13]

L. Bass, I. Weber, and L. Zhu. 2015. DevOps: A Software Architect’s Perspective. Addison-Wesley.

Digital Library

[14]

S. Bellomo, I. Gorton, and R. Kazman. 2015. Toward Agile architecture: Insights from 15 years of ATAM data. IEEE Software 32, 5 (2015), 38--45.

Digital Library

[15]

P. Bengtsson, N. Lassing, J. Bosch, and H. van Vliet. 2004. Architecture-level modifiability analysis (ALMA). Journal of Systems and Software 69, 1 (2004), 129--147.

Digital Library

[16]

A. Benlian and I. Haffke. 2016. Does mutuality matter? Examining the bilateral nature and effects of CEO--CIO mutual understanding. Journal of Strategic Information Systems 25, 2 (2016), 104--126.

Digital Library

[17]

S. J. Berman. 2012. Digital transformation: Opportunities to create new business models. Strategy 8 Leadership 40, 2 (2012), 16--24.

[18]

S. C. Blumenthal. 1969. Management Information Systems; A Framework for Planning and Development. Technical Report.

[19]

B. Boehm. 1988. A spiral model of software development and enhancement. IEEE Computer 21, 5 (1988), 61--72.

Digital Library

[20]

B. Boehm, C. Abts, and S. Chulani. 2000. Software development cost estimation approaches--A survey. Annals of Software Engineering 10, 1--4 (2000), 177--205.

Digital Library

[21]

B. W. Boehm, J. R. Brown, and M. Lipow. 1976. Quantitative evaluation of software quality. In Proc. 2nd Int. Conf. on Software Engineering (ICSE’76). ACM/IEEE, 592--605.

Digital Library

[22]

W. F. Boh and D. Yellin. 2006. Using enterprise architecture standards in managing information technology. Journal of Management Information Systems 23, 3 (2006), 163--207.

Digital Library

[23]

V. Boucharas, M. van Steenbergen, S. Jansen, and S. Brinkkemper. 2010. The contribution of enterprise architecture to the achievement of organizational goals: Establishing the enterprise architecture benefits framework. Department of Information and Computing Sciences, Utrecht University, Utrecht.

[24]

A. C. Boynton, B. Victor, and Pine J.1993. New competitive strategies: Challenges to organizations and information technology. IBM Systems Journal 32, 1 (1993), 40--64.

Digital Library

[25]

J. Brancheau, B. Janz, and J. Wetherbe. 1996. Key issues in information systems management: 1994-95 SIM Delphi results. MIS Quarterly 20, 2 (1996), 225--242.

Digital Library

[26]

W. Brown, R. Malveau, H. McCormick, and T. Mowbray. 1998. AntiPatterns: Refactoring Software, Architectures, and Projects in Crisis. John Wiley 8 Sons.

Digital Library

[27]

G. Campbell and P. Papapetrou. 2013. SonarQube in Action. Manning Publications Co.

Digital Library

[28]

P. Checkland. 1981. Systems Thinking, Systems Practice. John Wiley.

[29]

C. Cherryholmes. 1992. Notes on pragmatism and scientific realism. Educational Researcher 21, 6 (1992), 13--17.

[30]

T. Chow and D. Cao. 2008. A survey study of critical success factors in Agile software projects. Journal of Systems and Software 81, 6 (2008), 961--971.

Digital Library

[31]

M. B. Chrissis, M. Konrad, and S. Shrum. 2003. CMMI Guidelines for Process Integration and Product Improvement. Addison-Wesley Longman Publishing.

Digital Library

[32]

C. Churchman. 1971. The Design of Inquiring Systems Basic Concepts of Systems and Organization. Basic Books.

[33]

P. Ciancarini, D. Russo, A. Sillitti, and G. Succi. 2016. A guided tour of the legal implications of software cloning. In Proc. 38th Int. Conf. on Software Engineering (ICSE’16). ACM/IEEE, 563--572.

Digital Library

[34]

P. Ciancarini, D. Russo, A. Sillitti, and G. Succi. 2016. Reverse engineering: A european IPR perspective. In Proc. 31st Annual ACM Symposium on Applied Computing (SAC’16). 1498--1503.

Digital Library

[35]

J. Cleland-Huang, R. S. Hanmer, S. Supakkul, and M. Mirakhorli. 2013. The twin peaks of requirements and architecture. IEEE Software 30, 2 (2013), 24--29.

Digital Library

[36]

P. Clements, R. Kazman, and M. Klein. 2002. Evaluating Software Architectures. Addison-Wesley.

[37]

J. Creswell. 2013. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. Sage.

[38]

J. Creswell, V. Clark, and L. Plano. 2007. Designing and Conducting Mixed Methods Research. Wiley.

[39]

M. A. Cusumano. 2004. The Business of Software: What Every Manager, Programmer, and Entrepreneur Must Know to Thrive and Survive in Good Times and Bad. Simon and Schuster.

Digital Library

[40]

J. S. David, D. Schuff, and R. St Louis. 2002. Managing your total IT cost of ownership. Communications of the ACM 45, 1 (2002), 101--106.

Digital Library

[41]

C. Deephouse, T. Mukhopadhyay, D. R. Goldenson, and M. I. Kellner. 1995. Software processes and project performance. Journal of Management Information Systems 12, 3 (1995), 187--205.

Digital Library

[42]

W. DeLone and E. McLean. 1992. Information systems success: The quest for the dependent variable. Information Systems Research 3, 1 (1992), 60--95.

Digital Library

[43]

W. DeLone and E. McLean. 2003. The DeLone and McLean model of information systems success: A ten-year update. Journal of Management Information Systems 19, 4 (2003), 9--30.

[44]

J. Dewey. 1938. Logic: The Theory of Inquiry. Holt.

[45]

G. W Dickson. 1968. Management information-decision systems: A new era ahead? Business Horizons 11, 6 (1968), 17--26.

[46]

L. Dobrica and E. Niemela. 2002. A survey on software architecture analysis methods. IEEE Transactions on Software Engineering 28, 7 (2002), 638--653.

Digital Library

[47]

E. Doke and N. Swanson. 1995. Decision variables for selecting prototyping in information systems development: A Delphi study of MIS managers. Information 8 Management 29, 4 (1995), 173--182.

Digital Library

[48]

A. Dorling. 1993. SPICE: Software process improvement and capability determination. Software Quality Journal 2, 4 (1993), 209--224.

[49]

K. E. Emam, W. Melo, and J.-N. Drouin. 1997. SPICE: The Theory and Practice of Software Process Improvement and Capability Determination. IEEE.

Digital Library

[50]

J. Etezadi-Amoli and A. Farhoomand. 1996. A structural model of end user computing satisfaction and user performance. Information 8 Management 30, 2 (1996), 65--73.

Digital Library

[51]

D. Feeny, M. Lacity, and L. Willcocks. 2005. Taking the measure of outsourcing providers. MIT Sloan Management Review 46, 3 (2005), 41.

[52]

D. F. Feeny, B. R. Edwards, and K. M. Simpson. 1992. Understanding the CEO/CIO relationship. MIS Quarterly 16, 4 (1992), 435--448.

Digital Library

[53]

D. Garlan and D. E Perry. 1995. Introduction to the special issue on software architecture. IEEE Transactions on Software Engineering 21, 4 (1995), 269--274.

Digital Library

[54]

B. G. Glaser. 1978. Theoretical Sensitivity: Advances in the Methodology of Grounded Theory. Sociology Press.

[55]

B. G. Glaser. 1992. Basics of Grounded Theory Analysis: Emergence vs Forcing. Sociology Press.

[56]

N. Gorla and S. C. Lin. 2010. Determinants of software quality: A survey of information systems project managers. Information and Software Technology 52, 6 (2010), 602--610.

Digital Library

[57]

N. Gorla, T. Somers, and B. Wong. 2010. Organizational impact of system quality, information quality, and service quality. Journal of Strategic Information Systems 19, 3 (2010), 207--228.

Digital Library

[58]

E. Guba. 1981. Criteria for assessing the trustworthiness of naturalistic inquiries. Educational Communication and Technology Journal 29, 2 (1981), 75--91.

[59]

U. G. Gupta and R. E. Clarke. 1996. Theory and applications of the Delphi technique: A bibliography (1975--1994). Technological Forecasting and Social Change 53, 2 (1996), 185--211.

[60]

S. Hayne and C. Pollard. 2000. A comparative analysis of critical issues facing Canadian information systems personnel: A national and global perspective. Information 8 Management 38, 2 (2000), 73--86.

Digital Library

[61]

L. A. Von Hellens. 1997. Information systems quality versus software quality a discussion from a managerial, an organisational and an engineering viewpoint. Information and Software Technology 39, 12 (1997), 801--808.

[62]

J. Highsmith and M. Fowler. 2001. The Agile manifesto. Software Development Magazine 9, 8 (2001), 29--30.

[63]

R. Hirschheim and H. K Klein. 2011. Tracing the history of the information systems field. The Oxford Handbook of Management Information Systems: Critical Perspectives and New Directions, 16--61.

[64]

W. Humphrey. 1988. Characterizing the software process: A maturity framework. IEEE Software 5, 2 (1988), 73--79.

Digital Library

[65]

R. Judd. 1972. Use of Delphi methods in higher education. Technological Forecasting and Social Change 4, 2 (1972), 173--186.

[66]

M. Jun and S. Cai. 2001. The key determinants of internet banking service quality: A content analysis. International Journal of Bank Marketing 19, 7 (2001), 276--291.

[67]

H. W. Jung. 2007. Validating the external quality subcharacteristics of software products according to ISO/IEC 9126. Computer Standards 8 Interfaces 29, 6 (2007), 653--661.

[68]

H. W. Jung, S. G. Kim, and C. S. Chung. 2004. Measuring software product quality: A survey of ISO/IEC 9126. IEEE Software 21, 5 (2004), 88--92.

Digital Library

[69]

S. H. Kaisler, F. Armour, and M. Valivullah. 2005. Enterprise architecting: Critical problems. In Proc. 38th Annual Hawaii Int. Conf. on System Sciences (HICSS’05). IEEE, 224b.

Digital Library

[70]

R. Kazman, L. Bass, G. Abowd, and M. Webb. 1994. SAAM: A method for analyzing the properties of software architectures. In Proc. Int. Conf. on Software Engineering (ICSE’94). ACM/IEEE, 81--90.

Digital Library

[71]

P. G. W. Keen. 1987. MIS research: Current status, trends and needs. Information Systems Education: Recommendations and Implementation, R. A. Buckingham, R. A. Hirschheim, F. F. Land, and C. J. Tully (Eds.). Cambridge University Press, Cambridge, England, 1--13.

[72]

Ravi Khadka, Belfrit V. Batlajery, Amir M. Saeidi, Slinger Jansen, and Jurriaan Hage. 2014. How do professionals perceive legacy systems and software modernization?. In Proc. of the 36th Int. Conf. on Software Engineering. ACM/IEEE, 36--47.

Digital Library

[73]

M. Krafft, K. Stol, and B. Fitzgerald. 2016. How do free/open source developers pick their tools?: A Delphi study of the Debian project. In Proc. 38th Int. Conf. on Software Engineering (ICSE’16). ACM/IEEE, 232--241.

Digital Library

[74]

V. Krotov. 2015. Bridging the CIO-CEO gap: It takes two to tango. Business Horizons 58, 3 (2015), 275--283.

[75]

M. Lange, J. Mendling, and J. Recker. 2016. An empirical analysis of the factors and measures of enterprise architecture management success. European Journal of Information Systems 25, 5 (2016), 411--431.

[76]

B. Langefors. 1973. Theoretical Analysis of Information Systems. Technical Report.

[77]

P. Lavrakas. 2008. Encyclopedia of Survey Research Methods. Sage.

[78]

Z. Li, P. Liang, and P. Avgeriou. 2015. Architectural technical debt identification based on architecture decisions and change scenarios. In Proc. 12th Work. Int. Conf on Software Architecture (WICSA’15). IEEE, 65--74.

Digital Library

[79]

J. Luftman and H. S. Zadeh. 2011. Key information technology and management issues 2010--11: An international study. Journal of Information Technology 26, 3 (2011), 193--204.

[80]

G. H. Mead. 1913. The social self. Journal of Philosophy, Psychology and Scientific Methods 10, 14 (1913), 374--380.

[81]

N. Medvidovic and R. N. Taylor. 2010. Software architecture: Foundations, theory, and practice. In Proc. Int. Conf. Software Engineering (ICSE’10). ACM/IEEE, 471--472.

Digital Library

[82]

meta. 2013. Oxford Dictionary of English (3rd ed.). Oxford University Press.

Digital Library

[83]

metamodel. 2013. Oxford Dictionary of English (3rd ed.). Oxford University Press.

Digital Library

[84]

J. Miller and B. A Doyle. 1987. Measuring the effectiveness of computer-based information systems in the financial services sector. MIS Quarterly 11, 1 (1987), 107--124.

Digital Library

[85]

I. Mistrik, R. Bahsoon, P. Eeles, R. Roshandel, and M. Stal. 2014. Relating System Quality and Software Architecture. Morgan Kaufmann.

Digital Library

[86]

S. N. Mohanty. 1979. Models and measurements for quality assessment of software. Computing Surveys 11, 3 (1979), 251--275.

Digital Library

[87]

D. Moody. 2005. Theoretical and practical issues in evaluating the quality of conceptual models: Current state and future directions. Data 8 Knowledge Engineering 55, 3 (2005), 243--276.

Digital Library

[88]

K. Mordal-Manet, F. Balmas, S. Denier, S. Ducasse, H. Wertz, J. Laval, F. Bellingard, and P. Vaillergues. 2009. The Squale model--A practice-based industrial quality model. In Proc. Int. Conf. on Software Maintenance (ICSM’09). IEEE, 531--534.

[89]

C. Moustakas. 1994. Phenomenological Research Methods. Sage.

[90]

P. Mulligan. 2002. Specification of a capability-based IT classification framework. Information 8 Management 39, 8 (2002), 647--658.

Digital Library

[91]

E. Mumford. 1974. Computer systems and work design: Problems of philosophy and vision. Personnel Review 3, 2 (1974), 40--49.

[92]

R. R. Nelson and S. G. Winter. 2009. An Evolutionary Theory of Economic Change. Harvard University Press.

[93]

S. Nidumolu. 1995. The effect of coordination and uncertainty on software project performance: Residual performance risk as an intervening variable. Information Systems Research 6, 3 (1995), 191--219.

Digital Library

[94]

S. Nidumolu and G. W. Knotts. 1998. The effects of customizability and reusability on perceived process and competitive performance of software firms. MIS Quarterly 22, 2 (1998), 105--137.

Digital Library

[95]

S. Nidumolu and M. Subramani. 2003. The matrix of control: Combining process and structure approaches to managing software development. Journal of Management Information Systems 20, 3 (2003), 159--196.

Digital Library

[96]

B. Nuseibeh. 2001. Weaving together requirements and architectures. IEEE Computer 34, 3 (2001), 115--119.

Digital Library

[97]

C. Okoli and S. Pawlowski. 2004. The Delphi method as a research tool: An example, design considerations and applications. Information 8 Management 42, 1 (2004), 15--29.

Digital Library

[98]

R. Parthasarthy and S. Sethi. 1992. The impact of flexible automation on business strategy and organizational structure. Academy of Management Review 17, 1 (1992), 86--111.

[99]

M. C. Paulk, B. Curtis, M. B. Chrissis, and C. V. Weber. 1993. Capability maturity model, version 1.1. IEEE Software 10, 4 (1993), 18--27.

Digital Library

[100]

C. S. Peirce. 1905. The architectonic construction of pragmatism. Collected Papers of Charles Sanders Pierce 5 (1905), 3--6.

[101]

J. Peppard and J. Ward. 2016. The Strategic Management of Information Systems: Building a Digital Strategy. Wiley.

[102]

S. Petter, W. DeLone, and E. McLean. 2008. Measuring information systems success: Models, dimensions, measures, and interrelationships. European Journal of Information Systems 17, 3 (2008), 236--263.

[103]

L. Pitt, R. Watson, and B. Kavan. 1995. Service quality: A measure of information systems effectiveness. MIS Quarterly 19, 2 (1995), 173--187.

Digital Library

[104]

M. E. Porter and V. E. Millar. 1985. How information gives you competitive advantage. Harvard Business Review 63, 4 (1985), 149--160.

[105]

T. C. Powell and A. Dent-Micallef. 1997. Information technology as competitive advantage: The role of human, business, and technology resources. Strategic Management Journal 18, 5 (1997), 375--405.

[106]

C. K. Prahalad and M. S. Krishnan. 1998. The new meaning of quality in the information age. Harvard Business Review 77, 5 (1998), 109--18.

[107]

R. Pressman. 2014. Software Engineering: A Practitioner’s Approach. McGrawHill.

Digital Library

[108]

Pilar Rodríguez, Alireza Haghighatkhah, Lucy Ellen Lwakatare, Susanna Teppola, Tanja Suomalainen, Juho Eskeli, Teemu Karvonen, Pasi Kuvaja, June M. Verner, and Markku Oivo. 2017. Continuous deployment of software intensive products and services: A systematic mapping study. Journal of Systems and Software 123 (2017), 263--291.

[109]

K. Rostami, R. Heinrich, A. Busch, and R. Reussner. 2017. Architecture-based change impact analysis in information systems and business processes. In Proc. Int. Conf. on Software Architecture (ICSA’17). IEEE, 179--188.

[110]

K. Rostami, J. Stammel, R. Heinrich, and R. Reussner. 2015. Architecture-based assessment and planning of change requests. In Proc. 11th Int. Conf. on Quality of Software Architectures (QoSA’15). ACM, 21--30.

Digital Library

[111]

W. Royce. 1987. Managing the development of large software systems: Concepts and techniques. In Proc. Int. Conf. Software Engineering (ICSE’87). ACM/IEEE, 328--338.

Digital Library

[112]

D. Russo, P. Ciancarini, T. Falasconi, and M. Tomasi. 2017. Software quality concerns in the italian bank sector: The emergence of a meta-quality dimension. In Proc. 39th Int. Conf. on Software Engineering (ICSE’17). ACM/IEEE, 63--72.

Digital Library

[113]

C. Schmidt and P. Buxmann. 2011. Outcomes and success factors of enterprise IT architecture management: Empirical insight from the international financial services industry. European Journal of Information Systems 20, 2 (2011), 168--185.

[114]

R. Schmidt. 1997. Managing Delphi surveys using nonparametric statistical techniques. Decision Sciences 28, 3 (1997), 763--774.

[115]

R. Schmidt, K. Lyytinen, M. Keil, and P. Cule. 2001. Identifying software project risks: An international Delphi study. Journal of Management Information Systems 17, 4 (2001), 5--36.

Digital Library

[116]

M. Shaw and D. Garlan. 1996. Software Architecture: Perspectives on an Emerging Discipline. Prentice Hall Englewood Cliffs.

Digital Library

[117]

R. Singh. 1996. International standard ISO/IEC 12207 software life cycle processes. Software Process Improvement and Practice 2, 1 (1996), 35--50.

[118]

B. Slife and R. Williams. 1995. What’s Behind the Research?: Discovering Hidden Assumptions in the Behavioral Sciences. Sage.

[119]

Deloitte Italy S.p.A. 2016. Payments Service Directive 2 (PSD2): Il Nostro Approccio. Technical Report. Deloitte Consulting.

[120]

A. Strauss and J. M Corbin. 1997. Grounded Theory in Practice. Sage.

[121]

T. Sunazuka, M. Azuma, and N. Yamagishi. 1985. Software quality assessment technology. In Proc. 8th Int. Conf. on Software Engineering (ICSE’85). ACM/IEEE, 142--148.

Digital Library

[122]

CMMI Product Team. 2002. Capability maturity model® integration (CMMI), version 1.1--Continuous representation.

[123]

D. Teichroew. 1972. A survey of languages for stating requirements for computer-based information systems. In Proc. Fall Joint Computer Conference. ACM, 1203--1224.

Digital Library

[124]

J. Tian. 2004. Quality-evaluation models and measurements. IEEE Software 21, 3 (2004), 84--91.

Digital Library

[125]

M. Unterkalmsteiner, T. Gorschek, A. Islam, C. Cheng, R. Permadi, and R. Feldt. 2012. Evaluation and measurement of software process improvement--A systematic literature review. IEEE Transactions on Software Engineering 38, 2 (2012), 398--424.

Digital Library

[126]

N. Venkatraman. 1994. IT-enabled business transformation: From automation to business scope redefinition. Sloan Management Review 35, 2 (1994), 73.

[127]

Stefan Wagner, Klaus Lochmann, Lars Heinemann, Michael Kläs, Adam Trendowicz, Reinhold Plösch, Andreas Seidl, Andreas Goeb, and Jonathan Streit. 2012. The Quamoco product quality modelling and assessment approach. In Proc. 34th Int. Conf. on Software Engineering (ICSE’12). ACM/IEEE, 1133--1142.

Digital Library

[128]

Stefan Wagner, Andreas Goeb, Lars Heinemann, Michael Kläs, Constanza Lampasona, Klaus Lochmann, Alois Mayr, Reinhold Plösch, Andreas Seidl, Jonathan Streit, and others. 2015. Operationalised product quality models and assessment: The Quamoco approach. Information and Software Technology 62 (2015), 101--123.

Digital Library

[129]

S. Wagner and F. Deissenboeck. 2007. An integrated approach to quality modelling. In Proc. 5th Int. Workshop on Software Quality. IEEE Computer Society, 1--6.

Digital Library

[130]

R. Winter, C. Legner, and K. Fischbach. 2014. Introduction to the special issue on enterprise architecture management. Information Systems and e-Business Management 12, 1 (2014), 1--4.

Digital Library

[131]

B. Wixom and H. Watson. 2001. An empirical investigation of the factors affecting data warehousing success. MIS Quarterly 25, 1 (2001), 17--41.

Digital Library

[132]

B. H. Wixom and P. A. Todd. 2005. A theoretical integration of user satisfaction and technology acceptance. Information Systems Research 16, 1 (2005), 85--102.

Digital Library

[133]

C. Wohlin, P. Runeson, M. Höst, M. Ohlsson, B. Regnell, and A. Wesslén. 2012. Experimentation in Software Engineering. Springer Science 8 Business Media.

Digital Library

[134]

C. Yang, P. Liang, and P. Avgeriou. 2016. A systematic mapping study on the combination of software architecture and Agile development. Journal of Systems and Software 111 (2016), 157--184.

Digital Library

Cited By

Russo D(2024)Navigating the Complexity of Generative AI Adoption in Software EngineeringACM Transactions on Software Engineering and Methodology10.1145/365215433:5(1-50)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3652154
Verwijs CRusso D(2023)A Theory of Scrum Team EffectivenessACM Transactions on Software Engineering and Methodology10.1145/357184932:3(1-51)Online publication date: 27-Apr-2023
https://dl.acm.org/doi/10.1145/3571849
Ali FUsman MAbrar MRahman SKhan INiazi B(2023)Practices of De-Motivators in Adopting Agile Software Development Methods at Large Scale Development Teams From Management PerspectiveIEEE Access10.1109/ACCESS.2023.333175911(130368-130390)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3331759
Show More Cited By

Index Terms

A Meta-Model for Information Systems Quality: A Mixed Study of the Financial Sector

Recommendations

Software quality models: a systematic mapping study
ICSSP '19: Proceedings of the International Conference on Software and System Processes

Quality Models play a critical role in assuring quality and have evolved over 40+ years. They provide support for defining quality attributes, building and measuring the quality of the resulting product. Each quality model adopts a critical view on ...
Software Quality Initiatives: An Empirical Study of Indian SMEs in the IT Sector

Through extensive research into the area of quality management practices, such as ISO International Standard Organization, Six Sigma has been observed within small and medium-sized enterprises SMEs. Few empirical studies have reported the application of ...
Organizational impact of system quality, information quality, and service quality

Increased organizational dependence on information systems drives management attention towards improving information systems' quality. A recent survey shows that ''Improve IT quality'' is one of the top concerns facing IT executives. As IT quality is a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Management Information Systems

ACM Transactions on Management Information Systems Volume 9, Issue 3

Research Commentary and Regular Papers

September 2018

106 pages

ISSN:2158-656X

EISSN:2158-6578

DOI:10.1145/3281626

Editor:
Daniel Zeng
University of Arizona, USA

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 September 2018

Accepted: 01 May 2018

Revised: 01 May 2018

Received: 01 May 2017

Published in TMIS Volume 9, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Italian National Research Council (CNR-ISTC)
Consorzio Interuniversitario Nazionale per l'Informatica (CINI)

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
651
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)9

Reflects downloads up to 24 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Russo D(2024)Navigating the Complexity of Generative AI Adoption in Software EngineeringACM Transactions on Software Engineering and Methodology10.1145/365215433:5(1-50)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3652154
Verwijs CRusso D(2023)A Theory of Scrum Team EffectivenessACM Transactions on Software Engineering and Methodology10.1145/357184932:3(1-51)Online publication date: 27-Apr-2023
https://dl.acm.org/doi/10.1145/3571849
Ali FUsman MAbrar MRahman SKhan INiazi B(2023)Practices of De-Motivators in Adopting Agile Software Development Methods at Large Scale Development Teams From Management PerspectiveIEEE Access10.1109/ACCESS.2023.333175911(130368-130390)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3331759
Cucolaş ARusso D(2023)The impact of working from home on the success of Scrum projects: A multi-method studyJournal of Systems and Software10.1016/j.jss.2022.111562197(111562)Online publication date: Mar-2023
https://doi.org/10.1016/j.jss.2022.111562
Zangerle EBauer C(2022)Evaluating Recommender Systems: Survey and FrameworkACM Computing Surveys10.1145/355653655:8(1-38)Online publication date: 23-Dec-2022
https://dl.acm.org/doi/10.1145/3556536
Werder KRamesh BZhang R(2022)Establishing Data Provenance for Responsible Artificial Intelligence SystemsACM Transactions on Management Information Systems10.1145/350348813:2(1-23)Online publication date: 10-Mar-2022
https://dl.acm.org/doi/10.1145/3503488
Liu ZSampaio PPishchulov GMehandjiev NCisneros-Cabrera SSchirrmann AJiru FBnouhanna N(2022)The architectural design and implementation of a digital platform for Industry 4.0 SME collaborationComputers in Industry10.1016/j.compind.2022.103623138:COnline publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1016/j.compind.2022.103623
UMAROH SBARMAWI M(2021)DeLone and McLean Model of Academic Information System SuccessElectrotehnica, Electronica, Automatica10.46904/eea.21.69.2.110801169:2(92-101)Online publication date: 15-May-2021
https://doi.org/10.46904/eea.21.69.2.1108011
Russo D(2021)The Agile Success ModelACM Transactions on Software Engineering and Methodology10.1145/346493830:4(1-46)Online publication date: 23-Jul-2021
https://dl.acm.org/doi/10.1145/3464938
Theunissen Tvan Heesch UAvgeriou P(2021)A mapping study on documentation in Continuous Software DevelopmentInformation and Software Technology10.1016/j.infsof.2021.106733(106733)Online publication date: Oct-2021
https://doi.org/10.1016/j.infsof.2021.106733
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents