Work in Progress

Towards a Human-Centred Artificial Intelligence Maturity Model

Authors:

Maria Hartikainen,

Kaisa Väänänen,

Thomas OlssonAuthors Info & Claims

CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

Article No.: 285, Pages 1 - 7

https://doi.org/10.1145/3544549.3585752

Published: 19 April 2023 Publication History

Abstract

Artificial intelligence (AI) is becoming a central building block of computational systems. Following the long traditions of human-centered design, Human-Centered AI (HCAI) emphasises the importance of putting humans and various societal considerations in the centre of the development. However, the question is: how to realise HCAI when designing systems that utilise novel computational tools and require consideration of increasingly broad set of requirements, spanning from fairness and transparency to accountability and ethics? The purpose of our study is to support the AI development practices in companies in order for the humans to have AI solutions that are efficient, trustworthy, and safe. To this end, we propose a maturity model for HCAI (HCAI-MM). In this paper we present the first phase of the model development, in which the central building blocks of HCAI are specified and initial company requirements for the model's structure and content are evaluated with four AI developers.

Supplementary Material

MP4 File (3544549.3585752-talk-video.mp4)

Pre-recorded Video Presentation

Download
56.05 MB

MP4 File (3544549.3585752-video-figure.mp4)

Video Figure

Download
56.05 MB

References

[1]

Alsheiabni, Sulaiman, Yen Cheung, and Chris Messom. 2019. Towards An Artificial Intelligence Maturity Model: From Science Fiction To Business Facts. In Proceedings of PACIS 2019.

[2]

Amershi, Saleema, Andrew Begel, Christian Bird, Robert DeLine, Harald Gall, Ece Kamar, Nachiappan Nagappan, Besmira Nushi, and Thomas Zimmermann. 2019. Software engineering for machine learning: A case study. In Proceedings of the 41st International Conference on Software Engineering: Software Engineering in Practise.

Digital Library

[3]

Auernhammer, Jan. 2020. Human-centered AI: The role of Human-centered Design Research in the development of AI. In Synergy - DRS International Conference.

[4]

Becker, Jörg, Ralf Knackstedt, and Jens Pöppelbuß. 2009. Developing maturity models for IT management. Business & Information Systems Engineering 1:3. 213-222.

[5]

van Berkel, Niels, Benjamine Tag, Jorge Goncalves, and Simo Hosio. 2020. Human-centred artificial intelligence: a contextual morality perspective. Behaviour & Information Technology. 1-17.

[6]

Braun, Virginia, and Victoria Clarke. 2012. Thematic analysis. APA handbook of research methods in psychology, Vol. 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. American Psychological Association, Washington.

[7]

De Bruin, Tonia, Michael Rosemann, Ronald Freeze, and Uday Kaulkarni. 2005. Understanding the main phases of developing a maturity assessment model. In Australasian Conference on Information Systems (ACIS). 8-19.

[8]

Bingley, William J., Caitlin Curtis, Steven Lockey, Alina Bialkowski, Nicole Gillespie, S. Alexander Haslam, Ryan KL Ko, Niklas Steffens, Janet Wiles, and Peter Worthy. 2022. Where is the human in human-centered AI? Insights from developer priorities and user experiences. Computers in Human Behavior: 107617.

[9]

Dellermann, Dominik, Adrian Calma, Nikolaus Lipusch, Thorsten Weber, Sascha Weigel, and Philipp Ebel. 2021. The future of human- AI collaboration: a taxonomy of design knowledge for hybrid intelligence systems. arXiv preprint arXiv:2105.03354.

[10]

Dignum, Virginia. 2019. HumanE AI. Project report. Retrieved Jan 10, 2022, from https://www.humane-ai.eu/wp- content/uploads/2019/11/D13-HumaneAI-framework-report.pdf

[11]

Ehsan, Upol, and Mark O. Riedl. 2020. Human-Centered Explainable AI: Towards a Reflective Sociotechnical Approach. In International Conference on Human-Computer Interaction. Springer, Cham, 449-466.

Digital Library

[12]

Feuerriegel, Stefan, Mateusz Dolata, and Gerhard Schwabe. 2020. Fair AI: Challenges and Opportunities. Business & information systems engineering 62:4. 379-384.

[13]

Giacomin, Joseph. 2014. What is human centred design? The Design Journal 17, 4 (2014): 606-623.

[14]

Hagendorff, Thilo. 2020. The ethics of AI ethics: An evaluation of guidelines. Minds and Machines 30, 1 (2020). 99-120.

Digital Library

[15]

Hartikainen, Maria, Kaisa Väänänen, Anu Lehtiö, Saara Ala-Luopa, and Thomas Olsson. 2022. Human-Centered AI Design in Reality: A Study of Developer Companies’ Practices: A study of Developer Companies’ Practices. In Nordic Human-Computer Interaction Conference. 1-11.

Digital Library

[16]

Hesenius, Marc, Nils Schwenzfeier, Ole Meyer, Wilhelm Koop, and Volker Gruhn. 2019. Towards a software engineering process for developing data-driven applications. In Proceedings of 7th International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering. ACM, Montreal, 35-41.

Digital Library

[17]

Hill, Charles, Bellamy, Rachel, Erickson, Thomas, and Burnett, Margaret. 2016. Trials and Tribulations of Developers of Intelligent Systems: A Field Study. In 2016 IEEE Symposium on Visual Languages and Human-Centric Computing.162-170.

[18]

IBM Design for AI. Retrieved Jan 2, 2022 from https://www.ibm.com/design/ai/

[19]

Microsoft Responsible AI. Retrieved Jan 2, 2022 from https://www.microsoft.com/en-us/ai/responsible-ai-resources

[20]

PAIR with Google. People + AI Research. Retrieved Jan 3, 2022 from https://pair.withgoogle.com.

[21]

Passi, Samir and Steven J. Jackson. 2018. Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects. Proceedings of the ACM on Human-Computer Interaction, 2. 1-28.

Digital Library

[22]

Perrault, R., Shoham, Y., Brynjolfsson, E., Clark, J., Etchemendy, J., Grosz, B., Lyons, T.,Manyika, J., Niebles, J. C. and S. Mishra. 2019. The AI Index 2019 Annual Report. AI Index Steering Committee. Human-Centered AI Institute. Stanford University.

[23]

Pöppelbuß, Jens, and Maximilian Röglinger. 2011. What makes a useful maturity model? A framework of general design principles for maturity models and its demonstration in business process management. In ECIS 2011 proceedings.

[24]

Sadiq, Raghad Baker, Nurhizam Safie, Abdul Hadi Abd Rahman, and Shidrokh Goudarzi. 2021. Artificial intelligence maturity model: a systematic literature review. PeerJ Computer Science 7. e661.

[25]

Shneiderman, Ben. 2020. Bridging the gap between ethics and practise: Guidelines for reliable, safe, and trustworthy Human-Centered AI systems. ACM Transactions on Interactive Intelligent Systems, 10: 4. 1-31.

Digital Library

[26]

Shneiderman, Ben. 2020. Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy. International Journal of Human–Computer Interaction 36:6. 495-504.

[27]

Wan, Zhiyuan, Xin Xia, David Lo, and Gail C. Murphy. 2019. How Does Machine Learning Change Software Development Practices? IEEE Transactions on Software Engineering, 47:9. 1857-1871.

[28]

Wickramasinghe, Chathurika, S., Daniel L. Marino, Javier Grandio, and Milos Manic. 2020. Trustworthy AI Development Guidelines for Human System Interaction. In International Conference on Human System Interaction. 130-136.

[29]

Wilkens, Uta, Valentin Langholf, Greta Ontrup, and Annette Kluge. 2021. Towards a Maturity Model of Human Centered AI–A Reference for AI Implementation at the Workplace. Forschungsseminar der Wissenschaftlichen Gesellschaft für Arbeits-und Betriebsorganisation (WGAB).

[30]

Xu, Wei. 2019. Toward Human-Centered AI: A Perspective from Human-Computer Interaction. Interactions 26:4. 42-46.

Digital Library

Cited By

Bauroth MRath-Manakidis PLangholf VWiskott LGlasmachers T(2024)tachAId—An interactive tool supporting the design of human-centered AI solutionsFrontiers in Artificial Intelligence10.3389/frai.2024.13541147Online publication date: 12-Mar-2024
https://doi.org/10.3389/frai.2024.1354114
Raftopoulos M(2024)Designing Tiny Robots: Engaging Stakeholders in Collaborative AI System DesignProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3681722(121-132)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3681716.3681722
Kommiya Mothilal RGuha SAhmed S(2024)Towards a Non-Ideal Methodological Framework for Responsible MLProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642501(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642501
Show More Cited By

Index Terms

Towards a Human-Centred Artificial Intelligence Maturity Model
1. Computing methodologies
  1. Artificial intelligence
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

What is Human-Centered about Human-Centered AI? A Map of the Research Landscape
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

The application of Artificial Intelligence (AI) across a wide range of domains comes with both high expectations of its benefits and dire predictions of misuse. While AI systems have largely been driven by a technology-centered design approach, the ...
Human-Centered AI Design in Reality: A Study of Developer Companies’ Practices : A study of Developer Companies’ Practices
NordiCHI '22: Nordic Human-Computer Interaction Conference

Human-Centered AI (HCAI) advocates the development of AI applications that are trustworthy, usable, and based on human needs. While the conceptual foundations of HCAI are extensively discussed in recent literature, the industry practices and methods ...
Integrating Agile Development Processes and User Centred Design- A Place for Usability Maturity Models?
HCSE 2014: Proceedings of the 5th IFIP WG 13.2 International Conference on Human-Centered Software Engineering - Volume 8742

The aim of this paper is to explore and evaluate the role that can be played by Usability Maturity Models UMMs in integrating agile processes and User Centred Design UCD. UMMs can be utilised in Agile projects as a diagnostic tool to assess the extent ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

3914 pages

ISBN:9781450394222

DOI:10.1145/3544549

Editors:
Albrecht Schmidt
LMU Munich, Germany
,
Kaisa Väänänen
Tampere University, Finland
,
Tesh Goyal
Google Research, USA
,
Per Ola Kristensson
University of Cambridge, UK
,
Anicia Peters
University of Namibia, Namibia

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
538
Total Downloads

Downloads (Last 12 months)376
Downloads (Last 6 weeks)78

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bauroth MRath-Manakidis PLangholf VWiskott LGlasmachers T(2024)tachAId—An interactive tool supporting the design of human-centered AI solutionsFrontiers in Artificial Intelligence10.3389/frai.2024.13541147Online publication date: 12-Mar-2024
https://doi.org/10.3389/frai.2024.1354114
Raftopoulos M(2024)Designing Tiny Robots: Engaging Stakeholders in Collaborative AI System DesignProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3681722(121-132)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3681716.3681722
Kommiya Mothilal RGuha SAhmed S(2024)Towards a Non-Ideal Methodological Framework for Responsible MLProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642501(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642501
Mamad MChichi O(2024)Towards a Human-Centred Artificial Intelligence in the Age of Industry 5.0: A Cross-Country Analysis2024 11th International Conference on Wireless Networks and Mobile Communications (WINCOM)10.1109/WINCOM62286.2024.10655038(1-6)Online publication date: 23-Jul-2024
https://doi.org/10.1109/WINCOM62286.2024.10655038
Xu WGao Z(2024)Enabling Human-Centered AI: A Methodological Perspective2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS)10.1109/ICHMS59971.2024.10555771(1-6)Online publication date: 15-May-2024
https://doi.org/10.1109/ICHMS59971.2024.10555771
Almenara AElich JSaltiveri T(2024)Past, Present and Future of User-Centred Design Methodologies that Empathise with the User and Generate Better Accessible Experiences. From Theory to PracticeFuture Perspectives on Human-Computer Interaction Research10.1007/978-3-031-71697-3_2(17-43)Online publication date: 25-Oct-2024
https://doi.org/10.1007/978-3-031-71697-3_2
Usmani UHapponen AWatada J(2023)Human-Centered Artificial Intelligence: Designing for User Empowerment and Ethical Considerations2023 5th International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA)10.1109/HORA58378.2023.10156761(1-7)Online publication date: 8-Jun-2023
https://doi.org/10.1109/HORA58378.2023.10156761

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents