Ethics in AI through the practitioner’s view: a grounded theory literature review
Abstract
The term ethics is widely used, explored, and debated in the context of developing Artificial Intelligence (AI) based software systems. In recent years, numerous incidents have raised the profile of ethical issues in AI development and led to public concerns about the proliferation of AI technology in our everyday lives. But what do we know about the views and experiences of those who develop these systems – the AI practitioners? We conducted a grounded theory literature review (GTLR) of 38 primary empirical studies that included AI practitioners’ views on ethics in AI and analysed them to derive five categories: practitioner awareness, perception, need, challenge, and approach. These are underpinned by multiple codes and concepts that we explain with evidence from the included studies. We present a taxonomy of ethics in AI from practitioners’ viewpoints to assist AI practitioners in identifying and understanding the different aspects of AI ethics. The taxonomy provides a landscape view of the key aspects that concern AI practitioners when it comes to ethics in AI. We also share an agenda for future research studies and recommendations for practitioners, managers, and organisations to help in their efforts to better consider and implement ethics in AI.
References
[1]
(2019) AI ethics guidelines global inventory. https://inventory.algorithmwatch.org/about. Accessed 10 Aug 2022
[2]
(2020) How Dutch activists got an invasive fraud detection algorithm banned. https://algorithmwatch.org/en/syri-netherlands-algorithm/. Accessed 22 Aug 2023
[3]
(2021) 193 countries adopt first-ever global agreement on the ethics of artificial intelligence. https://news.un.org/en/story/2021/11/1106612. Accessed 26 Sept 2023
[4]
(2023) Australia’s AI ethics principles. https://www.industry.gov.au/publications/australias-artificial-intelligence-ethics-framework/australias-ai-ethics-principles. Accessed 2 Oct 2023
[5]
Al-Kaswan A, Izadi M (2023) The (AB) use of open source code to train large language models. arXiv:2302.13681
[6]
Alfrink K, Keller I, Doorn N, Kortuem G (2023) Contestable camera cars: a speculative design exploration of public AI that is open and responsive to dispute. In: Proceedings of the 2023 CHI conference on human factors in computing systems. pp 1–16
[7]
Allen GN, Ball NL, Smith HJ (2011) Information systems research behaviors: what are the normative standards? Mis Quarterly pp 533–551
[8]
Anderson M, Anderson SL (2011) Machine ethics. Cambridge University Press
[9]
Aydemir FB, Dalpiaz F (2018) A roadmap for ethics-aware software engineering. In: Proceedings of the international workshop on software fairness. pp 15–21
[10]
Van den Bergh J, Deschoolmeester D (2010) Ethical decision making in ICT: discussing the impact of an ethical code of conduct. Communications of the IBIMA pp 1–10
[11]
Bostrom N, Yudkowsky E (2018) The ethics of artificial intelligence. In: Artificial intelligence safety and security. Chapman and Hall/CRC, pp 57–69
[12]
Bryson J and Winfield A Standardizing ethical design for artificial intelligence and autonomous systems Computer 2017 50 5 116-119
[13]
Buolamwini J, Gebru T (2018) Gender shades: intersectional accuracy disparities in commercial gender classification. In: Conference on fairness, accountability and transparency. PMLR, pp 77–91
[14]
Castelnovo A, Crupi R, Del Gamba G, Greco G, Naseer A, Regoli D, Gonzalez BSM (2020) BeFair: addressing fairness in the banking sector. In: 2020 IEEE international conference on big data (Big Data). IEEE, pp 3652–3661,
[15]
Charmaz K Grounded theory: objectivist and constructivist methods Handb Qual Res 2000 2 1 509-535
[16]
Commission E (2019) Ethics guidelines for trustworthy AI. https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai. Accessed 2 Feb 2024
[17]
Dastin J (2018) Amazon scraps secret AI recruiting tool that showed bias against women. https://www.reuters.com/. Accessed 22 Aug 2023
[18]
Defense (2020) DOD adopts 5 principles of artificial intelligence ethics. https://www.defense.gov/News/News-Stories/article/article/2094085/dod-adopts-5-principles-of-artificial-intelligence-ethics/. Accessed 5 Feb 2024
[19]
Felzmann H, Fosch-Villaronga E, Lutz C, and Tamò-Larrieux A Towards transparency by design for artificial intelligence Sci Eng Ethics 2020 26 6 3333-3361
[20]
Fjeld J, Achten N, Hilligoss H, Nagy A, Srikumar M (2020) Principled artificial intelligence: mapping consensus in ethical and rights-based approaches to principles for AI. Berkman Klein Center Research Publication (2020-1)
[21]
Fleischmann KR, Hui C, and Wallace WA The societal responsibilities of computational modelers: human values and professional codes of ethics J Assoc Inf Sci Technol 2017 68 3 543-552
[22]
Fraga A (2022) An ethical leadership approach for complex systems integrated into the systems engineering practice. In: Emerging trends in systems engineering leadership: practical research from women leaders. Springer, pp 261–280
[23]
Glaser BG (1978) Theoretical sensitivity. University of California
[24]
Gotterbarn D (1991) Computer ethics: responsibility regained. In: National forum, honor society of Phi Kappa Phi, vol 71, p 26
[25]
Goulding C Grounded theory: the missing methodology on the interpretivist agenda Qual Market Res Int J 1998 1 1 50-57
[26]
Hagendorff T The ethics of AI ethics: an evaluation of guidelines Minds Mach 2020 30 1 99-120
[27]
Hall D The ethical software engineer IEEE Soft 2009 26 4 9-10
[28]
Harrington SJ (1996) The effect of codes of ethics and personal denial of responsibility on computer abuse judgments and intentions. MIS quarterly, pp 257–278
[29]
Hidellaarachchi D, Grundy J, Hoda R, and Madampe K The effects of human aspects on the requirements engineering process: a systematic literature review IEEE Trans Softw Eng 2021 48 6 2105-2127
[30]
Hoda R Socio-technical grounded theory for software engineering IEEE Trans Softw Eng 2021 48 10 1-1
[31]
Jameel T, Ali R, Toheed I (2020) Ethics of artificial intelligence: research challenges and potential solutions. In: 2020 3rd international conference on computing, mathematics and engineering technologies (iCoMET). IEEE, pp 1–6.
[32]
Jobin A, Ienca M, and Vayena E The global landscape of AI ethics guidelines Nat Mach Intell 2019 1 9 389-399
[33]
Kazim E, Koshiyama AS (2021) A high-level overview of AI ethics. Patterns 2(9)
[34]
Kelley S (2021) Employee perceptions of effective AI principle adoption. AI Principle Adoption & Implementation
[35]
Kessing M (2021) Fairness in AI: discussion of a unified approach to ensure responsible AI development. Master dissertation, KTH Royal Institute of Technology
[36]
Khan AA, Badshah S, Liang P, Khan B, Waseem M, Niazi M, Akbar MA (2022) Ethics of AI: A systematic literature review of principles and challenges. In: Proceedings of the international conference on evaluation and assessment in software engineering 2022, pp 383–392.
[37]
Kitchenham B, Brereton OP, Budgen D, Turner M, Bailey J, and Linkman S Systematic literature reviews in software engineering-A systematic literature review Inf Softw Technol 2009 51 1 7-15
[38]
Lee PYK, Ma NF, Kim IJ, and Yoon D Speculating on risks of AI clones to selfhood and relationships: Doppelganger-phobia, identity fragmentation, and living memories Proc ACM Hum-Comput Interact 2023 7 CSCW1 1-28
[39]
Leikas J, Koivisto R, and Gotcheva N Ethical framework for designing autonomous intelligent systems J Open Innov Technol Mark Complexity 2019 5 1 18
[40]
Li X, Thelwall M, and Kousha K The role of arXiv, RePEc, SSRN and PMC in formal scholarly communication Aslib J Inf Manag 2015 67 6 614-635
[41]
Lu Q, Zhu L, Xu X, Whittle J, Xing Z (2022) Towards a roadmap on software engineering for responsible AI. In: Proceedings of the 1st international conference on AI engineering: software engineering for AI. pp 101–112
[42]
Madampe K, Hoda R, and Grundy J A faceted taxonomy of requirements changes in agile contexts IEEE Trans Softw Eng 2021
[43]
Mark R and Anya G Ethics of using smart city AI and big data: the case of four large European cities ORBIT J 2019 2 2 1-36
[44]
Metcalf J, Moss E, et al. Owning ethics: corporate logics, silicon valley, and the institutionalization of ethics Soc Res Int Q 2019 86 2 449-476
[45]
Mittelstadt B Principles alone cannot guarantee ethical AI Nat Mach Intell 2019 1 11 501-507
[46]
Möllmann NR, Mirbabaie M, and Stieglitz S Is it alright to use artificial intelligence in digital health? a systematic literature review on ethical considerations Health Inform J 2021 27 4 14604582211052391
[47]
Morley J, Floridi L, Kinsey L, and Elhalal A From what to how: an initial review of publicly available AI ethics tools, methods and research to translate principles into practices Sci Eng Ethics 2020 26 4 2141-2168
[48]
Mukhra R, Baryah N, Krishan K, and Kanchan T ‘blue whale challenge’: a game or crime? Sci Eng Ethics 2019 25 285-291
[49]
Nalini B (2020) The Hitchhiker’s guide to AI ethics. https://towardsdatascience.com/ethics-of-ai-a-comprehensive-primer. Accessed 15 July 2022
[50]
Obermeyer Z and Emanuel EJ Predicting the future-big data, machine learning, and clinical medicine N Engl J Med 2016 375 13 1216
[51]
OECD (2019) OECD AI principles overview. https://oecd.ai/en/ai-principles. Accessed 5 Feb 2024
[52]
Payne D and Landry BJ A uniform code of ethics: business and it professional ethics Commun ACM 2006 49 11 81-84
[53]
Perera H, Hussain W, Whittle J, Nurwidyantoro A, Mougouei D, Shams RA, Oliver G (2020) A study on the prevalence of human values in software engineering publications. In: 2020 IEEE/ACM 42nd international conference on software engineering. pp 409–420,
[54]
Pierce MA and Henry JW Computer ethics: the role of personal, informal, and formal codes J Bus Ethics 1996 15 425-437
[55]
Rashid A, Weckert J, and Lucas R Software engineering ethics in a digital world Computer 2009 42 6 34-41
[56]
Rothenberger L, Fabian B, Arunov E (2019) Relevance of ethical guidelines for artificial intelligence-a survey and evaluation. In: ECIS
[57]
Royakkers L, Timmer J, Kool L, and Van Est R Societal and ethical issues of digitization Ethics Inf Technol 2018 20 127-142
[58]
Ryan M and Stahl BC Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications J Inf Commun Ethics Soc 2020 19 1 61-86
[59]
Sanderson C, Douglas D, Lu Q, Schleiger E, Whittle J, Lacey J, Newnham G, Hajkowicz S, Robinson C, Hansen D (2023) AI ethics principles in practice: perspectives of designers and developers. IEEE Transactions on Technology and Society
[60]
Seah J, Findlay M (2021) Communicating ethics across the AI ecosystem. SMU Centre for AI & Data Governance Research Paper (7)
[61]
Shneiderman B Bridging the gap between ethics and practice: guidelines for reliable, safe, and trustworthy human-centered AI systems ACM Trans Interact Intell Syst 2020 10 4 1-31
[62]
Siau K and Wang W Artificial intelligence ethics: ethics of AI and ethical AI J Database Manag 2020 31 2 74-87
[63]
Smith MJ, Mitchell JA, Blajeski S, Parham B, Harrington MM, Ross B, Sinco B, Brydon DM, Johnson JE, Cuddeback GS, et al. Enhancing vocational training in corrections: a type 1 hybrid randomized controlled trial protocol for evaluating virtual reality job interview training among returning citizens preparing for community re-entry Contemp Clin Trials Commun 2020 19 100604
[64]
Strauss A, Corbin J (1990) Basics of qualitative research. Sage Publications
[65]
Vainio-Pekka H (2020) The role of explainable AI in the research field of AI ethics: systematic mapping study. Master dissertation, University of Jyväskylä
[66]
Vakkuri V, Kemell KK, Abrahamsson P (2020a) ECCOLA- A method for implementing ethically aligned AI systems. In: 2020 46th Euromicro conference on software engineering and advanced applications (SEAA). IEEE, pp 195–204.
[67]
Vakkuri V, Kemell KK, Kultanen J, and Abrahamsson P The current state of industrial practice in artificial intelligence ethics IEEE Softw 2020 37 4 50-57
[68]
Vakkuri V, Jantunen M, Halme E, Kemell KK, Nguyen-Duc A, Mikkonen T, Abrahamsson P (2021) Time for AI (ethics) maturity model is now. arXiv:2101.12701,
[69]
Varanasi RA, Goyal N (2023) “It is currently hodgepodge”: examining AI/ML practitioners’ challenges during co-production of responsible AI values. In: Proceedings of the 2023 CHI conference on human factors in computing systems. pp 1–17
[70]
Veale M, Van Kleek M, Binns R (2018) Fairness and accountability design needs for algorithmic support in high-stakes public sector decision-making. In: Proceedings of the 2018 chi conference on human factors in computing systems. pp 1–14
[71]
Wiese LJ, Schiff DS, Magana AJ (2023) Being proactive for responsible AI: analyzing multiple sectors for innovation via systematic literature review. In: 2023 IEEE international symposium on ethics in engineering, science, and technology (ETHICS). IEEE, pp 1–1
[72]
Wohlin C (2014) Guidelines for snowballing in systematic literature studies and a replication in software engineering. In: Proceedings of the 18th international conference on evaluation and assessment in software engineering. pp 1–10.
[73]
Wolfswinkel JF, Furtmueller E, and Wilderom CP Using grounded theory as a method for rigorously reviewing literature Eur J Inf Syst 2013 22 1 45-55
Recommendations
Integrating AI ethics in wildlife conservation AI systems in South Africa: a review, challenges, and future research agenda
AbstractWith the increased use of Artificial Intelligence (AI) in wildlife conservation, issues around whether AI-based monitoring tools in wildlife conservation comply with standards regarding AI Ethics are on the rise. This review aims to summarise ...
Why Machine Ethics?
Machine ethics, machine morality, artificial morality, and computational ethics are all terms for an emerging field of study that seeks to implement moral decision-making faculties in computers and robots. Machine ethics is not merely science fiction ...
The Role of Explainable AI in the Research Field of AI Ethics
Ethics of Artificial Intelligence (AI) is a growing research field that has emerged in response to the challenges related to AI. Transparency poses a key challenge for implementing AI ethics in practice. One solution to transparency issues is AI systems ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© The Author(s) 2024.
Publisher
Kluwer Academic Publishers
United States
Publication History
Published: 06 May 2024
Accepted: 13 February 2024
Author Tags
Qualifiers
- Research-article
Funding Sources
- Monash University
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 24 Oct 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in