skip to main content
10.1145/3184558.3191611acmotherconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article
Free access

Pitfalls of Affective Computing: How can the automatic visual communication of emotions lead to harm, and what can be done to mitigate such risks

Published: 23 April 2018 Publication History

Abstract

What would happen in a world where people could "see'' others' hidden emotions directly through some visualizing technology Would lies become uncommon and would we understand each other better Or to the contrary, would such forced honesty make it impossible for a society to exist The science fiction television show Black Mirror has exposed a number of darker scenarios in which such futuristic technologies, by blurring the lines of what is private and what is not, could also catalyze suffering. Thus, the current paper first turns an eye towards identifying some potential pitfalls in emotion visualization which could lead to psychological or physical harm, miscommunication, and disempowerment. Then, some countermeasures are proposed and discussed--including some level of control over what is visualized and provision of suitably rich emotional information comprising intentions--toward facilitating a future in which emotion visualization could contribute toward people's well-being. The scenarios presented here are not limited to web technologies, since one typically thinks about emotion recognition primarily in the context of direct contact. However, as interfaces develop beyond today's keyboard and monitor, more information becomes available also at a distance--for example, speech-to-text software could evolve to annotate any dictated text with a speaker's emotional state.

References

[1]
{n. d.}. Black Mirror episode explanation. ({n. d.}). en.wikipedia.org/wiki/Black_Mirror
[2]
{n. d.}. EU General Data Protection Regulation (GDPR). ({n. d.}). https://www. eugdpr.org/
[3]
{n. d.}. Fear-Based Anger Is the Primary Motive for Violence. ({n. d.}). https://www.psychologytoday.com/blog/wicked-deeds/201707/ fear-based-anger-is-the-primary-motive-violence
[4]
Robert Agnew. 2006. General strain theory: Current status and directions for further research. Taking stock: The status of criminological theory 15 (2006), 101--123.
[5]
T. B. Brown, D. Mané, A. Roy, M. Abadi, and J. Gilmer. 2017. Adversarial Patch. ArXiv e-prints (Dec. 2017). arXiv:cs.CV/1712.09665
[6]
Joseph Bullington. 2005. Affective Computing and Emotion Recognition Systems: The Future of Biometric Surveillance. In Proceedings of the 2Nd Annual Conference on Information Security Curriculum Development (InfoSecCD '05). ACM, New York, NY, USA, 95--99.
[7]
Martin Cooney, Shuichi Nishio, and Hiroshi Ishiguro. 2015. Affectionate interaction with a small humanoid robot capable of recognizing social touch behavior. ACM Transactions on Interactive Intelligent Systems (TiiS) 4, 4 (2015), 19.
[8]
Martin D Cooney, Shuichi Nishio, and Hiroshi Ishiguro. 2015. Importance of touch for conveying affection in a multimodal interaction with a small humanoid robot. International Journal of Humanoid Robotics 12, 01 (2015), 1550002.
[9]
Roddy Cowie. 2015. Ethical Issues in Affective Computing. (2015). http://www.oxfordhandbooks.com/view/10.1093/oxfordhb/9780199942237.001. 0001/oxfordhb-9780199942237-e-006
[10]
Paul Ekman and Wallace V Friesen. 1969. Nonverbal leakage and clues to deception. Psychiatry 32, 1 (1969), 88--106.
[11]
Thomas Grote and Oliver Korn. 2017. Risks and Potentials of Affective Computing. An Interdisciplinary View on the ACM Code of Ethics. In CHI 2017 workshop on Ethical Encounters in HCI.
[12]
Nick Haslam. 2006. Dehumanization: An integrative review. Personality and social psychology review 10, 3 (2006), 252--264.
[13]
Jeff T Larsen, A Peter McGraw, and John T Cacioppo. 2001. Can people feel happy and sad at the same time Journal of personality and social psychology 81, 4 (2001), 684.
[14]
Hong-Wei Ng, Viet Dung Nguyen, Vassilios Vonikakis, and Stefan Winkler. 2015. Deep Learning for Emotion Recognition on Small Datasets Using Transfer Learning. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction (ICMI '15). ACM, New York, NY, USA, 443--449.
[15]
Kohei Ogawa, Koichi Taura, and Hiroshi Ishiguro. 2012. Possibilities of androids as poetry-reciting agent. In RO-MAN, 2012 IEEE. IEEE, 565--570.
[16]
Masaru Ohkubo, Miki Yamamura, Hiroko Uchiyama, and Takuya Nojima. 2014. Breathing clothes: artworks using the hairlytop interface. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology. ACM, 39.
[17]
Catherine ONeill. 2016. Weapons of Math Destruction. How Big Data Increases Inequality and Threatens Democracy (2016).
[18]
Rebeccah Pailes-Friedman. 2015. BioWear: a kinetic accessory that communicates emotions through wearable technology. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers. ACM, 627--633.
[19]
Rosalind W Picard. 1995. Affective Computing-MIT Media Laboratory Perceptual Computing Section Technical Report No. 321. Cambridge, MA 2139 (1995).
[20]
Rosalind W. Picard and Jennifer Healey. 1997. Affective wearables. Personal Technologies 1, 4 (01 Dec 1997), 231--240.
[21]
Isabella Poggi, Francesca DErrico, and Laura Vincze. 2010. Types of Nods. The Polysemy of a Social Signal. In LREC.
[22]
Anas Samara, Maria Luiza Recena Menezes, and Leo Galway. 2016. Feature Extraction for Emotion Recognition and Modelling Using Neurophysiological Data. In Ubiquitous Computing and Communications and 2016 International Symposium on Cyberspace and Security (IUCC-CSS), International Conference on. IEEE, 138--144.
[23]
Erica Scharrer. 2008. Media exposure and sensitivity to violence in news reports: Evidence of desensitization Journalism & Mass Communication Quarterly 85, 2 (2008), 291--310.
[24]
Amanda Sharkey and Natalie Wood. 2014. The Paro seal robot: demeaning or enabling. In Proceedings of AISB, Vol. 36.
[25]
Alessandro Vinciarelli, Hugues Salamin, and Maja Pantic. 2009. Social signal processing: Understanding social interactions through nonverbal behavior analysis. In Computer Vision and Pattern Recognition Workshops, 2009. CVPR Workshops 2009. IEEE Computer Society Conference on. IEEE, 42--49.

Cited By

View all
  • (2023)Spatio-Temporal Graph Analytics on Secondary Affect Data for Improving Trustworthy Emotional AIIEEE Transactions on Affective Computing10.1109/TAFFC.2023.329669515:1(30-49)Online publication date: 20-Jul-2023
  • (2023)Ethical considerations in emotion recognition technologies: a review of the literatureAI and Ethics10.1007/s43681-023-00307-3Online publication date: 20-Jun-2023
  • (2022)Understanding Privacy Risks and Perceived Benefits in Open Dataset Collection for Mobile Affective ComputingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346236:2(1-26)Online publication date: 7-Jul-2022
  • Show More Cited By

Index Terms

  1. Pitfalls of Affective Computing: How can the automatic visual communication of emotions lead to harm, and what can be done to mitigate such risks

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        WWW '18: Companion Proceedings of the The Web Conference 2018
        April 2018
        2023 pages
        ISBN:9781450356404
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        • IW3C2: International World Wide Web Conference Committee

        In-Cooperation

        Publisher

        International World Wide Web Conferences Steering Committee

        Republic and Canton of Geneva, Switzerland

        Publication History

        Published: 23 April 2018

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. affective computing
        2. black mirror
        3. emotion visualization
        4. ethics
        5. intention recognition
        6. privacy

        Qualifiers

        • Research-article

        Funding Sources

        • Swedish Knowledge Foundation

        Conference

        WWW '18
        Sponsor:
        • IW3C2
        WWW '18: The Web Conference 2018
        April 23 - 27, 2018
        Lyon, France

        Acceptance Rates

        Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)422
        • Downloads (Last 6 weeks)36
        Reflects downloads up to 13 Sep 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2023)Spatio-Temporal Graph Analytics on Secondary Affect Data for Improving Trustworthy Emotional AIIEEE Transactions on Affective Computing10.1109/TAFFC.2023.329669515:1(30-49)Online publication date: 20-Jul-2023
        • (2023)Ethical considerations in emotion recognition technologies: a review of the literatureAI and Ethics10.1007/s43681-023-00307-3Online publication date: 20-Jun-2023
        • (2022)Understanding Privacy Risks and Perceived Benefits in Open Dataset Collection for Mobile Affective ComputingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346236:2(1-26)Online publication date: 7-Jul-2022
        • (2022)CalmResponses: Displaying Collective Audience Reactions in Remote CommunicationProceedings of the 2022 ACM International Conference on Interactive Media Experiences10.1145/3505284.3529959(193-208)Online publication date: 21-Jun-2022
        • (2021)Guidelines for Assessing and Minimizing Risks of Emotion Recognition Applications2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII52823.2021.9597452(1-8)Online publication date: 28-Sep-2021
        • (2020)Security and Ethical Concerns of Affective Algorithmic Music Composition in Smart SpacesModern Theories and Practices for Cyber Ethics and Security Compliance10.4018/978-1-7998-3149-5.ch012(193-203)Online publication date: 2020
        • (2019)Affective Computing for Enhancing Affective Touch-Based Communication Through Extended RealityComputational Science and Its Applications – ICCSA 201910.1007/978-3-030-24296-1_29(351-360)Online publication date: 29-Jun-2019
        • (2018)Design for an Art Therapy Robot: An Explorative Review of the Theoretical Foundations for Engaging in Emotional and Creative Painting with a RobotMultimodal Technologies and Interaction10.3390/mti20300522:3(52)Online publication date: 3-Sep-2018

        View Options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Get Access

        Login options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media