research-article

Multi-Purposeful Activities for Robot-Assisted Autism Therapy: What Works Best for Children's Social Outcomes?

Authors:

Aida Zhanatkyzy,

Zhansaule Telisheva,

Nazerke Rakhymbayeva,

Anara SandygulovaAuthors Info & Claims

HRI '23: Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

Pages 34 - 43

https://doi.org/10.1145/3568162.3576963

Published: 13 March 2023 Publication History

Abstract

This research designed and applied 24 multi-purposeful robot activities of varying social mediation levels in a multiple-session experiment with 34 children of diverse autistic characteristics in a rehabilitation setting. This paper explores what type of robot activities can meet individual needs to bring more socio-behavioral progress and juxtaposes child characteristics to identify behavioral outcomes in each activity. This knowledge would help us to respond to the question of what activity types suit specific subgroups of Autism Spectrum Disorder (ASD). Our data analysis included coding 48.5 hours of video data for a total of 14 measures to fully capture children's activity-based socio-emotional outcomes. Overall, the activities on varying social mediation levels brought more or less positive social outcomes to all children. However, children showed some different behavioral outcomes as mediated by core autism-related and age-specific characteristics. This study provides in-depth accounts of what might be helpful in designing and applying multi-purposeful activities responsive to the diverse needs of children.

References

[1]

M. de Vries and H. Geurts, "Influence of autism traits and executive functioning on quality of life in children with an autism spectrum disorder," Journal of autism and developmental disorders, vol. 45, 2015.

[2]

J. L. Matson, T. Dempsey, and J. C. Fodstad, "The effect of autism spectrum disorders on adaptive independent living skills in adults with severe intellectual disability." Research in developmental disabilities, vol. 30 6, pp. 1203--11, 2009.

[3]

R. Landa, "Early communication development and intervention for children with autism," Mental retardation and developmental disabilities research reviews, vol. 13, pp. 16--25, 2007.

[4]

K. Gotham, A. Pickles, and C. Lord, "Standardizing ados scores for a measure of severity in autism spectrum disorders," Journal of autism and developmental disorders, vol. 39, no. 5, pp. 693--705, 2009.

[5]

K. D. Gadow, C. J. DeVincent, J. Pomeroy, and A. Azizian, "Psychiatric symptoms in preschool children with pdd and clinic and comparison samples," J Autism Dev Disord, vol. 34, no. 4, pp. 379--393, August 2004.

[6]

B. Tleubayev, Z. Zhexenova, A. Zhakenova, and A. Sandygulova, "Robot-assisted therapy for children with adhd and asd: a pilot study," in Proceedings of the 2019 2nd International Conference on Service Robotics Technologies. ACM, 2019, pp. 58--62.

[7]

Y. Rong, C. Yang, Y. Jin, and Y. Wang, "Prevalence of attention- deficit/hyperactivity disorder in individuals with autism spectrum disorder: A meta-analysis," Research in Autism Spectrum Disorders, vol. 83, p. 101759, 2021.

[8]

J. M. J. van der Meer, A. M. Oerlemans, D. J. van Steijn, M. G. A. Lappenschaar, L. M. J. de Sonneville, J. K. Buitelaar, and N. N. J. Rommelse, "Are autism spectrum disorder and attention-deficit/hyperactivity disorder different manifestations of one overarching disorder? cognitive and symptom evidence from a clinical and population-based sample." J Am Acad Child Adolesc Psychiatry, vol. 51, no. 11, pp. 1160--1172, 2012.

[9]

P. Andersen, K. Hovik, E. Skogli, and M. Øie, "Severity of autism symptoms and degree of attentional difficulties predicts emotional and behavioral problems in children with high-functioning autism; a two-year follow-up study." Frontiers in Psychology, vol. 8, 2017.

[10]

H. Tager-Flusberg and C. Kasari, "Minimally verbal school-aged children with autism spectrum disorder: The neglected end of the spectrum," Autism research: official journal of the International Society for Autism Research, vol. 6, 12 2013.

[11]

A. McKinney, E. J. Weisblatt, K. L. Hotson, Z. B. Ahmed, C. Días, D. BenShalom, J. L. H. Foster, S. Murphy, S. S. Villar, and M. K. Belmonte, "Overcoming hurdles to intervention studies with autistic children with profound communication difficulties and their families," Autism, vol. 25, pp. 1627--1639, 2021.

[12]

K. Dautenhahn, "Roles and functions of robots in human society: implications from research in autism therapy," Robotica, vol. 21, no. 4, p. 443--452, 2003.

Digital Library

[13]

B. Scassellati, "How social robots will help us to diagnose, treat, and understand autism," in Robotics Research, S. Thrun, R. Brooks, and H. Durrant-Whyte, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 2007, pp. 552--563.

[14]

N. Rakhymbayeva, A. Amirova, and A. Sandygulova, "A long-term engagement with a social robot for autism therapy." Frontiers in robotics and AI, p. 669972, 2021.

[15]

I. van den Berk-Smeekens, M. van Dongen-Boomsma, M. W. P. de Korte, J. C. den Boer, I. Oosterling, N. C. Peters-Scheffer, J. K. Buitelaar, E. I. Barakova, T. Lourens, W. G. Staal, and J. C. Glennon, "Adherence and acceptability of a robot-assisted pivotal response treatment protocol for children with autism spectrum disorder," Scientific Reports, vol. 10, 2020.

[16]

S.-S. Yun, J. Choi, S.-K. Park, G.-Y. Bong, and H. Yoo, "Social skills training for children with autism spectrum disorder using a robotic behavioral intervention system: Social skills training for children with asd," Autism Research, vol. 10, 2017.

[17]

W. Cao, W. Song, X. Li, S. Zheng, G. Zhang, Y. Wu, S. He, H. Zhu, and J. Chen, "Interaction with social robots: Improving gaze toward face but not necessarily joint attention in children with autism spectrum disorder," Frontiers in Psychology, vol. 10, 2019.

[18]

D. O. David, C. A. Costescu, S. A. Matu, A. Szentágotai, and A. Dobrean, "Effects of a robot-enhanced intervention for children with asd on teaching turn-taking skills," Journal of Educational Computing Research, vol. 58, pp. 29--62, 2019.

[19]

J. M. Beer, M. Boren, and K. R. Liles, "Robot assisted music therapy a case study with children diagnosed with autism," in 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2016, pp. 419--420.

[20]

A. Taheri, A. Shariati, R. Heidari, M. Shahab, M. Alemi, and A. Meghdari, "Impacts of using a social robot to teach music to children with low-functioning autism," Journal of Behavioral Robotics, vol. 12, pp. 256--275, 2021.

[21]

B. Robins and K. Dautenhahn, "Tactile interactions with a humanoid robot: Novel play scenario implementations with children with autism," International Journal of Social Robotics, vol. 6, pp. 397--415, 2014.

[22]

B. Scassellati, L. Boccanfuso, C.-M. Huang, M. Mademtzi, M. Qin, N. Salomons, P. Ventola, and F. Shic, "Improving social skills in children with asd using a long-term, in-home social robot," Science Robotics, vol. 3, 2018.

[23]

B. Robins, N. Otero, E. Ferrari, and K. Dautenhahn, "Eliciting requirements for a robotic toy for children with autism - results from user panels," 2007, pp. 101--106.

[24]

G. Walker and J. Weidenbenner, "Social and emotional learning in the age of virtual play: technology, empathy, and learning," Journal of Research in Innovative Teaching & Learning, vol. 12, 2019.

[25]

M. Flavia, P. Chilà, S. Sfrazzetto, C. Carrozza, I. Crimi, C. Failla, M. Busà, G. Bernava, G. Tartarisco, D. Vagni, L. Ruta, and G. Pioggia, "Outcomes of a robot-assisted social-emotional understanding intervention for young children with autism spectrum disorders," Journal of Autism and Developmental Disorders, vol. 50, p. 1973--1987, 2020.

[26]

O. O. Rudovic, J. Lee, L. Mascarell-Maricic, B. W. Schuller, and R. W. Picard, "Measuring engagement in robot-assisted autism therapy: A cross-cultural study," Front. Robot. AI, vol. 4, no. 36, July 2017. [Online]. Available: https://doi.org/10.3389/frobt.2017.00036

[27]

M. J. Salvador, S. Silver, and M. H. Mahoor, "An emotion recognition comparative study of autistic and typically-developing children using the zeno robot," in 2015 IEEE International Conference on Robotics and Automation (ICRA), 2015, pp. 6128--6133.

[28]

S. Costa, F. Soares, A. P. Pereira, C. Santos, and A. Hiolle, "Building a game scenario to encourage children with autism to recognize and label emotions using a humanoid robot," in The 23rd IEEE International Symposium on Robot and Human Interactive Communication, 2014, pp. 820--825.

[29]

C. Pop, R. Simut, S. Pintea, J. Saldien, A. Rusu, D. O. David, J. Vanderfaeillie, D. Lefeber, and B. Vanderborght, "Can the social robot probo help children with autism to identify situation-based emotions? a series of single case experiments," Int. J. Humanoid Robotics, vol. 10, 2013.

[30]

B. Scassellati, H. Admoni, and M. Matarić, ?Robots for use in autism research," Annual review of biomedical engineering, vol. 14, pp. 275--94, 2012.

[31]

W. C. So, C.-H. Cheng, W.-W. Law, T. Wong, C. Lee, F.-Y. Kwok, S.-H. Lee, and K.-Y. Lam, "Robot dramas may improve joint attention of chinese-speaking low-functioning children with autism: stepped wedge trials." Disability and rehabilitation. Assistive technology, pp. 1--10, 2020.

[32]

A. Taheri, A. F. Meghdari, M. Alemi, and H. Pouretemad, "Clinical interventions of social humanoid robots in the treatment of a set of high-and low-functioning autistic iranian twins," Scientia Iranica, vol. 25, pp. 1197--1214, 2017.

[33]

A. Taheri, A. F. Meghdari, and M. H. Mahoor, "A close look at the imitation performance of children with autism and typically developing children using a robotic system," International Journal of Social Robotics, vol. 13, pp. 1125--1147, 2021.

[34]

B. Ingersoll, "The social role of imitation in autism: Implications for the treatment of imitation deficits," Infants & Young Children, vol. 21, p. 107--119, 2008.

[35]

S. R. Rieth, A. C. Stahmer, J. Suhrheinrich, L. Schreibman, J. Kennedy, and B. Ross, "Identifying critical elements of treatment," Focus on Autism and Other Developmental Disabilities, vol. 29, pp. 168--179, 2014.

[36]

S. Kim and E. Clarke, "Case study: An ipad-based intervention on turn-taking behaviors in preschoolers with autism." The Behavioral Development Bulletin, vol. 20, pp. 253--264, 2015.

[37]

K. Arent, D. Brown, J. Kruk-Lasocka, T. Niemiec, A. Pasieczna, P. Standen, and R. Szczepanowski, "The use of social robots in the diagnosis of autism in preschool children," Applied Sciences, vol. 12, p. 8399, 08 2022.

[38]

C. Robertson and S. Baron-Cohen, "Sensory perception in autism," Nature reviews. Neuroscience, vol. 18, pp. 671--684, 09 2017.

[39]

S. Leekam, C. Nieto, S. Libby, L. Wing, and J. Gould, "Describing the sensory abnormalities of children and adults with autism," Journal of autism and developmental disorders, vol. 37, pp. 894--910, 2007.

[40]

B. Robins and K. Dautenhahn, "Developing play scenarios for tactile interaction with a humanoid robot: A case study exploration with children with autism," in ICSR, 2010.

[41]

A. Bhat, "Is motor impairment in autism spectrum disorder (asd) distinct from de- velopmental coordination disorder (dcd)? a report from the spark study," Physical therapy, vol. 100, p. 633--644, 2020.

[42]

M. J. P. Bernal, N. Céspedes, P. Castro, M. C. Múnera, and C. A. Cifuentes, "Physical human-robot interaction influence in asd therapy through an affordable soft social robot," J. Intell. Robotic Syst., vol. 105, p. 67, 2022.

Digital Library

[43]

W. C. So, M. K.-Y. Wong, Y. Wong, W.-Y. Lam, C.-H. Cheng, S.-Y. Ku, K.-Y. Lam, Y. Huang, and W. L. Wong, "Who is a better teacher for children with autism? comparison of learning outcomes between robot-based and human-based interventions in gestural production and recognition," Research in developmental disabilities, vol. 86, 01 2019.

[44]

A. Sandygulova, Z. Zhexenova, B. Tleubayev, A. Nurakhmetova, D. Zhumabekova, I. Assylgali, Y. Rzagaliyev, and A. Zhakenova, ?Interaction design and methodology of robot-assisted therapy for children with severe asd and adhd," Paladyn, Journal of Behavioral Robotics, vol. 10, no. 1, pp. 330--345, 2019.

[45]

J. B. Leaf, J. H. Cihon, J. L. Ferguson, and S. M. Weinkauf, An Introduction to Applied Behavior Analysis. Cham: Springer International Publishing, 2017, pp. 25--42. [Online]. Available: https://doi.org/10.1007/978-3-319-71210-9_3

[46]

D. Bulgarelli and N. Bianquin, Play, Dreams and Imitation in Childhood. London. UK: Taylor & Francis, 1945.

[47]

C. Garvey, Play. Cambridge, MA: Harvard University Press, 1990.

[48]

D. Bulgarelli and N. Bianquin, 3 Conceptual Review of Play. De Gruyter Open Poland, 2017, pp. 58--70. [Online]. Available: https://doi.org/10.1515/ 9783110522143-005

[49]

C. Lord, R. Luyster, K. Gotham, and W. Guthrie, Autism Diagnostic Observation Schedule, 2nd ed. Toddler module. Torrance, CA: Western Psychological Services, 2012.

[50]

A. Amirova, N. Rakhymbayeva, E. Yadollahi, A. Sandygulova, and W. Johal, "10 years of human-nao interaction research: A scoping review," Frontiers in Robotics and AI, vol. 8, p. 744526, 2021.

[51]

E. Kim, R. Paul, F. Shic, and B. Scassellati, "Bridging the research gap: Making hri useful to individuals with autism," Journal of Human-Robot Interaction, vol. 1, 08 2012.

[52]

C. A. Pop, S. Pintea, B. Vanderborght, and D. O. David, "Enhancing play skills, engagement and social skills in a play task in asd children by using robot-based interventions. a pilot study," Interaction Studies, vol. 15, no. 2, pp. 292--320, 2014. [Online]. Available: https://www.jbe-platform.com/content/journals/10.1075/is.15.2.14pop

[53]

C. M. Stanton, P. H. Kahn, R. L. Severson, J. H. Ruckert, and B. T. Gill, "Robotic animals might aid in the social development of children with autism," in 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2008, pp. 271--278.

[54]

H. Admoni, C. Bank, J. Tan, M. Toneva, and B. Scassellati, "Robot gaze does not reflexively cue human attention," in CogSci, 2011. [Online]. Available: https://mindmodeling.org/cogsci2011/papers/0454/index.html

[55]

C. A. Pop, R. Simut, S. Pintea, J. Saldien, A. Rusu, D. David, J. Vanderfaeillie, D. Lefeber, and B. Vanderborght, "Can the social robot probo help children with autism to identify situation-based emotions? a series of single case experiments," International Journal of Humanoid Robotics, vol. 10, no. 03, p. 1350025, 2013.

[56]

J. J. Diehl, L. M. Schmitt, M. Villano, and C. R. Crowell, "The clinical use of robots for individuals with autism spectrum disorders: A critical review," Research in autism spectrum disorders, vol. 6, no. 1, pp. 249--262, 2012.

[57]

A. Sandygulova, A. Amirova, Z. Telisheva, A. Zhanatkyzy, and N. Rakhymbayeva, "Individual differences of children with autism in robot-assisted autism therapy," in Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction, ser. HRI '22. IEEE Press, 2022, p. 43--52.

[58]

J. Jang, J. L. Matson, L. W. Williams, K. Tureck, R. L. Goldin, and P. E. Cervantes, "Rates of comorbid symptoms in children with asd, adhd, and comorbid asd and adhd." Research in developmental disabilities, vol. 34 8, pp. 2369--78, 2013.

[59]

M. Scheeff, J. Pinto, K. Rahardja, S. Snibbe, and R. Tow, Experiences with Sparky, a Social Robot. Boston, MA: Springer US, 2002, pp. 173--180. [Online]. Available: https://doi.org/10.1007/0-306-47373-9_21

Cited By

Dubois-Sage MJacquet BJamet FBaratgin J(2024)People with Autism Spectrum Disorder Could Interact More Easily with a Robot than with a Human: Reasons and LimitsBehavioral Sciences10.3390/bs1402013114:2(131)Online publication date: 12-Feb-2024
https://doi.org/10.3390/bs14020131
Ashwini BGhoshal ASuri VAchary KShukla J(2024)“It looks useful, works just fine, but will it replace me ?" Understanding Special Educators’ Perception of Social Robots for Autism Care in IndiaProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642836(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642836
Neerincx AVeldhuis DMasthoff Jde Graaf M(2024)Co-designing a social robot for child health careInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2023.10061538:COnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijcci.2023.100615
Show More Cited By

Index Terms

Multi-Purposeful Activities for Robot-Assisted Autism Therapy: What Works Best for Children's Social Outcomes?

Recommendations

Individual Differences of Children with Autism in Robot-assisted Autism Therapy
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction

Research has recognized the importance of individual differences of children with Autism Spectrum Disorder (ASD) that require interventions to meet their heterogeneous needs. This relatively large-scale study investigates a robot-assisted autism therapy (...
A Long-term Study of Robot-Assisted Therapy for Children with Severe Autism and ADHD
HRI '20: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction

Social robots are increasingly being used as a mediator between therapists and children with Autism Spectrum Disorder (ASD) and Attention Deficit Hyperactivity Disorder (ADHD). This paper describes an ongoing work that aims to target children with ...
A Tactile Robot for Developmental Disorder Therapy
TechMindSociety '18: Proceedings of the Technology, Mind, and Society

Developmental disorders, such as Attention-Deficit-- Hyperactivity Disorder (ADHD) and Autism Spectrum Disorder (ASD), have clinical symptoms of inattention, hyperactivity, and impulsivity. These symptoms are often accompanied by tactile and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '23: Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

March 2023

631 pages

ISBN:9781450399647

DOI:10.1145/3568162

General Chairs:
Ginevra Castellano
Uppsala University, Sweden
,
Laurel Riek
University of California San Diego, USA
,
Program Chairs:
Maya Cakmak
University of Washington, USA
,
Iolanda Leite
KTH Royal Institute of Technology, Sweden

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Best Paper

Author Tags

Qualifiers

Research-article

Funding Sources

Nazarbayev University
Nazarbayev University Collaborative Research Program

Conference

HRI '23

Sponsor:

HRI '23: ACM/IEEE International Conference on Human-Robot Interaction

March 13 - 16, 2023

Stockholm, Sweden

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
596
Total Downloads

Downloads (Last 12 months)289
Downloads (Last 6 weeks)49

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dubois-Sage MJacquet BJamet FBaratgin J(2024)People with Autism Spectrum Disorder Could Interact More Easily with a Robot than with a Human: Reasons and LimitsBehavioral Sciences10.3390/bs1402013114:2(131)Online publication date: 12-Feb-2024
https://doi.org/10.3390/bs14020131
Ashwini BGhoshal ASuri VAchary KShukla J(2024)“It looks useful, works just fine, but will it replace me ?" Understanding Special Educators’ Perception of Social Robots for Autism Care in IndiaProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642836(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642836
Neerincx AVeldhuis DMasthoff Jde Graaf M(2024)Co-designing a social robot for child health careInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2023.10061538:COnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijcci.2023.100615
Currie JGiannaccini MBach P(2024)Sonic Sleight of Hand: Sound Induces Illusory Distortions in the Perception and Prediction of Robot ActionInternational Journal of Social Robotics10.1007/s12369-024-01105-5Online publication date: 17-Feb-2024
https://doi.org/10.1007/s12369-024-01105-5

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents