research-article

Why Did you Stop? - Investigating Origins and Effects of Interruptions during Mobile Language Learning

Authors:

Christina Schneegass,

Jonas Safranek,

Heinrich HussmannAuthors Info & Claims

MuC '21: Proceedings of Mensch und Computer 2021

Pages 21 - 33

https://doi.org/10.1145/3473856.3473881

Published: 13 September 2021 Publication History

Abstract

The technological advances of smartphones facilitate the transformation of learning from the classroom to an activity that can happen anywhere and anytime. While micro-learning fosters ubiquitous learning, this flexibility comes at the cost of having an uncontrolled learning environment. To this point, we know little about the usage of mobile learning applications, particularly the occurrence of interruptions and the harm they cause. By diverting users’ attention away from the learning task, interruptions can potentially compromise learning performance. We present a four-week in-the-wild study (N = 12) where we investigate learning behavior and the occurrence of interruptions based on device logging and experience sampling questionnaires. We recorded 276 interruptions in 327 learning sessions and found that interruption type as well as users’ context influence learning sessions and the severity of the interruption (i.e., session termination likeliness). We discuss challenges and opportunities for the design of automated mechanisms to detect and mitigate interruptions in mobile learning.

Supplementary Material

Details on GAMLSS reported in Results (3473856.3473881.pdf)

Download
102.48 KB

References

[1]

Erik M Altmann and J Gregory Trafton. 2002. Memory for goals: An activation-based model. Cognitive science 26, 1 (2002), 39–83.

[2]

Christoph Anderson, Isabel Hübener, Ann-Kathrin Seipp, Sandra Ohly, Klaus David, and Veljko Pejovic. 2018. A Survey of Attention Management Systems in Ubiquitous Computing Environments. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (July 2018), 1–27. https://doi.org/10.1145/3214261

Digital Library

[3]

Brian P Bailey and Joseph A Konstan. 2006. On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state. Computers in human behavior 22, 4 (2006), 685–708. https://doi.org/10.1016/j.chb.2005.12.009

[4]

Niels Van Berkel, Denzil Ferreira, and Vassilis Kostakos. 2017. The Experience Sampling Method on Mobile Devices. Comput. Surveys 50, 6 (Dec. 2017), 1–40. https://doi.org/10.1145/3123988

Digital Library

[5]

Niels van Berkel, Denzil Ferreira, and Vassilis Kostakos. 2017. The experience sampling method on mobile devices. ACM Computing Surveys (CSUR) 50, 6 (2017), 1–40.

Digital Library

[6]

Cindy Blanco. 2020. 2020 Duolingo Language Report: Global Overview. https://blog.duolingo.com/global-language-report-2020/

[7]

Shadan Sadeghian Borojeni, Abdallah El Ali, Wilko Heuten, and Susanne Boll. 2016. Peripheral Light Cues for In-Vehicle Task Resumption. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction. ACM, Gothenburg Sweden, 1–4. https://doi.org/10.1145/2971485.2971498

Digital Library

[8]

Peter A Bruck, Luvai Motiwalla, and Florian Foerster. 2012. Mobile Learning with Micro-content: A Framework and Evaluation., In Bled eConference. Bled eConference 25, 527–543.

[9]

Duncan P Brumby, Anna L Cox, Jonathan Back, and Sandy JJ Gould. 2013. Recovering from an interruption: Investigating speed-accuracy trade-offs in task resumption behavior.Journal of Experimental Psychology: Applied 19, 2 (2013), 95.

[10]

Fabio Ciravegna. 2019. Creating a never ending background service in Android > 7. https://fabcirablog.weebly.com/blog/creating-a-never-ending-background-service-in-android-gt-7

[11]

William L Cull. 2000. Untangling the benefits of multiple study opportunities and repeated testing for cued recall. Applied Cognitive Psychology 14, 3 (2000), 215–235.

[12]

C. A. Czeisler and J. J. Gooley. 2007. Sleep and Circadian Rhythms in Humans. Cold Spring Harbor Symposia on Quantitative Biology 72, 1 (Jan. 2007), 579–597. https://doi.org/10.1101/sqb.2007.72.064

[13]

Valérie Demouy, Ann Jones, Qian Kan, Agnes Kukulska-Hulme, and Annie Eardley. 2016. Why and How Do Distance Learners Use Mobile Devices for Language Learning?The EuroCALL Review 24, 1 (2016), 10–24.

[14]

Tilman Dingler, Dominik Weber, Martin Pielot, Jennifer Cooper, Chung-Cheng Chang, and Niels Henze. 2017. Language learning on-the-go: opportune moments and design of mobile microlearning sessions. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI ’17. ACM Press, Vienna, Austria, 1–12. https://doi.org/10.1145/3098279.3098565

Digital Library

[15]

Fiona Draxler, Christina Schneegass, and Evangelos Niforatos. 2019. Designing for Task Resumption Support in Mobile Learning. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, Taipei Taiwan, 1–6. https://doi.org/10.1145/3338286.3344394

Digital Library

[16]

Joel E. Fischer, Chris Greenhalgh, and Steve Benford. 2011. Investigating episodes of mobile phone activity as indicators of opportune moments to deliver notifications. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services - MobileHCI ’11. ACM Press, Stockholm, Sweden, 181. https://doi.org/10.1145/2037373.2037402

Digital Library

[17]

Victor M. González and Gloria Mark. 2004. ”Constant, constant, multi-tasking craziness”: managing multiple working spheres. In Proceedings of the 2004 conference on Human factors in computing systems - CHI ’04. ACM Press, Vienna, Austria, 113–120. https://doi.org/10.1145/985692.985707

[18]

Helen M Hodgetts and Dylan M Jones. 2006. Interruption of the Tower of London task: support for a goal-activation approach.Journal of Experimental Psychology: General 135, 1 (2006), 103.

[19]

Theo Hug and Martin Lindner (Eds.). 2006. Micromedia & e-Learning 2.0: Gaining the Big Picture. Proceedings of Microlearning Conference 2006(1. ed ed.). Innsbruck Univ. Press, Innsbruck. OCLC: 699639536.

[20]

Shamsi T. Iqbal and Brian P. Bailey. 2007. Understanding and developing models for detecting and differentiating breakpoints during interactive tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI ’07. ACM Press, San Jose, California, USA, 697–706. https://doi.org/10.1145/1240624.1240732

[21]

Shamsi T. Iqbal and Eric Horvitz. 2007. Disruption and recovery of computing tasks: field study, analysis, and directions. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI ’07. ACM Press, San Jose, California, USA, 677. https://doi.org/10.1145/1240624.1240730

[22]

Ioanna Katidioti, Jelmer P Borst, Marieke K van Vugt, and Niels A Taatgen. 2016. Interrupt me: External interruptions are less disruptive than self-interruptions. Computers in Human Behavior 63 (2016), 906–915.

Digital Library

[23]

Matthew Kay, Gregory L. Nelson, and Eric B. Hekler. 2016. Researcher-Centered Design of Statistics: Why Bayesian Statistics Better Fit the Culture and Incentives of HCI. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, San Jose California USA, 4521–4532. https://doi.org/10.1145/2858036.2858465

Digital Library

[24]

Dagmar Kern, Paul Marshall, and Albrecht Schmidt. 2010. Gazemarks: gaze-based visual placeholders to ease attention switching. In Proceedings of the 28th international conference on Human factors in computing systems - CHI ’10. ACM Press, Atlanta, Georgia, USA, 2093. https://doi.org/10.1145/1753326.1753646

Digital Library

[25]

John G Kreifeldt and ME McCarthy. 1981. Interruption as a test of the user-computer interface. In Proceedings of the 17th Annual Conference on Manual Interaction. 655–667.

[26]

Agnes Kukulska-Hulme. 2009. Will mobile learning change language learning?ReCALL 21, 02 (May 2009), 157. https://doi.org/10.1017/S0958344009000202

[27]

Alexander Mariakakis, Mayank Goel, Md Tanvir Islam Aumi, Shwetak N. Patel, and Jacob O. Wobbrock. 2015. SwitchBack: Using Focus and Saccade Tracking to Guide Users’ Attention for Mobile Task Resumption. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI ’15. ACM Press, Seoul, Republic of Korea, 2953–2962. https://doi.org/10.1145/2702123.2702539

Digital Library

[28]

Mark A McDaniel, Gilles O Einstein, Thomas Graham, and Erica Rall. 2004. Delaying execution of intentions: Overcoming the costs of interruptions. Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition 18, 5 (2004), 533–547.

[29]

Jessica S. Mendoza, Benjamin C. Pody, Seungyeon Lee, Minsung Kim, and Ian M. McDonough. 2018. The effect of cellphones on attention and learning: The influences of time, distraction, and nomophobia. Computers in Human Behavior 86 (2018), 52 – 60. https://doi.org/10.1016/j.chb.2018.04.027

[30]

Christopher A Monk, J Gregory Trafton, and Deborah A Boehm-Davis. 2008. The effect of interruption duration and demand on resuming suspended goals.Journal of experimental psychology: Applied 14, 4 (2008), 299.

[31]

Tadashi Okoshi, Julian Ramos, Hiroki Nozaki, Jin Nakazawa, Anind K. Dey, and Hideyuki Tokuda. 2015. Reducing users’ perceived mental effort due to interruptive notifications in multi-device mobile environments. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp ’15. ACM Press, Osaka, Japan, 475–486. https://doi.org/10.1145/2750858.2807517

Digital Library

[32]

Antti Oulasvirta. 2005. Interrupted cognition and design for non-disruptiveness: the skilled memory approach. In CHI ’05 extended abstracts on Human factors in computing systems - CHI ’05. ACM Press, Portland, OR, USA, 1124. https://doi.org/10.1145/1056808.1056843

[33]

Antti Oulasvirta and Pertti Saariluoma. 2006. Surviving task interruptions: Investigating the implications of long-term working memory theory. International Journal of Human-Computer Studies 64, 10 (Oct. 2006), 941–961. https://doi.org/10.1016/j.ijhcs.2006.04.006

Digital Library

[34]

Romina Poguntke, Christina Schneegass, Lucas Van der Vekens, Rufat Rzayev, Jonas Auda, Stefan Schneegass, and Albrecht Schmidt. 2020. NotiModes: an investigation of notification delay modes and their effects on smartphone users. In Proceedings of the Conference on Mensch und Computer. ACM, Magdeburg Germany, 415–419. https://doi.org/10.1145/3404983.3410006

Digital Library

[35]

R Core Team. 2020. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org

[36]

R. A. Rigby and D. M. Stasinopoulos. 2005. Generalized additive models for location, scale and shape,(with discussion). Applied Statistics 54(2005), 507–554.

[37]

Fernando Rosell-Aguilar. 2018. Autonomous language learning through a mobile application: a user evaluation of the busuu app. Computer Assisted Language Learning 31, 8 (Nov. 2018), 854–881. https://doi.org/10.1080/09588221.2018.1456465

[38]

Alireza Sahami Shirazi, Niels Henze, Tilman Dingler, Martin Pielot, Dominik Weber, and Albrecht Schmidt. 2014. Large-scale Assessment of Mobile Notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). ACM, New York, NY, USA, 3055–3064. https://doi.org/10.1145/2556288.2557189

Digital Library

[39]

Farzan Sasangohar, Stacey D Scott, and Mary L Cummings. 2014. Supervisory-level interruption recovery in time-critical control tasks. Applied ergonomics 45, 4 (2014), 1148–1156.

[40]

Christina Schmidt, Fabienne Collette, Christian Cajochen, and Philippe Peigneux. 2007. A time to think: circadian rhythms in human cognition. Cognitive neuropsychology 24, 7 (2007), 755–789.

[41]

Christina Schneegass and Fiona Draxler. 2021. Designing Task Resumption Cues for Interruptions in Mobile Learning Scenarios. In Technology-Augmented Perception and Cognition, Tilman Dingler and Evangelos Niforatos (Eds.). Springer International Publishing, Cham, 125–181. https://doi.org/10.1007/978-3-030-30457-7_5 Series Title: Human–Computer Interaction Series.

[42]

Christina Schneegass, Nađa Terzimehić, Mariam Nettah, and Stefan Schneegass. 2018. Informing the Design of User-adaptive Mobile Language Learning Applications. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia - MUM 2018. ACM Press, Cairo, Egypt, 233–238. https://doi.org/10.1145/3282894.3282926

Digital Library

[43]

Ramona Schoedel, Florian Pargent, Quay Au, Sarah Theres Völkel, Tobias Schuwerk, Markus Bühner, and Clemens Stachl. 2020. To Challenge the Morning Lark and the Night Owl: Using Smartphone Sensing Data to Investigate Day–Night Behaviour Patterns. European Journal of Personality 34, 5 (Sept. 2020), 733–752. https://doi.org/10.1002/per.2258

[44]

Stacey D. Scott, Stéphane Mercier, M. L. Cummings, and Enlie Wang. 2006. Assisting interruption recovery in supervisory control of multiple UAVs. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 50. SAGE Publications Sage CA: Los Angeles, CA, 699–703. https://doi.org/10.1177/154193120605000518

[45]

Mikis D. Stasinopoulos (Ed.). 2017. Flexible regression and smoothing: using GAMLSS in R. CRC Press/Taylor & Francis Group, Boca Raton.

[46]

Peyman Toreini, Moritz Langner, and Alexander Maedche. 2018. Use of attentive information dashboards to support task resumption in working environments. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications. ACM, Warsaw Poland, 1–3. https://doi.org/10.1145/3204493.3208348

Digital Library

[47]

J Gregory Trafton, Erik M Altmann, Derek P Brock, and Farilee E Mintz. 2003. Preparing to resume an interrupted task: Effects of prospective goal encoding and retrospective rehearsal. International Journal of Human-Computer Studies 58, 5 (2003), 583–603.

Digital Library

[48]

Eric-Jan Wagenmakers, Jonathon Love, Maarten Marsman, Tahira Jamil, Alexander Ly, Josine Verhagen, Ravi Selker, Quentin F. Gronau, Damian Dropmann, Bruno Boutin, Frans Meerhoff, Patrick Knight, Akash Raj, Erik-Jan van Kesteren, Johnny van Doorn, Martin Šmíra, Sacha Epskamp, Alexander Etz, Dora Matzke, Tim de Jong, Don van den Bergh, Alexandra Sarafoglou, Helen Steingroever, Koen Derks, Jeffrey N. Rouder, and Richard D. Morey. 2018. Bayesian inference for psychology. Part II: Example applications with JASP. Psychonomic Bulletin & Review 25, 1 (Feb. 2018), 58–76. https://doi.org/10.3758/s13423-017-1323-7

[49]

W.L. Yeung and Simon Y.W. Li. 2016. Prototyping the Machine-Human Dialogues in a Smartphone Voice Call Application With Task Resumption Support. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA ’16. ACM Press, Santa Clara, California, USA, 1788–1793. https://doi.org/10.1145/2851581.2892464

Digital Library

Cited By

Terzimehić NDraxler FAhsanpour MSchmidt A(2023)Implicit Smartphone Use Interventions to Promote Life-Technology Balance: An App-Market Survey, Design Space and the Case of Life-RelaunchedProceedings of Mensch und Computer 202310.1145/3603555.3603578(237-249)Online publication date: 3-Sep-2023
https://dl.acm.org/doi/10.1145/3603555.3603578
Janzen IMcGrenere J(2022)Reflective Spring Cleaning: Using Personal Informatics to Support Infrequent Notification PersonalizationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517493(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517493
Schneegass CFüseschi VKonevych VDraxler F(2021)Investigating the Use of Task Resumption Cues to Support Learning in Interruption-Prone EnvironmentsMultimodal Technologies and Interaction10.3390/mti60100026:1(2)Online publication date: 30-Dec-2021
https://doi.org/10.3390/mti6010002

Recommendations

Designing for Task Resumption Support in Mobile Learning
MobileHCI '19: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services

Distractions and interruptions often disrupt mobile learners. Luckily, task resumption (memory) cues can support users in resuming a learning task. These cues can have multiple forms and designs, but their effectiveness depends heavily on their ...
Investigating interruptions in the context of computerised cognitive testing for older adults
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Interruptions in the home pose a threat to the validity of self-administered computerised cognitive testing. We report the findings of a laboratory experiment investigating the effects of increased interruption workload demand on older adults' ...
Effects of content and time of delivery on receptivity to mobile interruptions
MobileHCI '10: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services

In this paper we investigate effects of the content of interruptions and of the time of interruption delivery on mobile phones. We review related work and report on a naturalistic quasi-experiment using experience-sampling that showed that the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MuC '21: Proceedings of Mensch und Computer 2021

September 2021

613 pages

ISBN:9781450386456

DOI:10.1145/3473856

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Conference

MuC '21

MuC '21: Mensch und Computer 2021

September 5 - 8, 2021

Ingolstadt, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
140
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)4

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Terzimehić NDraxler FAhsanpour MSchmidt A(2023)Implicit Smartphone Use Interventions to Promote Life-Technology Balance: An App-Market Survey, Design Space and the Case of Life-RelaunchedProceedings of Mensch und Computer 202310.1145/3603555.3603578(237-249)Online publication date: 3-Sep-2023
https://dl.acm.org/doi/10.1145/3603555.3603578
Janzen IMcGrenere J(2022)Reflective Spring Cleaning: Using Personal Informatics to Support Infrequent Notification PersonalizationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517493(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517493
Schneegass CFüseschi VKonevych VDraxler F(2021)Investigating the Use of Task Resumption Cues to Support Learning in Interruption-Prone EnvironmentsMultimodal Technologies and Interaction10.3390/mti60100026:1(2)Online publication date: 30-Dec-2021
https://doi.org/10.3390/mti6010002

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents