skip to main content
research-article

A sense of ice and fire: : Exploring thermal feedback with multiple thermoelectric-cooling elements on a smart ring

Published: 01 October 2019 Publication History

Highlights

We developed three working prototypes of smart rings embedded with multiple (4, 6, and 8) thermoelectric coolers (TECs), of various sizes, which can be used with the in-ring spatial thermal patterns described in the paper.
Our pilot study investigated how well users could localized the in-ring thermal feedback with three different settings. Results showed that users could reliably recognize 4 points with cold stimulation (97.2% accuracy). In the two main experiments, we investigated the use of 4 in-ring TECs to achieve two combinations of spatial thermal patterns (i.e. the neighboring or opposite patterns). The results revealed three neighboring patterns and five opposite patterns that were reliably recognized by the participants with the accuracy above 80%.
The follow-up studies showed that it could be confusing for users by combining four single-spot cold stimulations, three neighboring patterns, and five opposite patterns in the same group (average accuracy: 50.2%). On the other hand, the participants could identify the thermal patterns in the combined group of the single-spot cold stimulations and the neighboring patterns (average accuracy: 85.3%), and the combined group of the single-spot cold stimulations and the opposite patterns (average accuracy: 89.3%). This suggested it could feasible to use these combined group of thermal patterns as thermal icons for information representation.
We further conducted three design workshops, involving six product/interface designers. The designers suggested different mappings between the given thermal patterns and the information, including direction cueing through single-spot and neighboring patterns, artifact comparison through opposite patterns, notifying incoming calls/messages from different persons with different locations and temperatures of the TECs, etc.

Abstract

In this paper, we investigate the use of thermal feedback on a smart ring with multiple thermoelectric coolers (TECs). Our prototype aims to offer an increased expressivity with spatial thermal patterns. Our pilot study showed that users could reliably recognize 4 single points with cold stimulation (97.2% accuracy). In the following two main experiments, we investigated the use of 4 in-ring TECs to achieve two categories of spatial thermal patterns by combining two neighboring or opposite elements. The results revealed three neighboring patterns and five opposite patterns that could be reliably recognized by the participants with the average accuracy above 80%. A follow-up experiment suggested that it could be confusing for users by combining four single-spot cold stimulations, three neighboring patterns, and five opposite patterns in the same group (average accuracy: 50.2%). We conducted two more follow-up studies, showing that the participants could identify the thermal patterns in the combined group of the single-spot cold stimulations and the neighboring patterns (average accuracy: 85.3%), and the combined group of the single-spot cold stimulations and the opposite patterns (average accuracy: 89.3%). We further conducted three design workshops, involving six product/interface designers, to investigate the potential applications of these thermal patterns. The designers suggested different mappings between the given thermal patterns and the information, including direction cueing through single-spot and neighboring patterns, artifact comparison through opposite patterns, notifying incoming calls/messages from different persons with different locations and temperatures of the TECs, etc. This demonstrated interest in spatial thermal patterns in smart rings not only for notifications but also for various everyday activities.

References

[1]
J. Alvina, S. Zhao, S.T. Perrault, M. Azh, T. Roumen, M. Fjeld, OmniVib: towards cross-body spatiotemporal vibrotactile notifications for mobile phones, Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2015, pp. 2487–2496.
[2]
L.M. Brown, S.A. Brewster, H.C. Purchase, A first investigation into the effectiveness of Tactons, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems., World Haptics Conference, 2005, pp. 167–176.
[3]
W.S. Cain, Spatial discrimination of cutaneous warmth, Am. J. Psychol. 86 (1) (1973) 169–181.
[4]
M.G. Carcedo, S.H. Chua, S. Perrault, P. Wozniak, R. Joshi, M. Obaid, S. Zhao, HaptiColor: interpolating color information as haptic feedback to assist the colorblind, Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, 2016, pp. 3572–3583.
[5]
J.R. Cauchard, J.L. Cheng, T. Pietrzak, J.A. Landay, ActiVibe: design and evaluation of vibrations for progress monitoring, Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, 2016, pp. 3261–3271.
[6]
A. Chan, K. MacLean, J. McGrenere, Designing haptic icons to support collaborative turn-taking, Int. J. Hum.-Comput. Stud. 66 (5) (2008) 333–355.
[7]
T. Chen, Y.S. Wu, K. Zhu, Investigating different modalities of directional cues for multi-task visual-searching scenario in virtual reality, Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, ACM, 2018, p. 41.
[8]
J. Chung, C. Oh, S. Park, B. Suh, PairRing: a ring-shaped rotatable smartwatch controller, Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, ACM, 2018, p. LBW635.
[9]
A. Dufour, V. Candas, Ageing and thermal responses during passive heat exposure: sweating and sensory aspects, Eur. J. Appl. Physiol. 100 (1) (2007) 19–26.
[10]
M.A. Farage, K.W. Miller, A.M. Wippel, E. Berardesca, L. Misery, H. Maibach, Sensitive skin in the United States: survey of regional differences, Family Med Med. Sci. Res. 2 (112) (2013) 2.
[11]
Y.L. Feng, C.L. Fernando, J. Rod, K. Minamizawa, Submerged haptics: a 3-DOF fingertip haptic display using miniature 3d printed airbags, ACM SIGGRAPH 2017 Emerging Technologies, ACM, 2017, p. 22.
[12]
A. Gallace, H.Z. Tan, C. Spence, The body surface as a communication system: The state of the art after 50 years, Presence: Teleoperators and Virtual Environments, Vol. 16, 2007, pp. 655–676.
[13]
S. Ghosh, H.C. Kim, Y. Cao, A. Wessels, S.T. Perrault, S. Zhao, Ringteraction: coordinated thumb-index interaction using a ring, Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, ACM, 2016, pp. 2640–2647.
[14]
G.O. Gibson, J.C. Craig, Tactile spatial sensitivity and anisotropy, Percept. Psychophys. 67 (6) (2005) 1061–1079.
[15]
B.G. Green, Localization of thermal sensation: an illusion and synthetic heat, Percept. Psychophys. 22 (4) (1977) 331–337.
[16]
M. Halvey, M. Henderson, S.A. Brewster, G. Wilson, S.A. Hughes, Augmenting media with thermal stimulation, International Conference on Haptic and Audio Interaction Design, Springer, Berlin, Heidelberg, 2012, pp. 91–100.
[17]
M. Halvey, G. Wilson, S. Brewster, S. Hughes, Baby it’s cold outside: the influence of ambient temperature and humidity on thermal feedback, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 2012, pp. 715–724.
[18]
M. Halvey, G. Wilson, S.A. Brewster, S.A. Hughes, Perception of thermal stimuli for continuous interaction, CHI’13 Extended Abstracts on Human Factors in Computing Systems, ACM, 2013, pp. 1587–1592.
[19]
M. Halvey, G. Wilson, Y. Vazquez-Alvarez, S.A. Brewster, S.A. Hughes, The effect of clothing on thermal feedback perception, Proceedings of the 13th International Conference on Multimodal Interfaces, ACM, 2011, pp. 217–220.
[20]
T. Han, Q. Han, M. Annett, F. Anderson, D.Y. Huang, X.D. Yang, Frictio: passive kinesthetic force feedback for smart ring output, Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, ACM, 2017, pp. 131–142.
[21]
J. Hong, A. Pradhan, J.E. Froehlich, L. Findlater, Evaluating wrist-based haptic feedback for non-visual target finding and path tracing on a 2d surface, Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility, ACM, 2017, pp. 210–219.
[22]
M.J. Hsieh, R.H. Liang, B.Y. Chen, NailTactors: eyes-free spatial output using a nail-mounted tactor array, Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, ACM, 2016, pp. 29–34.
[23]
K. Iwasaki, T. Miyaki, J. Rakimoto, AffectPhone: a handset device to present user’s emotional state with warmth/coolness. BIOSTEC2010, B-Interface Workshop, Vol. 2010, 2010, pp. 1–6.
[24]
S. Je, M. Lee, Y. Kim, L. Chan, X.D. Yang, A. Bianchi, PokeRing: notifications by poking around the finger, Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ACM, 2018, p. 542.
[25]
S. Je, B. Rooney, L. Chan, A. Bianchi, tactoRing: a skin-drag discrete display, Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 2017, pp. 3106–3114.
[26]
L.A. Jones, M. Berris, The psychophysics of temperature perception and thermal-interface design, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS, Vol. 2002, IEEE, 2002, pp. 137–142.
[27]
L.A. Jones, H.N. Ho, Warm or cool, large or small? The challenge of thermal displays, IEEE Transactions on Haptics, Vol. 1, 2008, pp. 53–70.
[28]
D.R. Kenshalo, C.E. Holmes, P.B. Wood, Warm and cool thresholds as a function of rate of stimulus temperature change, Perception & Psychophysics, Vol. 3, 1968, pp. 81–84.
[29]
H. Ketabdar, P. Moghadam, M. Roshandel, Pingu: a new miniature wearable device for ubiquitous computing environments, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems, IEEE, 2012, pp. 502–506.
[30]
T. Lappalainen, L. Virtanen, J. Häkkilä, Experiences with wellness ring and bracelet form factor, Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia, ACM, 2016, pp. 351–353.
[31]
K. MacLean, M. Enriquez, Perceptual design of haptic icons, Proc. of EuroHaptics, 2003, pp. 351–363.
[32]
K.E. MacLean, Foundations of transparency in tactile information design, IEEE Trans. Haptic. 1 (2) (2008) 84–95.
[33]
S. Marti, C. Schmandt, Giving the caller the finger: collaborative responsibility for cellphone interruptions, CHI’05 Extended Abstracts on Human Factors in Computing Systems, ACM, 2005, pp. 1633–1636.
[34]
G.A. Miller, The magical number seven, plus or minus two: some limits on our capacity for processing information, Psychol. Rev. 63 (2) (1956) 81.
[35]
T. Murakami, T. Person, C.L. Fernando, K. Minamizawa, Altered touch: miniature haptic display with force, thermal and tactile feedback for augmented haptics, ACM SIGGRAPH 2017 Emerging Technologies, ACM, 2017, p. 2.
[36]
M. Nakashige, M. Kobayashi, Y. Suzuki, “Hiya-Atsu” media: augmenting digital media with temperature, Proceedings of CHI ’09, Boston, MA, 2009.
[37]
L.U. Odhner, H.H. Asada, Sensorless temperature estimation and control of shape memory alloy actuators using thermoelectric devices, IEEE/ASME Transactions on Mechatronics, Vol. 11, 2006, pp. 139–144.
[38]
R.L. Peiris, L. Chan, K. Minamizawa, Thermocons: evaluating the thermal haptic perception of the forehead, Proceedings of the 29th Annual Symposium on User Interface Software and Technology, ACM, 2016, pp. 187–188.
[39]
R.L. Peiris, Y.L. Feng, L. Chan, K. Minamizawa, ThermalBracelet: exploring thermal haptic feedback around the wrist, Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, ACM, 2019, p. 170.
[40]
R.L. Peiris, W. Peng, Z. Chen, L. Chan, K. Minamizawa, ThermoVR: exploring integrated thermal haptic feedback with head mounted displays, Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 2017, pp. 5452–5456.
[41]
A. Pertovaara, I. Kojo, Influence of the rate of temperature change on thermal thresholds in man, Exp. Neurol. 87 (3) (1985) 439–445.
[42]
D. Polydorou, K. Zhu, A. Karkotis, Digital humanities and techno-animism in wearables: a case-study-based collaborative design framework for digitally-ensouled jewellery, International Conference of Design, User Experience, and Usability, Springer, Cham, 2017, pp. 719–736.
[43]
G.A. Pradana, A.D. Cheok, M. Inami, J. Tewell, Y. Choi, Emotional priming of mobile text messages with ring-shaped wearable device using color lighting and tactile expressions, Proceedings of the 5th Augmented Human International Conference, ACM, 2014, p. 14.
[44]
N. Ranasinghe, P. Jain, S. Karwita, D. Tolley, E.Y.L. Do, Ambiotherm: enhancing sense of presence in virtual reality by simulating real-world environmental conditions, Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 2017, pp. 1731–1742.
[45]
T. Roumen, S.T. Perrault, S. Zhao, NotiRing: a comparative study of notification channels for wearable interactive rings, Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2015, pp. 2497–2500.
[46]
B. Saket, C. Prasojo, Y. Huang, S. Zhao, Designing an effective vibration-based notification interface for mobile phones, Proceedings of the 2013 Conference on Computer Supported Cooperative Work, ACM, 2013, pp. 149–1504.
[47]
K. Sato, T. Maeno, Presentation of sudden temperature change using spatially divided warm and cool stimuli, International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, Springer, Berlin, Heidelberg, 2012, pp. 457–468.
[48]
R. Shilkrot, J. Huber, J. Steimle, S. Nanayakkara, P. Maes, Digital digits: a comprehensive survey of finger augmentation devices, ACM Computing Surveys (CSUR), Vol. 48, 2015, p. 30.
[49]
A. Singhal, L. Jones, Space-time dependencies and thermal perception, International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, Springer, Cham, 2016, pp. 291–302.
[50]
A. Singhal, L.A. Jones, Creating thermal icons? A model-based approach, ACM Trans. Appl. Percept., 15,2, 2018, p. 14.
[51]
J.C. Stevens, Temperature can sharpen tactile acuity, Percept. Psychophys. 31 (6) (1982) 577–580.
[52]
J.C. Stevens, K.K. Choo, Spatial acuity of the body surface over the life span, Somatosens. Mot. Res. 13 (2) (1996) 153–166.
[53]
J.C. Stevens, K.K. Choo, Temperature sensitivity of the body surface over the life span, Somatosens. Mot. Res. 15 (1) (1998) 13–28.
[54]
E. Strasnick, J.R. Cauchard, J.A. Landay, BrushTouch: exploring an alternative tactile method for wearable haptics, Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 2017, pp. 3120–3125.
[55]
R.H. Taus, J.C. Stevens, L.E. Marks, Spatial localization of warmth, Percept.Psychophys. 17 (2) (1975) 194–196.
[56]
J. Tewell, J. Bird, G.R. Buchanan, The heat is on: a temperature display for conveying affective feedback, Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 2017, pp. 1756–1767.
[57]
J. Tewell, J. Bird, G.R. Buchanan, Heat-Nav: using temperature changes as navigation cues, Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 2017, pp. 1131–1135.
[58]
R.D. Treede, R.A. Meyer, S.N. Raja, J.N. Campbell, Evidence for two different heat transduction mechanisms in nociceptive primary afferents innervating monkey skin, J. Physiol. 483 (3) (1995) 747–758.
[59]
R. Wettach, C. Behrens, A. Danielsson, T. Ness, A thermal information display for mobile applications, Proceedings of the 9th International Conference on Human Computer Interaction with Mobile Devices and Services, ACM, 2007, pp. 182–185.
[60]
G. Wilson, S. Brewster, M. Halvey, S. Hughes, Thermal icons: evaluating structured thermal feedback for mobile interaction, Proceedings of the 14th International Conference on Human-Computer Interaction with Mobile Devices and Services, ACM, 2012, pp. 309–312.
[61]
G. Wilson, S. Brewster, M. Halvey, S. Hughes, Thermal feedback identification in a mobile environment, International Workshop on Haptic and Audio Interaction Design, Springer, Berlin, Heidelberg., 2013, pp. 10–19.
[62]
G. Wilson, S.A. Brewster, Multi-Moji: combining thermal, vibrotactile & visual stimuli to expand the affective range of feedback, Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 2017, pp. 1743–1755.
[63]
G. Wilson, G. Davidson, S.A. Brewster, In the heat of the moment: subjective interpretations of thermal feedback during interaction, Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM., 2015, pp. 2063–2072.
[64]
G. Wilson, D. Dobrev, S.A. Brewster, Hot under the collar: mapping thermal feedback to dimensional models of emotion, Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, 2016, pp. 4838–4849.
[65]
Wilson, G., Halvey, M., Brewster, S. A., Hughes, S. A., 2011. Some like it hot: thermal feedback for mobile devices. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2555–2564. ACM.
[66]
G. Wilson, H. Maxwell, M. Just, Everything’s cool: Extending security warnings with thermal feedback, Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, ACM., 2017, pp. 2232–2239.
[67]
G.H. Yang, D.S. Kwon, L.A. Jones, Spatial acuity and summation on the hand: the role of thermal cues in material discrimination, Percept. Psychophys. 71 (1) (2009) 156–163.
[68]
K. Yatani, K.N. Truong, Semfeel: a user interface with semantic tactile feedback for mobile touch-screen devices, Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, ACM., 2009, pp. 111–120.
[69]
V. Yem, R. Okazaki, H. Kajimoto, FinGAR: combination of electrical and mechanical stimulation for high-fidelity tactile presentation, ACM SIGGRAPH 2016 Emerging Technologies, ACM, 2016, p. 7.
[70]
H. Zhang, E. Arens, C. Huizenga, T. Han, Thermal sensation and comfort models for non-uniform and transient environments: part i: local sensation of individual body parts, Build. Environ. 45 (2) (2010) 380–388.

Cited By

View all
  • (2024)ThermoGrasp: Enabling Localized Thermal Feedback on Fingers for Precision Grasps in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36765268:MHCI(1-21)Online publication date: 24-Sep-2024
  • (2024)Fiery Hands: Designing Thermal Glove through Thermal and Tactile Integration for Virtual Object ManipulationProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676457(1-15)Online publication date: 13-Oct-2024
  • (2024)Hydroptical Thermal Feedback: Spatial Thermal Feedback Using Visible Lights and WaterProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676453(1-19)Online publication date: 13-Oct-2024
  • Show More Cited By

Index Terms

  1. A sense of ice and fire: Exploring thermal feedback with multiple thermoelectric-cooling elements on a smart ring
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image International Journal of Human-Computer Studies
    International Journal of Human-Computer Studies  Volume 130, Issue C
    Oct 2019
    273 pages

    Publisher

    Academic Press, Inc.

    United States

    Publication History

    Published: 01 October 2019

    Author Tags

    1. Smart ring
    2. Thermal feedback
    3. Spatial thermal sensitivity
    4. Wearable

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 06 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)ThermoGrasp: Enabling Localized Thermal Feedback on Fingers for Precision Grasps in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36765268:MHCI(1-21)Online publication date: 24-Sep-2024
    • (2024)Fiery Hands: Designing Thermal Glove through Thermal and Tactile Integration for Virtual Object ManipulationProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676457(1-15)Online publication date: 13-Oct-2024
    • (2024)Hydroptical Thermal Feedback: Spatial Thermal Feedback Using Visible Lights and WaterProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676453(1-19)Online publication date: 13-Oct-2024
    • (2024)DexteriSync: A Hand Thermal I/O Exoskeleton for Morphing Finger Dexterity ExperienceProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676422(1-12)Online publication date: 13-Oct-2024
    • (2024)Flip-Pelt: Motor-Driven Peltier Elements for Rapid Thermal Stimulation and Congruent Pressure Feedback in Virtual RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676363(1-15)Online publication date: 13-Oct-2024
    • (2024)Smiles Summon the Warmth of Spring: A Design Framework for Thermal-Affective Interaction based in Chinese Cí PoetryProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661620(2802-2819)Online publication date: 1-Jul-2024
    • (2024)ThermalPen: Investigating the Influence of Thermal Haptic Feedback for Creativity in 3D SketchingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656191(661-673)Online publication date: 23-Jun-2024
    • (2024)Understanding and Designing Thermal ExperiencesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3634893(1-4)Online publication date: 11-Feb-2024
    • (2024)Designing Beyond Hot and Cold – Exploring Full-Body Heat Experiences in SaunaProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633364(1-14)Online publication date: 11-Feb-2024
    • (2024)What Is the User Experience of Eyes-Free Touch Input with Vibrotactile Feedback Decoupled from the Touchscreen?Extended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650804(1-8)Online publication date: 11-May-2024
    • Show More Cited By

    View Options

    View options

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media