Metaverse Demos

Pain Management – Fiery Hands: Designing Thermal Glove through Thermal and Tactile
Integration for Virtual Object Manipulation

Abstract: We present a novel approach to render thermal and tactile feedback to the palm and fingertips through thermal and tactile integration to enable virtual object manipulation while providing localized and global thermal feedback. We demonstrate the efficacy of our approach in Metaverse to show the significant progress in thermal interactions within VR, offering enhanced sensory immersion at an optimal energy cost. [PaperVideo] This technology could enable targeted relief for pain management. Key areas where Fiery Hands could contribute include:

  • Localized Heat Therapy: The glove’s capacity to deliver focused warmth on the palm and fingers aligns well with the needs of arthritis patients, as heat can reduce joint stiffness and improve blood flow, which is often beneficial for easing joint pain and increasing flexibility.
  • Alternating Heat and Cold Patterns: The ability to switch between hot and cold sensations could mimic a therapeutic “contrast therapy,” known to reduce inflammation and soothe pain by alternating temperature changes. This is beneficial for reducing joint swelling and soreness, particularly in VR applications where the intensity and duration can be customized for comfort.
  • Enhanced Immersion for Therapeutic Exercises: In a virtual setting, Fiery Hands could enhance physical therapy exercises by creating simulated warm-up routines, calming cooling effects, or adaptive sensory cues that guide users through VR-based therapeutic exercises, fostering a deeper connection between exercise and therapeutic outcomes.

Hygiene Training for Healthcare Professionals and General Public – Thermal In Motion: Designing Thermal Flow Illusions with Tactile and Thermal Interaction

Abstract: This study presents a novel method for creating moving thermal sensations by integrating the thermal referral illusion with tactile motion. It is integrated into Metaverse VR environment of two interaction scenarios to show the comprehension of thermal perception and its integration with tactile cues, promising significant advancements in incorporating thermal motion into diverse thermal interfaces for immersive VR experiences. [PaperVideo] This technology can be used for hygiene training, particularly for healthcare professionals in high-stress settings like Emergency Rooms (ERs) and Intensive Care Units (ICUs), as well as for general public training. Here’s how it could contribute to these areas:

  • Simulated Thermal Feedback for Hygiene Zones: By leveraging thermal flow illusion, specific “hygiene zones” (areas that require extra care during handwashing or sanitizing) can be highlighted through warm or cold sensations. This sensory feedback could guide users through proper handwashing techniques, covering each step thoroughly, which is crucial in healthcare environments.
  • Routine Training for ER and ICU Providers: For healthcare providers, this could reinforce essential hygiene protocols in VR simulations. For example, the sensation of thermal flow could be integrated to remind them of specific disinfection steps or prompt a thermal alert if they inadvertently skip essential areas, fostering meticulous hygiene habits under time constraints.
  • Post-COVID Public Hygiene Training: For the general population, creating an engaging, immersive hygiene training experience could be highly effective in instilling consistent habits, especially with post-COVID vigilance. Using thermal flow illusions as cues in handwashing or sanitization routines could make training memorable and intuitive.

Mental Health – FIRE: Mid-Air Thermo-Tactile Display in VR

Abstract: We prototyped a thermo-tactile feedback system with an open-top chamber, heat modules, and an ultrasound display to provide heated airflow along the path to the focused pressure point created from the ultrasound display to generate thermal and vibrotactile cues in mid-air simultaneously. [PaperVideo] FIRE system has potential applications for mental health, especially for meditation and relaxation exercises that promote well-being in the post-COVID era. Here’s how this technology could support mental health:

  • Simulated Candle for Meditation: The mid-air thermo-tactile display could emulate the warmth and gentle vibrational cues of a candle, creating a calming focal point that enhances traditional meditation practices. This sensory experience could be highly effective for grounding and relaxation, providing users with a comforting ambiance associated with mindfulness.
  • Guided VR-Based Relaxation: For meditation applications, your system could deliver gentle, pulsing warmth and subtle tactile feedback, mimicking natural environmental sensations (like sitting by a warm fire or candle). These sensations can help users focus on breathing and mindfulness techniques, ideal for reducing stress and anxiety, especially in immersive, therapeutic settings.
  • Home-Based Relaxation Therapy: As more people focus on mental well-being at home, especially after the isolation of the pandemic, FIRE could offer a highly accessible form of relaxation therapy. Users could engage in VR-guided meditation sessions that integrate soothing thermal and tactile cues to enhance immersion, creating a spa-like experience conducive to stress relief.

Dr. Jin Ryong Kim

The University of Texas at Dallas, USA

Dr. Jin Ryong Kim (https://www.jessekim.com) is an Assistant Professor of Computer Science and the Director of the Multimodal Interaction Lab (MI Lab, https://mi-lab.io) at the University of Texas at Dallas. Prior to joining UT Dallas, he was a Staff Researcher at Alibaba Group in Sunnyvale, California, USA, and a Senior Researcher at ETRI, Korea. His research focuses on haptics, virtual reality (VR), and human-computer interaction (HCI), with a focus on advancing interactive technologies through multimodal interaction, specially useful in Metaverse for Healthcare. 

Dr. Kim’s work emphasizes the exploration of haptics and multimodal interaction to create user interfaces and interaction techniques that fully leverage human sensory capabilities. His work has received multiple awards including the IEEE RA-L Outstanding Associate Editor Award, ACM SIGGRAPH Asia Emerging Technologies Best Demo Award, IEEE Haptics Symposium 2024 Best Demo Honorable Mention Award, ACM UIST 2024 Best Demo Honorable Mention Award, IEEE ISMAR 2024 Best Demo Award, ACM VRST 2022 Best Poster Award, and the Young Researcher Award from the Korea Haptics Community. Dr. Kim earned his Ph.D. in Electrical and Computer Engineering (advised by Dr. Hong Tan) and an M.S. in Computer Science, both from Purdue University. He is a member of IEEE and ACM.