HaptoFloater: Visuo-Haptic Augmented Reality by Embedding Imperceptible Color Vibration Signals for Tactile Display Control in a Mid-Air Image
<|reference_start|>HaptoFloater: Visuo-Haptic Augmented Reality by Embedding Imperceptible Color Vibration Signals for Tactile Display Control in a Mid-Air Image: We propose HaptoFloater, a low-latency mid-air visuo-haptic augmented reality (VHAR) system that utilizes imperceptible color vibrations. When adding tactile stimuli to the visual information of a mid-air image, the user should not perceive the latency between the tactile and visual information. However, conventional tactile presentation methods for mid-air images, based on camera-detected fingertip positioning, introduce latency due to image processing and communication. To mitigate this latency, we use a color vibration technique; humans cannot perceive the vibration when the display alternates between two different color stimuli at a frequency of 25 Hz or higher. In our system, we embed this imperceptible color vibration into the mid-air image formed by a micromirror array plate, and a photodiode on the fingertip device directly detects this color vibration to provide tactile stimulation. Thus, our system allows for the tactile perception of multiple patterns on a mid-air image in 59.5 ms. In addition, we evaluate the visual-haptic delay tolerance on a mid-air display using our VHAR system and a tactile actuator with a single pattern and faster response time. The results of our user study indicate a visual-haptic delay tolerance of 110.6 ms, which is considerably larger than the latency associated with systems using multiple tactile patterns.<|reference_end|>
@article{nagano2024haptofloater:,
    title={HaptoFloater: Visuo-Haptic Augmented Reality by Embedding Imperceptible
  Color Vibration Signals for Tactile Display Control in a Mid-Air Image},
    author={Rina Nagano, Takahiro Kinoshita, Shingo Hattori, Yuichi Hiroi, Yuta
  Itoh, Takefumi Hiraki},
    journal={arXiv preprint arXiv:2408.06552},
    year={2024},
    archivePrefix={arXiv},
    eprint={2408.06552},
    primaryClass={cs.HC}
}