Multimodal Augmented Reality – Augmenting Auditory-Tactile Feedback to Change the Perception of Thickness
Lugtenberg, Geert; Hürst, Wolfgang; Rosa, Nina; Sandor, Christian; Plopski, Alexander; Taketomi, Takafumi; Kato, Hirokazu; Schoeffmann, Klaus; Gabbouj, Moncef; O'Connor, Noel E.; Elgammal, Ahmed; Chalidabhongse, Thanarat H.; Aramvith, Supavadee; Ngo, Chong Wah; Ho, Yo-Sung
(2018)
MultiMedia Modeling - 24th International Conference, MMM 2018, Proceedings, volume 10704 LNCS, pp. 369 - 380
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 10704 LNCS, pp. 369 - 380
24th International Conference on MultiMedia Modeling, MMM 2018, volume 10704 LNCS, pp. 369 - 380
(Part of book)
Abstract
With vision being a primary sense of humans, we often first estimate the physical properties of objects by looking at them. However, when in doubt, for example, about the material they are made of or its structure, it is natural to apply other senses, such as haptics by touching them.
... read more
Aiming at the ultimate goal of achieving a full-sensory augmented reality experience, we present an initial study focusing on multimodal feedback when tapping an object to estimate the thickness of its material. Our results indicate that we can change the perception of thickness of stiff objects by modulating acoustic stimuli. For flexible objects, which have a more distinctive tactile characteristic, adding vibratory responses when tapping on thick objects can make people perceive them as thin. We also identified that in the latter case, adding congruent acoustic stimuli does not further enhance the illusion but worsens it.
show less
Download/Full Text
The full text of this publication is not available.
Keywords: Augmented reality, Multimodal AR, Multimodal perception, Theoretical Computer Science, Computer Science(all)
ISSN: 0302-9743
ISBN: 9783319736020
Publisher: Springer Verlag
(Peer reviewed)
See more statistics about this item