GMRV Publications

Augmented Touch without Visual Obtrusion

Francesco I. Cosco, Carlos Garre, Fabio Bruno, Maurizio Muzzupappa, Miguel A. Otaduy
Proc. of International Symposium on Mixed and Augmented Reality (ISMAR 2009) - 2009
Download the publication : CGBMO09.pdf [4.9Mo]  
Visuo-haptic mixed reality consists of adding to a real scene the ability to see and touch virtual bjects. It requires the use of seethrough display technology for visually mixing real and virtual objects, and haptic devices for adding haptic interaction with the virtual objects. However, haptic devices tend to be bulky items that appear in the field of view of the user. In this work, we propose a novel mixed reality paradigm where it is possible to touch and see virtual objects in combination with a real scene, but without visual obtrusion produced by the haptic device. This mixed reality paradigm relies on the following three technical steps: tracking of the haptic device, visual deletion of the device from the real scene, and background completion using image-based models. We have developed a successful proof-of-concept implementation, where a user can touch virtual objects in the context of a real scene.

Images and movies

image1.jpg [152Ko]
image2.jpg [118Ko]
image3.jpg [146Ko]
CGBMO09_divx.avi [45.7Mo]

BibTex references

  author       = "Cosco, Francesco I.  and Garre, Carlos and Bruno, Fabio and Muzzupappa, Maurizio and Otaduy, Miguel A.",
  title        = "Augmented Touch without Visual Obtrusion",
  booktitle    = "Proc. of International Symposium on Mixed and Augmented Reality (ISMAR 2009)",
  year         = "2009",
  publisher    = "IEEE/ACM",
  url          = ""

Other publications in the database

» Francesco I. Cosco
» Carlos Garre
» Fabio Bruno
» Maurizio Muzzupappa
» Miguel A. Otaduy