Intermediated reality

  Augmented Reality (AR) aims to extend the physical world through virtual content. To perform such addition in an unnoticeable way, a variety of technical constraints need to be surpassed. Seamless mixing between Real and Virtual worlds require methods of texture and geometry deformation, lighting consistency, Diminished Reality and information visualization.

This research brings together technical solutions and perceptual studies to address the gap between virtual and physical objects through photo-realistic Real-time interactive Augmented Reality. To do so, we perform deformation of surface camera samples to accomplish seamless animations of physical objects. In addition, we incorporate a Diminished Reality method to allow virtual deformations that would, otherwise, reveal undesired background behind the animated mesh. Furthermore, we implement a shadow remapping technique that projects shadows to physical animated objects according to its environment lighting.

Presented research, if successful, could be applied to a variety of industries and scenarios. Such as, for instance, Stop Motion Animation, where in-between frames could be generated through Augmented Reality. Hence, only key poses would require to be physically present reducing production costs and generating a potential advance for the field.

  • Dates:

    2016 to 2020

  • Qualification:

    Doctorate (PhD)

Project Team


Research Areas