A particular challenge with mixed reality is ensuring that virtual content is perceived accurately, with the appropriate shape, in the correct position and orientation, and with the proper relationships to other virtual and real content.  Specific project areas are detailed below.

Medical augmented reality (AR) applications where virtual renderings are aligned with the real world allow to visualize internal anatomy of the patient to a medical caregiver wearing an AR headset. Accurate alignment of virtual and real content is important for applications where the virtual rendering is used to guide the medical procedure such as a surgery. Compared to 2D AR applications, where the alignment accuracy can be directly measured on the 2D screen, 3D medical AR applications require alignment measurements using phantoms and external tracking systems. At IMMERS we are developing technologies to improve 3D AR alignment procedures that allow medical caregivers to perceive virtual content to be accurately aligned with the real patient. We then evaluate these techniques both according to their computer vision and tracking capabilities but also based on the AR user’s perception when using the device and projecting medical imaging data on a subject.