Many augmented reality (AR) applications require the alignment of virtual objects to the real world; this is particularly important in medical AR scenarios where medical imaging information may be displayed directly on a patient and is used to identify the exact locations of specific anatomical structures within the body.

Accurate alignment of virtual and real content is important for applications where the virtual rendering of medical imaging data is used to guide the medical procedure such as a surgery.

External approaches to the frontal sinus such as osteoplastic flaps are challenging because they require blind entry into the sinus, posing risks of injury to the brain or orbit.

Repetitive Transcranial Magnetic Stimulation (rTMS) is an important treatment option for medication resistant depression.

Mixed reality may help with identifying small lung lesions during minimally invasive thoracic surgery.

Depression affects more than 16 million American adults, more than half of whom do not respond to medication.

The magnetic susceptibility effects of magnetic ink in MRI can be exploited to visualize magnetic ink patterns placed on the skin.

We have developed a mixed-reality system that projects a 3D “hologram” of images from a preoperative breast MRI onto a patient using the Microsoft HoloLens.