A Patient-Specific Mixed-Reality Visualization Tool for Thoracic Surgical Planning

Mixed reality may help with identifying small lung lesions during minimally invasive thoracic surgery.  We have developed a software application and medical image processing pipeline for the Microsoft HoloLens to incorporate patient-specific data and provide a mixed-reality tool to explore and manipulate chest anatomy in three dimensions with a custom-designed user interface featuring gesture and voice recognition.  Our prototype allows the user to (1) view a patient's original preoperative imaging; (2) manipulate a 3-dimensional rendering of that patient's chest anatomy including the bronchial, osseus, and vascular structures; and (3) simulate lung deflation and surgical instrument placement.

Perkins SL*, Krajancich B*, Yang CFJ, Hargreaves BA, Daniel BL, Berry MF. A patient-specific mixed-reality visualization tool for thoracic surgical planning. Ann Thorac Surg. 2020 Jul;110(1):290-295.

Online Journal Article
Brian A. Hargreaves
Professor of Radiology (Radiological Sciences Laboratory) and, by courtesy, of Electrical Engineering and of Bioengineering
(650) 498-5368
bah@stanford.edu
Bruce Daniel
Professor of Radiology (Body Imaging) and, by courtesy, of Bioengineering
bdaniel@stanford.edu
Mark Francis Berry, MD
Mylavarapu Rogers Professor of Cardiothoracic Surgery
berry037@stanford.edu
This profile is not available

Bruce Daniel, MD
(Director)
Professor, Radiology, 
and Bioengineering

bdaniel@stanford.edu

Brian Hargreaves, PhD
(Co-Director)   
Professor, Radiology,
Electrical Engineering 
and Bioengineering
bah@stanford.edu

Contact Information

Lucas Center for Imaging
1201 Welch Rd P170
Stanford, CA 94305-5488

Directions to Lucas Ctr