Abstract

Middle and inner ear procedures target hearing loss, infections, and tumors of the temporal bone and lateral skull base. Despite the advances in surgical techniques, these procedures remain challenging due to limited haptic and visual feedback. Augmented reality (AR) may improve operative safety by allowing the 3D visualization of anatomical structures from preoperative computed tomography (CT) scans on real intraoperative microscope video feed. The purpose of this work was to develop a real-time CT-augmented stereo microscope system using camera calibration and electromagnetic (EM) tracking.A 3D printed and electromagnetically tracked calibration board was used to compute the intrinsic and extrinsic parameters of the surgical stereo microscope. These parameters were used to establish a transformation between the EM tracker coordinate system and the stereo microscope image space such that any tracked 3D point can be projected onto the left and right images of the microscope video stream. This allowed the augmentation of the microscope feed of a 3D printed temporal bone with its corresponding CT-derived virtual model. Finally, the calibration board was also used for evaluating the accuracy of the calibration.We evaluated the accuracy of the system by calculating the registration error (RE) in 2D and 3D in a microsurgical laboratory setting. Our calibration workflow achieved a RE of 0.11 ± 0.06 mm in 2D and 0.98 ± 0.13 mm in 3D. In addition, we overlaid a 3D CT model on the microscope feed of a 3D resin printed model of a segmented temporal bone. The system exhibited small latency and good registration accuracy.We present the calibration of an electromagnetically tracked surgical stereo microscope for augmented reality visualization. The calibration method achieved accuracy within a range suitable for otologic procedures. The AR process introduces enhanced visualization of the surgical field while allowing depth perception.

View details for DOI 10.1007/s11548-023-02980-5

View details for PubMedID 37450175

View details for PubMedCentralID 4634572

Abstract

PURPOSE: To develop a method for building MRI reconstruction neural networks robust to changes in signal-to-noise ratio (SNR) and trainable with a limited number of fully sampled scans.METHODS: We propose Noise2Recon, a consistency training method for SNR-robust accelerated MRI reconstruction that can use both fully sampled (labeled) and undersampled (unlabeled) scans. Noise2Recon uses unlabeled data by enforcing consistency between model reconstructions of undersampled scans and their noise-augmented counterparts. Noise2Recon was compared to compressed sensing and both supervised and self-supervised deep learning baselines. Experiments were conducted using retrospectively accelerated data from the mridata three-dimensional fast-spin-echo knee and two-dimensional fastMRI brain datasets. All methods were evaluated in label-limited settings and among out-of-distribution (OOD) shifts, including changes in SNR, acceleration factors, and datasets. An extensive ablation study was conducted to characterize the sensitivity of Noise2Recon to hyperparameter choices.RESULTS: In label-limited settings, Noise2Recon achieved better structural similarity, peak signal-to-noise ratio, and normalized-RMS error than all baselines and matched performance of supervised models, which were trained with 14 *

Abstract

[Formula: see text] mapping is a powerful tool for studying osteoarthritis (OA) changes and bilateral imaging may be useful in investigating the role of between-knee asymmetry in OA onset and progression. The quantitative double-echo in steady-state (qDESS) can provide fast simultaneous bilateral knee [Formula: see text] and high-resolution morphometry for cartilage and meniscus. The qDESS uses an analytical signal model to compute [Formula: see text] relaxometry maps, which require knowledge of the flip angle (FA). In the presence of [Formula: see text] inhomogeneities, inconsistencies between the nominal and actual FA can affect the accuracy of [Formula: see text] measurements. We propose a pixel-wise [Formula: see text] correction method for qDESS [Formula: see text] mapping exploiting an auxiliary [Formula: see text] map to compute the actual FA used in the model.The technique was validated in a phantom and in vivo with simultaneous bilateral knee imaging. [Formula: see text] measurements of femoral cartilage (FC) of both knees of six healthy participants were repeated longitudinally to investigate the association between [Formula: see text] variation and [Formula: see text].The results showed that applying the [Formula: see text] correction mitigated [Formula: see text] variations that were driven by [Formula: see text] inhomogeneities. Specifically, [Formula: see text] left-right symmetry increased following the [Formula: see text] correction ([Formula: see text] = 0.74 > [Formula: see text] = 0.69). Without the [Formula: see text] correction, [Formula: see text] values showed a linear dependence with [Formula: see text]. The linear coefficient decreased using the [Formula: see text] correction (from 24.3 ± 1.6 ms to 4.1 ± 1.8) and the correlation was not statistically significant after the application of the Bonferroni correction (p value > 0.01).The study showed that [Formula: see text] correction could mitigate variations driven by the sensitivity of the qDESS [Formula: see text] mapping method to [Formula: see text], therefore, increasing the sensitivity to detect real biological changes. The proposed method may improve the robustness of bilateral qDESS [Formula: see text] mapping, allowing for an accurate and more efficient evaluation of OA pathways and pathophysiology through longitudinal and cross-sectional studies.

View details for DOI 10.1007/s10334-023-01094-y

View details for PubMedID 37142852

View details for PubMedCentralID 2268124

View details for Web of Science ID 001013148000151

Abstract

We systematically evaluate the training methodology and efficacy of two inpainting-based pretext tasks of context prediction and context restoration for medical image segmentation using self-supervised learning (SSL). Multiple versions of self-supervised U-Net models were trained to segment MRI and CT datasets, each using a different combination of design choices and pretext tasks to determine the effect of these design choices on segmentation performance. The optimal design choices were used to train SSL models that were then compared with baseline supervised models for computing clinically-relevant metrics in label-limited scenarios. We observed that SSL pretraining with context restoration using 32 × 32 patches and Poission-disc sampling, transferring only the pretrained encoder weights, and fine-tuning immediately with an initial learning rate of 1 × 10-3 provided the most benefit over supervised learning for MRI and CT tissue segmentation accuracy (p < 0.001). For both datasets and most label-limited scenarios, scaling the size of unlabeled pretraining data resulted in improved segmentation performance. SSL models pretrained with this amount of data outperformed baseline supervised models in the computation of clinically-relevant metrics, especially when the performance of supervised learning was low. Our results demonstrate that SSL pretraining using inpainting-based pretext tasks can help increase the robustness of models in label-limited scenarios and reduce worst-case errors that occur with supervised learning.

View details for DOI 10.3390/bioengineering10020207

View details for PubMedID 36829701

View details for DOI 10.1117/12.2648463

View details for Web of Science ID 001170185600040

Abstract

This paper investigates the accuracy of Augmented Reality (AR) technologies, particularly commercially available optical see-through displays, in depicting virtual content inside the human body for surgical planning. Their inherent limitations result in inaccuracies in perceived object positioning. We examine how occlusion, specifically with opaque surfaces, affects perceived depth of virtual objects at arm's length working distances. A custom apparatus with a half-silvered mirror was developed, providing accurate depth cues excluding occlusion, differing from commercial displays. We carried out a study, contrasting our apparatus with a HoloLens 2, involving a depth estimation task under varied surface complexities and illuminations. In addition, we explored the effects of creating a virtual "hole" in the surface. Subjects' depth estimation accuracy and confidence were a ssessed. Results showed more depth estimation variation with HoloLens and significant depth error beneath complex occluding surfaces. However, creating a virtual hole significantly reduced depth errors and increased subjects' confidence, irrespective of accuracy enhancement. These findings have important implications for the design and use of mixed-reality technologies in surgical applications, and industrial applications such as using virtual content to guide maintenance or repair of components hidden beneath the opaque outer surface of equipment. A free copy of this paper and all supplemental materials are available at https://bit.ly/3YbkwjU.

View details for DOI 10.1109/TVCG.2023.3320239

View details for PubMedID 37782607

Abstract

BACKGROUND: Diffusion-weighted imaging (DWI) may allow for breast cancer screening MRI without a contrast injection. Multishot methods improve prone DWI of the breasts but face different challenges in the supine position.PURPOSE: To establish a multishot DWI (msDWI) protocol for supine breast MRI and to evaluate the performance of supine vs. prone msDWI.STUDY TYPE: Prospective.POPULATION: Protocol optimization: 10 healthy women (ages 22-56), supine vs. prone: 24 healthy women (ages 22-62) and five women (ages 29-61) with breast tumors.FIELD STRENGTH/SEQUENCE: 3-T, protocol optimization msDWI: free-breathing (FB) 2-shots, FB 4-shots, respiratory-triggered (RT) 2-shots, RT 4-shots, supine vs. prone: RT 4-shot msDWI, T2-weighted fast-spin echo.ASSESSMENT: Protocol optimization and supine vs. prone: three observers performed an image quality assessment of sharpness, aliasing, distortion (vs. T2), perceived SNR, and overall image quality (scale of 1-5). Apparent diffusion coefficients (ADCs) in fibroglandular tissue (FGT) and breast tumors were measured.STATISTICAL TESTS: Effect of study variables on dichotomized ratings (4/5 vs. 1/2/3) and FGT ADCs were assessed with mixed-effects logistic regression. Interobserver agreement utilized Gwet's agreement coefficient (AC). Lesion ADCs were assessed by Bland-Altman analysis and concordance correlation (rhoc ). P value <0.05 was considered statistically significant.RESULTS: Protocol optimization: 4-shots significantly improved sharpness and distortion; RT significantly improved sharpness, aliasing, perceived SNR, and overall image quality. FGT ADCs were not significantly different between shots (P=0.812), FB vs. RT (P=0.591), or side (P=0.574). Supine vs. prone: supine images were rated significantly higher for sharpness, aliasing, and overall image quality. FGT ADCs were significantly higher supine; lesion ADCs were highly correlated (rhoc =0.92).DATA CONCLUSION: Based on image quality, supine msDWI outperformed prone msDWI. Lesion ADCs were highly correlated between the two positions, while FGT ADCs were higher in the supine position.EVIDENCE LEVEL: 2.TECHNICAL EFFICACY: Stage 1.

View details for DOI 10.1002/jmri.28582

View details for PubMedID 36583628

Abstract

To develop and validate a method for B 0

Abstract

PURPOSE: Diffusion weighted Fast Spin Echo (DW-FSE) is a promising approach for distortionless DW imaging that is robust to system imperfections such as eddy currents and off-resonance. Due to non-Carr-Purcell-Meiboom-Gill (CPMG) magnetization, most DW-FSE sequences discard a large fraction of the signal ( 2 - 2 *