Vessel-targeted compensation of deformable motion in interventional cone-beam CT.

The present standard of care for unresectable liver cancer is transarterial chemoembolization (TACE), which involves using chemotherapeutic particles to selectively embolize the arteries supplying hepatic tumors. Accurate volumetric identification of intricate fine vascularity is crucial for selective embolization. Three-dimensional imaging, particularly cone-beam CT (CBCT), aids in visualization and targeting of small vessels in such highly variable anatomy, but long image acquisition time results in intra-scan patient motion, which distorts vascular structures and tissue boundaries. To improve clarity of vascular anatomy and intra-procedural utility, this work proposes a targeted motion estimation and compensation framework that removes the need for any prior information or external tracking and for user interaction. Motion estimation is performed in two stages: (i) a target identification stage that segments arteries and catheters in the projection domain using a multi-view convolutional neural network to construct a coarse 3D vascular mask; and (ii) a targeted motion estimation stage that iteratively solves for the time-varying motion field via optimization of a vessel-enhancing objective function computed over the target vascular mask. The vessel-enhancing objective is derived through eigenvalues of the local image Hessian to emphasize bright tubular structures. Motion compensation is achieved via spatial transformer operators that apply time-dependent deformations to partial angle reconstructions, allowing efficient minimization via gradient backpropagation. The framework was trained and evaluated in anatomically realistic simulated motion-corrupted CBCTs mimicking TACE of hepatic tumors, at intermediate (3.0 mm) and large (6.0 mm) motion magnitudes. Motion compensation substantially improved median vascular DICE score (from 0.30 to 0.59 for large motion), image SSIM (from 0.77 to 0.93 for large motion), and vessel sharpness (0.189 mm-1 to 0.233 mm-1 for large motion) in simulated cases. Motion compensation also demonstrated increased vessel sharpness (0.188 mm-1 before to 0.205 mm-1 after) and reconstructed vessel length (median increased from 37.37 to 41.00 mm) on a clinical interventional CBCT. The proposed anatomy-aware motion compensation framework presented a promising approach for improving the utility of CBCT for intra-procedural vascular imaging, facilitating selective embolization procedures.

CT in musculoskeletal imaging: still helpful and for what?

Computed tomography (CT) is a common modality employed for musculoskeletal imaging. Conventional CT techniques are useful for the assessment of trauma in detection, characterization and surgical planning of complex fractures. CT arthrography can depict internal derangement lesions and impact medical decision making of orthopedic providers. In oncology, CT can have a role in the characterization of bone tumors and may elucidate soft tissue mineralization patterns. Several advances in CT technology have led to a variety of acquisition techniques with distinct clinical applications. These include four-dimensional CT, which allows examination of joints during motion; cone-beam CT, which allows examination during physiological weight-bearing conditions; dual-energy CT, which allows material decomposition useful in musculoskeletal deposition disorders (e.g., gout) and bone marrow edema detection; and photon-counting CT, which provides increased spatial resolution, decreased radiation, and material decomposition compared to standard multi-detector CT systems due to its ability to directly translate X-ray photon energies into electrical signals. Advanced acquisition techniques provide higher spatial resolution scans capable of enhanced bony microarchitecture and bone mineral density assessment. Together, these CT acquisition techniques will continue to play a substantial role in the practices of orthopedics, rheumatology, metabolic bone, oncology, and interventional radiology.

Deformable motion compensation in interventional cone-beam CT with a context-aware learned autofocus metric.

PURPOSE: Interventional Cone-Beam CT (CBCT) offers 3D visualization of soft-tissue and vascular anatomy, enabling 3D guidance of abdominal interventions. However, its long acquisition time makes CBCT susceptible to patient motion. Image-based autofocus offers a suitable platform for compensation of deformable motion in CBCT, but it relies on handcrafted motion metrics based on first-order image properties and that lack awareness of the underlying anatomy. This work proposes a data-driven approach to motion quantification via a learned, context-aware, deformable metric, VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ , that quantifies the amount of motion degradation as well as the realism of the structural anatomical content in the image. METHODS: The proposed VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ was modeled as a deep convolutional neural network (CNN) trained to recreate a reference-based structural similarity metric-visual information fidelity (VIF). The deep CNN acted on motion-corrupted images, providing an estimation of the spatial VIF map that would be obtained against a motion-free reference, capturing motion distortion, and anatomic plausibility. The deep CNN featured a multi-branch architecture with a high-resolution branch for estimation of voxel-wise VIF on a small volume of interest. A second contextual, low-resolution branch provided features associated to anatomical context for disentanglement of motion effects and anatomical appearance. The deep CNN was trained on paired motion-free and motion-corrupted data obtained with a high-fidelity forward projection model for a protocol involving 120 kV and 9.90 mGy. The performance of VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ was evaluated via metrics of correlation with ground truth VIF ${\bm{VIF}}$ and with the underlying deformable motion field in simulated data with deformable motion fields with amplitude ranging from 5 to 20 mm and frequency from 2.4 up to 4 cycles/scan. Robustness to variation in tissue contrast and noise levels was assessed in simulation studies with varying beam energy (90-120 kV) and dose (1.19-39.59 mGy). Further validation was obtained on experimental studies with a deformable phantom. Final validation was obtained via integration of VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ on an autofocus compensation framework, applied to motion compensation on experimental datasets and evaluated via metric of spatial resolution on soft-tissue boundaries and sharpness of contrast-enhanced vascularity. RESULTS: The magnitude and spatial map of VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ showed consistent and high correlation levels with the ground truth in both simulation and real data, yielding average normalized cross correlation (NCC) values of 0.95 and 0.88, respectively. Similarly, VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ achieved good correlation values with the underlying motion field, with average NCC of 0.90. In experimental phantom studies, VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ properly reflects the change in motion amplitudes and frequencies: voxel-wise averaging of the local VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ across the full reconstructed volume yielded an average value of 0.69 for the case with mild motion (2 mm, 12 cycles/scan) and 0.29 for the case with severe motion (12 mm, 6 cycles/scan). Autofocus motion compensation using VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ resulted in noticeable mitigation of motion artifacts and improved spatial resolution of soft tissue and high-contrast structures, resulting in reduction of edge spread function width of 8.78% and 9.20%, respectively. Motion compensation also increased the conspicuity of contrast-enhanced vascularity, reflected in an increase of 9.64% in vessel sharpness. CONCLUSION: The proposed VI F D L ${\bm{VI}}{{\bm{F}}}_{DL}$ , featuring a novel context-aware architecture, demonstrated its capacity as a reference-free surrogate of structural similarity to quantify motion-induced degradation of image quality and anatomical plausibility of image content. The validation studies showed robust performance across motion patterns, x-ray techniques, and anatomical instances. The proposed anatomy- and context-aware metric poses a powerful alternative to conventional motion estimation metrics, and a step forward for application of deep autofocus motion compensation for guidance in clinical interventional procedures.

Deformable registration of preoperative MR and intraoperative long-length tomosynthesis images for guidance of spine surgery via image synthesis.

PURPOSE: Improved integration and use of preoperative imaging during surgery hold significant potential for enhancing treatment planning and instrument guidance through surgical navigation. Despite its prevalent use in diagnostic settings, MR imaging is rarely used for navigation in spine surgery. This study aims to leverage MR imaging for intraoperative visualization of spine anatomy, particularly in cases where CT imaging is unavailable or when minimizing radiation exposure is essential, such as in pediatric surgery. METHODS: This work presents a method for deformable 3D-2D registration of preoperative MR images with a novel intraoperative long-length tomosynthesis imaging modality (viz., Long-Film [LF]). A conditional generative adversarial network is used to translate MR images to an intermediate bone image suitable for registration, followed by a model-based 3D-2D registration algorithm to deformably map the synthesized images to LF images. The algorithm's performance was evaluated on cadaveric specimens with implanted markers and controlled deformation, and in clinical images of patients undergoing spine surgery as part of a large-scale clinical study on LF imaging. RESULTS: The proposed method yielded a median 2D projection distance error of 2.0 mm (interquartile range [IQR]: 1.1-3.3 mm) and a 3D target registration error of 1.5 mm (IQR: 0.8-2.1 mm) in cadaver studies. Notably, the multi-scale approach exhibited significantly higher accuracy compared to rigid solutions and effectively managed the challenges posed by piecewise rigid spine deformation. The robustness and consistency of the method were evaluated on clinical images, yielding no outliers on vertebrae without surgical instrumentation and 3% outliers on vertebrae with instrumentation. CONCLUSIONS: This work constitutes the first reported approach for deformable MR to LF registration based on deep image synthesis. The proposed framework provides access to the preoperative annotations and planning information during surgery and enables surgical navigation within the context of MR images and/or dual-plane LF images.

Synthetic PET from CT improves diagnosis and prognosis for lung cancer: Proof of concept.

[18F]Fluorodeoxyglucose positron emission tomography (FDG-PET) and computed tomography (CT) are indispensable components in modern medicine. Although PET can provide additional diagnostic value, it is costly and not universally accessible, particularly in low-income countries. To bridge this gap, we have developed a conditional generative adversarial network pipeline that can produce FDG-PET from diagnostic CT scans based on multi-center multi-modal lung cancer datasets (n = 1,478). Synthetic PET images are validated across imaging, biological, and clinical aspects. Radiologists confirm comparable imaging quality and tumor contrast between synthetic and actual PET scans. Radiogenomics analysis further proves that the dysregulated cancer hallmark pathways of synthetic PET are consistent with actual PET. We also demonstrate the clinical values of synthetic PET in improving lung cancer diagnosis, staging, risk prediction, and prognosis. Taken together, this proof-of-concept study testifies to the feasibility of applying deep learning to obtain high-fidelity PET translated from CT.

Objective image quality assurance in cone-beam CT: Test methods, analysis, and workflow in longitudinal studies.

BACKGROUND: Standards for image quality evaluation in multi-detector CT (MDCT) and cone-beam CT (CBCT) are evolving to keep pace with technological advances. A clear need is emerging for methods that facilitate rigorous quality assurance (QA) with up-to-date metrology and streamlined workflow suitable to a range of MDCT and CBCT systems. PURPOSE: To evaluate the feasibility and workflow associated with image quality (IQ) assessment in longitudinal studies for MDCT and CBCT with a single test phantom and semiautomated analysis of objective, quantitative IQ metrology. METHODS: A test phantom (CorgiTM Phantom, The Phantom Lab, Greenwich, New York, USA) was used in monthly IQ testing over the course of 1 year for three MDCT scanners (one of which presented helical and volumetric scan modes) and four CBCT scanners. Semiautomated software analyzed image uniformity, linearity, contrast, noise, contrast-to-noise ratio (CNR), 3D noise-power spectrum (NPS), modulation transfer function (MTF) in axial and oblique directions, and cone-beam artifact magnitude. The workflow was evaluated using methods adapted from systems/industrial engineering, including value stream process modeling (VSPM), standard work layout (SWL), and standard work control charts (SWCT) to quantify and optimize test methodology in routine practice. The completeness and consistency of DICOM data from each system was also evaluated. RESULTS: Quantitative IQ metrology provided valuable insight in longitudinal quality assurance (QA), with metrics such as NPS and MTF providing insight on root cause for various forms of system failure-for example, detector calibration and geometric calibration. Monthly constancy testing showed variations in IQ test metrics owing to system performance as well as phantom setup and provided initial estimates of upper and lower control limits appropriate to QA action levels. Rigorous evaluation of QA workflow identified methods to reduce total cycle time to ∼10 min for each system-viz., use of a single phantom configuration appropriate to all scanners and Head or Body scan protocols. Numerous gaps in the completeness and consistency of DICOM data were observed for CBCT systems. CONCLUSION: An IQ phantom and test methodology was found to be suitable to QA of MDCT and CBCT systems with streamlined workflow appropriate to busy clinical settings.

Feasibility of bone marrow edema detection using dual-energy cone-beam computed tomography.

BACKGROUND: Dual-energy (DE) detection of bone marrow edema (BME) would be a valuable new diagnostic capability for the emerging orthopedic cone-beam computed tomography (CBCT) systems. However, this imaging task is inherently challenging because of the narrow energy separation between water (edematous fluid) and fat (health yellow marrow), requiring precise artifact correction and dedicated material decomposition approaches. PURPOSE: We investigate the feasibility of BME assessment using kV-switching DE CBCT with a comprehensive CBCT artifact correction framework and a two-stage projection- and image-domain three-material decomposition algorithm. METHODS: DE CBCT projections of quantitative BME phantoms (water containers 100-165 mm in size with inserts presenting various degrees of edema) and an animal cadaver model of BME were acquired on a CBCT test bench emulating the standard wrist imaging configuration of a Multitom Rax twin robotic x-ray system. The slow kV-switching scan protocol involved a 60 kV low energy (LE) beam and a 120 kV high energy (HE) beam switched every 0.5° over a 200° angular span. The DE CBCT data preprocessing and artifact correction framework consisted of (i) projection interpolation onto matched LE and HE projections views, (ii) lag and glare deconvolutions, and (iii) efficient Monte Carlo (MC)-based scatter correction. Virtual non-calcium (VNCa) images for BME detection were then generated by projection-domain decomposition into an Aluminium (Al) and polyethylene basis set (to remove beam hardening) followed by three-material image-domain decomposition into water, Ca, and fat. Feasibility of BME detection was quantified in terms of VNCa image contrast and receiver operating characteristic (ROC) curves. Robustness to object size, position in the field of view (FOV) and beam collimation (varied 20-160 mm) was investigated. RESULTS: The MC-based scatter correction delivered > 69% reduction of cupping artifacts for moderate to wide collimations (> 80 mm beam width), which was essential to achieve accurate DE material decomposition. In a forearm-sized object, a 20% increase in water concentration (edema) of a trabecular bone-mimicking mixture presented as ∼15 HU VNCa contrast using 80-160 mm beam collimations. The variability with respect to object position in the FOV was modest (< 15% coefficient of variation). The areas under the ROC curve were > 0.9. A femur-sized object presented a somewhat more challenging task, resulting in increased sensitivity to object positioning at 160 mm collimation. In animal cadaver specimens, areas of VNCa enhancement consistent with BME were observed in DE CBCT images in regions of MRI-confirmed edema. CONCLUSION: Our results indicate that the proposed artifact correction and material decomposition pipeline can overcome the challenges of scatter and limited spectral separation to achieve relatively accurate and sensitive BME detection in DE CBCT. This study provides an important baseline for clinical translation of musculoskeletal DE CBCT to quantitative, point-of-care bone health assessment.

Deformable Motion Compensation for Intraprocedural Vascular Cone-beam CT with Sequential Projection Domain Targeting and Vessel-Enhancing Autofocus.

Purpose: Cone-beam CT (CBCT) is used in interventional radiology (IR) for identification of complex vascular anatomy, difficult to visualize in 2D fluoroscopy. However, long acquisition time makes CBCT susceptible to soft-tissue deformable motion that degrades visibility of fine vessels. We propose a targeted framework to compensate for deformable intra-scan motion via learned full-sequence models for identification of vascular anatomy coupled to an autofocus function specifically tailored to vascular imaging. Methods: The vessel-targeted autofocus acts in two stages: (i) identification of vascular and catheter targets in the projection domain; and, (ii) autofocus optimization for a 4D vector field through an objective function that quantifies vascular visibility. Target identification is based on a deep learning model that operates on the complete sequence of projections, via a transformer encoder-decoder architecture that uses spatial-temporal self-attention modules to infer long-range feature correlations, enabling identification of vascular anatomy with highly variable conspicuity. The vascular autofocus function is derived through eigenvalues of the local image Hessian, which quantify the local image structure for identification of bright tubular structures. Motion compensation was achieved via spatial transformer operators that impart time dependent deformations to NPAR = 90 partial angle reconstructions, allowing for efficient minimization via gradient backpropagation. The framework was trained and evaluated in synthetic abdominal CBCTs obtained from liver MDCT volumes and including realistic models of contrast-enhanced vascularity with 15 to 30 end branches, 1 - 3.5 mm vessel diameter, and 1400 HU contrast. Results: The targeted autofocus resulted in qualitative and quantitative improvement in vascular visibility in both simulated and clinical intra-procedural CBCT. The transformer-based target identification module resulted in superior detection of target vascularity and a lower number of false positives, compared to a baseline U-Net model acting on individual projection views, reflected as a 1.97x improvement in intersection-over-union values. Motion compensation in simulated data yielded improved conspicuity of vascular anatomy, and reduced streak artifacts and blurring around vessels, as well as recovery of shape distortion. These improvements amounted to an average 147% improvement in cross correlation computed against the motion-free ground truth, relative to the un-compensated reconstruction. Conclusion: Targeted autofocus yielded improved visibility of vascular anatomy in abdominal CBCT, providing better potential for intra-procedural tracking of fine vascular anatomy in 3D images. The proposed method poses an efficient solution to motion compensation in task-specific imaging, with future application to a wider range of imaging scenarios.

Cone-beam computed tomography produces images of numerically comparable diagnostic quality for bone and inferior quality for soft tissues compared with fan-beam computed tomography in cadaveric equine metacarpophalangeal joints.

Cone-beam computed tomography (CBCT) is an emerging modality for imaging of the equine patient. The objective of this prospective, descriptive, exploratory study was to assess visualization tasks using CBCT compared with conventional fan-beam CT (FBCT) for imaging of the metacarpophalangeal joint in equine cadavers. Satisfaction scores were numerically excellent with both CBCT and FBCT for bone evaluation, and FBCT was numerically superior for soft tissue evaluation. Preference tests indicated FBCT was numerically superior for soft tissue evaluation, while preference test scoring for bone was observer-dependent. Findings from this study can be used as background for future studies evaluating CBCT image quality in live horses.

Imaging in Interventional Radiology: 2043 and Beyond.

Since its inception in the early 20th century, interventional radiology (IR) has evolved tremendously and is now a distinct clinical discipline with its own training pathway. The arsenal of modalities at work in IR includes x-ray radiography and fluoroscopy, CT, MRI, US, and molecular and multimodality imaging within hybrid interventional environments. This article briefly reviews the major developments in imaging technology in IR over the past century, summarizes technologies now representative of the standard of care, and reflects on emerging advances in imaging technology that could shape the field in the century ahead. The role of emergent imaging technologies in enabling high-precision interventions is also briefly reviewed, including image-guided ablative therapies.

Cone-beam CT sampling incompleteness: analytical and empirical studies of emerging systems and source-detector orbits.

Purpose: Motivated by emerging cone-beam computed tomography (CBCT) systems and scan orbits, we aim to quantitatively assess the completeness of data for 3D image reconstruction-in turn, related to "cone-beam artifacts." Fundamental principles of cone-beam sampling incompleteness are considered with respect to an analytical figure-of-merit [FOM, denoted tan(ψmin)] and related to an empirical FOM (denoted zmod) for measurement of cone-beam artifact magnitude in a test phantom. Approach: A previously proposed analytical FOM [tan(ψmin), defined as the minimum angle between a point in the 3D image reconstruction and the x-ray source over the scan orbit] was analyzed for a variety of CBCT geometries. A physical test phantom was configured with parallel disk pairs (perpendicular to the z-axis) at various locations throughout the field of view, quantifying cone-beam artifact magnitude in terms of zmod (the relative signal modulation between the disks). Two CBCT systems were considered: an interventional C-arm (Cios Spin 3D; Siemens Healthineers, Forcheim Germany) and a musculoskeletal extremity scanner; Onsight3D, Carestream Health, Rochester, United States)]. Simulations and physical experiments were conducted for various source-detector orbits: (a) a conventional 360 deg circular orbit, (b) tilted and untilted semi-circular (196 deg) orbits, (c) multi-source (three x-ray sources distributed along the z axis) semi-circular orbits, and (d) a non-circular (sine-on-sphere, SoS) orbit. The incompleteness of sampling [tan(ψmin)] and magnitude of cone-beam artifacts (zmod) were evaluated for each system and orbit. Results: The results show visually and quantitatively the effect of system geometry and scan orbit on cone-beam sampling effects, demonstrating the relationship between analytical tan(ψmin) and empirical zmod. Advanced source-detector orbits (e.g., three-source and SoS orbits) exhibited superior sampling completeness as quantified by both the analytical and the empirical FOMs. The test phantom and zmod metric were sensitive to variations in CBCT system geometry and scan orbit and provided a surrogate measure of underlying sampling completeness. Conclusion: For a given system geometry and source-detector orbit, cone-beam sampling completeness can be quantified analytically (in terms arising from Tuy's condition) and/or empirically (using a test phantom for quantification of cone-beam artifacts). Such analysis provides theoretical and practical insight on sampling effects and the completeness of data for emerging CBCT systems and scan trajectories.

Operational Ontology for Oncology (O3): A Professional Society-Based, Multistakeholder, Consensus-Driven Informatics Standard Supporting Clinical and Research Use of Real-World Data From Patients Treated for Cancer.

PURPOSE: The ongoing lack of data standardization severely undermines the potential for automated learning from the vast amount of information routinely archived in electronic health records (EHRs), radiation oncology information systems, treatment planning systems, and other cancer care and outcomes databases. We sought to create a standardized ontology for clinical data, social determinants of health, and other radiation oncology concepts and interrelationships. METHODS AND MATERIALS: The American Association of Physicists in Medicine's Big Data Science Committee was initiated in July 2019 to explore common ground from the stakeholders' collective experience of issues that typically compromise the formation of large inter- and intra-institutional databases from EHRs. The Big Data Science Committee adopted an iterative, cyclical approach to engaging stakeholders beyond its membership to optimize the integration of diverse perspectives from the community. RESULTS: We developed the Operational Ontology for Oncology (O3), which identified 42 key elements, 359 attributes, 144 value sets, and 155 relationships ranked in relative importance of clinical significance, likelihood of availability in EHRs, and the ability to modify routine clinical processes to permit aggregation. Recommendations are provided for best use and development of the O3 to 4 constituencies: device manufacturers, centers of clinical care, researchers, and professional societies. CONCLUSIONS: O3 is designed to extend and interoperate with existing global infrastructure and data science standards. The implementation of these recommendations will lower the barriers for aggregation of information that could be used to create large, representative, findable, accessible, interoperable, and reusable data sets to support the scientific objectives of grant programs. The construction of comprehensive "real-world" data sets and application of advanced analytical techniques, including artificial intelligence, holds the potential to revolutionize patient management and improve outcomes by leveraging increased access to information derived from larger, more representative data sets.

Customized External Cranioplasty for Management of Syndrome of Trephined in Nonsurgical Candidates.

BACKGROUND: Craniectomies represent a lifesaving neurosurgical procedure for many severe neurological conditions, such as traumatic brain injury. Syndrome of trephined (SoT) is an important complication of decompressive craniectomy, and cranial reconstruction is the definitive treatment. However, many patients cannot undergo surgical intervention because of neurological status, healing of the primary surgical wound, or the presence of concurrent infection, which may prevent cranioplasty. OBJECTIVE: To offer a customized external cranioplasty option for managing skull deformities for patients who could not undergo surgical intervention for definitive cranioplasty. METHODS: We describe the design and clinical application of an external cranioplasty for a patient with a medical history of intractable epilepsy, for which she underwent multiple right cerebral resections with a large resultant skull defect and SoT. RESULTS: The patient had resolution of symptoms and restoration of a symmetrical skull contour with no complication at 17 months. CONCLUSION: Customized external cranioplasty can improve symptoms associated with SoT for patients who cannot undergo a definitive cranioplasty. In addition, inset monitoring options, such as electroencephalography or telemetric intracranial pressure sensors, could be incorporated in the future for comprehensive monitoring of the patient's neurological condition.

A Self-Configuring Deep Learning Network for Segmentation of Temporal Bone Anatomy in Cone-Beam CT Imaging.

OBJECTIVE: Preoperative planning for otologic or neurotologic procedures often requires manual segmentation of relevant structures, which can be tedious and time-consuming. Automated methods for segmenting multiple geometrically complex structures can not only streamline preoperative planning but also augment minimally invasive and/or robot-assisted procedures in this space. This study evaluates a state-of-the-art deep learning pipeline for semantic segmentation of temporal bone anatomy. STUDY DESIGN: A descriptive study of a segmentation network. SETTING: Academic institution. METHODS: A total of 15 high-resolution cone-beam temporal bone computed tomography (CT) data sets were included in this study. All images were co-registered, with relevant anatomical structures (eg, ossicles, inner ear, facial nerve, chorda tympani, bony labyrinth) manually segmented. Predicted segmentations from no new U-Net (nnU-Net), an open-source 3-dimensional semantic segmentation neural network, were compared against ground-truth segmentations using modified Hausdorff distances (mHD) and Dice scores. RESULTS: Fivefold cross-validation with nnU-Net between predicted and ground-truth labels were as follows: malleus (mHD: 0.044 ± 0.024 mm, dice: 0.914 ± 0.035), incus (mHD: 0.051 ± 0.027 mm, dice: 0.916 ± 0.034), stapes (mHD: 0.147 ± 0.113 mm, dice: 0.560 ± 0.106), bony labyrinth (mHD: 0.038 ± 0.031 mm, dice: 0.952 ± 0.017), and facial nerve (mHD: 0.139 ± 0.072 mm, dice: 0.862 ± 0.039). Comparison against atlas-based segmentation propagation showed significantly higher Dice scores for all structures (p < .05). CONCLUSION: Using an open-source deep learning pipeline, we demonstrate consistently submillimeter accuracy for semantic CT segmentation of temporal bone anatomy compared to hand-segmented labels. This pipeline has the potential to greatly improve preoperative planning workflows for a variety of otologic and neurotologic procedures and augment existing image guidance and robot-assisted systems for the temporal bone.

Combining physics-based models with deep learning image synthesis and uncertainty in intraoperative cone-beam CT of the brain.

BACKGROUND: Image-guided neurosurgery requires high localization and registration accuracy to enable effective treatment and avoid complications. However, accurate neuronavigation based on preoperative magnetic resonance (MR) or computed tomography (CT) images is challenged by brain deformation occurring during the surgical intervention. PURPOSE: To facilitate intraoperative visualization of brain tissues and deformable registration with preoperative images, a 3D deep learning (DL) reconstruction framework (termed DL-Recon) was proposed for improved intraoperative cone-beam CT (CBCT) image quality. METHODS: The DL-Recon framework combines physics-based models with deep learning CT synthesis and leverages uncertainty information to promote robustness to unseen features. A 3D generative adversarial network (GAN) with a conditional loss function modulated by aleatoric uncertainty was developed for CBCT-to-CT synthesis. Epistemic uncertainty of the synthesis model was estimated via Monte Carlo (MC) dropout. Using spatially varying weights derived from epistemic uncertainty, the DL-Recon image combines the synthetic CT with an artifact-corrected filtered back-projection (FBP) reconstruction. In regions of high epistemic uncertainty, DL-Recon includes greater contribution from the FBP image. Twenty paired real CT and simulated CBCT images of the head were used for network training and validation, and experiments evaluated the performance of DL-Recon on CBCT images containing simulated and real brain lesions not present in the training data. Performance among learning- and physics-based methods was quantified in terms of structural similarity (SSIM) of the resulting image to diagnostic CT and Dice similarity metric (DSC) in lesion segmentation compared to ground truth. A pilot study was conducted involving seven subjects with CBCT images acquired during neurosurgery to assess the feasibility of DL-Recon in clinical data. RESULTS: CBCT images reconstructed via FBP with physics-based corrections exhibited the usual challenges to soft-tissue contrast resolution due to image non-uniformity, noise, and residual artifacts. GAN synthesis improved image uniformity and soft-tissue visibility but was subject to error in the shape and contrast of simulated lesions that were unseen in training. Incorporation of aleatoric uncertainty in synthesis loss improved estimation of epistemic uncertainty, with variable brain structures and unseen lesions exhibiting higher epistemic uncertainty. The DL-Recon approach mitigated synthesis errors while maintaining improvement in image quality, yielding 15%-22% increase in SSIM (image appearance compared to diagnostic CT) and up to 25% increase in DSC in lesion segmentation compared to FBP. Clear gains in visual image quality were also observed in real brain lesions and in clinical CBCT images. CONCLUSIONS: DL-Recon leveraged uncertainty estimation to combine the strengths of DL and physics-based reconstruction and demonstrated substantial improvements in the accuracy and quality of intraoperative CBCT. The improved soft-tissue contrast resolution could facilitate visualization of brain structures and support deformable registration with preoperative images, further extending the utility of intraoperative CBCT in image-guided neurosurgery.

Image quality models for 2D and 3D x-ray imaging systems: A perspective vignette.

Image quality models based on cascaded systems analysis and task-based imaging performance were an important aspect of the emergence of 2D and 3D digital x-ray systems over the last 25 years. This perspective vignette offers cursory review of such developments and personal insights that may not be obvious within previously published scientific literature. The vignette traces such models to the mid-1990s, when flat-panel x-ray detectors were emerging as a new base technology for digital radiography and benefited from the rigorous, objective characterization of imaging performance gained from such models. The connection of models for spatial resolution and noise to spatial-frequency-dependent descriptors of imaging task provided a useful framework for system optimization that helped to accelerate the development of new technologies to first clinical use. Extension of the models to new technologies and applications is also described, including dual-energy imaging, photon-counting detectors, phase contrast imaging, tomosynthesis, cone-beam CT, 3D image reconstruction, and image registration.

Computed Tomography: State-of-the-Art Advancements in Musculoskeletal Imaging.

ABSTRACT: Although musculoskeletal magnetic resonance imaging (MRI) plays a dominant role in characterizing abnormalities, novel computed tomography (CT) techniques have found an emerging niche in several scenarios such as trauma, gout, and the characterization of pathologic biomechanical states during motion and weight-bearing. Recent developments and advancements in the field of musculoskeletal CT include 4-dimensional, cone-beam (CB), and dual-energy (DE) CT. Four-dimensional CT has the potential to quantify biomechanical derangements of peripheral joints in different joint positions to diagnose and characterize patellofemoral instability, scapholunate ligamentous injuries, and syndesmotic injuries. Cone-beam CT provides an opportunity to image peripheral joints during weight-bearing, augmenting the diagnosis and characterization of disease processes. Emerging CBCT technologies improved spatial resolution for osseous microstructures in the quantitative analysis of osteoarthritis-related subchondral bone changes, trauma, and fracture healing. Dual-energy CT-based material decomposition visualizes and quantifies monosodium urate crystals in gout, bone marrow edema in traumatic and nontraumatic fractures, and neoplastic disease. Recently, DE techniques have been applied to CBCT, contributing to increased image quality in contrast-enhanced arthrography, bone densitometry, and bone marrow imaging. This review describes 4-dimensional CT, CBCT, and DECT advances, current logistical limitations, and prospects for each technique.

SPIE Medical Imaging 50th anniversary: historical review of the Image-Guided Procedures, Robotic Interventions, and Modeling conference.

Purpose: Among the conferences comprising the Medical Imaging Symposium is the MI104 conference currently titled Image-Guided Procedures, Robotic Interventions, and Modeling, although its name has evolved through at least nine iterations over the last 30 years. Here, we discuss the important role that this forum has presented for researchers in the field during this time. Approach: The origins of the conference are traced from its roots in Image Capture and Display in the late 1980s, and some of the major themes for which the conference and its proceedings have provided a valuable forum are highlighted. Results: These major themes include image display/visualization, surgical tracking/navigation, surgical robotics, interventional imaging, image registration, and modeling. Exceptional work from the conference is highlighted by summarizing keynote lectures, the top 50 most downloaded proceedings papers over the last 30 years, the most downloaded paper each year, and the papers earning student paper and young scientist awards. Conclusions: Looking forward and considering the burgeoning technologies, algorithms, and markets related to image-guided and robot-assisted interventions, we anticipate growth and ever increasing quality of the conference as well as increased interaction with sister conferences within the symposium.

Active shape model registration of ocular structures in computed tomography images.

Purpose. The goal of this work is to create an active shape model segmentation method based on the statistical shape model of five regions of the globe on computed tomography (CT) scans and to use the method to categorize normal globe from globe injury.Methods. A set of 78 normal globes imaged with CT scans were manually segmented (vitreous cavity, lens, sclera, anterior chamber, and cornea) by two graders. A statistical shape model was created from the regions. An active shape model was trained using the manual segmentations and the statistical shape model and was assessed using leave-one-out cross validations. The active shape model was then applied to a set of globes with open globe injures, and the segmentations were compared to those of normal globes, in terms of the standard deviations away from normal.Results. The active shape model (ASM) segmentation compared well to ground truth, based on Dice similarity coefficient score in a leave-one-out experiment: 90.2% ± 2.1% for the cornea, 92.5% ± 3.5% for the sclera, 87.4% ± 3.7% for the vitreous cavity, 83.5% ± 2.3% for the anterior chamber, and 91.2% ± 2.4% for the lens. A preliminary set of CT scans of patients with open globe injury were segmented using the ASM and the shape of each region was quantified. The sclera and vitreous cavity were statistically different in shape from the normal. The Zone 1 and Zone 2 globes were statistically different than normal from the cornea and anterior chamber. Both results are consistent with the definition of the zonal injuries in OGI.Conclusion. The ASM results were found to be reproducible and accurately correlated with manual segmentations. The quantitative metrics derived from ASM of globes with OGI are consistent with existing medical knowledge in terms of structural deformation.

Detection of fibular rotational changes in cone beam CT: experimental study in a specimen model.

BACKGROUND: In syndesmotic injuries, incorrect reduction leads to early arthrosis of the ankle joint. Being able to analyze the reduction result is therefore crucial for obtaining an anatomical reduction. Several studies that assess fibular rotation in the incisura have already been published. The aim of the study was to validate measurement methods that use cone beam computed tomography imaging to detect rotational malpositions of the fibula in a standardized specimen model. METHODS: An artificial Maisonneuve injury was created on 16 pairs of fresh-frozen lower legs. Using a stable instrument, rotational malpositions of 5, 10, and 15° internal and external rotation were generated. For each malposition of the fibula, a cone beam computed tomography scan was performed. Subsequently, the malpositions were measured and statistically evaluated with t-tests using two measuring methods: angle (γ) at 10 mm proximal to the tibial joint line and the angle (δ) at 6 mm distal to the talar joint line. RESULTS: Rotational malpositions of ≥ 10° could be reliably displayed in the 3D images using the measuring method with angle δ. For angle γ significant results could only be displayed for an external rotation malposition of 15°. CONCLUSIONS: Clinically relevant rotational malpositions of the fibula in comparison with an uninjured contralateral side can be reliably detected using intraoperative 3D imaging with a C-arm cone beam computed tomography. This may allow surgeons to achieve better reduction of fibular malpositions in the incisura tibiofibularis.