Infratentorial lesions in multiple sclerosis patients: intra- and inter-rater variability in comparison to a fully automated segmentation using 3D convolutional neural networks.

OBJECTIVE: Automated quantification of infratentorial multiple sclerosis lesions on magnetic resonance imaging is clinically relevant but challenging. To overcome some of these problems, we propose a fully automated lesion segmentation algorithm using 3D convolutional neural networks (CNNs). METHODS: The CNN was trained on a FLAIR image alone or on FLAIR and T1-weighted images from 1809 patients acquired on 156 different scanners. An additional training using an extra class for infratentorial lesions was implemented. Three experienced raters manually annotated three datasets from 123 MS patients from different scanners. RESULTS: The inter-rater sensitivity (SEN) was 80% for supratentorial lesions but only 62% for infratentorial lesions. There was no statistically significant difference between the inter-rater SEN and the SEN of the CNN with respect to the raters. For supratentorial lesions, the CNN featured an intra-rater intra-scanner SEN of 0.97 (R1 = 0.90, R2 = 0.84) and for infratentorial lesion a SEN of 0.93 (R1 = 0.61, R2 = 0.73). CONCLUSION: The performance of the CNN improved significantly for infratentorial lesions when specifically trained on infratentorial lesions using a T1 image as an additional input and matches the detection performance of experienced raters. Furthermore, for infratentorial lesions the CNN was more robust against repeated scans than experienced raters. KEY POINTS: • A 3D convolutional neural network was trained on MRI data from 1809 patients (156 different scanners) for the quantification of supratentorial and infratentorial multiple sclerosis lesions. • Inter-rater variability was higher for infratentorial lesions than for supratentorial lesions. The performance of the 3D convolutional neural network (CNN) improved significantly for infratentorial lesions when specifically trained on infratentorial lesions using a T1 image as an additional input. • The detection performance of the CNN matches the detection performance of experienced raters.

Concept for Markerless 6D Tracking Employing Volumetric Optical Coherence Tomography.

Optical tracking systems are widely used, for example, to navigate medical interventions. Typically, they require the presence of known geometrical structures, the placement of artificial markers, or a prominent texture on the target's surface. In this work, we propose a 6D tracking approach employing volumetric optical coherence tomography (OCT) images. OCT has a micrometer-scale resolution and employs near-infrared light to penetrate few millimeters into, for example, tissue. Thereby, it provides sub-surface information which we use to track arbitrary targets, even with poorly structured surfaces, without requiring markers. Our proposed system can shift the OCT's field-of-view in space and uses an adaptive correlation filter to estimate the motion at multiple locations on the target. This allows one to estimate the target's position and orientation. We show that our approach is able to track translational motion with root-mean-squared errors below 0 . 25 m m and in-plane rotations with errors below 0 . 3 ∘ . For out-of-plane rotations, our prototypical system can achieve errors around 0 . 6 ∘ .

Development of a new catheter prototype for laser thrombolysis under guidance of optical coherence tomography (OCT): validation of feasibility and efficacy in a preclinical model.

In this feasibility study, a novel catheter prototype for laser thrombolysis under the guidance of optical coherence tomography (OCT) was designed and evaluated in a preclinical model. Human arteries and veins were integrated into a physiological flow model and occluded with thrombi made from the Chandler Loop. There were four experimental groups: placebo, 20 mg alteplase, laser, 20 mg alteplase + laser. The extent of thrombolysis was analyzed by weighing, OCT imaging and relative thrombus size. In the alteplase group, thrombus size decreased to 0.250 ± 0.036 g (p < 0.0001) and 14.495 ± 0.526 mm2 (p < 0.0001) at 60 min. The relative thrombus size decreased to 73.6 ± 4.1% at 60 min (p < 0.0001). In the laser group, thrombus size decreased significantly to 0.145 ± 0.028 g (p < 0.0001) and 11.559 ± 1.034 mm2 (p < 0.0001). In the alteplase + laser group, thrombus size decreased significantly (0.051 ± 0.026 g; p < 0.0001; 9.622 ± 0.582 mm2; p < 0.0001; 47.4 ± 6.1%; p < 0.0001) in contrast to sole alteplase and laser application. The reproducibility and accuracy of the OCT imaging was high (SD <10%). Histological examination showed no relevant destruction of the vascular layers after laser ablation (arteries: 745.8 ± 5.5 µm; p = 0.69; veins: 448.3 ± 4.5 µm; p = 0.27). Thus, laser ablation and OCT imaging are feasible with the novel catheter and thrombolysis combining alteplase with laser irradiation appears highly efficient.

Ultrasound-based tumor movement compensation during navigated laparoscopic liver interventions.

BACKGROUND: Image-guided navigation aims to provide better orientation and accuracy in laparoscopic interventions. However, the ability of the navigation system to reflect anatomical changes and maintain high accuracy during the procedure is crucial. This is particularly challenging in soft organs such as the liver, where surgical manipulation causes significant tumor movements. We propose a fast approach to obtain an accurate estimation of the tumor position throughout the procedure. METHODS: Initially, a three-dimensional (3D) ultrasound image is reconstructed and the tumor is segmented. During surgery, the position of the tumor is updated based on newly acquired tracked ultrasound images. The initial segmentation of the tumor is used to automatically detect the tumor and update its position in the navigation system. Two experiments were conducted. First, a controlled phantom motion using a robot was performed to validate the tracking accuracy. Second, a needle navigation scenario based on pseudotumors injected into ex vivo porcine liver was studied. RESULT: In the robot-based evaluation, the approach estimated the target location with an accuracy of 0.4 ± 0.3 mm. The mean navigation error in the needle experiment was 1.2 ± 0.6 mm, and the algorithm compensated for tumor shifts up to 38 mm in an average time of 1 s. CONCLUSION: We demonstrated a navigation approach based on tracked laparoscopic ultrasound (LUS), and focused on the neighborhood of the tumor. Our experimental results indicate that this approach can be used to quickly and accurately compensate for tumor movements caused by surgical manipulation during laparoscopic interventions. The proposed approach has the advantage of being based on the routinely used LUS; however, it upgrades its functionality to estimate the tumor position in 3D. Hence, the approach is repeatable throughout surgery, and enables high navigation accuracy to be maintained.

Robust stochastic optimization of needle configurations for robotic HDR prostate brachytherapy.

BACKGROUND: Ideally, inverse planning for HDR brachytherapy (BT) should include the pose of the needles which define the trajectory of the source. This would be particularly interesting when considering the additional freedom and accuracy in needle pose which robotic needle placement enables. However, needle insertion typically leads to tissue deformation, resulting in uncertainty regarding the actual pose of the needles with respect to the tissue. PURPOSE: To efficiently address uncertainty during inverse planning for HDR BT in order to robustly optimize the pose of the needles before insertion, that is, to facilitate path planning for robotic needle placement. METHODS: We use a form of stochastic linear programming to model the inverse treatment planning problem. To account for uncertainty, we consider random tissue displacements at the needle tip to simulate tissue deformation. Conventionally for stochastic linear programming, each simulated deformation is reflected by an addition to the linear programming problem which increases problem size and computational complexity substantially and leads to impractical runtime. We propose two efficient approaches for stochastic linear programming. First, we consider averaging dose coefficients to reduce the problem size. Second, we study weighting of the slack variables of an adjusted linear problem to approximate the full stochastic linear program. We compare different approaches to optimize the needle configurations and evaluate their robustness with respect to different amounts of tissue deformation. RESULTS: Our results illustrate that stochastic planning can improve the robustness of the treatment with respect to deformation. The proposed approaches approximating stochastic linear programming better conform to the tissue deformation compared to conventional linear programming. They show good correlation with the plans computed after deformation while reducing the runtime by two orders of magnitude compared to the complete stochastic linear program. Robust optimization of needle configurations takes on average 59.42 s. Skew needle configurations lead to mean coverage improvements compared to parallel needles from 0.39 to 2.94 percentage points, when 8 mm tissue deformation is considered. Considering tissue deformations from 4  to 10 mm during planning with weighted stochastic optimization and skew needles generally results in improved mean coverage from 1.77 to 4.21 percentage points. CONCLUSIONS: We show that efficient stochastic optimization allows selecting needle configurations which are more robust with respect to potentially negative effects of target deformation and displacement on the achievable prescription dose coverage. The approach facilitates robust path planning for robotic needle placement.

Needle tracking in low-resolution ultrasound volumes using deep learning.

PURPOSE: Clinical needle insertion into tissue, commonly assisted by 2D ultrasound imaging for real-time navigation, faces the challenge of precise needle and probe alignment to reduce out-of-plane movement. Recent studies investigate 3D ultrasound imaging together with deep learning to overcome this problem, focusing on acquiring high-resolution images to create optimal conditions for needle tip detection. However, high-resolution also requires a lot of time for image acquisition and processing, which limits the real-time capability. Therefore, we aim to maximize the US volume rate with the trade-off of low image resolution. We propose a deep learning approach to directly extract the 3D needle tip position from sparsely sampled US volumes. METHODS: We design an experimental setup with a robot inserting a needle into water and chicken liver tissue. In contrast to manual annotation, we assess the needle tip position from the known robot pose. During insertion, we acquire a large data set of low-resolution volumes using a 16  ×  16 element matrix transducer with a volume rate of 4 Hz. We compare the performance of our deep learning approach with conventional needle segmentation. RESULTS: Our experiments in water and liver show that deep learning outperforms the conventional approach while achieving sub-millimeter accuracy. We achieve mean position errors of 0.54 mm in water and 1.54 mm in liver for deep learning. CONCLUSION: Our study underlines the strengths of deep learning to predict the 3D needle positions from low-resolution ultrasound volumes. This is an important milestone for real-time needle navigation, simplifying the alignment of needle and ultrasound probe and enabling a 3D motion analysis.

PolypNextLSTM: a lightweight and fast polyp video segmentation network using ConvNext and ConvLSTM.

PURPOSE: Commonly employed in polyp segmentation, single-image UNet architectures lack the temporal insight clinicians gain from video data in diagnosing polyps. To mirror clinical practices more faithfully, our proposed solution, PolypNextLSTM, leverages video-based deep learning, harnessing temporal information for superior segmentation performance with least parameter overhead, making it possibly suitable for edge devices. METHODS: PolypNextLSTM employs a UNet-like structure with ConvNext-Tiny as its backbone, strategically omitting the last two layers to reduce parameter overhead. Our temporal fusion module, a Convolutional Long Short Term Memory (ConvLSTM), effectively exploits temporal features. Our primary novelty lies in PolypNextLSTM, which stands out as the leanest in parameters and the fastest model, surpassing the performance of five state-of-the-art image and video-based deep learning models. The evaluation of the SUN-SEG dataset spans easy-to-detect and hard-to-detect polyp scenarios, along with videos containing challenging artefacts like fast motion and occlusion. RESULTS: Comparison against 5 image-based and 5 video-based models demonstrates PolypNextLSTM's superiority, achieving a Dice score of 0.7898 on the hard-to-detect polyp test set, surpassing image-based PraNet (0.7519) and video-based PNS+ (0.7486). Notably, our model excels in videos featuring complex artefacts such as ghosting and occlusion. CONCLUSION: PolypNextLSTM, integrating pruned ConvNext-Tiny with ConvLSTM for temporal fusion, not only exhibits superior segmentation performance but also maintains the highest frames per speed among evaluated models. Code can be found here: https://github.com/mtec-tuhh/PolypNextLSTM .

Multiple instance ensembling for paranasal anomaly classification in the maxillary sinus.

PURPOSE: Paranasal anomalies are commonly discovered during routine radiological screenings and can present with a wide range of morphological features. This diversity can make it difficult for convolutional neural networks (CNNs) to accurately classify these anomalies, especially when working with limited datasets. Additionally, current approaches to paranasal anomaly classification are constrained to identifying a single anomaly at a time. These challenges necessitate the need for further research and development in this area. METHODS: We investigate the feasibility of using a 3D convolutional neural network (CNN) to classify healthy maxillary sinuses (MS) and MS with polyps or cysts. The task of accurately localizing the relevant MS volume within larger head and neck Magnetic Resonance Imaging (MRI) scans can be difficult, but we develop a strategy which includes the use of a novel sampling technique that not only effectively localizes the relevant MS volume, but also increases the size of the training dataset and improves classification results. Additionally, we employ a Multiple Instance Ensembling (MIE) prediction method to further boost classification performance. RESULTS: With sampling and MIE, we observe that there is consistent improvement in classification performance of all 3D ResNet and 3D DenseNet architecture with an average AUPRC percentage increase of 21.86 ± 11.92% and 4.27 ± 5.04% by sampling and 28.86 ± 12.80% and 9.85 ± 4.02% by sampling and MIE, respectively. CONCLUSION: Sampling and MIE can be effective techniques to improve the generalizability of CNNs for paranasal anomaly classification. We demonstrate the feasibility of classifying anomalies in the MS. We propose a data enlarging strategy through sampling alongside a novel MIE strategy that proves to be beneficial for paranasal anomaly classification in the MS.

Computer-Aided Diagnosis of Maxillary Sinus Anomalies: Validation and Clinical Correlation.

OBJECTIVE: Computer aided diagnostics (CAD) systems can automate the differentiation of maxillary sinus (MS) with and without opacification, simplifying the typically laborious process and aiding in clinical insight discovery within large cohorts. METHODS: This study uses Hamburg City Health Study (HCHS) a large, prospective, long-term, population-based cohort study of participants between 45 and 74 years of age. We develop a CAD system using an ensemble of 3D Convolutional Neural Network (CNN) to analyze cranial MRIs, distinguishing MS with opacifications (polyps, cysts, mucosal thickening) from MS without opacifications. The system is used to find correlations of participants with and without MS opacifications with clinical data (smoking, alcohol, BMI, asthma, bronchitis, sex, age, leukocyte count, C-reactive protein, allergies). RESULTS: The evaluation metrics of CAD system (Area Under Receiver Operator Characteristic: 0.95, sensitivity: 0.85, specificity: 0.90) demonstrated the effectiveness of our approach. MS with opacification group exhibited higher alcohol consumption, higher BMI, higher incidence of intrinsic asthma and extrinsic asthma. Male sex had higher prevalence of MS opacifications. Participants with MS opacifications had higher incidence of hay fever and house dust allergy but lower incidence of bee/wasp venom allergy. CONCLUSION: The study demonstrates a 3D CNN's ability to distinguish MS with and without opacifications, improving automated diagnosis and aiding in correlating clinical data in population studies. LEVEL OF EVIDENCE: 3 Laryngoscope, 134:3927-3934, 2024.

Self-supervised learning for classifying paranasal anomalies in the maxillary sinus.

PURPOSE: Paranasal anomalies, frequently identified in routine radiological screenings, exhibit diverse morphological characteristics. Due to the diversity of anomalies, supervised learning methods require large labelled dataset exhibiting diverse anomaly morphology. Self-supervised learning (SSL) can be used to learn representations from unlabelled data. However, there are no SSL methods designed for the downstream task of classifying paranasal anomalies in the maxillary sinus (MS). METHODS: Our approach uses a 3D convolutional autoencoder (CAE) trained in an unsupervised anomaly detection (UAD) framework. Initially, we train the 3D CAE to reduce reconstruction errors when reconstructing normal maxillary sinus (MS) image. Then, this CAE is applied to an unlabelled dataset to generate coarse anomaly locations by creating residual MS images. Following this, a 3D convolutional neural network (CNN) reconstructs these residual images, which forms our SSL task. Lastly, we fine-tune the encoder part of the 3D CNN on a labelled dataset of normal and anomalous MS images. RESULTS: The proposed SSL technique exhibits superior performance compared to existing generic self-supervised methods, especially in scenarios with limited annotated data. When trained on just 10% of the annotated dataset, our method achieves an area under the precision-recall curve (AUPRC) of 0.79 for the downstream classification task. This performance surpasses other methods, with BYOL attaining an AUPRC of 0.75, SimSiam at 0.74, SimCLR at 0.73 and masked autoencoding using SparK at 0.75. CONCLUSION: A self-supervised learning approach that inherently focuses on localizing paranasal anomalies proves to be advantageous, particularly when the subsequent task involves differentiating normal from anomalous maxillary sinuses. Access our code at https://github.com/mtec-tuhh/self-supervised-paranasal-anomaly .

Nodule Detection and Generation on Chest X-Rays: NODE21 Challenge.

Pulmonary nodules may be an early manifestation of lung cancer, the leading cause of cancer-related deaths among both men and women. Numerous studies have established that deep learning methods can yield high-performance levels in the detection of lung nodules in chest X-rays. However, the lack of gold-standard public datasets slows down the progression of the research and prevents benchmarking of methods for this task. To address this, we organized a public research challenge, NODE21, aimed at the detection and generation of lung nodules in chest X-rays. While the detection track assesses state-of-the-art nodule detection systems, the generation track determines the utility of nodule generation algorithms to augment training data and hence improve the performance of the detection systems. This paper summarizes the results of the NODE21 challenge and performs extensive additional experiments to examine the impact of the synthetically generated nodule training images on the detection algorithm performance.

Validating polyp and instrument segmentation methods in colonoscopy through Medico 2020 and MedAI 2021 Challenges.

Automatic analysis of colonoscopy images has been an active field of research motivated by the importance of early detection of precancerous polyps. However, detecting polyps during the live examination can be challenging due to various factors such as variation of skills and experience among the endoscopists, lack of attentiveness, and fatigue leading to a high polyp miss-rate. Therefore, there is a need for an automated system that can flag missed polyps during the examination and improve patient care. Deep learning has emerged as a promising solution to this challenge as it can assist endoscopists in detecting and classifying overlooked polyps and abnormalities in real time, improving the accuracy of diagnosis and enhancing treatment. In addition to the algorithm's accuracy, transparency and interpretability are crucial to explaining the whys and hows of the algorithm's prediction. Further, conclusions based on incorrect decisions may be fatal, especially in medicine. Despite these pitfalls, most algorithms are developed in private data, closed source, or proprietary software, and methods lack reproducibility. Therefore, to promote the development of efficient and transparent methods, we have organized the "Medico automatic polyp segmentation (Medico 2020)" and "MedAI: Transparency in Medical Image Segmentation (MedAI 2021)" competitions. The Medico 2020 challenge received submissions from 17 teams, while the MedAI 2021 challenge also gathered submissions from another 17 distinct teams in the following year. We present a comprehensive summary and analyze each contribution, highlight the strength of the best-performing methods, and discuss the possibility of clinical translations of such methods into the clinic. Our analysis revealed that the participants improved dice coefficient metrics from 0.8607 in 2020 to 0.8993 in 2021 despite adding diverse and challenging frames (containing irregular, smaller, sessile, or flat polyps), which are frequently missed during a routine clinical examination. For the instrument segmentation task, the best team obtained a mean Intersection over union metric of 0.9364. For the transparency task, a multi-disciplinary team, including expert gastroenterologists, accessed each submission and evaluated the team based on open-source practices, failure case analysis, ablation studies, usability and understandability of evaluations to gain a deeper understanding of the models' credibility for clinical deployment. The best team obtained a final transparency score of 21 out of 25. Through the comprehensive analysis of the challenge, we not only highlight the advancements in polyp and surgical instrument segmentation but also encourage subjective evaluation for building more transparent and understandable AI-based colonoscopy systems. Moreover, we discuss the need for multi-center and out-of-distribution testing to address the current limitations of the methods to reduce the cancer burden and improve patient care.

Optical force estimation for interactions between tool and soft tissues.

Robotic assistance in minimally invasive surgery offers numerous advantages for both patient and surgeon. However, the lack of force feedback in robotic surgery is a major limitation, and accurately estimating tool-tissue interaction forces remains a challenge. Image-based force estimation offers a promising solution without the need to integrate sensors into surgical tools. In this indirect approach, interaction forces are derived from the observed deformation, with learning-based methods improving accuracy and real-time capability. However, the relationship between deformation and force is determined by the stiffness of the tissue. Consequently, both deformation and local tissue properties must be observed for an approach applicable to heterogeneous tissue. In this work, we use optical coherence tomography, which can combine the detection of tissue deformation with shear wave elastography in a single modality. We present a multi-input deep learning network for processing of local elasticity estimates and volumetric image data. Our results demonstrate that accounting for elastic properties is critical for accurate image-based force estimation across different tissue types and properties. Joint processing of local elasticity information yields the best performance throughout our phantom study. Furthermore, we test our approach on soft tissue samples that were not present during training and show that generalization to other tissue properties is possible.

Towards fast adaptive replanning by constrained reoptimization for intra-fractional non-periodic motion during robotic SBRT.

BACKGROUND: Periodic and slow target motion is tracked by synchronous motion of the treatment beams in robotic stereotactic body radiation therapy (SBRT). However, spontaneous, non-periodic displacement or drift of the target may completely change the treatment geometry. Simple motion compensation is not sufficient to guarantee the best possible treatment, since relative motion between the target and organs at risk (OARs) can cause substantial deviations of dose in the OARs. This is especially evident when considering the temporally heterogeneous dose delivery by many focused beams which is typical for robotic SBRT. Instead, a reoptimization of the remaining treatment plan after a large target motion during the treatment could potentially reduce the actually delivered dose to OARs and improve target coverage. This reoptimization task, however, is challenging due to time constraints and limited human supervision. PURPOSE: To study the detrimental effect of spontaneous target motion relative to surrounding OARs on the delivered dose distribution and to analyze how intra-fractional constrained replanning could improve motion compensated robotic SBRT of the prostate. METHODS: We solve the inverse planning problem by optimizing a linear program. When considering intra-fractional target motion resulting in a change of geometry, we adapt the linear program to account for the changed dose coefficients and delivered dose. We reduce the problem size by only reweighting beams from the reference treatment plan without motion. For evaluation we simulate target motion and compare our approach for intra-fractional replanning to the conventional compensation by synchronous beam motion. Results are generated retrospectively on data of 50 patients. RESULTS: Our results show that reoptimization can on average retain or improve coverage in case of target motion compared to the reference plan without motion. Compared to the conventional compensation, coverage is improved from 87.83 % to 94.81 % for large target motion. Our approach for reoptimization ensures fixed upper constraints on the dose even after motion, enabling safer intra-fraction adaption, compared to conventional motion compensation where overdosage in OARs can lead to 21.79 % higher maximum dose than planned. With an average reoptimization time of 6 s for 200 reoptimized beams our approach shows promising performance for intra-fractional application. CONCLUSIONS: We show that intra-fractional constrained reoptimization for adaption to target motion can improve coverage compared to the conventional approach of beam translation while ensuring that upper dose constraints on VOIs are not violated.

Bayesian Reconstruction Algorithms for Low-Dose Computed Tomography Are Not Yet Suitable in Clinical Context.

Computed tomography (CT) is a widely used examination technique that usually requires a compromise between image quality and radiation exposure. Reconstruction algorithms aim to reduce radiation exposure while maintaining comparable image quality. Recently, unsupervised deep learning methods have been proposed for this purpose. In this study, a promising sparse-view reconstruction method (posterior temperature optimized Bayesian inverse model; POTOBIM) is tested for its clinical applicability. For this study, 17 whole-body CTs of deceased were performed. In addition to POTOBIM, reconstruction was performed using filtered back projection (FBP). An evaluation was conducted by simulating sinograms and comparing the reconstruction with the original CT slice for each case. A quantitative analysis was performed using peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM). The quality was assessed visually using a modified Ludewig's scale. In the qualitative evaluation, POTOBIM was rated worse than the reference images in most cases. A partially equivalent image quality could only be achieved with 80 projections per rotation. Quantitatively, POTOBIM does not seem to benefit from more than 60 projections. Although deep learning methods seem suitable to produce better image quality, the investigated algorithm (POTOBIM) is not yet suitable for clinical routine.

Real-Time Motion Analysis With 4D Deep Learning for Ultrasound-Guided Radiotherapy.

Motion compensation in radiation therapy is a challenging scenario that requires estimating and forecasting motion of tissue structures to deliver the target dose. Ultrasound offers direct imaging of tissue in real-time and is considered for image guidance in radiation therapy. Recently, fast volumetric ultrasound has gained traction, but motion analysis with such high-dimensional data remains difficult. While deep learning could bring many advantages, such as fast data processing and high performance, it remains unclear how to process sequences of hundreds of image volumes efficiently and effectively. We present a 4D deep learning approach for real-time motion estimation and forecasting using long-term 4D ultrasound data. Using motion traces acquired during radiation therapy combined with various tissue types, our results demonstrate that long-term motion estimation can be performed markerless with a tracking error of 0.35±0.2 mm and with an inference time of less than 5 ms. Also, we demonstrate forecasting directly from the image data up to 900 ms into the future. Overall, our findings highlight that 4D deep learning is a promising approach for motion analysis during radiotherapy.

Automated isocenter optimization approach for treatment planning for gyroscopic radiosurgery.

BACKGROUND: Radiosurgery is a well-established treatment for various intracranial tumors. In contrast to other established radiosurgery platforms, the new ZAP-X® allows for self-shielding gyroscopic radiosurgery. Here, treatment beams with variable beam-on times are targeted towards a small number of isocenters. The existing planning framework relies on a heuristic based on random selection or manual selection of isocenters, which often leads to a higher plan quality in clinical practice. PURPOSE: The purpose of this work is to study an improved approach for radiosurgery treatment planning, which automatically selects the isocenter locations for the treatment of brain tumors and diseases in the head and neck area using the new system ZAP-X® . METHODS: We propose a new method to automatically obtain the locations of the isocenters, which are essential in gyroscopic radiosurgery treatment planning. First, an optimal treatment plan is created based on a randomly selected nonisocentric candidate beam set. The intersections of the resulting subset of weighted beams are then clustered to find isocenters. This approach is compared to sphere-packing, random selection, and selection by an expert planner for generating isocenters. We retrospectively evaluate plan quality on 10 acoustic neuroma cases. RESULTS: Isocenters acquired by the method of clustering result in clinically viable plans for all 10 test cases. When using the same number of isocenters, the clustering approach improves coverage on average by 31 percentage points compared to random selection, 15 percentage points compared to sphere packing and 2 percentage points compared to the coverage achieved with the expert selected isocenters. The automatic determination of location and number of isocenters leads, on average, to a coverage of 97 ± 3% with a conformity index of 1.22 ± 0.22, while using 2.46 ± 3.60 fewer isocenters than manually selected. In terms of algorithm performance, all plans were calculated in less than 2 min with an average runtime of 75 ± 25 s. CONCLUSIONS: This study demonstrates the feasibility of an automatic isocenter selection by clustering in the treatment planning process with the ZAP-X® system. Even in complex cases where the existing approaches fail to produce feasible plans, the clustering method generates plans that are comparable to those produced by expert selected isocenters. Therefore, our approach can help reduce the effort and time required for treatment planning in gyroscopic radiosurgery.

A systematic approach to deep learning-based nodule detection in chest radiographs.

Lung cancer is a serious disease responsible for millions of deaths every year. Early stages of lung cancer can be manifested in pulmonary lung nodules. To assist radiologists in reducing the number of overseen nodules and to increase the detection accuracy in general, automatic detection algorithms have been proposed. Particularly, deep learning methods are promising. However, obtaining clinically relevant results remains challenging. While a variety of approaches have been proposed for general purpose object detection, these are typically evaluated on benchmark data sets. Achieving competitive performance for specific real-world problems like lung nodule detection typically requires careful analysis of the problem at hand and the selection and tuning of suitable deep learning models. We present a systematic comparison of state-of-the-art object detection algorithms for the task of lung nodule detection. In this regard, we address the critical aspect of class imbalance and and demonstrate a data augmentation approach as well as transfer learning to boost performance. We illustrate how this analysis and a combination of multiple architectures results in state-of-the-art performance for lung nodule detection, which is demonstrated by the proposed model winning the detection track of the Node21 competition. The code for our approach is available at https://github.com/FinnBehrendt/node21-submit.

Tissue Classification During Needle Insertion Using Self-Supervised Contrastive Learning and Optical Coherence Tomography.

Needle positioning is essential for various medical applications such as epidural anaesthesia. Physicians rely on their instincts while navigating the needle in epidural spaces. Thereby, identifying the tissue structures may be helpful to the physician as they can provide additional feedback in the needle insertion process. To this end, we propose a deep neural network that classifies the tissues from the phase and intensity data of complex OCT signals acquired at the needle tip. We investigate the performance of the deep neural network in a limited labelled dataset scenario and propose a novel contrastive pretraining strategy that learns invariant representation for phase and intensity data. We show that with 10% of the training set, our proposed pretraining strategy helps the model achieve an F1 score of 0.84±0.10 whereas the model achieves an F1 score of 0.60±0.07 without it. Further, we analyse the importance of phase and intensity individually towards tissue classification.

A Miniature Dual-Fiber Probe for Quantitative Optical Coherence Elastography.

OBJECTIVE: Optical coherence elastography (OCE) allows for high resolution analysis of elastic tissue properties. However, due to the limited penetration of light into tissue, miniature probes are required to reach structures inside the body, e.g., vessel walls. Shear wave elastography relates shear wave velocities to quantitative estimates of elasticity. Generally, this is achieved by measuring the runtime of waves between two or multiple points. For miniature probes, optical fibers have been integrated and the runtime between the point of excitation and a single measurement point has been considered. This approach requires precise temporal synchronization and spatial calibration between excitation and imaging. METHODS: We present a miniaturized dual-fiber OCE probe of 1 mm diameter allowing for robust shear wave elastography. Shear wave velocity is estimated between two optics and hence independent of wave propagation between excitation and imaging. We quantify the wave propagation by evaluating either a single or two measurement points. Particularly, we compare both approaches to ultrasound elastography. RESULTS: Our experimental results demonstrate that quantification of local tissue elasticities is feasible. For homogeneous soft tissue phantoms, we obtain mean deviations of 0.15 ms-1 and 0.02 ms-1 for single-fiber and dual-fiber OCE, respectively. In inhomogeneous phantoms, we measure mean deviations of up to 0.54 ms-1 and 0.03 ms-1 for single-fiber and dual-fiber OCE, respectively. CONCLUSION: We present a dual-fiber OCE approach that is much more robust in inhomogeneous tissues. Moreover, we demonstrate the feasibility of elasticity quantification in ex-vivo coronary arteries. SIGNIFICANCE: This study introduces an approach for robust elasticity quantification from within the tissue.