Uncertainty-aware deep learning for trustworthy prediction of long-term outcome after endovascular thrombectomy.

Acute ischemic stroke (AIS) is a leading global cause of mortality and morbidity. Improving long-term outcome predictions after thrombectomy can enhance treatment quality by supporting clinical decision-making. With the advent of interpretable deep learning methods in recent years, it is now possible to develop trustworthy, high-performing prediction models. This study introduces an uncertainty-aware, graph deep learning model that predicts endovascular thrombectomy outcomes using clinical features and imaging biomarkers. The model targets long-term functional outcomes, defined by the three-month modified Rankin Score (mRS), and mortality rates. A sample of 220 AIS patients in the anterior circulation who underwent endovascular thrombectomy (EVT) was included, with 81 (37%) demonstrating good outcomes (mRS ≤ 2). The performance of the different algorithms evaluated was comparable, with the maximum validation under the curve (AUC) reaching 0.87 using graph convolutional networks (GCN) for mRS prediction and 0.86 using fully connected networks (FCN) for mortality prediction. Moderate performance was obtained at admission (AUC of 0.76 using GCN), which improved to 0.84 post-thrombectomy and to 0.89 a day after stroke. Reliable uncertainty prediction of the model could be demonstrated.

A principled representation of elongated structures using heatmaps.

The detection of elongated structures like lines or edges is an essential component in semantic image analysis. Classical approaches that rely on significant image gradients quickly reach their limits when the structure is context-dependent, amorphous, or not directly visible. This study introduces a principled mathematical description of elongated structures with various origins and shapes. Among others, it serves as an expressive operational description of target functions that can be well approximated by Convolutional Neural Networks. The nominal position of a curve and its positional uncertainty are encoded as a heatmap by convolving the curve distribution with a filter function. We propose a low-error approximation to the expensive numerical integration by evaluating a distance-dependent function, enabling a lightweight implementation with linear time complexity. We analyze the method's numerical approximation error and behavior for different curve types and signal-to-noise levels. Application to surgical 2D and 3D data, semantic boundary detection, skeletonization, and other related tasks demonstrate the method's versatility at low errors.

Automatic plane adjustment of orthopedic intraoperative flat panel detector CT-volumes.

Purpose: To assess the result in orthopedic trauma surgery, usually three-dimensional volume data of the treated region is acquired. With mobile C-arm systems, these acquisitions can be performed intraoperatively, reducing the number of required revision surgeries. However, the acquired volumes are typically not aligned to the anatomical regions. Thus, the multiplanar reconstructed (MPR) planes need to be adjusted manually during the review of the volume. To speed up and ease the workflow, an automatic parameterization of these planes is needed. Approach: We present a detailed study of multitask learning (MTL) regression networks to estimate the parameters of the MPR planes. First, various mathematical descriptions for rotation, including Euler angle, quaternion, and matrix representation, are revised. Then, two different MTL network architectures based on the PoseNet are compared with a single task learning network. Results: Using a matrix description rather than the Euler angle description, the accuracy of the regressed normals improves from 7.7 deg to 7.3 deg in the mean value for single anatomies. The multihead approach improves the regression of the plane position from 7.4 to 6.1 mm, whereas the orientation does not benefit from this approach. Thus, the achieved accuracy meets the reported interrater variance in similarly complex body regions of up to 6.3 deg for the normals and up to 9.3 mm for the plane position. Conclusions: The use of a multihead approach with shared features leads to more accurate plane regression compared with the use of individual networks for each task. It also improves the angle estimation for the ankle region. The reported results are in the same range as manual plane adjustments. The use of a combined network with shared parameters requires less memory, which is a great benefit for the implementation of an application for the surgical environment.

Computer-assisted contralateral side comparison of the ankle joint using flat panel technology.

PURPOSE: Reduction and osteosynthesis of ankle fractures is a challenging surgical procedure when it comes to the verification of the reduction result. Evaluation is conducted using intra-operative imaging of the injured ankle and depends on the expertise of the surgeon. Studies suggest that intra-individual variance of the ankle bone shape and pose is considerably lower than the inter-individual variance. It stands to reason that the information gain from the healthy contralateral side can help to improve the evaluation. METHOD: In this paper, an assistance system is proposed that provides a side-to-side view of the two ankle joints for visual comparison and instant evaluation using only one 3D C-arm image. Two convolutional neural networks (CNN) are employed to extract the relevant image regions and pose information of each ankle so that they can be aligned with each other. A first U-Net uses a sliding window to predict the location of each ankle. The standard plane estimation is formulated as segmentation problem so that a second U-Net predicts the three viewing planes for alignment. RESULTS: Experiments were conducted to assess the accuracy of the individual steps on 218 unilateral ankle datasets as well as the overall performance on 7 bilateral ankle datasets. The experiments on unilateral ankles yield a median position-to-plane error of [Formula: see text] mm and a median angular error between 2.98[Formula: see text] and 3.71[Formula: see text] for the plane normals. CONCLUSION: Standard plane estimation via segmentation outperforms direct pose regression. Furthermore, the complete pipeline was evaluated including ankle detection and subsequent plane estimation on bilateral datasets. The proposed pipeline enables a direct contralateral side comparison without additional radiation. This has the potential to ease and improve the intra-operative evaluation for the surgeons in the future and reduce the need for revision surgery.