Predicting Progression in Adolescent Idiopathic Scoliosis at the First Visit by Integrating 2D Imaging and 1D Clinical Information.

STUDY DESIGN: Retrospective observational study. OBJECTIVES: The prediction of curve progression in patients with adolescent idiopathic scoliosis (AIS) remains an unresolved area in orthopedic surgery. To make a rapid meaningful prediction, easily accessible multi-dimensional data at the patient's first consultation should be used. Current studies use clinical growth parameters and numerical values extracted from radiographs to compile a predictive model, leaving out the radiographs themselves. Such practice inevitably wastes a lot of information. Thus, this study aims to create a neural network that can predict AIS progression among patients with curves indicated for bracing by integrating both one-dimensional (1D) clinical and two-dimensional (2D) radiological data collected at the patient's first visit in a fully automated manner. METHODS: 513 idiopathic scoliosis patients indicated for and managed with bracing orthosis were recruited. After exclusion, 463 patients were included in deep learning analysis. Processed first-visit growth parameters and posteroanterior radiographs are used as training inputs and the curve progression outcomes obtained in follow ups are used as binary training outputs. The CapsuleNet architecture was modified and trained accordingly to make a prediction. RESULTS: The final model achieved 90% sensitivity with an overall accuracy of 73.9% in the prediction of AIS in-brace curve progression by using first-visit multi-dimensional data, outperforming conventional convolutional neural networks. CONCLUSIONS: This first-ever multidimensional-input model shows promise in serving as a screening tool for AIS in-brace curve progression. The incorporation of such a model into routine AIS diagnostic pipeline can assist orthopedics clinicians in personalizing the most appropriate management for each patient.

Improved fully convolutional neuron networks on small retinal vessel segmentation using local phase as attention.

Retinal images have been proven significant in diagnosing multiple diseases such as diabetes, glaucoma, and hypertension. Retinal vessel segmentation is crucial for the quantitative analysis of retinal images. However, current methods mainly concentrate on the segmentation performance of overall retinal vessel structures. The small vessels do not receive enough attention due to their small percentage in the full retinal images. Small retinal vessels are much more sensitive to the blood circulation system and have great significance in the early diagnosis and warning of various diseases. This paper combined two unsupervised methods, local phase congruency (LPC) and orientation scores (OS), with a deep learning network based on the U-Net as attention. And we proposed the U-Net using local phase congruency and orientation scores (UN-LPCOS), which showed a remarkable ability to identify and segment small retinal vessels. A new metric called sensitivity on a small ship (Sesv ) was also proposed to evaluate the methods' performance on the small vessel segmentation. Our strategy was validated on both the DRIVE dataset and the data from Maastricht Study and achieved outstanding segmentation performance on both the overall vessel structure and small vessels.

5-Year progression prediction of endplate defects: Utilizing the EDPP-Flow convolutional neural network based on unbalanced data.

Background: Lumbar disc degeneration (LDD) is considered as one of the main causes of low back pain. For clinical diagnosis of LDD, magnetic resonance imaging (MRI) is commonly used. Schmorl's node, high intensity zone (HIZ), Modic changes, and other MRI biomarkers of intervertebral disc (IVD) degeneration are also associated with low back pain. However, the progression and natural history of these features are unclear and there is limited predictive capacity with MRI. Purpose: We aim to establish and validate a deep learning pipeline, EDPP-Flow, for the 5-year progression prediction of Schmorl's node, HIZ, and Modic changes, based on clinical MRIs. Materials and methods: An MRI dataset developed on 1152 volunteers was used in this study. For each volunteer, two MRI scans, at baseline and 5-year follow-up, were collected and pathology labels were annotated as present or absent (with/without pathology) by two specialists with over 10 years of clinical experience. Our pipeline contained the published MRI-SegFlow and state-of-the-art convolutional neural network for progression prediction of endplate defects. The label distribution of the dataset is unbalanced, where the number of present samples was much smaller than absent samples. The resampling and data augmentation strategies were adopted to increase the number of present samples in the training process and balance the influence of different samples on the model, which can improve the prediction accuracy. Results: Our pipeline achieved high weighted accuracy, sensitivity, and specificity for progression prediction of Schmorl's node (89.46 ± 3.71%, 89.19 ± 2.70%, 89.72 ± 2.42%), HIZ (91.75 ± 2.48%, 93.07 ± 3.96%, 90.43 ± 2.51%), and Modic changes (87.51 ± 2.23%, 87.93 ± 1.72%, 87.10 ± 1.99%), on the unbalanced dataset (present sample's percentages of the 3 pathologies above were 4.3%, 11.7%, and 6.7%). Conclusion: We developed and validated a deep learning pipeline, for the progression prediction of endplate defects, which showed high prediction accuracy on unbalanced data. The method has significant potential for clinical implementation.

SpineQ: Unsupervised 3D Lumbar Quantitative Assessment.

Most lumbar quantitative assessment methods can only analyze the image from one view and require laborious manual annotation. We aim to develop an unsupervised pipeline for 3D quantitative assessment of the lumbar spine that can assess the MRI with different views. We combine rule-based and deep learning methods to generate multi-tissue segmentation, and parameters can be measured from segmentation results using the anatomical and geometric prior. Preliminary testing demonstrates that our proposed method can generate accurate segmentation and measurement results.Clinical Relevance- The proposed unsupervised 3D lumbar quantitative assessment pipeline can significantly improve the efficiency and consistency of clinical diagnosis and surgical planning.

Spine-GFlow: A hybrid learning framework for robust multi-tissue segmentation in lumbar MRI without manual annotation.

Most learning-based magnetic resonance image (MRI) segmentation methods rely on the manual annotation to provide supervision, which is extremely tedious, especially when multiple anatomical structures are required. In this work, we aim to develop a hybrid framework named Spine-GFlow that combines the image features learned by a CNN model and anatomical priors for multi-tissue segmentation in a sagittal lumbar MRI. Our framework does not require any manual annotation and is robust against image feature variation caused by different image settings and/or underlying pathology. Our contributions include: 1) a rule-based method that automatically generates the weak annotation (initial seed area), 2) a novel proposal generation method that integrates the multi-scale image features and anatomical prior, 3) a comprehensive loss for CNN training that optimizes the pixel classification and feature distribution simultaneously. Our Spine-GFlow has been validated on 2 independent datasets: HKDDC (containing images obtained from 3 different machines) and IVDM3Seg. The segmentation results of vertebral bodies (VB), intervertebral discs (IVD), and spinal canal (SC) are evaluated quantitatively using intersection over union (IoU) and the Dice coefficient. Results show that our method, without requiring manual annotation, has achieved a segmentation performance comparable to a model trained with full supervision (mean Dice 0.914 vs 0.916).

Dual Encoder-Based Dynamic-Channel Graph Convolutional Network With Edge Enhancement for Retinal Vessel Segmentation.

Retinal vessel segmentation with deep learning technology is a crucial auxiliary method for clinicians to diagnose fundus diseases. However, the deep learning approaches inevitably lose the edge information, which contains spatial features of vessels while performing down-sampling, leading to the limited segmentation performance of fine blood vessels. Furthermore, the existing methods ignore the dynamic topological correlations among feature maps in the deep learning framework, resulting in the inefficient capture of the channel characterization. To address these limitations, we propose a novel dual encoder-based dynamic-channel graph convolutional network with edge enhancement (DE-DCGCN-EE) for retinal vessel segmentation. Specifically, we first design an edge detection-based dual encoder to preserve the edge of vessels in down-sampling. Secondly, we investigate a dynamic-channel graph convolutional network to map the image channels to the topological space and synthesize the features of each channel on the topological map, which solves the limitation of insufficient channel information utilization. Finally, we study an edge enhancement block, aiming to fuse the edge and spatial features in the dual encoder, which is beneficial to improve the accuracy of fine blood vessel segmentation. Competitive experimental results on five retinal image datasets validate the efficacy of the proposed DE-DCGCN-EE, which achieves more remarkable segmentation results against the other state-of-the-art methods, indicating its potential clinical application.

Learning-based fully automated prediction of lumbar disc degeneration progression with specified clinical parameters and preliminary validation.

BACKGROUND: Lumbar disc degeneration (LDD) may be related to aging, biomechanical and genetic factors. Despite the extensive work on understanding its etiology, there is currently no automated tool for accurate prediction of its progression. PURPOSE: We aim to establish a novel deep learning-based pipeline to predict the progression of LDD-related findings using lumbar MRIs. MATERIALS AND METHODS: We utilized our dataset with MRIs acquired from 1,343 individual participants (taken at the baseline and the 5-year follow-up timepoint), and progression assessments (the Schneiderman score, disc bulging, and Pfirrmann grading) that were labelled by spine specialists with over ten years clinical experience. Our new pipeline was realized by integrating the MRI-SegFlow and the Visual Geometry Group-Medium (VGG-M) for automated disc region detection and LDD progression prediction correspondingly. The LDD progression was quantified by comparing the Schneiderman score, disc bulging and Pfirrmann grading at the baseline and at follow-up. A fivefold cross-validation was conducted to assess the predictive performance of the new pipeline. RESULTS: Our pipeline achieved very good performances on the LDD progression prediction, with high progression prediction accuracy of the Schneiderman score (Accuracy: 90.2 ± 0.9%), disc bulging (Accuracy: 90.4% ± 1.1%), and Pfirrmann grading (Accuracy: 89.9% ± 2.1%). CONCLUSION: This is the first attempt of using deep learning to predict LDD progression on a large dataset with 5-year follow-up. Requiring no human interference, our pipeline can potentially achieve similar predictive performances in new settings with minimal efforts.

MRI-SegFlow: a novel unsupervised deep learning pipeline enabling accurate vertebral segmentation of MRI images.

Most deep learning based vertebral segmentation methods require laborious manual labelling tasks. We aim to establish an unsupervised deep learning pipeline for vertebral segmentation of MR images. We integrate the sub-optimal segmentation results produced by a rule-based method with a unique voting mechanism to provide supervision in the training process for the deep learning model. Preliminary validation shows a high segmentation accuracy achieved by our method without relying on any manual labelling.The clinical relevance of this study is that it provides an efficient vertebral segmentation method with high accuracy. Potential applications are in automated pathology detection and vertebral 3D reconstructions for biomechanical simulations and 3D printing, facilitating clinical decision making, surgical planning and tissue engineering.