Deep Learning-Based Joint Effusion Classification in Adult Knee Radiographs: A Multi-Center Prospective Study.

Knee effusion, a common and important indicator of joint diseases such as osteoarthritis, is typically more discernible on magnetic resonance imaging (MRI) scans compared to radiographs. However, the use of radiographs for the early detection of knee effusion remains promising due to their cost-effectiveness and accessibility. This multi-center prospective study collected a total of 1413 radiographs from four hospitals between February 2022 to March 2023, of which 1281 were analyzed after exclusions. To automatically detect knee effusion on radiographs, we utilized a state-of-the-art (SOTA) deep learning-based classification model with a novel preprocessing technique to optimize images for diagnosing knee effusion. The diagnostic performance of the proposed method was significantly higher than that of the baseline model, achieving an area under the receiver operating characteristic curve (AUC) of 0.892, accuracy of 0.803, sensitivity of 0.820, and specificity of 0.785. Moreover, the proposed method significantly outperformed two non-orthopedic physicians. Coupled with an explainable artificial intelligence method for visualization, this approach not only improved diagnostic performance but also interpretability, highlighting areas of effusion. These results demonstrate that the proposed method enables the early and accurate classification of knee effusions on radiographs, thereby reducing healthcare costs and improving patient outcomes through timely interventions.

Development of a multi-modal learning-based lymph node metastasis prediction model for lung cancer.

PURPOSE: This study proposed a three-dimensional (3D) multi-modal learning-based model for the automated prediction and classification of lymph node metastasis in patients with non-small cell lung cancer (NSCLC) using computed tomography (CT) images and clinical information. METHODS: We utilized clinical information and CT image data from 4239 patients with NSCLC across multiple institutions. Four deep learning algorithm-based multi-modal models were constructed and evaluated for lymph node classification. To further enhance classification performance, a soft-voting ensemble technique was applied to integrate the outcomes of multiple multi-modal models. RESULTS: A comparison of the classification performance revealed that the multi-modal model, which integrated CT images and clinical information, outperformed the single-modal models. Among the four multi-modal models, the Xception model demonstrated the highest classification performance, with an area under the curve (AUC) of 0.756 for the internal test dataset and 0.736 for the external validation dataset. The ensemble model (SEResNet50_DenseNet121_Xception) exhibited even better performance, with an AUC of 0.762 for the internal test dataset and 0.751 for the external validation dataset, surpassing the multi-modal model's performance. CONCLUSIONS: Integrating CT images and clinical information improved the performance of the lymph node metastasis prediction models in patients with NSCLC. The proposed 3D multi-modal lymph node prediction model can serve as an auxiliary tool for evaluating lymph node metastasis in patients with non-pretreated NSCLC, aiding in patient screening and treatment planning.

Weakly supervised deep learning for diagnosis of multiple vertebral compression fractures in CT.

OBJECTIVE: This study aims to develop a weakly supervised deep learning (DL) model for vertebral-level vertebral compression fracture (VCF) classification using image-level labelled data. METHODS: The training set included 815 patients with normal (n = 507, 62%) or VCFs (n = 308, 38%). Our proposed model was trained on image-level labelled data for vertebral-level classification. Another supervised DL model was trained with vertebral-level labelled data to compare the performance of the proposed model. RESULTS: The test set included 227 patients with normal (n = 117, 52%) or VCFs (n = 110, 48%). For a fair comparison of the two models, we compared sensitivities with the same specificities of the proposed model and the vertebral-level supervised model. The specificity for overall L1-L5 performance was 0.981. The proposed model may outperform the vertebral-level supervised model with sensitivities of 0.770 vs 0.705 (p = 0.080), respectively. For vertebral-level analysis, the specificities for each L1-L5 were 0.974, 0.973, 0.970, 0.991, and 0.995, respectively. The proposed model yielded the same or better sensitivity than the vertebral-level supervised model in L1 (0.750 vs 0.694, p = 0.480), L3 (0.793 vs 0.586, p < 0.05), L4 (0.833 vs 0.667, p = 0.480), and L5 (0.600 vs 0.600, p = 1.000), respectively. The proposed model showed lower sensitivity than the vertebral-level supervised model for L2, but there was no significant difference (0.775 vs 0.825, p = 0.617). CONCLUSIONS: The proposed model may have a comparable or better performance than the supervised model in vertebral-level VCF classification. CLINICAL RELEVANCE STATEMENT: Vertebral-level vertebral compression fracture classification aids in devising patient-specific treatment plans by identifying the precise vertebrae affected by compression fractures. KEY POINTS: • Our proposed weakly supervised method may have comparable or better performance than the supervised method for vertebral-level vertebral compression fracture classification. • The weakly supervised model could have classified cases with multiple vertebral compression fractures at the vertebral-level, even if the model was trained with image-level labels. • Our proposed method could help reduce radiologists' labour because it enables vertebral-level classification from image-level labels.