RESUMEN
BACKGROUND: Hemoglobinopathies, the most common inherited blood disorder, are frequently underdiagnosed. Early identification of carriers is important for genetic counseling of couples at risk. The aim of this study was to develop and validate a novel machine learning model on a multicenter data set, covering a wide spectrum of hemoglobinopathies based on routine complete blood count (CBC) testing. METHODS: Hemoglobinopathy test results from 10 322 adults were extracted retrospectively from 8 Dutch laboratories. eXtreme Gradient Boosting (XGB) and logistic regression models were developed to differentiate negative from positive hemoglobinopathy cases, using 7 routine CBC parameters. External validation was conducted on a data set from an independent Dutch laboratory, with an additional external validation on a Spanish data set (n = 2629) specifically for differentiating thalassemia from iron deficiency anemia (IDA). RESULTS: The XGB and logistic regression models achieved an area under the receiver operating characteristic (AUROC) of 0.88 and 0.84, respectively, in distinguishing negative from positive hemoglobinopathy cases in the independent external validation set. Subclass analysis showed that the XGB model reached an AUROC of 0.97 for ß-thalassemia, 0.98 for α0-thalassemia, 0.95 for homozygous α+-thalassemia, 0.78 for heterozygous α+-thalassemia, and 0.94 for the structural hemoglobin variants Hemoglobin C, Hemoglobin D, Hemoglobin E. Both models attained AUROCs of 0.95 in differentiating IDA from thalassemia. CONCLUSIONS: Both the XGB and logistic regression model demonstrate high accuracy in predicting a broad range of hemoglobinopathies and are effective in differentiating hemoglobinopathies from IDA. Integration of these models into the laboratory information system facilitates automated hemoglobinopathy detection using routine CBC parameters.
Asunto(s)
Hemoglobinopatías , Aprendizaje Automático , Humanos , Hemoglobinopatías/diagnóstico , Hemoglobinopatías/genética , Hemoglobinopatías/sangre , Estudios Retrospectivos , Recuento de Células Sanguíneas , Adulto , Femenino , Masculino , Modelos Logísticos , Curva ROCRESUMEN
INTRODUCTION: This study investigates the performance of a commercially available artificial intelligence (AI) system to identify normal chest radiographs and its potential to reduce radiologist workload. METHODS: Retrospective analysis included consecutive chest radiographs from two medical centers between Oct 1, 2016 and Oct 14, 2016. Exclusions comprised follow-up exams within the inclusion period, bedside radiographs, incomplete images, imported radiographs, and pediatric radiographs. Three chest radiologists categorized findings into normal, clinically irrelevant, clinically relevant, urgent, and critical. A commercial AI system processed all radiographs, scoring 10 chest abnormalities on a 0-100 confidence scale. AI system performance was evaluated using the area under the ROC curve (AUC), assessing the detection of normal radiographs. Sensitivity was calculated for the default and a conservative operating point. the detection of negative predictive value (NPV) for urgent and critical findings, as well as the potential workload reduction, was calculated. RESULTS: A total of 2603 radiographs were acquired in 2141 unique patients. Post-exclusion, 1670 radiographs were analyzed. Categories included 479 normal, 332 clinically irrelevant, 339 clinically relevant, 501 urgent, and 19 critical findings. The AI system achieved an AUC of 0.92. Sensitivity for normal radiographs was 92% at default and 53% at the conservative operating point. At the conservative operating point, NPV was 98% for urgent and critical findings, and could result in a 15% workload reduction. CONCLUSION: A commercially available AI system effectively identifies normal chest radiographs and holds the potential to lessen radiologists' workload by omitting half of the normal exams from reporting. CLINICAL RELEVANCE STATEMENT: The AI system is able to detect half of all normal chest radiographs at a clinically acceptable operating point, thereby potentially reducing the workload for the radiologists by 15%. KEY POINTS: The AI system reached an AUC of 0.92 for the detection of normal chest radiographs. Fifty-three percent of normal chest radiographs were identified with a NPV of 98% for urgent findings. AI can reduce the workload of chest radiography reporting by 15%.
RESUMEN
OBJECTIVES: To develop and validate an artificial intelligence (AI) system for measuring and detecting signs of carpal instability on conventional radiographs. MATERIALS AND METHODS: Two case-control datasets of hand and wrist radiographs were retrospectively acquired at three hospitals (hospitals A, B, and C). Dataset 1 (2178 radiographs from 1993 patients, hospitals A and B, 2018-2019) was used for developing an AI system for measuring scapholunate (SL) joint distances, SL and capitolunate (CL) angles, and carpal arc interruptions. Dataset 2 (481 radiographs from 217 patients, hospital C, 2017-2021) was used for testing, and with a subsample (174 radiographs from 87 patients), an observer study was conducted to compare its performance to five clinicians. Evaluation metrics included mean absolute error (MAE), sensitivity, and specificity. RESULTS: Dataset 2 included 258 SL distances, 189 SL angles, 191 CL angles, and 217 carpal arc labels obtained from 217 patients (mean age, 51 years ± 23 [standard deviation]; 133 women). The MAE in measuring SL distances, SL angles, and CL angles was respectively 0.65 mm (95%CI: 0.59, 0.72), 7.9 degrees (95%CI: 7.0, 8.9), and 5.9 degrees (95%CI: 5.2, 6.6). The sensitivity and specificity for detecting arc interruptions were 83% (95%CI: 74, 91) and 64% (95%CI: 56, 71). The measurements were largely comparable to those of the clinicians, while arc interruption detections were more accurate than those of most clinicians. CONCLUSION: This study demonstrates that a newly developed automated AI system accurately measures and detects signs of carpal instability on conventional radiographs. CLINICAL RELEVANCE STATEMENT: This system has the potential to improve detections of carpal arc interruptions and could be a promising tool for supporting clinicians in detecting carpal instability.
RESUMEN
This paper presents a large publicly available multi-center lumbar spine magnetic resonance imaging (MRI) dataset with reference segmentations of vertebrae, intervertebral discs (IVDs), and spinal canal. The dataset includes 447 sagittal T1 and T2 MRI series from 218 patients with a history of low back pain and was collected from four different hospitals. An iterative data annotation approach was used by training a segmentation algorithm on a small part of the dataset, enabling semi-automatic segmentation of the remaining images. The algorithm provided an initial segmentation, which was subsequently reviewed, manually corrected, and added to the training data. We provide reference performance values for this baseline algorithm and nnU-Net, which performed comparably. Performance values were computed on a sequestered set of 39 studies with 97 series, which were additionally used to set up a continuous segmentation challenge that allows for a fair comparison of different segmentation algorithms. This study may encourage wider collaboration in the field of spine segmentation and improve the diagnostic value of lumbar spine MRI.
Asunto(s)
Disco Intervertebral , Vértebras Lumbares , Humanos , Algoritmos , Procesamiento de Imagen Asistido por Computador/métodos , Disco Intervertebral/patología , Vértebras Lumbares/diagnóstico por imagen , Imagen por Resonancia Magnética/métodos , Dolor de la Región LumbarRESUMEN
OBJECTIVES: Severity of degenerative scoliosis (DS) is assessed by measuring the Cobb angle on anteroposterior radiographs. However, MRI images are often available to study the degenerative spine. This retrospective study aims to develop and evaluate the reliability of a novel automatic method that measures coronal Cobb angles on lumbar MRI in DS patients. MATERIALS AND METHODS: Vertebrae and intervertebral discs were automatically segmented using a 3D AI algorithm, trained on 447 lumbar MRI series. The segmentations were used to calculate all possible angles between the vertebral endplates, with the largest being the Cobb angle. The results were validated with 50 high-resolution sagittal lumbar MRI scans of DS patients, in which three experienced readers measured the Cobb angle. Reliability was determined using the intraclass correlation coefficient (ICC). RESULTS: The ICCs between the readers ranged from 0.90 (95% CI 0.83-0.94) to 0.93 (95% CI 0.88-0.96). The ICC between the maximum angle found by the algorithm and the average manually measured Cobb angles was 0.83 (95% CI 0.71-0.90). In 9 out of the 50 cases (18%), all readers agreed on both vertebral levels for Cobb angle measurement. When using the algorithm to extract the angles at the vertebral levels chosen by the readers, the ICCs ranged from 0.92 (95% CI 0.87-0.96) to 0.97 (95% CI 0.94-0.98). CONCLUSION: The Cobb angle can be accurately measured on MRI using the newly developed algorithm in patients with DS. The readers failed to consistently choose the same vertebral level for Cobb angle measurement, whereas the automatic approach ensures the maximum angle is consistently measured. CLINICAL RELEVANCE STATEMENT: Our AI-based algorithm offers reliable Cobb angle measurement on routine MRI for degenerative scoliosis patients, potentially reducing the reliance on conventional radiographs, ensuring consistent assessments, and therefore improving patient care. KEY POINTS: ⢠While often available, MRI images are rarely utilized to determine the severity of degenerative scoliosis. ⢠The presented MRI Cobb angle algorithm is more reliable than humans in patients with degenerative scoliosis. ⢠Radiographic imaging for Cobb angle measurements is mitigated when lumbar MRI images are available.
Asunto(s)
Algoritmos , Vértebras Lumbares , Imagen por Resonancia Magnética , Escoliosis , Humanos , Escoliosis/diagnóstico por imagen , Imagen por Resonancia Magnética/métodos , Femenino , Masculino , Vértebras Lumbares/diagnóstico por imagen , Reproducibilidad de los Resultados , Estudios Retrospectivos , Anciano , Persona de Mediana Edad , Anciano de 80 o más Años , Inteligencia Artificial , Adulto , Imagenología Tridimensional/métodosRESUMEN
Background Multiple commercial artificial intelligence (AI) products exist for assessing radiographs; however, comparable performance data for these algorithms are limited. Purpose To perform an independent, stand-alone validation of commercially available AI products for bone age prediction based on hand radiographs and lung nodule detection on chest radiographs. Materials and Methods This retrospective study was carried out as part of Project AIR. Nine of 17 eligible AI products were validated on data from seven Dutch hospitals. For bone age prediction, the root mean square error (RMSE) and Pearson correlation coefficient were computed. The reference standard was set by three to five expert readers. For lung nodule detection, the area under the receiver operating characteristic curve (AUC) was computed. The reference standard was set by a chest radiologist based on CT. Randomized subsets of hand (n = 95) and chest (n = 140) radiographs were read by 14 and 17 human readers, respectively, with varying experience. Results Two bone age prediction algorithms were tested on hand radiographs (from January 2017 to January 2022) in 326 patients (mean age, 10 years ± 4 [SD]; 173 female patients) and correlated strongly with the reference standard (r = 0.99; P < .001 for both). No difference in RMSE was observed between algorithms (0.63 years [95% CI: 0.58, 0.69] and 0.57 years [95% CI: 0.52, 0.61]) and readers (0.68 years [95% CI: 0.64, 0.73]). Seven lung nodule detection algorithms were validated on chest radiographs (from January 2012 to May 2022) in 386 patients (mean age, 64 years ± 11; 223 male patients). Compared with readers (mean AUC, 0.81 [95% CI: 0.77, 0.85]), four algorithms performed better (AUC range, 0.86-0.93; P value range, <.001 to .04). Conclusions Compared with human readers, four AI algorithms for detecting lung nodules on chest radiographs showed improved performance, whereas the remaining algorithms tested showed no evidence of a difference in performance. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Omoumi and Richiardi in this issue.
Asunto(s)
Inteligencia Artificial , Programas Informáticos , Humanos , Femenino , Masculino , Niño , Persona de Mediana Edad , Estudios Retrospectivos , Algoritmos , PulmónRESUMEN
OBJECTIVES: To map the clinical use of CE-marked artificial intelligence (AI)-based software in radiology departments in the Netherlands (n = 69) between 2020 and 2022. MATERIALS AND METHODS: Our AI network (one radiologist or AI representative per Dutch hospital organization) received a questionnaire each spring from 2020 to 2022 about AI product usage, financing, and obstacles to adoption. Products that were not listed on www.AIforRadiology.com by July 2022 were excluded from the analysis. RESULTS: The number of respondents was 43 in 2020, 36 in 2021, and 33 in 2022. The number of departments using AI has been growing steadily (2020: 14, 2021: 19, 2022: 23). The diversity (2020: 7, 2021: 18, 2022: 34) and the number of total implementations (2020: 19, 2021: 38, 2022: 68) has rapidly increased. Seven implementations were discontinued in 2022. Four hospital organizations said to use an AI platform or marketplace for the deployment of AI solutions. AI is mostly used to support chest CT (17), neuro CT (17), and musculoskeletal radiograph (12) analysis. The budget for AI was reserved in 13 of the responding centers in both 2021 and 2022. The most important obstacles to the adoption of AI remained costs and IT integration. Of the respondents, 28% stated that the implemented AI products realized health improvement and 32% assumed both health improvement and cost savings. CONCLUSION: The adoption of AI products in radiology departments in the Netherlands is showing common signs of a developing market. The major obstacles to reaching widespread adoption are a lack of financial resources and IT integration difficulties. CLINICAL RELEVANCE STATEMENT: The clinical impact of AI starts with its adoption in daily clinical practice. Increased transparency around AI products being adopted, implementation obstacles, and impact may inspire increased collaboration and improved decision-making around the implementation and financing of AI products. KEY POINTS: ⢠The adoption of artificial intelligence products for radiology has steadily increased since 2020 to at least a third of the centers using AI in clinical practice in the Netherlands in 2022. ⢠The main areas in which artificial intelligence products are used are lung nodule detection on CT, aided stroke diagnosis, and bone age prediction. ⢠The majority of respondents experienced added value (decreased costs and/or improved outcomes) from using artificial intelligence-based software; however, major obstacles to adoption remain the costs and IT-related difficulties.
Asunto(s)
Inteligencia Artificial , Radiología , Humanos , Países Bajos , Radiografía , RadiólogosRESUMEN
BACKGROUND: Outside a screening program, early-stage lung cancer is generally diagnosed after the detection of incidental nodules in clinically ordered chest CT scans. Despite the advances in artificial intelligence (AI) systems for lung cancer detection, clinical validation of these systems is lacking in a non-screening setting. METHOD: We developed a deep learning-based AI system and assessed its performance for the detection of actionable benign nodules (requiring follow-up), small lung cancers, and pulmonary metastases in CT scans acquired in two Dutch hospitals (internal and external validation). A panel of five thoracic radiologists labeled all nodules, and two additional radiologists verified the nodule malignancy status and searched for any missed cancers using data from the national Netherlands Cancer Registry. The detection performance was evaluated by measuring the sensitivity at predefined false positive rates on a free receiver operating characteristic curve and was compared with the panel of radiologists. RESULTS: On the external test set (100 scans from 100 patients), the sensitivity of the AI system for detecting benign nodules, primary lung cancers, and metastases is respectively 94.3% (82/87, 95% CI: 88.1-98.8%), 96.9% (31/32, 95% CI: 91.7-100%), and 92.0% (104/113, 95% CI: 88.5-95.5%) at a clinically acceptable operating point of 1 false positive per scan (FP/s). These sensitivities are comparable to or higher than the radiologists, albeit with a slightly higher FP/s (average difference of 0.6). CONCLUSIONS: The AI system reliably detects benign and malignant pulmonary nodules in clinically indicated CT scans and can potentially assist radiologists in this setting.
Early-stage lung cancer can be diagnosed after identifying an abnormal spot on a chest CT scan ordered for other medical reasons. These spots or lung nodules can be overlooked by radiologists, as they are not necessarily the focus of an examination and can be as small as a few millimeters. Software using Artificial Intelligence (AI) technology has proven to be successful for aiding radiologists in this task, but its performance is understudied outside a lung cancer screening setting. We therefore developed and validated AI software for the detection of cancerous nodules or non-cancerous nodules that would need attention. We show that the software can reliably detect these nodules in a non-screening setting and could potentially aid radiologists in daily clinical practice.
RESUMEN
OBJECTIVE: To study trends in the incidence of reported pulmonary nodules and stage I lung cancer in chest CT. METHODS: We analyzed the trends in the incidence of detected pulmonary nodules and stage I lung cancer in chest CT scans in the period between 2008 and 2019. Imaging metadata and radiology reports from all chest CT studies were collected from two large Dutch hospitals. A natural language processing algorithm was developed to identify studies with any reported pulmonary nodule. RESULTS: Between 2008 and 2019, a total of 74,803 patients underwent 166,688 chest CT examinations at both hospitals combined. During this period, the annual number of chest CT scans increased from 9955 scans in 6845 patients in 2008 to 20,476 scans in 13,286 patients in 2019. The proportion of patients in whom nodules (old or new) were reported increased from 38% (2595/6845) in 2008 to 50% (6654/13,286) in 2019. The proportion of patients in whom significant new nodules (≥ 5 mm) were reported increased from 9% (608/6954) in 2010 to 17% (1660/9883) in 2017. The number of patients with new nodules and corresponding stage I lung cancer diagnosis tripled and their proportion doubled, from 0.4% (26/6954) in 2010 to 0.8% (78/9883) in 2017. CONCLUSION: The identification of incidental pulmonary nodules in chest CT has steadily increased over the past decade and has been accompanied by more stage I lung cancer diagnoses. CLINICAL RELEVANCE STATEMENT: These findings stress the importance of identifying and efficiently managing incidental pulmonary nodules in routine clinical practice. KEY POINTS: ⢠The number of patients who underwent chest CT examinations substantially increased over the past decade, as did the number of patients in whom pulmonary nodules were identified. ⢠The increased use of chest CT and more frequently identified pulmonary nodules were associated with more stage I lung cancer diagnoses.
Asunto(s)
Neoplasias Pulmonares , Nódulos Pulmonares Múltiples , Nódulo Pulmonar Solitario , Humanos , Incidencia , Nódulo Pulmonar Solitario/diagnóstico por imagen , Nódulo Pulmonar Solitario/epidemiología , Nódulos Pulmonares Múltiples/diagnóstico por imagen , Nódulos Pulmonares Múltiples/epidemiología , Tomografía Computarizada por Rayos X/métodos , Neoplasias Pulmonares/diagnóstico por imagen , Neoplasias Pulmonares/epidemiologíaRESUMEN
OBJECTIVES: We evaluated whether lesion-to-fat ratio measured by shear wave elastography in patients with Breast Imaging Reporting and Data System (BI-RADS) 3 or 4 lesions has the potential to further refine the assessment of B-mode ultrasound alone in breast cancer diagnostics. METHODS: This was a secondary analysis of an international diagnostic multicenter trial (NCT02638935). Data from 1288 women with breast lesions categorized as BI-RADS 3 and 4a-c by conventional B-mode ultrasound were analyzed, whereby the focus was placed on differentiating lesions categorized as BI-RADS 3 and BI-RADS 4a. All women underwent shear wave elastography and histopathologic evaluation functioning as reference standard. Reduction of benign biopsies as well as the number of missed malignancies after reclassification using lesion-to-fat ratio measured by shear wave elastography were evaluated. RESULTS: Breast cancer was diagnosed in 368 (28.6%) of 1288 lesions. The assessment with conventional B-mode ultrasound resulted in 53.8% (495 of 1288) pathologically benign lesions categorized as BI-RADS 4 and therefore false positives as well as in 1.39% (6 of 431) undetected malignancies categorized as BI-RADS 3. Additional lesion-to-fat ratio in BI-RADS 4a lesions with a cutoff value of 1.85 resulted in 30.11% biopsies of benign lesions which correspond to a reduction of 44.04% of false positives. CONCLUSIONS: Adding lesion-to-fat ratio measured by shear wave elastography to conventional B-mode ultrasound in BI-RADS 4a breast lesions could help reduce the number of benign biopsies by 44.04%. At the same time, however, 1.98% of malignancies were missed, which would still be in line with American College of Radiology BI-RADS 3 definition of <2% of undetected malignancies.
Asunto(s)
Neoplasias de la Mama , Diagnóstico por Imagen de Elasticidad , Humanos , Femenino , Sensibilidad y Especificidad , Diagnóstico por Imagen de Elasticidad/métodos , Ultrasonografía Mamaria/métodos , Reproducibilidad de los Resultados , Neoplasias de la Mama/diagnóstico por imagen , Neoplasias de la Mama/patología , Biopsia , Elasticidad , Diagnóstico DiferencialRESUMEN
PURPOSE: In this prospective, multicenter trial we evaluated whether additional shear wave elastography (SWE) for patients with BI-RADS 3 or 4 lesions on breast ultrasound could further refine the assessment with B-mode breast ultrasound for breast cancer diagnosis. MATERIALS AND METHODS: We analyzed prospective, multicenter, international data from 1288 women with breast lesions rated by conventional 2âD B-mode ultrasound as BI-RADS 3 to 4c and undergoing 2D-SWE. After reclassification with SWE the proportion of undetected malignancies should be <â2â%. All patients underwent histopathologic evaluation (reference standard). RESULTS: Histopathologic evaluation showed malignancy in 368 of 1288 lesions (28.6â%). The assessment with B-mode breast ultrasound resulted in 1.39â% (6 of 431) undetected malignancies (malignant lesions in BI-RADS 3) and 53.80â% (495 of 920) unnecessary biopsies (biopsies in benign lesions). Re-classifying BI-RADS 4a patients with a SWE cutoff of 2.55âm/s resulted in 1.98â% (11 of 556) undetected malignancies and a reduction of 24.24â% (375 vs. 495) of unnecessary biopsies. CONCLUSION: A SWE value below 2.55âm/s for BI-RADS 4a lesions could be used to downstage these lesions to follow-up, and therefore reduce the number of unnecessary biopsies by 24.24â%. However, this would come at the expense of some additionally missed cancers compared to B-mode breast ultrasound (rate of undetected malignancies 1.98â%, 11 of 556, versus 1.39â%, 6 of 431) which would, however, still be in line with the ACR BI-RADS 3 definition (<â2â% of undetected malignancies).
Asunto(s)
Neoplasias de la Mama , Diagnóstico por Imagen de Elasticidad , Femenino , Humanos , Neoplasias de la Mama/diagnóstico por imagen , Neoplasias de la Mama/patología , Diagnóstico por Imagen de Elasticidad/métodos , Estudios Prospectivos , Sensibilidad y Especificidad , Diagnóstico Diferencial , Reproducibilidad de los Resultados , Ultrasonografía Mamaria/métodos , BiopsiaRESUMEN
OBJECTIVES: To assess how an artificial intelligence (AI) algorithm performs against five experienced musculoskeletal radiologists in diagnosing scaphoid fractures and whether it aids their diagnosis on conventional multi-view radiographs. METHODS: Four datasets of conventional hand, wrist, and scaphoid radiographs were retrospectively acquired at two hospitals (hospitals A and B). Dataset 1 (12,990 radiographs from 3353 patients, hospital A) and dataset 2 (1117 radiographs from 394 patients, hospital B) were used for training and testing a scaphoid localization and laterality classification component. Dataset 3 (4316 radiographs from 840 patients, hospital A) and dataset 4 (688 radiographs from 209 patients, hospital B) were used for training and testing the fracture detector. The algorithm was compared with the radiologists in an observer study. Evaluation metrics included sensitivity, specificity, positive predictive value (PPV), area under the characteristic operating curve (AUC), Cohen's kappa coefficient (κ), fracture localization precision, and reading time. RESULTS: The algorithm detected scaphoid fractures with a sensitivity of 72%, specificity of 93%, PPV of 81%, and AUC of 0.88. The AUC of the algorithm did not differ from each radiologist (0.87 [radiologists' mean], p ≥ .05). AI assistance improved five out of ten pairs of inter-observer Cohen's κ agreements (p < .05) and reduced reading time in four radiologists (p < .001), but did not improve other metrics in the majority of radiologists (p ≥ .05). CONCLUSIONS: The AI algorithm detects scaphoid fractures on conventional multi-view radiographs at the level of five experienced musculoskeletal radiologists and could significantly shorten their reading time. KEY POINTS: ⢠An artificial intelligence algorithm automatically detects scaphoid fractures on conventional multi-view radiographs at the same level of five experienced musculoskeletal radiologists. ⢠There is preliminary evidence that automated scaphoid fracture detection can significantly shorten the reading time of musculoskeletal radiologists.
Asunto(s)
Aprendizaje Profundo , Fracturas Óseas , Hueso Escafoides , Traumatismos de la Muñeca , Humanos , Fracturas Óseas/diagnóstico por imagen , Muñeca , Estudios Retrospectivos , Inteligencia Artificial , Hueso Escafoides/diagnóstico por imagen , RadiólogosRESUMEN
BACKGROUND: Breast ultrasound identifies additional carcinomas not detected in mammography but has a higher rate of false-positive findings. We evaluated whether use of intelligent multi-modal shear wave elastography (SWE) can reduce the number of unnecessary biopsies without impairing the breast cancer detection rate. METHODS: We trained, tested, and validated machine learning algorithms using SWE, clinical, and patient information to classify breast masses. We used data from 857 women who underwent B-mode breast ultrasound, SWE, and subsequent histopathologic evaluation at 12 study sites in seven countries from 2016 to 2019. Algorithms were trained and tested on data from 11 of the 12 sites and externally validated using the additional site's data. We compared findings to the histopathologic evaluation and compared the diagnostic performance between B-mode breast ultrasound, traditional SWE, and intelligent multi-modal SWE. RESULTS: In the external validation set (n = 285), intelligent multi-modal SWE showed a sensitivity of 100% (95% CI, 97.1-100%, 126 of 126), a specificity of 50.3% (95% CI, 42.3-58.3%, 80 of 159), and an area under the curve of 0.93 (95% CI, 0.90-0.96). Diagnostic performance was significantly higher compared to traditional SWE and B-mode breast ultrasound (P < 0.001). Unlike traditional SWE, positive-predictive values of intelligent multi-modal SWE were significantly higher compared to B-mode breast ultrasound. Unnecessary biopsies were reduced by 50.3% (79 versus 159, P < 0.001) without missing cancer compared to B-mode ultrasound. CONCLUSION: The majority of unnecessary breast biopsies might be safely avoided by using intelligent multi-modal SWE. These results may be helpful to reduce diagnostic burden for patients, providers, and healthcare systems.
Asunto(s)
Neoplasias de la Mama , Diagnóstico por Imagen de Elasticidad , Humanos , Femenino , Diagnóstico por Imagen de Elasticidad/métodos , Neoplasias de la Mama/diagnóstico por imagen , Neoplasias de la Mama/patología , Estudios Retrospectivos , Ultrasonografía Mamaria , Biopsia , Sensibilidad y Especificidad , Reproducibilidad de los Resultados , Diagnóstico DiferencialRESUMEN
Surgeons often prefer to use a tourniquet during minor procedures, such as carpal tunnel release (CTR) or trigger finger release (TFR). Besides the possible discomfort for the patient, the effect of tourniquet use on long-term results and complications is unknown. Our primary aim was to compare the patient-reported outcomes 1 year after CTR or TFR under local anesthesia with or without tourniquet. Secondary outcomes included satisfaction, sonographically estimated scar tissue thickness after CTR' and postoperative complications. Methods: Between May 2019 and May 2020, 163 patients planned for open CTR or TFR under local anesthesia were included. Before surgery, and at 3, 6, and 12 months postoperatively, Quick Disabilities of the Arm, Shoulder and Hand and Boston Carpal Tunnel questionnaires were administered, and complications were noted. At 6 months postoperatively, an ultrasound was conducted to determine the thickness of scar tissue in the region of median nerve. Results: A total of 142 patients (51 men [38%]) were included. The Quick Disabilities of the Arm, Shoulder and Hand questionnaire and Boston Carpal Tunnel Questionnaire scores improved significantly in both groups during follow-up, wherein most improvements were seen in the first 3 months. No difference in clinical outcome and scar tissue formation was found between the two groups after 12 months. The complication rate was comparable between both groups. Thirty-two (24%) patients had at least one complication, none needed surgical interventions, and no recurrent symptoms were seen. Conclusions: Our study shows similar long-term clinical outcomes, formation of scar tissue, and complication rates for patients undergoing CTR or TFR with or without a tourniquet. Tourniquet usage should be based on shared decision-making.
RESUMEN
OBJECTIVES: AI-based algorithms for medical image analysis showed comparable performance to human image readers. However, in practice, diagnoses are made using multiple imaging modalities alongside other data sources. We determined the importance of this multi-modal information and compared the diagnostic performance of routine breast cancer diagnosis to breast ultrasound interpretations by humans or AI-based algorithms. METHODS: Patients were recruited as part of a multicenter trial (NCT02638935). The trial enrolled 1288 women undergoing routine breast cancer diagnosis (multi-modal imaging, demographic, and clinical information). Three physicians specialized in ultrasound diagnosis performed a second read of all ultrasound images. We used data from 11 of 12 study sites to develop two machine learning (ML) algorithms using unimodal information (ultrasound features generated by the ultrasound experts) to classify breast masses which were validated on the remaining study site. The same ML algorithms were subsequently developed and validated on multi-modal information (clinical and demographic information plus ultrasound features). We assessed performance using area under the curve (AUC). RESULTS: Of 1288 breast masses, 368 (28.6%) were histopathologically malignant. In the external validation set (n = 373), the performance of the two unimodal ultrasound ML algorithms (AUC 0.83 and 0.82) was commensurate with performance of the human ultrasound experts (AUC 0.82 to 0.84; p for all comparisons > 0.05). The multi-modal ultrasound ML algorithms performed significantly better (AUC 0.90 and 0.89) but were statistically inferior to routine breast cancer diagnosis (AUC 0.95, p for all comparisons ≤ 0.05). CONCLUSIONS: The performance of humans and AI-based algorithms improves with multi-modal information. KEY POINTS: ⢠The performance of humans and AI-based algorithms improves with multi-modal information. ⢠Multimodal AI-based algorithms do not necessarily outperform expert humans. ⢠Unimodal AI-based algorithms do not represent optimal performance to classify breast masses.
Asunto(s)
Inteligencia Artificial , Neoplasias de la Mama , Algoritmos , Mama/diagnóstico por imagen , Mama/patología , Neoplasias de la Mama/diagnóstico por imagen , Neoplasias de la Mama/patología , Femenino , Humanos , Imagen MultimodalRESUMEN
OBJECTIVES: Over 2500 percutaneous transhepatic cholangiography and biliary drainage (PTCD) procedures are yearly performed in the Netherlands. Most interventions are performed for treatment of biliary obstruction following unsuccessful endoscopic biliary cannulation. Our aim was to evaluate complication rates and risk factors for complications in PTCD patients after failed ERCP. METHODS: We performed an observational study collecting data from a cohort that was subjected to PTCD during a 5-year period in one academic and four teaching hospitals. Primary objective was the development of infectious (sepsis, cholangitis, abscess, or cholecystitis) and non-infectious complications (bile leakage, severe hemorrhage, etc.) and mortality within 30 days of the procedure. Subsequently, risk factors for complications and mortality were analyzed with a multilevel logistic regression analysis. RESULTS: A total of 331 patients underwent PTCD of whom 205 (61.9%) developed PTCD-related complications. Of the 224 patients without a pre-existent infection, 91 (40.6%) developed infectious complications, i.e., cholangitis in 26.3%, sepsis in 24.6%, abscess formation in 2.7%, and cholecystitis in 1.3%. Non-infectious complications developed in 114 of 331 patients (34.4%). 30-day mortality was 17.2% (N = 57). Risk factors for infectious complications included internal drainage and drain obstruction, while multiple re-interventions were a risk factor for non-infectious complications. CONCLUSION: Both infectious and non-infectious complications are frequent after PTCD, most often due to biliary drain obstruction.
Asunto(s)
Colangitis , Colecistitis , Colestasis , Sepsis , Absceso , Colangiografía/métodos , Colangitis/diagnóstico por imagen , Colangitis/etiología , Colestasis/diagnóstico por imagen , Colestasis/terapia , Drenaje/métodos , HumanosRESUMEN
BACKGROUND: Shear wave elastography (SWE) and strain elastography (SE) have shown promising potential in breast cancer diagnostics by evaluating the stiffness of a lesion. Combining these two techniques could further improve the diagnostic performance. We aimed to exploratorily define the cut-offs at which adding combined SWE and SE to B-mode breast ultrasound could help reclassify Breast Imaging Reporting and Data System (BI-RADS) 3-4 lesions to reduce the number of unnecessary breast biopsies. METHODS: We report the secondary results of a prospective, multicentre, international trial (NCT02638935). The trial enrolled 1288 women with BI-RADS 3 to 4c breast masses on conventional B-mode breast ultrasound. All patients underwent SWE and SE (index test) and histopathologic evaluation (reference standard). Reduction of unnecessary biopsies (biopsies in benign lesions) and missed malignancies after recategorising with SWE and SE were the outcome measures. RESULTS: On performing histopathologic evaluation, 368 of 1288 breast masses were malignant. Following the routine B-mode breast ultrasound assessment, 53.80% (495 of 920 patients) underwent an unnecessary biopsy. After recategorising BI-RADS 4a lesions (SWE cut-off ≥3.70 m/s, SE cut-off ≥1.0), 34.78% (320 of 920 patients) underwent an unnecessary biopsy corresponding to a 35.35% (320 versus 495) reduction of unnecessary biopsies. Malignancies in the new BI-RADS 3 cohort were missed in 1.96% (12 of 612 patients). CONCLUSION: Adding combined SWE and SE to routine B-mode breast ultrasound to recategorise BI-RADS 4a patients could help reduce the number of unnecessary biopsies in breast diagnostics by about 35% while keeping the rate of undetected malignancies below the 2% ACR BI-RADS 3 definition.
Asunto(s)
Biopsia/métodos , Neoplasias de la Mama/diagnóstico , Diagnóstico por Imagen de Elasticidad/métodos , Femenino , Humanos , Persona de Mediana EdadRESUMEN
Since the introduction of artificial intelligence (AI) in radiology, the promise has been that it will improve health care and reduce costs. Has AI been able to fulfill that promise? We describe six clinical objectives that can be supported by AI: a more efficient workflow, shortened reading time, a reduction of dose and contrast agents, earlier detection of disease, improved diagnostic accuracy and more personalized diagnostics. We provide examples of use cases including the available scientific evidence for its impact based on a hierarchical model of efficacy. We conclude that the market is still maturing and little is known about the contribution of AI to clinical practice. More real-world monitoring of AI in clinical practice is expected to aid in determining the value of AI and making informed decisions on development, procurement and reimbursement.
Asunto(s)
Inteligencia Artificial , Radiología , Medios de Contraste , Humanos , Evaluación de Resultado en la Atención de Salud , RadiografíaRESUMEN
BACKGROUND: Limited evidence is available on the clinical impact of artificial intelligence (AI) in radiology. Early health technology assessment (HTA) is a methodology to assess the potential value of an innovation at an early stage. We use early HTA to evaluate the potential value of AI software in radiology. As a use-case, we evaluate the cost-effectiveness of AI software aiding the detection of intracranial large vessel occlusions (LVO) in stroke in comparison to standard care. We used a Markov based model from a societal perspective of the United Kingdom predominantly using stroke registry data complemented with pooled outcome data from large, randomized trials. Different scenarios were explored by varying missed diagnoses of LVOs, AI costs and AI performance. Other input parameters were varied to demonstrate model robustness. Results were reported in expected incremental costs (IC) and effects (IE) expressed in quality adjusted life years (QALYs). RESULTS: Applying the base case assumptions (6% missed diagnoses of LVOs by clinicians, $40 per AI analysis, 50% reduction of missed LVOs by AI), resulted in cost-savings and incremental QALYs over the projected lifetime (IC: - $156, - 0.23%; IE: + 0.01 QALYs, + 0.07%) per suspected ischemic stroke patient. For each yearly cohort of patients in the UK this translates to a total cost saving of $11 million. CONCLUSIONS: AI tools for LVO detection in emergency care have the potential to improve healthcare outcomes and save costs. We demonstrate how early HTA may be applied for the evaluation of clinically applied AI software for radiology.
RESUMEN
PURPOSE: To compare the performance of a convolutional neural network (CNN) to that of 11 radiologists in detecting scaphoid bone fractures on conventional radiographs of the hand, wrist, and scaphoid. MATERIALS AND METHODS: At two hospitals (hospitals A and B), three datasets consisting of conventional hand, wrist, and scaphoid radiographs were retrospectively retrieved: a dataset of 1039 radiographs (775 patients [mean age, 48 years ± 23 {standard deviation}; 505 female patients], period: 2017-2019, hospitals A and B) for developing a scaphoid segmentation CNN, a dataset of 3000 radiographs (1846 patients [mean age, 42 years ± 22; 937 female patients], period: 2003-2019, hospital B) for developing a scaphoid fracture detection CNN, and a dataset of 190 radiographs (190 patients [mean age, 43 years ± 20; 77 female patients], period: 2011-2020, hospital A) for testing the complete fracture detection system. Both CNNs were applied consecutively: The segmentation CNN localized the scaphoid and then passed the relevant region to the detection CNN for fracture detection. In an observer study, the performance of the system was compared with that of 11 radiologists. Evaluation metrics included the Dice similarity coefficient (DSC), Hausdorff distance (HD), sensitivity, specificity, positive predictive value (PPV), and area under the receiver operating characteristic curve (AUC). RESULTS: The segmentation CNN achieved a DSC of 97.4% ± 1.4 with an HD of 1.31 mm ± 1.03. The detection CNN had sensitivity of 78% (95% CI: 70, 86), specificity of 84% (95% CI: 77, 92), PPV of 83% (95% CI: 77, 90), and AUC of 0.87 (95% CI: 0.81, 0.91). There was no difference between the AUC of the CNN and that of the radiologists (0.87 [95% CI: 0.81, 0.91] vs 0.83 [radiologist range: 0.79-0.85]; P = .09). CONCLUSION: The developed CNN achieved radiologist-level performance in detecting scaphoid bone fractures on conventional radiographs of the hand, wrist, and scaphoid.Keywords: Convolutional Neural Network (CNN), Deep Learning Algorithms, Machine Learning Algorithms, Feature Detection-Vision-Application Domain, Computer-Aided DiagnosisSee also the commentary by Li and Torriani in this issue.Supplemental material is available for this article.©RSNA, 2021.