Multicenter Assessment of CT Pneumonia Analysis Prototype for Predicting Disease Severity and Patient Outcome.

To perform a multicenter assessment of the CT Pneumonia Analysis prototype for predicting disease severity and patient outcome in COVID-19 pneumonia both without and with integration of clinical information. Our IRB-approved observational study included consecutive 241 adult patients (> 18 years; 105 females; 136 males) with RT-PCR-positive COVID-19 pneumonia who underwent non-contrast chest CT at one of the two tertiary care hospitals (site A: Massachusetts General Hospital, USA; site B: Firoozgar Hospital Iran). We recorded patient age, gender, comorbid conditions, laboratory values, intensive care unit (ICU) admission, mechanical ventilation, and final outcome (recovery or death). Two thoracic radiologists reviewed all chest CTs to record type, extent of pulmonary opacities based on the percentage of lobe involved, and severity of respiratory motion artifacts. Thin-section CT images were processed with the prototype (Siemens Healthineers) to obtain quantitative features including lung volumes, volume and percentage of all-type and high-attenuation opacities (≥ -200 HU), and mean HU and standard deviation of opacities within a given lung region. These values are estimated for the total combined lung volume, and separately for each lung and each lung lobe. Multivariable analyses of variance (MANOVA) and multiple logistic regression were performed for data analyses. About 26% of chest CTs (62/241) had moderate to severe motion artifacts. There were no significant differences in the AUCs of quantitative features for predicting disease severity with and without motion artifacts (AUC 0.94-0.97) as well as for predicting patient outcome (AUC 0.7-0.77) (p > 0.5). Combination of the volume of all-attenuation opacities and the percentage of high-attenuation opacities (AUC 0.76-0.82, 95% confidence interval (CI) 0.73-0.82) had higher AUC for predicting ICU admission than the subjective severity scores (AUC 0.69-0.77, 95% CI 0.69-0.81). Despite a high frequency of motion artifacts, quantitative features of pulmonary opacities from chest CT can help differentiate patients with favorable and adverse outcomes.

A study on bone mass density using dual energy X-ray absorptiometry: Does high body mass index have protective effect on bone density in obese patients?

BACKGROUND: Osteoporosis is known as reduction of bone density, which is diagnosed using dual-energy X-ray absorptiometry. Although some studies have shown high body mass index (BMI) as a protective factor for osteoporosis and fracture risks, some other studies demonstrated obesity as a risk factor for osteoporosis. The aim of this study is to evaluate the relationship between BMI and bone mineral density (BMD) in premenopausal and postmenopausal females. Furthermore, we determined the correlation between BMI and fracture risk in postmenopausal females. MATERIALS AND METHODS: In this study, we evaluated the relationship between the age and BMI with 10-year probability fracture risk (estimated using fracture risk assessment tool) and BMD in the L1-L4 spine and femoral neck. Data were collected from BMD center, Askariye Hospital, Isfahan, Iran, from May 2016 to July 2017. RESULTS: The study consisted of 1361 individuals, including 305 premenopausal females and 1056 postmenopausal females. The results showed a statistically significant increase of BMD (P < 0.001) and a decrease of fracture risk (ß = -0.158, R 2 = 0.518) with an increase of BMI in postmenopausal females. Moreover, lumbar spine and femoral neck BMD were significantly higher in individuals with BMI ≥30 than in those with BMI <25 in both premenopausal and postmenopausal females (P < 0.001). In addition, older postmenopausal females indicated significantly lower L1-L4 BMD (r = -0.280, P < 0.05) and femoral neck BMD (r = -0.358, P < 0.05). CONCLUSION: The results showed a positive correlation between BMI and BMD of the spine and femoral neck which did not differ by menopausal status. However, there was a correlation between BMI and fracture risk in postmenopausal females.

Salary Equity in Academic Radiology Relative to Other Clinical Specialties.

BACKGROUND: Equity in faculty compensation in U.S. academic radiology physicians relative to other specialties is not well known. OBJECTIVE: The aim of this study is to assess salary equity in U.S. academic radiology physicians at different ranks relative to other clinical specialties. METHODS: The American Association of Medical Colleges (AAMC) Faculty Salary Survey was used to collect information for full-time faculty at U.S. medical schools. Financial compensation data were collected for 2023 for faculty with MD or equivalent degree in medical specialties, stratified by gender and rank. RESULTS: The AAMC Faculty Salary Survey data for 2023 included responses for 97,224 faculty members in clinical specialties, with 5847 faculty members in Radiology departments. In radiology, compared to men (n = 3839), the women faculty members (n = 1763) had a lower median faculty compensation by 6% at the rank of Assistant Professor, 3% for Associate Professors, 4% for Professors and 6% for Section Chief positions. Surgery had the highest difference in median compensation with 21%, 24%, 22% and 19% lower faculty compensation, respectively, for women faculty members at corresponding ranks. Pathology had the lowest percent difference (<1%) in median compensation for all professor ranks. Salary inequity in radiology was lower compared to most other specialties. From assistant to full professors, all other clinical specialties except Pathology and Psychiatry, had a greater salary inequity than Radiology. CONCLUSION: The salary inequity in academic radiology faculty is lower than most other specialties. Further efforts should be made to reduce salary inequities as broader efforts to provide a more diverse, equitable and inclusive environment. SUMMARY STATEMENT: Salary inequity in academic radiology faculty is lower than most other specialties.

Performance of threshold-based stone segmentation and radiomics for determining the composition of kidney stones from single-energy CT.

PURPOSE: Knowledge of kidney stone composition can help in patient management; urine composition analysis and dual-energy CT are frequently used to assess stone type. We assessed if threshold-based stone segmentation and radiomics can determine the composition of kidney stones from single-energy, non-contrast abdomen-pelvis CT. METHODS: With IRB approval, we identified 218 consecutive patients (mean age 64 ± 13 years; male:female 138:80) with the presence of kidney stones on non-contrast, abdomen-pelvis CT and surgical or biochemical proof of their stone composition. CT examinations were performed on one of the seven multidetector-row scanners from four vendors (GE, Philips, Siemens, Toshiba). Deidentified CT images were processed with a radiomics prototype (Frontier, Siemens Healthineers) to segment the entire kidney volumes with an AI-based organ segmentation tool. We applied a threshold of 130 HU to isolate stones in the segmented kidneys and to estimate radiomics over the segmented stone volume. A coinvestigator verified kidney stone segmentation and adjusted the volume of interest to include the entire stone volume when necessary. We applied multiple logistic regression tests with precision recall plots to obtain area under the curve (AUC) using a built-in R statistical program. RESULTS: The threshold-based stone segmentation successfully isolated kidney stones (uric acid: n = 102 patients, calcium oxalate/phosphate: n = 116 patients) in all patients. Radiomics differentiated between calcium and uric acid stones with an AUC of 0.78 (p < 0.01, 95% CI 0.73-0.83), 0.79 sensitivity, and 0.90 specificity regardless of CT vendors (GE CT: AUC = 0.82, p < 0.01, 95% CI 0.740-0896; Siemens CT: AUC = 0.77, 95% CI 0.700-0.846, p < 0.01). CONCLUSION: Automated threshold-based stone segmentation and radiomics can differentiate between calcium oxalate/phosphate and urate stones from non-contrast, single-energy abdomen CT.

Automatic segmentation and measurement of tracheal collapsibility in tracheomalacia.

PURPOSE: To assess feasibility of automated segmentation and measurement of tracheal collapsibility for detecting tracheomalacia on inspiratory and expiratory chest CT images. METHODS: Our study included 123 patients (age 67 ± 11 years; female: male 69:54) who underwent clinically indicated chest CT examinations in both inspiration and expiration phases. A thoracic radiologist measured anteroposterior length of trachea in inspiration and expiration phase image at the level of maximum collapsibility or aortic arch (in absence of luminal change). Separately, another investigator separately processed the inspiratory and expiratory DICOM CT images with Airway Segmentation component of a commercial COPD software (IntelliSpace Portal, Philips Healthcare). Upon segmentation, the software automatically estimated average lumen diameter (in mm) and lumen area (sq.mm) both along the entire length of trachea and at the level of aortic arch. Data were analyzed with independent t-tests and area under the receiver operating characteristic curve (AUC). RESULTS: Of the 123 patients, 48 patients had tracheomalacia and 75 patients did not. Ratios of inspiration to expiration phases average lumen area and lumen diameter from the length of trachea had the highest AUC of 0.93 (95% CI = 0.88-0.97) for differentiating presence and absence of tracheomalacia. A decrease of ≥25% in average lumen diameter had sensitivity of 82% and specificity of 87% for detecting tracheomalacia. A decrease of ≥40% in the average lumen area had sensitivity and specificity of 86% for detecting tracheomalacia. CONCLUSION: Automatic segmentation and measurement of tracheal dimension over the entire tracheal length is more accurate than a single-level measurement for detecting tracheomalacia.

Auto-Detection of Motion Artifacts on CT Pulmonary Angiograms with a Physician-Trained AI Algorithm.

Purpose: Motion-impaired CT images can result in limited or suboptimal diagnostic interpretation (with missed or miscalled lesions) and patient recall. We trained and tested an artificial intelligence (AI) model for identifying substantial motion artifacts on CT pulmonary angiography (CTPA) that have a negative impact on diagnostic interpretation. Methods: With IRB approval and HIPAA compliance, we queried our multicenter radiology report database (mPower, Nuance) for CTPA reports between July 2015 and March 2022 for the following terms: "motion artifacts", "respiratory motion", "technically inadequate", and "suboptimal" or "limited exam". All CTPA reports were from two quaternary (Site A, n = 335; B, n = 259) and a community (C, n = 199) healthcare sites. A thoracic radiologist reviewed CT images of all positive hits for motion artifacts (present or absent) and their severity (no diagnostic effect or major diagnostic impairment). Coronal multiplanar images from 793 CTPA exams were de-identified and exported offline into an AI model building prototype (Cognex Vision Pro, Cognex Corporation) to train an AI model to perform two-class classification ("motion" or "no motion") with data from the three sites (70% training dataset, n = 554; 30% validation dataset, n = 239). Separately, data from Site A and Site C were used for training and validating; testing was performed on the Site B CTPA exams. A five-fold repeated cross-validation was performed to evaluate the model performance with accuracy and receiver operating characteristics analysis (ROC). Results: Among the CTPA images from 793 patients (mean age 63 ± 17 years; 391 males, 402 females), 372 had no motion artifacts, and 421 had substantial motion artifacts. The statistics for the average performance of the AI model after five-fold repeated cross-validation for the two-class classification included 94% sensitivity, 91% specificity, 93% accuracy, and 0.93 area under the ROC curve (AUC: 95% CI 0.89-0.97). Conclusion: The AI model used in this study can successfully identify CTPA exams with diagnostic interpretation limiting motion artifacts in multicenter training and test datasets. Clinical relevance: The AI model used in the study can help alert technologists about the presence of substantial motion artifacts on CTPA, where a repeat image acquisition can help salvage diagnostic information.

Radiologist-Trained AI Model for Identifying Suboptimal Chest-Radiographs.

RATIONALE AND OBJECTIVES: Suboptimal chest radiographs (CXR) can limit interpretation of critical findings. Radiologist-trained AI models were evaluated for differentiating suboptimal(sCXR) and optimal(oCXR) chest radiographs. MATERIALS AND METHODS: Our IRB-approved study included 3278 CXRs from adult patients (mean age 55 ± 20 years) identified from a retrospective search of CXR in radiology reports from 5 sites. A chest radiologist reviewed all CXRs for the cause of suboptimality. The de-identified CXRs were uploaded into an AI server application for training and testing 5 AI models. The training set consisted of 2202 CXRs (n = 807 oCXR; n = 1395 sCXR) while 1076 CXRs (n = 729 sCXR; n = 347 oCXR) were used for testing. Data were analyzed with the Area under the curve (AUC) for the model's ability to classify oCXR and sCXR correctly. RESULTS: For the two-class classification into sCXR or oCXR from all sites, for CXR with missing anatomy, AI had sensitivity, specificity, accuracy, and AUC of 78%, 95%, 91%, 0.87(95% CI 0.82-0.92), respectively. AI identified obscured thoracic anatomy with 91% sensitivity, 97% specificity, 95% accuracy, and 0.94 AUC (95% CI 0.90-0.97). Inadequate exposure with 90% sensitivity, 93% specificity, 92% accuracy, and AUC of 0.91 (95% CI 0.88-0.95). The presence of low lung volume was identified with 96% sensitivity, 92% specificity, 93% accuracy, and 0.94 AUC (95% CI 0.92-0.96). The sensitivity, specificity, accuracy, and AUC of AI in identifying patient rotation were 92%, 96%, 95%, and 0.94 (95% CI 0.91-0.98), respectively. CONCLUSION: The radiologist-trained AI models can accurately classify optimal and suboptimal CXRs. Such AI models at the front end of radiographic equipment can enable radiographers to repeat sCXRs when necessary.

Establishing national clinical diagnostic reference levels and achievable doses for CT examinations in Brazil: A prospective study.

PURPOSE: Diagnostic reference levels (DRL) and achievable doses (AD) are important tools for radiation dose optimization. Therefore, a prospective study was performed which aimed to establish a multi-parametric, clinical indication based - DRL(DRLCI) and clinical indication - AD (ADCI) for adult CT in Brazil. METHODS: The prospective study included 4787 patients (50 ± 18 years old; male:female 2041:2746) at 13 Brazilian sites that have been submitted to head, paranasal sinus, cervical spine, chest, or abdomen-pelvis CT between January and October 2021 for 13 clinical indications. The sites provided the following information: patient age, gender, weight, height, body mass index[BMI], clinical indications, scanner information(vendor, model, detector configuration), scan parameters (number of scan phases, kV, mA, pitch) and dose-related quantities (CT dose index volume- CTDIvol, dose length product- DLP). Median(AD) and 75th(DRL) percentile CTDIvol and DLP values were estimated for each body region and clinical indications. Non-normal data were analyzed with the Kruskal-Wallis test. RESULTS: In majority of Brazilian sites, body region and clinical indications based DRLs were at or lower than the corresponding DRLs in the US and higher than Europe. Although radiation doses varied significantly for patients in different body mass index groups (p < 0.001), within each body region, there were no differences in radiation doses for different clinical indications (p > 0.1). Radiation doses for 7/13 clinical indications were higher using iterative reconstruction technique than for the filtered back projection. CONCLUSIONS: There was substantial variation in Brazil DRLCI across different institutions with higher doses compared to the European standards. There was also a lack of clinical indication-based protocol and dose optimization based on different clinical indications for the same body region.

Spectral segmentation and radiomic features predict carotid stenosis and ipsilateral ischemic burden from DECT angiography.

PURPOSE The purpose of this study is to compare spectral segmentation, spectral radiomic, and single- energy radiomic features in the assessment of internal and common carotid artery (ICA/CCA) stenosis and prediction of surgical outcome. METHODS Our ethical committee-approved, Health Insurance Portability and Accountability Act (HIPAA)- compliant study included 85 patients (mean age, 73 ± 10 years; male : female, 56 : 29) who under- went contrast-enhanced, dual-source dual-energy CT angiography (DECTA) (Siemens Definition Flash) of the neck for assessing ICA/CCA stenosis. Patients with a prior surgical or interventional treatment of carotid stenosis were excluded. Two radiologists graded the severity of carotid ste- nosis on DECTA images as mild (<50% luminal narrowing), moderate (50%-69%), and severe (>70%) stenosis. Thin-section, low- and high-kV DICOM images from the arterial phase acquisi- tion were processed with a dual-energy CT prototype (DTA, eXamine, Siemens Healthineers) to generate spectral segmentation and radiomic features over regions of interest along the entire length (volume) and separately at a single-section with maximum stenosis. Multiple logistic regressions and area under the receiver operating characteristic curve (AUC) were used for data analysis. RESULTS Among 85 patients, 22 ICA/CCAs had normal luminal dimensions and 148 ICA/CCAs had luminal stenosis (mild stenosis: 51, moderate: 38, severe: 59). For differentiating non-severe and severe ICA/CCA stenosis, radiomic features (volume: AUC=0.94, 95% CI 0.88-0.96; section: AUC=0.92, 95% CI 0.86-0.93) were significantly better than spectral segmentation features (volume: AUC = 0.86, 95% CI 0.74-0.87; section: AUC = 0.68, 95% CI 0.66-0.78) (P < .001). Spectral radiomic features predicted revascularization procedure (AUC = 0.77) and the presence of ipsilateral intra- cranial ischemic changes (AUC = 0.76). CONCLUSION Spectral segmentation and radiomic features from DECTA can differentiate patients with differ- ent luminal ICA/CCA stenosis grades.

Predictive values of AI-based triage model in suboptimal CT pulmonary angiography.

PURPOSE: We evaluated and compared performance of an acute pulmonary embolism (PE) triaging artificial intelligence (PE-AI) model in suboptimal and optimal CT pulmonary angiography (CTPA). METHODS: In an IRB approved, retrospective study we identified 104 consecutive, suboptimal CTPA which were deemed as suboptimal for PE evaluation in radiology reports due to motion, artifacts and/or inadequate contrast enhancement. We enriched this dataset, with additional 226 optimal CTPA (over same timeframe as suboptimal CTPA) with and without PE. Two thoracic radiologists (ground truth) independently reviewed all 330 CTPA for adequacy (to assess PE down to distal segmental level), reason for suboptimal CTPA (artifacts or poor contrast enhancement), as well as for presence and location of PE. CT values (HU) were measured in the main pulmonary artery. Same attributes were assessed in 80 patients who had repeat or follow-up CTPA following suboptimal CTPA. All CTPA were processed with the PE-AI (Aidoc). RESULTS: Among 104 suboptimal CTPA (mean age ± standard deviation 56 ± 15 years), 18/104 (17%) were misclassified as suboptimal for PE evaluation in their radiology reports but relabeled as optimal on ground truth evaluation. Of 226 optimal CTPA, 47 (21%) were reclassified as suboptimal CTPA. PEs were present in 97/330 CTPA. PE-AI had similar performance on suboptimal CTPA (sensitivity 100%; specificity 89%; AUC 0.89, 95% CI 0.80-0.98) and optimal CTPA (sensitivity 96%; specificity 92%; AUC 0.87, 95% CI 0.81-0.93). CONCLUSION: Suboptimal CTPA examinations do not impair the performance of PE-AI triage model; AI retains clinically meaningful sensitivity and high specificity regardless of diagnostic quality.

FDA-regulated AI Algorithms: Trends, Strengths, and Gaps of Validation Studies.

RATIONALE AND OBJECTIVES: To assess key trends, strengths, and gaps in validation studies of the Food and Drug Administration (FDA)-regulated imaging-based artificial intelligence/machine learning (AI/ML) algorithms. MATERIALS AND METHODS: We audited publicly available details of regulated AI/ML algorithms in imaging from 2008 until April 2021. We reviewed 127 regulated software (118 AI/ML) to classify information related to their parent company, subspecialty, body area and specific anatomy type, imaging modality, date of FDA clearance, indications for use, target pathology (such as trauma) and findings (such as fracture), technique (CAD triage, CAD detection and/or characterization, CAD acquisition or improvement, and image processing/quantification), product performance, presence, type, strength and availability of clinical validation data. Pertaining to validation data, where available, we recorded the number of patients or studies included, sensitivity, specificity, accuracy, and/or receiver operating characteristic area under the curve, along with information on ground-truthing of use-cases. Data were analyzed with pivot tables and charts for descriptive statistics and trends. RESULTS: We noted an increasing number of FDA-regulated AI/ML from 2008 to 2021. Seventeen (17/118) regulated AI/ML algorithms posted no validation claims or data. Just 9/118 reviewed AI/ML algorithms had a validation dataset sizes of over 1000 patients. The most common type of AI/ML included image processing/quantification (IPQ; n = 59/118), and triage (CADt; n = 27/118). Brain, breast, and lungs dominated the targeted body regions of interest. CONCLUSION: Insufficient public information on validation datasets in several FDA-regulated AI/ML algorithms makes it difficult to justify clinical applications since their generalizability and presence of bias cannot be inferred.

Characterization of Benign and Malignant Pancreatic Lesions with DECT Quantitative Metrics and Radiomics.

RATIONALE AND OBJECTIVES: To compare dual energy CT (DECT) quantitative metrics and radiomics for differentiating benign and malignant pancreatic lesions on contrast enhanced abdomen CT. MATERIALS AND METHODS: Our study included 103 patients who underwent contrast-enhanced DECT for assessing focal pancreatic lesions at one of the two hospitals (Site A: age 68 ± 12 yrs; malignant = 41, benign = 18; Site B: age 46 ± 2 yrs; malignant = 23, benign = 21). All malignant lesions had histologic confirmation, and benign lesions were stable on follow up CT (>12 months) or had characteristic benign features on MRI. Arterial-phase, low- and high-kV DICOM images were processed with the DECT Tumor Analysis (DETA) to obtain DECT quantitative metrics such as HU, iodine and water content from a region of interest (ROI) over focal pancreatic lesions. Separately, we obtained DECT radiomics from the same ROI. Data were analyzed with multiple logistic regression and receiver operating characteristics to generate area under the curve (AUC) for best predictive variables. RESULTS: DECT quantitative metrics and radiomics had AUCs of 0.98-0.99 at site A and 0.89-0.94 at site B data for classifying benign and malignant pancreatic lesions. There was no significant difference in the AUCs and accuracies of DECT quantitative metrics and radiomics from lesion rims and volumes among patients at both sites (p > 0.05). Supervised learning-based model with data from the two sites demonstrated best AUCs of 0.94 (DECT radiomics) and 0.90 (DECT quantitative metrics) for characterizing pancreatic lesions as benign or malignant. CONCLUSION: Compared to complex DECT radiomics, quantitative DECT information provide a simpler but accurate method of differentiating benign and malignant pancreatic lesions.

Artificial Intelligence has Similar Performance to Subjective Assessment of Emphysema Severity on Chest CT.

RATIONALE AND OBJECTIVES: To compare an artificial intelligence (AI)-based prototype and subjective grading for predicting disease severity in patients with emphysema. METHODS: Our IRB approved HIPAA-compliant study included 113 adults (71±8 years; 47 females, 66 males) who had both non-contrast chest CT and pulmonary function tests performed within a span of 2 months. The disease severity was classified based on the forced expiratory volume in 1 second (FEV1 as % of predicted) into mild, moderate, and severe. 2 thoracic radiologists (RA), blinded to the clinical and AI results, graded severity of emphysema on a 5-point scale suggested by the Fleischner Society for each lobe. The whole lung scores were derived from the summation of lobar scores. Thin-section CT images were processed with the AI-Rad Companion Chest prototype (Siemens Healthineers) to quantify low attenuation areas (LAA < - 950 HU) in whole lung and each lobe separately. Bronchial abnormality was assessed by both radiologists and a fully automated software (Philips Healthcare). RESULTS: Both AI (AUC of 0.77; 95% CI: 0.68 - 0.85) and RA (AUC: 0.76, 95% CI: 0.65 - 0.84) emphysema quantification could differentiate mild, moderate, and severe disease based on FEV1. There was a strong positive correlation between AI and RA (r = 0.72 - 0.80; p <0.001). The combination of emphysema and bronchial abnormality quantification from radiologists' and AI assessment could differentiate between different severities with AUC of 0.80 - 0.82 and 0.87, respectively. CONCLUSION: The assessed AI-prototypes can predict the disease severity in patients with emphysema with the same predictive value as the radiologists.

Effect of technologist and patient attributes on centering for body CT examinations: Influence of cultural and ethnic factors.

There are no published data on the effect of patient and technologist gender and ethnicity attributes on off-centering in CT. Therefore, we assessed the impact of patient and technologist variations on off-centering patients undergoing body CT. With institutional review board approval, our retrospective study included 1000 consecutive adult patients (age ranged 22-96 years; 756 males: 244 females) who underwent chest or abdomen CT examinations. We recorded patient (age, gender, nationality, body weight, height,), technologist gender, and scan-related (scanner vendor, body region imaged, scan length, CT dose index volume, dose length product) information. Lateral and anteroposterior (AP) diameters were recorded to calculate effective diameter and size-specific dose estimate (SSDE). Off-centering represented the distance between the anterior-posterior centers of the scan field of view and the patient at the level of carina (for chest CT) and iliac crest (for abdomen CT). About 76% of the patients (760/1000) were off-centered with greater off-centering for chest (22 mm) than for abdomen (15 mm). Although ethnicity or patient gender was not a significant determinant of off-centering, technologist-patient gender mismatch was associated with a significantly greater frequency of off-centering (p<0.001). Off-centering below the gantry isocenter was twice as common as off-centering above the gantry isocenter (p<0.001). The latter occurred more frequently in larger patients and was associated with higher radiation doses than those centered below the isocenter (p<0.001). Technologists' years of experience and patient factors profoundly affect the presence and extent of off-centering for both chest and abdomen CTs. Larger patients are more often off-centered than smaller patients.

Validation pipeline for machine learning algorithm assessment for multiple vendors.

A standardized objective evaluation method is needed to compare machine learning (ML) algorithms as these tools become available for clinical use. Therefore, we designed, built, and tested an evaluation pipeline with the goal of normalizing performance measurement of independently developed algorithms, using a common test dataset of our clinical imaging. Three vendor applications for detecting solid, part-solid, and groundglass lung nodules in chest CT examinations were assessed in this retrospective study using our data-preprocessing and algorithm assessment chain. The pipeline included tools for image cohort creation and de-identification; report and image annotation for ground-truth labeling; server partitioning to receive vendor "black box" algorithms and to enable model testing on our internal clinical data (100 chest CTs with 243 nodules) from within our security firewall; model validation and result visualization; and performance assessment calculating algorithm recall, precision, and receiver operating characteristic curves (ROC). Algorithm true positives, false positives, false negatives, recall, and precision for detecting lung nodules were as follows: Vendor-1 (194, 23, 49, 0.80, 0.89); Vendor-2 (182, 270, 61, 0.75, 0.40); Vendor-3 (75, 120, 168, 0.32, 0.39). The AUCs for detection of solid (0.61-0.74), groundglass (0.66-0.86) and part-solid (0.52-0.86) nodules varied between the three vendors. Our ML model validation pipeline enabled testing of multi-vendor algorithms within the institutional firewall. Wide variations in algorithm performance for detection as well as classification of lung nodules justifies the premise for a standardized objective ML algorithm evaluation process.

Using barium as an internal radioprotective shield for pregnant patients undergoing CT pulmonary angiography: A retrospective study.

PURPOSE: The purpose of our retrospective study was to assess the effect of barium sulfate contrast medium on radiation dose and diagnostic quality of CT Pulmonary Angiography (CTPA) in an in-vivo study of pregnant patients. METHODS: Our retrospective study included 33 pregnant patients who underwent CTPA to exclude pulmonary embolism. The patients received oral 40% w/v barium solution just prior to the acquisition of their planning radiograph. All CTPA were performed on 64-slice, single-source CT scanners with AEC with noise index = 28.62-31.64 and the allowed mA range of 100-450. However, only 5/33 patients had mA modulation (AEC 100-450 mA range), while 28/33 patients had mA maxed out at the set maximum mA of 450 over the entire scan range. We recorded CTDIvol (mGy), DLP (mGy.cm) and scan length. The same information was recorded in weight-and scanner-matched, non-pregnant patients. Statistical tests included descriptive data (median and interquartile range) and Mann-Whitney test. RESULTS: There were no significant differences in CTDIvol and DLP between the barium and control group patients (p > 0.1). The median mA below the diaphragm was significantly higher in each patient with barium compared to the weight and scanner-matched patient without barium. Evaluation of lung and subsegmental lower lobe pulmonary arteries was limited in 85% barium group. Due to thin prospective section thickness (1.25 mm), most patients were scanned at maximum allowed mA for AEC. CONCLUSION: Use of AEC with thick barium in pregnant patients undergoing CTPA as an internal radioprotective shield produces counterproductive artifacts and tube current increments.

Performance of a Chest Radiography AI Algorithm for Detection of Missed or Mislabeled Findings: A Multicenter Study.

Purpose: We assessed whether a CXR AI algorithm was able to detect missed or mislabeled chest radiograph (CXR) findings in radiology reports. Methods: We queried a multi-institutional radiology reports search database of 13 million reports to identify all CXR reports with addendums from 1999-2021. Of the 3469 CXR reports with an addendum, a thoracic radiologist excluded reports where addenda were created for typographic errors, wrong report template, missing sections, or uninterpreted signoffs. The remaining reports contained addenda (279 patients) with errors related to side-discrepancies or missed findings such as pulmonary nodules, consolidation, pleural effusions, pneumothorax, and rib fractures. All CXRs were processed with an AI algorithm. Descriptive statistics were performed to determine the sensitivity, specificity, and accuracy of the AI in detecting missed or mislabeled findings. Results: The AI had high sensitivity (96%), specificity (100%), and accuracy (96%) for detecting all missed and mislabeled CXR findings. The corresponding finding-specific statistics for the AI were nodules (96%, 100%, 96%), pneumothorax (84%, 100%, 85%), pleural effusion (100%, 17%, 67%), consolidation (98%, 100%, 98%), and rib fractures (87%, 100%, 94%). Conclusions: The CXR AI could accurately detect mislabeled and missed findings. Clinical Relevance: The CXR AI can reduce the frequency of errors in detection and side-labeling of radiographic findings.

Association of Artificial Intelligence-Aided Chest Radiograph Interpretation With Reader Performance and Efficiency.

Importance: The efficient and accurate interpretation of radiologic images is paramount. Objective: To evaluate whether a deep learning-based artificial intelligence (AI) engine used concurrently can improve reader performance and efficiency in interpreting chest radiograph abnormalities. Design, Setting, and Participants: This multicenter cohort study was conducted from April to November 2021 and involved radiologists, including attending radiologists, thoracic radiology fellows, and residents, who independently participated in 2 observer performance test sessions. The sessions included a reading session with AI and a session without AI, in a randomized crossover manner with a 4-week washout period in between. The AI produced a heat map and the image-level probability of the presence of the referrable lesion. The data used were collected at 2 quaternary academic hospitals in Boston, Massachusetts: Beth Israel Deaconess Medical Center (The Medical Information Mart for Intensive Care Chest X-Ray [MIMIC-CXR]) and Massachusetts General Hospital (MGH). Main Outcomes and Measures: The ground truths for the labels were created via consensual reading by 2 thoracic radiologists. Each reader documented their findings in a customized report template, in which the 4 target chest radiograph findings and the reader confidence of the presence of each finding was recorded. The time taken for reporting each chest radiograph was also recorded. Sensitivity, specificity, and area under the receiver operating characteristic curve (AUROC) were calculated for each target finding. Results: A total of 6 radiologists (2 attending radiologists, 2 thoracic radiology fellows, and 2 residents) participated in the study. The study involved a total of 497 frontal chest radiographs-247 from the MIMIC-CXR data set (demographic data for patients were not available) and 250 chest radiographs from MGH (mean [SD] age, 63 [16] years; 133 men [53.2%])-from adult patients with and without 4 target findings (pneumonia, nodule, pneumothorax, and pleural effusion). The target findings were found in 351 of 497 chest radiographs. The AI was associated with higher sensitivity for all findings compared with the readers (nodule, 0.816 [95% CI, 0.732-0.882] vs 0.567 [95% CI, 0.524-0.611]; pneumonia, 0.887 [95% CI, 0.834-0.928] vs 0.673 [95% CI, 0.632-0.714]; pleural effusion, 0.872 [95% CI, 0.808-0.921] vs 0.889 [95% CI, 0.862-0.917]; pneumothorax, 0.988 [95% CI, 0.932-1.000] vs 0.792 [95% CI, 0.756-0.827]). AI-aided interpretation was associated with significantly improved reader sensitivities for all target findings, without negative impacts on the specificity. Overall, the AUROCs of readers improved for all 4 target findings, with significant improvements in detection of pneumothorax and nodule. The reporting time with AI was 10% lower than without AI (40.8 vs 36.9 seconds; difference, 3.9 seconds; 95% CI, 2.9-5.2 seconds; P < .001). Conclusions and Relevance: These findings suggest that AI-aided interpretation was associated with improved reader performance and efficiency for identifying major thoracic findings on a chest radiograph.

Diagnostic Accuracy of Magnetic Resonance Cholangiopancreatography to Detect Benign and Malignant Biliary Strictures.

BACKGROUND: Magnetic resonance cholangiopancreatography (MRCP) is a noninvasive method to detect pancreaticobiliary strictures. In this study, we aimed to evaluate the diagnostic performance of MRCP and detect sensitive and specific radiologic features in distinguishing malignant and benign pathologies. MATERIALS AND METHODS: In this study, 50 patients with biliary obstruction and a confirmed diagnosis using histopathology were included. The pathologies were evaluated using MRCP which were categorized into malignant and benign strictures. The etiology of strictures was detected using histopathology and endoscopic retrograde cholangiopancreatography. The diagnostic performance of MRCP was calculated using SPSS software. P < 0.05 was considered statistically significant. RESULTS: Of 50 patients, 23 patients (46%) had malignant strictures based on MRCP and histopathology. The sensitivity and specificity of MRCP to detect malignancy were 95.7% and 96.3%, respectively. The most sensitive MRCP features to detect malignancy were upstream biliary duct dilation, abrupt tapering, and the presence of a solid mass with sensitivity 100%, 95.7%, and 78.2%, respectively. The malignancy rate was significantly higher in the strictures with length >11.5 mm or wall thickness >2.75 mm (P < 0.05). CONCLUSION: MRCP is a sensitive method to differentiate malignant lesions from benign pathologies. A long and thick stricture with the presence of a solid mass, upstream biliary duct dilation, and abrupt tapering is highly suggestive of malignancy.

Is High Preprocedural Renal Resistive Index Sensitive Enough to Predict Iodine Contrast-Induced Nephropathy in Patients Receiving Intra-Arterial Iodinate Contrast?

PURPOSE: Renal Resistive Index (RRI) is a newly introduced sonographic index in predicting contrast-induced nephropathy (CIN) development. It has been suggested that RRI > 0.69 should be considered as a risk factor for CIN development. The present study aimed to calculate the predictive value of RRI using a cutoff point of 0.69. METHODS: A total of 90 patients who were a candidate for coronary vessels angiography were enrolled in this study. Color Doppler ultrasonography was performed and RRI was measured. Patients were followed up for 48 hours after contrast media exposure for the CIN development. The diagnosis of CIN was based on a 25% relative rise or 0.5 mg/dL absolute rise in creatinine level. The predictive values of RRI were measured using 0.69 as a cutoff point. RESULTS: Out of 90 patients, CIN developed in 3 patients and 17 patients had preprocedural RRI > 0.69. Of 3 patients with CIN, 1 had RRI > 0.69. Using 0.69 as the cutoff point, the measured sensitivity and specificity of RRI were 33.3% and 83.9%, respectively. CONCLUSIONS: RRI > 0.69 is not a sensitive index in predicting the CIN development and cannot be used as an independent factor.