From Machine Learning to Patient Outcomes: A Comprehensive Review of AI in Pancreatic Cancer.

Pancreatic cancer is a highly aggressive and difficult-to-detect cancer with a poor prognosis. Late diagnosis is common due to a lack of early symptoms, specific markers, and the challenging location of the pancreas. Imaging technologies have improved diagnosis, but there is still room for improvement in standardizing guidelines. Biopsies and histopathological analysis are challenging due to tumor heterogeneity. Artificial Intelligence (AI) revolutionizes healthcare by improving diagnosis, treatment, and patient care. AI algorithms can analyze medical images with precision, aiding in early disease detection. AI also plays a role in personalized medicine by analyzing patient data to tailor treatment plans. It streamlines administrative tasks, such as medical coding and documentation, and provides patient assistance through AI chatbots. However, challenges include data privacy, security, and ethical considerations. This review article focuses on the potential of AI in transforming pancreatic cancer care, offering improved diagnostics, personalized treatments, and operational efficiency, leading to better patient outcomes.

Enrichment of lung cancer computed tomography collections with AI-derived annotations.

Public imaging datasets are critical for the development and evaluation of automated tools in cancer imaging. Unfortunately, many do not include annotations or image-derived features, complicating downstream analysis. Artificial intelligence-based annotation tools have been shown to achieve acceptable performance and can be used to automatically annotate large datasets. As part of the effort to enrich public data available within NCI Imaging Data Commons (IDC), here we introduce AI-generated annotations for two collections containing computed tomography images of the chest, NSCLC-Radiomics, and a subset of the National Lung Screening Trial. Using publicly available AI algorithms, we derived volumetric annotations of thoracic organs-at-risk, their corresponding radiomics features, and slice-level annotations of anatomical landmarks and regions. The resulting annotations are publicly available within IDC, where the DICOM format is used to harmonize the data and achieve FAIR (Findable, Accessible, Interoperable, Reusable) data principles. The annotations are accompanied by cloud-enabled notebooks demonstrating their use. This study reinforces the need for large, publicly accessible curated datasets and demonstrates how AI can aid in cancer imaging.

Expert-centered Evaluation of Deep Learning Algorithms for Brain Tumor Segmentation.

Purpose To present results from a literature survey on practices in deep learning segmentation algorithm evaluation and perform a study on expert quality perception of brain tumor segmentation. Materials and Methods A total of 180 articles reporting on brain tumor segmentation algorithms were surveyed for the reported quality evaluation. Additionally, ratings of segmentation quality on a four-point scale were collected from medical professionals for 60 brain tumor segmentation cases. Results Of the surveyed articles, Dice score, sensitivity, and Hausdorff distance were the most popular metrics to report segmentation performance. Notably, only 2.8% of the articles included clinical experts' evaluation of segmentation quality. The experimental results revealed a low interrater agreement (Krippendorff α, 0.34) in experts' segmentation quality perception. Furthermore, the correlations between the ratings and commonly used quantitative quality metrics were low (Kendall tau between Dice score and mean rating, 0.23; Kendall tau between Hausdorff distance and mean rating, 0.51), with large variability among the experts. Conclusion The results demonstrate that quality ratings are prone to variability due to the ambiguity of tumor boundaries and individual perceptual differences, and existing metrics do not capture the clinical perception of segmentation quality. Keywords: Brain Tumor Segmentation, Deep Learning Algorithms, Glioblastoma, Cancer, Machine Learning Clinical trial registration nos. NCT00756106 and NCT00662506 Supplemental material is available for this article. © RSNA, 2023.

Not without Context-A Multiple Methods Study on Evaluation and Correction of Automated Brain Tumor Segmentations by Experts.

RATIONALE AND OBJECTIVES: Brain tumor segmentations are integral to the clinical management of patients with glioblastoma, the deadliest primary brain tumor in adults. The manual delineation of tumors is time-consuming and highly provider-dependent. These two problems must be addressed by introducing automated, deep-learning-based segmentation tools. This study aimed to identify criteria experts use to evaluate the quality of automatically generated segmentations and their thought processes as they correct them. MATERIALS AND METHODS: Multiple methods were used to develop a detailed understanding of the complex factors that shape experts' perception of segmentation quality and their thought processes in correcting proposed segmentations. Data from a questionnaire and semistructured interview with neuro-oncologists and neuroradiologists were collected between August and December 2021 and analyzed using a combined deductive and inductive approach. RESULTS: Brain tumors are highly complex and ambiguous segmentation targets. Therefore, physicians rely heavily on the given context related to the patient and clinical context in evaluating the quality and need to correct brain tumor segmentation. Most importantly, the intended clinical application determines the segmentation quality criteria and editing decisions. Physicians' personal beliefs and preferences about the capabilities of AI algorithms and whether questionable areas should not be included are additional criteria influencing the perception of segmentation quality and appearance of an edited segmentation. CONCLUSION: Our findings on experts' perceptions of segmentation quality will allow the design of improved frameworks for expert-centered evaluation of brain tumor segmentation models. In particular, the knowledge presented here can inspire the development of brain tumor-specific metrics for segmentation model training and evaluation.

Machine learning-based detection of sarcopenic obesity and association with adverse outcomes in patients undergoing surgical treatment for spinal metastases.

OBJECTIVE: The distributions and proportions of lean and fat tissues may help better assess the prognosis and outcomes of patients with spinal metastases. Specifically, in obese patients, sarcopenia may be easily overlooked as a poor prognostic indicator. The role of this body phenotype, sarcopenic obesity (SO), has not been adequately studied among patients undergoing surgical treatment for spinal metastases. To this end, here the authors investigated the role of SO as a potential prognostic factor in patients undergoing surgical treatment for spinal metastases. METHODS: The authors identified patients who underwent surgical treatment for spinal metastases between 2010 and 2020. A validated deep learning approach evaluated sarcopenia and adiposity on routine preoperative CT images. Based on composition analyses, patients were classified with SO or nonsarcopenic obesity. After nearest-neighbor propensity matching that accounted for confounders, the authors compared the rates and odds of postoperative complications, length of stay, 30-day readmission, and all-cause mortality at 90 days and 1 year between the SO and nonsarcopenic obesity groups. RESULTS: A total of 62 patients with obesity underwent surgical treatment for spinal metastases during the study period. Of these, 37 patients had nonsarcopenic obesity and 25 had SO. After propensity matching, 50 records were evaluated that were equally composed of patients with nonsarcopenic obesity and SO (25 patients each). Patients with SO were noted to have increased odds of nonhome discharge (OR 6.0, 95% CI 1.69-21.26), 30-day readmission (OR 3.27, 95% CI 1.01-10.62), and 90-day (OR 4.85, 95% CI 1.29-18.26) and 1-year (OR 3.78, 95% CI 1.17-12.19) mortality, as well as increased time to mortality after surgery (12.60 ± 19.84 months vs 37.16 ± 35.19 months, p = 0.002; standardized mean difference 0.86). No significant differences were noted in terms of length of stay or postoperative complications when comparing the two groups (p > 0.05). CONCLUSIONS: The SO phenotype was associated with increased odds of nonhome discharge, readmission, and postoperative mortality. This study suggests that SO may be an important prognostic factor to consider when developing care plans for patients with spinal metastases.

The influence of anisotropy on the clinical target volume of brain tumor patients.

Objective.Current radiotherapy guidelines for glioma target volume definition recommend a uniform margin expansion from the gross tumor volume (GTV) to the clinical target volume (CTV), assuming uniform infiltration in the invaded brain tissue. However, glioma cells migrate preferentially along white matter tracts, suggesting that white matter directionality should be considered in an anisotropic CTV expansion. We investigate two models of anisotropic CTV expansion and evaluate their clinical feasibility.Approach.To incorporate white matter directionality into the CTV, a diffusion tensor imaging (DTI) atlas is used. The DTI atlas consists of water diffusion tensors that are first spatially transformed into local tumor resistance tensors, also known as metric tensors, and secondly fed to a CTV expansion algorithm to generate anisotropic CTVs. Two models of spatial transformation are considered in the first step. The first model assumes that tumor cells experience reduced resistance parallel to the white matter fibers. The second model assumes that the anisotropy of tumor cell resistance is proportional to the anisotropy observed in DTI, with an 'anisotropy weighting parameter' controlling the proportionality. The models are evaluated in a cohort of ten brain tumor patients.Main results.To evaluate the sensitivity of the model, a library of model-generated CTVs was computed by varying the resistance and anisotropy parameters. Our results indicate that the resistance coefficient had the most significant effect on the global shape of the CTV expansion by redistributing the target volume from potentially less involved gray matter to white matter tissue. In addition, the anisotropy weighting parameter proved useful in locally increasing CTV expansion in regions characterized by strong tissue directionality, such as near the corpus callosum.Significance.By incorporating anisotropy into the CTV expansion, this study is a step toward an interactive CTV definition that can assist physicians in incorporating neuroanatomy into a clinically optimized CTV.

Abnormal vascular structure and function within brain metastases is linked to pembrolizumab resistance.

BACKGROUND: We recently conducted a phase 2 trial (NCT028865685) evaluating intracranial efficacy of pembrolizumab for brain metastases (BM) of diverse histologies. Our study met its primary efficacy endpoint and illustrates that pembrolizumab exerts promising activity in a select group of patients with BM. Given the importance of aberrant vasculature in mediating immunosuppression, we explored the relationship between checkpoint inhibitor (ICI) efficacy and vascular architecture in the hopes of identifying potential mechanisms of intracranial ICI response or resistance for BM. METHODS: Using Vessel Architectural Imaging (VAI), a histologically validated quantitative metric for in vivo tumor vascular physiology, we analyzed dual echo DSC/DCE MRI for 44 patients on trial. Tumor and peri-tumor cerebral blood volume/flow, vessel size, arterial- and venous-dominance, and vascular permeability were measured before and after treatment with pembrolizumab. RESULTS: BM that progressed on ICI were characterized by a highly aberrant vasculature dominated by large-caliber vessels. In contrast, ICI-responsive BM possessed a more structurally balanced vasculature consisting of both small and large vessels, and there was a trend towards a decrease in under-perfused tissue, suggesting a reversal of the negative effects of hypoxia. In the peri-tumor region, development of smaller blood vessels, consistent with neo-angiogenesis, was associated with tumor growth before radiographic evidence of contrast enhancement on anatomical MRI. CONCLUSIONS: This study, one of the largest functional imaging studies for BM, suggests that vascular architecture is linked with ICI efficacy. Studies identifying modulators of vascular architecture, and effects on immune activity, are warranted and may inform future combination treatments.

Structural and functional vascular dysfunction within brain metastases is linked to pembrolizumab inefficacy.

Structurally and functionally aberrant vasculature is a hallmark of tumor angiogenesis and treatment resistance. Given the synergistic link between aberrant tumor vasculature and immunosuppression, we analyzed perfusion MRI for 44 patients with brain metastases (BM) undergoing treatment with pembrolizumab. To date, vascular-immune communication, or the relationship between immune checkpoint inhibitor (ICI) efficacy and vascular architecture, has not been well-characterized in human imaging studies. We found that ICI-responsive BM possessed a structurally balanced vascular makeup, which was linked to improved vascular efficiency and an immune-stimulatory microenvironment. In contrast, ICI-resistant BM were characterized by a lack of immune cell infiltration and a highly aberrant vasculature dominated by large-caliber vessels. Peri-tumor region analysis revealed early functional changes predictive of ICI resistance before radiographic evidence on conventional MRI. This study was one of the largest functional imaging studies for BM and establishes a foundation for functional studies that illuminate the mechanisms linking patterns of vascular architecture with immunosuppression, as targeting these aspects of cancer biology may serve as the basis for future combination treatments.

Body composition and lung cancer-associated cachexia in TRACERx.

Cancer-associated cachexia (CAC) is a major contributor to morbidity and mortality in individuals with non-small cell lung cancer. Key features of CAC include alterations in body composition and body weight. Here, we explore the association between body composition and body weight with survival and delineate potential biological processes and mediators that contribute to the development of CAC. Computed tomography-based body composition analysis of 651 individuals in the TRACERx (TRAcking non-small cell lung Cancer Evolution through therapy (Rx)) study suggested that individuals in the bottom 20th percentile of the distribution of skeletal muscle or adipose tissue area at the time of lung cancer diagnosis, had significantly shorter lung cancer-specific survival and overall survival. This finding was validated in 420 individuals in the independent Boston Lung Cancer Study. Individuals classified as having developed CAC according to one or more features at relapse encompassing loss of adipose or muscle tissue, or body mass index-adjusted weight loss were found to have distinct tumor genomic and transcriptomic profiles compared with individuals who did not develop such features. Primary non-small cell lung cancers from individuals who developed CAC were characterized by enrichment of inflammatory signaling and epithelial-mesenchymal transitional pathways, and differentially expressed genes upregulated in these tumors included cancer-testis antigen MAGEA6 and matrix metalloproteinases, such as ADAMTS3. In an exploratory proteomic analysis of circulating putative mediators of cachexia performed in a subset of 110 individuals from TRACERx, a significant association between circulating GDF15 and loss of body weight, skeletal muscle and adipose tissue was identified at relapse, supporting the potential therapeutic relevance of targeting GDF15 in the management of CAC.

Head CT deep learning model is highly accurate for early infarct estimation.

Non-contrast head CT (NCCT) is extremely insensitive for early (< 3-6 h) acute infarct identification. We developed a deep learning model that detects and delineates suspected early acute infarcts on NCCT, using diffusion MRI as ground truth (3566 NCCT/MRI training patient pairs). The model substantially outperformed 3 expert neuroradiologists on a test set of 150 CT scans of patients who were potential candidates for thrombectomy (60 stroke-negative, 90 stroke-positive middle cerebral artery territory only infarcts), with sensitivity 96% (specificity 72%) for the model versus 61-66% (specificity 90-92%) for the experts; model infarct volume estimates also strongly correlated with those of diffusion MRI (r2 > 0.98). When this 150 CT test set was expanded to include a total of 364 CT scans with a more heterogeneous distribution of infarct locations (94 stroke-negative, 270 stroke-positive mixed territory infarcts), model sensitivity was 97%, specificity 99%, for detection of infarcts larger than the 70 mL volume threshold used for patient selection in several major randomized controlled trials of thrombectomy treatment.

Utility of Normalized Body Composition Areas, Derived From Outpatient Abdominal CT Using a Fully Automated Deep Learning Method, for Predicting Subsequent Cardiovascular Events.

BACKGROUND. CT-based body composition (BC) measurements have historically been too resource intensive to analyze for widespread use and have lacked robust comparison with traditional weight metrics for predicting cardiovascular risk. OBJECTIVE. The aim of this study was to determine whether BC measurements obtained from routine CT scans by use of a fully automated deep learning algorithm could predict subsequent cardiovascular events independently from weight, BMI, and additional cardiovascular risk factors. METHODS. This retrospective study included 9752 outpatients (5519 women and 4233 men; mean age, 53.2 years; 890 patients self-reported their race as Black and 8862 self-reported their race as White) who underwent routine abdominal CT at a single health system from January 2012 through December 2012 and who were given no major cardiovascular or oncologic diagnosis within 3 months of undergoing CT. Using publicly available code, fully automated deep learning BC analysis was performed at the L3 vertebral body level to determine three BC areas (skeletal muscle area [SMA], visceral fat area [VFA], and subcutaneous fat area [SFA]). Age-, sex-, and race-normalized reference curves were used to generate z scores for the three BC areas. Subsequent myocardial infarction (MI) or stroke was determined from the electronic medical record. Multivariable-adjusted Cox proportional hazards models were used to determine hazard ratios (HRs) for MI or stroke within 5 years after CT for the three BC area z scores, with adjustment for normalized weight, normalized BMI, and additional cardiovascular risk factors (smoking status, diabetes diagnosis, and systolic blood pressure). RESULTS. In multivariable models, age-, race-, and sex-normalized VFA was associated with subsequent MI risk (HR of highest quartile compared with lowest quartile, 1.31 [95% CI, 1.03-1.67], p = .04 for overall effect) and stroke risk (HR of highest compared with lowest quartile, 1.46 [95% CI, 1.07-2.00], p = .04 for overall effect). In multivariable models, normalized SMA, SFA, weight, and BMI were not associated with subsequent MI or stroke risk. CONCLUSION. VFA derived from fully automated and normalized analysis of abdominal CT examinations predicts subsequent MI or stroke in Black and White patients, independent of traditional weight metrics, and should be considered an adjunct to BMI in risk models. CLINICAL IMPACT. Fully automated and normalized BC analysis of abdominal CT has promise to augment traditional cardiovascular risk prediction models.

Machine Learning for Adrenal Gland Segmentation and Classification of Normal and Adrenal Masses at CT.

Background Adrenal masses are common, but radiology reporting and recommendations for management can be variable. Purpose To create a machine learning algorithm to segment adrenal glands on contrast-enhanced CT images and classify glands as normal or mass-containing and to assess algorithm performance. Materials and Methods This retrospective study included two groups of contrast-enhanced abdominal CT examinations (development data set and secondary test set). Adrenal glands in the development data set were manually segmented by radiologists. Images in both the development data set and the secondary test set were manually classified as normal or mass-containing. Deep learning segmentation and classification models were trained on the development data set and evaluated on both data sets. Segmentation performance was evaluated with use of the Dice similarity coefficient (DSC), and classification performance with use of sensitivity and specificity. Results The development data set contained 274 CT examinations (251 patients; median age, 61 years; 133 women), and the secondary test set contained 991 CT examinations (991 patients; median age, 62 years; 578 women). The median model DSC on the development test set was 0.80 (IQR, 0.78-0.89) for normal glands and 0.84 (IQR, 0.79-0.90) for adrenal masses. On the development reader set, the median interreader DSC was 0.89 (IQR, 0.78-0.93) for normal glands and 0.89 (IQR, 0.85-0.97) for adrenal masses. Interreader DSC for radiologist manual segmentation did not differ from automated machine segmentation (P = .35). On the development test set, the model had a classification sensitivity of 83% (95% CI: 55, 95) and specificity of 89% (95% CI: 75, 96). On the secondary test set, the model had a classification sensitivity of 69% (95% CI: 58, 79) and specificity of 91% (95% CI: 90, 92). Conclusion A two-stage machine learning pipeline was able to segment the adrenal glands and differentiate normal adrenal glands from those containing masses. © RSNA, 2022 Online supplemental material is available for this article.

Improving the repeatability of deep learning models with Monte Carlo dropout.

The integration of artificial intelligence into clinical workflows requires reliable and robust models. Repeatability is a key attribute of model robustness. Ideal repeatable models output predictions without variation during independent tests carried out under similar conditions. However, slight variations, though not ideal, may be unavoidable and acceptable in practice. During model development and evaluation, much attention is given to classification performance while model repeatability is rarely assessed, leading to the development of models that are unusable in clinical practice. In this work, we evaluate the repeatability of four model types (binary classification, multi-class classification, ordinal classification, and regression) on images that were acquired from the same patient during the same visit. We study the each model's performance on four medical image classification tasks from public and private datasets: knee osteoarthritis, cervical cancer screening, breast density estimation, and retinopathy of prematurity. Repeatability is measured and compared on ResNet and DenseNet architectures. Moreover, we assess the impact of sampling Monte Carlo dropout predictions at test time on classification performance and repeatability. Leveraging Monte Carlo predictions significantly increases repeatability, in particular at the class boundaries, for all tasks on the binary, multi-class, and ordinal models leading to an average reduction of the 95% limits of agreement by 16% points and of the class disagreement rate by 7% points. The classification accuracy improves in most settings along with the repeatability. Our results suggest that beyond about 20 Monte Carlo iterations, there is no further gain in repeatability. In addition to the higher test-retest agreement, Monte Carlo predictions are better calibrated which leads to output probabilities reflecting more accurately the true likelihood of being correctly classified.

Highdicom: a Python Library for Standardized Encoding of Image Annotations and Machine Learning Model Outputs in Pathology and Radiology.

Machine learning (ML) is revolutionizing image-based diagnostics in pathology and radiology. ML models have shown promising results in research settings, but the lack of interoperability between ML systems and enterprise medical imaging systems has been a major barrier for clinical integration and evaluation. The DICOM® standard specifies information object definitions (IODs) and services for the representation and communication of digital images and related information, including image-derived annotations and analysis results. However, the complexity of the standard represents an obstacle for its adoption in the ML community and creates a need for software libraries and tools that simplify working with datasets in DICOM format. Here we present the highdicom library, which provides a high-level application programming interface (API) for the Python programming language that abstracts low-level details of the standard and enables encoding and decoding of image-derived information in DICOM format in a few lines of Python code. The highdicom library leverages NumPy arrays for efficient data representation and ties into the extensive Python ecosystem for image processing and machine learning. Simultaneously, by simplifying creation and parsing of DICOM-compliant files, highdicom achieves interoperability with the medical imaging systems that hold the data used to train and run ML models, and ultimately communicate and store model outputs for clinical use. We demonstrate through experiments with slide microscopy and computed tomography imaging, that, by bridging these two ecosystems, highdicom enables developers and researchers to train and evaluate state-of-the-art ML models in pathology and radiology while remaining compliant with the DICOM standard and interoperable with clinical systems at all stages. To promote standardization of ML research and streamline the ML model development and deployment process, we made the library available free and open-source at https://github.com/herrmannlab/highdicom .

Evaluating frailty, mortality, and complications associated with metastatic spine tumor surgery using machine learning-derived body composition analysis.

OBJECTIVE: Cancer patients with spinal metastases may undergo surgery without clear assessments of prognosis, thereby impacting the optimal palliative strategy. Because the morbidity of surgery may adversely impact recovery and initiation of adjuvant therapies, evaluation of risk factors associated with mortality risk and complications is critical. Evaluation of body composition of cancer patients as a surrogate for frailty is an emerging area of study for improving preoperative risk stratification. METHODS: To examine the associations of muscle characteristics and adiposity with postoperative complications, length of stay, and mortality in patients with spinal metastases, the authors designed an observational study of 484 cancer patients who received surgical treatment for spinal metastases between 2010 and 2019. Sarcopenia, muscle radiodensity, visceral adiposity, and subcutaneous adiposity were assessed on routinely available 3-month preoperative CT images by using a validated deep learning methodology. The authors used k-means clustering analysis to identify patients with similar body composition characteristics. Regression models were used to examine the associations of sarcopenia, frailty, and clusters with the outcomes of interest. RESULTS: Of 484 patients enrolled, 303 had evaluable CT data on muscle and adiposity (mean age 62.00 ± 11.91 years; 57.8% male). The authors identified 2 clusters with significantly different body composition characteristics and mortality risks after spine metastases surgery. Patients in cluster 2 (high-risk cluster) had lower muscle mass index (mean ± SD 41.16 ± 7.99 vs 50.13 ± 10.45 cm2/m2), lower subcutaneous fat area (147.62 ± 57.80 vs 289.83 ± 109.31 cm2), lower visceral fat area (82.28 ± 48.96 vs 239.26 ± 98.40 cm2), higher muscle radiodensity (35.67 ± 9.94 vs 31.13 ± 9.07 Hounsfield units [HU]), and significantly higher risk of 1-year mortality (adjusted HR 1.45, 95% CI 1.05-2.01, p = 0.02) than individuals in cluster 1 (low-risk cluster). Decreased muscle mass, muscle radiodensity, and adiposity were not associated with a higher rate of complications after surgery. Prolonged length of stay (> 7 days) was associated with low muscle radiodensity (mean 30.87 vs 35.23 HU, 95% CI 1.98-6.73, p < 0.001). CONCLUSIONS: Body composition analysis shows promise for better risk stratification of patients with spinal metastases under consideration for surgery. Those with lower muscle mass and subcutaneous and visceral adiposity are at greater risk for inferior outcomes.

A Fully Automated Deep Learning Pipeline for Multi-Vertebral Level Quantification and Characterization of Muscle and Adipose Tissue on Chest CT Scans.

Body composition on chest CT scans encompasses a set of important imaging biomarkers. This study developed and validated a fully automated analysis pipeline for multi-vertebral level assessment of muscle and adipose tissue on routine chest CT scans. This study retrospectively trained two convolutional neural networks on 629 chest CT scans from 629 patients (55% women; mean age, 67 years ± 10 [standard deviation]) obtained between 2014 and 2017 prior to lobectomy for primary lung cancer at three institutions. A slice-selection network was developed to identify an axial image at the level of the fifth, eighth, and 10th thoracic vertebral bodies. A segmentation network (U-Net) was trained to segment muscle and adipose tissue on an axial image. Radiologist-guided manual-level selection and segmentation generated ground truth. The authors then assessed the predictive performance of their approach for cross-sectional area (CSA) (in centimeters squared) and attenuation (in Hounsfield units) on an independent test set. For the pipeline, median absolute error and intraclass correlation coefficients for both tissues were 3.6% (interquartile range, 1.3%-7.0%) and 0.959-0.998 for the CSA and 1.0 HU (interquartile range, 0.0-2.0 HU) and 0.95-0.99 for median attenuation. This study demonstrates accurate and reliable fully automated multi-vertebral level quantification and characterization of muscle and adipose tissue on routine chest CT scans. Keywords: Skeletal Muscle, Adipose Tissue, CT, Chest, Body Composition Analysis, Convolutional Neural Network (CNN), Supervised Learning Supplemental material is available for this article. © RSNA, 2022.

Development and clinical application of a deep learning model to identify acute infarct on magnetic resonance imaging.

Stroke is a leading cause of death and disability. The ability to quickly identify the presence of acute infarct and quantify the volume on magnetic resonance imaging (MRI) has important treatment implications. We developed a machine learning model that used the apparent diffusion coefficient and diffusion weighted imaging series. It was trained on 6,657 MRI studies from Massachusetts General Hospital (MGH; Boston, USA). All studies were labelled positive or negative for infarct (classification annotation) with 377 having the region of interest outlined (segmentation annotation). The different annotation types facilitated training on more studies while not requiring the extensive time to manually segment every study. We initially validated the model on studies sequestered from the training set. We then tested the model on studies from three clinical scenarios: consecutive stroke team activations for 6-months at MGH, consecutive stroke team activations for 6-months at a hospital that did not provide training data (Brigham and Women's Hospital [BWH]; Boston, USA), and an international site (Diagnósticos da América SA [DASA]; Brazil). The model results were compared to radiologist ground truth interpretations. The model performed better when trained on classification and segmentation annotations (area under the receiver operating curve [AUROC] 0.995 [95% CI 0.992-0.998] and median Dice coefficient for segmentation overlap of 0.797 [IQR 0.642-0.861]) compared to segmentation annotations alone (AUROC 0.982 [95% CI 0.972-0.990] and Dice coefficient 0.776 [IQR 0.584-0.857]). The model accurately identified infarcts for MGH stroke team activations (AUROC 0.964 [95% CI 0.943-0.982], 381 studies), BWH stroke team activations (AUROC 0.981 [95% CI 0.966-0.993], 247 studies), and at DASA (AUROC 0.998 [95% CI 0.993-1.000], 171 studies). The model accurately segmented infarcts with Pearson correlation comparing model output and ground truth volumes between 0.968 and 0.986 for the three scenarios. Acute infarct can be accurately detected and segmented on MRI in real-world clinical scenarios using a machine learning model.

Multilevel Body Composition Analysis on Chest Computed Tomography Predicts Hospital Length of Stay and Complications After Lobectomy for Lung Cancer: A Multicenter Study.

OBJECTIVE: To investigate the impact of thoracic body composition on outcomes after lobectomy for lung cancer. SUMMARY AND BACKGROUND DATA: Preoperative identification of patients at risk for adverse outcomes permits treatment modification. The impact of body composition on lung resection outcomes has not been investigated in a multicenter setting. METHODS: A total of 958 consecutive patients undergoing lobectomy for lung cancer at 3 centers from 2014 to 2017 were retrospectively analyzed. Muscle and adipose tissue cross-sectional area at the fifth, eighth, and tenth thoracic vertebral body was quantified. Prospectively collected outcomes from a national database were abstracted to characterize the association between sums of muscle and adipose tissue and hospital length of stay (LOS), number of any postoperative complications, and number of respiratory postoperative complications using multivariate regression. A priori determined covariates were forced expiratory volume in 1 second and diffusion capacity of the lungs for carbon monoxide predicted, age, sex, body mass index, race, surgical approach, smoking status, Zubrod and American Society of Anesthesiologists scores. RESULTS: Mean patient age was 67 years, body mass index 27.4 kg/m2 and 65% had stage i disease. Sixty-three percent underwent minimally invasive lobectomy. Median LOS was 4 days and 34% of patients experienced complications. Muscle (using 30 cm2 increments) was an independent predictor of LOS (adjusted coefficient 0.972; P = 0.002), any postoperative complications (odds ratio 0.897; P = 0.007) and postoperative respiratory complications (odds ratio 0.860; P = 0.010). Sarcopenic obesity was also associated with LOS and adverse outcomes. CONCLUSIONS: Body composition on preoperative chest computed tomography is an independent predictor of LOS and postoperative complications after lobectomy for lung cancer.

The Trials and Tribulations of Assembling Large Medical Imaging Datasets for Machine Learning Applications.

With vast interest in machine learning applications, more investigators are proposing to assemble large datasets for machine learning applications. We aim to delineate multiple possible roadblocks to exam retrieval that may present themselves and lead to significant time delays. This HIPAA-compliant, institutional review board-approved, retrospective clinical study required identification and retrieval of all outpatient and emergency patients undergoing abdominal and pelvic computed tomography (CT) at three affiliated hospitals in the year 2012. If a patient had multiple abdominal CT exams, the first exam was selected for retrieval (n=23,186). Our experience in attempting to retrieve 23,186 abdominal CT exams yielded 22,852 valid CT abdomen/pelvis exams and identified four major categories of challenges when retrieving large datasets: cohort selection and processing, retrieving DICOM exam files from PACS, data storage, and non-recoverable failures. The retrieval took 3 months of project time and at minimum 300 person-hours of time between the primary investigator (a radiologist), a data scientist, and a software engineer. Exam selection and retrieval may take significantly longer than planned. We share our experience so that other investigators can anticipate and plan for these challenges. We also hope to help institutions better understand the demands that may be placed on their infrastructure by large-scale medical imaging machine learning projects.

ECGAug: A novel method of generating augmented annotated electrocardiogram QRST complexes and rhythm strips.

Applications of neural networks (NNs) in medicine have increased dramatically in recent years. In order to train a NN that performs ECG segmentation, it can be very time consuming, or even completely prohibitive, to manually annotate fiducial points on enough QRST complexes to reach a high level of performance. Existing methods for time series data augmentation risk creating non-physiological ECG signals that may hamper NN training, and are unable to provide accurate fiducial point locations in the augmented data. We therefore developed ECGAug, a new method which generates an augmented training set of QRST signals (single beats or rhythm strips) with accurate fiducial point annotations. Our algorithm recombines a library of existing, annotated QRS complexes and T waves in physiologic ways, and then performs additional physiological transformations to generate a set of new annotated QRST complexes or rhythm strips to be used for NN training or validation of ECG annotation algorithms. In experiments where we trained NNs to annotate QRST complexes with a limited training dataset, QRST complexes added to the training dataset by ECGAug significantly improved NN performance. We present the ECGAug process, demonstrate its efficacy, and provide links for downloading the open source ECGAug software.