Artificial intelligence image-based prediction models in IBD exhibit high risk of bias: A systematic review.

BACKGROUND: There has been an increase in the development of both machine learning (ML) and deep learning (DL) prediction models in Inflammatory Bowel Disease. We aim in this systematic review to assess the methodological quality and risk of bias of ML and DL IBD image-based prediction studies. METHODS: We searched three databases, PubMed, Scopus and Embase, to identify ML and DL diagnostic or prognostic predictive models using imaging data in IBD, to Dec 31, 2022. We restricted our search to include studies that primarily used conventional imaging data, were undertaken in human participants, and published in English. Two reviewers independently reviewed the abstracts. The methodological quality of the studies was determined, and risk of bias evaluated using the prediction risk of bias assessment tool (PROBAST). RESULTS: Forty studies were included, thirty-nine developed diagnostic models. Seven studies utilized ML approaches, six were retrospective and none used multicenter data for model development. Thirty-three studies utilized DL approaches, ten were prospective, and twelve multicenter studies. Overall, all studies demonstrated high risk of bias. ML studies were evaluated in 4 domains all rated as high risk of bias: participants (6/7), predictors (1/7), outcome (3/7), and analysis (7/7), and DL studies evaluated in 3 domains: participants (24/33), outcome (10/33), and analysis (18/33). The majority of image-based studies used colonoscopy images. CONCLUSION: The risk of bias was high in AI IBD image-based prediction models, owing to insufficient sample size, unreported missingness and lack of an external validation cohort. Models with a high risk of bias are unlikely to be generalizable and suitable for clinical implementation.

Using Deep Learning to Automate Eosinophil Counting in Pediatric Ulcerative Colitis Histopathological Images.

Background: Accurate identification of inflammatory cells from mucosal histopathology images is important in diagnosing ulcerative colitis. The identification of eosinophils in the colonic mucosa has been associated with disease course. Cell counting is not only time-consuming but can also be subjective to human biases. In this study we developed an automatic eosinophilic cell counting tool from mucosal histopathology images, using deep learning. Method: Four pediatric IBD pathologists from two North American pediatric hospitals annotated 530 crops from 143 standard-of-care hematoxylin and eosin (H & E) rectal mucosal biopsies. A 305/75 split was used for training/validation to develop and optimize a U-Net based deep learning model, and 150 crops were used as a test set. The U-Net model was then compared to SAU-Net, a state-of-the-art U-Net variant. We undertook post-processing steps, namely, (1) the pixel-level probability threshold, (2) the minimum number of clustered pixels to designate a cell, and (3) the connectivity. Experiments were run to optimize model parameters using AUROC and cross-entropy loss as the performance metrics. Results: The F1-score was 0.86 (95%CI:0.79-0.91) (Precision: 0.77 (95%CI:0.70-0.83), Recall: 0.96 (95%CI:0.93-0.99)) to identify eosinophils as compared to an F1-score of 0.2 (95%CI:0.13-0.26) for SAU-Net (Precision: 0.38 (95%CI:0.31-0.46), Recall: 0.13 (95%CI:0.08-0.19)). The inter-rater reliability was 0.96 (95%CI:0.93-0.97). The correlation between two pathologists and the algorithm was 0.89 (95%CI:0.82-0.94) and 0.88 (95%CI:0.80-0.94) respectively. Conclusion: Our results indicate that deep learning-based automated eosinophilic cell counting can obtain a robust level of accuracy with a high degree of concordance with manual expert annotations.

Accessible chromatin maps of inflammatory bowel disease intestine nominate cell-type mediators of genetic disease risk.

Inflammatory Bowel Disease ( IBD ) is a chronic and often debilitating autoinflammatory condition, with an increasing incidence in children. Standard-of-care therapies lead to sustained transmural healing and clinical remission in fewer than one-third of patients. For children, TNFα inhibition remains the only FDA-approved biologic therapy, providing an even greater urgency to understanding mechanisms of response. Genome-wide association studies ( GWAS ) have identified 418 independent genetic risk loci contributing to IBD, yet the majority are noncoding and their mechanisms of action are difficult to decipher. If causal, they likely alter transcription factor ( TF ) binding and downstream gene expression in particular cell types and contexts. To bridge this knowledge gap, we built a novel resource: multiome-seq (tandem single-nuclei ( sn )RNA-seq and chromatin accessibility ( snATAC )-seq) of intestinal tissue from pediatric IBD patients, where anti-TNF response was defined by endoscopic healing. From the snATAC-seq data, we generated a first-time atlas of chromatin accessibility (putative regulatory elements) for diverse intestinal cell types in the context of IBD. For cell types/contexts mediating genetic risk, we reasoned that accessible chromatin will co-localize with genetic disease risk loci. We systematically tested for significant co-localization of our chromatin accessibility maps and risk variants for 758 GWAS traits. Globally, genetic risk variants for IBD, autoimmune and inflammatory diseases are enriched in accessible chromatin of immune populations, while other traits (e.g., colorectal cancer, metabolic) are enriched in epithelial and stromal populations. This resource opens new avenues to uncover the complex molecular and cellular mechanisms mediating genetic disease risk.