Reliability of Intestinal Ultrasound for Evaluating Crohn's Disease Activity Using Point-of-care and Central Reading.

BACKGROUND & AIMS: Intestinal ultrasound (IUS) is increasingly used to assess Crohn's disease (CD) activity in clinical practice. However, application in clinical trials has been limited by heterogeneous scoring methods and concerns about reliability. We aimed to determine the inter- and intra-rater reliability of locally and centrally read IUS parameters for evaluating CD using prospectively performed scans. METHODS: Twenty-four participants with CD and 6 gastroenterologists participated in a 2-day workshop where each participant underwent 6 IUS scans in total. Eight IUS parameters (bowel wall thickness [BWT], bowel wall stratification [BWS], color Doppler signal [CDS], inflammatory mesenteric fat [i-fat], submucosal prominence, submucosal layer thickness, haustra coli/peristalsis, and affected segment length) and an overall measure of sonographic disease activity were blindly assessed by the 6 local readers and 4 central gastroenterologist-sonographers. Reliability was quantified using intraclass correlation coefficients (ICCs). Institutional review board approval was granted for this study (12938). RESULTS: Five IUS parameters demonstrated at least moderate (ICC ≥0.41) inter- and intra-rater reliability when local and central reading was performed (BWT, CDS, i-fat, submucosal prominence, and affected segment length). Reliability was generally better with central, in distinction to local, reading. ICCs for BWS and i-fat were highest when evaluated as binary outcomes. Sensitivity analyses demonstrated that IUS parameters are most reliable when evaluated in the worst affected segment. Fair reliability was observed when local readers identified the worst affected segment. CONCLUSIONS: Local and central reading of IUS demonstrated at least moderate inter- and intra-rater reliability for several parameters. This study supports refining existing activity indices and incorporating IUS central reading into clinical trials.

Reliability of CT Enterography for Describing Fibrostenosing Crohn Disease.

Background Standardized methods to measure and describe Crohn disease strictures at CT enterography are needed to guide clinical decision making and for use in therapeutic studies. Purpose To assess the reliability of CT enterography features to describe Crohn disease strictures and their correlation with stricture severity. Materials and Methods A retrospective study was conducted in 43 adult patients with symptomatic terminal ileal Crohn disease strictures who underwent standard-of-care CT enterography at a tertiary care center at the Cleveland Clinic between January 2008 and August 2016. After training on standardized definitions, four abdominal radiologists blinded to all patient information assessed imaging features (seven continuous measurements and nine observations) of the most distal ileal stricture in two separate sessions (separated by ≥2 weeks) in random order. Features with an interrater intraclass correlation coefficient (ICC) of 0.41 or greater (ie, moderate reliability or better) were considered reliable. Univariable and multivariable linear regression analysis identified reliable features associated with a visual analog scale of overall stricture severity. Significant reliable features were assessed as components of a CT enterography-based model to quantitate stricture severity. Results Examinations in 43 patients (mean age, 52 years ± 16 [SD]; 23 female) were evaluated. Five continuous measurements and six observations demonstrated at least moderate interrater reliability (interrater ICC range, 0.42 [95% CI: 0.25, 0.57] to 0.80 [95% CI: 0.67, 0.88]). Of these, 10 were univariably associated with stricture severity, and three continuous measurements-stricture length (interrater ICC, 0.64 [95% CI: 0.42, 0.81]), maximal associated small bowel dilation (interrater ICC, 0.80 [95% CI: 0.67, 0.88]), and maximal stricture wall thickness (interrater ICC, 0.50 [95% CI: 0.34, 0.62])-were independently associated (P value range, <.001 to .003) with stricture severity in a multivariable model. These three measurements were used to derive a well-calibrated (optimism-adjusted calibration slope = 1.00) quantitative model of stricture severity. Conclusion Standardized CT enterography measurements and observations can reliably describe terminal ileal Crohn disease strictures. Stricture length, maximal associated small bowel dilation, and maximal stricture wall thickness are correlated with stricture severity. © RSNA, 2024 Supplemental material is available for this article. See also the article by Rieder et al in this issue. See also the editorial by Galgano and Summerlin in this issue.

Reliability of MR Enterography Features for Describing Fibrostenosing Crohn Disease.

Background Clinical decision making and drug development for fibrostenosing Crohn disease is constrained by a lack of imaging definitions, scoring conventions, and validated end points. Purpose To assess the reliability of MR enterography features to describe Crohn disease strictures and determine correlation with stricture severity. Materials and Methods A retrospective study of patients with symptomatic terminal ileal Crohn disease strictures who underwent MR enterography at tertiary care centers (Cleveland Clinic: September 2013 to November 2020; Mayo Clinic: February 2008 to March 2019) was conducted by using convenience sampling. In the development phase, blinded and trained radiologists independently evaluated 26 MR enterography features from baseline and follow-up examinations performed more than 6 months apart, with no bowel resection performed between examinations. Follow-up examinations closest to 12 months after baseline were selected. Reliability was assessed using the intraclass correlation coefficient (ICC). In the validation phase, after five features were redefined, reliability was re-estimated in an independent convenience sample using baseline examinations. Multivariable linear regression analysis identified features with at least moderate interrater reliability (ICC ≥0.41) that were independently associated with stricture severity. Results Ninety-nine (mean age, 40 years ± 14 [SD]; 50 male) patients were included in the development group and 51 (mean age, 45 years ± 16 [SD]; 35 female) patients were included in the validation group. In the development group, nine features had at least moderate interrater reliability. One additional feature demonstrated moderate reliability in the validation group. Stricture length (ICC = 0.85 [95% CI: 0.75, 0.91] and 0.91 [95% CI: 0.75, 0.96] in development and validation phase, respectively) and maximal associated small bowel dilation (ICC = 0.74 [95% CI: 0.63, 0.80] and 0.73 [95% CI: 0.58, 0.87] in development and validation group, respectively) had the highest interrater reliability. Stricture length, maximal stricture wall thickness, and maximal associated small bowel dilation were independently (regression coefficients, 0.09-3.97; P < .001) associated with stricture severity. Conclusion MR enterography definitions and scoring conventions for reliably assessing features of Crohn disease strictures were developed and validated, and feature correlation with stricture severity was determined. © RSNA, 2024 Supplemental material is available for this article. See also the article by Rieder and Ma et al in this issue. See also the editorial by Galgano and Summerlin in this issue.

Reliability and Responsiveness of Histologic Indices for the Assessment of Crohn's Disease Activity.

BACKGROUND & AIMS: The operating properties of histologic indices for evaluating Crohn's disease (CD) activity are poorly characterized. We assessed the reliability and responsiveness of existing histologic indices/items used in CD and ulcerative colitis (UC), in addition to 3 novel items, and developed exploratory ileal, colonic, and colonic-ileal CD instruments. METHODS: Blinded central readers independently reviewed paired baseline and week 12 image sets from the EXTEND trial. Disease activity was scored using 4 indices (the Global Histologic Activity Score, Geboes Score, Nancy Histological Index, and Robarts Histopathology Index) and 3 items identified by an expert panel (mucin depletion, basal plasmacytosis, and ileal pyloric gland metaplasia). Reliability and responsiveness were quantified using the intraclass correlation coefficient (ICC) and area under the receiver operating curve (AUC), respectively. Exploratory indices were developed using backward stepwise linear regression analysis. Candidate independent variables were items with an inter-rater ICC ≥0.40 and AUC ≥0.56. The dependent variable was histologic disease activity measured by a 100-mm visual analogue scale. RESULTS: Paired image sets were available from 55 patients. Substantial to almost perfect inter-rater reliability (ICC, 0.63-0.87) and some responsiveness (AUC, 0.57-0.94) were observed for all existing indices regardless of whether individual colonic and ileal segments, combined colonic segments, or combined colonic and ileal segments were assessed and the calculation method used. Five items were tested as candidate items, and exploratory colonic, ileal, and colonic-ileal indices were developed. CONCLUSIONS: CD and UC indices were similarly reliable and responsive in measuring histologic CD activity. Exploratory index development did not offer benefit over current histologic instruments.

Standardizing Scoring Conventions for Crohn's Disease Endoscopy: An International RAND/UCLA Appropriateness Study.

BACKGROUND AND AIMS: Endoscopic assessment of disease activity is integral for evaluating treatment response in patients with Crohn's disease (CD). We aimed to define appropriate items for evaluating endoscopic activity and conventions for consistent endoscopic scoring rules in CD. METHODS: A 2-round modified RAND/University of California at Los Angeles Appropriateness Method study was conducted. A panel of 15 gastroenterologists used a 9-point Likert scale to rate the appropriateness of statements pertaining to the Simple Endoscopic Score for CD, Crohn's Disease Endoscopic Index of Severity, and additional items relevant to endoscopy scoring in CD. Each statement was voted as appropriate, uncertain, or inappropriate based on the median panel rating and presence of disagreement. RESULTS: Panelists voted that it is appropriate for all ulcers to contribute to endoscopic scoring in CD, including aphthous ulcers, ulcerations at a surgical anastomosis, and anal canal ulcers (scored in the rectum). Endoscopic healing should reflect an absence of ulcers. Narrowing should be defined as a clear decrease in luminal diameter; stenosis should be defined by an impassable narrowing, and if occurring at the junction of 2 segments, scored in the distal segment. Scarring and inflammatory polyps were considered inappropriate for including in the affected area score. The optimal method for defining ulcer depth remains uncertain. CONCLUSIONS: We outlined scoring conventions for the Simple Endoscopic Score for CD and Crohn's Disease Endoscopic Index of Severity, noting that both scores have limitations. Therefore, we identified priorities for future research and steps for developing and validating a more representative endoscopic index in CD.

An Expert Consensus to Standardize Assessment of Bowel Cleansing for Clinical Trials of Bowel Preparations for Crohn's Disease.

BACKGROUND: Despite regular need for colonoscopy in patients with Crohn's disease (CD), the efficacy and tolerability of bowel preparation (BP) agents is rarely assessed in this population. Assessing BP quality with existing scales may be challenging in CD due to presence of inflammation, bowel resection, and strictures. AIMS: To provide recommendations for assessing BP quality in clinical trials for CD using a modified Research and Development/University of California, Los Angeles appropriateness process. METHODS: Based on systematic reviews and a literature search, 110 statements relating to BP quality assessment in CD were developed. A panel of 15 gastroenterologists rated the statements as appropriate, uncertain, or inappropriate using a 9-point Likert scale. RESULTS: Panelists considered it appropriate that central readers, either alone or with local assessment, score BP quality in clinical trials. Central readers should be trained on scoring BP quality and local endoscopists on performing high-quality video recording. Both endoscope insertion and withdrawal phases should be reviewed to score BP quality in each colonic segment and segments should align with endoscopic disease activity indices. The Harefield Cleansing Scale and the Boston Bowel Preparation Scale were considered appropriate. The final score should be calculated as the average of all visualized segments. Both total and worst segment scores should also be assessed. CONCLUSIONS: We developed a framework for assessing BP quality in patients with CD based on expert feedback. This framework could support the development or refinement of BP quality scales and the integration of BP quality assessment in future CD studies.

Reliability and responsiveness of endoscopic disease activity assessment in eosinophilic esophagitis.

BACKGROUND AND AIMS: Endoscopic outcomes have become important measures of eosinophilic esophagitis (EoE) disease activity, including as an endpoint in randomized controlled trials (RCTs). We evaluated the operating properties of endoscopic measures for use in EoE RCTs. METHODS: Modified Research and Development/University of California Los Angeles appropriateness methods and a panel of 15 international EoE experts identified endoscopic items and definitions with face validity that were used in a 2-round voting process to define simplified (all items graded as absent or present) and expanded versions (additional grades for edema, furrows, and/or exudates) of the EoE Endoscopic Reference Score (EREFS). Inter- and intrarater reliability of these instruments (expressed as intraclass correlation coefficients [ICC]) were evaluated using paired endoscopy video assessments of 2 blinded central readers in patients before and after 8 weeks of proton pump inhibitors, swallowed topical corticosteroids, or dietary elimination. Responsiveness was measured using the standardized effect size (SES). RESULTS: The appropriateness of 41 statements relevant to EoE endoscopic activity (endoscopic items, item definitions and grading, and other considerations relevant for endoscopy) was considered. The original and expanded EREFS demonstrated moderate-to-substantial inter-rater reliability (ICCs of .472-.736 and .469-.763, respectively) and moderate-to-almost perfect intrarater reliability (ICCs of .580-.828 and .581-.828, respectively). Strictures were least reliably assessed (ICC, .072-.385). The original EREFS was highly responsive (SES, 1.126 [95% confidence interval {CI}, .757-1.534]), although both expanded versions of EREFS, scored based on worst affected area, were numerically most responsive to treatment (expanded furrows: SES, 1.229 [95% CI, .858-1.643]; all items expanded: SES, 1.252 [95% CI, .880-1.667]). The EREFS and its modifications were not more reliably scored by segment and also not more responsive when proximal and distal EREFSs were summed. CONCLUSIONS: EREFS and its modifications were reliable and responsive, and the original or expanded versions of the EREFS may be preferred in RCTs. Disease activity scored based on the worst affected area optimizes reliability and responsiveness.

Performance of bowel preparation quality scales in patients with Crohn's disease.

BACKGROUND: The performance of bowel preparation (BP) in patients with Crohn's disease (CD) is unknown. AIMS: To evaluate the operating properties of instruments used to assess BP quality in patients with CD. METHODS: We used the Boston Bowel Preparation Scale, modified Boston Bowel Preparation Scale, Harefield Cleansing Scale, Food and Drug Administration Bowel Cleansing Assessment Scale (BCAS), and a 100-mm visual analogue scale of bowel cleanliness to assess BP quality in 50 videos from 40 patients with CD. We assessed endoscopic activity with the Simple Endoscopic Score for CD (SES-CD). Assessments were on endoscope insertion and withdrawal. Reliability was quantified using the intraclass correlation coefficient (ICC). We assessed validity by within-patient correlation between instruments and the visual analogue scale using mixed-effect models. The correlation between BP quality and SES-SD scores was assessed using Spearman's rho. RESULTS: Inter- and intra-rater reliability for all BP quality instruments was substantial (ICC ≥0.61) except for the Food and Drug Administration BCAS on insertion (inter-rater reliability ICC ≥0.41). The visual analogue scale had substantial inter- and almost perfect (ICC ≥0.81) intra-rater reliability. Correlation coefficients for the validity of the instruments exceeded 0.58. BP quality and endoscopic disease activity scores in the colon were negatively correlated. CONCLUSION: Most existing instruments reliably assess BP quality in patients with CD. These results support the use of these instruments in clinical practice, provide a framework for scoring BP quality in CD clinical trials, and support evaluation of novel BP agents in patients with CD.

Recommendations for Standardizing MRI-based Evaluation of Perianal Fistulizing Disease Activity in Pediatric Crohn's Disease Clinical Trials.

BACKGROUND: Perianal fistulas and abscesses occur commonly as complications of pediatric Crohn's disease (CD). A validated imaging assessment tool for quantification of perianal disease severity and activity is needed to evaluate treatment response. We aimed to identify magnetic resonance imaging (MRI)-based measures of perianal fistulizing disease activity and study design features appropriate for pediatric patients. METHODS: Seventy-nine statements relevant to MRI-based assessment of pediatric perianal fistulizing CD activity and clinical trial design were generated from literature review and expert opinion. Statement appropriateness was rated by a panel (N = 15) of gastroenterologists, radiologists, and surgeons using modified RAND/University of California Los Angeles appropriateness methodology. RESULTS: The modified Van Assche Index (mVAI) and the Magnetic Resonance Novel Index for Fistula Imaging in CD (MAGNIFI-CD) were considered appropriate instruments for use in pediatric perianal fistulizing disease clinical trials. Although there was concern regarding the use of intravascular contrast material in pediatric patients, its use in clinical trials was considered appropriate. A clinically evident fistula tract and radiologic disease defined as at least 1 fistula or abscess on pelvic MRI were considered appropriate trial inclusion criteria. A coprimary clinical and radiologic end point and inclusion of a patient-reported outcome were also considered appropriate. CONCLUSION: Outcomes of treatment of perianal fistulizing disease in children must include MRI. Existing multi-item measures, specifically the mVAI and MAGNIFI-CD, can be adapted and used for children. Further research to assess the operating properties of the indices when used in a pediatric patient population is ongoing.

International expert guidance for defining and monitoring small bowel strictures in Crohn's disease on intestinal ultrasound: a consensus statement.

BACKGROUND: Diagnostic imaging using CT enterography, magnetic resonance enterography, and intestinal ultrasound are important tools in evaluating stricturing Crohn's disease. Definitions of strictures have been developed for CT enterography and magnetic resonance enterography. However, expert recommendations for definitions and treatment response of strictures on intestinal ultrasound are not available. The aim of this study was to standardise definitions, diagnosis, and treatment response criteria in small bowel stricturing Crohn's disease on intestinal ultrasound. METHODS: Using modified RAND-University of California Los Angeles Appropriateness Method, a diverse expert panel of 13 gastroenterologists, seven radiologists, and two patient representatives was assembled. A total of 466 statements on definitions and response to therapy of stricturing Crohn's disease on intestinal ultrasound were generated from a systematic review and from expert opinion, with subsequent rating for appropriateness. Two rounds of voting with an interposed survey result discussion were performed. Statements were classified as inappropriate, uncertain, or appropriate based on the median panel rating and degree of disagreement. Appropriateness was rated using a nine-point Likert scale (1 being inappropriate, 9 being highly appropriate). FINDINGS: A naive or anastomotic small bowel Crohn's disease stricture on intestinal ultrasound is defined by the combination of bowel wall thickening, luminal narrowing, and pre-stenotic dilation. Bowel wall thickness is defined as being more than 3 mm. Luminal narrowing is defined as either a luminal diameter reduction of more than 50% in the narrowest area and relative to a normal adjacent bowel loop, or a luminal diameter of less than 1 cm. Pre-stenotic dilation is defined as more than 2·5 cm or an increase in bowel diameter relative to a normal adjacent bowel loop. Definitions for grading hyperaemia, inflammatory fat, wall stratification, intestinal ultrasound machine technical parameters, and image acquisition were also devised. Treatment response of strictures was defined as reduction in stricture length, bowel wall thickening, luminal narrowing, pre-stenotic dilation, and motility abnormalities. INTERPRETATION: To our knowledge, this is the first intestinal ultrasound appropriateness rating exercise conducted for defining, diagnosing, and measuring response to therapy in small bowel stricturing Crohn's disease and informs future clinical use and intestinal ultrasound index development for clinical trials. FUNDING: Leona M and Harry B Helmsley Charitable Trust.

An expert consensus to standardise clinical, endoscopic and histologic items and inclusion and outcome criteria for evaluation of pouchitis disease activity in clinical trials.

BACKGROUND: Pouchitis is a condition with large unmet medical needs and no approved therapies. Lack of validated instruments to measure disease activity and treatment response is a major barrier to drug development. AIM: To conduct a modified RAND/University of California Los Angeles appropriateness process to produce a standardised assessment of pouchitis disease activity in clinical trials. METHODS: A list of 164 items generated upon a systematic review and expert opinion were rated based on a 9-point scale (appropriate, uncertain and inappropriate), by a panel including 16 gastroenterologists, surgeons and histopathologists. RESULTS: Items rated as appropriate to evaluate in pouchitis clinical trials were: (a) clinical: stool frequency and faecal urgency; (b) endoscopic: primary assessment in the pouch body according to the percentage of affected area (<50%, 50%-75% and >75%), evaluation of the presence of ulcers/erosions according to size (erosions <5 mm, ulcers ≥5 mm to 2 cm and large ulcers >2 cm) and ulcerated area (<10%, 10%-30% and >30%); (c) histologic: two biopsies from each segment, from the ulcer's edge when present, or endoscopically normal areas, assessment of lamina propria chronic inflammation, epithelial and lamina propria neutrophils, epithelial damage, erosions and ulcers; and (d) clinical trial inclusion/outcome criteria: minimum histologic disease activity for inclusion, a primary endpoint based on stool frequency and assessment of clinical, endoscopic and histologic response and remission. The overall majority of items surveyed (100/164) were rated 'uncertain'. CONCLUSION: We conducted a RAND/UCLA appropriateness process to help inform measurement of pouchitis disease activity within clinical trials and foster the development of novel therapies.