Reliability and Responsiveness of Histologic Indices for the Assessment of Crohn's Disease Activity.

BACKGROUND & AIMS: The operating properties of histologic indices for evaluating Crohn's disease (CD) activity are poorly characterized. We assessed the reliability and responsiveness of existing histologic indices/items used in CD and ulcerative colitis (UC), in addition to 3 novel items, and developed exploratory ileal, colonic, and colonic-ileal CD instruments. METHODS: Blinded central readers independently reviewed paired baseline and week 12 image sets from the EXTEND trial. Disease activity was scored using 4 indices (the Global Histologic Activity Score, Geboes Score, Nancy Histological Index, and Robarts Histopathology Index) and 3 items identified by an expert panel (mucin depletion, basal plasmacytosis, and ileal pyloric gland metaplasia). Reliability and responsiveness were quantified using the intraclass correlation coefficient (ICC) and area under the receiver operating curve (AUC), respectively. Exploratory indices were developed using backward stepwise linear regression analysis. Candidate independent variables were items with an inter-rater ICC ≥0.40 and AUC ≥0.56. The dependent variable was histologic disease activity measured by a 100-mm visual analogue scale. RESULTS: Paired image sets were available from 55 patients. Substantial to almost perfect inter-rater reliability (ICC, 0.63-0.87) and some responsiveness (AUC, 0.57-0.94) were observed for all existing indices regardless of whether individual colonic and ileal segments, combined colonic segments, or combined colonic and ileal segments were assessed and the calculation method used. Five items were tested as candidate items, and exploratory colonic, ileal, and colonic-ileal indices were developed. CONCLUSIONS: CD and UC indices were similarly reliable and responsive in measuring histologic CD activity. Exploratory index development did not offer benefit over current histologic instruments.

Reliability of histologic assessment for NAFLD and development of an expanded NAFLD activity score.

BACKGROUND AND AIMS: The NASH Clinical Research Network histologic scoring system, the gold-standard NASH histology assessment for clinical trials, has demonstrated intrarater and interrater variability. An expert panel in a previous systematic Research and Development/University of California Los Angeles (RAND/UCLA) study determined that existing histologic scoring systems do not fully capture NASH disease activity and fibrosis, and standardized definitions of histologic features are needed. We evaluated the reliability of existing and alternate histologic measures and their correlations with a disease activity visual analog scale to propose optimal components for an expanded NAFLD activity score (NAS). APPROACH AND RESULTS: Four liver pathologists who were involved in the prior RAND/UCLA study underwent standardized training and multiple discussions with the goal of improving agreement. They were blinded to clinical information and scored histologic measures twice, ≥2 weeks apart, for 40 liver biopsies representing the full spectrum of NAFLD. Index intraclass correlation coefficient (ICC) estimates demonstrated intrarater (0.80-0.85) and interrater (0.60-0.72) reliability. Hepatocyte ballooning items had similar interrater ICCs (0.68-0.79), including those extending scores from 0-2 to 0-4. Steatosis measures (interrater ICCs, 0.72-0.80) correlated poorly with disease activity. Correlations with disease activity were largest for hepatocyte ballooning and Mallory-Denk bodies (MDBs), with both used to develop the expanded NAS (intrarater ICC, 0.90; interrater ICC, 0.80). Fibrosis measures had ICCs of 0.70-0.87. CONCLUSIONS: After extensive preparation among a group of experienced pathologists, we demonstrated improved reliability of multiple existing histologic NAFLD indices and fibrosis staging systems. Hepatocyte ballooning and MDBs most strongly correlated with disease activity and were used for the expanded NAS. Further validation including evaluation of responsiveness is required.

Reliability and responsiveness of endoscopic disease activity assessment in eosinophilic esophagitis.

BACKGROUND AND AIMS: Endoscopic outcomes have become important measures of eosinophilic esophagitis (EoE) disease activity, including as an endpoint in randomized controlled trials (RCTs). We evaluated the operating properties of endoscopic measures for use in EoE RCTs. METHODS: Modified Research and Development/University of California Los Angeles appropriateness methods and a panel of 15 international EoE experts identified endoscopic items and definitions with face validity that were used in a 2-round voting process to define simplified (all items graded as absent or present) and expanded versions (additional grades for edema, furrows, and/or exudates) of the EoE Endoscopic Reference Score (EREFS). Inter- and intrarater reliability of these instruments (expressed as intraclass correlation coefficients [ICC]) were evaluated using paired endoscopy video assessments of 2 blinded central readers in patients before and after 8 weeks of proton pump inhibitors, swallowed topical corticosteroids, or dietary elimination. Responsiveness was measured using the standardized effect size (SES). RESULTS: The appropriateness of 41 statements relevant to EoE endoscopic activity (endoscopic items, item definitions and grading, and other considerations relevant for endoscopy) was considered. The original and expanded EREFS demonstrated moderate-to-substantial inter-rater reliability (ICCs of .472-.736 and .469-.763, respectively) and moderate-to-almost perfect intrarater reliability (ICCs of .580-.828 and .581-.828, respectively). Strictures were least reliably assessed (ICC, .072-.385). The original EREFS was highly responsive (SES, 1.126 [95% confidence interval {CI}, .757-1.534]), although both expanded versions of EREFS, scored based on worst affected area, were numerically most responsive to treatment (expanded furrows: SES, 1.229 [95% CI, .858-1.643]; all items expanded: SES, 1.252 [95% CI, .880-1.667]). The EREFS and its modifications were not more reliably scored by segment and also not more responsive when proximal and distal EREFSs were summed. CONCLUSIONS: EREFS and its modifications were reliable and responsive, and the original or expanded versions of the EREFS may be preferred in RCTs. Disease activity scored based on the worst affected area optimizes reliability and responsiveness.