CRISPR-Cas9 Editing of the HBG1 and HBG2 Promoters to Treat Sickle Cell Disease.

BACKGROUND: Sickle cell disease is caused by a defect in the ß-globin subunit of adult hemoglobin. Sickle hemoglobin polymerizes under hypoxic conditions, producing deformed red cells that hemolyze and cause vaso-occlusion that results in progressive organ damage and early death. Elevated fetal hemoglobin levels in red cells protect against complications of sickle cell disease. OTQ923, a clustered regularly interspaced short palindromic repeats (CRISPR)-Cas9-edited CD34+ hematopoietic stem- and progenitor-cell (HSPC) product, has a targeted disruption of the HBG1 and HBG2 (γ-globin) gene promoters that increases fetal hemoglobin expression in red-cell progeny. METHODS: We performed a tiling CRISPR-Cas9 screen of the HBG1 and HBG2 promoters by electroporating CD34+ cells obtained from healthy donors with Cas9 complexed with one of 72 guide RNAs, and we assessed the fraction of fetal hemoglobin-immunostaining erythroblasts (F cells) in erythroid-differentiated progeny. The gRNA resulting in the highest level of F cells (gRNA-68) was selected for clinical development. We enrolled participants with severe sickle cell disease in a multicenter, phase 1-2 clinical study to assess the safety and adverse-effect profile of OTQ923. RESULTS: In preclinical experiments, CD34+ HSPCs (obtained from healthy donors and persons with sickle cell disease) edited with CRISPR-Cas9 and gRNA-68 had sustained on-target editing with no off-target mutations and produced high levels of fetal hemoglobin after in vitro differentiation or xenotransplantation into immunodeficient mice. In the study, three participants received autologous OTQ923 after myeloablative conditioning and were followed for 6 to 18 months. At the end of the follow-up period, all the participants had engraftment and stable induction of fetal hemoglobin (fetal hemoglobin as a percentage of total hemoglobin, 19.0 to 26.8%), with fetal hemoglobin broadly distributed in red cells (F cells as a percentage of red cells, 69.7 to 87.8%). Manifestations of sickle cell disease decreased during the follow-up period. CONCLUSIONS: CRISPR-Cas9 disruption of the HBG1 and HBG2 gene promoters was an effective strategy for induction of fetal hemoglobin. Infusion of autologous OTQ923 into three participants with severe sickle cell disease resulted in sustained induction of red-cell fetal hemoglobin and clinical improvement in disease severity. (Funded by Novartis Pharmaceuticals; ClinicalTrials.gov number, NCT04443907.).

Clinical and functional spectrum of RAC2-related immunodeficiency.

ABSTRACT: Mutations in the small Rho-family guanosine triphosphate hydrolase RAC2, critical for actin cytoskeleton remodeling and intracellular signal transduction, are associated with neonatal severe combined immunodeficiency (SCID), infantile neutrophilic disorder resembling leukocyte adhesion deficiency (LAD), and later-onset combined immune deficiency (CID). We investigated 54 patients (23 previously reported) from 37 families yielding 15 novel RAC2 missense mutations, including one present only in homozygosity. Data were collected from referring physicians and literature reports with updated clinical information. Patients were grouped by presentation: neonatal SCID (n = 5), infantile LAD-like disease (n = 5), or CID (n = 44). Disease correlated to RAC2 activity: constitutively active RAS-like mutations caused neonatal SCID, dominant-negative mutations caused LAD-like disease, whereas dominant-activating mutations caused CID. Significant T- and B-lymphopenia with low immunoglobulins were seen in most patients; myeloid abnormalities included neutropenia, altered oxidative burst, impaired neutrophil migration, and visible neutrophil macropinosomes. Among 42 patients with CID with clinical data, upper and lower respiratory infections and viral infections were common. Twenty-three distinct RAC2 mutations, including 15 novel variants, were identified. Using heterologous expression systems, we assessed downstream effector functions including superoxide production, p21-activated kinase 1 binding, AKT activation, and protein stability. Confocal microscopy showed altered actin assembly evidenced by membrane ruffling and macropinosomes. Altered protein localization and aggregation were observed. All tested RAC2 mutant proteins exhibited aberrant function; no single assay was sufficient to determine functional consequence. Most mutants produced elevated superoxide; mutations unable to support superoxide formation were associated with bacterial infections. RAC2 mutations cause a spectrum of immune dysfunction, ranging from early onset SCID to later-onset combined immunodeficiencies depending on RAC2 activity. This trial was registered at www.clinicaltrials.gov as #NCT00001355 and #NCT00001467.

Genotype, oxidase status, and preceding infection or autoinflammation do not affect allogeneic HCT outcomes for CGD.

Chronic granulomatous disease (CGD) is a primary immunodeficiency characterized by life-threatening infections and inflammatory conditions. Hematopoietic cell transplantation (HCT) is the definitive treatment for CGD, but questions remain regarding patient selection and impact of active disease on transplant outcomes. We performed a multi-institutional retrospective and prospective study of 391 patients with CGD treated either conventionally (non-HCT) enrolled from 2004 to 2018 or with HCT from 1996 to 2018. Median follow-up after HCT was 3.7 years with a 3-year overall survival of 82% and event-free survival of 69%. In a multivariate analysis, a Lansky/Karnofsky score <90 and use of HLA-mismatched donors negatively affected survival. Age, genotype, and oxidase status did not affect outcomes. Before HCT, patients had higher infection density, higher frequency of noninfectious lung and liver diseases, and more steroid use than conventionally treated patients; however, these issues did not adversely affect HCT survival. Presence of pre-HCT inflammatory conditions was associated with chronic graft-versus-host disease. Graft failure or receipt of a second HCT occurred in 17.6% of the patients and was associated with melphalan-based conditioning and/or early mixed chimerism. At 3 to 5 years after HCT, patients had improved growth and nutrition, resolved infections and inflammatory disease, and lower rates of antimicrobial prophylaxis or corticosteroid use compared with both their baseline and those of conventionally treated patients. HCT leads to durable resolution of CGD symptoms and lowers the burden of the disease. Patients with active infection or inflammation are candidates for transplants; HCT should be considered before the development of comorbidities that could affect performance status. This trial was registered at www.clinicaltrials.gov as #NCT02082353.

Posttransplantation late complications increase over time for patients with SCID: A Primary Immune Deficiency Treatment Consortium (PIDTC) landmark study.

BACKGROUND: The Primary Immune Deficiency Treatment Consortium (PIDTC) enrolled children in the United States and Canada onto a retrospective multicenter natural history study of hematopoietic cell transplantation (HCT). OBJECTIVE: We investigated outcomes of HCT for severe combined immunodeficiency (SCID). METHODS: We evaluated the chronic and late effects (CLE) after HCT for SCID in 399 patients transplanted from 1982 to 2012 at 32 PIDTC centers. Eligibility criteria included survival to at least 2 years after HCT without need for subsequent cellular therapy. CLE were defined as either conditions present at any time before 2 years from HCT that remained unresolved (chronic), or new conditions that developed beyond 2 years after HCT (late). RESULTS: The cumulative incidence of CLE was 25% in those alive at 2 years, increasing to 41% at 15 years after HCT. CLE were most prevalent in the neurologic (9%), neurodevelopmental (8%), and dental (8%) categories. Chemotherapy-based conditioning was associated with decreased-height z score at 2 to 5 years after HCT (P < .001), and with endocrine (P < .001) and dental (P = .05) CLE. CD4 count of ≤500 cells/µL and/or continued need for immunoglobulin replacement therapy >2 years after transplantation were associated with lower-height z scores. Continued survival from 2 to 15 years after HCT was 90%. The presence of any CLE was associated with increased risk of late death (hazard ratio, 7.21; 95% confidence interval, 2.71-19.18; P < .001). CONCLUSION: Late morbidity after HCT for SCID was substantial, with an adverse impact on overall survival. This study provides evidence for development of survivorship guidelines based on disease characteristics and treatment exposure for patients after HCT for SCID.

Allogeneic hematopoietic cell transplantation is effective for p47phox chronic granulomatous disease: A Primary Immune Deficiency Treatment Consortium study.

BACKGROUND: P47phox (neutrophil cytosolic factor-1) deficiency is the most common cause of autosomal recessive chronic granulomatous disease (CGD) and is considered to be associated with a milder clinical phenotype. Allogeneic hematopoietic cell transplantation (HCT) for p47phox CGD is not well-described. OBJECTIVES: We sought to study HCT for p47phox CGD in North America. METHODS: Thirty patients with p47phox CGD who received allogeneic HCT at Primary Immune Deficiency Treatment Consortium centers since 1995 were included. RESULTS: Residual oxidative activity was present in 66.7% of patients. In the year before HCT, there were 0.38 CGD-related infections per person-years. Inflammatory diseases, predominantly of the lungs and bowel, occurred in 36.7% of the patients. The median age at HCT was 9.1 years (range 1.5-23.6 years). Most HCTs (90%) were performed after using reduced intensity/toxicity conditioning. HCT sources were HLA-matched (40%) and -mismatched (10%) related donors or HLA-matched (36.7%) and -mismatched (13.3%) unrelated donors. CGD-related infections after HCT decreased significantly to 0.06 per person-years (P = .038). The frequency of inflammatory bowel disease and the use of steroids also decreased. The cumulative incidence of graft failure and second HCT was 17.9%. The 2-year overall and event-free survival were 92.3% and 82.1%, respectively, while at 5 years they were 85.7% and 77.0%, respectively. In the surviving patients evaluated, ≥95% donor myeloid chimerism at 1 and 2 years after HCT was 93.8% and 87.5%, respectively. CONCLUSIONS: Patients with p47phox CGD suffer from a significant disease burden that can be effectively alleviated by HCT. Similar to other forms of CGD, HCT should be considered for patients with p47phox CGD.

Relevance of lymphocyte proliferation to PHA in severe combined immunodeficiency (SCID) and T cell lymphopenia.

Severe combined immunodeficiency (SCID) is characterized by a severe deficiency in T cell numbers. We analyzed data collected (n = 307) for PHA-based T cell proliferation from the PIDTC SCID protocol 6901, using either a radioactive or flow cytometry method. In comparing the two groups, a smaller number of the patients tested by flow cytometry had <10% of the lower limit of normal proliferation as compared to the radioactive method (p = 0.02). Further, in patients with CD3+ T cell counts between 51 and 300 cells/µL, there was a higher proliferative response with the PHA flow assay compared to the 3H-T assay (p < 0.0001), suggesting that the method of analysis influences the resolution and interpretation of PHA results. Importantly, we observed many SCID patients with profound T cell lymphopenia having normal T cell proliferation when assessed by flow cytometry. We recommend this test be considered only as supportive in the diagnosis of typical SCID.

Measuring the effect of newborn screening on survival after haematopoietic cell transplantation for severe combined immunodeficiency: a 36-year longitudinal study from the Primary Immune Deficiency Treatment Consortium.

BACKGROUND: Severe combined immunodeficiency (SCID) is fatal unless durable adaptive immunity is established, most commonly through allogeneic haematopoietic cell transplantation (HCT). The Primary Immune Deficiency Treatment Consortium (PIDTC) explored factors affecting the survival of individuals with SCID over almost four decades, focusing on the effects of population-based newborn screening for SCID that was initiated in 2008 and expanded during 2010-18. METHODS: We analysed transplantation-related data from children with SCID treated at 34 PIDTC sites in the USA and Canada, using the calendar time intervals 1982-89, 1990-99, 2000-09, and 2010-18. Categorical variables were compared by χ2 test and continuous outcomes by the Kruskal-Wallis test. Overall survival was estimated by the Kaplan-Meier method. A multivariable analysis using Cox proportional hazards regression models examined risk factors for HCT outcomes, including the variables of time interval of HCT, infection status and age at HCT, trigger for diagnosis, SCID type and genotype, race and ethnicity of the patient, non-HLA-matched sibling donor type, graft type, GVHD prophylaxis, and conditioning intensity. FINDINGS: For 902 children with confirmed SCID, 5-year overall survival remained unchanged at 72%-73% for 28 years until 2010-18, when it increased to 87% (95% CI 82·1-90·6; n=268; p=0·0005). For children identified as having SCID by newborn screening since 2010, 5-year overall survival was 92·5% (95% CI 85·8-96·1), better than that of children identified by clinical illness or family history in the same interval (79·9% [69·5-87·0] and 85·4% [71·8-92·8], respectively [p=0·043]). Multivariable analysis demonstrated that the factors of active infection (hazard ratio [HR] 2·41, 95% CI 1·56-3·72; p<0·0001), age 3·5 months or older at HCT (2·12, 1·38-3·24; p=0·001), Black or African-American race (2·33, 1·56-3·46; p<0·0001), and certain SCID genotypes to be associated with lower overall survival during all time intervals. Moreover, after adjusting for several factors in this multivariable analysis, HCT after 2010 no longer conveyed a survival advantage over earlier time intervals studied (HR 0·73, 95% CI 0·43-1·26; p=0·097). This indicated that younger age and freedom from infections at HCT, both directly driven by newborn screening, were the main drivers for recent improvement in overall survival. INTERPRETATION: Population-based newborn screening has facilitated the identification of infants with SCID early in life, in turn leading to prompt HCT while avoiding infections. Public health programmes worldwide can benefit from this definitive demonstration of the value of newborn screening for SCID. FUNDING: National Institute of Allergy and Infectious Diseases, Office of Rare Diseases Research, and National Center for Advancing Translational Sciences.

Outcomes following treatment for ADA-deficient severe combined immunodeficiency: a report from the PIDTC.

Adenosine deaminase (ADA) deficiency causes ∼13% of cases of severe combined immune deficiency (SCID). Treatments include enzyme replacement therapy (ERT), hematopoietic cell transplant (HCT), and gene therapy (GT). We evaluated 131 patients with ADA-SCID diagnosed between 1982 and 2017 who were enrolled in the Primary Immune Deficiency Treatment Consortium SCID studies. Baseline clinical, immunologic, genetic characteristics, and treatment outcomes were analyzed. First definitive cellular therapy (FDCT) included 56 receiving HCT without preceding ERT (HCT); 31 HCT preceded by ERT (ERT-HCT); and 33 GT preceded by ERT (ERT-GT). Five-year event-free survival (EFS, alive, no need for further ERT or cellular therapy) was 49.5% (HCT), 73% (ERT-HCT), and 75.3% (ERT-GT; P < .01). Overall survival (OS) at 5 years after FDCT was 72.5% (HCT), 79.6% (ERT-HCT), and 100% (ERT-GT; P = .01). Five-year OS was superior for patients undergoing HCT at <3.5 months of age (91.6% vs 68% if ≥3.5 months, P = .02). Active infection at the time of HCT (regardless of ERT) decreased 5-year EFS (33.1% vs 68.2%, P < .01) and OS (64.7% vs 82.3%, P = .02). Five-year EFS (90.5%) and OS (100%) were best for matched sibling and matched family donors (MSD/MFD). For patients treated after the year 2000 and without active infection at the time of FDCT, no difference in 5-year EFS or OS was found between HCT using a variety of transplant approaches and ERT-GT. This suggests alternative donor HCT may be considered when MSD/MFD HCT and GT are not available, particularly when newborn screening identifies patients with ADA-SCID soon after birth and before the onset of infections. This trial was registered at www.clinicaltrials.gov as #NCT01186913 and #NCT01346150.

Lactoferrin intake from maternal milk during the neonatal hospitalization and early brain development among preterm infants.

BACKGROUND: Lactoferrin is an immuno-modulatory nutrient in human milk that may be neuroprotective. METHODS: In 36 infants born <32 weeks' gestation, we sampled human milk at 14 and 28 days of chronologic age and measured lactoferrin by electrochemiluminescence multiplex immunoassay. Using 3T quantitative brain magnetic resonance imaging scans obtained at term equivalent, we estimated total and regional brain volumes. We compared outcomes between infants exposed to low (bottom tertile, range 0.06-0.13 mg/mL) vs. high (top tertile, range 0.22-0.35 mg/mL) lactoferrin using median regression in models adjusted for gestational age, birth weight z-score, sex, and postmenstrual age. RESULTS: Compared to infants exposed to low lactoferrin, infants exposed to high lactoferrin had 43.9 cc (95% CI: 7.6, 80.4) larger total brain volume, 48.3 cc (95% CI: 12.1, 84.6) larger cortical gray matter, and 3.8 cc (95% CI: 0.7, 7.0) larger deep gray matter volume at term equivalent age. Other regional brain volumes were not statistically different between groups. CONCLUSION: Higher lactoferrin exposure during the neonatal hospitalization was associated with larger total brain and gray matter volumes, suggesting that lactoferrin may have potential as a dietary supplement to enhance brain growth in the neonatal intensive care unit setting. IMPACT: This study suggests that lactoferrin, a whey protein found in human milk, may be beneficial for preterm infant brain development, and therefore has potential as a dietary supplement in the neonatal intensive care unit setting.

Recommendations for Additional Imaging on Head and Neck Imaging Examinations: Interradiologist Variation and Associated Factors.

BACKGROUND. A paucity of relevant guidelines may lead to pronounced variation among radiologists in issuing recommendations for additional imaging (RAI) for head and neck imaging. OBJECTIVE. The purpose of this article was to explore associations of RAI for head and neck imaging examinations with examination, patient, and radiologist factors and to assess the role of individual radiologist-specific behavior in issuing such RAI. METHODS. This retrospective study included 39,200 patients (median age, 58 years; 21,855 women, 17,315 men, 30 with missing sex information) who underwent 39,200 head and neck CT or MRI examinations, interpreted by 61 radiologists, from June 1, 2021, through May 31, 2022. A natural language processing (NLP) tool with manual review of NLP results was used to identify RAI in report impressions. Interradiologist variation in RAI rates was assessed. A generalized mixed-effects model was used to assess associations between RAI and examination, patient, and radiologist factors. RESULTS. A total of 2943 (7.5%) reports contained RAI. Individual radiologist RAI rates ranged from 0.8% to 22.0% (median, 7.1%; IQR, 5.2-10.2%), representing a 27.5-fold difference between minimum and a maximum values and 1.8-fold difference between 25th and 75th percentiles. In multivariable analysis, RAI likelihood was higher for CTA than for CT examinations (OR, 1.32), for examinations that included a trainee in report generation (OR, 1.23), and for patients with self-identified race of Black or African American versus White (OR, 1.25); was lower for male than female patients (OR, 0.90); and was associated with increasing patient age (OR, 1.09 per decade) and inversely associated with radiologist years since training (OR, 0.90 per 5 years). The model accounted for 10.9% of the likelihood of RAI. Of explainable likelihood of RAI, 25.7% was attributable to examination, patient, and radiologist factors; 74.3% was attributable to radiologist-specific behavior. CONCLUSION. Interradiologist variation in RAI rates for head and neck imaging was substantial. RAI appear to be more substantially associated with individual radiologist-specific behavior than with measurable systemic factors. CLINICAL IMPACT. Quality improvement initiatives, incorporating best practices for incidental findings management, may help reduce radiologist preference-sensitive decision-making in issuing RAI for head and neck imaging and associated care variation.

Aberrant T-cell exhaustion in severe combined immunodeficiency survivors with poor T-cell reconstitution after transplantation.

BACKGROUND: Severe combined immunodeficiency (SCID) comprises rare inherited disorders of immunity that require definitive treatment through hematopoietic cell transplantation (HCT) or gene therapy for survival. Despite successes of allogeneic HCT, many SCID patients experience incomplete immune reconstitution, persistent T-cell lymphopenia, and poor long-term outcomes. OBJECTIVE: We hypothesized that CD4+ T-cell lymphopenia could be associated with a state of T-cell exhaustion in previously transplanted SCID patients. METHODS: We analyzed markers of exhaustion in blood samples from 61 SCID patients at a median of 10.4 years after HCT. RESULTS: Compared to post-HCT SCID patients with normal CD4+ T-cell counts, those with poor T-cell reconstitution showed lower frequency of naive CD45RA+/CCR7+ T cells, recent thymic emigrants, and TCR excision circles. They also had a restricted TCR repertoire, increased expression of inhibitory receptors (PD-1, 2B4, CD160, BTLA, CTLA-4), and increased activation markers (HLA-DR, perforin) on their total and naive CD8+ T cells, suggesting T-cell exhaustion and aberrant activation, respectively. The exhaustion score of CD8+ T cells was inversely correlated with CD4+ T-cell count, recent thymic emigrants, TCR excision circles, and TCR diversity. Exhaustion scores were higher among recipients of unconditioned HCT, especially when further in time from HCT. Patients with fewer CD4+ T cells showed a transcriptional signature of exhaustion. CONCLUSIONS: Recipients of unconditioned HCT for SCID may develop late post-HCT T-cell exhaustion as a result of diminished production of T-lineage cells. Elevated expression of inhibitory receptors on their T cells may be a biomarker of poor long-term T-cell reconstitution.

The diagnosis of severe combined immunodeficiency: Implementation of the PIDTC 2022 Definitions.

BACKGROUND: Shearer et al in 2014 articulated well-defined criteria for the diagnosis and classification of severe combined immunodeficiency (SCID) as part of the Primary Immune Deficiency Treatment Consortium's (PIDTC's) prospective and retrospective studies of SCID. OBJECTIVE: Because of the advent of newborn screening for SCID and expanded availability of genetic sequencing, revision of the PIDTC 2014 Criteria was needed. METHODS: We developed and tested updated PIDTC 2022 SCID Definitions by analyzing 379 patients proposed for prospective enrollment into Protocol 6901, focusing on the ability to distinguish patients with various SCID subtypes. RESULTS: According to PIDTC 2022 Definitions, 18 of 353 patients eligible per 2014 Criteria were considered not to have SCID, whereas 11 of 26 patients ineligible per 2014 Criteria were determined to have SCID. Of note, very low numbers of autologous T cells (<0.05 × 109/L) characterized typical SCID under the 2022 Definitions. Pathogenic variant(s) in SCID-associated genes was identified in 93% of patients, with 7 genes (IL2RG, RAG1, ADA, IL7R, DCLRE1C, JAK3, and RAG2) accounting for 89% of typical SCID. Three genotypes (RAG1, ADA, and RMRP) accounted for 57% of cases of leaky/atypical SCID; there were 13 other rare genotypes. Patients with leaky/atypical SCID were more likely to be diagnosed at more than age 1 year than those with typical SCID lacking maternal T cells: 20% versus 1% (P < .001). Although repeat testing proved important, an initial CD3 T-cell count of less than 0.05 × 109/L differentiated cases of typical SCID lacking maternal cells from leaky/atypical SCID: 97% versus 7% (P < .001). CONCLUSIONS: The PIDTC 2022 Definitions describe SCID and its subtypes more precisely than before, facilitating analyses of SCID characteristics and outcomes.

Intestinal microbiome and metabolome signatures in patients with chronic granulomatous disease.

BACKGROUND: Chronic granulomatous disease (CGD) is caused by defects in any 1 of the 6 subunits forming the nicotinamide adenine dinucleotide phosphate oxidase complex 2 (NOX2), leading to severely reduced or absent phagocyte-derived reactive oxygen species production. Almost 50% of patients with CGD have inflammatory bowel disease (CGD-IBD). While conventional IBD therapies can treat CGD-IBD, their benefits must be weighed against the risk of infection. Understanding the impact of NOX2 defects on the intestinal microbiota may lead to the identification of novel CGD-IBD treatments. OBJECTIVE: We sought to identify microbiome and metabolome signatures that can distinguish individuals with CGD and CGD-IBD. METHODS: We conducted a cross-sectional observational study of 79 patients with CGD, 8 pathogenic variant carriers, and 19 healthy controls followed at the National Institutes of Health Clinical Center. We profiled the intestinal microbiome (amplicon sequencing) and stool metabolome, and validated our findings in a second cohort of 36 patients with CGD recruited through the Primary Immune Deficiency Treatment Consortium. RESULTS: We identified distinct intestinal microbiome and metabolome profiles in patients with CGD compared to healthy individuals. We observed enrichment for Erysipelatoclostridium spp, Sellimonas spp, and Lachnoclostridium spp in CGD stool samples. Despite differences in bacterial alpha and beta diversity between the 2 cohorts, several taxa correlated significantly between both cohorts. We further demonstrated that patients with CGD-IBD have a distinct microbiome and metabolome profile compared to patients without CGD-IBD. CONCLUSION: Intestinal microbiome and metabolome signatures distinguished patients with CGD and CGD-IBD, and identified potential biomarkers and therapeutic targets.

Measuring people's views on health system performance: Design and development of the People's Voice Survey.

Todd Lewis and co-authors discuss development and use of the People's Voice Survey for health system assessment.

Development and External Validation of an Artificial Intelligence Model for Identifying Radiology Reports Containing Recommendations for Additional Imaging.

BACKGROUND. Reported rates of recommendations for additional imaging (RAIs) in radiology reports are low. Bidirectional encoder representations from transformers (BERT), a deep learning model pretrained to understand language context and ambiguity, has potential for identifying RAIs and thereby assisting large-scale quality improvement efforts. OBJECTIVE. The purpose of this study was to develop and externally validate an artificial intelligence (AI)-based model for identifying radiology reports containing RAIs. METHODS. This retrospective study was performed at a multisite health center. A total of 6300 radiology reports generated at one site from January 1, 2015, to June 30, 2021, were randomly selected and split by 4:1 ratio to create training (n = 5040) and test (n = 1260) sets. A total of 1260 reports generated at the center's other sites (including academic and community hospitals) from April 1 to April 30, 2022, were randomly selected as an external validation group. Referring practitioners and radiologists of varying sub-specialties manually reviewed report impressions for presence of RAIs. A BERT-based technique for identifying RAIs was developed by use of the training set. Performance of the BERT-based model and a previously developed traditional machine learning (TML) model was assessed in the test set. Finally, performance was assessed in the external validation set. The code for the BERT-based RAI model is publicly available. RESULTS. Among a total of 7419 unique patients (4133 women, 3286 men; mean age, 58.8 years), 10.0% of 7560 reports contained RAI. In the test set, the BERT-based model had 94.4% precision, 98.5% recall, and an F1 score of 96.4%. In the test set, the TML model had 69.0% precision, 65.4% recall, and an F1 score of 67.2%. In the test set, accuracy was greater for the BERT-based than for the TML model (99.2% vs 93.1%, p < .001). In the external validation set, the BERT-based model had 99.2% precision, 91.6% recall, an F1 score of 95.2%, and 99.0% accuracy. CONCLUSION. The BERT-based AI model accurately identified reports with RAIs, outperforming the TML model. High performance in the external validation set suggests the potential for other health systems to adapt the model without requiring institution-specific training. CLINICAL IMPACT. The model could potentially be used for real-time EHR monitoring for RAIs and other improvement initiatives to help ensure timely performance of clinically necessary recommended follow-up.

Predictors of Completion of Clinically Necessary Radiologist-Recommended Follow-Up Imaging: Assessment Using an Automated Closed-Loop Communication and Tracking Tool.

BACKGROUND. Patients with adverse social determinants of health may be at increased risk of not completing clinically necessary follow-up imaging. OBJECTIVE. The purpose of this study was to use an automated closed-loop communication and tracking tool to identify patient-, referrer-, and imaging-related factors associated with lack of completion of radiologist-recommended follow-up imaging. METHODS. This retrospective study was performed at a single academic health system. A tool for automated communication and tracking of radiologist-recommended follow-up imaging was embedded in the PACS and electronic health record. The tool prompted referrers to record whether they deemed recommendations to be clinically necessary and assessed whether clinically necessary follow-up imaging was pursued. If imaging was not performed within 1 month after the intended completion date, the tool prompted a safety net team to conduct further patient and referrer follow-up. The study included patients for whom a follow-up imaging recommendation deemed clinically necessary by the referrer was entered with the tool from October 21, 2019, through June 30, 2021. The electronic health record was reviewed for documentation of eventual completion of the recommended imaging at the study institution or an outside institution. Multivariable logistic regression analysis was performed to identify factors associated with completion of follow-up imaging. RESULTS. Of 5856 recommendations entered during the study period, the referrer agreed with 4881 recommendations in 4599 patients (2929 women, 1670 men; mean age, 61.3 ± 15.6 years), who formed the study sample. Follow-up was completed for 74.8% (3651/4881) of recommendations. Independent predictors of lower likelihood of completing follow-up imaging included living in a socioeconomically disadvantaged neighborhood according to the area deprivation index (odds ratio [OR], 0.67 [95% CI, 0.54-0.84]), inpatient (OR, 0.25 [95% CI, 0.20-0.32]) or emergency department (OR, 0.09 [95% CI, 0.05-0.15]) care setting, and referrer surgical specialty (OR, 0.70 [95% CI, 0.58-0.84]). Patient age, race and ethnicity, primary language, and insurance status were not independent predictors of completing follow-up (p > .05). CONCLUSION. Socioeconomically disadvantaged patients are at increased risk of not completing recommended follow-up imaging that referrers deem clinically necessary. CLINICAL IMPACT. Initiatives for ensuring completion of follow-up imaging should be aimed at the identified patient groups to reduce disparities in missed and delayed diagnoses.

Electronic Health Record Order Entry-Based Interventions in Response to a Global Iodinated Contrast Media Shortage: Impact on Contrast-Enhanced CT Utilization.

BACKGROUND. Radiology informatics systems and clinical decision support tools in the electronic health record (EHR) can be leveraged to help impact ordering patterns in response to the ongoing global iodinated contrast media shortage. OBJECTIVE. The purpose of our study was to assess the impact of EHR order entry-based interventions, implemented as part of a health system's response to the global contrast media shortage, on contrast-enhanced CT utilization. METHODS. This retrospective study included 79,259 patients who underwent CT at a large multisite health system between April 1, 2022, and July 3, 2022. Two EHR-based interventions were implemented as part of the health system's response to the global contrast media shortage. A first EHR-based intervention on May 10, 2022, entailed creating an alert that appeared in a sidebar after any contrast-enhanced body CT orders, indicating the present shortage and recommending alternate imaging modalities. A second EHR-based intervention on May 16, 2022, required referrers to enter detailed clinical information for all contrast-enhanced body CT orders, which radiologists used when protocoling examinations. Data regarding CT orders and examinations performed were extracted from the electronic data warehouse. RESULTS. During the preintervention, first postintervention, and second postintervention periods, the mean number of patients who underwent contrast-enhanced CT per weekday was 726, 689, and 639, respectively (p for preintervention vs second postintervention periods, < .001). During the three periods, the mean number of patients who underwent CT per weekday was 1350, 1323, and 1314 (p < .001). During the three periods, the mean number of patients who underwent contrast-enhanced body CT per weekday was 561, 532, and 492 (p < .001). During the three periods, the mean number of orders for CT with IV contrast media per weekday was 154, 143, and 131 (p < .001). During the three periods, the mean number of orders for CT without IV contrast media per weekday was 196, 202, and 221 (p < .001). CONCLUSION. EHR order entry-based interventions implemented in response to the global contrast media shortage significantly reduced contrast-enhanced CT utilization in a large health system. CLINICAL IMPACT. The findings indicate the ability to rapidly achieve changes in ordering clinician behavior and subsequent clinical practice using systemwide EHR changes.

Quality of routine health data at the onset of the COVID-19 pandemic in Ethiopia, Haiti, Laos, Nepal, and South Africa.

BACKGROUND: During the COVID-19 pandemic, governments and researchers have used routine health data to estimate potential declines in the delivery and uptake of essential health services. This research relies on the data being high quality and, crucially, on the data quality not changing because of the pandemic. In this paper, we investigated those assumptions and assessed data quality before and during COVID-19. METHODS: We obtained routine health data from the DHIS2 platforms in Ethiopia, Haiti, Lao People's Democratic Republic, Nepal, and South Africa (KwaZulu-Natal province) for a range of 40 indicators on essential health services and institutional deaths. We extracted data over 24 months (January 2019-December 2020) including pre-pandemic data and the first 9 months of the pandemic. We assessed four dimensions of data quality: reporting completeness, presence of outliers, internal consistency, and external consistency. RESULTS: We found high reporting completeness across countries and services and few declines in reporting at the onset of the pandemic. Positive outliers represented fewer than 1% of facility-month observations across services. Assessment of internal consistency across vaccine indicators found similar reporting of vaccines in all countries. Comparing cesarean section rates in the HMIS to those from population-representative surveys, we found high external consistency in all countries analyzed. CONCLUSIONS: While efforts remain to improve the quality of these data, our results show that several indicators in the HMIS can be reliably used to monitor service provision over time in these five countries.

Associations between the stringency of COVID-19 containment policies and health service disruptions in 10 countries.

BACKGROUND: Disruptions in essential health services during the COVID-19 pandemic have been reported in several countries. Yet, patterns in health service disruption according to country responses remain unclear. In this paper, we investigate associations between the stringency of COVID-19 containment policies and disruptions in 31 health services in 10 low- middle- and high-income countries in 2020. METHODS: Using routine health information systems and administrative data from 10 countries (Chile, Ethiopia, Ghana, Haiti, Lao People's Democratic Republic, Mexico, Nepal, South Africa, South Korea, and Thailand) we estimated health service disruptions for the period of April to December 2020 by dividing monthly service provision at national levels by the average service provision in the 15 months pre-COVID (January 2019-March 2020). We used the Oxford COVID-19 Government Response Tracker (OxCGRT) index and multi-level linear regression analyses to assess associations between the stringency of restrictions and health service disruptions over nine months. We extended the analysis by examining associations between 11 individual containment or closure policies and health service disruptions. Models were adjusted for COVID caseload, health service category and country GDP and included robust standard errors. FINDINGS: Chronic disease care was among the most affected services. Regression analyses revealed that a 10% increase in the mean stringency index was associated with a 3.3 percentage-point (95% CI -3.9, -2.7) reduction in relative service volumes. Among individual policies, curfews, and the presence of a state of emergency, had the largest coefficients and were associated with 14.1 (95% CI -19.6, 8.7) and 10.7 (95% CI -12.7, -8.7) percentage-point lower relative service volumes, respectively. In contrast, number of COVID-19 cases in 2020 was not associated with health service disruptions in any model. CONCLUSIONS: Although containment policies were crucial in reducing COVID-19 mortality in many contexts, it is important to consider the indirect effects of these restrictions. Strategies to improve the resilience of health systems should be designed to ensure that populations can continue accessing essential health care despite the presence of containment policies during future infectious disease outbreaks.

Tracking health system performance in times of crisis using routine health data: lessons learned from a multicountry consortium.

COVID-19 has prompted the use of readily available administrative data to track health system performance in times of crisis and to monitor disruptions in essential healthcare services. In this commentary we describe our experience working with these data and lessons learned across countries. Since April 2020, the Quality Evidence for Health System Transformation (QuEST) network has used administrative data and routine health information systems (RHIS) to assess health system performance during COVID-19 in Chile, Ethiopia, Ghana, Haiti, Lao People's Democratic Republic, Mexico, Nepal, South Africa, Republic of Korea and Thailand. We compiled a large set of indicators related to common health conditions for the purpose of multicountry comparisons. The study compiled 73 indicators. A total of 43% of the indicators compiled pertained to reproductive, maternal, newborn and child health (RMNCH). Only 12% of the indicators were related to hypertension, diabetes or cancer care. We also found few indicators related to mental health services and outcomes within these data systems. Moreover, 72% of the indicators compiled were related to volume of services delivered, 18% to health outcomes and only 10% to the quality of processes of care. While several datasets were complete or near-complete censuses of all health facilities in the country, others excluded some facility types or population groups. In some countries, RHIS did not capture services delivered through non-visit or nonconventional care during COVID-19, such as telemedicine. We propose the following recommendations to improve the analysis of administrative and RHIS data to track health system performance in times of crisis: ensure the scope of health conditions covered is aligned with the burden of disease, increase the number of indicators related to quality of care and health outcomes; incorporate data on nonconventional care such as telehealth; continue improving data quality and expand reporting from private sector facilities; move towards collecting patient-level data through electronic health records to facilitate quality-of-care assessment and equity analyses; implement more resilient and standardized health information technologies; reduce delays and loosen restrictions for researchers to access the data; complement routine data with patient-reported data; and employ mixed methods to better understand the underlying causes of service disruptions.