Managing differential performance of polygenic risk scores across groups: Real-world experience of the eMERGE Network.

The differential performance of polygenic risk scores (PRSs) by group is one of the major ethical barriers to their clinical use. It is also one of the main practical challenges for any implementation effort. The social repercussions of how people are grouped in PRS research must be considered in communications with research participants, including return of results. Here, we outline the decisions faced and choices made by a large multi-site clinical implementation study returning PRSs to diverse participants in handling this issue of differential performance. Our approach to managing the complexities associated with the differential performance of PRSs serves as a case study that can help future implementers of PRSs to plot an anticipatory course in response to this issue.

Risk factors affecting polygenic score performance across diverse cohorts.

Apart from ancestry, personal or environmental covariates may contribute to differences in polygenic score (PGS) performance. We analyzed effects of covariate stratification and interaction on body mass index (BMI) PGS (PGSBMI) across four cohorts of European (N=491,111) and African (N=21,612) ancestry. Stratifying on binary covariates and quintiles for continuous covariates, 18/62 covariates had significant and replicable R2 differences among strata. Covariates with the largest differences included age, sex, blood lipids, physical activity, and alcohol consumption, with R2 being nearly double between best and worst performing quintiles for certain covariates. 28 covariates had significant PGSBMI-covariate interaction effects, modifying PGSBMI effects by nearly 20% per standard deviation change. We observed overlap between covariates that had significant R2 differences among strata and interaction effects - across all covariates, their main effects on BMI were correlated with their maximum R2 differences and interaction effects (0.56 and 0.58, respectively), suggesting high-PGSBMI individuals have highest R2 and increase in PGS effect. Using quantile regression, we show the effect of PGSBMI increases as BMI itself increases, and that these differences in effects are directly related to differences in R2 when stratifying by different covariates. Given significant and replicable evidence for context-specific PGSBMI performance and effects, we investigated ways to increase model performance taking into account non-linear effects. Machine learning models (neural networks) increased relative model R2 (mean 23%) across datasets. Finally, creating PGSBMI directly from GxAge GWAS effects increased relative R2 by 7.8%. These results demonstrate that certain covariates, especially those most associated with BMI, significantly affect both PGSBMI performance and effects across diverse cohorts and ancestries, and we provide avenues to improve model performance that consider these effects.

Clinical associations with a polygenic predisposition to benign lower white blood cell counts.

Polygenic variation unrelated to disease contributes to interindividual variation in baseline white blood cell (WBC) counts, but its clinical significance is uncharacterized. We investigated the clinical consequences of a genetic predisposition toward lower WBC counts among 89,559 biobank participants from tertiary care centers using a polygenic score for WBC count (PGSWBC) comprising single nucleotide polymorphisms not associated with disease. A predisposition to lower WBC counts was associated with a decreased risk of identifying pathology on a bone marrow biopsy performed for a low WBC count (odds-ratio = 0.55 per standard deviation increase in PGSWBC [95%CI, 0.30-0.94], p = 0.04), an increased risk of leukopenia (a low WBC count) when treated with a chemotherapeutic (n = 1724, hazard ratio [HR] = 0.78 [0.69-0.88], p = 4.0 × 10-5) or immunosuppressant (n = 354, HR = 0.61 [0.38-0.99], p = 0.04). A predisposition to benign lower WBC counts was associated with an increased risk of discontinuing azathioprine treatment (n = 1,466, HR = 0.62 [0.44-0.87], p = 0.006). Collectively, these findings suggest that there are genetically predisposed individuals who are susceptible to escalations or alterations in clinical care that may be harmful or of little benefit.

Genetic sex validation for sample tracking in next-generation sequencing clinical testing.

OBJECTIVE: Data from DNA genotyping via a 96-SNP panel in a study of 25,015 clinical samples were utilized for quality control and tracking of sample identity in a clinical sequencing network. The study aimed to demonstrate the value of both the precise SNP tracking and the utility of the panel for predicting the sex-by-genotype of the participants, to identify possible sample mix-ups. RESULTS: Precise SNP tracking showed no sample swap errors within the clinical testing laboratories. In contrast, when comparing predicted sex-by-genotype to the provided sex on the test requisition, we identified 110 inconsistencies from 25,015 clinical samples (0.44%), that had occurred during sample collection or accessioning. The genetic sex predictions were confirmed using additional SNP sites in the sequencing data or high-density genotyping arrays. It was determined that discrepancies resulted from clerical errors (49.09%), samples from transgender participants (3.64%) and stem cell or bone marrow transplant patients (7.27%) along with undetermined sample mix-ups (40%) for which sample swaps occurred prior to arrival at genome centers, however the exact cause of the events at the sampling sites resulting in the mix-ups were not able to be determined.

Selection, optimization and validation of ten chronic disease polygenic risk scores for clinical implementation in diverse US populations.

Polygenic risk scores (PRSs) have improved in predictive performance, but several challenges remain to be addressed before PRSs can be implemented in the clinic, including reduced predictive performance of PRSs in diverse populations, and the interpretation and communication of genetic results to both providers and patients. To address these challenges, the National Human Genome Research Institute-funded Electronic Medical Records and Genomics (eMERGE) Network has developed a framework and pipeline for return of a PRS-based genome-informed risk assessment to 25,000 diverse adults and children as part of a clinical study. From an initial list of 23 conditions, ten were selected for implementation based on PRS performance, medical actionability and potential clinical utility, including cardiometabolic diseases and cancer. Standardized metrics were considered in the selection process, with additional consideration given to strength of evidence in African and Hispanic populations. We then developed a pipeline for clinical PRS implementation (score transfer to a clinical laboratory, validation and verification of score performance), and used genetic ancestry to calibrate PRS mean and variance, utilizing genetically diverse data from 13,475 participants of the All of Us Research Program cohort to train and test model parameters. Finally, we created a framework for regulatory compliance and developed a PRS clinical report for return to providers and for inclusion in an additional genome-informed risk assessment. The initial experience from eMERGE can inform the approach needed to implement PRS-based testing in diverse clinical settings.

Comparing ancestry calibration approaches for a trans-ancestry colorectal cancer polygenic risk score.

Background: Colorectal cancer (CRC) is a complex disease with monogenic, polygenic and environmental risk factors. Polygenic risk scores (PRS) are being developed to identify high polygenic risk individuals. Due to differences in genetic background, PRS distributions vary by ancestry, necessitating calibration. Methods: We compared four calibration methods using the All of Us Research Program Whole Genome Sequence data for a CRC PRS previously developed in participants of European and East Asian ancestry. The methods contrasted results from linear models with A) the entire data set or an ancestrally diverse training set AND B) covariates including principal components of ancestry or admixture. Calibration with the training set adjusted the variance in addition to the mean. Results: All methods performed similarly within ancestry with OR (95% C.I.) per s.d. change in PRS: African 1.5 (1.02, 2.08), Admixed American 2.2 (1.27, 3.85), European 1.6 (1.43, 1.89), and Middle Eastern 1.1 (0.71, 1.63). Using admixture and an ancestrally diverse training set provided distributions closest to standard Normal with accurate upper tail frequencies. Conclusion: Although the PRS is predictive of CRC risk for most ancestries, its performance varies by ancestry. Post-hoc calibration preserves the risk prediction within ancestries. Training a calibration model on ancestrally diverse participants to adjust both the mean and variance of the PRS, using admixture as covariates, created standard Normal z-scores. These z-scores can be used to identify patients at high polygenic risk, and can be incorporated into comprehensive risk scores including other known risk factors, allowing for more precise risk estimates.

Genetic Sex Validation for Sample Tracking in Clinical Testing.

Objective: Data from DNA genotyping via a 96-SNP panel in a study of 25,015 clinical samples were utilized for quality control and tracking of sample identity in a clinical sequencing network. The study aimed to demonstrate the value of both the precise SNP tracking and the utility of the panel for predicting the sex-by-genotype of the participants, to identify possible sample mix-ups. Results: Precise SNP tracking showed no sample swap errors within the clinical testing laboratories. In contrast, when comparing predicted sex-by-genotype to the provided sex on the test requisition, we identified 110 inconsistencies from 25,015 clinical samples (0.44%), that had occurred during sample collection or accessioning. The genetic sex predictions were confirmed using additional SNP sites in the sequencing data or high-density genotyping arrays. It was determined that discrepancies resulted from clerical errors, samples from transgender participants and stem cell or bone marrow transplant patients along with undetermined sample mix-ups.

Prospective, multi-site study of healthcare utilization after actionable monogenic findings from clinical sequencing.

As large-scale genomic screening becomes increasingly prevalent, understanding the influence of actionable results on healthcare utilization is key to estimating the potential long-term clinical impact. The eMERGE network sequenced individuals for actionable genes in multiple genetic conditions and returned results to individuals, providers, and the electronic health record. Differences in recommended health services (laboratory, imaging, and procedural testing) delivered within 12 months of return were compared among individuals with pathogenic or likely pathogenic (P/LP) findings to matched individuals with negative findings before and after return of results. Of 16,218 adults, 477 unselected individuals were found to have a monogenic risk for arrhythmia (n = 95), breast cancer (n = 96), cardiomyopathy (n = 95), colorectal cancer (n = 105), or familial hypercholesterolemia (n = 86). Individuals with P/LP results more frequently received services after return (43.8%) compared to before return (25.6%) of results and compared to individuals with negative findings (24.9%; p < 0.0001). The annual cost of qualifying healthcare services increased from an average of $162 before return to $343 after return of results among the P/LP group (p < 0.0001); differences in the negative group were non-significant. The mean difference-in-differences was $149 (p < 0.0001), which describes the increased cost within the P/LP group corrected for cost changes in the negative group. When stratified by individual conditions, significant cost differences were observed for arrhythmia, breast cancer, and cardiomyopathy. In conclusion, less than half of individuals received billed health services after monogenic return, which modestly increased healthcare costs for payors in the year following return.

Synchronized long-read genome, methylome, epigenome, and transcriptome for resolving a Mendelian condition.

Resolving the molecular basis of a Mendelian condition (MC) remains challenging owing to the diverse mechanisms by which genetic variants cause disease. To address this, we developed a synchronized long-read genome, methylome, epigenome, and transcriptome sequencing approach, which enables accurate single-nucleotide, insertion-deletion, and structural variant calling and diploid de novo genome assembly, and permits the simultaneous elucidation of haplotype-resolved CpG methylation, chromatin accessibility, and full-length transcript information in a single long-read sequencing run. Application of this approach to an Undiagnosed Diseases Network (UDN) participant with a chromosome X;13 balanced translocation of uncertain significance revealed that this translocation disrupted the functioning of four separate genes (NBEA, PDK3, MAB21L1, and RB1) previously associated with single-gene MCs. Notably, the function of each gene was disrupted via a distinct mechanism that required integration of the four 'omes' to resolve. These included nonsense-mediated decay, fusion transcript formation, enhancer adoption, transcriptional readthrough silencing, and inappropriate X chromosome inactivation of autosomal genes. Overall, this highlights the utility of synchronized long-read multi-omic profiling for mechanistically resolving complex phenotypes.

Genetic variation in the human leukocyte antigen region confers susceptibility to Clostridioides difficile infection.

Clostridioides difficile (C. diff.) infection (CDI) is a leading cause of hospital acquired diarrhea in North America and Europe and a major cause of morbidity and mortality. Known risk factors do not fully explain CDI susceptibility, and genetic susceptibility is suggested by the fact that some patients with colons that are colonized with C. diff. do not develop any infection while others develop severe or recurrent infections. To identify common genetic variants associated with CDI, we performed a genome-wide association analysis in 19,861 participants (1349 cases; 18,512 controls) from the Electronic Medical Records and Genomics (eMERGE) Network. Using logistic regression, we found strong evidence for genetic variation in the DRB locus of the MHC (HLA) II region that predisposes individuals to CDI (P > 1.0 × 10-14; OR 1.56). Altered transcriptional regulation in the HLA region may play a role in conferring susceptibility to this opportunistic enteric pathogen.

Clinical consequences of a polygenic predisposition to benign lower white blood cell counts: Consequences of benign WBC count genetics.

Polygenic variation unrelated to disease contributes to interindividual variation in baseline white blood cell (WBC) counts, but its clinical significance is undefined. We investigated the clinical consequences of a genetic predisposition toward lower WBC counts among 89,559 biobank participants from tertiary care centers using a polygenic score for WBC count (PGSWBC) comprising single nucleotide polymorphisms not associated with disease. A predisposition to lower WBC counts was associated with a decreased risk of identifying pathology on a bone marrow biopsy performed for a low WBC count (odds-ratio=0.55 per standard deviation increase in PGSWBC [95%CI, 0.30 - 0.94], p=0.04), an increased risk of leukopenia (a low WBC count) when treated with a chemotherapeutic (n=1,724, hazard ratio [HR]=0.78 [0.69 - 0.88], p=4.0×10-5) or immunosuppressant (n=354, HR=0.61 [0.38 - 0.99], p=0.04). A predisposition to benign lower WBC counts was associated with an increased risk of discontinuing azathioprine treatment (n=1,466, HR=0.62 [0.44 - 0.87], p=0.006). Collectively, these findings suggest that a WBC count polygenic score identifies individuals who are susceptible to escalations or alterations in clinical care that may be harmful or of little benefit.

Full-length Isoform Sequencing for Resolving the Molecular Basis of Charcot-Marie-Tooth 2A.

Objectives: Transcript sequencing of patient-derived samples has been shown to improve the diagnostic yield for solving cases of suspected Mendelian conditions, yet the added benefit of full-length long-read transcript sequencing is largely unexplored. Methods: We applied short-read and full-length transcript sequencing and mitochondrial functional studies to a patient-derived fibroblast cell line from an individual with neuropathy that previously lacked a molecular diagnosis. Results: We identified an intronic homozygous MFN2 c.600-31T>G variant that disrupts the branch point critical for intron 6 splicing. Full-length long-read isoform complementary DNA (cDNA) sequencing after treatment with a nonsense-mediated mRNA decay (NMD) inhibitor revealed that this variant creates 5 distinct altered splicing transcripts. All 5 altered splicing transcripts have disrupted open reading frames and are subject to NMD. Furthermore, a patient-derived fibroblast line demonstrated abnormal lipid droplet formation, consistent with MFN2 dysfunction. Although correctly spliced full-length MFN2 transcripts are still produced, this branch point variant results in deficient MFN2 levels and autosomal recessive Charcot-Marie-Tooth disease, axonal, type 2A (CMT2A). Discussion: This case highlights the utility of full-length isoform sequencing for characterizing the molecular mechanism of undiagnosed rare diseases and expands our understanding of the genetic basis for CMT2A.

Genetic Architecture of Dilated Cardiomyopathy in Individuals of African and European Ancestry.

Importance: Black patients with dilated cardiomyopathy (DCM) have increased familial risk and worse outcomes than White patients, but most DCM genetic data are from White patients. Objective: To compare the rare variant genetic architecture of DCM by genomic ancestry within a diverse population of patients with DCM. Design: Cross-sectional study enrolling patients with DCM who self-identified as non-Hispanic Black, Hispanic, or non-Hispanic White from June 7, 2016, to March 15, 2020, at 25 US advanced heart failure programs. Variants in 36 DCM genes were adjudicated as pathogenic, likely pathogenic, or of uncertain significance. Exposure: Presence of DCM. Main Outcomes and Measures: Variants in DCM genes classified as pathogenic/likely pathogenic/uncertain significance and clinically actionable (pathogenic/likely pathogenic). Results: A total of 505, 667, and 26 patients with DCM of predominantly African, European, or Native American genomic ancestry, respectively, were included. Compared with patients of European ancestry, a lower percentage of patients of African ancestry had clinically actionable variants (8.2% [95% CI, 5.2%-11.1%] vs 25.5% [95% CI, 21.3%-29.6%]), reflecting the lower odds of a clinically actionable variant for those with any pathogenic variant/likely pathogenic variant/variant of uncertain significance (odds ratio, 0.25 [95% CI, 0.17-0.37]). On average, patients of African ancestry had fewer clinically actionable variants in TTN (difference, -0.09 [95% CI, -0.14 to -0.05]) and other genes with predicted loss of function as a disease-causing mechanism (difference, -0.06 [95% CI, -0.11 to -0.02]). However, the number of pathogenic variants/likely pathogenic variants/variants of uncertain significance was more comparable between ancestry groups (difference, -0.07 [95% CI, -0.22 to 0.09]) due to a larger number of non-TTN non-predicted loss of function variants of uncertain significance, mostly missense, in patients of African ancestry (difference, 0.15 [95% CI, 0.00-0.30]). Published clinical case-based evidence supporting pathogenicity was less available for variants found only in patients of African ancestry (P < .001). Conclusion and Relevance: Patients of African ancestry with DCM were less likely to have clinically actionable variants in DCM genes than those of European ancestry due to differences in genetic architecture and a lack of representation of African ancestry in clinical data sets.

Evaluating construct validity of computable acute respiratory distress syndrome definitions in adults hospitalized with COVID-19: an electronic health records based approach.

BACKGROUND: Evolving ARDS epidemiology and management during COVID-19 have prompted calls to reexamine the construct validity of Berlin criteria, which have been rarely evaluated in real-world data. We developed a Berlin ARDS definition (EHR-Berlin) computable in electronic health records (EHR) to (1) assess its construct validity, and (2) assess how expanding its criteria affected validity. METHODS: We performed a retrospective cohort study at two tertiary care hospitals with one EHR, among adults hospitalized with COVID-19 February 2020-March 2021. We assessed five candidate definitions for ARDS: the EHR-Berlin definition modeled on Berlin criteria, and four alternatives informed by recent proposals to expand criteria and include patients on high-flow oxygen (EHR-Alternative 1), relax imaging criteria (EHR-Alternatives 2-3), and extend timing windows (EHR-Alternative 4). We evaluated two aspects of construct validity for the EHR-Berlin definition: (1) criterion validity: agreement with manual ARDS classification by experts, available in 175 patients; (2) predictive validity: relationships with hospital mortality, assessed by Pearson r and by area under the receiver operating curve (AUROC). We assessed predictive validity and timing of identification of EHR-Berlin definition compared to alternative definitions. RESULTS: Among 765 patients, mean (SD) age was 57 (18) years and 471 (62%) were male. The EHR-Berlin definition classified 171 (22%) patients as ARDS, which had high agreement with manual classification (kappa 0.85), and was associated with mortality (Pearson r = 0.39; AUROC 0.72, 95% CI 0.68, 0.77). In comparison, EHR-Alternative 1 classified 219 (29%) patients as ARDS, maintained similar relationships to mortality (r = 0.40; AUROC 0.74, 95% CI 0.70, 0.79, Delong test P = 0.14), and identified patients earlier in their hospitalization (median 13 vs. 15 h from admission, Wilcoxon signed-rank test P < 0.001). EHR-Alternative 3, which removed imaging criteria, had similar correlation (r = 0.41) but better discrimination for mortality (AUROC 0.76, 95% CI 0.72, 0.80; P = 0.036), and identified patients median 2 h (P < 0.001) from admission. CONCLUSIONS: The EHR-Berlin definition can enable ARDS identification with high criterion validity, supporting large-scale study and surveillance. There are opportunities to expand the Berlin criteria that preserve predictive validity and facilitate earlier identification.

Longitudinal adherence to breast cancer surveillance following cancer genetic testing in an integrated health care system.

PURPOSE: Screening with mammography and breast magnetic resonance imaging (MRI) is an important risk management strategy for individuals with inherited pathogenic variants (PVs) in genes associated with increased breast cancer risk. We describe longitudinal screening adherence in individuals who underwent cancer genetic testing as part of usual care in a vertically integrated health system. METHODS: We determined the proportion time covered (PTC) by annual mammography and breast MRI for individuals with PVs in TP53, BRCA1, BRCA2, PALB2, NF1, CHEK2, and ATM. We determined time covered by biennial mammography beginning at age 50 years for individuals who received negative results, uncertain results, or with PVs in genes without specific breast cancer screening recommendations. RESULTS: One hundred and forty individuals had PVs in TP53, BRCA1, BRCA2, PALB2, NF1, CHEK2, or ATM. Among these individuals, average PTC was 48% (range 0-99%) for annual screening mammography and 34% (range 0-100%) for annual breast MRI. Average PTC was highest for individuals with PVs in CHEK2 (N = 14) and lowest for individuals with PVs in TP53 (N = 3). Average PTC for biennial mammography (N = 1,027) was 49% (0-100%). CONCLUSION: Longitudinal screening adherence in individuals with PVs in breast cancer associated genes, as measured by the proportion of time covered, is low; adherence to annual breast MRI falls below that of annual mammography. Additional research should examine screening behavior in individuals with PVs in breast cancer associated genes with a goal of developing interventions to improve adherence to recommended risk management.

Selection, optimization, and validation of ten chronic disease polygenic risk scores for clinical implementation in diverse populations.

Polygenic risk scores (PRS) have improved in predictive performance supporting their use in clinical practice. Reduced predictive performance of PRS in diverse populations can exacerbate existing health disparities. The NHGRI-funded eMERGE Network is returning a PRS-based genome-informed risk assessment to 25,000 diverse adults and children. We assessed PRS performance, medical actionability, and potential clinical utility for 23 conditions. Standardized metrics were considered in the selection process with additional consideration given to strength of evidence in African and Hispanic populations. Ten conditions were selected with a range of high-risk thresholds: atrial fibrillation, breast cancer, chronic kidney disease, coronary heart disease, hypercholesterolemia, prostate cancer, asthma, type 1 diabetes, obesity, and type 2 diabetes. We developed a pipeline for clinical PRS implementation, used genetic ancestry to calibrate PRS mean and variance, created a framework for regulatory compliance, and developed a PRS clinical report. eMERGE's experience informs the infrastructure needed to implement PRS-based implementation in diverse clinical settings.

Dominant-negative variant in SLC1A4 causes an autosomal dominant epilepsy syndrome.

SLC1A4 is a trimeric neutral amino acid transporter essential for shuttling L-serine from astrocytes into neurons. Individuals with biallelic variants in SLC1A4 are known to have spastic tetraplegia, thin corpus callosum, and progressive microcephaly (SPATCCM) syndrome, but individuals with heterozygous variants are not thought to have disease. We identify an 8-year-old patient with global developmental delay, spasticity, epilepsy, and microcephaly who has a de novo heterozygous three amino acid duplication in SLC1A4 (L86_M88dup). We demonstrate that L86_M88dup causes a dominant-negative N-glycosylation defect of SLC1A4, which in turn reduces the plasma membrane localization of SLC1A4 and the transport rate of SLC1A4 for L-serine.