Lessons learned and recommendations for data coordination in collaborative research: The CSER consortium experience.

Integrating data across heterogeneous research environments is a key challenge in multi-site, collaborative research projects. While it is important to allow for natural variation in data collection protocols across research sites, it is also important to achieve interoperability between datasets in order to reap the full benefits of collaborative work. However, there are few standards to guide the data coordination process from project conception to completion. In this paper, we describe the experiences of the Clinical Sequence Evidence-Generating Research (CSER) consortium Data Coordinating Center (DCC), which coordinated harmonized survey and genomic sequencing data from seven clinical research sites from 2020 to 2022. Using input from multiple consortium working groups and from CSER leadership, we first identify 14 lessons learned from CSER in the categories of communication, harmonization, informatics, compliance, and analytics. We then distill these lessons learned into 11 recommendations for future research consortia in the areas of planning, communication, informatics, and analytics. We recommend that planning and budgeting for data coordination activities occur as early as possible during consortium conceptualization and development to minimize downstream complications. We also find that clear, reciprocal, and continuous communication between consortium stakeholders and the DCC is equally important to maintaining a secure and centralized informatics ecosystem for pooling data. Finally, we discuss the importance of actively interrogating current approaches to data governance, particularly for research studies that straddle the research-clinical divide.

Variant Classification Concordance using the ACMG-AMP Variant Interpretation Guidelines across Nine Genomic Implementation Research Studies.

Harmonization of variant pathogenicity classification across laboratories is important for advancing clinical genomics. The two CLIA-accredited Electronic Medical Record and Genomics Network sequencing centers and the six CLIA-accredited laboratories and one research laboratory performing genome or exome sequencing in the Clinical Sequencing Evidence-Generating Research Consortium collaborated to explore current sources of discordance in classification. Eight laboratories each submitted 20 classified variants in the ACMG secondary finding v.2.0 genes. After removing duplicates, each of the 158 variants was annotated and independently classified by two additional laboratories using the ACMG-AMP guidelines. Overall concordance across three laboratories was assessed and discordant variants were reviewed via teleconference and email. The submitted variant set included 28 P/LP variants, 96 VUS, and 34 LB/B variants, mostly in cancer (40%) and cardiac (27%) risk genes. Eighty-six (54%) variants reached complete five-category (i.e., P, LP, VUS, LB, B) concordance, and 17 (11%) had a discordance that could affect clinical recommendations (P/LP versus VUS/LB/B). 21% and 63% of variants submitted as P and LP, respectively, were discordant with VUS. Of the 54 originally discordant variants that underwent further review, 32 reached agreement, for a post-review concordance rate of 84% (118/140 variants). This project provides an updated estimate of variant concordance, identifies considerations for LP classified variants, and highlights ongoing sources of discordance. Continued and increased sharing of variant classifications and evidence across laboratories, and the ongoing work of ClinGen to provide general as well as gene- and disease-specific guidance, will lead to continued increases in concordance.

Lessons learned about harmonizing survey measures for the CSER consortium.

INTRODUCTION: Implementation of genome-scale sequencing in clinical care has significant challenges: the technology is highly dimensional with many kinds of potential results, results interpretation and delivery require expertise and coordination across multiple medical specialties, clinical utility may be uncertain, and there may be broader familial or societal implications beyond the individual participant. Transdisciplinary consortia and collaborative team science are well poised to address these challenges. However, understanding the complex web of organizational, institutional, physical, environmental, technologic, and other political and societal factors that influence the effectiveness of consortia is understudied. We describe our experience working in the Clinical Sequencing Evidence-Generating Research (CSER) consortium, a multi-institutional translational genomics consortium. METHODS: A key aspect of the CSER consortium was the juxtaposition of site-specific measures with the need to identify consensus measures related to clinical utility and to create a core set of harmonized measures. During this harmonization process, we sought to minimize participant burden, accommodate project-specific choices, and use validated measures that allow data sharing. RESULTS: Identifying platforms to ensure swift communication between teams and management of materials and data were essential to our harmonization efforts. Funding agencies can help consortia by clarifying key study design elements across projects during the proposal preparation phase and by providing a framework for data sharing data across participating projects. CONCLUSIONS: In summary, time and resources must be devoted to developing and implementing collaborative practices as preparatory work at the beginning of project timelines to improve the effectiveness of research consortia.

The Genomic Medicine Integrative Research Framework: A Conceptual Framework for Conducting Genomic Medicine Research.

Conceptual frameworks are useful in research because they can highlight priority research domains, inform decisions about interventions, identify outcomes and factors to measure, and display how factors might relate to each other to generate and test hypotheses. Discovery, translational, and implementation research are all critical to the overall mission of genomic medicine and prevention, but they have yet to be organized into a unified conceptual framework. To fill this gap, our diverse team collaborated to develop the Genomic Medicine Integrative Research (GMIR) Framework, a simple but comprehensive tool to aid the genomics community in developing research questions, strategies, and measures and in integrating genomic medicine and prevention into clinical practice. Here we present the GMIR Framework and its development, along with examples of its use for research development, demonstrating how we applied it to select and harmonize measures for use across diverse genomic medicine implementation projects. Researchers can utilize the GMIR Framework for their own research, collaborative investigations, and clinical implementation efforts; clinicians can use it to establish and evaluate programs; and all stakeholders can use it to help allocate resources and make sure that the full complexity of etiology is included in research and program design, development, and evaluation.

Correction: Secondary findings from clinical genomic sequencing: prevalence, patient perspectives, family history assessment, and health-care costs from a multisite study.

The originally published version of this Article contained errors in Fig. 2. The numbers below the black arrowheads were incorrect; please see incorrect Figure in associated Correction. These errors have now been corrected in the PDF and HTML versions of the Article.

Secondary findings from clinical genomic sequencing: prevalence, patient perspectives, family history assessment, and health-care costs from a multisite study.

PURPOSE: Clinical sequencing emerging in health care may result in secondary findings (SFs). METHODS: Seventy-four of 6240 (1.2%) participants who underwent genome or exome sequencing through the Clinical Sequencing Exploratory Research (CSER) Consortium received one or more SFs from the original American College of Medical Genetics and Genomics (ACMG) recommended 56 gene-condition pair list; we assessed clinical and psychosocial actions. RESULTS: The overall adjusted prevalence of SFs in the ACMG 56 genes across the CSER consortium was 1.7%. Initially 32% of the family histories were positive, and post disclosure, this increased to 48%. The average cost of follow-up medical actions per finding up to a 1-year period was $128 (observed, range: $0-$678) and $421 (recommended, range: $141-$1114). Case reports revealed variability in the frequency of and follow-up on medical recommendations patients received associated with each SF gene-condition pair. Participants did not report adverse psychosocial impact associated with receiving SFs; this was corroborated by 18 participant (or parent) interviews. All interviewed participants shared findings with relatives and reported that relatives did not pursue additional testing or care. CONCLUSION: Our results suggest that disclosure of SFs shows little to no adverse impact on participants and adds only modestly to near-term health-care costs; additional studies are needed to confirm these findings.

The Clinical Sequencing Evidence-Generating Research Consortium: Integrating Genomic Sequencing in Diverse and Medically Underserved Populations.

The Clinical Sequencing Evidence-Generating Research (CSER) consortium, now in its second funding cycle, is investigating the effectiveness of integrating genomic (exome or genome) sequencing into the clinical care of diverse and medically underserved individuals in a variety of healthcare settings and disease states. The consortium comprises a coordinating center, six funded extramural clinical projects, and an ongoing National Human Genome Research Institute (NHGRI) intramural project. Collectively, these projects aim to enroll and sequence over 6,100 participants in four years. At least 60% of participants will be of non-European ancestry or from underserved settings, with the goal of diversifying the populations that are providing an evidence base for genomic medicine. Five of the six clinical projects are enrolling pediatric patients with various phenotypes. One of these five projects is also enrolling couples whose fetus has a structural anomaly, and the sixth project is enrolling adults at risk for hereditary cancer. The ongoing NHGRI intramural project has enrolled primarily healthy adults. Goals of the consortium include assessing the clinical utility of genomic sequencing, exploring medical follow up and cascade testing of relatives, and evaluating patient-provider-laboratory level interactions that influence the use of this technology. The findings from the CSER consortium will offer patients, healthcare systems, and policymakers a clearer understanding of the opportunities and challenges of providing genomic medicine in diverse populations and settings, and contribute evidence toward developing best practices for the delivery of clinically useful and cost-effective genomic sequencing in diverse healthcare settings.

Anticipated responses of early adopter genetic specialists and nongenetic specialists to unsolicited genomic secondary findings.

PURPOSE: Secondary findings from genomic sequencing are becoming more common. We compared how health-care providers with and without specialized genetics training anticipated responding to different types of secondary findings. METHODS: Providers with genomic sequencing experience reviewed five secondary-findings reports and reported attitudes and potential clinical follow-up. Analyses compared genetic specialists and physicians without specialized genetics training, and examined how responses varied by secondary finding. RESULTS: Genetic specialists scored higher than other providers on four-point scales assessing understandings of reports (3.89 vs. 3.42, p = 0.0002), and lower on scales assessing reporting obligations (2.60 vs. 3.51, p < 0.0001) and burdens of responding (1.73 vs. 2.70, p < 0.0001). Nearly all attitudes differed between findings, although genetic specialists were more likely to assert that laboratories had no obligations when findings had less-established actionability (p < 0.0001 in interaction tests). The importance of reviewing personal and family histories, documenting findings, learning more about the variant, and recommending familial discussions also varied according to finding (all p < 0.0001). CONCLUSION: Genetic specialists felt better prepared to respond to secondary findings than providers without specialized genetics training, but perceived fewer obligations for laboratories to report them, and the two groups anticipated similar clinical responses. Findings may inform development of targeted education and support.

Performance of ACMG-AMP Variant-Interpretation Guidelines among Nine Laboratories in the Clinical Sequencing Exploratory Research Consortium.

Evaluating the pathogenicity of a variant is challenging given the plethora of types of genetic evidence that laboratories consider. Deciding how to weigh each type of evidence is difficult, and standards have been needed. In 2015, the American College of Medical Genetics and Genomics (ACMG) and the Association for Molecular Pathology (AMP) published guidelines for the assessment of variants in genes associated with Mendelian diseases. Nine molecular diagnostic laboratories involved in the Clinical Sequencing Exploratory Research (CSER) consortium piloted these guidelines on 99 variants spanning all categories (pathogenic, likely pathogenic, uncertain significance, likely benign, and benign). Nine variants were distributed to all laboratories, and the remaining 90 were evaluated by three laboratories. The laboratories classified each variant by using both the laboratory's own method and the ACMG-AMP criteria. The agreement between the two methods used within laboratories was high (K-alpha = 0.91) with 79% concordance. However, there was only 34% concordance for either classification system across laboratories. After consensus discussions and detailed review of the ACMG-AMP criteria, concordance increased to 71%. Causes of initial discordance in ACMG-AMP classifications were identified, and recommendations on clarification and increased specification of the ACMG-AMP criteria were made. In summary, although an initial pilot of the ACMG-AMP guidelines did not lead to increased concordance in variant interpretation, comparing variant interpretations to identify differences and having a common framework to facilitate resolution of those differences were beneficial for improving agreement, allowing iterative movement toward increased reporting consistency for variants in genes associated with monogenic disease.

Clinical Sequencing Exploratory Research Consortium: Accelerating Evidence-Based Practice of Genomic Medicine.

Despite rapid technical progress and demonstrable effectiveness for some types of diagnosis and therapy, much remains to be learned about clinical genome and exome sequencing (CGES) and its role within the practice of medicine. The Clinical Sequencing Exploratory Research (CSER) consortium includes 18 extramural research projects, one National Human Genome Research Institute (NHGRI) intramural project, and a coordinating center funded by the NHGRI and National Cancer Institute. The consortium is exploring analytic and clinical validity and utility, as well as the ethical, legal, and social implications of sequencing via multidisciplinary approaches; it has thus far recruited 5,577 participants across a spectrum of symptomatic and healthy children and adults by utilizing both germline and cancer sequencing. The CSER consortium is analyzing data and creating publically available procedures and tools related to participant preferences and consent, variant classification, disclosure and management of primary and secondary findings, health outcomes, and integration with electronic health records. Future research directions will refine measures of clinical utility of CGES in both germline and somatic testing, evaluate the use of CGES for screening in healthy individuals, explore the penetrance of pathogenic variants through extensive phenotyping, reduce discordances in public databases of genes and variants, examine social and ethnic disparities in the provision of genomics services, explore regulatory issues, and estimate the value and downstream costs of sequencing. The CSER consortium has established a shared community of research sites by using diverse approaches to pursue the evidence-based development of best practices in genomic medicine.