Four-Year Laboratory Performance of the First College of American Pathologists In Silico Next-Generation Sequencing Bioinformatics Proficiency Testing Surveys.

CONTEXT.­: In 2016, the College of American Pathologists (CAP) launched the first next-generation sequencing (NGS) in silico bioinformatics proficiency testing survey to evaluate the performance of clinical laboratory bioinformatics pipelines for the detection of oncology-associated variants at varying allele fractions. This survey focused on 2 commonly used oncology panels, the Illumina TruSeq Amplicon Cancer Panel and the Thermo Fisher Ion AmpliSeq Cancer Hotspot v2 Panel. OBJECTIVE.­: To review the analytical performance of laboratories participating in the CAP NGS bioinformatics (NGSB) surveys, comprising NGSB1 for Illumina users and NGSB2 for Thermo Fisher Ion Torrent users, between 2016 and 2019. DESIGN.­: Responses from 78 laboratories were analyzed for accuracy and associated performance characteristics. RESULTS.­: The analytical sensitivity was 90.0% (1901 of 2112) for laboratories using the Illumina platform and 94.8% (2153 of 2272) for Thermo Fisher Ion Torrent users. Variant type and variant allele fraction were significantly associated with performance. False-negative results were seen mostly for multi-nucleotide variants and variants engineered at variant allele fractions of less than 25%. Analytical specificity for all participating laboratories was 99.8% (9303 of 9320). There was no statistically significant association between deletion-insertion length and detection rate. CONCLUSIONS.­: These results demonstrated high analytical sensitivity and specificity, supporting the feasibility and utility of using in silico mutagenized NGS data sets as a supplemental challenge to CAP surveys for oncology-associated variants based on physical samples. This program demonstrates the opportunity and challenges that can guide future surveys inclusive of customized in silico programs.

Tiered Somatic Variant Classification Adoption Has Increased Worldwide With Some Practice Differences Based on Location and Institutional Setting.

CONTEXT.­: The 2017 Association for Molecular Pathology/American Society of Clinical Oncology/College of American Pathologists (CAP) tier classification guideline provides a framework to standardize interpretation and reporting of somatic variants. OBJECTIVE.­: To evaluate the adoption and performance of the 2017 guideline among laboratories performing somatic next-generation sequencing (NGS). DESIGN.­: A survey was distributed to laboratories participating in NGS CAP proficiency testing for solid tumors (NGSST) and hematologic malignancies (NGSHM). RESULTS.­: Worldwide, 64.4% (152 of 236) of NGSST and 66.4% (87 of 131) of NGSHM participants used tier classification systems, of which the 2017 guideline was used by 84.9% (129 of 152) of NGSST and 73.6% (64 of 87) of NGSHM participants. The 2017 guideline was modified by 24.4% (30 of 123) of NGSST and 21.7% (13 of 60) of NGSHM laboratories. Laboratories implementing the 2017 guideline were satisfied or very satisfied (74.2% [89 of 120] NGSST and 69.5% [41 of 59] NGSHM), and the impression of tier classification reproducibility was high (mean of 3.9 [NGSST] and 3.6 [NGSHM] on a 5-point scale). Of nonusers, 35.2% (38 of 108) of NGSST and 39.4% (26 of 66) of NGSHM laboratories were planning implementation. For future guideline revisions, respondents favored including variants to monitor disease (63.9% [78 of 122] NGSST, 80.0% [48 of 60] NGSHM) and germline variants (55.3% [63 of 114] NGSST, 75.0% [45 of 60] NGSHM). Additional subtiers were not favored by academic laboratories compared to nonacademic laboratories (P < .001 NGSST and P = .02 NGSHM). CONCLUSIONS.­: The 2017 guideline has been implemented by more than 50.0% of CAP laboratories. While most laboratories using the 2017 guideline report satisfaction, thoughtful guideline modifications may further enhance the quality, reproducibility, and clinical utility of the 2017 guideline for tiered somatic variant classification.

A Primer on Chimeric Antigen Receptor T-cell Therapy: What Does It Mean for Pathologists?

CONTEXT.­: Chimeric antigen receptor T-cell (CAR-T) technology has shown great promise in both clinical and preclinical models in mediating potent and specific antitumor activity. With the advent of US Food and Drug Administration-approved CAR-T therapies for B-cell lymphoblastic leukemia and B-cell non-Hodgkin lymphomas, CAR-T therapy is poised to become part of mainstream clinical practice. OBJECTIVE.­: To educate pathologists on CAR-T and chimeric antigen receptor-derived cellular therapy, provide a better understanding of their role in this process, explain important regulatory aspects of CAR-T therapy, and advocate for pathologist involvement in the delivery and monitoring of chimeric antigen receptor-based treatments. Much of the focus of this article addresses US Food and Drug Administration-approved therapies; however, more general issues and future perspectives are considered for therapies in development. DESIGN.­: A CAR-T workgroup, facilitated by the College of American Pathologists Personalized Health Care Committee and consisting of pathologists of various backgrounds, was convened to develop a summary guidance paper for the College of American Pathologists Council on Scientific Affairs. RESULTS.­: The workgroup identified gaps in pathologists' knowledge of CAR-T therapy, including uncertainty in the role of the clinical laboratory in supporting CAR-T therapy. The workgroup considered these issues and summarized the findings to assist pathologists to become stakeholders in CAR-T therapy administration. CONCLUSIONS.­: This manuscript serves to both educate pathologists on CAR-T therapy and serve as a point of initial discussions in areas of CAR-T science, clinical therapy, and regulatory issues as CAR-T therapies continue to be introduced into clinical practice.

Frontline Science: Cxxc5 expression alters cell cycle and myeloid differentiation of mouse hematopoietic stem and progenitor cells.

CXXC5 is a member of the CXXC-type zinc finger epigenetic regulators. Various hematopoietic and nonhematopoietic roles have been assigned to CXXC5. In the present study, the role of Cxxc5 in myelopoiesis was studied using overexpression and short hairpin RNA-mediated knockdown in mouse early stem and progenitor cells defined as Lineage- Sca-1+ c-Kit+ (LSK) cells. Knockdown of Cxxc5 in mouse progenitor cells reduced monocyte and increased granulocyte development in ex vivo culture systems. In addition, ex vivo differentiation and proliferation experiments demonstrated that the expression of Cxxc5 affects the cell cycle in stem/progenitor cells and myeloid cells. Flow cytometry-based analyses revealed that down-regulation of Cxxc5 leads to an increase in the percentage of cells in the S phase, whereas overexpression results in a decrease in the percentage of cells in the S phase. Progenitor cells proliferate more after Cxxc5 knockdown, and RNA sequencing of LSK cells, and single-cell RNA sequencing of differentiating myeloid cells showed up-regulation of genes involved in the regulation of cell cycle after Cxxc5 knockdown. These results provide novel insights into the physiologic function of Cxxc5 during hematopoiesis, and demonstrate for the first time that it plays a role in monocyte development.

Evaluation of Mass Cytometry in the Clinical Laboratory.

BACKGROUND: Mass cytometry can differentiate more channels than conventional flow cytometry. However, for clinical use, standardization and agreement with well-established methods is paramount. We compared mass cytometry to standard clinical flow cytometry. METHODS: Mass and flow cytometry were performed in parallel on peripheral blood samples from 25 healthy individuals. Antibody staining was performed on the same samples at the same time, and analyzed for granulocyte, monocyte, lymphocyte, T, B, NK, CD4 and CD8 percentages. Validation parameters included comparison to flow cytometry, inter- and intra-assay precision and establishment of reference intervals. RESULTS: There was a positive correlation between mass and flow cytometry for the eight populations studied (R2 between 0.26 and 0.97). Slopes of the best-fit lines varied from 0.50 to 1.21 (fluorescence/mass). No significant differences in variance were found (F-test, P > 0.05). However, paired t-tests were significantly different for four of the eight markers (granulocytes, NK cells, T cells and CD4 cells), resulting in different reference intervals. Signal intensities were correlated for monocytes, lymphocytes, T, CD4 and CD8 cells (R2 = 0.41-0.57). The mass cytometry intra-assay precisions were 0.7-8.5% and inter-assay precisions 1.5-13.8%. CONCLUSION: Mass and flow cytometry evaluations of whole blood for major cell populations correlate with similar precision and signal intensity. However, for clinical use, separate reference interval studies are required. Cell population identification should rely on gating strategies that take advantage of the characteristics offered by each method. © 2019 International Clinical Cytometry Society.

Novel PLP1 Mutations Identified With Next-Generation Sequencing Expand the Spectrum of PLP1-Associated Leukodystrophy Clinical Phenotypes.

Next-generation sequencing was performed for 2 families with an undiagnosed neurologic disease. Analysis revealed X-linked mutations in the proteolipid protein 1 (PLP1) gene, which is associated with X-linked Pelizaeus-Merzbacher disease and Spastic Paraplegia type 2. In family A, the novel PLP1 missense mutation c.617T>A (p.M206K) was hemizygous in the 2 affected male children and heterozygous in the mother. In family B, the novel de novoPLP1 frameshift mutation c.359_369del (p.G120fs) was hemizygous in the affected male child. Although PLP1 mutations have been reported to cause an increasingly wide range of phenotypes inclusive of the dystonia, spastic paraparesis, motor neuronopathy, and leukodystrophy observed in our patients, atypical features included the cerebrospinal fluid deficiency of neurotransmitter and pterin metabolites and the delayed appearance of myelin abnormalities on neuroimaging studies. Next-generation sequencing studies provided a diagnosis for these families with complex leukodystrophy disease phenotypes, which expanded the spectrum of PLP1-associated leukodystrophy clinical phenotypes.

Ikaros family zinc finger 1 regulates dendritic cell development and function in humans.

Ikaros family zinc finger 1 (IKZF1) is a haematopoietic transcription factor required for mammalian B-cell development. IKZF1 deficiency also reduces plasmacytoid dendritic cell (pDC) numbers in mice, but its effects on human DC development are unknown. Here we show that heterozygous mutation of IKZF1 in human decreases pDC numbers and expands conventional DC1 (cDC1). Lenalidomide, a drug that induces proteosomal degradation of IKZF1, also decreases pDC numbers in vivo, and reduces the ratio of pDC/cDC1 differentiated from progenitor cells in vitro in a dose-dependent manner. In addition, non-classical monocytes are reduced by IKZF1 deficiency in vivo. DC and monocytes from patients with IKZF1 deficiency or lenalidomide-treated cultures secrete less IFN-α, TNF and IL-12. These results indicate that human DC development and function are regulated by IKZF1, providing further insights into the consequences of IKZF1 mutation on immune function and the mechanism of immunomodulation by lenalidomide.

Standards and Guidelines for Validating Next-Generation Sequencing Bioinformatics Pipelines: A Joint Recommendation of the Association for Molecular Pathology and the College of American Pathologists.

Bioinformatics pipelines are an integral component of next-generation sequencing (NGS). Processing raw sequence data to detect genomic alterations has significant impact on disease management and patient care. Because of the lack of published guidance, there is currently a high degree of variability in how members of the global molecular genetics and pathology community establish and validate bioinformatics pipelines. Improperly developed, validated, and/or monitored pipelines may generate inaccurate results that may have negative consequences for patient care. To address this unmet need, the Association of Molecular Pathology, with organizational representation from the College of American Pathologists and the American Medical Informatics Association, has developed a set of 17 best practice consensus recommendations for the validation of clinical NGS bioinformatics pipelines. Recommendations include practical guidance for laboratories regarding NGS bioinformatics pipeline design, development, and operation, with additional emphasis on the role of a properly trained and qualified molecular professional to achieve optimal NGS testing quality.

Development and Validation of Clinical Whole-Exome and Whole-Genome Sequencing for Detection of Germline Variants in Inherited Disease.

CONTEXT: - With the decrease in the cost of sequencing, the clinical testing paradigm has shifted from single gene to gene panel and now whole-exome and whole-genome sequencing. Clinical laboratories are rapidly implementing next-generation sequencing-based whole-exome and whole-genome sequencing. Because a large number of targets are covered by whole-exome and whole-genome sequencing, it is critical that a laboratory perform appropriate validation studies, develop a quality assurance and quality control program, and participate in proficiency testing. OBJECTIVE: - To provide recommendations for whole-exome and whole-genome sequencing assay design, validation, and implementation for the detection of germline variants associated in inherited disorders. DATA SOURCES: - An example of trio sequencing, filtration and annotation of variants, and phenotypic consideration to arrive at clinical diagnosis is discussed. CONCLUSIONS: - It is critical that clinical laboratories planning to implement whole-exome and whole-genome sequencing design and validate the assay to specifications and ensure adequate performance prior to implementation. Test design specifications, including variant filtering and annotation, phenotypic consideration, guidance on consenting options, and reporting of incidental findings, are provided. These are important steps a laboratory must take to validate and implement whole-exome and whole-genome sequencing in a clinical setting for germline variants in inherited disorders.

Principles and Recommendations for Standardizing the Use of the Next-Generation Sequencing Variant File in Clinical Settings.

A national workgroup convened by the Centers for Disease Control and Prevention identified principles and made recommendations for standardizing the description of sequence data contained within the variant file generated during the course of clinical next-generation sequence analysis for diagnosing human heritable conditions. The specifications for variant files were initially developed to be flexible with regard to content representation to support a variety of research applications. This flexibility permits variation with regard to how sequence findings are described and this depends, in part, on the conventions used. For clinical laboratory testing, this poses a problem because these differences can compromise the capability to compare sequence findings among laboratories to confirm results and to query databases to identify clinically relevant variants. To provide for a more consistent representation of sequence findings described within variant files, the workgroup made several recommendations that considered alignment to a common reference sequence, variant caller settings, use of genomic coordinates, and gene and variant naming conventions. These recommendations were considered with regard to the existing variant file specifications presently used in the clinical setting. Adoption of these recommendations is anticipated to reduce the potential for ambiguity in describing sequence findings and facilitate the sharing of genomic data among clinical laboratories and other entities.

Guidelines for Validation of Next-Generation Sequencing-Based Oncology Panels: A Joint Consensus Recommendation of the Association for Molecular Pathology and College of American Pathologists.

Next-generation sequencing (NGS) methods for cancer testing have been rapidly adopted by clinical laboratories. To establish analytical validation best practice guidelines for NGS gene panel testing of somatic variants, a working group was convened by the Association of Molecular Pathology with liaison representation from the College of American Pathologists. These joint consensus recommendations address NGS test development, optimization, and validation, including recommendations on panel content selection and rationale for optimization and familiarization phase conducted before test validation; utilization of reference cell lines and reference materials for evaluation of assay performance; determining of positive percentage agreement and positive predictive value for each variant type; and requirements for minimal depth of coverage and minimum number of samples that should be used to establish test performance characteristics. The recommendations emphasize the role of laboratory director in using an error-based approach that identifies potential sources of errors that may occur throughout the analytical process and addressing these potential errors through test design, method validation, or quality controls so that no harm comes to the patient. The recommendations contained herein are intended to assist clinical laboratories with the validation and ongoing monitoring of NGS testing for detection of somatic variants and to ensure high quality of sequencing results.

Development and Validation of Targeted Next-Generation Sequencing Panels for Detection of Germline Variants in Inherited Diseases.

CONTEXT: - The number of targeted next-generation sequencing (NGS) panels for genetic diseases offered by clinical laboratories is rapidly increasing. Before an NGS-based test is implemented in a clinical laboratory, appropriate validation studies are needed to determine the performance characteristics of the test. OBJECTIVE: - To provide examples of assay design and validation of targeted NGS gene panels for the detection of germline variants associated with inherited disorders. DATA SOURCES: - The approaches used by 2 clinical laboratories for the development and validation of targeted NGS gene panels are described. Important design and validation considerations are examined. CONCLUSIONS: - Clinical laboratories must validate performance specifications of each test prior to implementation. Test design specifications and validation data are provided, outlining important steps in validation of targeted NGS panels by clinical diagnostic laboratories.

A Model Study of In Silico Proficiency Testing for Clinical Next-Generation Sequencing.

CONTEXT: -Most current proficiency testing challenges for next-generation sequencing assays are methods-based proficiency testing surveys that use DNA from characterized reference samples to test both the wet-bench and bioinformatics/dry-bench aspects of the tests. Methods-based proficiency testing surveys are limited by the number and types of mutations that either are naturally present or can be introduced into a single DNA sample. OBJECTIVE: -To address these limitations by exploring a model of in silico proficiency testing in which sequence data from a single well-characterized specimen are manipulated electronically. DESIGN: -DNA from the College of American Pathologists reference genome was enriched using the Illumina TruSeq and Life Technologies AmpliSeq panels and sequenced on the MiSeq and Ion Torrent platforms, respectively. The resulting data were mutagenized in silico and 26 variants, including single-nucleotide variants, deletions, and dinucleotide substitutions, were added at variant allele fractions (VAFs) from 10% to 50%. Participating clinical laboratories downloaded these files and analyzed them using their clinical bioinformatics pipelines. RESULTS: -Laboratories using the AmpliSeq/Ion Torrent and/or the TruSeq/MiSeq participated in the 2 surveys. On average, laboratories identified 24.6 of 26 variants (95%) overall and 21.4 of 22 variants (97%) with VAFs greater than 15%. No false-positive calls were reported. The most frequently missed variants were single-nucleotide variants with VAFs less than 15%. Across both challenges, reported VAF concordance was excellent, with less than 1% median absolute difference between the simulated VAF and mean reported VAF. CONCLUSIONS: -The results indicate that in silico proficiency testing is a feasible approach for methods-based proficiency testing, and demonstrate that the sensitivity and specificity of current next-generation sequencing bioinformatics across clinical laboratories are high.

Taxonomer: an interactive metagenomics analysis portal for universal pathogen detection and host mRNA expression profiling.

BACKGROUND: High-throughput sequencing enables unbiased profiling of microbial communities, universal pathogen detection, and host response to infectious diseases. However, computation times and algorithmic inaccuracies have hindered adoption. RESULTS: We present Taxonomer, an ultrafast, web-tool for comprehensive metagenomics data analysis and interactive results visualization. Taxonomer is unique in providing integrated nucleotide and protein-based classification and simultaneous host messenger RNA (mRNA) transcript profiling. Using real-world case-studies, we show that Taxonomer detects previously unrecognized infections and reveals antiviral host mRNA expression profiles. To facilitate data-sharing across geographic distances in outbreak settings, Taxonomer is publicly available through a web-based user interface. CONCLUSIONS: Taxonomer enables rapid, accurate, and interactive analyses of metagenomics data on personal computers and mobile devices.

Design of a Genomics Curriculum: Competencies for Practicing Pathologists.

CONTEXT: The field of genomics is rapidly impacting medical care across specialties. To help guide test utilization and interpretation, pathologists must be knowledgeable about genomic techniques and their clinical utility. The technology allowing timely generation of genomic data is relatively new to patient care and the clinical laboratory, and therefore, many currently practicing pathologists have been trained without any molecular or genomics exposure. Furthermore, the exposure that current and recent trainees receive in this field remains inconsistent. OBJECTIVE: To assess pathologists' learning needs in genomics and to develop a curriculum to address these educational needs. DESIGN: A working group formed by the College of American Pathologists developed an initial list of genomics competencies (knowledge and skills statements) that a practicing pathologist needs to be successful. Experts in genomics were then surveyed to rate the importance of each competency. These data were used to create a final list of prioritized competencies. A subset of the working group defined subtopics and tasks for each competency. Appropriate delivery methods for the educational material were also proposed. RESULTS: A final list of 32 genomics competency statements was developed. A prioritized curriculum was created with designated subtopics and tasks associated with each competency. CONCLUSIONS: We present a genomics curriculum designed as a first step toward providing practicing pathologists with the competencies needed to practice successfully.

College of American Pathologists' laboratory standards for next-generation sequencing clinical tests.

CONTEXT: The higher throughput and lower per-base cost of next-generation sequencing (NGS) as compared to Sanger sequencing has led to its rapid adoption in clinical testing. The number of laboratories offering NGS-based tests has also grown considerably in the past few years, despite the fact that specific Clinical Laboratory Improvement Amendments of 1988/College of American Pathologists (CAP) laboratory standards had not yet been developed to regulate this technology. OBJECTIVE: To develop a checklist for clinical testing using NGS technology that sets standards for the analytic wet bench process and for bioinformatics or "dry bench" analyses. As NGS-based clinical tests are new to diagnostic testing and are of much greater complexity than traditional Sanger sequencing-based tests, there is an urgent need to develop new regulatory standards for laboratories offering these tests. DESIGN: To develop the necessary regulatory framework for NGS and to facilitate appropriate adoption of this technology for clinical testing, CAP formed a committee in 2011, the NGS Work Group, to deliberate upon the contents to be included in the checklist. Results . -A total of 18 laboratory accreditation checklist requirements for the analytic wet bench process and bioinformatics analysis processes have been included within CAP's molecular pathology checklist (MOL). CONCLUSIONS: This report describes the important issues considered by the CAP committee during the development of the new checklist requirements, which address documentation, validation, quality assurance, confirmatory testing, exception logs, monitoring of upgrades, variant interpretation and reporting, incidental findings, data storage, version traceability, and data transfer confidentiality.

Identification of patients with RAG mutations previously diagnosed with common variable immunodeficiency disorders.

PURPOSE: Combined immunodeficiency (CID) presents a unique challenge to clinicians. Two patients presented with the prior clinical diagnosis of common variable immunodeficiency (CVID) disorder marked by an early age of presentation, opportunistic infections, and persistent lymphopenia. Due to the presence of atypical clinical features, next generation sequencing was applied documenting RAG deficiency in both patients. METHODS: Two different genetic analysis techniques were applied in these patients including whole exome sequencing in one patient and the use of a gene panel designed to target genes known to cause primary immunodeficiency disorders (PIDD) in a second patient. Sanger dideoxy sequencing was used to confirm RAG1 mutations in both patients. RESULTS: Two young adults with a history of recurrent bacterial sinopulmonary infections, viral infections, and autoimmune disease as well as progressive hypogammaglobulinemia, abnormal antibody responses, lymphopenia and a prior diagnosis of CVID disorder were evaluated. Compound heterozygous mutations in RAG1 (1) c256_257delAA, p86VfsX32 and (2) c1835A>G, pH612R were documented in one patient. Compound heterozygous mutations in RAG1 (1) c.1566G>T, p.W522C and (2) c.2689C>T, p. R897X) were documented in a second patient post-mortem following a fatal opportunistic infection. CONCLUSION: Astute clinical judgment in the evaluation of patients with PIDD is necessary. Atypical clinical findings such as early onset, granulomatous disease, or opportunistic infections should support the consideration of atypical forms of late onset CID secondary to RAG deficiency. Next generation sequencing approaches provide powerful tools in the investigation of these patients and may expedite definitive treatments.