Use of Biosynthetic Controls as Performance Standards for Next-Generation Sequencing Assays of Somatic Tumors: A Multilaboratory Study.

BACKGROUND: Next-generation sequencing (NGS) assays are highly complex tests that can vary substantially in both their design and intended application. Despite their innumerous advantages, NGS assays present some unique challenges associated with the preanalytical process, library preparation, data analysis, and reporting. According to a number of professional laboratory organization, control materials should be included both during the analytical validation phase and in routine clinical use to guarantee highly accurate results. The SeraseqTM Solid Tumor Mutation Mix AF10 and AF20 control materials consist of 26 biosynthetic DNA constructs in a genomic DNA background, each containing a specific variant or mutation of interest and an internal quality marker at 2 distinct allelic frequencies of 10% and 20%, respectively. The goal of this interlaboratory study was to evaluate the Seraseq AF10 and AF20 control materials by verifying their performance as control materials and by evaluating their ability to measure quality metrics essential to a clinical test. METHODS: Performance characteristics were assessed within and between 6 CLIA-accredited laboratories and 1 research laboratory. RESULTS: Most laboratories detected all 26 mutations of interest; however, some discrepancies involving the internal quality markers were observed. CONCLUSION: This interlaboratory study showed that the Seraseq AF10 and AF20 control materials have high quality, stability, and genomic complexity in variant types that are well suited for assisting in NGS assay analytical validation and monitoring routine clinical applications.

Analytical Validation of the Next-Generation Sequencing Assay for a Nationwide Signal-Finding Clinical Trial: Molecular Analysis for Therapy Choice Clinical Trial.

The National Cancer Institute-Molecular Analysis for Therapy Choice (NCI-MATCH) trial is a national signal-finding precision medicine study that relies on genomic assays to screen and enroll patients with relapsed or refractory cancer after standard treatments. We report the analytical validation processes for the next-generation sequencing (NGS) assay that was tailored for regulatory compliant use in the trial. The Oncomine Cancer Panel assay and the Personal Genome Machine were used in four networked laboratories accredited for the Clinical Laboratory Improvement Amendments. Using formalin-fixed paraffin-embedded clinical specimens and cell lines, we found that the assay achieved overall sensitivity of 96.98% for 265 known mutations and 99.99% specificity. High reproducibility in detecting all reportable variants was observed, with a 99.99% mean interoperator pairwise concordance across the four laboratories. The limit of detection for each variant type was 2.8% for single-nucleotide variants, 10.5% for insertion/deletions, 6.8% for large insertion/deletions (gap ≥4 bp), and four copies for gene amplification. The assay system from biopsy collection through reporting was tested and found to be fully fit for purpose. Our results indicate that the NCI-MATCH NGS assay met the criteria for the intended clinical use and that high reproducibility of a complex NGS assay is achievable across multiple clinical laboratories. Our validation approaches can serve as a template for development and validation of other NGS assays for precision medicine.

Certified DNA Reference Materials to Compare HER2 Gene Amplification Measurements Using Next-Generation Sequencing Methods.

The National Institute of Standards and Technology (NIST) Standard Reference Materials 2373 is a set of genomic DNA samples prepared from five breast cancer cell lines with certified values for the ratio of the HER2 gene copy number to the copy numbers of reference genes determined by real-time quantitative PCR and digital PCR. Targeted-amplicon, whole-exome, and whole-genome sequencing measurements were used with the reference material to compare the performance of both the laboratory steps and the bioinformatic approaches of the different methods using a range of amplification ratios. Although good reproducibility was observed in each next-generation sequencing method, slightly different HER2 copy numbers associated with platform-specific biases were obtained. This study clearly demonstrates the value of Standard Reference Materials 2373 as reference material and as a calibrator for evaluating assay performance as well as for increasing confidence in reporting HER2 amplification for clinical applications.

Plasmid-Based Materials as Multiplex Quality Controls and Calibrators for Clinical Next-Generation Sequencing Assays.

Although next-generation sequencing technologies have been widely adapted for clinical diagnostic applications, an urgent need exists for multianalyte calibrator materials and controls to evaluate the performance of these assays. Control materials will also play a major role in the assessment, development, and selection of appropriate alignment and variant calling pipelines. We report an approach to provide effective multianalyte controls for next-generation sequencing assays, referred to as the control plasmid spiked-in genome (CPSG). Control plasmids that contain approximately 1000 bases of human genomic sequence with a specific mutation of interest positioned near the middle of the insert and a nearby 6-bp molecular barcode were synthesized, linearized, quantitated, and spiked into genomic DNA derived from formalin-fixed, paraffin-embedded-prepared hapmap cell lines at defined copy number ratios. Serial titration experiments demonstrated the CPSGs performed with similar efficiency of variant detection as formalin-fixed, paraffin-embedded cell line genomic DNA. Repetitive analyses of one lot of CPSGs 90 times during 18 months revealed that the reagents were stable with consistent detection of each of the plasmids at similar variant allele frequencies. CPSGs are designed to work across most next-generation sequencing methods, platforms, and data analysis pipelines. CPSGs are robust controls and can be used to evaluate the performance of different next-generation sequencing diagnostic assays, assess data analysis pipelines, and ensure robust assay performance metrics.

Analytical Validation and Application of a Targeted Next-Generation Sequencing Mutation-Detection Assay for Use in Treatment Assignment in the NCI-MPACT Trial.

Robust and analytically validated assays are essential for clinical studies. We outline an analytical validation study of a targeted next-generation sequencing mutation-detection assay used for patient selection in the National Cancer Institute Molecular Profiling-Based Assignment of Cancer Therapy (NCI-MPACT) trial (NCT01827384). Using DNA samples from normal or tumor cell lines and xenografts with known variants, we assessed the sensitivity, specificity, and reproducibility of the NCI-MPACT assay in five variant types: single-nucleotide variants (SNVs), SNVs at homopolymeric (HP) regions (≥3 identical bases), small insertions/deletions (indels), large indels (gap ≥4 bp), and indels at HP regions. The assay achieved sensitivities of 100% for 64 SNVs, nine SNVs at HP regions, and 11 large indels, 83.33% for six indels, and 93.33% for 15 indels at HP regions. Zero false positives (100% specificity) were found in 380 actionable mutation loci in 96 runs of haplotype map cells. Reproducibility analysis showed 96.3% to 100% intraoperator and 98.1% to 100% interoperator mean concordance in detected variants and 100% reproducibility in treatment selection. To date, 38 tumors have been screened, 34 passed preanalytical quality control, and 18 had actionable mutations for treatment assignment. The NCI-MPACT assay is well suited for its intended investigational use and can serve as a template for developing next-generation sequencing assays for other cancer clinical trial applications.