External Quality Assessment on Molecular Tumor Profiling with Circulating Tumor DNA-Based Methodologies Routinely Used in Clinical Pathology within the COIN Consortium.

BACKGROUND: Identification of tumor-derived variants in circulating tumor DNA (ctDNA) has potential as a sensitive and reliable surrogate for tumor tissue-based routine diagnostic testing. However, variations in pre(analytical) procedures affect the efficiency of ctDNA recovery. Here, an external quality assessment (EQA) was performed to determine the performance of ctDNA mutation detection work flows that are used in current diagnostic settings across laboratories within the Dutch COIN consortium (ctDNA on the road to implementation in The Netherlands). METHODS: Aliquots of 3 high-volume diagnostic leukapheresis (DLA) plasma samples and 3 artificial reference plasma samples with predetermined mutations were distributed among 16 Dutch laboratories. Participating laboratories were requested to perform ctDNA analysis for BRAF exon 15, EGFR exon 18-21, and KRAS exon 2-3 using their regular circulating cell-free DNA (ccfDNA) analysis work flow. Laboratories were assessed based on adherence to the study protocol, overall detection rate, and overall genotyping performance. RESULTS: A broad range of preanalytical conditions (e.g., plasma volume, elution volume, and extraction methods) and analytical methodologies (e.g., droplet digital PCR [ddPCR], small-panel PCR assays, and next-generation sequencing [NGS]) were used. Six laboratories (38%) had a performance score of >0.90; all other laboratories scored between 0.26 and 0.80. Although 13 laboratories (81%) reached a 100% overall detection rate, the therapeutically relevant EGFR p.(S752_I759del) (69%), EGFR p.(N771_H773dup) (50%), and KRAS p.(G12C) (48%) mutations were frequently not genotyped accurately. CONCLUSIONS: Divergent (pre)analytical protocols could lead to discrepant clinical outcomes when using the same plasma samples. Standardization of (pre)analytical work flows can facilitate the implementation of reproducible liquid biopsy testing in the clinical routine.

A Micro-Costing Framework for Circulating Tumor DNA Testing in Dutch Clinical Practice.

Circulating tumor DNA (ctDNA) is a promising new biomarker with multiple potential applications in cancer care. Estimating total cost of ctDNA testing is necessary for reimbursement and implementation, but challenging because of variations in workflow. We aimed to develop a micro-costing framework for consistent cost calculation of ctDNA testing. First, the foundation of the framework was built, based on the complete step-wise diagnostic workflow of ctDNA testing. Second, the costing method was set up, including costs for personnel, materials, equipment, overhead, and failures. Third, the framework was evaluated by experts and applied to six case studies, including PCR-, mass spectrometry-, and next-generation sequencing-based platforms, from three Dutch hospitals. The developed ctDNA micro-costing framework includes the diagnostic workflow from blood sample collection to diagnostic test result. The framework was developed from a Dutch perspective and takes testing volume into account. An open access tool is provided to allow for laboratory-specific calculations to explore the total costs of ctDNA testing specific workflow parameters matching the setting of interest. It also allows to straightforwardly assess the impact of alternative prices or assumptions on the cost per sample by simply varying the input parameters. The case studies showed a wide range of costs, from €168 to €7638 ($199 to $9124) per sample, and generated information. These costs are sensitive to the (coverage of) platform, setting, and testing volume.

Results of a worldwide external quality assessment of cfDNA testing in lung Cancer.

BACKGROUND: Circulating cell free DNA (cfDNA) testing of plasma for EGFR somatic variants in lung cancer patients is being widely implemented and with any new service, external quality assessment (EQA) is required to ensure patient safety. An international consortium, International Quality Network for Pathology (IQNPath), has delivered a second round of assessment to measure the accuracy of cfDNA testing for lung cancer and the interpretation of the results. METHODS: A collaboration of five EQA provider organisations, all members of IQNPath, have delivered the assessment during 2018-19 to a total of 264 laboratories from 45 countries. Bespoke plasma reference material containing a range of EGFR mutations at varying allelic frequencies were supplied to laboratories for testing and reporting according to routine procedures. The genotyping accuracy and clinical reporting was reviewed against standardised criteria and feedback was provided to participants. RESULTS: The overall genotyping error rate in the EQA was found to be 11.1%. Low allelic frequency samples were the most challenging and were not detected by some testing methods, resulting in critical genotyping errors. This was reflected in higher false negative rates for samples with variant allele frequencies (VAF) rates less than 1.5% compared to higher frequencies. A sample with two different EGFR mutations gave inconsistent detection of both mutations. However, for one sample, where two variants were present at a VAF of less than 1% then both mutations were correctly detected in 145/263 laboratories. Reports often did not address the risk that tumour DNA may have not been tested and limitations of the methodologies provided by participants were insufficient. This was reflected in the average interpretation score for the EQA being 1.49 out of a maximum of 2. CONCLUSIONS: The variability in the standard of genotyping and reporting highlighted the need for EQA and educational guidance in this field to ensure the delivery of high-quality clinical services where testing of cfDNA is the only option for clinical management.

Cost-Effectiveness of Parallel Versus Sequential Testing of Genetic Aberrations for Stage IV Non-Small-Cell Lung Cancer in the Netherlands.

PURPOSE: A large number of targeted treatment options for stage IV nonsquamous non-small-cell lung cancer with specific genetic aberrations in tumor DNA is available. It is therefore important to optimize diagnostic testing strategies, such that patients receive adequate personalized treatment that improves survival and quality of life. The aim of this study is to assess the efficacy (including diagnostic costs, turnaround time (TAT), unsuccessful tests, percentages of correct findings, therapeutic costs, and therapeutic effectiveness) of parallel next generation sequencing (NGS)-based versus sequential single-gene-based testing strategies routinely used in patients with metastasized non-small-cell lung cancer in the Netherlands. METHODS: A diagnostic microsimulation model was developed to simulate 100,000 patients with prevalence of genetic aberrations, extracted from real-world data from the Dutch Pathology Registry. These simulated patients were modeled to undergo different testing strategies composed of multiple tests with different test characteristics including single-gene and panel tests, test accuracy, the probability of an unsuccessful test, and TAT. Diagnostic outcomes were linked to a previously developed treatment model, to predict average long-term survival, quality-adjusted life-years (QALYs), costs, and cost-effectiveness of parallel versus sequential testing. RESULTS: NGS-based parallel testing for all actionable genetic aberrations is on average €266 cheaper than single-gene-based sequential testing, and detects additional relevant targetable genetic aberrations in 20.5% of the cases, given a TAT of maximally 2 weeks. Therapeutic costs increased by €8,358, and 0.12 QALYs were gained, leading to an incremental cost-effectiveness ratio of €69,614/QALY for parallel versus sequential testing. CONCLUSION: NGS-based parallel testing is diagnostically superior over single-gene-based sequential testing, as it is cheaper and more effective than sequential testing. Parallel testing remains cost-effective with an incremental cost-effectiveness ratio of 69,614 €/QALY upon inclusion of therapeutic costs and long-term outcomes.

Cortactin expression assessment improves patient selection for a watchful waiting strategy in pT1cN0-staged oral squamous cell carcinomas with a tumor infiltration depth below 4 mm.

BACKGROUND: In this feasibility study we aimed to evaluate the value of previously reported molecular tumor biomarkers associated with lymph node metastasis in oral squamous cell carcinoma (OSCC) to optimize neck strategy selection criteria. METHODS: The association between expression of cortactin, cyclin D1, FADD, RAB25, and S100A9 and sentinel lymph node status was evaluated in a series of 87 (cT1-2N0) patients with OSCC treated with primary resection and SLNB procedure. RESULTS: Tumor infiltration depth and tumor pattern of invasion were independent prognostic markers for SLN status, while none of the tumor makers showed a better prognostic value to replace SLNB as neck staging technique in the total cohort. However, in the subgroup of patients with pT1N0 OSCC, cortactin expression (OR 16.0, 95%CI 2.0-127.9) was associated with SLN classification. CONCLUSIONS: Expression of cortactin is a promising immunohistochemical tumor marker to identify patients at low risk that may not benefit from SLNB or END.

Micro-costing diagnostics in oncology: from single-gene testing to whole- genome sequencing.

Purpose: Predictive diagnostics play an increasingly important role in personalized medicine for cancer treatment. Whole-genome sequencing (WGS)-based treatment selection is expected to rapidly increase worldwide. This study aimed to calculate and compare the total cost of currently used diagnostic techniques and of WGS in treatment of non-small cell lung carcinoma (NSCLC), melanoma, colorectal cancer (CRC), and gastrointestinal stromal tumor (GIST) in the Netherlands.Methods: The activity-based costing (ABC) method was conducted to calculate total cost of included diagnostic techniques based on data provided by Dutch pathology laboratories and the Dutch-centralized cancer WGS facility. Costs were allocated to four categories: capital costs, maintenance costs, software costs, and operational costs.Results: The total cost per cancer patient per technique varied from € 58 (Sanger sequencing, three amplicons) to € 2925 (paired tumor-normal WGS). The operational costs accounted for the vast majority (over 90%) of the total per cancer patient technique costs.Conclusion: This study outlined in detail all costing aspects and cost prices of current and new diagnostic modalities used in treatment of NSCLC, melanoma, CRC, and GIST in the Netherlands. Detailed cost differences and value comparisons between these diagnostic techniques enable future economic evaluations to support decision-making.

External Quality Assessment Schemes for Biomarker Testing in Oncology: Comparison of Performance between Formalin-Fixed, Paraffin-Embedded-Tissue and Cell-Free Tumor DNA in Plasma.

Liquid biopsies have emerged as a useful addition to tissue biopsies in molecular pathology. Literature has shown lower laboratory performances when a new method of variant analysis is introduced. This study evaluated the differences in variant analysis between tissue and plasma samples after the introduction of liquid biopsy in molecular analysis. Data from a pilot external quality assessment scheme for the detection of molecular variants in plasma samples and from external quality assessment schemes for the detection of molecular variants in tissue samples were collected. Laboratory performance and error rates by sample were compared between matrices for variants present in both scheme types. Results showed lower overall performance [65.6% (n = 276) versus 89.2% (n = 1607)] and higher error rates [21.0% to 43.5% (n = 138) versus 8.7% to 16.7% (n = 234 to 689)] for the detection of variants in plasma compared to tissue, respectively. In the plasma samples, performance was decreased for variants with an allele frequency of 1% compared to 5% [56.5% (n = 138) versus 74.6% (n = 138)]. The implementation of liquid biopsy in the detection of circulating tumor DNA in plasma was associated with poor laboratory performance. It is important both to apply optimal detection methods and to extensively validate new methods for testing circulating tumor DNA before treatment decisions are made.

Standardised Ki-67 proliferation index assessment in early-stage laryngeal squamous cell carcinoma in relation to local control and survival after primary radiotherapy.

OBJECTIVES: Ambiguous results have been reported on the predictive value of the Ki-67 proliferation index (Ki-67 PI) regarding local control (LC) and survival after primary radiotherapy (RT) in early-stage laryngeal squamous cell cancer (LSCC). Small study size, heterogenic inclusion, variations in immunostaining and cut-off values are attributing factors. Our aim was to elucidate the predictive value of the Ki-67 PI for LC and disease-specific survival (DSS) using a well-defined series of T1-T2 LSCC, standardised automatic immunostaining and digital image analysis (DIA). METHODS: A consecutive and well-defined cohort of 208 patients with T1-T2 LSCC treated with primary RT was selected. The Ki-67 PI was determined using DIA. Mann-Whitney U-tests, logistic and Cox regression analyses were performed to assess associations between Ki-67 PI, clinicopathological variables, LC and DSS. RESULTS: In multivariate Cox regression analysis, poor tumour differentiation (HR 2.20; 95% CI 1.06-4.59, P = .04) and alcohol use (HR 2.84, 95% CI 1.20-6.71; P = .02) were independent predictors for LC. Lymph node positivity was an independent predictor for DSS (HR 3.16, 95% CI 1.16-8.64; P = .03). Ki-67 PI was not associated with LC (HR 1.59; 95% CI 0.89-2.81; P = .11) or DSS (HR 0.98; 95% CI 0.57-1.66; P = .97). In addition, continuous Ki-67 PI was not associated with LC (HR 2.03; 95% CI 0.37-11.14, P = .42) or DSS (HR 0.62; 95% CI 0.05-8.28; P = .72). CONCLUSION: The Ki-67 PI was not found to be a predictor for LC or DSS and therefore should not be incorporated in treatment-related decision-making for LSCC.

International pilot external quality assessment scheme for analysis and reporting of circulating tumour DNA.

BACKGROUND: Molecular analysis of circulating tumour DNA (ctDNA) is becoming increasingly important in clinical treatment decisions. A pilot External Quality Assessment (EQA) scheme for ctDNA analysis was organized by four European EQA providers under the umbrella organization IQN Path, in order to investigate the feasibility of delivering an EQA to assess the detection of clinically relevant variants in plasma circulating cell-free DNA (cfDNA) and to analyze reporting formats. METHODS: Thirty-two experienced laboratories received 5 samples for EGFR mutation analysis and/or 5 samples for KRAS and NRAS mutation analysis. Samples were artificially manufactured to contain 3 mL of human plasma with 20 ng/mL of fragmented ctDNA and variants at allelic frequencies of 1 and 5%. RESULTS: The scheme error rate was 20.1%. Higher error rates were observed for RAS testing when compared to EGFR analysis, for allelic frequencies of 1% compared to 5%, and for cases including 2 different variants. The reports over-interpreted wild-type results and frequently failed to comment on the amount of cfDNA extracted. CONCLUSIONS: The pilot scheme demonstrated the feasibility of delivering a ctDNA EQA scheme and the need for such a scheme due to high error rates in detecting low frequency clinically relevant variants. Recommendations to improve reporting of cfDNA are provided.

A stitch in time saves nine: external quality assessment rounds demonstrate improved quality of biomarker analysis in lung cancer.

Biomarker analysis has become routine practice in the treatment of non-small cell lung cancer (NSCLC). To ensure high quality testing, participation to external quality assessment (EQA) schemes is essential. This article provides a longitudinal overview of the EQA performance for EGFR, ALK, and ROS1 analyses in NSCLC between 2012 and 2015. The four scheme years were organized by the European Society of Pathology according to the ISO 17043 standard. Participants were asked to analyze the provided tissue using their routine procedures. Analysis scores improved for individual laboratories upon participation to more EQA schemes, except for ROS1 immunohistochemistry (IHC). For EGFR analysis, scheme error rates were 18.8%, 14.1% and 7.5% in 2013, 2014 and 2015 respectively. For ALK testing, error rates decreased between 2012 and 2015 by 5.2%, 3.2% and 11.8% for the fluorescence in situ hybridization (FISH), FISH digital, and IHC subschemes, respectively. In contrast, for ROS1 error rates increased between 2014 and 2015 for FISH and IHC by 3.2% and 9.3%. Technical failures decreased over the years for all three markers. Results show that EQA contributes to an ameliorated performance for most predictive biomarkers in NSCLC. Room for improvement is still present, especially for ROS1 analysis.

Assessment of hypoxic subvolumes in laryngeal cancer with (18)F-fluoroazomycinarabinoside ((18)F-FAZA)-PET/CT scanning and immunohistochemistry.

BACKGROUND AND PURPOSE: (18)F-fluoroazomycinarabinoside ((18)F-FAZA) is a promising hypoxia radiopharmaceutical agent with outstanding biokinetic parameters. We aimed to determine the accuracy of (18)F-FAZA-PET/CT scan in detecting hypoxic regions within the tumor using immunohistochemical markers in a pilot study. PATIENTS AND METHODS: Eleven patients with primary or recurrent laryngeal squamous cell carcinoma were indicated for total laryngectomy (TLE). Patients underwent (18)F-FAZA-PET/CT scan before TLE. Hypoxic regions inside the laryngeal tumor were determined. After TLE, regions with high uptake on (18)F-FAZA-PET scan were selected for immunohistochemical examination for exogenous (pimonidazole) and endogenous (HIF1α, CA-IX and GLUT-1) hypoxia markers. To assess the accuracy of (18)F-FAZA-PET scanning, radiopharmacon accumulation was related with immunohistochemical expression of hypoxia markers. RESULTS: Inter- and intratumoral heterogeneity of tumor hypoxia was observed on (18)F-FAZA-PET scan. Nine of the eleven tumors were hypoxic with (18)F-FAZA-PET. Hypoxia could also be detected with pimonidazole, HIF1α, CA-IX and GLUT-1 expression in some tumors. No clear association was observed between (18)F-FAZA uptake and hypoxia markers. CONCLUSIONS: This pilot study could not prove the accuracy of (18)F-FAZA-PET in determining hypoxic subvolumes in laryngeal cancer. Further study is required to investigate the benefit of (18)F-FAZA-PET imaging in radiotherapy planning.

The relevance of external quality assessment for molecular testing for ALK positive non-small cell lung cancer: results from two pilot rounds show room for optimization.

BACKGROUND AND PURPOSE: Molecular profiling should be performed on all advanced non-small cell lung cancer with non-squamous histology to allow treatment selection. Currently, this should include EGFR mutation testing and testing for ALK rearrangements. ROS1 is another emerging target. ALK rearrangement status is a critical biomarker to predict response to tyrosine kinase inhibitors such as crizotinib. To promote high quality testing in non-small cell lung cancer, the European Society of Pathology has introduced an external quality assessment scheme. This article summarizes the results of the first two pilot rounds organized in 2012-2013. MATERIALS AND METHODS: Tissue microarray slides consisting of cell-lines and resection specimens were distributed with the request for routine ALK testing using IHC or FISH. Participation in ALK FISH testing included the interpretation of four digital FISH images. RESULTS: Data from 173 different laboratories was obtained. Results demonstrate decreased error rates in the second round for both ALK FISH and ALK IHC, although the error rates were still high and the need for external quality assessment in laboratories performing ALK testing is evident. Error rates obtained by FISH were lower than by IHC. The lowest error rates were observed for the interpretation of digital FISH images. CONCLUSION: There was a large variety in FISH enumeration practices. Based on the results from this study, recommendations for the methodology, analysis, interpretation and result reporting were issued. External quality assessment is a crucial element to improve the quality of molecular testing.

Guideline on the requirements of external quality assessment programs in molecular pathology.

Molecular pathology is an integral part of daily diagnostic pathology and used for classification of tumors, for prediction of prognosis and response to therapy, and to support treatment decisions. For these reasons, analyses in molecular pathology must be highly reliable and hence external quality assessment (EQA) programs are called for. Several EQA programs exist to which laboratories can subscribe, but they vary in scope, number of subscribers, and execution. The guideline presented in this paper has been developed with the purpose to harmonize EQA in molecular pathology. It presents recommendations on how an EQA program should be organized, provides criteria for a reference laboratory, proposes requirements for EQA test samples, and defines the number of samples needed for an EQA program. Furthermore, a system for scoring of the results is proposed as well as measures to be taken for poorly performing laboratories. Proposals are made regarding the content requirements of an EQA report and how its results should be communicated. Finally, the need for an EQA database and a participant manual are elaborated. It is the intention of this guideline to improve EQA for molecular pathology in order to provide more reliable molecular analyses as well as optimal information regarding patient selection for treatment.

Validation of a gene expression signature for assessment of lymph node metastasis in oral squamous cell carcinoma.

PURPOSE: Current assessment of lymph node metastasis in patients with head and neck squamous cell carcinoma is not accurate enough to prevent overtreatment. The aim of this study was validation of a gene expression signature for distinguishing metastasizing (N+) from nonmetastasizing (N0) squamous cell carcinoma of the oral cavity (OSCC) and oropharynx (OPSCC) in a large multicenter cohort, using a diagnostic DNA microarray in a Clinical Laboratory Improvement Amendments/International Organization for Standardization-approved laboratory. METHODS: A multigene signature, previously reported as predictive for the presence of lymph node metastases in OSCC and OPSCC, was first re-evaluated and trained on 94 samples using generic, whole-genome, DNA microarrays. Signature genes were then transferred to a dedicated diagnostic microarray using the same technology platform. Additional samples (n=222) were collected from all head and neck oncologic centers in the Netherlands and analyzed with the diagnostic microarray. Human papillomavirus status was determined by real-time quantitative polymerase chain reaction. RESULTS: The negative predictive value (NPV) of the diagnostic signature on the entire validation cohort (n=222) was 72%. The signature performed well on the most relevant subset of early-stage (cT1-T2N0) OSCC (n=101), with an NPV of 89%. CONCLUSION: Combining current clinical assessment with the expression signature would decrease the rate of undetected nodal metastases from 28% to 11% in early-stage OSCC. This should be sufficient to enable clinicians to refrain from elective neck treatment. A new clinical decision model that incorporates the expression signature is therefore proposed for testing in a prospective study, which could substantially improve treatment for this group of patients.

Assessment of gene promoter hypermethylation for detection of cervical neoplasia.

Current cervical cancer screening is based on morphological assessment of Pap smears and associated with significant false negative and false positive results. Previously, we have shown that detection of hypermethylated genes in cervical scrapings using quantitative methylation-specific PCR (QMSP) is a promising tool for identification of squamous cell cervical cancer. Aim of the present pilot-study was to evaluate presence of hypermethylated genes in cervical carcinogenesis, both in squamous cell as well as adenocarcinomas. Cervical scrapings were obtained from 30 patients diagnosed with cervical cancer (20 squamous cell carcinomas and 10 adenocarcinomas) and 19 women with histologically normal cervices. The scraped cells were used for determination of promoter hypermethylation by QMSP for 12 genes and for morphological assessment. Overall, CALCA, DAPK, ESR1, TIMP3, APC and RAR-beta2 promoters were significantly more often hypermethylated in cancers than in controls, while adenocarcinomas were more often hypermethylated above the highest control ratio for APC, TIMP3 and RASSF1A promoters. Combining 4 genes (CALCA, DAPK, ESR1 and APC) yielded a sensitivity of 89% (with all adenocarcinomas identified), equal to cytomorphology (89%) and high-risk human papilloma virus (Hr-HPV; 90%). The 4-gene QMSP proved theoretically superior to cytomorphology as well as Hr-HPV in specificity (100% vs. 83 and 68%, respectively), because cytology identified 3 controls as moderate or severe dyskaryosis and 6 controls were positive for Hr-HPV. In conclusions, QMSP of 4 gene promoters combined appears to have comparable sensitivity and potentially better specificity in comparison to "classic" cytomorphological assessment and Hr-HPV detection. QMSP holds promise as a new diagnostic tool for both squamous cell carcinoma and adenocarcinoma of the cervix.