Implementation of circulating tumour DNA multi-target mutation testing in plasma: a perspective from an external quality assessment providers' survey.

Demand for large-scale tumour profiling across cancer types has increased in recent years, driven by the emergence of targeted drug therapies. Analysing alternations in plasma circulating tumour DNA (ctDNA) for cancer detection can improve survival; ctDNA testing is recommended when tumour tissue is unavailable. An online survey of molecular pathology testing was circulated by six external quality assessment members of IQN Path to registered laboratories and all IQN Path collaborative corporate members. Data from 275 laboratories across 45 countries were collected; 245 (89%) perform molecular pathology testing, including 177 (64%) which perform plasma ctDNA diagnostic service testing. The most common tests were next-generation sequencing-based (n = 113). Genes with known stratified treatment options, including KRAS (n = 97), NRAS (n = 84), and EGFR (n = 130), were common targets. The uptake of ctDNA plasma testing and plans to implement further testing demonstrates the importance of support from a well-designed EQA scheme.

External quality assessment (EQA) for tumor mutational burden: results of an international IQN path feasibility pilot scheme.

Tumor mutational burden (TMB) has recently been approved as an agnostic biomarker for immune checkpoint inhibitors. However, methods for TMB testing have not yet been standardized. The International Quality Network for Pathology (IQNPath) organized a pilot external quality assessment (EQA) scheme for TMB testing. The aim of this program was the validation of the materials and the procedures for the EQA of this complex biomarker. Five formalin-fixed paraffin-embedded (FFPE) cell lines were selected to mimic the various TMB values observed in clinical practice. The FFPE samples were tested with the FoundationOne CDx (F1CDx) assay as the reference test and three commercially available targeted sequencing panels. Following this internal validation, the five cell lines were sent to 29 laboratories selected on the basis of a previous survey. Nineteen of the 23 laboratories that submitted results (82.6%) used targeted sequencing for TMB estimation. Only two laboratories performed whole exome sequencing (WES) and two assessed TMB by clinical exome. A high variability in the reported TMB values was observed. The variability was higher for samples with the highest TMB value according to the F1CDx test. However, good reproducibility of the TMB score was shown by laboratories using the same panel. The majority of laboratories did not indicate a TMB cut-off value for clinical interpretation. In conclusion, this pilot EQA scheme suggests that it is feasible to run such an EQA program for TMB assessment. However, the results of our pilot highlight the numerous challenges for the standardization of this test.

Results of a worldwide external quality assessment of cfDNA testing in lung Cancer.

BACKGROUND: Circulating cell free DNA (cfDNA) testing of plasma for EGFR somatic variants in lung cancer patients is being widely implemented and with any new service, external quality assessment (EQA) is required to ensure patient safety. An international consortium, International Quality Network for Pathology (IQNPath), has delivered a second round of assessment to measure the accuracy of cfDNA testing for lung cancer and the interpretation of the results. METHODS: A collaboration of five EQA provider organisations, all members of IQNPath, have delivered the assessment during 2018-19 to a total of 264 laboratories from 45 countries. Bespoke plasma reference material containing a range of EGFR mutations at varying allelic frequencies were supplied to laboratories for testing and reporting according to routine procedures. The genotyping accuracy and clinical reporting was reviewed against standardised criteria and feedback was provided to participants. RESULTS: The overall genotyping error rate in the EQA was found to be 11.1%. Low allelic frequency samples were the most challenging and were not detected by some testing methods, resulting in critical genotyping errors. This was reflected in higher false negative rates for samples with variant allele frequencies (VAF) rates less than 1.5% compared to higher frequencies. A sample with two different EGFR mutations gave inconsistent detection of both mutations. However, for one sample, where two variants were present at a VAF of less than 1% then both mutations were correctly detected in 145/263 laboratories. Reports often did not address the risk that tumour DNA may have not been tested and limitations of the methodologies provided by participants were insufficient. This was reflected in the average interpretation score for the EQA being 1.49 out of a maximum of 2. CONCLUSIONS: The variability in the standard of genotyping and reporting highlighted the need for EQA and educational guidance in this field to ensure the delivery of high-quality clinical services where testing of cfDNA is the only option for clinical management.

External Quality Assessment Schemes for Biomarker Testing in Oncology: Comparison of Performance between Formalin-Fixed, Paraffin-Embedded-Tissue and Cell-Free Tumor DNA in Plasma.

Liquid biopsies have emerged as a useful addition to tissue biopsies in molecular pathology. Literature has shown lower laboratory performances when a new method of variant analysis is introduced. This study evaluated the differences in variant analysis between tissue and plasma samples after the introduction of liquid biopsy in molecular analysis. Data from a pilot external quality assessment scheme for the detection of molecular variants in plasma samples and from external quality assessment schemes for the detection of molecular variants in tissue samples were collected. Laboratory performance and error rates by sample were compared between matrices for variants present in both scheme types. Results showed lower overall performance [65.6% (n = 276) versus 89.2% (n = 1607)] and higher error rates [21.0% to 43.5% (n = 138) versus 8.7% to 16.7% (n = 234 to 689)] for the detection of variants in plasma compared to tissue, respectively. In the plasma samples, performance was decreased for variants with an allele frequency of 1% compared to 5% [56.5% (n = 138) versus 74.6% (n = 138)]. The implementation of liquid biopsy in the detection of circulating tumor DNA in plasma was associated with poor laboratory performance. It is important both to apply optimal detection methods and to extensively validate new methods for testing circulating tumor DNA before treatment decisions are made.

Ensuring high standards for the delivery of NIPT world-wide: Development of an international external quality assessment scheme.

OBJECTIVE: To ensure accurate and appropriate reporting of non-invasive prenatal testing (NIPT) results, the standard of testing should be measured and monitored by participation in external quality assessment (EQA) schemes. The findings from international pilot EQAs for NIPT for the common trisomies are presented. METHODS: In the first pilot, three EQA providers used artificially manufactured reference materials to deliver an EQA for NIPT. The second pilot used clinically collected maternal plasma samples. The testing and reporting for aneuploidy status was performed by participating laboratories using routine procedures. Reports were assessed against peer ratified criteria and EQA scores were returned to participants. RESULTS: Forty laboratories participated in the first. Genotyping accuracy was high; four laboratories reported a critical genotyping error (10%) and two reported partial results. Eighty seven laboratories participated in the second pilot using maternal plasma, two reporting a critical genotyping error (2.3%). For both rounds, report content was variable with key information frequently omitted or difficult to identify within the report. CONCLUSIONS: We have successfully delivered an international pilot EQA for NIPT. When compared with currently available manufactured materials, EQA for NIPT was best performed using clinically collected maternal plasma. Work is required to define and improve the standard of reporting.

International pilot external quality assessment scheme for analysis and reporting of circulating tumour DNA.

BACKGROUND: Molecular analysis of circulating tumour DNA (ctDNA) is becoming increasingly important in clinical treatment decisions. A pilot External Quality Assessment (EQA) scheme for ctDNA analysis was organized by four European EQA providers under the umbrella organization IQN Path, in order to investigate the feasibility of delivering an EQA to assess the detection of clinically relevant variants in plasma circulating cell-free DNA (cfDNA) and to analyze reporting formats. METHODS: Thirty-two experienced laboratories received 5 samples for EGFR mutation analysis and/or 5 samples for KRAS and NRAS mutation analysis. Samples were artificially manufactured to contain 3 mL of human plasma with 20 ng/mL of fragmented ctDNA and variants at allelic frequencies of 1 and 5%. RESULTS: The scheme error rate was 20.1%. Higher error rates were observed for RAS testing when compared to EGFR analysis, for allelic frequencies of 1% compared to 5%, and for cases including 2 different variants. The reports over-interpreted wild-type results and frequently failed to comment on the amount of cfDNA extracted. CONCLUSIONS: The pilot scheme demonstrated the feasibility of delivering a ctDNA EQA scheme and the need for such a scheme due to high error rates in detecting low frequency clinically relevant variants. Recommendations to improve reporting of cfDNA are provided.

HGVS Nomenclature in Practice: An Example from the United Kingdom National External Quality Assessment Scheme.

The recommendations for the description of sequence variants from the Human Genome Variation Society (HGVS) were published in 2000. Over the years, the recommendations became widely adopted, especially in human clinical genetics and DNA laboratory reporting. As part of a testing scheme performed by the United Kingdom National External Quality Assessment Scheme (UK NEQAS) for Molecular Genetics, we assessed the current variability in the use and interpretation of the guidelines by diagnostic laboratories based across the globe. Twenty-six participating laboratories gave 21 different descriptions. Six laboratories gave fully compliant HGVS descriptions, 12 laboratories reported the correct variant, although not using the recommended format, whilst eight laboratory reports (31%) were not correct. The results indicate that available tools to check variant descriptions were not used. We conclude that education appears to be the way forward to eliminate the observed variability in data reporting.

External quality assessment of BRAF molecular analysis in melanoma.

The availability of BRAF inhibitors has given metastatic melanoma patients an effective new treatment choice and molecular testing to determine the presence or absence of a BRAF codon 600 mutation is pivotal in the clinical management of these patients. This molecular test must be performed accurately and appropriately to ensure that the patient receives the most suitable treatment in a timely manner. Laboratories have introduced such testing; however, some experience low sample throughput making it critical that an external quality assurance programme is available to help promote a high standard of testing, reporting and provide an educational aspect for BRAF molecular testing. Laboratories took part in three rounds of external quality assessment (EQA) during a 12-month period giving participants a measure of the accuracy of genotyping, clinical interpretation of the result and experience in testing a range of different samples. Formalin fixed paraffin embedded tissue sections from malignant melanoma patients were distributed to participants for BRAF molecular testing. The standard of testing was generally high but distribution of a mutation other than the most common, p.(Val600Glu), highlighted concerns with detection or reporting of the presence of rarer mutations. The main issues raised in the interpretation of the results were the importance of clear unambiguous interpretation of the result tailored to the patient and the understanding that the treatment is different from that given to other stratified medicine programmes. The variability in reporting and wide range of methodologies used indicate a continuing need for EQA in this field.

Improvement in the quality of molecular analysis of EGFR in non-small-cell lung cancer detected by three rounds of external quality assessment.

BACKGROUND: The clinical need to determine the presence of epidermal growth factor receptor (EGFR) gene mutations in non-small-cell lung cancers (NSCLC) in order to make informed decisions for patient treatment has seen the widespread introduction of EGFR molecular testing in many laboratories. To ensure high-quality molecular testing and allow laboratories to externally measure the standard of the service, an external quality assessment (EQA) scheme was provided to assess the whole testing process. METHODS: Formalin-fixed paraffin-embedded NSCLC tumour sections were distributed to laboratories for routine EGFR molecular testing, and the genotyping accuracy, interpretation of the result and clerical accuracy of the report were independently assessed. RESULTS: Three rounds of assessment have identified many genotyping errors and have highlighted the need for external assessment and education in many testing laboratories. The main issues raised were the importance of accurate genotyping, including the use of common mutation nomenclature, clear unambiguous interpretation of the result, the impact of tumour sample assessment regarding amount of tumour being analysed and the heterogeneity of the sample on the molecular test result. CONCLUSIONS: Improvements in all these areas were observed during the progression of the three EQA rounds, however, continuous unacceptably high genotyping error rates demonstrate the clear need for continual external assessment and education in this field.

Guideline on the requirements of external quality assessment programs in molecular pathology.

Molecular pathology is an integral part of daily diagnostic pathology and used for classification of tumors, for prediction of prognosis and response to therapy, and to support treatment decisions. For these reasons, analyses in molecular pathology must be highly reliable and hence external quality assessment (EQA) programs are called for. Several EQA programs exist to which laboratories can subscribe, but they vary in scope, number of subscribers, and execution. The guideline presented in this paper has been developed with the purpose to harmonize EQA in molecular pathology. It presents recommendations on how an EQA program should be organized, provides criteria for a reference laboratory, proposes requirements for EQA test samples, and defines the number of samples needed for an EQA program. Furthermore, a system for scoring of the results is proposed as well as measures to be taken for poorly performing laboratories. Proposals are made regarding the content requirements of an EQA report and how its results should be communicated. Finally, the need for an EQA database and a participant manual are elaborated. It is the intention of this guideline to improve EQA for molecular pathology in order to provide more reliable molecular analyses as well as optimal information regarding patient selection for treatment.

Molecular genetics external quality assessment pilot scheme for KRAS analysis in metastatic colorectal cancer.

Laboratories are increasingly required to perform molecular tests for the detection of mutations in the KRAS gene in metastatic colorectal cancers to allow better clinical management and more effective treatment for these patients. KRAS mutation status predicts a patient's likely response to the monoclonal antibody cetuximab. To provide a high standard of service, these laboratories require external quality assessment (EQA) to monitor the level of laboratory output and measure the performance of the laboratory against other service providers. National External Quality Assurance Services for Molecular Genetics provided a pilot EQA scheme for KRAS molecular analysis in metastatic colorectal cancers during 2009. Very few genotyping errors were reported by participating laboratories; however, the reporting nomenclature of the genotyping results varied considerably between laboratories. The pilot EQA scheme highlighted the need for continuing EQA in this field which will assess the laboratories' ability not only to obtain accurate, reliable results but also to interpret them safely and correctly ensuring that the referring clinician has the correct information to make the best clinical therapeutic decision for their patient.