Analysis of College of American Pathologists von Willebrand Factor Proficiency Testing Program.

Von Willebrand factor (VWF) level and/or function is altered in von Willebrand disease (VWD), the most common heritable bleeding disorder worldwide. Laboratory assessment of VWF is continually evolving. Historically, the primary method for the assessment of VWF platelet-binding activity was the ristocetin cofactor assay (VWF:RCo). Contemporary alternative measures of VWF platelet-binding activity include VWF:GPIbR (recombinant; using ristocetin), VWF:GPIbM (recombinant; gain-of-function mutant), and monoclonal antibody. Recently, the American Society of Hematology, International Society on Thrombosis and Haemostasis, National Hemophilia Foundation, and World Federation of Hemophilia collaboration issued guidelines recommending the use of newer assays of VWF platelet-binding activity (VWF: GPIbM, VWF: GPIbR) over VWF:RCo, given known limitations of the VWF:RCo assay. Despite this recommendation, the newer VWF:GPIbM and VWF:GPIbR assays are not United States Food and Drug Administration cleared, limiting their availability in the United States. We sought to assess assay utilization trends, agreement of VWF testing methods, and imprecision of VWF testing (based on assigned sample type) from the College of American Pathologists Proficiency Testing Surveys. The analysis confirms that, while VWF antigen testing has low imprecision, the various VWF activity assays have significant interassay variability, with VWF:RCo showing greater imprecision than the newer GPIb-binding assays. The overall trends in assay utilization reflect the barriers to complete compliance with modern VWD diagnostic guidelines in North America.

Analysis of College of American Pathologists von Willebrand Factor Proficiency Testing Program.

Von Willebrand factor (VWF) level and/or function is altered in von Willebrand disease (VWD), the most common heritable bleeding disorder worldwide. Laboratory assessment of VWF is continually evolving. Historically, the primary method for the assessment of VWF platelet-binding activity was the ristocetin cofactor assay (VWF:RCo). Contemporary alternative measures of VWF platelet-binding activity include VWF:GPIbR (recombinant; using ristocetin), VWF:GPIbM (recombinant; gain-of-function mutant), and monoclonal antibody. Recently, the American Society of Hematology, International Society on Thrombosis and Haemostasis, National Hemophilia Foundation, and World Federation of Hemophilia collaboration issued guidelines recommending the use of newer assays of VWF platelet-binding activity (VWF: GPIbM, VWF: GPIbR) over VWF:RCo, given known limitations of the VWF:RCo assay. Despite this recommendation, the newer VWF:GPIbM and VWF:GPIbR assays are not United States Food and Drug Administration cleared, limiting their availability in the United States. We sought to assess assay utilization trends, agreement of VWF testing methods, and imprecision of VWF testing (based on assigned sample type) from the College of American Pathologists Proficiency Testing Surveys. The analysis confirms that, while VWF antigen testing has low imprecision, the various VWF activity assays have significant interassay variability, with VWF:RCo showing greater imprecision than the newer GPIb-binding assays. The overall trends in assay utilization reflect the barriers to complete compliance with modern VWD diagnostic guidelines in North America.

Estrogen Receptor, Progesterone Receptor, and Human Epidermal Growth Factor Receptor 2 Expression Rates in Invasive Breast Carcinoma: A Study of 21 Institutions.

CONTEXT.­: Laboratories performing predictive marker testing for breast carcinoma are encouraged to compare patient results to published benchmarks. OBJECTIVE.­: To collect expression rates for estrogen receptor (ER), progesterone receptor (PgR), and human epidermal growth factor receptor 2 (HER2) in invasive breast carcinoma from multiple laboratories. DESIGN.­: Participants submitted data from up to 50 primary cases during the study period. Participants reported ER, PgR, and HER2 results in addition to demographic and histologic information. Participants also provided annual institution-level expression rates. RESULTS.­: A total of 21 institutions submitted data for 687 cases. Aggregate positivity rates for ER and PgR were 85.6% and 75.1%, respectively. Receptor positivity rates were higher in well-differentiated (grade 1) tumors (ER, 97.4%; PgR, 88.0%) compared with moderately differentiated (grade 2) tumors (ER, 92.4%; PgR, 84.0%) and poorly differentiated (grade 3) tumors (ER, 61.8%; PgR, 48.0%). Expression rates were higher in postmenopausal women (ER, 87.2%) than premenopausal women (ER, 79.6%) and higher in lobular carcinomas (ER, 98.7%; PgR, 85.3%) than ductal carcinomas (ER, 84.1%; PgR, 74.5%). The aggregate HER2 positivity (score 3+) rate was 9.0%. The aggregate HER2 equivocal (score 2+) rate was 14.5%. Of 81 equivocal (score 2+) cases, 70 (86.4%) were nonamplified. CONCLUSIONS.­: The data from this study provide multi-institutional benchmark data to assist laboratories performing periodic comparisons as part of a quality management program. Overall expression rates were generally similar to those of other published reports, with the exception of the ER-negative and HER2-positive rates, both of which were somewhat lower.

SPOT/Dx Pilot Reanalysis and College of American Pathologists Proficiency Testing for KRAS and NRAS Demonstrate Excellent Laboratory Performance.

CONTEXT.­: The Sustainable Predictive Oncology Therapeutics and Diagnostics quality assurance pilot study (SPOT/Dx pilot) on molecular oncology next-generation sequencing (NGS) reportedly demonstrated performance limitations of NGS laboratory-developed tests, including discrepancies with a US Food and Drug Administration-approved companion diagnostic. The SPOT/Dx pilot methods differ from those used in proficiency testing (PT) programs. OBJECTIVE.­: To reanalyze SPOT/Dx pilot data using PT program methods and compare to PT program data.Also see p. 136. DESIGN.­: The College of American Pathologists (CAP) Molecular Oncology Committee reanalyzed SPOT/Dx pilot data applying PT program methods, adjusting for confounding conditions, and compared them to CAP NGS PT program performance (2019-2022). RESULTS.­: Overall detection rates of KRAS and NRAS single-nucleotide variants (SNVs) and multinucleotide variants (MNVs) by SPOT/Dx pilot laboratories were 96.8% (716 of 740) and 81.1% (129 of 159), respectively. In CAP PT programs, the overall detection rates for the same SNVs and MNVs were 97.2% (2671 of 2748) and 91.8% (1853 of 2019), respectively. In 2022, the overall detection rate for 5 KRAS and NRAS MNVs in CAP PT programs was 97.3% (1161 of 1193). CONCLUSIONS.­: CAP PT program data demonstrate that laboratories consistently have high detection rates for KRAS and NRAS variants. The SPOT/Dx pilot has multiple design and analytic differences with established PT programs. Reanalyzed pilot data that adjust for confounding conditions demonstrate that laboratories proficiently detect SNVs and less successfully detect rare to never-observed MNVs. The SPOT/Dx pilot results are not generalizable to all molecular oncology testing and should not be used to market products or change policy affecting all molecular oncology testing.

Next-Generation Sequencing Somatic and Germline Assay Troubleshooting Guide Derived From Proficiency Testing Data.

CONTEXT.­: Next-generation sequencing-based assays are increasingly used in clinical molecular laboratories to detect somatic variants in solid tumors and hematologic malignancies and to detect constitutional variants. Proficiency testing data are potential sources of information about challenges in performing these assays. OBJECTIVE.­: To examine the most common sources of unacceptable results from the College of American Pathologists Next-Generation Sequencing Bioinformatics, Hematological Malignancies, Solid Tumor, and Germline surveys and provide recommendations on how to avoid these pitfalls and improve performance. DESIGN.­: The College of American Pathologists next-generation sequencing somatic and germline proficiency testing survey results from 2016 to 2019 were analyzed to identify the most common causes of unacceptable results. RESULTS.­: On somatic and germline proficiency testing surveys, 95.9% (18 815/19 623) and 97.8% (33 890/34 641) of all variants were correctly identified, respectively. The most common causes of unacceptable results related to sequencing were false-negative errors in genomic regions that were difficult to sequence because of high GC content. False-positive errors occurred in the context of homopolymers and pseudogenes. Recurrent errors in variant annotation were seen for dinucleotide and duplication variants and included unacceptable transcript selection and outdated variant nomenclature. A small percentage of preanalytic or postanalytic errors were attributed to specimen swaps and transcription errors. CONCLUSIONS.­: Laboratories demonstrate overall excellent performance for detecting variants in both somatic and germline proficiency testing surveys. Proficiency testing survey results highlight infrequent, but recurrent, analytic and nonanalytic challenges in performing next- generation sequencing-based assays and point to remedies to help laboratories improve performance.

Therapeutic Drug Monitoring of Second- and Third-Generation Antiepileptic Drugs.

CONTEXT.­: Therapeutic drug monitoring has traditionally been widely used for first-generation antiepileptic drugs (AEDs) such as carbamazepine and phenytoin. The last 2 decades have seen the introduction of second- and third-generation AEDs (eg, lamotrigine, levetiracetam, and topiramate) into clinical practice. OBJECTIVE.­: To use data from the College of American Pathologists Therapeutic Drug Monitoring, Extended Proficiency Testing Survey to determine the performance of assays used for therapeutic drug monitoring of newer AEDs, including comparison of enzyme immunoassay and chromatographic techniques. DESIGN.­: Six years of proficiency testing surveys were reviewed (2013-2018). RESULTS.­: Steady growth was seen in participant volumes for newer AEDs. The analytical performance of automated enzyme immunoassays for lamotrigine, levetiracetam, and topiramate was similar to that of chromatographic methods, consistent with published literature using patient samples for comparisons. The majority of participating laboratories now use enzyme immunoassays to measure levetiracetam. CONCLUSIONS.­: Survey results reflect steadily growing interest in therapeutic drug monitoring of newer AEDs. The increasing availability of robust immunoassays for new AEDs should facilitate their clinical utility, especially for clinical laboratories that do not perform chromatographic assays for therapeutic drug monitoring.

Crucial Role of the C-Terminal Domain of Hfq Protein in Genomic Instability.

G-rich DNA repeats that can form G-quadruplex structures are prevalent in bacterial genomes and are frequently associated with regulatory regions of genes involved in virulence, antigenic variation, and antibiotic resistance. These sequences are also inherently mutagenic and can lead to changes affecting cell survival and adaptation. Transcription of the G-quadruplex-forming repeat (G3T)n in E. coli, when mRNA comprised the G-rich strand, promotes G-quadruplex formation in DNA and increases rates of deletion of G-quadruplex-forming sequences. The genomic instability of G-quadruplex repeats may be a source of genetic variability that can influence alterations and evolution of bacteria. The DNA chaperone Hfq is involved in the genetic instability of these G-quadruplex sequences. Inactivation of the hfq gene decreases the genetic instability of G-quadruplex, demonstrating that the genomic instability of this regulatory element can be influenced by the E. coli highly pleiotropic Hfq protein, which is involved in small noncoding RNA regulation pathways, and DNA organization and packaging. We have shown previously that the protein binds to and stabilizes these sequences, increasing rates of their genomic instability. Here, we extend this analysis to characterize the role of the C-terminal domain of Hfq protein in interaction with G-quadruplex structures. This allows to better understand the function of this specific region of the Hfq protein in genomic instability.

Genotype and Phenotype Concordance for Pharmacogenetic Tests Through Proficiency Survey Testing.

CONTEXT.­: As pharmacogenetic testing is incorporated into routine care, it is essential for laboratories to provide accurate and consistent results. Certified laboratories must successfully complete proficiency testing. OBJECTIVES.­: To understand and examine trends in participation and performance of laboratories participating in the College of American Pathologists pharmacogenetic proficiency testing surveys. DESIGN.­: Results from College of American Pathologists pharmacogenetic proficiency testing challenges from 2012 through 2017 were reviewed for concordance with expected genotype and phenotype for each sample (intended responses). RESULTS.­: Laboratories correctly reported results for 96.7% to 100% of samples with no variants. Excluding CYP2D6, laboratories correctly detected and reported variant alleles for each gene (93.7%-99.2% correct). CYP2D6 showed lower concordance, with 83.1% of laboratories reporting the intended genotype across all samples; however, in many cases, the laboratories that did not report a variant allele did not test for that allele. Among laboratories reporting the intended genotype, most successfully reported the intended phenotype (85.9%-99.0%). CONCLUSIONS.­: Although laboratories are generally performing well, there is room for additional improvement, particularly for challenging genes, such as CYP2D6. Efforts in the field of pharmacogenomics to recommend alleles that should be included in clinical tests, identify reference materials, and standardize translation from genotype to phenotype may address some of the remaining variability in results.

Proficiency Testing of Standardized Samples Shows High Interlaboratory Agreement for Clinical Next Generation Sequencing-Based Hematologic Malignancy Assays With Survey Material-Specific Differences in Variant Frequencies.

CONTEXT.­: As laboratories increasingly turn from single-analyte testing in hematologic malignancies to next-generation sequencing-based panel testing, there is a corresponding need for proficiency testing to ensure adequate performance of these next-generation sequencing assays for optimal patient care. OBJECTIVE.­: To report the performance of laboratories on proficiency testing from the first 4 College of American Pathologists Next-Generation Sequencing Hematologic Malignancy surveys. DESIGN.­: College of American Pathologists proficiency testing results for 36 different engineered variants and/or allele fractions as well as a sample with no pathogenic variants were analyzed for accuracy and associated assay performance characteristics. RESULTS.­: The overall sensitivity observed for all variants was 93.5% (2190 of 2341) with 99.8% specificity (22 800 of 22 840). The false-negative rate was 6.5% (151 of 2341), and the largest single cause of these errors was difficulty in identifying variants in the sequence of CEBPA that is rich in cytosines and guanines. False-positive results (0.18%; 40 of 22 840) were most likely the result of preanalytic or postanalytic errors. Interestingly, the variant allele fractions were almost uniformly lower than the engineered fraction (as measured by digital polymerase chain reaction). Extensive troubleshooting identified a multifactorial cause for the low variant allele fractions, a result of an interaction between the linearized nature of the plasmid and the Illumina TruSeq chemistry. CONCLUSIONS.­: Laboratories demonstrated an overall accuracy of 99.2% (24 990 of 25 181) with 99.8% specificity and 93.5% sensitivity when examining 36 clinically relevant somatic single-nucleotide variants with a variant allele fraction of 10% or greater. The data also highlight an issue with artificial linearized plasmids as survey material for next-generation sequencing.

Next-Generation Sequencing (NGS) Methods Show Superior or Equivalent Performance to Non-NGS Methods on BRAF, EGFR, and KRAS Proficiency Testing Samples.

CONTEXT.­: There has been a rapid expansion of next-generation sequencing (NGS)-based assays for the detection of somatic variants in solid tumors. However, limited data are available regarding the comparative performance of NGS and non-NGS assays using standardized samples across a large number of laboratories. OBJECTIVE.­: To compare the performance of NGS and non-NGS assays using well-characterized proficiency testing samples provided by the College of American Pathologists (CAP) Molecular Oncology Committee. A secondary goal was to compare the use of preanalytic and postanalytic practices. DESIGN.­: A total of 17 343 responses were obtained from participants in the BRAF, EGFR, KRAS, and the Multigene Tumor Panel surveys across 84 different proficiency testing samples interrogating 16 variants and 3 wild-type sequences. Performance and preanalytic/postanalytic practices were analyzed by method. RESULTS.­: While both NGS and non-NGS achieved an acceptable response rate of greater than 95%, the overall performance of NGS methods was significantly better than that of non-NGS methods for the identification of variants in BRAF (overall 97.8% versus 95.6% acceptable responses, P = .001) and EGFR (overall 98.5% versus 97.3%, P = .01) and was similar for KRAS (overall 98.8% and 97.6%, P = .10). There were specific variant differences, but in all discrepant cases, NGS methods outperformed non-NGS methods. NGS laboratories also more consistently used preanalytic and postanalytic practices suggested by the CAP checklist requirements than non-NGS laboratories. CONCLUSIONS.­: The overall analytic performance of both methods was excellent. For specific BRAF and EGFR variants, NGS outperformed non-NGS methods and NGS laboratories report superior adherence to suggested laboratory practices.

Performance Comparison of Different Analytic Methods in Proficiency Testing for Mutations in the BRAF, EGFR, and KRAS Genes: A Study of the College of American Pathologists Molecular Oncology Committee.

CONTEXT.­: The performance of laboratory testing has recently come under increased scrutiny as part of important and ongoing debates on regulation and reimbursement. To address this critical issue, this study compares the performance of assay methods, using either commercial kits or assays designed and implemented by single laboratories ("home brews"), including next-generation sequencing methods, on proficiency testing provided by the College of American Pathologists Molecular Oncology Committee. OBJECTIVE.­: To compare the performance of different assay methods on College of American Pathologists proficiency testing for variant analysis of 3 common oncology analytes: BRAF, EGFR, and KRAS. DESIGN.­: There were 6897 total responses across 35 different proficiency testing samples interrogating 13 different variants as well as wild-type sequences for BRAF, EGFR, and KRAS. Performance was analyzed by test method, kit manufacturer, variants tested, and preanalytic and postanalytic practices. RESULTS.­: Of 26 reported commercial kits, 23 achieved greater than 95% accuracy. Laboratory-developed tests with no kit specified demonstrated 96.8% or greater accuracy across all 3 analytes (1123 [96.8%] acceptable of 1160 total responses for BRAF; 848 [97.5%] acceptable of 870 total responses for EGFR; 942 [97.0%] acceptable of 971 total responses for KRAS). Next-generation sequencing platforms (summed across all analytes and 2 platforms) demonstrated 99.4% accuracy for these analytes (165 [99.4%] acceptable of 166 total next-generation sequencing responses). Slight differences in performance were noted among select commercial assays, dependent upon the particular design and specificity of the assay. Wide differences were noted in the lower limits of neoplastic cellularity laboratories accepted for testing. CONCLUSIONS.­: These data demonstrate the high degree of accuracy and comparable performance across all laboratories, regardless of methodology. However, care must be taken in understanding the diagnostic specificity and reported analytic sensitivity of individual methods.

Comparison of Laboratory-Developed Tests and FDA-Approved Assays for BRAF, EGFR, and KRAS Testing.

Importance: The debate about the role of the Food and Drug Administration (FDA) in the regulation of laboratory-developed tests (LDTs) has focused attention on the analytical performance of all clinical laboratory testing. This study provides data comparing the performance of LDTs and FDA-approved companion diagnostics (FDA-CDs) in proficiency testing (PT) provided by the College of American Pathologists Molecular Oncology Committee. Objective: To compare the analytical performance of LDTs and FDA-CDs on well-characterized PT samples and to compare the practice characteristics of laboratories using these assays. Design, Setting, and Participants: This comparison of PT responses examines the performance of laboratories participating in the College of American Pathologists PT for 3 oncology analytes for which both FDA-CDs and LDTs are used: BRAF, EGFR, and KRAS. A total of 6897 PT responses were included: BRAF (n = 2524; 14 PT samples), EGFR (n = 2216; 11 PT samples), and KRAS (n = 2157, 10 PT samples). US Food and Drug Administration companion diagnostics and LDTs are compared for both accuracy and preanalytic practices of the laboratories. Main Outcomes and Measures: As per the College of American Pathologists PT standards, results were scored and the percentages of acceptable responses for each analyte were compared. These were also broken down by the specific variants tested, by kit manufacturer for laboratories using commercial reagents, and by preanalytic practices. Results: From analysis of 6897 PT responses, this study demonstrates that both LDTs and FDA-CDs have excellent performance overall, with both test types exceeding 97% accuracy for all 3 genes (BRAF, EGFR, and KRAS) combined. Rare variant-specific differences did not consistently favor LDTs or FDA-CDs. Additionally, more than 60% of participants using an FDA-CD reported adapting their assay from the approved procedure to allow for a greater breadth of sample types, minimum tumor content, and instrumentation, changing the classification of their assay from FDA-CD to LDT. Conclusions: This study demonstrates the high degree of accuracy and comparable performance of both LDTs and FDA-CDs for 3 oncology analytes. More significantly, the majority of laboratories using FDA-CDs have modified the scope of their assay to allow for more clinical practice variety, rendering them LDTs. These findings support both the excellent and equivalent performance of both LDTs and FDA-CDs in clinical diagnostic testing.

A prospective, multi-institutional diagnostic trial to determine pathologist accuracy in estimation of percentage of malignant cells.

CONTEXT: The fraction of malignant cells in tumor tissue submitted for tests of genetic alterations is a critical variable in testing accuracy. That fraction is currently determined by pathologist visual estimation of the percentage of malignant cells. Inaccuracy could lead to a false-negative test result. OBJECTIVE: To describe a prospective, multi-institutional study to determine pathologist estimation accuracy. DESIGN: Ten ×20 magnification images of hematoxylin-eosin-stained colon tissue specimens were sent as an educational component of the College of American Pathologists KRAS-B 2011 Survey. Data from 194 labs were analyzed and compared to a criterion standard with comprehensive manual nuclear counts. RESULTS: Survey responses indicated low interlaboratory precision of pathologist estimation, but mean estimates were fairly accurate. A total of 5 of the 10 cases assessed showed more than 10% of respondents overestimating in a manner that could lead to false-negative test results. CONCLUSIONS: The significance of estimation errors resulting in molecular testing failures with implications for patient care is unknown, but the current study suggests false-negative test results may occur.