Assessment of laboratories offering cell-free (cf) DNA screening for Down syndrome: results of the 2018 College of American Pathology External Educational Exercises.

PURPOSE: Summarize and interpret results from exercises distributed to laboratories offering cell-free (cf) DNA screening for Down syndrome. METHODS: The College of American Pathologists distributed three patient-derived plasma specimens twice in 2018. Sequencing platforms, test methods, results, and responses to supplemental questions were collected. Results were not graded but discrepancies were identified. RESULTS: Sixty-five laboratories from six continents enrolled; six provided no results. The most common methodology was shotgun/genome sequencing (39/56, 70%). Overall, 40% of the gestational or maternal age responses were incorrect but 45% of the errors were corrected by the next distribution. Fetal fractions from 54 responding laboratories generally agreed with the intended response. No genotyping errors occurred (40/40 for trisomy 21 and 226/226 for euploid challenges) but 10 additional tests failed (3.6%). All 213 fetal sex calls were correct. Participants reported their clinical text for a Down syndrome screen positive test; 39% were classified as inadequate or misleading. CONCLUSION: Patient-derived materials are suitable for all enrolled technologies/methodologies, but collecting material is challenging. Suggested clinical text includes the terms "screen positive" and "screen negative." Overall, laboratories performed well. Future efforts will focus on potential manufactured samples, clarifying results reporting and including additional chromosome abnormalities.

Reported Awareness and Adoption of 2021 Estimated Glomerular Filtration Rate Equations Among US Clinical Laboratories, March 2022.

This study includes clinical laboratories that participated in the first general chemistry proficiency testing survey in 2022 to assess awareness and adoption of new equations from the Chronic Kidney Disease Epidemiology Collaboration for estimated glomerular filtration rate (eGFR) that eliminated race-adjustment factors, including one based on creatinine and one based on creatinine and cystatin C.

Reported Awareness and Use of Pyridoxal-5'-Phosphate Supplementation in Alanine Aminotransferase and Aspartate Aminotransferase Assay Reagents: A Survey by the College of American Pathologists Clinical Chemistry Committee.

CONTEXT.­: Alanine aminotransferase (ALT) and aspartate aminotransferase (AST) assay reagents are available both with and without supplementation with pyridoxal-5'-phosphate (P5P; the active form of vitamin B6), a catalytic cofactor required for their enzymatic reactions. Nonsupplemented assays may miss ALT or AST elevations in patients with vitamin B6 deficiency. OBJECTIVE.­: To assess awareness and adoption of ALT and AST reagents that are supplemented with P5P. DESIGN.­: A 4-question survey about ALT and AST reagent supplementation with P5P was included in the College of American Pathologists General Chemistry and Therapeutic Drugs (C program) proficiency testing 2023 B mailing. RESULTS.­: Overall, 38% (1651 of 4304) of responding laboratories reported using ALT and/or AST reagent supplemented with P5P. P5P supplementation was more common for nonacademic hospital/medical center laboratories (44%; 713 of 1629) relative to other settings. Of the laboratories that reported not using P5P-supplemented reagents, few (5%; 141 of 2611) cited plans to convert in the future. Despite the availability of P5P-supplemented reagents from several major assay manufacturers, the most common stated barrier for adoption was that the laboratory's reagent manufacturer does not provide P5P-supplemented reagents. CONCLUSIONS.­: There is a lack of awareness of the existence and benefits of P5P-supplemented ALT and AST reagents. There is a need for ALT and AST assay manufacturers to clarify and standardize the P5P status of ALT and AST reagents.

Navigating Practice Issues Related to the Unsatisfactory Cervicovaginal Papanicolaou Test: Survey Results of Laboratories Participating in the 2020 College of American Pathologists PAP Education Program.

CONTEXT.­: Unsatisfactory Papanicolaou (Pap) tests pose a unique set of challenges to the laboratory with regard to their processing, review, reporting, and performance of human papillomavirus (HPV) testing. There are no standardized guidelines for the review process and handling of unsatisfactory Pap tests. OBJECTIVE.­: To assess the current practice patterns regarding various aspects of the unsatisfactory Pap test, from processing to reporting, across laboratories worldwide. DESIGN.­: A supplemental questionnaire was mailed to laboratories participating in the 2020 College of American Pathologists (CAP) Gynecologic Cytopathology (PAP Education) Program, requesting data regarding the unsatisfactory Pap test. RESULTS.­: Of 1520 participating laboratories, 619 (40.7%) responded, and the responses of 577 laboratories were included for further analysis. Only 64.6% (373 of 577) laboratories used the unsatisfactory Pap test criteria as specified by the 2014 Bethesda System. About three-quarters of the respondents (433 of 576; 75.2%) routinely rescreened unsatisfactory Pap tests. Routine repreparation of such Pap tests was performed by 54.9% (316 of 576) of laboratories, and 52.0% (293 of 563) used glacial acetic acid for repreparing excessively bloody specimens. HPV test results were reported for unsatisfactory Pap tests, always or sometimes, by 62.4% (353 of 566) of respondents. CONCLUSIONS.­: This CAP survey reveals important information regarding the practice patterns pertaining to several aspects of the unsatisfactory Pap test. It also provides valuable insight into the quality assurance measures that can be implemented for such tests. Future studies can further aid in the standardization of all components of the handling of unsatisfactory Pap tests for overall quality improvement.

High Prevalence of Multistep Algorithms in Diagnostic Clostridioides difficile Laboratory Testing.

CONTEXT.­: Laboratory testing practices for diagnosis of Clostridioides difficile infection (CDI) have evolved in response to published guidelines, availability of highly sensitive nucleic acid amplification tests (NAATs), perceived problems with the specificity of NAATs, and CDI reporting requirements. OBJECTIVE.­: To assess the current state of laboratory practice for diagnostic CDI testing. DESIGN.­: An optional 8-item supplemental questionnaire was distributed in December 2019 to the 1374 laboratories participating in the College of American Pathologists C difficile Detection (CDF) proficiency testing program challenge CDF-C. RESULTS.­: Of 1374 CDF-C participants, 1160 (84.4%) responded, predominantly representing laboratories based in the United States (1077 of 1160; 92.8%). The majority reported using a multistep testing algorithm (684 of 1159; 59.0%). Initial testing with a glutamate dehydrogenase and toxin A/B combination test followed by NAAT for discrepant results was the most common testing method (360 of 1146; 31.4%). NAAT alone (299 of 1146; 26.1%) was next, then NAAT followed by an assay that included toxin A/B enzyme immunoassay if NAAT is positive (258 of 1146; 22.5%). Only 5.4% (62 of 1146) reported using toxin A/B immunoassay alone. Most respondents (1093 of 1131; 96.6%) reported rejecting CDI tests on formed stool, but rejection of CDI testing in pediatric patients was uncommon (211 of 1131; 18.7%). Rejection of CDI testing in patients using laxatives was reported more often by US-based respondents (379 of 1054 [36.0%] versus 9 of 77 [11.7%], P < .001). CONCLUSIONS.­: Multistep algorithms for CDI diagnosis are widely used in line with published recommendations. Most respondents reported rejection of formed stool for CDI testing, but few reported rejection of testing in infants and patients taking laxatives, suggesting these may be areas of opportunity for laboratories to pursue in improving CDI testing practices.

SPOT/Dx Pilot Reanalysis and College of American Pathologists Proficiency Testing for KRAS and NRAS Demonstrate Excellent Laboratory Performance.

CONTEXT.­: The Sustainable Predictive Oncology Therapeutics and Diagnostics quality assurance pilot study (SPOT/Dx pilot) on molecular oncology next-generation sequencing (NGS) reportedly demonstrated performance limitations of NGS laboratory-developed tests, including discrepancies with a US Food and Drug Administration-approved companion diagnostic. The SPOT/Dx pilot methods differ from those used in proficiency testing (PT) programs. OBJECTIVE.­: To reanalyze SPOT/Dx pilot data using PT program methods and compare to PT program data.Also see p. 136. DESIGN.­: The College of American Pathologists (CAP) Molecular Oncology Committee reanalyzed SPOT/Dx pilot data applying PT program methods, adjusting for confounding conditions, and compared them to CAP NGS PT program performance (2019-2022). RESULTS.­: Overall detection rates of KRAS and NRAS single-nucleotide variants (SNVs) and multinucleotide variants (MNVs) by SPOT/Dx pilot laboratories were 96.8% (716 of 740) and 81.1% (129 of 159), respectively. In CAP PT programs, the overall detection rates for the same SNVs and MNVs were 97.2% (2671 of 2748) and 91.8% (1853 of 2019), respectively. In 2022, the overall detection rate for 5 KRAS and NRAS MNVs in CAP PT programs was 97.3% (1161 of 1193). CONCLUSIONS.­: CAP PT program data demonstrate that laboratories consistently have high detection rates for KRAS and NRAS variants. The SPOT/Dx pilot has multiple design and analytic differences with established PT programs. Reanalyzed pilot data that adjust for confounding conditions demonstrate that laboratories proficiently detect SNVs and less successfully detect rare to never-observed MNVs. The SPOT/Dx pilot results are not generalizable to all molecular oncology testing and should not be used to market products or change policy affecting all molecular oncology testing.

Current laboratory testing practices for mismatch repair deficiency and microsatellite instability testing: A survey-based review of current laboratory practices.

OBJECTIVES: To describe mismatch repair (MMR) and microsatellite instability (MSI) testing practices in laboratories using the College of American Pathologists (CAP) MSI/MMR proficiency testing programs prior to the 2022 publication of the MSI/MMR practice guidelines copublished by CAP and the Association of Molecular Pathology (AMP). METHODS: Data from supplemental questionnaires provided with the 2020-B MSI/MMR programs to 542 laboratories across different practice settings were reviewed. Questionnaires contained 21 questions regarding the type of testing performed, specimen/tumor types used for testing, and clinical practices for checkpoint blockade therapy. RESULTS: Domestic laboratories test for MSI/MMR more often than international laboratories (P = .04) and academic hospitals/medical centers test more frequently than nonhospital sites/clinics (P = .03). The most commonly used testing modality is immunohistochemistry, followed by polymerase chain reaction, then next-generation sequencing. Most laboratories (72.6%; 347/478) reported awareness of the use of immune checkpoint inhibitor therapy for patients with high MSI or MMR-deficient results. CONCLUSIONS: The results demonstrate the state of MMR and MSI testing in laboratories prior to the publication of the CAP/AMP best practice guidelines, highlighting differences between various laboratory types. The findings indicate the importance of consensus guidelines and provide a baseline for comparison after their implementation.

Pancreaticobiliary Cytology Practice in 2021: Results of a College of American Pathologists Survey.

CONTEXT.­: The College of American Pathologists (CAP) surveys provide national benchmarks of pathology practice. OBJECTIVE.­: To investigate pancreaticobiliary cytology practice in domestic and international laboratories in 2021. DESIGN.­: We analyzed data from the CAP Pancreaticobiliary Cytology Practice Supplemental Questionnaire that was distributed to laboratories participating in the 2021 CAP Nongynecologic Cytopathology Education Program. RESULTS.­: Ninety-three percent (567 of 612) of respondent laboratories routinely evaluated pancreaticobiliary cytology specimens. Biliary brushing (85%) was the most common pancreaticobiliary cytology specimen evaluated, followed by pancreatic fine-needle aspiration (79%). The most used sampling methods reported by 235 laboratories were 22-gauge needle for fine-needle aspiration (62%) and SharkCore needle for fine-needle biopsy (27%). Cell block was the most used slide preparation method (76%), followed by liquid-based cytology (59%) for pancreatic cystic lesions. Up to 95% (303 of 320) of laboratories performed rapid on-site evaluation (ROSE) on pancreatic solid lesions, while 56% (180 of 320) performed ROSE for cystic lesions. Thirty-six percent (193 of 530) of laboratories used the Papanicolaou Society of Cytopathology System for Reporting Pancreaticobiliary Cytology in 2021. Among all institution types, significant differences in specimen volume, specimen type, ROSE practice, and case sign-out were identified. Additionally, significant differences in specimen type, slide preparation, and ROSE practice were found. CONCLUSIONS.­: This is the first survey from the CAP to investigate pancreaticobiliary cytology practice. The findings reveal significant differences among institution types and between domestic and international laboratories. These data provide a baseline for future studies in a variety of practice settings.

RNA Sequencing for Solid Tumor Fusion Gene Detection: Proficiency Testing Practice and Performance Comparison.

CONTEXT.­: Next-generation sequencing-based approaches using RNA have increasingly been used by clinical laboratories for the detection of fusion genes, intragenic rearrangements, and exon-skipping events. Correspondingly, the College of American Pathologists (CAP) has advanced RNA sequencing proficiency testing (PT) to ensure optimal performance of these assays. OBJECTIVE.­: To report on laboratory performance and practices of RNA sequencing for the detection of fusion genes, intragenic rearrangements, and exon-skipping events using CAP PT data from 8 mailings (2018-A through 2021-B). DESIGN.­: CAP PT RNA sequencing program results from 153 laboratories across 24 proficiency test specimens, interrogating 22 distinct engineered fusion transcripts, were analyzed for correct identification of the fusion event, associated performance variables, and laboratory practices. RESULTS.­: Overall, the 4-year program detection rate (sensitivity) was 95.5% (1486 of 1556 results). False-negative rates were 3.6% (53 of 1463) and 18.3% (17 of 93) for fusion gene and intragenic rearrangement/exon-skipping events, respectively. Only 19 false-positive results were reported among the 8 PT mailings, and most were likely the result of preanalytical or postanalytical errors. There were no practice characteristics (eg, instrumentation, sequencing method) significantly associated with the fusion detection results. CONCLUSIONS.­: These data reveal a high overall sensitivity and specificity for fusion gene detection by participating laboratories using clinical RNA sequencing. Performance was comparable across all laboratories, regardless of methodology. The fraction of false-negative results for intragenic rearrangement/exon-skipping events was greater than that for the chimeric fusion genes. False-negative results could not be attributed to any specific practice characteristics.

Implementation, Evolution, and Laboratory Performance of Methods-Based Proficiency Testing for Next-Generation Sequencing Detection of Germline Sequence Variants.

CONTEXT.­: Next-generation sequencing (NGS)-based assays are used for diagnosis of diverse inherited disorders. Limited data are available pertaining to interlaboratory analytical performance of these assays. OBJECTIVE.­: To report on the College of American Pathologists (CAP) NGS Germline Program, which is methods based, and explore the evolution in laboratory testing practices. DESIGN.­: Results from the NGS Germline Program from 2016-2020 were analyzed for interlaboratory analytical performance. Self-reported laboratory testing practices were also evaluated. RESULTS.­: From 2016-2020, a total of 297 laboratories participated in at least 1 program mailing. Of the 289 laboratories that provided information on tests offered, 138 (47.8%) offered only panel testing throughout their enrollment, while 35 (12.1%) offered panels and exome testing, 30 (10.4%) offered only exomes, 9 (3.1%) offered only genomes, and 15 (5.2%) offered panels, exomes, and genomes. The remainder (62 laboratories, 21.4%) changed their test offerings during the 2016-2020 timeframe. Considering each genomic position/interval, the median detection percentage at variant positions across the 2016-2020 mailings ranged from 94.3% to 100%, while at reference positions (no variant detected), the median correct response percentage was 100% across all mailings. When considering performance of individual laboratories, 89.5% (136 of 152) to 98.0% (149 of 152) of laboratories successfully met the detection threshold (≥90% of the variants present), while 94.6% (87 of 92) to 100% (163 of 163) of laboratories met the 95% specificity threshold across mailings. CONCLUSIONS.­: Since the inception of this program, laboratories have consistently performed well. The median sensitivity and specificity of detection of sequence variants included in this program (eg, single nucleotide variants, insertions, and deletions) were 100.0%.

Current Laboratory Testing Practices for Assessment of ERBB2/HER2 in Endometrial Serous Carcinoma and Colorectal Carcinoma.

CONTEXT.­: Therapy targeted at human epidermal growth factor receptor 2 (HER2; also known as ERBB2) was used initially for breast and gastroesophageal carcinoma and has more recently been adopted for endometrial serous carcinoma (ESC) and colorectal carcinoma (CRC). There is evidence that predictive biomarker testing algorithms for HER2 must be tumor type specific and that an algorithm validated for one tumor type cannot be applied to another. OBJECTIVE.­: To describe current laboratory practices for HER2 assessment in ESC and CRC. DESIGN.­: We surveyed laboratories participating in the 2021 College of American Pathologists (CAP) HER2 immunohistochemistry proficiency testing program. RESULTS.­: The survey was distributed to 1548 laboratories and returned by 1195, of which 83.5% (998) were in the United States. For ESC, 24.0% (287) of laboratories reported performing in-house testing for HER2 by immunohistochemical staining and/or in situ hybridization; of these, 44.3% (127) performed it reflexively on all cases of ESC. The most common criterion for evaluating HER2 was the American Society of Clinical Oncology/CAP 2018 guideline for breast carcinoma (69.0%; 194 of 281), whereas only 16.0% (45) of laboratories used guidelines specific to ESC. For CRC, 20.2% (239 of 1185) of laboratories performed in-house HER2 testing, and 82.0% of these (196) did the test only at the clinician's request. A plurality (49.4%; 115 of 233) used gastroesophageal cancer guidelines when scoring CRC, 30.0% (70) used the CRC scoring system from the HERACLES trial, and 16.3% (38) used the American Society of Clinical Oncology/CAP 2018 guideline for breast carcinoma. CONCLUSIONS.­: Laboratories vary in their approach to HER2 testing in ESC and CRC. Most laboratories did not report using tumor type-specific recommendations for HER2 interpretation. The lack of standardization could present a challenge to evidence-based practice when considering targeted therapy for these diseases.

Antibody Titers in Transfusion Medicine: A Critical Reevaluation of Testing Accuracy, Reliability, and Clinical Use.

CONTEXT.­: Substantial variability between different antibody titration methods has been identified since the development and introduction of the uniform procedure in 2008. OBJECTIVE.­: To determine whether more recent methods or techniques decrease interlaboratory and intralaboratory variation measured using proficiency testing. DESIGN.­: Proficiency test data for antibody titration between 2014 and 2018 were obtained from the College of American Pathologists. Interlaboratory and intralaboratory variations were compared by analyzing the distribution of titer results by method and phase, comparing the results against the supplier's quality control titer, and by evaluating the distribution of paired titer results when each laboratory received a sample with the same titer twice. RESULTS.­: A total of 1337 laboratories participated in the antibody titer proficiency test during the study period. Only 54.1% (5874 of 10 852) of anti-D and 63.4% (3603 of 5680) of anti-A reported responses were within 1 titer of the supplier's intended result. Review of the agreement between laboratories of the same methodology found that 78.4% (3139 of 4004) for anti-A and 89.0% (9655 of 10 852) of laboratory responses for anti-D fell within 1 titer of the mode response. When provided with 2 consecutive samples of the same titer (anti-D titer: 16), 85% (367 of 434) of laboratories using the uniform procedure and 80% (458 of 576) using the other method reported a titer difference of 1 or less. CONCLUSIONS.­: Despite advances, interlaboratory and intralaboratory variance for this assay remains high in comparison with the strong reliance on titer results in clinical practice. There needs to be a reevaluation of the role of this test in clinical decision-making.

Cytologic-Histologic Correlation Practices for Nongynecologic Cytology Specimens: A Survey by the College of American Pathologists Cytopathology Committee.

CONTEXT.­: Cytologic-histologic correlation (CHC) is a Clinical Laboratory Improvement Amendments-mandated requirement for gynecologic cytology, but no similar requirement exists for nongynecologic cytology. This study presents the findings from a College of American Pathologists' survey of nongynecologic cytology practice patterns. OBJECTIVE.­: To survey the current CHC practices for nongynecologic cytology. DESIGN.­: Data were analyzed from a survey developed by the committee and distributed to participants in the Nongynecologic Cytopathology Education Program mailing. RESULTS.­: Adoption of CHC for nongynecologic cytology cases is worldwide, with 88.5% of institutions performing CHC on these specimens, a substantial increase from previous years. Performance of CHC varied by institution type, with clinic or regional/local independent laboratories and national/corporate laboratories performing CHC significantly less frequently than hospitals, university hospitals/academic medical centers, and Veterans Administration/Department of Defense hospital institutions. Most CHC was performed concurrently in real time, when the corresponding surgical specimen was reviewed. Selection for real-time concurrent CHC was by the interpreting pathologist, the pathologist diagnosing the surgical biopsy sample or cytopathology case, or both. Sampling was by far the most common reason for discordance. A 2-step difference was the most frequent threshold for discordance between cytology and surgical specimens, but this criterion varied among institutions, with no majority definition. The positive predictive value of a positive cytology finding was calculated rarely in North American institutions but was calculated more frequently in international institutions. CONCLUSIONS.­: CHC practices for nongynecologic cytopathology mirror those found for CHC of gynecologic cytopathology.

Current State of Cytologic-Histologic Correlation Implementation for North American and International Laboratories: Results of the College of American Pathologists Cytopathology Committee Laboratory Practices in Gynecologic Cytology Survey.

CONTEXT.­: The College of American Pathologists (CAP) updated the Laboratory Accreditation Program Cytopathology Checklist to assist laboratories in meeting and exceeding the Clinical Laboratory Improvement Amendments standards for gynecologic cytologic-histologic correlation (CHC). OBJECTIVE.­: To survey the current CHC practices. DESIGN.­: Data were analyzed from a survey developed by the committee and distributed to participants in the CAP Gynecologic Cytopathology PAP Education Program mailing. RESULTS.­: Worldwide, CHC practice is nearly universally adopted, with an overall rate of 87.0% (568 of 653). CHC material was highly accessible. CHC was commonly performed real time/concurrently at the time the corresponding surgical pathology was reviewed. Investigation of CHC discordances varied with North American laboratories usually having a single pathologist review all discrepant histology and cytology slides to determine the reason for discordance, while international laboratories have a second pathologist review histology slides to determine the reason for discordance. The cause of CHC discordance was primarily sampling issues. The more common statistical metrics for CHC monitoring were the total percentage of cases that correlated with subsequent biopsies, screening error rate by cytotechnologist, and interpretative error rate by cytotechnologist. CONCLUSIONS.­: Many laboratories have adopted and implemented the CHC guidelines with identifiable differences in practices between North American and international laboratories. We identify the commonalities and differences between North American and international institutional practices including where CHC is performed, how CHC cases are identified and their accessibility, when CHC is performed, who investigates discordances, what discordances are identified, and how the findings affect quality improvement.

Obstetric and Newborn Weak D-Phenotype RBC Testing and Rh Immune Globulin Management Recommendations: Lessons From a Blinded Specimen-Testing Survey of 81 Transfusion Services.

CONTEXT.­: Modern RHD genotyping can be used to determine when patients with serologic weak D phenotypes have RHD gene variants at risk for anti-D alloimmunization. However, serologic testing, RhD interpretations, and laboratory management of these patients are quite variable. OBJECTIVE.­: To obtain interlaboratory comparisons of serologic testing, RhD interpretations, Rh immune globulin (RhIG) management, fetomaternal hemorrhage testing, and RHD genotyping for weak D-reactive specimens. DESIGN.­: We devised an educational exercise in which 81 transfusion services supporting obstetrics performed tube-method RhD typing on 2 unknown red blood cell challenge specimens identified as (1) maternal and (2) newborn. Both specimens were from the same weak D-reactive donor. The exercise revealed how participants responded to these different clinical situations. RESULTS.­: Of reporting laboratories, 14% (11 of 80) obtained discrepant immediate-spin reactions on the 2 specimens. Nine different reporting terms were used to interpret weak D-reactive maternal RhD types to obstetricians. In laboratories obtaining negative maternal immediate-spin reactions, 28% (16 of 57) performed unwarranted antiglobulin testing, sometimes leading to recommendations against giving RhIG. To screen for excess fetomaternal hemorrhage after a weak D-reactive newborn, 47% (34 of 73) of reporting laboratories would have employed a contraindicated fetal rosette test, risking false-negative results and inadequate RhIG coverage. Sixty percent (44 of 73) of laboratories would obtain RHD genotyping in some or all cases. CONCLUSIONS.­: For obstetric and neonatal patients with serologic weak D phenotypes, we found several critical problems in transfusion service laboratory practices. We provide recommendations for appropriate testing, consistent immunohematologic terminology, and RHD genotype-guided management of Rh immune globulin therapy and RBC transfusions.

Clinical Testing for Tumor Cell-Free DNA: College of American Pathologists Proficiency Programs Reveal Practice Trends.

CONTEXT.­: Clinical testing for tumor cell-free DNA (cfDNA) has evolved rapidly, but no practice guidelines exist. OBJECTIVE.­: To summarize cfDNA laboratory practices based on self-reporting and assess preanalytical, analytical, and postanalytical trends that may influence the quality, accuracy, and consistency of cfDNA testing. DESIGN.­: Data were derived from the College of American Pathologists cfDNA proficiency testing program submitted by 101 participating laboratories from 2018 to 2019. RESULTS.­: Most laboratories performing clinical circulating tumor DNA testing are commercial/nonhospital (71.2%; 72 of 101) and international (77.2%; 78 of 101) laboratories. Commercial laboratories had higher monthly test volumes than hospital-based laboratories (median, 36 versus 7-8) and tended to have larger gene panels (median, 50 versus 11 genes) when panel-based testing was offered. The main clinical indications include therapy selection and treatment/disease monitoring. Plasma is the most commonly accepted specimen, which is predominantly collected in cell-stabilizing tubes. Equal proportions of laboratories use next-generation sequencing (NGS) and non-NGS methods to assess key genes, including EGFR, BRAF, KRAS, NRAS, and IDH1. Most laboratories reported a lower limit of detection (LLOD) of 0.5%, variant allele frequency or less, which did not differ by method, NGS or non-NGS, except for EGFR. Sixty-five percent (17 of 26) of laboratories using the US Food and Drug Administration (FDA)-approved non-NGS EGFR assay report analytical sensitivities higher than 0.5%, as compared to 15% (16 of 104) of laboratories using an alternative NGS or non-NGS method. There is also a wider range in LLODs obtained for the FDA-approved EGFR assay than nonapproved assays. CONCLUSIONS.­: These results highlight emerging practice trends and serve as a foundation to initiate future practice recommendations.

Four-Year Laboratory Performance of the First College of American Pathologists In Silico Next-Generation Sequencing Bioinformatics Proficiency Testing Surveys.

CONTEXT.­: In 2016, the College of American Pathologists (CAP) launched the first next-generation sequencing (NGS) in silico bioinformatics proficiency testing survey to evaluate the performance of clinical laboratory bioinformatics pipelines for the detection of oncology-associated variants at varying allele fractions. This survey focused on 2 commonly used oncology panels, the Illumina TruSeq Amplicon Cancer Panel and the Thermo Fisher Ion AmpliSeq Cancer Hotspot v2 Panel. OBJECTIVE.­: To review the analytical performance of laboratories participating in the CAP NGS bioinformatics (NGSB) surveys, comprising NGSB1 for Illumina users and NGSB2 for Thermo Fisher Ion Torrent users, between 2016 and 2019. DESIGN.­: Responses from 78 laboratories were analyzed for accuracy and associated performance characteristics. RESULTS.­: The analytical sensitivity was 90.0% (1901 of 2112) for laboratories using the Illumina platform and 94.8% (2153 of 2272) for Thermo Fisher Ion Torrent users. Variant type and variant allele fraction were significantly associated with performance. False-negative results were seen mostly for multi-nucleotide variants and variants engineered at variant allele fractions of less than 25%. Analytical specificity for all participating laboratories was 99.8% (9303 of 9320). There was no statistically significant association between deletion-insertion length and detection rate. CONCLUSIONS.­: These results demonstrated high analytical sensitivity and specificity, supporting the feasibility and utility of using in silico mutagenized NGS data sets as a supplemental challenge to CAP surveys for oncology-associated variants based on physical samples. This program demonstrates the opportunity and challenges that can guide future surveys inclusive of customized in silico programs.

Using American Type Culture Collection Cell Lines to Evaluate Interlaboratory Variables for Estrogen Receptor and Human Epidermal Growth Factor Receptor 2 Immunostaining.

CONTEXT.­: Most laboratories currently use patient tissues for validating immunohistochemical stains. OBJECTIVE.­: To explore advantages of using cell lines with known antigenicity as a validation method. DESIGN.­: Five American Type Culture Collection (ATCC) cell lines with known negative, low positive, and moderate to strong estrogen receptor (ER) expression as well as negative, equivocal, and positive human epidermal growth factor receptor 2 (HER2) expression were cultured and made into cell blocks. One block from each cell line was fixed in formalin and another in ethanol before cell block preparation. Two sets of paired unstained slides from each block were sent to 10 different laboratories for HER2 and ER staining to be stained on runs from different days according to each laboratory's defined protocol. RESULTS.­: The 10 study participants evaluated 40 slides in a blinded fashion. For ER expression, all 80 interpretations for the ER strong and moderate positive cell lines had the target ER-positive result, and 74 of 80 ER-negative cell lines (92.5%) had agreement with the intended negative result. The ER low positive cell line showed varied but positive expression among all observers. The HER2 (3+)-positive cell lines yielded a target interpretation of 3+ in 65 of 80 interpretations (81.2%). For the HER2-negative cell line 69 of 78 interpretations (88.5%) were consistent with the target response (0 or 1+). No significant variation was observed between the ethanol- and non-ethanol-exposed cell lines, or between runs by the same laboratory. Variation from target results clustered within laboratories. CONCLUSIONS.­: This study indicates that variability between laboratories can be identified by using cell lines for quantitative or semiquantitative immunohistochemistry when using cultured cell lines of known antigenicity. These cell lines could potentially play a role in aiding anatomic pathology laboratories in validating immunohistochemistry tests for formalin- and ethanol-fixed tissues.

Recommendations for Performance Evaluation of Machine Learning in Pathology: A Concept Paper From the College of American Pathologists.

CONTEXT.­: Machine learning applications in the pathology clinical domain are emerging rapidly. As decision support systems continue to mature, laboratories will increasingly need guidance to evaluate their performance in clinical practice. Currently there are no formal guidelines to assist pathology laboratories in verification and/or validation of such systems. These recommendations are being proposed for the evaluation of machine learning systems in the clinical practice of pathology. OBJECTIVE.­: To propose recommendations for performance evaluation of in vitro diagnostic tests on patient samples that incorporate machine learning as part of the preanalytical, analytical, or postanalytical phases of the laboratory workflow. Topics described include considerations for machine learning model evaluation including risk assessment, predeployment requirements, data sourcing and curation, verification and validation, change control management, human-computer interaction, practitioner training, and competency evaluation. DATA SOURCES.­: An expert panel performed a review of the literature, Clinical and Laboratory Standards Institute guidance, and laboratory and government regulatory frameworks. CONCLUSIONS.­: Review of the literature and existing documents enabled the development of proposed recommendations. This white paper pertains to performance evaluation of machine learning systems intended to be implemented for clinical patient testing. Further studies with real-world clinical data are encouraged to support these proposed recommendations. Performance evaluation of machine learning models is critical to verification and/or validation of in vitro diagnostic tests using machine learning intended for clinical practice.