Evaluation of the international Ki67 working group cut point recommendations for early breast cancer: comparison with 21-gene assay results in a large integrated health care system.

PURPOSE: The International Ki67 Working Group (IKWG) has developed training for immunohistochemistry (IHC) scoring reproducibility and recommends cut points of ≤ 5% and ≥ 30% for prognosis in ER+, HER2-, stage I/II breast cancer. We examined scoring reproducibility following IKWG training and evaluated these cut points for selecting patients for further testing with the 21-gene Recurrence Score (RS) assay. METHODS: We included 307 women aged 50+ years with node-negative, ER+PR+HER2- breast cancer and with available RS results. Slides from the diagnostic biopsy were stained for Ki67 and scored using digital image analysis (IA). Two IHC pathologists underwent IKWG training and visually scored slides, blinded to each other and IA readings. Interobserver reproducibility was examined using intraclass correlation (ICC) and Kappa statistics. RESULTS: Depending on reader, 8.8-16.0% of our cohort had Ki67 ≤ 5% and 11.4-22.5% had scores ≥ 30%. The ICC for Ki67 scores by the two pathologists was 0.82 (95% CI 0.78-0.85); it was 0.79 (95% CI 0.74-0.83) for pathologist 1 and IA and 0.76 (95% CI 0.71-0.80) for pathologist 2 and IA. For Ki67 scores ≤ 5%, the percentages with RS < 26 were 92.6%, 91.8%, and 90.9% for pathologist 1, pathologist 2, and IA, respectively. For Ki67 scores ≥ 30%, the percentages with RS ≥ 26 were 41.5%, 51.4%, and 27.5%, respectively. CONCLUSION: The IKWG's Ki67 training resulted in moderate to strong reproducibility across readers but cut points had only moderate overlap with RS cut points, especially for Ki67 ≥ 30% and RS ≥ 26; thus, their clinical utility for a 21-gene assay testing pathway remains unclear.

Trainable immunohistochemical HER2/neu image analysis: a multisite performance study using 260 breast tissue specimens.

CONTEXT: Aperio Technologies, Inc (Vista, California) provides a new immunohistochemistry (IHC) HER2 Image Analysis (IA) system that allows tuning of the intensity thresholds of the HER2/ neu scoring scheme to adapt to the staining characteristics of different reagents. OBJECTIVE: To compare the trainable IHC HER2 IA system for different reagents to conventional manual microscopy (MM) in a multisite study. DESIGN: Two hundred sixty formalin-fixed, paraffin-embedded breast cancer specimens from 3 clinical sites were assayed: 180 specimens stained with Dako's HercepTest (Carpinteria, California), and 80 specimens stained with Ventana's PATHWAY HER-2/neu (Tucson, California). At each site, 3 pathologists performed a blinded reading of the glass slides with the use of a light microscope. The glass slides were then scanned and after a wash-out period and randomization, the same pathologists outlined a representative set of tumor regions to be analyzed by IHC HER2 IA. Each of the methods, MM and IA, was evaluated separately and comparatively by using κ statistics of negative HER2/neu scores (0, 1+) versus equivocal HER2/neu scores (2+) versus positive HER2/neu scores (3+) among the different pathologists. RESULTS: κ Values for IA and MM were obtained across all sites. MM: 0.565-0.864; IA: 0.895-0.947; MM versus IA: 0.683-0.892 for site 1; MM: 0.771-0.837; IA: 0.726-0.917; MM versus IA: 0.687-0.877 for site 2; MM: 0.463-0.674; IA: 0.864-0.918; MM versus IA: 0.497-0.626 for site 3. CONCLUSION: Aperio's trainable IHC HER2 IA system shows substantial equivalence to MM for Dako's HercepTest and Ventana's PATHWAY HER-2/neu at 3 clinical sites. Image analysis improved interpathologist agreement in the different clinical sites.

Reading immunohistochemical slides on a computer monitor--a multisite performance study using 180 HER2-stained breast carcinomas.

BACKGROUND: With the adoption of digital pathology, image analysis (IA) of immunohistochemistry (IHC) slides can be integrated seamlessly into the digital pathology workflow. A pathologist can now use IA efficiently while reading the digital IHC slides on a computer monitor. Thus, the clinical acceptance of a digital pathology system for IHC quantitation depends both on the performance of the IHC IA, and the ability to manually read digital IHC slides on the monitor. A multisite study was conducted to compare the manual reading of IHC Human Epidermal Growth Factor Receptor 2 (HER2) slides on a monitor, using Aperio Technologies, Inc. ScanScope XT instrument and the Spectrum digital pathology information management system to conventional manual microscopy (MM). DESIGN: A total of 180 breast cancers were immunohistochemically stained using Dako HercepTest and assayed: (site 1) 80 retrospective specimens with equal HER2 score distribution from an academic center, and (site 2) 100 prospective specimens from a reference laboratory. At each site, 3 pathologists carried out a blinded read of the glass slides using a conventional light microscope, and reporting the HER2 score for each. The glass slides were scanned using a 20× objective, and after a wash-out period and randomization of the slides, the same 3 pathologists carried out another blinded read of the same slides, but this time of the digital image of the slides on the monitor, again reporting the HER2 score. Each of the methods: MM and reading digital slides on a computer monitor, from now on called manual digital read (MDR) were evaluated separately and comparatively using Percent Agreement (PA) of negative HER2 scores (0, 1+) versus equivocal (2+) versus positive HER2 scores (3+). RESULTS: Comparable PA values were obtained for MM and MDR IHC HER2 images on the monitor (MM: 76.3% to 91.3%; MDR: 70.0% to 86.0%; MM vs. MDR: 61.3% to 92.5%). CONCLUSIONS: Results of manually reading IHC HER2 slides on a monitor using Aperio Technologies, Inc. digital pathology system show substantial equivalence to those obtained by conventional manual microscopy. The digital slides are easily read on a monitor.

A multisite performance study comparing the reading of immunohistochemical slides on a computer monitor with conventional manual microscopy for estrogen and progesterone receptor analysis.

A multisite study was conducted to assess the performance of the Aperio digital pathology system (Aperio Technologies, Vista, CA) for reading estrogen receptor (ER) and progesterone receptor (PR) slides on a computer monitor. A total of 520 formalin-fixed breast tissue specimens were assayed at 3 clinical sites for ER and PR (260 each). Percentage and average staining intensity of positive nuclei were assessed. At each site, 3 pathologists performed a blinded reading of the glass slides using their microscopes initially and later using digital images on a computer monitor. Comparable percentages of agreements were obtained for manual microscopy (MM) and manual digital slide reading (MDR) (ER, percentage of positive nuclei with cutoffs: MM, 91.3%-99.0%/MDR, 91.3%-100.0%; PR, percentage of positive nuclei with cutoffs: MM, 83.8%-99.0%/MDR, 76.3%-100.0%). Reading ER and PR slides on a computer monitor using the Aperio digital pathology system is equivalent to reading the slides with a conventional light microscope.

A new immunohistochemical ER/PR image analysis system: a multisite performance study.

BACKGROUND: Aperio provides a new image analysis (IA) solution for immunohistochemistry (IHC) as part of its digital pathology system. To be used in a clinical setting, substantial equivalence to scoring by manual microscopy (MM) needs to be shown. A multisite study was conducted to assess the performance of Aperio's IHC IA solution for estrogen receptor (ER) and progesterone receptor (PR). DESIGN: A total of 260 formalin-fixed, paraffin-embedded breast tissue specimens were assayed at 2 clinical sites for ER and PR. The ability to score ER/PR slides in terms of (1) percentage of positive nuclei with cutoffs of 1%, 5%, and 10% and (2) average staining intensity as 0, 1+, 2+, and 3+ score was assessed. At each site, 3 pathologists performed a blinded read of the glass slides using their microscopes. The glass slides were then scanned, and after a wash-out period and randomization of the slides, the pathologists viewed the images on a computer monitor and outlined a representative set of tumor regions to be analyzed by IA. Each of the methods: MM and IA were evaluated separately and comparatively. RESULTS: Comparable or higher percent agreements were obtained for IA compared with MM (ER--percent of positive nuclei with cutoffs: MM: 91.3% to 98.8%/IA: 93.8% to 98.8%/IA vs. MM: 92.5% to 97.5%, and intensity score: MM: 55.0% to 86.3%/IA: 88.8% to 90.0%/IA vs. MM: 63.8% to 86.3%; PR-percent of positive nuclei with cutoffs: MM: 83.8% to 99.0%/IA: 85.0% to 99.0%/IA vs. MM: 81.3% to 99.0%, and intensity score: MM: 58.8% to 88.0%/IA: 68.8% to 88.0%/IA vs. MM: 58.8% to 84.0%). CONCLUSIONS: The study results show that Aperio's digital IHC IA solution for ER/PR is substantially equivalent to scoring by MM.