Analytical validation of CanAssist-Breast: an immunohistochemistry based prognostic test for hormone receptor positive breast cancer patients.

BACKGROUND: CanAssist-Breast is an immunohistochemistry based test that predicts risk of distant recurrence in early-stage hormone receptor positive breast cancer patients within first five years of diagnosis. Immunohistochemistry gradings for 5 biomarkers (CD44, ABCC4, ABCC11, N-Cadherin and pan-Cadherins) and 3 clinical parameters (tumor size, tumor grade and node status) of 298 patient cohort were used to develop a machine learning based statistical algorithm. The algorithm generates a risk score based on which patients are stratified into two groups, low- or high-risk for recurrence. The aim of the current study is to demonstrate the analytical performance with respect to repeatability and reproducibility of CanAssist-Breast. METHODS: All potential sources of variation in CanAssist-Breast testing involving operator, run and observer that could affect the immunohistochemistry performance were tested using appropriate statistical analysis methods for each of the CanAssist-Breast biomarkers using a total 309 samples. The cumulative effect of these variations in the immunohistochemistry gradings on the generation of CanAssist-Breast risk score and risk category were also evaluated. Intra-class Correlation Coefficient, Bland Altman plots and pair-wise agreement were performed to establish concordance on IHC gradings, risk score and risk categorization respectively. RESULTS: CanAssist-Breast test exhibited high levels of concordance on immunohistochemistry gradings for all biomarkers with Intra-class Correlation Coefficient of ≥0.75 across all reproducibility and repeatability experiments. Bland-Altman plots demonstrated that agreement on risk scores between the comparators was within acceptable limits. We also observed > 90% agreement on risk categorization (low- or high-risk) across all variables tested. CONCLUSIONS: The extensive analytical validation data for the CanAssist-Breast test, evaluating immunohistochemistry performance, risk score generation and risk categorization showed excellent agreement across variables, demonstrating that the test is robust.

Validation of CanAssist Breast immunohistochemistry biomarkers on an automated platform and its applicability in tissue microarray.

CanAssist Breast (CAB) is a prognostic test for early-stage hormone receptor-positive invasive breast cancer. The test involves performing immunohistochemical (IHC) analysis for five biomarkers, namely CD44, ABCC4, ABCC11, N-cadherin, and pan-cadherin. In addition to IHC grading information, three clinical features, i.e., tumor size, grade, and lymph node status, serve as input into the machine learning-based algorithm to generate the CAB risk score. CAB was developed and initially validated using manual IHC. This study's objectives included: i) automate CAB IHC on an autostainer and establish its performance equivalence with manual IHC ii) validate CAB test using samples in Tissue MicroArray (TMA) format. IHC for CAB biomarkers was standardized on Ventana BenchMark XT autostainer. Two IHC methods were compared for IHC gradings and corresponding CAB risk scores/risk categories. A concordance analysis was done using MedCalcTM software. The manual and automated IHC staining methods exhibited a high level of concordance on IHC gradings for 40 cases with an Intra-class Correlation Coefficient (ICC) of >0.85 for 4 of 5 biomarkers. 100% concordance was achieved in risk categorization (low- or high-risk), with very good agreement between the risk scores demonstrated by a kappa statistic of 0.83. TMA versus whole tissue section concordance was analyzed using 45 samples on an autostainer, and the data showed 92% concordance in terms of risk category. The results confirm the equivalence between manual and automated staining methods and demonstrate the utility of TMA as an acceptable format for CanAssist Breast testing.

Clinical validation of an immunohistochemistry-based CanAssist-Breast test for distant recurrence prediction in hormone receptor-positive breast cancer patients.

CanAssist-Breast (CAB) is an immunohistochemistry (IHC)-based prognostic test for early-stage Hormone Receptor (HR+)-positive breast cancer patients. CAB uses a Support Vector Machine (SVM) trained algorithm which utilizes expression levels of five biomarkers (CD44, ABCC4, ABCC11, N-Cadherin, and Pan-Cadherin) and three clinical parameters such as tumor size, grade, and node status as inputs to generate a risk score and categorizes patients as low- or high-risk for distant recurrence within 5 years of diagnosis. In this study, we present clinical validation of CAB. CAB was validated using a retrospective cohort of 857 patients. All patients were treated either with endocrine therapy or chemoendocrine therapy. Risk categorization by CAB was analyzed by calculating Distant Metastasis-Free Survival (DMFS) and recurrence rates using Kaplan-Meier survival curves. Multivariate analysis was performed to calculate Hazard ratios (HR) for CAB high-risk vs low-risk patients. The results showed that Distant Metastasis-Free Survival (DMFS) was significantly different (P-0.002) between low- (DMFS: 95%) and high-risk (DMFS: 80%) categories in the endocrine therapy treated alone subgroup (n = 195) as well as in the total cohort (n = 857, low-risk DMFS: 95%, high-risk DMFS: 84%, P < 0.0001). In addition, the segregation of the risk categories was significant (P = 0.0005) in node-positive patients, with a difference in DMFS of 12%. In multivariate analysis, CAB risk score was the most significant predictor of distant recurrence with hazard ratio of 3.2048 (P < 0.0001). CAB stratified patients into discrete risk categories with high statistical significance compared to Ki-67 and IHC4 score-based stratification. CAB stratified a higher percentage of the cohort (82%) as low-risk than IHC4 score (41.6%) and could re-stratify >74% of high Ki-67 and IHC4 score intermediate-risk zone patients into low-risk category. Overall the data suggest that CAB can effectively predict risk of distant recurrence with clear dichotomous high- or low-risk categorization.