An international study to increase concordance in Ki67 scoring.

Although an important biomarker in breast cancer, Ki67 lacks scoring standardization, which has limited its clinical use. Our previous study found variability when laboratories used their own scoring methods on centrally stained tissue microarray slides. In this current study, 16 laboratories from eight countries calibrated to a specific Ki67 scoring method and then scored 50 centrally MIB-1 stained tissue microarray cases. Simple instructions prescribed scoring pattern and staining thresholds for determination of the percentage of stained tumor cells. To calibrate, laboratories scored 18 'training' and 'test' web-based images. Software tracked object selection and scoring. Success for the calibration was prespecified as Root Mean Square Error of scores compared with reference <0.6 and Maximum Absolute Deviation from reference <1.0 (log2-transformed data). Prespecified success criteria for tissue microarray scoring required intraclass correlation significantly >0.70 but aiming for observed intraclass correlation ≥0.90. Laboratory performance showed non-significant but promising trends of improvement through the calibration exercise (mean Root Mean Square Error decreased from 0.6 to 0.4, Maximum Absolute Deviation from 1.6 to 0.9; paired t-test: P=0.07 for Root Mean Square Error, 0.06 for Maximum Absolute Deviation). For tissue microarray scoring, the intraclass correlation estimate was 0.94 (95% credible interval: 0.90-0.97), markedly and significantly >0.70, the prespecified minimum target for success. Some discrepancies persisted, including around clinically relevant cutoffs. After calibrating to a common scoring method via a web-based tool, laboratories can achieve high inter-laboratory reproducibility in Ki67 scoring on centrally stained tissue microarray slides. Although these data are potentially encouraging, suggesting that it may be possible to standardize scoring of Ki67 among pathology laboratories, clinically important discrepancies persist. Before this biomarker could be recommended for clinical use, future research will need to extend this approach to biopsies and whole sections, account for staining variability, and link to outcomes.

Racial/ethnic differences in clinical trial enrollment, refusal rates, ineligibility, and reasons for decline among patients at sites in the National Cancer Institute's Community Cancer Centers Program.

BACKGROUND: This study examined racial/ethnic differences among patients in clinical trial (CT) enrollment, refusal rates, ineligibility, and desire to participate in research within the National Cancer Institute's Community Cancer Centers Program (NCCCP) Clinical Trial Screening and Accrual Log. METHODS: Data from 4509 log entries were evaluated in this study. Four logistic regression models were run using physical/medical conditions, enrollment into a CT, patient eligible but declined a CT, and no desire to participate in research as dependent variables. RESULTS: Age ≥ 65 years (OR = 1.51, 95% CI = 1.28-1.79), males (OR = 2.28, 95% CI = 1.92-2.71), and non-Hispanic black race (OR = 1.53, 95% CI = 1.2-1.96) were significantly associated with more physical/medical conditions. Age ≥ 65 years was significantly associated with lower CT enrollment (OR = 0.83, 95% CI = 0.7-0.98). Males (OR = 0.78, 95% CI = 0.65-0.94) and a higher grade level score for consent form readability (OR = 0.9, 95% CI = 0.83-0.97) were significantly associated with lower refusal rates. Consent page length ≥ 20 was significantly associated with lower odds of "no desire to participate in research" among CT decliners (OR = 0.75, 95% CI = 0.58-0.98). CONCLUSIONS: There were no racial/ethnic differences in CT enrollment, refusal rates, or "no desire to participate in research" as the reason given for CT refusal. Higher odds of physical/medical conditions were associated with older age, males, and non-Hispanic blacks. Better management of physical/medical conditions before and during treatment may increase the pool of eligible patients for CTs. Future work should examine the role of comorbidities, sex, age, and consent form characteristics on CT participation.

Cross-Site Concordance Evaluation of Tumor DNA and RNA Sequencing Platforms for the CIMAC-CIDC Network.

PURPOSE: Whole-exome (WES) and RNA sequencing (RNA-seq) are key components of cancer immunogenomic analyses. To evaluate the consistency of tumor WES and RNA-seq profiling platforms across different centers, the Cancer Immune Monitoring and Analysis Centers (CIMAC) and the Cancer Immunologic Data Commons (CIDC) conducted a systematic harmonization study. EXPERIMENTAL DESIGN: DNA and RNA were centrally extracted from fresh frozen and formalin-fixed paraffin-embedded non-small cell lung carcinoma tumors and distributed to three centers for WES and RNA-seq profiling. In addition, two 10-plex HapMap cell line pools with known mutations were used to evaluate the accuracy of the WES platforms. RESULTS: The WES platforms achieved high precision (> 0.98) and recall (> 0.87) on the HapMap pools when evaluated on loci using > 50× common coverage. Nonsynonymous mutations clustered by tumor sample, achieving an index of specific agreement above 0.67 among replicates, centers, and sample processing. A DV200 > 24% for RNA, as a putative presequencing RNA quality control (QC) metric, was found to be a reliable threshold for generating consistent expression readouts in RNA-seq and NanoString data. MedTIN > 30 was likewise assessed as a reliable RNA-seq QC metric, above which samples from the same tumor across replicates, centers, and sample processing runs could be robustly clustered and HLA typing, immune infiltration, and immune repertoire inference could be performed. CONCLUSIONS: The CIMAC collaborating laboratory platforms effectively generated consistent WES and RNA-seq data and enable robust cross-trial comparisons and meta-analyses of highly complex immuno-oncology biomarker data across the NCI CIMAC-CIDC Network.

Network for Biomarker Immunoprofiling for Cancer Immunotherapy: Cancer Immune Monitoring and Analysis Centers and Cancer Immunologic Data Commons (CIMAC-CIDC).

PURPOSE: Immunoprofiling to identify biomarkers and integration with clinical trial outcomes are critical to improving immunotherapy approaches for patients with cancer. However, the translational potential of individual studies is often limited by small sample size of trials and the complexity of immuno-oncology biomarkers. Variability in assay performance further limits comparison and interpretation of data across studies and laboratories. EXPERIMENTAL DESIGN: To enable a systematic approach to biomarker identification and correlation with clinical outcome across trials, the Cancer Immune Monitoring and Analysis Centers and Cancer Immunologic Data Commons (CIMAC-CIDC) Network was established through support of the Cancer MoonshotSM Initiative of the National Cancer Institute (NCI) and the Partnership for Accelerating Cancer Therapies (PACT) with industry partners via the Foundation for the NIH. RESULTS: The CIMAC-CIDC Network is composed of four academic centers with multidisciplinary expertise in cancer immunotherapy that perform validated and harmonized assays for immunoprofiling and conduct correlative analyses. A data coordinating center (CIDC) provides the computational expertise and informatics platforms for the storage, integration, and analysis of biomarker and clinical data. CONCLUSIONS: This overview highlights strategies for assay harmonization to enable cross-trial and cross-site data analysis and describes key elements for establishing a network to enhance immuno-oncology biomarker development. These include an operational infrastructure, validation and harmonization of core immunoprofiling assays, platforms for data ingestion and integration, and access to specimens from clinical trials. Published in the same volume are reports of harmonization for core analyses: whole-exome sequencing, RNA sequencing, cytometry by time of flight, and IHC/immunofluorescence.

Toward Improving Practices for Submission of Diagnostic Tissue Blocks for National Cancer Institute Clinical Trials.

OBJECTIVES: The National Cancer Institute (NCI) National Clinical Trials Network performs phase II and III clinical trials, which increasingly rely on the submission of diagnostic formalin-fixed, paraffin-embedded tissue blocks for biomarker assessment. Simultaneously, advances in precision oncology require that clinical centers maintain diagnostic specimens for ancillary, standard-of-care diagnostics. This has caused tissue blocks to become a limited resource for advancing the NCI clinical trial enterprise and the practice of modern molecular pathology. METHODS: The NCI convened a 1-day workshop of multidisciplined experts to discuss barriers and strategic solutions to facilitate diagnostic block submission for clinical trial science, from the perspective of patient advocates, legal experts, pathologists, and clinical oncologists. RESULTS: The expert views and opinions were carefully noted and reported. CONCLUSIONS: Recommendations were proposed to reduce institutional barriers and to assist organizations in developing clear policies regarding diagnostic block submission for clinical trials.

State of the Art: Toward Improving Outcomes of Lung and Liver Tumor Biopsies in Clinical Trials-A Multidisciplinary Approach.

PURPOSE: National Cancer Institute (NCI)-sponsored clinical trial network studies frequently require biopsy specimens for pharmacodynamic and molecular biomarker analyses, including paired pre- and post-treatment samples. The purpose of this meeting of NCI-sponsored investigators was to identify local institutional standard procedures found to ensure quantitative and qualitative specimen adequacy. METHODS: NCI convened a conference on best biopsy practices, focusing on the clinical research community. Topics discussed were (1) criteria for specimen adequacy in the personalized medicine era, (2) team-based approaches to ensure specimen adequacy and quality control, and (3) risk considerations relevant to academic and community practitioners and their patients. RESULTS AND RECOMMENDATIONS: Key recommendations from the convened consensus panel included (1) establishment of infrastructure for multidisciplinary biopsy teams with a formalized information capture process, (2) maintenance of standard operating procedures with regular team review, (3) optimization of tissue collection and yield methodology, (4) incorporation of needle aspiration and other newer techniques, and (5) commitment of stakeholders to use of guideline documents to increase awareness of best biopsy practices, with the goal of universally improving tumor biopsy practices.

Analytical validation of a standardized scoring protocol for Ki67: phase 3 of an international multicenter collaboration.

Pathological analysis of the nuclear proliferation biomarker Ki67 has multiple potential roles in breast and other cancers. However, clinical utility of the immunohistochemical (IHC) assay for Ki67 immunohistochemistry has been hampered by unacceptable between-laboratory analytical variability. The International Ki67 Working Group has conducted a series of studies aiming to decrease this variability and improve the evaluation of Ki67. This study tries to assess whether acceptable performance can be achieved on prestained core-cut biopsies using a standardized scoring method. Sections from 30 primary ER+ breast cancer core biopsies were centrally stained for Ki67 and circulated among 22 laboratories in 11 countries. Each laboratory scored Ki67 using three methods: (1) global (4 fields of 100 cells each); (2) weighted global (same as global but weighted by estimated percentages of total area); and (3) hot-spot (single field of 500 cells). The intraclass correlation coefficient (ICC), a measure of interlaboratory agreement, for the unweighted global method (0.87; 95% credible interval (CI): 0.81-0.93) met the prespecified success criterion for scoring reproducibility, whereas that for the weighted global (0.87; 95% CI: 0.7999-0.93) and hot-spot methods (0.84; 95% CI: 0.77-0.92) marginally failed to do so. The unweighted global assessment of Ki67 IHC analysis on core biopsies met the prespecified criterion of success for scoring reproducibility. A few cases still showed large scoring discrepancies. Establishment of external quality assessment schemes is likely to improve the agreement between laboratories further. Additional evaluations are needed to assess staining variability and clinical validity in appropriate cohorts of samples.

Use of the National Cancer Institute Community Cancer Centers Program screening and accrual log to address cancer clinical trial accrual.

PURPOSE: Screening logs have the potential to help oncology clinical trial programs at the site level, as well as trial leaders, address enrollment in real time. Such an approach could be especially helpful in improving representation of racial/ethnic minority and other underrepresented populations in clinical trials. METHODS: The National Cancer Institute Community Cancer Centers Program (NCCCP) developed a screening log. Log data collected from March 2009 through May 2012 were analyzed for number of patients screened versus enrolled, including for demographic subgroups; screening methods; and enrollment barriers, including reasons for ineligibility and provider and patient reasons for declining to offer or participate in a trial. User feedback was obtained to better understand perceptions of log utility. RESULTS: Of 4,483 patients screened, 18.4% enrolled onto NCCCP log trials. Reasons for nonenrollment were ineligibility (51.6%), patient declined (25.8%), physician declined (15.6%), urgent need for treatment (6.6%), and trial suspension (0.4%). Major reasons for patients declining were no desire to participate in trials (43.2%) and preference for standard of care (39%). Major reasons for physicians declining to offer trials were preference for standard of care (53%) and concerns about tolerability (29.3%). Enrollment rates onto log trials did not differ between white and black (P = .15) or between Hispanic and non-Hispanic patients (P = .73). Other races had lower enrollment rates than whites and blacks. Sites valued the ready access to log data on enrollment barriers, with some sites changing practices to address those barriers. CONCLUSION: Use of screening logs to document enrollment barriers at the local level can facilitate development of strategies to enhance clinical trial accrual.

An international Ki67 reproducibility study.

BACKGROUND: In breast cancer, immunohistochemical assessment of proliferation using the marker Ki67 has potential use in both research and clinical management. However, lack of consistency across laboratories has limited Ki67's value. A working group was assembled to devise a strategy to harmonize Ki67 analysis and increase scoring concordance. Toward that goal, we conducted a Ki67 reproducibility study. METHODS: Eight laboratories received 100 breast cancer cases arranged into 1-mm core tissue microarrays-one set stained by the participating laboratory and one set stained by the central laboratory, both using antibody MIB-1. Each laboratory scored Ki67 as percentage of positively stained invasive tumor cells using its own method. Six laboratories repeated scoring of 50 locally stained cases on 3 different days. Sources of variation were analyzed using random effects models with log2-transformed measurements. Reproducibility was quantified by intraclass correlation coefficient (ICC), and the approximate two-sided 95% confidence intervals (CIs) for the true intraclass correlation coefficients in these experiments were provided. RESULTS: Intralaboratory reproducibility was high (ICC = 0.94; 95% CI = 0.93 to 0.97). Interlaboratory reproducibility was only moderate (central staining: ICC = 0.71, 95% CI = 0.47 to 0.78; local staining: ICC = 0.59, 95% CI = 0.37 to 0.68). Geometric mean of Ki67 values for each laboratory across the 100 cases ranged 7.1% to 23.9% with central staining and 6.1% to 30.1% with local staining. Factors contributing to interlaboratory discordance included tumor region selection, counting method, and subjective assessment of staining positivity. Formal counting methods gave more consistent results than visual estimation. CONCLUSIONS: Substantial variability in Ki67 scoring was observed among some of the world's most experienced laboratories. Ki67 values and cutoffs for clinical decision-making cannot be transferred between laboratories without standardizing scoring methodology because analytical validity is limited.

Early-phase clinical trials in the community: results from the national cancer institute community cancer centers program early-phase working group baseline assessment.

PURPOSE: The National Cancer Institute (NCI) Community Cancer Centers Program (NCCCP) formed an Early-Phase Working Group to facilitate site participation in early-phase (EP) trials. The Working Group conducted a baseline assessment (BA) to describe the sites' EP trial infrastructure and its association with accrual. METHODS: EP accrual and infrastructure data for the sites were obtained for July 2010-June 2011 and 2010, respectively. Sites with EP accrual rates at or above the median were considered high-accruing sites. Analyses were performed to identify site characteristics associated with higher accrual onto EP trials. RESULTS: Twenty-seven of the 30 NCCCP sites participated. The median number of EP trials open per site over the course of July 2010-June 2011 was 19. Median EP accrual per site was 14 patients in 1 year. Approximately half of the EP trials were Cooperative Group; most were phase II. Except for having a higher number of EP trials open (P = .04), high-accruing sites (n = 14) did not differ significantly from low-accruing sites (n = 13) in terms of any single site characteristic. High-accruing sites did have shorter institutional review board (IRB) turnaround time by 20 days, and were almost three times as likely to be a lead Community Clinical Oncology Program site (small sample size may have prevented statistical significance). Most sites had at least basic EP trial infrastructure. CONCLUSION: Community cancer centers are capable of conducting EP trials. Infrastructure and collaborations are critical components of success. This assessment provides useful information for implementing EP trials in the community.

The National Cancer Institute-American Society of Clinical Oncology Cancer Trial Accrual Symposium: summary and recommendations.

INTRODUCTION: Many challenges to clinical trial accrual exist, resulting in studies with inadequate enrollment and potentially delaying answers to important scientific and clinical questions. METHODS: The National Cancer Institute (NCI) and the American Society of Clinical Oncology (ASCO) cosponsored the Cancer Trial Accrual Symposium: Science and Solutions on April 29-30, 2010 to examine the state of accrual science related to patient/community, physician/provider, and site/organizational influences, and identify new interventions to facilitate clinical trial enrollment. The symposium featured breakout sessions, plenary sessions, and a poster session including 100 abstracts. Among the 358 attendees were clinical investigators, researchers of accrual strategies, research administrators, nurses, research coordinators, patient advocates, and educators. A bibliography of the accrual literature in these three major areas was provided to participants in advance of the meeting. After the symposium, the literature in these areas was revisited to determine if the symposium recommendations remained relevant within the context of the current literature. RESULTS: Few rigorously conducted studies have tested interventions to address challenges to clinical trials accrual. Attendees developed recommendations for improving accrual and identified priority areas for future accrual research at the patient/community, physician/provider, and site/organizational levels. Current literature continues to support the symposium recommendations. CONCLUSIONS: A combination of approaches addressing both the multifactorial nature of accrual challenges and the characteristics of the target population may be needed to improve accrual to cancer clinical trials. Recommendations for best practices and for future research developed from the symposium are provided.

Recommendations for collection and handling of specimens from group breast cancer clinical trials.

Recommendations for specimen collection and handling have been developed for adoption across breast cancer clinical trials conducted by the Breast International Group (BIG)-sponsored Groups and the National Cancer Institute (NCI)-sponsored North American Cooperative Groups. These recommendations are meant to promote identifiable standards for specimen collection and handling within and across breast cancer trials, such that the variability in collection/handling practices that currently exists is minimized and specimen condition and quality are enhanced, thereby maximizing results from specimen-based diagnostic testing and research. Three working groups were formed from the Cooperative Group Banking Committee, BIG groups, and North American breast cancer cooperative groups to identify standards for collection and handling of (1) formalin-fixed, paraffin-embedded (FFPE) tissue; (2) blood and its components; and (3) fresh/frozen tissue from breast cancer trials. The working groups collected standard operating procedures from multiple group specimen banks, administered a survey on banking practices to those banks, and engaged in a series of discussions from 2005 to 2007. Their contributions were synthesized into this document, which focuses primarily on collection and handling of specimens to the point of shipment to the central bank, although also offers some guidance to central banks. Major recommendations include submission of an FFPE block, whole blood, and serial serum or plasma from breast cancer clinical trials, and use of one fixative and buffer type (10% neutral phosphate-buffered formalin, pH 7) for FFPE tissue across trials. Recommendations for proper handling and shipping were developed for blood, serum, plasma, FFPE, and fresh/frozen tissue.

Proposal for standardized definitions for efficacy end points in adjuvant breast cancer trials: the STEEP system.

PURPOSE: Standardized definitions of breast cancer clinical trial end points must be adopted to permit the consistent interpretation and analysis of breast cancer clinical trials and to facilitate cross-trial comparisons and meta-analyses. Standardizing terms will allow for uniformity in data collection across studies, which will optimize clinical trial utility and efficiency. A given end point term (eg, overall survival) used in a breast cancer trial should always encompass the same set of events (eg, death attributable to breast cancer, death attributable to cause other than breast cancer, death from unknown cause), and, in turn, each event within that end point should be commonly defined across end points and studies. METHODS: A panel of experts in breast cancer clinical trials representing medical oncology, biostatistics, and correlative science convened to formulate standard definitions and address the confusion that nonstandard definitions of widely used end point terms for a breast cancer clinical trial can generate. We propose standard definitions for efficacy end points and events in early-stage adjuvant breast cancer clinical trials. In some cases, it is expected that the standard end points may not address a specific trial question, so that modified or customized end points would need to be prospectively defined and consistently used. CONCLUSION: The use of the proposed common end point definitions will facilitate interpretation of trial outcomes. This approach may be adopted to develop standard outcome definitions for use in trials involving other cancer sites.

Pediatric transplantation of the kidney, liver and heart: summary report.

The following is a summary report of an extensive review of the literature from 1966 to 2001 on growth and development in children receiving kidney, liver and heart transplants. The literature was assessed for relevancy to current clinical practice and for reliability and generalizability of the inferences based on the study design, controls, sample size, age distribution, confounding factors, use of standardized instruments, and consistency with other findings. While studies on growth are included in the review, the main emphasis is on research in cognitive and psychosocial development since these areas have been far less thoroughly studied and contain various methodological deficiencies. On the basis of the literature review both general methodological recommendations and specific recommendations for future research studies are made. Access to the full is provided on the World Wide Web at http://light.emmes.com/pedstransplantation/.