Reporting Recommendations for Tumor Marker Prognostic Studies (REMARK): An Abridged Explanation and Elaboration.

The Reporting Recommendations for Tumor Marker Prognostic Studies (REMARK) were developed to address widespread deficiencies in the reporting of such studies. The REMARK checklist consists of 20 items to report for published tumor marker prognostic studies. A detailed paper was published explaining the rationale behind checklist items, providing positive examples and giving empirical evidence of the quality of reporting. REMARK provides a comprehensive overview to educate on good reporting and provide a valuable reference for the many issues to consider when designing, conducting, and analyzing tumor marker studies and prognostic studies in medicine in general. Despite support for REMARK from major cancer journals, prognostic factor research studies remain poorly reported. To encourage dissemination and uptake of REMARK, we have produced this considerably abridged version of the detailed explanatory manuscript, which may also serve as a brief guide to key issues for investigators planning tumor marker prognostic studies. To summarize the current situation, more recent papers investigating the quality of reporting and related reporting guidelines are cited, but otherwise the literature is not updated. Another important impetus for this paper is that it serves as a basis for literal translations into other languages. Translations will help to bring key information to a larger audience world-wide. Many more details can be found in the original paper.

Breaking a vicious cycle.

Despite prodigious advances in tumor biology research, few tumor-biomarker tests have been adopted as standard clinical practice. This lack of reliable tests stems from a vicious cycle of undervaluation, resulting from inconsistent regulatory standards and reimbursement, as well as insufficient investment in research and development, scrutiny of biomarker publications by journals, and evidence of analytical validity and clinical utility. We offer recommendations designed to serve as a roadmap to break this vicious cycle and call for a national dialogue, as changes in regulation, reimbursement, investment, peer review, and guidelines development require the participation of all stakeholders.

Reporting Recommendations for Tumor Marker Prognostic Studies (REMARK): explanation and elaboration.

The REMARK (Reporting Recommendations for Tumor Marker Prognostic Studies) guideline includes a checklist which aims to improve the reporting of these types of studies. Here, we expand on the REMARK checklist to enhance its use and effectiveness through better understanding of the intent of each item and why the information is important to report. Each checklist item of the REMARK guideline is explained in detail and accompanied by published examples of good reporting. The paper provides a comprehensive overview to educate on good reporting and provide a valuable reference of issues to consider when designing, conducting, and analyzing tumor marker studies and prognostic studies in medicine in general.

Reporting recommendations for tumor marker prognostic studies (REMARK): explanation and elaboration.

BACKGROUND: The Reporting Recommendations for Tumor Marker Prognostic Studies (REMARK) checklist consists of 20 items to report for published tumor marker prognostic studies. It was developed to address widespread deficiencies in the reporting of such studies. In this paper we expand on the REMARK checklist to enhance its use and effectiveness through better understanding of the intent of each item and why the information is important to report. METHODS: REMARK recommends including a transparent and full description of research goals and hypotheses, subject selection, specimen and assay considerations, marker measurement methods, statistical design and analysis, and study results. Each checklist item is explained and accompanied by published examples of good reporting, and relevant empirical evidence of the quality of reporting. We give prominence to discussion of the 'REMARK profile', a suggested tabular format for summarizing key study details. SUMMARY: The paper provides a comprehensive overview to educate on good reporting and provide a valuable reference for the many issues to consider when designing, conducting, and analyzing tumor marker studies and prognostic studies in medicine in general. To encourage dissemination of the Reporting Recommendations for Tumor Marker Prognostic Studies (REMARK): Explanation and Elaboration, this article has also been published in PLoS Medicine.

Challenges in drug and biomarker co-development.

Co-development of drugs and biomarkers should be considered when the biomarker is intricately related to the use of the drug. There are risks and benefits to co-development and these need to be considered carefully early in the process. The current chapter attempts to delineate when it is appropriate to plan for co-development and to discuss a range of issues. Challenges include the determination of the type of assay (laboratory-developed test vs. reference laboratory vs. kit), the designs of trials for evaluation of clinical utility, and the regulatory pathway. Successful co-development requires planning very early in the process and assembling the appropriate multi-disciplinary team.

Biomarkers in oncology: trials and tribulations.

Few apparently promising oncology biomarkers actually make their way into routine clinical use. There are many reasons for this lack of success, and the complexity of cancer biology is only one of the reasons. Challenges involved in evaluating the analytical and the clinical performance of cancer biomarkers account for the lack of successful translation to the clinic. The lack of clear definition of the clinical need often results in tests that may perform reproducibly but are not used because they do not help with important patient care decisions. The National Cancer Institute Cancer Diagnosis Program launched the Program for the Assessment of Clinical Cancer Tests in an effort to move biomarkers more efficiently and effectively into the clinic. A development pathway is proposed that defines the steps required for evaluation of a biomarker assay's analytical and clinical performance. Several pilot projects are ongoing to test the process, and these are described.

A perspective on challenges and issues in biomarker development and drug and biomarker codevelopment.

A workshop sponsored by the National Cancer Institute and the US Food and Drug Administration addressed past lessons learned and ongoing challenges faced in biomarker development and drug and biomarker codevelopment. Participants agreed that critical decision points in the product life cycle depend on the level of understanding of the biology of the target and its interaction with the drug, the preanalytical and analytical factors affecting biomarker assay performance, and the clinical disease process. The more known about the biology and the greater the strength of association between an analytical signal and clinical result, the more efficient and less risky the development process will be. Rapid entry into clinical practice will only be achieved by using a rigorous scientific approach, including careful specimen collection and standardized and quality-controlled data collection. Early interaction with appropriate regulatory bodies will ensure studies are appropriately designed and biomarker test performance is well characterized.

A system for sharing routine surgical pathology specimens across institutions: the Shared Pathology Informatics Network.

This report presents an overview for pathologists of the development and potential applications of a novel Web enabled system allowing indexing and retrieval of pathology specimens across multiple institutions. The system was developed through the National Cancer Institute's Shared Pathology Informatics Network program with the goal of creating a prototype system to find existing pathology specimens derived from routine surgical and autopsy procedures ("paraffin blocks") that may be relevant to cancer research. To reach this goal, a number of challenges needed to be met. A central aspect was the development of an informatics system that supported Web-based searching while retaining local control of data. Additional aspects included the development of an eXtensible Markup Language schema, representation of tissue specimen annotation, methods for deidentifying pathology reports, tools for autocoding critical data from these reports using the Unified Medical Language System, and hierarchies of confidentiality and consent that met or exceeded federal requirements. The prototype system supported Web-based querying of millions of pathology reports from 6 participating institutions across the country in a matter of seconds to minutes and the ability of bona fide researchers to identify and potentially to request specific paraffin blocks from the participating institutions. With the addition of associated clinical and outcome information, this system could vastly expand the pool of annotated tissues available for cancer research as well as other diseases.

American Society of Clinical Oncology/College of American Pathologists guideline recommendations for human epidermal growth factor receptor 2 testing in breast cancer.

PURPOSE: To develop a guideline to improve the accuracy of human epidermal growth factor receptor 2 (HER2) testing in invasive breast cancer and its utility as a predictive marker. METHODS: The American Society of Clinical Oncology and the College of American Pathologists convened an expert panel, which conducted a systematic review of the literature and developed recommendations for optimal HER2 testing performance. The guideline was reviewed by selected experts and approved by the board of directors for both organizations. RESULTS: Approximately 20% of current HER2 testing may be inaccurate. When carefully validated testing is performed, available data do not clearly demonstrate the superiority of either immunohistochemistry (IHC) or in situ hybridization (ISH) as a predictor of benefit from anti-HER2 therapy. RECOMMENDATIONS: The panel recommends that HER2 status should be determined for all invasive breast cancer. A testing algorithm that relies on accurate, reproducible assay performance, including newly available types of brightfield ISH, is proposed. Elements to reliably reduce assay variation (for example, specimen handling, assay exclusion, and reporting criteria) are specified. An algorithm defining positive, equivocal, and negative values for both HER2 protein expression and gene amplification is recommended: a positive HER2 result is IHC staining of 3+ (uniform, intense membrane staining of > 30% of invasive tumor cells), a fluorescent in situ hybridization (FISH) result of more than six HER2 gene copies per nucleus or a FISH ratio (HER2 gene signals to chromosome 17 signals) of more than 2.2; a negative result is an IHC staining of 0 or 1+, a FISH result of less than 4.0 HER2 gene copies per nucleus, or FISH ratio of less than 1.8. Equivocal results require additional action for final determination. It is recommended that to perform HER2 testing, laboratories show 95% concordance with another validated test for positive and negative assay values. The panel strongly recommends validation of laboratory assay or modifications, use of standardized operating procedures, and compliance with new testing criteria to be monitored with the use of stringent laboratory accreditation standards, proficiency testing, and competency assessment. The panel recommends that HER2 testing be done in a CAP-accredited laboratory or in a laboratory that meets the accreditation and proficiency testing requirements set out by this document.

American Society of Clinical Oncology/College of American Pathologists guideline recommendations for human epidermal growth factor receptor 2 testing in breast cancer.

PURPOSE: To develop a guideline to improve the accuracy of human epidermal growth factor receptor 2(HER2) testing in invasive breast cancer and its utility as a predictive marker. METHODS: The American Society of Clinical Oncology and the College of American Pathologists convened an expert panel, which conducted a systematic review of the literature and developed recommendations for optimal HER2 testing performance. The guideline was reviewed by selected experts and approved by the board of directors for both organizations. RESULTS: Approximately 20% of current HER2 testing may be inaccurate. When carefully validated testing is performed, available data do not clearly demonstrate the superiority of either immunohistochemistry(IHC) or in situ hybridization (ISH) as a predictor of benefit from anti-HER2 therapy. RECOMMENDATIONS: The panel recommends that HER2 status should be determined for all invasive breast cancer. A testing algorithm that relies on accurate, reproducible assay performance, including newly available types of brightfield ISH, is proposed. Elements to reliably reduce assay variation (for example, specimen handling, assay exclusion, and reporting criteria) are specified. An algorithm defining positive, equivocal, and negative values for both HER2 protein expression and gene amplification is recommended: a positive HER2 result is IHC staining of 3 + (uniform, intense membrane staining of 30% of invasive tumor cells), a fluorescent in situ hybridization (FISH) result of more than six HER2 gene copies per nucleus or a FISH ratio (HER2 gene signals to chromosome 17 signals) of more than 2.2; a negative result is an IHC staining of 0 or 1 +, a FISH result of less than 4.0 HER2 gene copies per nucleus, or FISH ratio of less than 1.8. Equivocal results require additional action for final determination. It is recommended that to perform HER2 testing, laboratories show 95% concordance with another validated test for positive and negative assay values. The panel strongly recommends validation of laboratory assay or modifications, use of standardized operating procedures, and compliance with new testing criteria to be monitored with the use of stringent laboratory accreditation standards, proficiency testing, and competency assessment. The panel recommends that HER2 testing be done in a CAP-accredited laboratory or in a laboratory that meets the accreditation and proficiency testing requirements set out by this document.

REporting recommendations for tumor MARKer prognostic studies (REMARK).

Despite years of research and hundreds of reports on tumor markers in oncology, the number of markers that have emerged as clinically useful is pitifully small. Often initially reported studies of a marker show great promise, but subsequent studies on the same or related markers yield inconsistent conclusions or stand in direct contradiction to the promising results. It is imperative that we attempt to understand the reasons that multiple studies of the same marker lead to differing conclusions. A variety of methodologic problems have been cited to explain these discrepancies. Unfortunately, many tumor marker studies have not been reported in a rigorous fashion, and published articles often lack sufficient information to allow adequate assessment of the quality of the study or the generalizability of study results. The development of guidelines for the reporting of tumor marker studies was a major recommendation of the National Cancer Institute-European Organisation for Research and Treatment of Cancer (NCI-EORTC) First International Meeting on Cancer Diagnostics in 2000. As for the successful CONSORT initiative for randomized trials and for the STARD statement for diagnostic studies, we suggest guidelines to provide relevant information about the study design, pre-planned hypotheses, patient and specimen characteristics, assay methods, and statistical analysis methods. In addition, the guidelines suggest helpful presentations of data and important elements to include in discussions. The goal of these guidelines is to encourage transparent and complete reporting so that the relevant information will be available to others to help them to judge the usefulness of the data and understand the context in which the conclusions apply.

Cancer diagnostics: decision criteria for marker utilization in the clinic.

A new diagnostic tool must pass three major tests before it is adopted for routine clinical use. First, the tool must be robust and reproducible; second, the clinical value of the tool must be proven, i.e. the tool should reliably trigger a clinical decision that results in patient benefit; and, third, the clinical community has to be convinced of the need for this tool and the benefits it affords. Another factor that can influence the adoption of new tools relates to the cost and the vagaries of insurance reimbursement. The Cancer Diagnosis Program (CDP) of the US National Cancer Institute (NCI) launched the Program for the Assessment of Clinical Cancer Tests (PACCT) in 2000 to develop a process for moving the results of new technologies and new understanding of cancer biology more efficiently and effectively into clinical practice. PACCT has developed an algorithm that incorporates the iterative nature of assay development into an evaluation process that includes developers and end users. The effective introduction of new tests into clinical practice has been hampered by a series of common problems that are best described using examples of successes and failures. The successful application of the PACCT algorithm is described in the discussion of the recent development of the OncotypeDX assay and plan for a prospective trial of this assay by the NCI-supported Clinical Trials Cooperative Groups. The assay uses reverse transcription (RT)-PCR evaluation of a set of 16 genes that were shown to strongly associate with the risk of recurrence of breast cancer in women who presented with early stage disease (hormone responsive, and no involvement of the auxiliary lymph nodes). The test is highly reproducible. It provides information to aid the physician and patient in making important clinical decisions, including the aggressiveness of the therapy that should be recommended. A trial is planned to test whether OncotypeDX can be used as a standalone trigger for specific treatment decisions. The problems that have been encountered and have delayed the development of other diagnostic tools are exemplified in the development of tests for human epidermal growth factor receptor (HER2) overexpression, for predictors of response to epidermal growth factor receptor inhibitors, and for the detection of residual disease following chemotherapy.

REporting recommendations for tumor MARKer prognostic studies (REMARK).

Despite years of research and hundreds of reports on tumor markers in oncology, the number of markers that have emerged as clinically useful is pitifully small. Often initially reported studies of a marker show great promise, but subsequent studies on the same or related markers yield inconsistent conclusions or stand in direct contradiction to the promising results. It is imperative that we attempt to understand the reasons why multiple studies of the same marker lead to differing conclusions. A variety of methodological problems have been cited to explain these discrepancies. Unfortunately, many tumor marker studies have not been reported in a rigorous fashion, and published articles often lack sufficient information to allow adequate assessment of the quality of the study or the generalizability of study results. The development of guidelines for the reporting of tumor marker studies was a major recommendation of the National Cancer Institute-European Organisation for Research and Treatment of Cancer (NCI-EORTC) First International Meeting on Cancer Diagnostics in 2000. As for the successful CONSORT initiative for randomized trials and for the STARD statement for diagnostic studies, we suggest guidelines to provide relevant information about the study design, preplanned hypotheses, patient and specimen characteristics, assay methods, and statistical analysis methods. In addition, the guidelines provide helpful suggestions on how to present data and important elements to include in discussions. The goal of these guidelines is to encourage transparent and complete reporting so that the relevant information will be available to others to help them to judge the usefulness of the data and understand the context in which the conclusions apply.

Reporting recommendations for tumor marker prognostic studies (REMARK).

Despite years of research and hundreds of reports on tumor markers in oncology, the number of markers that have emerged as clinically useful is pitifully small. Often, initially reported studies of a marker show great promise, but subsequent studies on the same or related markers yield inconsistent conclusions or stand in direct contradiction to the promising results. It is imperative that we attempt to understand the reasons that multiple studies of the same marker lead to differing conclusions. A variety of methodologic problems have been cited to explain these discrepancies. Unfortunately, many tumor marker studies have not been reported in a rigorous fashion, and published articles often lack sufficient information to allow adequate assessment of the quality of the study or the generalizability of study results. The development of guidelines for the reporting of tumor marker studies was a major recommendation of the National Cancer Institute-European Organisation for Research and Treatment of Cancer (NCI-EORTC) First International Meeting on Cancer Diagnostics in 2000. As for the successful CONSORT initiative for randomized trials and for the STARD statement for diagnostic studies, we suggest guidelines to provide relevant information about the study design, preplanned hypotheses, patient and specimen characteristics, assay methods, and statistical analysis methods. In addition, the guidelines suggest helpful presentations of data and important elements to include in discussions. The goal of these guidelines is to encourage transparent and complete reporting so that the relevant information will be available to others to help them to judge the usefulness of the data and understand the context in which the conclusions apply.

REporting recommendations for tumour MARKer prognostic studies (REMARK).

Despite years of research and hundreds of reports on tumour markers in oncology, the number of markers that have emerged as clinically useful is pitifully small. Often initially reported studies of a marker show great promise, but subsequent studies on the same or related markers yield inconsistent conclusions or stand in direct contradiction to the promising results. It is imperative that we attempt to understand the reasons that multiple studies of the same marker lead to differing conclusions. A variety of methodologic problems have been cited to explain these discrepancies. Unfortunately, many tumour marker studies have not been reported in a rigorous fashion, and published articles often lack sufficient information to allow adequate assessment of the quality of the study or the generalisability of study results. The development of guidelines for the reporting of tumour marker studies was a major recommendation of the National Cancer Institute-European Organisation for Research and Treatment of Cancer (NCI-EORTC) First International Meeting on Cancer Diagnostics in 2000. As for the successful CONSORT initiative for randomised trials and for the STARD statement for diagnostic studies, we suggest guidelines to provide relevant information about the study design, pre-planned hypotheses, patient and specimen characteristics, assay methods, and statistical analysis methods. In addition, the guidelines suggest helpful presentations of data and important elements to include in discussions. The goal of these guidelines is to encourage transparent and complete reporting so that the relevant information will be available to others to help them to judge the usefulness of the data and understand the context in which the conclusions apply.

Program for the Assessment of Clinical Cancer Tests (PACCT): assisting the development of tailored cancer therapy.

Fulfillment of the promise of the genomic revolution for personalizing cancer therapy will depend on the ability to identify specific alterations in tumor cells that are critical to their growth, and the development of drugs that can target these alterations and inhibit their growth. In this report, examples of where this has been successful are discussed, and the challenges faced in other cases are described. The identification of the patients most likely to benefit from targeted agents requires significant investment in the development and validation of predictive assays. The Program for the Assessment of Clinical Cancer Tests (PACCT) has proposed an approach that should speed the development of the diagnostic tools required and their acceptance into clinical practice. This approach is dependent on determining the most pressing clinical questions confronting clinicians today and the availability of adequate specimens to validate the assays.

REporting recommendations for tumor MARKer prognostic studies (REMARK).

Despite years of research and hundreds of reports on tumor markers in oncology, the number of markers that have emerged as clinically useful is pitifully small. Often initially reported studies of a marker show great promise, but subsequent studies on the same or related markers yield inconsistent conclusions or stand in direct contradiction to the promising results. It is imperative that we attempt to understand the reasons why multiple studies of the same marker lead to differing conclusions. A variety of methodological problems have been cited to explain these discrepancies. Unfortunately, many tumor marker studies have not been reported in a rigorous fashion, and published articles often lack sufficient information to allow adequate assessment of the quality of the study or the generalizability of study results. The development of guidelines for the reporting of tumor marker studies was a major recommendation of the National Cancer Institute-European Organisation for Research and Treatment of Cancer (NCI-EORTC) First International Meeting on Cancer Diagnostic in 2000. As for the successful CONSORT initiative for randomized trials and for the STARD statement for diagnostic studies, we suggest guidelines to provide relevant information about the study design, preplanned hypotheses, patient and specimen characteristics, assay methods, and statistical analysis methods. In addition, the guidelines provide helpful suggestions on how to present data and important elements to include in discussions. The goal of these guidelines is to encourage transparent and complete reporting so that the relevant information will be available to others to help them to judge the usefulness of the data and understand the context in which the conclusions apply.

Prognostic and predictive markers in cancer.

The elucidation of the human genome and advances in knowledge about molecular abnormalities, signaling pathways, influence of the local tissue milieu and the relevance of genetic polymorphisms offer hope of designing more effective, individualized cancer treatment plans. Although the scientific and medical literature is replete with reports of putative prognostic or predictive markers for cancer, few new diagnostics have been incorporated into routine clinical practice. Criteria are needed to a) identify markers that have the promise to be clinically useful; b) assess the best methodology for clinical evaluation of the markers in question and c) confirm or validate that using the marker adds useful information compared to using standard prognostic factors alone. This review presents a methodology for the clinical evaluation of putative prognostic and predictive markers in cancer, with considerations of pitfalls in the early evaluation, rationale for development and optimization of assay methodology, and examples of possible clinical trials for assessing the clinical utility of putative markers.