Functional co-primary measures for clinical trials in schizophrenia: results from the MATRICS Psychometric and Standardization Study.

OBJECTIVE: During the consensus meetings of the National Institute of Mental Health Measurement and Treatment Research to Improve Cognition in Schizophrenia (NIMH-MATRICS) Initiative, the U.S. Food and Drug Administration took the position that a drug for this purpose should show changes on 1) an accepted consensus cognitive performance measure and 2) an additional measure (i.e., a co-primary) that is considered functionally meaningful. The goal of the current study was to describe steps to evaluate four potential co-primary measures for psychometric properties and validity. METHOD: As part of the five-site MATRICS Psychometric and Standardization Study (PASS), two measures of functional capacity and two interview-based measures of cognition were evaluated in 176 patients with schizophrenia (167 of these patients were retested 4 weeks later). RESULTS: Data are presented for each co-primary measure for test-retest reliability, utility as a repeated measure, relationship to cognitive performance, relationship to functioning, tolerability/practicality, and number of missing data. CONCLUSIONS: Psychometric properties of all of the measures were considered acceptable, and the measures were generally comparable across the various criteria, except that the functional capacity measures had stronger relationships to cognitive performance and fewer missing data. The development and evaluation of potential co-primary measures is still at an early stage, and it was decided not to endorse a single measure for clinical trials at this point. The current findings offer the initial steps to identify functionally meaningful co-primary measures in this area and will help to guide further evaluation of such measures.

The MATRICS Consensus Cognitive Battery, part 2: co-norming and standardization.

OBJECTIVE: The consensus cognitive battery developed by the National Institute of Mental Health's (NIMH's) Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative includes 10 independently developed tests that are recommended as the standard battery for clinical trials of cognition-enhancing interventions for schizophrenia. To facilitate interpretation of results from the MATRICS Consensus Cognitive Battery using a common scaling across tests, normative data were obtained from a single representative U.S. community sample with the battery administered as a unit. METHOD: The MATRICS Consensus Cognitive Battery was administered to 300 individuals from the general community at five sites in differing geographic regions. For each site, recruitment was stratified by age, gender, and education. A scientific survey sampling method was used to help avoid sampling bias. The battery was administered in a standard order to each participant in a single session lasting approximately 60 minutes. Descriptive data were generated, and age, gender, and education effects on performance were examined. RESULTS: Prominent age and education effects were observed across tests. The results for gender differed by measure, suggesting the need for age and gender corrections in clinical trials. The MATRICS Consensus Cognitive Battery components were co-normed, with allowance for demographic corrections. CONCLUSIONS: Co-norming a battery such as the MATRICS Consensus Cognitive Battery, comprising tests from independent test developers each with their own set of norms, facilitates valid interpretation of test scores and communication of findings across studies. These normative data will aid in estimating the magnitude of change during clinical trials of cognition-enhancing agents and make it possible to derive more directly interpretable composite scores.

The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity.

OBJECTIVE: The lack of an accepted standard for measuring cognitive change in schizophrenia has been a major obstacle to regulatory approval of cognition-enhancing treatments. A primary mandate of the National Institute of Mental Health's Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative was to develop a consensus cognitive battery for clinical trials of cognition-enhancing treatments for schizophrenia through a broadly based scientific evaluation of measures. METHOD: The MATRICS Neurocognition Committee evaluated more than 90 tests in seven cognitive domains to identify the 36 most promising measures. A separate expert panel evaluated the degree to which each test met specific selection criteria. Twenty tests were selected as a beta battery. The beta battery was administered to 176 individuals with schizophrenia and readministered to 167 of them 4 weeks later so that the 20 tests could be compared directly. RESULTS: The expert panel ratings are presented for the initially selected 36 tests. For the beta battery tests, data on test-retest reliability, practice effects, relationships to functional status, practicality, and tolerability are presented. Based on these data, 10 tests were selected to represent seven cognitive domains in the MATRICS Consensus Cognitive Battery. CONCLUSIONS: The structured consensus method was a feasible and fair mechanism for choosing candidate tests, and direct comparison of beta battery tests in a common sample allowed selection of a final consensus battery. The MATRICS Consensus Cognitive Battery is expected to be the standard tool for assessing cognitive change in clinical trials of cognition-enhancing drugs for schizophrenia. It may also aid evaluation of cognitive remediation strategies.

New paradigms for treatment development.

Wayne Fenton believed that government-particularly National Institute of Mental Health (NIMH)-could play a critical role in addressing important public health problems where the current system of treatment development was inadequate. Earlier experiences in HIV/AIDS convinced him and others that the NIMH can effectively facilitate the rapid development of new research in critical areas. This report will demonstrate how the work of Fenton and others brought together representatives from industry, government, and academia to address issues that included new preclinical approaches to drug development and defining new therapeutic targets in schizophrenia. An initiative to facilitate the development of new pharmacological agents to address the cognitive impairments in schizophrenia-titled Measurement and Treatment Research to Improve Cognition in Schizophreniaor MATRICS-is used as an example of a new paradigm for treatment development.

Assessment of community functioning in people with schizophrenia and other severe mental illnesses: a white paper based on an NIMH-sponsored workshop.

People with schizophrenia frequently have significant problems in community functioning. Progress in developing effective interventions to ameliorate these problems has been slowed by the absence of reliable and valid measures that are suitable for use in clinical trials. The National Institute of Mental Health convened a workgroup in September 2005 to examine this issue and make recommendations to the field that would foster research in this area. This article reports on issues raised at the meeting. Many instruments have been developed to assess community functioning, but overall insufficient attention has been paid to psychometric issues and many instruments are not suitable for use in clinical trials. Consumer self-report, informant report, ratings by clinicians and trained raters, and behavioral assessment all can provide useful and valid information in some circumstances and may be practical for use in clinical trials. However, insufficient attention has been paid to when and how different forms of assessment and sources of information are useful or how to understand inconsistencies. A major limiting factor in development of reliable and valid instruments is failure to develop a suitable model of functioning and its primary mediators and moderators. Several examples that can guide thinking are presented. Finally, the field is limited by the absence of an objective gold standard of community functioning. Hence, outcomes must be evaluated in part by "clinical significance." This criterion is problematic because different observers and constituencies often have different opinions about what types of change are clinically important and how much change is significant.

Mood disorders: cardiovascular and diabetes comorbidity.

PURPOSE OF REVIEW: Depression is often associated with medical comorbidity. New research quantifies patterns of mood disorder in illnesses such as cardiovascular disease and diabetes, evaluates the prognostic significance of mood symptoms, and seeks to identify common mechanisms for both mood and medical disease. This review provides recent findings on comorbidity, summarizes mechanistic hypotheses, and outlines developments in treatment and services. RECENT FINDINGS: Depression occurs in up to one-quarter of patients with cardiovascular disease and diabetes. Depressed patients with heart disease have poorer medical outcomes including increased risk of reinfarction and all-cause mortality. Patients with diabetes and depression have poorer glycemic control, more diabetes symptoms, and greater all-cause mortality. Depression is associated with both biological (hypothalamic-pituitary-adrenal axis dysregulation) and psychosocial processes (adherence, poorer diet, and exercise) that may mediate adverse medical outcomes. Antidepressant treatments are effective in treating depression in medically ill patients, but their impact on medical outcomes remains to be quantified. SUMMARY: Depression, cardiovascular disease, and diabetes are among the most common chronic illnesses affecting an aging population. Depression is treatable in patients with medical illnesses, and collaborative care models can yield better detection and depression treatment in primary care settings in which most patients with depression are seen.

A summary of the FDA-NIMH-MATRICS workshop on clinical trial design for neurocognitive drugs for schizophrenia.

OBJECTIVE: On April 23, 2004, a joint meeting of the FDA, NIMH, MATRICS investigators, and experts from academia and the pharmaceutical industry was convened to develop guidelines for the design of clinical trials of cognitive-enhancing drugs for neurocognitive impairments in patients with schizophrenia. METHOD: Experts were asked to address specific questions relating to clinical trial design of adjunctive/co-treatment and broad spectrum agents. At the workshop, experts reviewed relevant evidence before offering the discussion panel proposed guidelines for a given subset of questions. The discussion panel, which consisted of presenters and representatives from FDA, NIMH, academia, and industry, deliberated to reach consensus on suggested guidelines. When evidence was insufficient, suggested guidelines represent the opinion of a cross-section of the presenters and discussion panel. RESULTS: Guidelines were developed for inclusion criteria, the use of co-primary outcome measures, and statistical approaches for study design. Consensus was achieved regarding diagnostic and concomitant medication inclusion criteria and on the use of cognitive screening measures. A key guideline was to limit the trial to patients in the residual phase of their illness, who have a predefined level of positive, negative, and affective symptoms. The most difficult issues were the feasibility of including a co-primary measure of functional improvement and the choice of comparator agent for a trial of a broad spectrum agent (with antipsychotic and cognitive-enhancing effects). CONCLUSIONS: The suggested guidelines represent reasonable starting points for trial design of cognitive-enhancing drugs, with the understanding that new data, subsequent findings, or other methodological considerations may lead to future modifications.

Approaching a consensus cognitive battery for clinical trials in schizophrenia: the NIMH-MATRICS conference to select cognitive domains and test criteria.

To stimulate the development of new drugs for the cognitive deficits of schizophrenia, the National Institute of Mental Health (NIMH) established the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative. This article presents an overview of decisions from the first MATRICS consensus conference. The goals of the meeting were to 1) identify the cognitive domains that should be represented in a consensus cognitive battery and 2) prioritize key criteria for selection of tests for the battery. Seven cognitive domains were selected based on a review of the literature and input from experts: working memory, attention/vigilance, verbal learning and memory, visual learning and memory, reasoning and problem solving, speed of processing, and social cognition. Based on discussions at this meeting, five criteria were considered essential for test selection: good test-retest reliability, high utility as a repeated measure, relationship to functional outcome, potential response to pharmacologic agents, and practicality/tolerability. The results from this meeting constitute the initial steps for reaching a consensus cognitive battery for clinical trials in schizophrenia.

Evaluation of functionally meaningful measures for clinical trials of cognition enhancement in schizophrenia.

OBJECTIVE: Because reduction of psychotic symptoms in schizophrenia does not result in adequate community functioning, efforts have shifted to other areas, such as cognitive impairment. The U.S. Food and Drug Administration requires that drugs for cognition enhancement in schizophrenia show improvement on two distinct outcome measures in clinical trials: an accepted cognitive performance battery and a functionally meaningful coprimary measure. The authors examined the reliability, validity, and practicality of functionally meaningful measures. METHOD: In this four-site validation study, schizophrenia patients were assessed at baseline (N=166) and 4 weeks later (N=144) on performance-based (Independent Living Scales, Test of Adaptive Behavior in Schizophrenia [TABS], and UCSD Performance-based Skills Assessment [UPSA]) and interview-based (Cognitive Assessment Interview and Clinical Global Impression Scale for Cognition) candidate coprimary measures. In addition, cognitive performance, community functioning, and clinical symptoms were assessed. Both full and short forms of the performance-based measures were evaluated. RESULTS: All measures were well tolerated by patients, had adequate test-retest reliability, and showed good utility as a repeated measure. Measures differed in their correlation with cognitive performance, with performance-based measures having stronger correlations than interview-based measures. None of the measures had notable floor or ceiling effects or missing data. CONCLUSIONS: Among the full-form measures, the UPSA was judged to have the strongest overall properties. Among the short forms, the TABS and UPSA appeared to have the strongest features. Use of the short forms saves time, but at the cost of lower test-retest reliability and weaker correlations with cognitive performance.

NIMH initiatives to facilitate collaborations among industry, academia, and government for the discovery and clinical testing of novel models and drugs for psychiatric disorders.

There is an urgent need to transform basic research discoveries into tools for treatment and prevention of mental illnesses. This article presents an overview of the National Institute of Mental Health (NIMH) programs and resources to address the challenges and opportunities in psychiatric drug development starting at the point of discovery through the early phases of translational research. We summarize NIMH and selected National Institutes of Health (NIH) efforts to stimulate translation of basic and clinical neuroscience findings into novel targets, models, compounds, and strategies for the development of innovative therapeutics for psychiatric disorders. Examples of collaborations and partnerships among NIMH/NIH, academia, and industry are highlighted.