Achieving consensus across diverse stakeholders on quality measures for mental healthcare.

OBJECTIVE: Quality-improvement efforts are hindered by a lack of consensus on meaningful and feasible measures of care. The objective of this study was to develop a core set of quality measures for mental health and substance-related care that are meaningful to stakeholders, feasible to implement, and broadly representative of diverse dimensions of the mental health system. METHOD: A 12-member panel of stakeholders from national organizations evaluated 116 process measures in a 2-stage modified Delphi consensus development process. Drawing on a conceptual framework and literature review, panelists rated each measure on 7 domains using a 9-point scale (1 = best). Measures were then mapped to a framework of system dimensions to identify a core set with the highest ratings for system characteristics within each dimension. RESULTS: Twenty-eight measures were identified assessing treatment (12), access (2), assessment (2), continuity (4), coordination (2), prevention (1), and safety (5). Overall, mean ratings for meaningfulness were: clinical importance 2.29; perceived gap between actual and optimal care 2.59; association between improved performance and outcome 2.61. For feasibility, mean ratings were clarity of specifications 3.39; acceptability of data collection burden 4.77; and adequacy of case mix adjustment 4.20. The measures address a range of treatment modalities, clinical settings, diagnostic categories, vulnerable populations, and other dimensions of mental healthcare. CONCLUSIONS: A structured consensus process identified a core set of quality measures that are meaningful and feasible to multiple stakeholders, as well as broadly representative of the mental healthcare system. By yielding quantitative assessments of meaningfulness, feasibility and degree of consensus among stakeholders, these results can inform ongoing national efforts to adopt common quality measures for mental healthcare.

Process measures for the assessment and improvement of quality of care for schizophrenia.

The development of process measures for the assessment and improvement of care for schizophrenia is at an early stage. As part of a national inventory of mental health quality measures, we identified 42 process measures developed to assess the quality of schizophrenia care. A greater proportion of measures assessed pharmacotherapy than assessed psychosocial interventions or other clinical processes, such as assessment, continuity, or coordination. Twenty-five measures (60%) were based on research evidence linking measure conformance with improved patient outcomes, while 17 (40%) were based on clinical consensus or opinion. Only 12 measures (29%) were fully operationalized. Few were tested for validity or reliability. A number of demonstration projects currently under way should expand the pool of well-developed and tested measures. Further research and consensus development will be needed to identify common measurement priorities, reduce the data collection burden, enhance the interpretability of results, and allow for comparisons of clinical practice across facilities and health care systems.