Progress toward a performance measure for mental health based on a generic patient- reported outcome measure: Findings from the Veterans Outcome Assessment survey.

We report on studies conducted to develop outcome-based performance measures (PROM-PMs) based on generic patient-reported outcome measures (PROMs) that could support strategies for quality improvement applicable to all patients in a mental health system. Data were from the Veterans Outcome Assessment Survey at baseline and three months for the Mental Component Score (MCS-12), a widely used measure of mental health-related quality of life, for 15,540 outpatients beginning treatment in General Mental Health clinics in 140 Veterans Affairs (VA) facilities. Mental health diagnoses from medical records were coded using hierarchical categories. Mental health staffing levels and quality measures were from administrative data. Changes in MCS-12 scores were associated with demographics, baseline scores, and diagnostic categories; in fully adjusted models, differences between facilities accounted for only 0.5% of the total variance between patients. There were small but significant associations of both baseline and changes in MCS-12 scores with staffing levels and administrative measures of the quality of care that support the potential value of adjusted measures of changes in MCS-12 as a PROM-PM. Remaining issues include the low proportion of variability that can be attributed to differences between facilities and the associations of staffing and quality with possible case-mix adjustment variables.

Do Proposed Quality Measures for Carpal Tunnel Release Reveal Important Quality Gaps and Are They Reliable?

BACKGROUND: The American Academy of Orthopaedic Surgeons recently proposed quality measures for the initial surgical treatment of carpal tunnel syndrome (CTS). One measure addressed avoidance of adjunctive surgical procedures during carpal tunnel release; and a second measure addressed avoidance of routine use of clinic-based occupational and/or physical therapy (OT/PT) after carpal tunnel release. However, for quality measures to serve their intended purposes, they must be tested in real-world data to establish that gaps in quality exist and that the measures yield reliable performance information. QUESTIONS/PURPOSES: (1) Is there an important quality gap in clinical practice for avoidance of adjunctive surgical procedures during carpal tunnel release? (2) Is there an important quality gap in avoiding routine use of clinic-based occupational and/or physical therapy after carpal tunnel release? (3) Do these two quality measures have adequate beta-binomial signal-to-noise ratio (SNR) and split-sample reliability (SSR)? METHODS: This retrospective comparative study used a large national private insurance claims database, the 2018 Optum Clinformatics® Data Mart. Ideally, healthcare quality measures are tested within data reflective of the providers and payors to which the measures will be applied. We previously tested these measures in a large public healthcare system and a single academic medical center. In this study, we sought to test the measures in the broader context of patients and providers using private insurance. For both measures, we included the first carpal tunnel release from 28,083 patients performed by one of 7236 surgeons, irrespective of surgical specialty (including, orthopaedic, plastic, neuro-, and general surgery). To calculate surgeon-level descriptive and reliability statistics, analyses were focused on the 66% (18,622 of 28,083) of patients who received their procedure from one of the 24% (1740 of 7236) of surgeons with at least five carpal tunnel releases in the database. No other inclusion/exclusion criteria were applied. To determine whether the measures reveal important gaps in treatment quality (avoidance of adjunctive procedures and routine therapy), we calculated descriptive statistics (median and interquartile range) of the performance distribution stratified by surgeon-level annual volume of carpal tunnel releases in the database (5+, 10+, 15+, 20+, 25+, and 30+). Like the Centers for Medicare & Medicaid Services (CMS), we considered a measure "topped out" if median performance was greater than 95%, meaning the opportunity for further quality improvement is low. We calculated the surgeon-level beta-binomial SNR and SSR for each measure, each stratified by the number of carpal tunnel releases performed by each surgeon in the database. These are standard measures of reliability in health care quality measurement science. The SNR quantifies the proportion of variance that is between rather than within surgeons, and the SSR is the correlation of performance scores when each surgeons' patients are split into two random samples and then corrected for sample size. RESULTS: We found that 2% (308 of 18,622) of carpal tunnel releases involved an adjunctive procedure. The results showed that avoidance of adjunctive surgical procedures during carpal tunnel release had a median (IQR) performance of 100% (100% to 100%) at all case volumes. Only 8% (144 of 1740) of surgeons with at least five cases in the database had less than 100% performance, and only 5% (84 of 1740) had less than 90% performance. This means adjunctive procedures were rarely performed and an important quality gap does not exist based on the CMS criterion. Regarding the avoidance of routine therapy, there was a larger quality gap: For surgeons with at least five cases in the database, median performance was 89% (75% to 100%), and 25% (435 of 1740) of these surgeons had less than 75% performance. This signifies that the measure is not topped out and may reveal an important quality gap. Most patients receiving clinic-based OT/PT had only one visit in the 6 weeks after surgery. Median (IQR) SNRs of the first measure, which addressed avoidance of adjunctive surgical procedures, and the second measure, which addresses avoidance of routine use clinic-based OT/PT, were 1.00 (1.00 to 1.00) and 0.86 (0.67 to 1.00), respectively. The SSR for these measures were 0.87 (95% CI 0.85 to 0.88) and 0.75 (95% CI 0.73 to 0.77), respectively. All of these reliability statistics exceed National Quality Forum's emerging minimum standard of 0.60. CONCLUSION: The first measure, the avoidance of adjunctive surgical procedures during carpal tunnel release, lacked an important quality gap suggesting it is unlikely to be useful in driving improvements. The second measure, avoidance of routine use of clinic-based OT/PT, revealed a larger quality gap and had very good reliability, suggesting it may be useful for quality monitoring and improvement purposes. CLINICAL RELEVANCE: As healthcare systems and payors use the second measure, avoidance of routine use of clinic-based OT/PT, to encourage adherence to clinical practice guidelines (such as provider profiling, public reporting, and payment policies), it will be critically important to consider what proportion of patients receiving OT/PT should be considered routine practice and therefore inconsistent with guidelines. The value or potential harm of this measure depends on this judgement.

Surveying the Landscape of Quality-of-Care Measures for Mental and Substance Use Disorders.

OBJECTIVE: Quality measures that are used to evaluate health care services have a central role in monitoring and incentivizing quality improvement and the provision of evidence-based treatment. This systematic scan aimed to catalog quality-of-care measures for mental and substance use disorders and assess gaps and redundancies to inform efforts to develop and retire measures. METHODS: Quality measure inventories were analyzed from six organizations that evaluate health care quality in the United States. Measures were included if they were defined via symptoms or diagnoses of mental and substance use disorders or specialty treatments or treatment settings for adults. RESULTS: Of 4,420 measures analyzed, 635 (14%) met inclusion criteria, and 376 unique quality-of-care measure constructs were cataloged and characterized. Symptoms or diagnoses of disorders were most commonly used to define measures (46%, N=172). Few measures were available for certain disorders (e.g., anxiety disorders), evidence-based treatments (e.g., psychotherapy), and quality domains (e.g., equity). Only one in four measures was endorsed by the National Quality Forum, which independently and critically evaluates quality measures. Among measures that were actively in use for national quality improvement initiatives (N=319), process measures (57%) were most common, followed by outcome measures (30%), the latter of which focused most often on experience of care. CONCLUSIONS: A vast landscape of mental and substance use disorder quality-of-care measures currently exists, and continued efforts to harmonize duplicative measures and to develop measures for underrepresented evidence-based treatments and quality domains are warranted. The authors recommend reinvesting in a national, centralized system for measure curation, with a stakeholder-centered process for independent measure review and endorsement.

Evaluating and Improving Engagement in Care After High-Intensity Stays for Mental or Substance Use Disorders.

OBJECTIVE: This interrupted time-series analysis examined whether activating a quality measure, supported by education and a population management tool, was associated with higher postdischarge engagement (PDE) in outpatient care after inpatient and residential stays for mental or substance use disorder care. METHODS: Discharges from October 2016 to May 2019 were identified from national Veterans Health Administration (VHA) records representing all 140 VHA health care systems. Engagement was defined as multiple mental or substance use disorder outpatient visits in the 30 days postdischarge. The number of such visits required to meet the engagement definition depended on a patient's suicide risk and acuity level of inpatient or residential treatment. Health care system-level performance was calculated as the percentage of qualifying discharges with 30-day PDE. A segmented mixed-effects linear regression model tested whether monthly health care system performance changed significantly after activation of the PDE measure (activation rollout period, October-December 2017). RESULTS: A total of 322,344 discharges qualified for the measure. In the regression model, average health care system performance was 65.6% at the beginning of the preactivation period (October 2016) and did not change significantly in the following 12 months. Average health care system performance increased by 5.7% (SE=0.8%, p<0.001) after PDE measure activation and did not change significantly thereafter-a difference representing 11,464 more patients engaging in care than would have without activation of the measure. CONCLUSIONS: Results support use of this measure, along with education, technical assistance, and population management tools, to improve engagement after discharge from residential and inpatient mental and substance use disorder treatment.

Testing proposed quality measures for treatment of carpal tunnel syndrome: feasibility, magnitude of quality gaps, and reliability.

BACKGROUND: The American Academy of Orthopaedic Surgeons and American Society for Surgery of the Hand recently proposed three quality measures for carpal tunnel syndrome (CTS): Measure 1 - Discouraging routine use of Magnetic resonance imaging (MRI) for diagnosis of CTS; Measure 2 - Discouraging the use of adjunctive surgical procedures during carpal tunnel release (CTR); and Measure 3 - Discouraging the routine use of occupational and/or physical therapy after CTR. The goal of this study were to 1) Assess the feasibility of using the specifications to calculate the measures in real-world healthcare data and identify aspects of the specifications that might be clarified or improved; 2) Determine if the measures identify important variation in treatment quality that justifies expending resources for their further development and implementation; 3) Assess the facility- and surgeon-level reliability of measures. METHODS: The measures were calculated using national data from the Veterans Health Administration (VA) Corporate Data Warehouse for three fiscal years (FY; 2016-18). Facility- and surgeon-level performance and reliability were examined. To expand the testing context, the measures were also tested using data from an academic medical center. RESULTS: The denominator of Measure 1 was 132,049 VA patients newly diagnosed with CTS. The denominators of Measures 2 and 3 were 20,813 CTRs received by VA patients. The median facility-level performances on the three measures were 96.5, 100, and 94.7%, respectively. Of 130 VA facilities, none had < 90% performance on Measure 1. Among 111 facilities that performed CTRs, only 1 facility had < 90% performance on Measure 2. In contrast, 21 facilities (18.9%) and 333 surgeons (17.8%) had lower than 90% performance on Measure 3 (Median facility- and surgeon-level reliability for Measure 3 were very high (0.95 and 0.96 respectively). CONCLUSIONS: Measure 3 displayed adequate facility- and surgeon-level variability and reliability to justify its use for quality monitoring and improvement purposes. Measures 1 and 2 lacked quality gaps, suggesting they should not be implemented in VA and need to be tested in other healthcare settings. Opportunities exist to refine the specifications of Measure 3 to ensure that different organizations calculate the measure in the same way.

Nonpharmacological Treatment of Army Service Members with Chronic Pain Is Associated with Fewer Adverse Outcomes After Transition to the Veterans Health Administration.

BACKGROUND: Potential protective effects of nonpharmacological treatments (NPT) against long-term pain-related adverse outcomes have not been examined. OBJECTIVE: To compare active duty U.S. Army service members with chronic pain who did/did not receive NPT in the Military Health System (MHS) and describe the association between receiving NPT and adverse outcomes after transitioning to the Veterans Health Administration (VHA). DESIGN AND PARTICIPANTS: A longitudinal cohort study of active duty Army service members whose MHS healthcare records indicated presence of chronic pain after an index deployment to Iraq or Afghanistan in the years 2008-2014 (N = 142,539). Propensity score-weighted multivariable Cox proportional hazard models tested for differences in adverse outcomes between the NPT group and No-NPT group. EXPOSURES: NPT received in the MHS included acupuncture/dry needling, biofeedback, chiropractic care, massage, exercise therapy, cold laser therapy, osteopathic spinal manipulation, transcutaneous electrical nerve stimulation and other electrical manipulation, ultrasonography, superficial heat treatment, traction, and lumbar supports. MAIN MEASURES: Primary outcomes were propensity score-weighted proportional hazards for the following adverse outcomes: (a) diagnoses of alcohol and/or drug disorders; (b) poisoning with opioids, related narcotics, barbiturates, or sedatives; (c) suicide ideation; and (d) self-inflicted injuries including suicide attempts. Outcomes were determined based on ICD-9 and ICD-10 diagnoses recorded in VHA healthcare records from the start of utilization until fiscal year 2018. KEY RESULTS: The propensity score-weighted proportional hazards for the NPT group compared to the No-NPT group were 0.92 (95% CI 0.90-0.94, P < 0.001) for alcohol and/or drug use disorders; 0.65 (95% CI 0.51-0.83, P < 0.001) for accidental poisoning with opioids, related narcotics, barbiturates, or sedatives; 0.88 (95% CI 0.84-0.91, P < 0.001) for suicide ideation; and 0.83 (95% CI 0.77-0.90, P < 0.001) for self-inflicted injuries including suicide attempts. CONCLUSIONS: NPT provided in the MHS to service members with chronic pain may reduce risk of long-term adverse outcomes.

Four Decades after War: Incident Diabetes among Women Vietnam-Era Veterans in the HealthViEWS Study.

OBJECTIVES: We analyzed long-term differences in incident diabetes associated with military service in a warzone among women who served during the Vietnam War era. METHODS: For HealthViEWS, the largest later-life study of women Vietnam War-era U.S. veterans, a population-based retrospective cohort who served during 1965-1973 completed a health interview in 2011-2012. This cohort included women deployed to Vietnam, near Vietnam, or who served primarily in the United States. We hypothesized a warzone exposure gradient: Vietnam (highest exposure), near Vietnam, and the United States (lowest exposure). We used an extended Cox regression to test for differences in incident diabetes by location of wartime service. RESULTS: Of 4,503 women in the analysis, 17.7% developed diabetes. Adjusting for demographics and military service characteristics, hazard of incident diabetes was significantly lower initially in the Vietnam group compared with the U.S. group (hazard ratio, 0.33; 95% confidence interval, 0.15-0.69). However, lower diabetes hazard in the Vietnam group was not constant over time; rather, hazard accumulated faster over time in the Vietnam group compared with the U.S. group (hazard ratio, 1.38; 95% confidence interval, 1.11-1.72). No significant difference in diabetes hazard was found between the near Vietnam and U.S. groups. Older age during military service, minority race/ethnicity, and lower military rank were associated with a higher diabetes hazard. CONCLUSIONS: Women deployed to a warzone might have protective health factors that lower risk for diabetes early in their military career, but delivery systems for long-term health should consider that a lower risk for chronic diseases like diabetes can wane quickly in the decades that follow warzone service.

Patient and Health Care Factors Associated With Long-term Diabetes Complications Among Adults With and Without Mental Health and Substance Use Disorders.

Importance: Among people with diabetes, co-occurring mental health (MH) or substance use (SU) disorders increase the risk of medical complications. Identifying how to effectively promote long-term medical benefits for at-risk populations, such as people with MH or SU disorders, is essential. Knowing more about how health care accessed before the onset of diabetes is associated with health benefits after the onset of diabetes could inform treatment planning and population health management. Objective: To analyze how preexisting MH or SU disorders and primary care utilization before a new diabetes diagnosis are associated with the long-term severity of diabetes complications. Design, Setting, and Participants: This cohort study analyzed medical record data from US Department of Veterans Affairs health care systems nationwide and used mixed-effects regressions to test associations between prediabetes patient or health care factors and longitudinal progression of diabetes complication severity from 2006 to 2015. Participants included patients who received a new diabetes diagnosis in 2008 and who were aged 18 to 85 years at the time of their diagnosis. Data analysis was conducted from March to August 2017. Exposures: Patients were assigned to groups on the basis of a 2-year look-back period for MH or SU disorders status (MH disorder only, SU disorder only, MH and SU disorder, or no MH or SU disorder diagnoses) and on the basis of the amount of primary care utilization before diabetes was diagnosed. Main Outcomes and Measures: Nine-year trajectories of Diabetes Complication Severity Index (DCSI) scores. Results: Among 122 992 patients with newly diagnosed diabetes, the mean (SD) age was 62.3 (11.1) years, 118 810 (96.6%) were male, and 28 633 (23.3%) had preexisting MH or SU disorders diagnoses. From the onset of diabetes to 7 years later, patients' mean estimated DCSI scores increased from 0.84 (95% CI, 0.82-0.87) to 1.42 (95% CI, 1.36-1.47). Controlling for sociodemographic characteristics and medical comorbidities, SU disorders only (decrease in DCSI score, -0.09; 95% CI, -0.13 to -0.04; P < .001) or both MH and SU disorders (decrease in DCSI score, -0.13; 95% CI, -0.16 to -0.09; P < .001), but not MH disorders only, were associated with lower DCSI scores at the time of the onset of diabetes compared with no MH or SU disorders. More than 90% of patients with MH or SU disorders had primary care visits before diabetes was newly diagnosed, compared with approximately 58% of patients without MH or SU disorders. Patients who had primary care visits before the onset of diabetes had lower baseline DCSI scores, compared with patients who did not have primary care visits (decrease in DCSI score, -0.41 [95% CI, -0.43 to -0.39] for 1-2 visits, -0.50 [95% CI, -0.52 to -0.48] for 3-4 visits, -0.39 [95% CI, -0.41 to -0.37] for 5-8 visits, and -0.15 [95% CI, -0.17 to -0.12] for ≥9 visits; P < .001 for all). Patients with MH or SU disorders had lower overall, but more rapidly progressing, mean DCSI scores through year 7 after the onset of diabetes (MH disorder only, 0.006 [95% CI, 0.005-0.008], P < .001; SU disorder only, 0.005 [95% CI, 0.001-0.008], P = .004; or both MH and SU disorders, 0.008 [95% CI, 0.006-0.011], P < .001), compared with patients without MH or SU disorders. Conclusions and Relevance: Access to and engagement in integrated health care may be associated with modest, albeit impermanent, long-term health benefits for patients with MH and/or SU disorders with newly diagnosed diabetes.

Variation in Nonsurgical Services for Carpal Tunnel Syndrome Across a Large Integrated Health Care System.

PURPOSE: To evaluate facility-level variation in the use of services for patients with carpal tunnel syndrome (CTS) receiving care in the Veterans Health Administration (VHA). METHODS: A national cohort of VHA patients diagnosed with CTS during fiscal year 2013 was divided into nonsurgical and operative treatment groups for comparison. We assessed the use of 5 types of CTS-related services (electrodiagnostic studies [EDS], imaging, steroid injection, oral steroids, and therapeutic modalities) in the prediagnosis and postdiagnosis periods before any operative intervention at the patient and facility levels. RESULTS: Among 72,599 patients newly diagnosed with CTS, 5,666 (7.8%) received carpal tunnel release within 12 months. The remaining 66,933 (92.2%) were in the nonsurgical group. Therapeutic modalities and EDS were the most commonly employed services after the index diagnosis and had large facility-level variation in use. At the facility level, the use of therapeutic modalities ranged from 0% to 93% in the operative group (mean, 32%) compared with 1% to 67% (mean, 30%) in the nonsurgical group. The use of EDS in the postdiagnosis period ranged from 0% to 100% (mean, 59%) in the operative treatment group and 0% to 55% (mean, 26%) in the nonsurgical group at the facility level. CONCLUSIONS: There is wide facility variation in the use of services for CTS among patients receiving operative and nonsurgical treatment. Care delivered by facilities with the highest and lowest rates of service use may suggest overuse and underuse, respectively, of nonsurgical CTS services and a lack of consideration of individual patient factors in making health care decisions regarding use. CLINICAL RELEVANCE: Surgeons must understand the degree of treatment variability for CTS, comprehend the ramifications of large variation in reimbursement and waste in the health care system, and become involved in devising strategies to optimize hand care across all phases of care.

Barriers and Facilitators to Implementation of Pharmacotherapy for Opioid Use Disorders in VHA Residential Treatment Programs.

OBJECTIVE: Despite evidence of effectiveness, pharmacotherapy-methadone, buprenorphine, or naltrexone-is prescribed to less than 35% of Veterans Health Administration (VHA) patients diagnosed with opioid use disorder (OUD). Among veterans whose OUD treatment is provided in VHA residential programs, factors influencing pharmacotherapy implementation are unknown. We examined barriers to and facilitators of pharmacotherapy for OUD among patients diagnosed with OUD in VHA residential programs to inform the development of implementation strategies to improve medication receipt. METHOD: VHA electronic health records and program survey data were used to describe pharmacotherapy provided to a national cohort of VHA patients with OUD in residential treatment programs (N = 4,323, 6% female). Staff members (N = 63, 57% women) from 44 residential programs (response rate = 32%) participated in interviews. Barriers to and facilitators of pharmacotherapy for OUD were identified from transcripts using thematic analysis. RESULTS: Across all 97 residential treatment programs, the average rate of pharmacotherapy for OUD was 21% (range: 0%-67%). Reported barriers included provider or program philosophy against pharmacotherapy, a lack of care coordination with nonresidential treatment settings, and provider perceptions of low patient interest or need. Facilitators included having a prescriber on staff, education and training for patients and staff, and support from leadership. CONCLUSIONS: Contrary to our hypothesis, barriers to and facilitators of pharmacotherapy for OUD in VHA residential treatment programs were consistent with prior research in outpatient settings. Intensive educational programs, such as academic detailing, and policy changes such as mandating buprenorphine waiver training for VHA providers, may help improve receipt of pharmacotherapy for OUD.

Potentially Preventable Medical Hospitalizations and Emergency Department Visits by the Behavioral Health Population.

This study investigated geographic variation in potentially preventable medical outcomes that might be used to monitor access to high-quality medical care in the behavioral health population. Analyzing public and non-public data sources from California on adults admitted between 2009 and 2011 to all non-federal licensed medical inpatient (N = 6,603,146) or emergency department units (N = 21,011,958) revealed that 33.6% of nearly 1 million potentially preventable hospitalizations and 9.8% of 1.5 million potentially preventable emergency department visits were made by people with mental or substance use disorder diagnoses. Across California counties or county groups (N = 36), a higher preventable hospitalization rate in the behavioral health population was associated with higher poverty, higher primary care safety net utilization, and fewer mental health providers. Although further validation is required, rates of potentially preventable encounters, particularly hospitalizations, may be useful measures of access to high-quality care in the behavioral health population.

Predictive Validity of Outpatient Follow-up After Detoxification as a Quality Measure.

OBJECTIVES: Care coordination for substance use disorder (SUD) treatment is a persistent challenge. Timely outpatient follow-up after detoxification from alcohol and opiates is associated with improved outcomes, leading some care systems to attempt to measure and incentivize this practice. This study evaluated the predictive validity of a 7-day outpatient follow-up after detoxification quality measure used by the Veterans Health Administration (VHA). METHODS: A national sample of patients who received detoxification from alcohol or opiates (N = 25,354) was identified in VHA administrative data. Propensity score-weighted mixed-effects regressions modeled associations between receiving an outpatient follow-up visit within 7 days of completing detoxification and patient outcomes, controlling for facility-level performance and clustering of patients within facilities. RESULTS: Baseline differences between patients who did (39.6%) and did not (60.4%) receive the follow-up visit were reduced or eliminated with propensity score weighting. Meeting the quality measure was associated with significantly more outpatient treatment for SUD (b = 1.07 visits) and other mental health conditions (b = 0.58 visits), and higher inpatient utilization for SUD (b = 0.75 admissions) and other mental health conditions (b = 0.76 admissions). Notably, meeting the quality measure was associated with 53.3% lower odds of 2-year mortality (P < 0.001 for all). CONCLUSIONS: These findings support the predictive validity of 7-day follow-up after detoxification as a care coordination measure. Well-coordinated care may be associated with higher outpatient and inpatient utilization, and such engagement in care may be protective against mortality in people who receive detoxification from alcohol or opiates.

Measurement-based management of mental health quality and access in VHA: SAIL mental health domain.

We outline the development of a Mental Health Domain to track accessibility and quality of mental health care in the United States Veterans Health Administration (VHA) as part of a broad-based performance measurement system. This domain adds an important element to national performance improvement efforts by targeting regional and facility leadership and providing them a concise yet comprehensive measure to identify facilities facing challenges in their mental health programs. We present the conceptual framework and rationale behind measure selection and development. The Mental Health Domain covers three important aspects of mental health treatment: Population Coverage, Continuity of Care, and Experience of Care. Each component is a composite of existing and newly adapted measures with moderate to high internal consistency; components are statistically independent or moderately related. Development and dissemination of the Mental Health Domain involved a variety of approaches and benefited from close collaboration between local, regional, and national leadership and from coordination with existing quality-improvement initiatives. During the first year of use, facilities varied in the direction and extent of change. These patterns of change were generally consistent with qualitative information, providing support for the validity of the domain and its component measures. Measure maintenance remains an iterative process as the VHA mental health system and potential data resources continue to evolve. Lessons learned may be helpful to the broader mental health-provider community as mental health care consolidates and becomes increasingly integrated within healthcare systems. (PsycINFO Database Record

Using organizational and clinical performance data to increase the value of mental health care.

U.S. health systems, policy makers, and patients increasingly demand high-value care that improves health outcomes at lower cost. This study describes the initial design and analysis of the Mental Health Management System (MHMS), a performance data and quality improvement tool used by the Veterans Health Administration (VHA) to increase the value of its mental health care. The MHMS evaluates access to and quality of mental health care, organizational structure and efficiency, implementation of innovative treatment options, and, in collaboration with management, resource needs for delivering care. Performance on 31 measures was calculated for all U.S. VHA facilities (N = 139). Pearson correlations revealed that better access to care was significantly associated with fewer mental health provider staffing vacancies (r = -.24) and higher staff-to-patient ratios for psychiatrists (r = .19) and other outpatient mental health providers (r = .27). Higher staff-to-patient ratios were significantly associated with higher performance on a number of patient and provider satisfaction measures (range of r = .18-.51) and continuity of care measures (range of r = .26-.43). Relationships observed between organizational and clinical performance measures suggest that the MHMS is a robust informatics and quality improvement tool that can serve as a model for health systems planning to adopt a value perspective. Future research should expand the MHMS framework to measure patient and health systems costs and psychosocial outcomes, as well as evaluate whether quality improvement solutions implemented as a result of using organizational information leads to higher-value mental health care. (PsycINFO Database Record

Predictive validity of a quality measure for intensive substance use disorder treatment.

BACKGROUND: Measures of substance use disorder (SUD) treatment quality are essential tools for performance improvement. The Veterans Health Administration (VHA) developed a measure of access to and engagement in intensive outpatient programs (IOPs) for SUD. However, predictive validity, or associations between this measure and treatment outcomes, has not been examined. METHODS: Data on veterans with SUD came from 3 samples: the Outcomes Monitoring Project (N = 5436), a national evaluation of VHA mental health services (N = 339,887), and patients receiving detoxification services (N = 23,572). Propensity score-weighted mixed-effects regressions modeled associations between receiving at least 1 week of IOP treatment and patient outcomes, controlling for facility-level performance and a random effect for facility. RESULTS: Propensity score weighting reduced or eliminated observable baseline differences between patient groups. Patients who accessed IOPs versus those who did not reported significantly reduced alcohol- and drug-related symptom severity, with significantly fewer past-month days drinking alcohol (b = 1.83, P < .001) and fewer past-month days intoxicated (b = 1.55, P < .001). Patients who received IOP after detoxification services had higher 6-month utilization of SUD outpatient visits (b = 2.09, P < .001), more subsequent detoxification episodes (b = 0.25, P < .001), and lower odds of 2-year mortality (odds ratio [OR] = 0.68, 95% confidence interval [CI]: 0.61-0.75; P < .001). CONCLUSIONS: Receiving at least 1 week of SUD treatment in an IOP was associated with higher follow-up utilization, improved health outcomes, and reduced mortality. These associations lend support to the predictive validity of VHA's IOP quality measure. Future research should focus on measure feasibility and validity outside of VHA, and whether predictive validity is maintained once this quality measure is tied to performance incentives.

Assessment of a novel hybrid Delphi and Nominal Groups technique to evaluate quality indicators.

OBJECTIVE: To test the implementation of a novel structured panel process in the evaluation of quality indicators. DATA SOURCE: National panel of 64 clinicians rating usefulness of indicator applications in 2008-2009. STUDY DESIGN: Hybrid panel combined Delphi Group and Nominal Group (NG) techniques to evaluate 81 indicator applications. PRINCIPAL FINDINGS: The Delphi Group and NG rated 56 percent of indicator applications similarly. Group assignment (Delphi versus Nominal) was not significantly associated with mean ratings, but specialty and research interests of panelists, and indicator factors such as denominator level and proposed use were. Rating distributions narrowed significantly in 20.8 percent of applications between review rounds. CONCLUSIONS: The hybrid panel process facilitated information exchange and tightened rating distributions. Future assessments of this method might include a control panel.