Understanding the characteristics of Latino individuals with first-time DUI offenses to facilitate effective interventions.

Literature shows that Latinos who drink are more likely to experience alcohol-related consequences and less likely to seek care for alcohol misuse than Whites. We aim to understand characteristics, consumption patterns, and openness to treatment among Latino first-time offenders driving under the influence. Latino participants were significantly younger (29.0 years) than non-Latinos (37.7 years). In adjusted models, Latino participants were significantly more likely than non-Latinos to binge drink, but there were no significant group differences in amount of alcohol consumed in a typical week. There was no significant difference in incidence of alcohol-related consequences, readiness to change drinking, and driving behaviors in this sample.

Shifting From Passive Quality Reporting to Active Nudging to Influence Consumer Choice of Health Plan.

Comparative quality information on health plan and provider performance is increasingly available in the form of quality report cards, but consumers rarely make use of these passively provided decision support tools. In 2012-2013, the Centers for Medicare & Medicaid Services (CMS) initiated quality-based nudges designed to encourage beneficiaries to move into higher quality Medicare Advantage (MA) plans. We assess the impacts of CMS' targeted quality-based nudges with longitudinal analysis of 2009-2014 MA plan enrollment trends. Nudges are associated with 17% reductions in enrollment in the lowest-performing plans and 3% increases in enrollment in the highest performing plans (annually, p < .01 for both), occurring at the time of nudge implementation and relative to trends for plans with moderate performance that were not targeted by nudges. These findings suggest that quality-based nudges can successfully steer consumers into higher quality plans and provide opportunities for purchasers and payers to increase consumers' use of quality information.

Sample selection in the face of design constraints: Use of clustering to define sample strata for qualitative research.

OBJECTIVE: To sample 40 physician organizations stratified on the basis of longitudinal cost of care measures for qualitative interviews in order to describe the range of care delivery structures and processes that are being deployed to influence the total costs of caring for patients. DATA SOURCES: Three years of physician organization-level total cost of care data (n = 156 in California) from the Integrated Healthcare Association's value-based pay-for-performance program. STUDY DESIGN: We fit total cost of care data using mixture and K-means clustering algorithms to segment the population of physician organizations into sampling strata based on 3-year cost trajectories (ie, cost curves). PRINCIPAL FINDINGS: A mixture of multivariate normal distributions can classify physician organization cost curves into clusters defined by total cost level, shape, and within-cluster variation. K-means clustering does not accommodate differing levels of within-cluster variation and resulted in more clusters being allocated to unstable cost curves. A mixture of regressions approach focuses overly on anomalous trajectories and is sensitive to model coding. CONCLUSIONS: Statistical clustering can be used to form sampling strata when longitudinal measures are of primary interest. Many clustering algorithms are available; the choice of the clustering algorithm can strongly impact the resulting strata because various algorithms focus on different aspects of the observed data.

Reducing disparities requires multiple strategies.

Disparities in care are a complex issue requiring multiple strategies to solve, including approaches to improve the measurement of quality and reporting stratified performance estimates.

Adjusting Medicare Advantage star ratings for socioeconomic status and disability.

OBJECTIVES: Studies have identified potential unintended effects of not adjusting clinical performance measures in value-based purchasing programs for socioeconomic status (SES) factors. We examine the impact of SES and disability adjustments on Medicare Advantage (MA) plans' and prescription drug plans' (PDPs') contract star ratings. These analyses informed the development of the Categorical Adjustment Index (CAI), which CMS implemented with the 2017 star ratings. STUDY DESIGN: Retrospective analyses of MA and PDP performance using 2012 Medicare beneficiary-level characteristics and performance data from the Star Rating Program. METHODS: We modeled within-contract associations of beneficiary SES (Medicaid and Medicare dual eligibility [DE] or receipt of a low-income subsidy [LIS]) and disability with performance on 16 clinical measures. We estimated variability in contract-level DE/LIS and disability disparities using mixed-effects regression models. We simulated the impact of applying the CAI to adjust star ratings for DE/LIS and disability to construct the 2017 star ratings. RESULTS: DE/LIS was negatively associated with performance for 12 of 16 measures and positively associated for 2 of 16 measures. Disability was negatively associated with performance for 11 of 15 measures and positively associated for 3 of 15 measures. Adjusting star ratings using the CAI resulted in half-star rating increases for 8.5% of MA and 33.3% of PDP contracts that exceeded 50% DE/LIS beneficiaries. CONCLUSIONS: Increases in star ratings following adjustment of clinical performance for SES and disability using the CAI focused on contracts with higher percentages of DE/LIS beneficiaries. Adjustment for enrollee characteristics may improve the accuracy of quality measurement and remove incentives for providers to avoid caring for more challenging patient populations.

Medicare Advantage and Fee-for-Service Performance on Clinical Quality and Patient Experience Measures: Comparisons from Three Large States.

OBJECTIVE: To compare performance between Medicare Advantage (MA) and Fee-for-Service (FFS) Medicare during a time of policy changes affecting both programs. DATA SOURCES/STUDY SETTING: Performance data for 16 clinical quality measures and 6 patient experience measures for 9.9 million beneficiaries living in California, New York, and Florida. STUDY DESIGN: We compared MA and FFS performance overall, by plan type, and within service areas associated with contracts between CMS and MA organizations. Case mix-adjusted analyses (for measures not typically adjusted) were used to explore the effect of case mix on MA/FFS differences. DATA COLLECTION/EXTRACTION METHODS: Performance measures were submitted by MA organizations, obtained from the nationwide fielding of the Medicare Consumer Assessment of Healthcare Providers and Systems (MCAHPS) Survey, or derived from claims. PRINCIPAL FINDINGS: Overall, MA outperformed FFS on all 16 clinical quality measures. Differences were large for HEDIS measures and small for Part D measures and remained after case mix adjustment. MA enrollees reported better experiences overall, but FFS beneficiaries reported better access to care. Relative to FFS, performance gaps were much wider for HMOs than PPOs. Excluding HEDIS measures, MA/FFS differences were much smaller in contract-level comparisons. CONCLUSIONS: Medicare Advantage/Fee-for-Service differences are often large but vary in important ways across types of measures and contracts.

What Role Does Efficiency Play in Understanding the Relationship Between Cost and Quality in Physician Organizations?

BACKGROUND: The belief that there is inefficiency, or the potential to improve patient health at current levels of spending, is driving the push for greater value in health care. Previous studies demonstrate overuse of a narrow set of services, suggesting provider inefficiency, but existing studies neither quantify inefficiency more broadly nor assess its variation across physician organizations (POs). DATA AND METHODS: We used data on quality of care and total cost of care from 129 California POs participating in a statewide value-based pay-for-performance program. We estimated a production function with quality as the output and cost as the input, using a stochastic frontier model, to develop a measure of relative efficiency for each PO. To validate the efficiency measure, we examined correlations of PO efficiency estimates with indicators representing overuse of services. RESULTS: The estimated production function showed that PO quality was positively associated with costs, although there were diminishing marginal returns to spending. A certain minimum level of spending was associated with high quality even among efficient POs. Most strikingly, however, POs had substantial variation in efficiency, producing widely differing levels of quality for the same cost. CONCLUSIONS: Differences among POs in the efficiency with which they produce quality suggest opportunities for improvements in care delivery that increase quality without increasing spending.

Misclassification Risk of Tier-Based Physician Quality Performance Systems.

OBJECTIVE: There is increasing interest in identifying high-quality physicians, such as whether physicians perform above or below a threshold level. To evaluate whether current methods accurately distinguish above- versus below-threshold physicians, we estimate misclassification rates for two-category identification systems. DATA SOURCES: Claims data for Medicare fee-for-service beneficiaries residing in Florida or New York in 2010. STUDY DESIGN: Estimate colorectal cancer, glaucoma, and diabetes quality scores for 23,085 physicians. Use a beta-binomial model to estimate physician score reliabilities. Compute the proportion of physicians whose performance tier would be misclassified under three scoring systems. PRINCIPAL FINDINGS: In the three scoring systems, misclassification ranges were 8.6-25.7 percent, 6.4-22.8 percent, and 4.5-21.7%. True positive rate ranges were 72.9-97.0 percent, 83.4-100.0 percent, and 34.7-88.2 percent. True negative rate ranges were 68.5-91.6 percent, 10.5-92.4 percent, and 81.1-99.9 percent. Positive predictive value ranges were 70.5-91.6 percent, 77.0-97.3 percent, and 55.2-99.1 percent. CONCLUSIONS: Current methods for profiling physicians on quality may produce misleading results, as the number of eligible events is typically small. Misclassification is a policy-relevant measure of the potential impact of tiering on providers, payers, and patients. Quantifying misclassification rates should inform the construction of high-performance networks and quality improvement initiatives.

Quality of Care for PTSD and Depression in the Military Health System: Phase I Report.

The U.S. Department of Defense (DoD) strives to maintain a physically and psychologically healthy, mission-ready force, and the care provided by the Military Health System (MHS) is critical to meeting this goal. Given the rates of posttraumatic stress disorder (PTSD) and depression among U.S. service members, attention has been directed to ensuring the quality and availability of programs and services targeting these and other psychological health (PH) conditions. Understanding the current quality of care for PTSD and depression is an important step toward improving care across the MHS. To help determine whether service members with PTSD or depression are receiving evidence-based care and whether there are disparities in care quality by branch of service, geographic region, and service member characteristics (e.g., gender, age, pay grade, race/ethnicity, deployment history), DoD's Defense Centers of Excellence for Psychological Health and Traumatic Brain Injury (DCoE) asked the RAND Corporation to conduct a review of the administrative data of service members diagnosed with PTSD or depression and to recommend areas on which the MHS could focus its efforts to continuously improve the quality of care provided to all service members. This study characterizes care for service members seen by MHS for diagnoses of PTSD and/or depression and finds that while the MHS performs well in ensuring outpatient follow-up following psychiatric hospitalization, providing sufficient psychotherapy and medication management needs to be improved. Further, quality of care for PTSD and depression varied by service branch, TRICARE region, and service member characteristics, suggesting the need to ensure that all service members receive high-quality care.

A pilot study comparing in-person and web-based motivational interviewing among adults with a first-time DUI offense.

BACKGROUND: Driving under the influence (DUI) is a significant problem, and there is a pressing need to develop interventions that reduce future risk. METHODS: We pilot-tested the acceptance and efficacy of web-motivational interviewing (MI) and in-person MI interventions among a diverse sample of individuals with a first-time DUI offense. Participants (N = 159) were 65 percent male, 40 percent Hispanic, and an average age of 30 (SD = 9.8). They were enrolled at one of three participating 3-month DUI programs in Los Angeles County and randomized to usual care (UC)-only (36-h program), in-person MI plus UC, or a web-based intervention using MI (web-MI) plus UC. Participants were assessed at intake and program completion. We examined intervention acceptance and preliminary efficacy of the interventions on alcohol consumption, DUI, and alcohol-related consequences. RESULTS: Web-MI and in-person MI participants rated the quality of and satisfaction with their sessions significantly higher than participants in the UC-only condition. However, there were no significant group differences between the MI conditions and the UC-only condition in alcohol consumption, DUI, and alcohol-related consequences. Further, 67 percent of our sample met criteria for alcohol dependence, and the majority of participants in all three study conditions continued to report alcohol-related consequences at follow-up. CONCLUSIONS: Participants receiving MI plus UC and UC-only had similar improvements, and a large proportion had symptoms of alcohol dependence. Receiving a DUI and having to deal with the numerous consequences related to this type of event may be significant enough to reduce short-term behaviors, but future research should explore whether more intensive interventions are needed to sustain long-term changes.

Better-than-average and worse-than-average hospitals may not significantly differ from average hospitals: an analysis of Medicare Hospital Compare ratings.

BACKGROUND: Public report card designers aim to provide comprehensible provider performance information to consumers. Report cards often display classifications of providers into performance tiers that reflect whether performance is statistically significantly above or below average or not statistically significantly different from average. To further enhance the salience of public reporting to consumers, report card websites often allow a user to compare a subset of selected providers on tiered performance rather than direct statistical comparisons of the providers in a consumer's personal choice set. OBJECTIVE: We illustrate the differences in conclusions drawn about relative provider performance using tiers versus conducing statistical tests to assess performance differences. METHODS: Using publicly available cross-sectional data from Medicare Hospital Compare on three mortality and three readmission outcome measures, we compared each provider in the top or bottom performance tier with those in the middle tier and assessed the proportion of such comparisons that exhibited no statistically significant differences. RESULTS: Across the six outcomes, 1.3-6.1% of hospitals were classified in the top tier. Each top-tier hospital did not statistically significantly differ in performance from at least one mid-tier hospital. The percentages of mid-tier hospitals that were not statistically significantly different from a given top-tier hospital were 74.3-81.1%. The percentages of hospitals classified as bottom tier were 0.6-4.0%. Each bottom-tier hospital showed no statistically significant difference from at least one mid-tier hospital. The percentage of mid-tier hospitals that were not significantly different from a bottom-tier hospital ranged from 60.4% to 74.8%. CONCLUSIONS: Our analyses illustrate the need for further innovations in the design of public report cards to enhance their salience for consumers.

Continuous quality improvement (CQI) in addiction treatment settings: design and intervention protocol of a group randomized pilot study.

BACKGROUND: Few studies have designed and tested the use of continuous quality improvement approaches in community based substance use treatment settings. Little is known about the feasibility, costs, efficacy, and sustainment of such approaches in these settings. METHODS/DESIGN: A group-randomized trial using a modified stepped wedge design is being used. In the first phase of the study, eight programs, stratified by modality (residential, outpatient) are being randomly assigned to the intervention or control condition. In the second phase, the initially assigned control programs are receiving the intervention to gain additional information about feasibility while sustainment is being studied among the programs initially assigned to the intervention. DISCUSSION: By using this design in a pilot study, we help inform the field about the feasibility, costs, efficacy and sustainment of the intervention. Determining information at the pilot stage about costs and sustainment provides value for designing future studies and implementation strategies with the goal to reduce the time between intervention development and translation to real world practice settings.

Statistical benchmarks for health care provider performance assessment: a comparison of standard approaches to a hierarchical Bayesian histogram-based method.

OBJECTIVE: Examine how widely used statistical benchmarks of health care provider performance compare with histogram-based statistical benchmarks obtained via hierarchical Bayesian modeling. DATA SOURCES: Publicly available data from 3,240 hospitals during April 2009-March 2010 on two process-of-care measures reported on the Medicare Hospital Compare website. STUDY DESIGN: Secondary data analyses of two process-of-care measures comparing statistical benchmark estimates and threshold exceedance determinations under various combinations of hospital performance measure estimates and benchmarking approaches. PRINCIPAL FINDINGS: Statistical benchmarking approaches for determining top 10 percent performance varied with respect to which hospitals exceeded the performance benchmark; such differences were not found at the 50 percent threshold. Benchmarks derived from the histogram of provider performance under hierarchical Bayesian modeling provide a compromise between benchmarks based on direct (raw) estimates, which are overdispersed relative to the true distribution of provider performance and prone to high variance for small providers, and posterior mean provider performance, for which over-shrinkage and under-dispersion relative to the true provider performance distribution is a concern. CONCLUSIONS: Given the rewards and penalties associated with characterizing top performance, the ability of statistical benchmarks to summarize key features of the provider performance distribution should be examined.

Evaluating the impact of getting to outcomes-underage drinking on prevention capacity and alcohol merchant attitudes and selling behaviors.

Underage drinking is a significant problem facing US communities. Several environmental alcohol prevention (EAP) strategies (laws, regulations, responsible beverage service training and practices) successfully address underage drinking. Communities, however, face challenges carrying out these EAP strategies effectively. This small-scale, 3-year, randomized controlled trial assessed whether providing prevention coalitions with Getting To Outcomes-Underage Drinking (GTO-UD), a tool kit and implementation support intervention, helped improve implementation of two common EAP strategies, responsible beverage service training (RBS) and compliance checks. Three coalitions in South Carolina and their RBS and compliance check programs received the 16-month GTO-UD intervention, including the GTO-UD manual, training, and onsite technical assistance, while another three in South Carolina maintained routine operations. The measures, collected at baseline and after the intervention, were a structured interview assessing how well coalitions carried out their work and a survey of merchant attitudes and practices in the six counties served by the participating coalitions. Over time, the quality of some RBS and compliance check activities improved more in GTO-UD coalitions than in the control sites. No changes in merchant practices or attitudes significantly differed between the GTO-UD and control groups, although merchants in the GTO-UD counties did significantly improve on refusing sales to minors while control merchants did not.

The cost-effectiveness of depression treatment for co-occurring disorders: a clinical trial.

The authors aimed to determine the economic value of providing on-site group cognitive behavioral therapy (CBT) for depression to clients receiving residential substance use disorder (SUD) treatment. Using a quasi-experimental design and an intention-to-treat analysis, the incremental cost-effectiveness and cost-utility ratio of the intervention were estimated relative to usual care residential treatment. The average cost of a treatment episode was $908, compared to $180 for usual care. The incremental cost effectiveness ratio was $131 for each point improvement of the BDI-II and $49 for each additional depression-free day. The incremental cost-utility ratio ranged from $9,249 to $17,834 for each additional quality adjusted life year. Although the intervention costs substantially more than usual care, the cost effectiveness and cost-utility ratios compare favorably to other depression interventions. Health care reform should promote dissemination of group CBT to individuals with depression in residential SUD treatment.

The quality of mental health care for veterans of Operation Enduring Freedom/Operation Iraqi Freedom.

BACKGROUND: Some Operation Enduring Freedom/Operation Iraqi Freedom (OEF/OIF) veterans experience serious mental health (MH) problems. As OEF/OIF soldiers leave active military duty, their growing numbers pose a challenge to the Department of Veterans Affairs (VA) in delivering high-quality mental health/substance-use disorder (MH/SUD) care. OBJECTIVE: To determine whether the quality of MH/SUD care provided by the VA differs by OEF/OIF veteran status. METHODS: Veterans with selected MH/SUDs were identified from administrative records using diagnostic codes. OEF/OIF service was determined based on Defense Manpower Data Center separation files. Eleven processes of care and 7 utilization performance indicators were examined. Regression analyses were adjusted for veteran demographic and clinical characteristics to test for differences in care by OEF/OIF status. RESULTS: Of the 836,699 veterans with selected diagnoses who received MH/SUD treatment in FY2007, 52,870 (6.3%) were OEF/OIF veterans. In unadjusted analyses, OEF/OIF veterans were more likely to receive evidence-based care processes captured by 6 of the 11 dichotomous performance indicators examined; however, among those receiving psychotherapy encounters, OEF/OIF veterans received significantly fewer visits (6.9 vs. 9.7, P<0.0001). In adjusted analyses, only postdischarge follow-up remained meaningfully higher for OEF/OIF veterans. CONCLUSIONS: Efforts to maintain and/or increase OEF/OIF veteran participation in VA MH/SUD services should be informed by their characteristics, such as younger age and better physical health relative to other veterans.

The health effects of Medicare for the near-elderly uninsured.

OBJECTIVE: To determine whether Medicare enrollment at age 65 has an effect on the health trajectory of the near-elderly uninsured. DATA SOURCES: Eight biennial waves (1992-2006) of the Health and Retirement Study, a nationally representative panel survey of noninstitutionalized 51-61 year olds and their spouses. STUDY DESIGN: We use a quasi-experimental approach to compare the health effects of insurance for the near-elderly uninsured with previously insured contemporaneous controls. The primary outcome measure is overall self-reported health status combined with mortality (i.e., excellent to very good, good, fair to poor, dead). RESULTS: The change in the trajectory of overall health status for the previously uninsured that can be attributed to Medicare is small and not statistically significant. For every 100 persons in the previously uninsured group, joining Medicare is associated with 0.6 fewer in excellent or very good health (95 percent CI: -4.8, 3.3), 0.3 more in good health (95 percent CI: -3.8, 4.1), 2.5 fewer in fair or poor health (95 percent CI: -7.4, 2.3), and 2.8 more dead (-4.0, 10.0) by age 73. The health trajectory patterns from physician objective health measures are similarly small and not statistically significant. CONCLUSIONS: Medicare coverage at age 65 for the previously uninsured is not linked to improvements in overall health status.

Perceived barriers to treatment for adolescent depression.

BACKGROUND AND OBJECTIVE: Adolescent depression is common, disabling, and is associated with academic, social, behavioral, and health consequences. Despite the availability of evidence-based depression care, few teens receive it, even when recognized by primary care clinicians. Perceived barriers such as teen worry about what others think or parent concerns about cost and access to care may contribute to low rates of care. We sought to better understand perceived barriers and their impact on service use. DESIGN: After completing an eligibility and diagnostic telephone interview, all depressed teens and a matched sample of nondepressed teens recruited from 7 primary care practices were enrolled and completed telephone interviews at baseline and 6 months (August 2005-September 2006). PARTICIPANTS: Three hundred sixty-eight adolescent patients aged 13 to 17 (184 depressed and 184 nondepressed) and 338 of their parents. MEASURES: Perceived barriers to depression care and use of services for depression (psychotherapy and antidepressant medication). RESULTS: Teens with depression were significantly more likely to perceive barriers to care compared with nondepressed teens. Parents were less likely to report barriers than their teens; perceived stigma and concern about family member response were among the significant teen barriers. Teen perceived barriers scores were negatively associated with any use of antidepressants (P < 0.01), use of antidepressants for at least 1 month (P < 0.001), and any psychotherapy or antidepressant use (P < 0.05) at 6 months. CONCLUSIONS: To improve treatment for adolescent depression, interventions should address both teen and parent perceived barriers and primary care clinicians should elicit information from both adolescents and their parents.