Associations of Primary Care Provider Burnout with Quality Improvement, Patient Experience Measurement, Clinic Culture, and Job Satisfaction.

BACKGROUND: Burnout among providers negatively impacts patient care experiences and safety. Providers at Federally Qualified Health Centers (FQHC) are at high risk for burnout due to high patient volumes; inadequate staffing; and balancing the demands of patients, families, and team members. OBJECTIVE: Examine associations of provider burnout with their perspectives on quality improvement (QI), patient experience measurement, clinic culture, and job satisfaction. DESIGN: We conducted a cross-sectional provider survey about their perspectives including the single-item burnout measure. We fit separate regression models, controlling for provider type, gender, being multilingual, and fixed effects for clinic predicting outcome measures from burnout. PARTICIPANTS: Seventy-four providers from 44 clinics in large, urban FQHC (52% response rate; n = 174). MAIN MEASURES: Survey included a single-item, self-defined burnout measure adapted from the Physician Worklife Survey, and measures from the RAND AMA Study survey, Heath Tracking Physician survey, TransforMed Clinician and Staff Questionnaire, Physician Worklife Survey, Minimizing Errors Maximizing Outcomes survey, and surveys by Friedberg et al. 31 and Walling et al. 32 RESULTS: Thirty percent of providers reported burnout. Providers in clinics with more facilitative leadership reported not being burned out (compared to those reporting burnout; p-values < 0.05). More pressures related to patient care and lower job satisfaction were associated with burnout (p-values < 0.05). CONCLUSIONS: Creating provider-team relationships and environments where providers have the time and space necessary to discuss changes to improve care, ideas are shared, leadership supports QI, and QI is monitored and discussed were related to not being burned out. Reducing time pressures and improving support needed for providers to address the high-need levels of FQHC patients can also decrease burnout. Such leadership and support to improving care may be a separate protective factor against burnout. Research is needed to further examine which aspects of leadership drive down burnout and increase provider involvement in change efforts and improving care.

Associations of pediatric nurse burnout with involvement in quality improvement.

PURPOSE: Burnout among nurses negatively impacts patient care experiences and safety. Inpatient pediatric nurses are high-risk for burnout due to high patient volumes, inadequate staffing, and needing to balance the demands of patients, families and team members. We examined the associations of inpatient pediatric nurse burnout with their perspectives on the importance of quality at the hospital, patient experience measurement, quality improvement (QI), unit culture, and staffing. METHODS: We conducted a cross-sectional study at an urban children's hospital. We surveyed pediatric nurses about their perspectives including the single-item Maslach Burnout Inventory. We fit separate regression models, controlling for role, location and unit, predicting outcome measures from the dichotomized burnout scale. RESULTS: Twenty-seven percent of pediatric nurses reported burnout. Nurses who had more confidence in patient experience measurement, received frequent patient experience performance reports, felt included in QI, and experienced QI efforts as integrated into patient care reported not being burned out (compared to those reporting burnout; all p-values<0.05). More open communication among nurses (e.g., about possible problems with care) and unit-level teamwork were also associated with not being burned out, whereas a larger QI workload was associated with burnout (p-values<0.05). CONCLUSIONS: Open communication among nurses and nurses being more involved and valued in QI efforts were related to not being burned out. Research is needed to further examine aspects of QI involvement that reduce burnout. PRACTICE IMPLICATIONS: Supporting open communication among pediatric nurses, engaging them in QI and integrating QI into patient care while minimizing QI workload may decrease burnout.

Robust estimation of the causal effect of time-varying neighborhood factors on health outcomes.

The fundamental difficulty of establishing causal relationships between an exposure and an outcome in observational data involves disentangling causality from confounding factors. This problem underlies much of neighborhoods research, which abounds with studies that consider associations between neighborhood characteristics and health outcomes in longitudinal data. Such analyses are confounded by selection issues; individuals with above average health outcomes (or associated characteristics) may self-select into advantaged neighborhoods. Techniques commonly used to assess causal inferences in observational longitudinal data, such as inverse probability of treatment weighting (IPTW), may be inappropriate in neighborhoods data due to unique characteristics of such data. We advance the IPTW toolkit by introducing a procedure based on a multivariate kernel density function which is more appropriate for neighborhoods data. The proposed weighting method is applied in conjunction with a marginal structural model. Our empirical analyses use longitudinal data from the Health and Retirement Study; our exposure of interest is an index of neighborhood socioeconomic status (NSES), and we examine its influence on cognitive function. Our findings illustrate the importance of the choice of method for IPTW-the comparison weighting methods provide poor balance across the set of covariates (which is not the case for our preferred procedure) and yield misleading results when applied in the outcomes models. The utility of the multivariate kernel is also validated via simulation. In addition, our findings emphasize the importance of IPTW-controlling for covariates within a regression without IPTW indicates that NSES affects cognition, whereas IPTW-weighted models fail to show a statistically significant effect.

Engagement in HIV Prevention Advocacy Associated with Increased Consistent Condom Use Among HIV Clients in Uganda.

We examined whether engagement in prevention advocacy among HIV clients is associated with their own condom use and HIV care adherence. Longitudinal data merged from three studies in Uganda produced a sample of 1,882 participants who were administered assessments at baseline and months 6 and 12. The measure of prevention advocacy was the mean of two Likert scale items assessing encouragement of others to (1) use condoms, and (2) get HIV tested. In regression analyses controlling for demographics and known correlates of the dependent variables, increased prevention advocacy from baseline to month 12 was significantly associated with increased consistent condom use and marginally associated with increased antiretroviral adherence and clinic attendance. These results suggest that empowering HIV clients to engage in prevention advocacy with others may benefit their own HIV protective behaviors and should be promoted as a component to interventions targeting positive living among people living with HIV.

Changes in condom use during the first year of HIV treatment in Uganda and the relationship to depression.

PURPOSE: We examined the effect of antiretroviral therapy (ART), and the predictive role of depression, on condom use with primary partners. METHODS: Data from three studies in Uganda were combined into a sample of 750 patients with a primary sex partner, with 502 starting ART and 248 entering HIV care, and followed for 12 months. Random-effects logistic regression models were used to examine the impact of ART, and the influence of baseline level and change in depression, on condom use with primary partners. RESULTS: At month 12, 61 % ART and 67 % non-ART patients were consistent condom users, compared to 44 and 41 % at baseline, respectively. Multivariate analysis revealed that consistent condom use increased similarly for ART and non-ART patients, and that minor depression at baseline and increased depression over time predicted inconsistent condom use. CONCLUSIONS: Improved depression diagnosis and treatment could benefit HIV prevention.

A tutorial on propensity score estimation for multiple treatments using generalized boosted models.

The use of propensity scores to control for pretreatment imbalances on observed variables in non-randomized or observational studies examining the causal effects of treatments or interventions has become widespread over the past decade. For settings with two conditions of interest such as a treatment and a control, inverse probability of treatment weighted estimation with propensity scores estimated via boosted models has been shown in simulation studies to yield causal effect estimates with desirable properties. There are tools (e.g., the twang package in R) and guidance for implementing this method with two treatments. However, there is not such guidance for analyses of three or more treatments. The goals of this paper are twofold: (1) to provide step-by-step guidance for researchers who want to implement propensity score weighting for multiple treatments and (2) to propose the use of generalized boosted models (GBM) for estimation of the necessary propensity score weights. We define the causal quantities that may be of interest to studies of multiple treatments and derive weighted estimators of those quantities. We present a detailed plan for using GBM to estimate propensity scores and using those scores to estimate weights and causal effects. We also provide tools for assessing balance and overlap of pretreatment variables among treatment groups in the context of multiple treatments. A case study examining the effects of three treatment programs for adolescent substance abuse demonstrates the methods.

Usefulness of Child HCAHPS Survey Data for Improving Inpatient Pediatric Care Experiences.

OBJECTIVES: Quality improvement (QI) requires data, indicators, and national benchmarks. Knowledge about the usefulness of Child Hospital Consumer Assessment of Healthcare Providers and Systems (Child HCAHPS) data are lacking. We examined quality leader and frontline staff perceptions about patient experience measurement and use of Child HCAHPS data for QI. METHODS: We surveyed children's hospital leaders and staff about their use of Child HCAHPS for QI, including measures from other studies. We compared scale and item means for leaders and staff and compared means to other studies. RESULTS: Almost all leaders, but only one-third of staff, received reports with Child HCAHPS data. Leaders found the data more useful for comparisons to other hospitals than did staff. Both agreed on the validity of Child HCAHPS scores and used these data for improving pediatric care experiences. They agreed the data accurately reflect their hospital's quality of care, provide specific information for QI, and can be used to improve pediatric care experiences. They also agreed on approaches to improve Child HCAHPS scores. Among staff, QI was reported as essential to their daily work and that Child HCAHPS data were integral to QI. CONCLUSIONS: As uptake of the Child HCAHPS survey increases, our study of one medium-sized, urban children's hospital revealed that leaders and staff believe Child HCAHPS provides actionable metrics for improvement. Our study fills a gap in research about the use of Child HCAHPS for pediatric QI. A multisite evaluation would provide further information about how the Child HCAHPS survey can improve care.

Do improvements in substance use and mental health symptoms during treatment translate to long-term outcomes in the opposite domain?

Providers who treat adolescents with co-occurring substance use and mental health issues may prioritize treatment of one set of symptoms believing that improvements in one domain will result in improvements of the other. However, limited empirical data for adolescents provide evidence of such "spillover effects." Using data from 2900 youth in an outpatient treatment, we examined whether during-treatment changes in substance use or mental health symptoms predicted 12-month outcomes in the analogous and opposite domains. There was very little evidence of spillover effects, only that youth with no internal distress at 0 and 3 months reported lower levels of substance use problems at 12-months relative to youth with internal distress that stayed the same from 0 to 3 months. These findings suggest that providers treat both sets of substance use and mental health symptoms in an integrated manner given that these symptoms commonly co-occur among youth with either set.

An intervention to improve program implementation: findings from a two-year cluster randomized trial of Assets-Getting To Outcomes.

BACKGROUND: Studies have shown that communities have not always been able to implement evidence-based prevention programs with quality and achieve outcomes demonstrated by prevention science. Implementation support interventions are needed to bridge this gap between science and practice. The purpose of this article is to present two-year outcomes from an evaluation of the Assets Getting To Outcomes (AGTO) intervention in 12 Maine communities engaged in promoting Developmental Assets, a positive youth development approach to prevention. AGTO is an implementation support intervention that consists of: a manual of text and tools; face-to-face training, and onsite technical assistance, focused on activities shown to be associated with obtaining positive results across any prevention program. METHODS: This study uses a nested and cross-sectional, cluster randomized controlled design. Participants were coalition members and program staff from 12 communities in Maine. Each coalition nominated up to five prevention programs to participate. At random, six coalitions and their respective 30 programs received the two-year AGTO intervention and the other six maintained routine operations. The study assessed prevention practitioner capacity (efficacy and behaviors), practitioner exposure to and use of AGTO, practitioner perceptions of AGTO, and prevention program performance. Capacity of coalition members and performance of their programs were compared between the two groups across the baseline, one-, and two-year time points. RESULTS: We found no significant differences between AGTO and control group's prevention capacity. However, within the AGTO group, significant differences were found between those with greater exposure to and use of AGTO. Programs that received the highest number of technical assistance hours showed the most program improvement. CONCLUSIONS: This study is the first of its kind to show that use of an implementation support intervention-AGTO -yielded improvements in practitioner capacity and consequently in program performance on a large sample of practitioners and programs using a randomized controlled design. CLINICALTRIALS.GOV IDENTIFIER: NCT00780338.

Understanding variations in Medicare Consumer Assessment of Health Care Providers and Systems scores: California as an example.

OBJECTIVE: To understand reasons why California has lower Consumer Assessment of Healthcare Providers and Systems (CAHPS) scores than the rest of the country, including differing patterns of CAHPS scores between Medicare Advantage (MA) and fee-for-service, effects of additional demographic characteristics of beneficiaries, and variation across MA plans within California. STUDY DESIGN/DATA COLLECTION: Using 2008 CAHPS survey data for fee-for-service Medicare beneficiaries and MA members, we compared mean case mix adjusted Medicare CAHPS scores for California and the remainder of the nation. PRINCIPAL FINDINGS: California fee-for-service Medicare had lower scores than non-California fee-for-service on 11 of 14 CAHPS measures; California MA had lower scores only for physician services measures and higher scores for other measures. Adding race/ethnicity and urbanity to risk adjustment improved California standing for all measures in both MA and fee-for-service. Within the MA plans, one large plan accounted for the positive performance in California MA; other California plans performed below national averages. CONCLUSIONS: This study shows that the mix of fee-for-service and MA enrollees, demographic characteristics of populations, and plan-specific factors can all play a role in observed regional variations. Anticipating value-based payments, further study of successful MA plans could generate lessons for enhancing patient experience for the Medicare population.

Long-term effect of community-based treatment: evidence from the Adolescent Outcomes Project.

A growing literature on adolescent drug treatment interventions demonstrates the efficacy of "research therapies," but few rigorous studies examine the effectiveness of community-based treatments that are more commonly available to and utilized by youths and their families, the criminal justice system and other referring agencies. Even less is known about the long-term effects of these community-based treatments. This study evaluates the effects 72-102 months after intake to a widely disseminated community-based treatment model, residential therapeutic community treatment, using data from RAND's Adolescent Outcomes Project. Weighting is used to control for pre-existing differences between adolescent probationers disposed to Phoenix Academy and those assigned to one of six alternative group homes serving as the comparison conditions. Although Phoenix Academy therapeutic community treatment had positive effects on substance use and psychological functioning during the first 12 months following intake, we find no evidence of positive long-term effects on 16 outcomes measuring substance use and problems, criminal activity, institutionalization, psychological functioning and general functioning. We discuss the implications of these findings and the failure to maintain the effects observed during the first year follow-up.