Associations of Primary Care Provider Burnout with Quality Improvement, Patient Experience Measurement, Clinic Culture, and Job Satisfaction.

BACKGROUND: Burnout among providers negatively impacts patient care experiences and safety. Providers at Federally Qualified Health Centers (FQHC) are at high risk for burnout due to high patient volumes; inadequate staffing; and balancing the demands of patients, families, and team members. OBJECTIVE: Examine associations of provider burnout with their perspectives on quality improvement (QI), patient experience measurement, clinic culture, and job satisfaction. DESIGN: We conducted a cross-sectional provider survey about their perspectives including the single-item burnout measure. We fit separate regression models, controlling for provider type, gender, being multilingual, and fixed effects for clinic predicting outcome measures from burnout. PARTICIPANTS: Seventy-four providers from 44 clinics in large, urban FQHC (52% response rate; n = 174). MAIN MEASURES: Survey included a single-item, self-defined burnout measure adapted from the Physician Worklife Survey, and measures from the RAND AMA Study survey, Heath Tracking Physician survey, TransforMed Clinician and Staff Questionnaire, Physician Worklife Survey, Minimizing Errors Maximizing Outcomes survey, and surveys by Friedberg et al. 31 and Walling et al. 32 RESULTS: Thirty percent of providers reported burnout. Providers in clinics with more facilitative leadership reported not being burned out (compared to those reporting burnout; p-values < 0.05). More pressures related to patient care and lower job satisfaction were associated with burnout (p-values < 0.05). CONCLUSIONS: Creating provider-team relationships and environments where providers have the time and space necessary to discuss changes to improve care, ideas are shared, leadership supports QI, and QI is monitored and discussed were related to not being burned out. Reducing time pressures and improving support needed for providers to address the high-need levels of FQHC patients can also decrease burnout. Such leadership and support to improving care may be a separate protective factor against burnout. Research is needed to further examine which aspects of leadership drive down burnout and increase provider involvement in change efforts and improving care.

The PROMIS-16 reproduces the PROMIS-29 physical and mental health summary scores accurately in a probability-based internet panel.

PURPOSE: The Patient-Reported Outcomes Measurement Information System® (PROMIS)-16 assesses the same multi-item domains but does not include the pain intensity item in the PROMIS-29. We evaluate how well physical and mental health summary scores estimated from the PROMIS-16 reproduce those estimated using the PROMIS-29. METHODS: An evaluation of data collected from 4130 respondents from the KnowledgePanel. Analyses include confirmatory factor analysis to assess physical and mental health latent variables based on PROMIS-16 scores, reliability estimates for the PROMIS measures, mean differences and correlations of scores estimated by the PROMIS-16 with those estimated by the PROMIS-29, and associations between differences in corresponding PROMIS-16 and PROMIS-29 scores by sociodemographic characteristics. RESULTS: A two-factor (physical and mental health) model adequately fits the PROMIS-16 scores. Reliability estimates for the PROMIS-16 measures were slightly lower than for the PROMIS-29 measures. There were minimal differences between PROMIS physical and mental health summary scores estimated using the PROMIS-16 or the PROMIS-29. PROMIS-16 and PROMIS-29 score differences by sociodemographic characteristics were small. Using the PROMIS pain intensity item when scoring the PROMIS-16 produced similar estimates of physical and mental health summary scores. CONCLUSION: The PROMIS-16 provides similar estimates of the PROMIS-29 physical and mental health summary scores. The high reliability of these scores indicates they are accurate enough for use with individual patients.

Crosswalking Four Pain Impact Measures in a Nationally Representative Sample of Adults with Back Pain.

OBJECTIVE: To generate crosswalk equations and tables for four pain impact measures: the Impact Stratification Score (ISS), Oswestry Disability Index (ODI), Roland-Morris Disability Questionnaire (RMDQ), and the Pain, Enjoyment of Life and General Activity Scale (PEG). DESIGN: Cross-sectional survey assessing demographics and pain impact. Crosswalks were developed using item response theory (IRT) co-calibrations and linear regressions between the ISS, ODI, RMDQ, and PEG. SETTING: Online panel. PARTICIPANTS: Population-based sample of U.S. adults aged 18 and older. Eligibility criteria were reporting currentback pain, not reporting two fake health conditions, and having data for two or more pain measures (N = 1,530; 37% of sample). Crosswalks were developed (n = 1,030) and cross-validated in a sub-sample of 500 participants (n = 125 randomly sampled from each ISS quartile). INTERVENTIONS: Not Applicable. MAIN OUTCOME MEASURES: ISS, ODI, RMDQ, and the PEG. RESULTS: Associations of the ISS with the PEG and ODI met the criteria for IRT co-calibration. Other measure pairs were cross-walked using regression. Associations were strongest between the PEG and the ISS (r = 0.87, Normalized Mean Absolute Error [NMAE] = 0.38) and between the ODI and the ISS (r = 0.85, NMAE = 0.39). Associations were weakest between the PEG and the RMDQ (r = 0.69, R2 = 0.48, NMAE: 0.55-0.58). Regression equations and IRT accounted for between 48% to 64% of the variance (NMAE: 0.38-0.58) in corresponding pain measures in the cross-validation sample. CONCLUSION: The crosswalks between the ISS and common legacy pain measures created in this study of a nationally representative sample of U.S. adults with back pain can be used to estimate one pain impact measure from another. Further evaluation in clinical samples is recommended.

A Comparative Analysis of the Demographics and Zip Codes of Patients Seen at the Indiana University Student Outreach Clinic.

Within a small geographic area, Marion County contains a stark spectrum of health outcomes and socioeconomic statuses. The Indiana University Student Outreach Clinic (IUSOC) serves as a safety net provider, offering free health and social services in the Near Eastside neighborhood of Indianapolis. The aim of this study was to characterize the demographics and geographic distribution of the IUSOC's patient population. From January to September 2023, 612 patients visited the IUSOC, and 460 self-identified as Marion County residents. 63.9% of patients were between 45 and 64 years old. 66.8% were Non-Hispanic (NH) Black, and 23.3% were Hispanic. 18.9% spoke Spanish and had limited English proficiency. Based on the Distressed Communities Index (DCI), 58.7% lived in "Distressed" zip codes, indicating economic vulnerability and disparities. The zip code with the greatest number of IUSOC patients had the highest rate of uninsured adults in Marion County. IUSOC patients are primarily middle-aged minorities who live in zip codes with low socioeconomic rankings by DCI. This information can be used to improve community resource referral pathways in the clinic.

Narrative comments about pediatric inpatient experiences yield substantial information beyond answers to closed-ended CAHPS survey questions.

PURPOSE: Adults' comments on patient experience surveys explain variation in provider ratings, with negative comments providing more actionable information than positive comments. We investigate if narrative comments on the Consumer Assessment of Healthcare Providers and Systems (CAHPS®) survey of inpatient pediatric care (Child HCAHPS) account for global perceptions of the hospital beyond that explained by reports about specific aspects of care. METHODS: We analyzed 545 comments from 927 Child HCAHPS surveys completed by parents and guardians of hospitalized children with at least a 24-h hospital stay from July 2017 to December 2020 at an urban children's hospital. Comments were coded for valence (positive/negative/mixed) and actionability and used to predict Overall Hospital Rating and Willingness to Recommend the Hospital along with Child HCAHPS composite scores. RESULTS: Comments were provided more often by White and more educated respondents. Negative comments and greater actionability of comments were significantly associated with Child HCAHPS global rating measures, controlling for responses to closed-ended questions, and child and respondent characteristics. Each explained an additional 8% of the variance in respondents' overall hospital ratings and an additional 5% in their willingness to recommend the hospital. CONCLUSIONS: Child HCAHPS narrative comment data provide significant additional information about what is important to parents and guardians during inpatient pediatric care beyond closed-ended composites. PRACTICE IMPLICATIONS: Quality improvement efforts should include a review of narrative comments alongside closed-ended responses to help identify ways to improve inpatient care experiences. To promote health equity, comments should be encouraged for racial-and-ethnic minority patients and those with less educational attainment.

Follow-Up Shadow Coaching Improves Primary Care Provider-Patient Interactions and Maintains Improvements When Conducted Regularly: A Spline Model Analysis.

INTRODUCTION: Shadow coaching improves provider-patient interactions, as measured by CG-CAHPS® overall provider rating (OPR) and provider communication (PC). However, these improvements erode over time. AIM: Examine whether a second coaching session (re-coaching) improves and sustains patient experience. SETTING: Large, urban Federally Qualified Health Center PROGRAM: Trained providers observed patient care by colleagues and provided suggestions for improvement. Providers with OPRs<90 (0-100-point scale) were eligible. EVALUATION: We used stratified randomization based on provider type and OPR to assign half of the 40 eligible providers to re-coaching. For OPR and PC, we fit mixed-effects regression models with random-effects for provider (level of treatment assignment) and fixed-effects for time (linear spline with knots and possible "jump" at initial coaching and re-coaching), previous OPR, patient characteristics, and sites. We observed a statistically significant medium jump among re-coached providers after re-coaching on OPR (3.7 points) and PC (3.5 points); differences of 1, 3, and ≥5-points for CAHPS measures are considered small, medium, and large. Improvements from re-coaching persisted for 12 months for OPR and 8 months for PC. DISCUSSION: Re-coaching improved patient experience more than initial coaching, suggesting the reactivation of knowledge from initial coaching. However, re-coaching gains also eroded. Coaching should occur every 6 to 12 months to maintain behaviors and scores.

Shadow Coaching Improves Patient Experience for English-Preferring Patients but not for Spanish-Preferring Patients.

BACKGROUND: Shadow coaching, a type of one-on-one provider counseling by trained peers, is an effective strategy for improving provider behaviors and patient interactions, but its effects on improving patient experience for English- and Spanish-preferring patients is unknown. OBJECTIVE: Assess effects of shadow coaching on patient experience for English- and for Spanish-preferring patients. DESIGN: We analyzed 2012-2019 Clinician and Group Consumer Assessment of Healthcare Providers and Systems (CG-CAHPS) data (n=46,089) from an urban Federally Qualified Health Center with 44 primary care practices and 320 providers. One-third (n=14,631) were Spanish-preferring patients. We fit mixed-effects regression models with random effects for provider (the level of treatment assignment) and fixed effects for time (a linear spline for time with a knot and "jump" at coaching date), patient characteristics, and site indicators, stratified by preferred language. PARTICIPANTS: The 74 providers who had a 6-month average top-box score on the CAHPS overall provider rating below 90 (on a 100-point scale) were shadow coached. Similar percentages of English-preferring (45%) and Spanish-preferring patients (43%) were seen by coached providers. INTERVENTION: Trained providers observed patient care by colleagues and provided suggestions for improvement. Verbal feedback was provided immediately after the observation and the participant received a written report summarizing the comments and recommendations from the coaching session. MAIN MEASURES: CG-CAHPS Visit Survey 2.0 provider communication composite and overall provider rating (0-100 scoring). KEY RESULTS: We found a statistically significant 2-point (small) jump in CAHPS provider communication and overall provider rating among English-preferring patients of coached providers. There was no evidence of a coaching effect on patient experience for Spanish-preferring patients. CONCLUSIONS: Coaching improved care experiences for English-preferring patients but may not have improved patient experience for Spanish-preferring patients. Selection and training of providers to communicate effectively with Spanish-preferring patients is needed to extend the benefits of shadow coaching to Spanish-preferring patients.

Crosswalking the National Institutes of Health Impact Stratification Score to the PEG.

OBJECTIVE: To crosswalk the National Institutes of Health (NIH) Pain Consortium's Research Task Force proposed Impact Stratification Score (ISS) to the PEG (Pain Intensity, Interference With Enjoyment of Life, Interference With General Activity) Scale. DESIGN: Cross-sectional data collected in 2021. Ordinary least squares regression analyses of ISS and PEG. SETTING: Amazon Mechanical Turk workers. PARTICIPANTS: 1931 adults with back pain with an average age of 41 (range, 19-77); 48% were female, 16% Hispanic, 7% non-Hispanic Black, 5% non-Hispanic Asian, and 71% non-Hispanic White (N=1931). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: The Patient-Reported Outcomes Measurement Information System (PROMIS)-29+2 v2.1 survey that includes the ISS, and the 3-item PEG. RESULTS: The ISS and PEG had a correlation coefficient of 0.74. The ISS accounted for 55% of the adjusted variance in the PEG and the standardized average deviation between observed and predicted scores (normalized mean absolute error) was 0.53. Likewise, the PEG explained 55% of the variance in the ISS with a normalized mean absolute error of 0.52. CONCLUSIONS: This study provides a crosswalk between the ISS and PEG that can be used to predict one from the other. The regression equations can facilitate comparisons in studies that use different measures.

Classifying patients with non-specific chronic low back pain using the impact stratification score in an online convenience sample.

BACKGROUND: In 2014, the National Institute of Health Pain Consortium's research task force (RTF) on research standards for chronic low back pain (CLBP) proposed the Impact Stratification Score (ISS) as a patient-reported outcome measure that could stratify patients by the impact CLBP has on their lives. This work compares three newly developed ISS-based classifications to the RTF's original to provide an optimal recommendation. METHODS: The online sample included 1226 individuals from Amazon's Mechanical Turk who indicated having non-specific CLBP, average age of 40, 49% female, and 67% White. Participants completed the PROMIS-29 v2.1 profile survey that contains the 9 ISS items as well the Roland-Morris Disability Questionnaire (RMDQ) and Graded Chronic Pain Scale (GCPS). Other items included high-impact chronic pain; not working due to health problems; overall health; and number of healthcare visits for back pain in the past 6 months. Three new classifications were created using quartiles (Classification 2), latent profile analysis (Classification 3), and one modeled after the GCPS (Classification 4). Classifications were subsequently compared to the RTF-proposed classification (Classification 1) on several concurrent and prognostic criteria. RESULTS: Classification 1 had three CLBP severity groups, four in Classification 2, three in Classification 3, and four in Classification 4. All novel classifications improved upon the original. Classification 2 performed best at minimizing the classification of those with negative outcomes into the lowest severity groups at baseline (e.g., 11% with RMDQ ≥ 7) and 6 months (e.g., 8.2% had fair/poor health). Classification 4 performed best at maximizing classification of those with negative outcomes into the most severe group concurrently (e.g., 100% had GCPS grade ≥ 2) and at 6 months (e.g., 100% with RMDQ ≥ 7). CONCLUSIONS: We developed three ISS-based classification schemes and tested them against several outcomes. All three improved upon the original scheme. While appearing more optimal than other classifications in the lowest severity groups, Classification 2 presents some considerations and limitations. Given that Classification 4 was an improvement at the lowest end of severity and was the best at the highest end, it is our tentative recommendation that this approach be adopted to classify individuals with non-specific CLBP.

Associations of pediatric nurse burnout with involvement in quality improvement.

PURPOSE: Burnout among nurses negatively impacts patient care experiences and safety. Inpatient pediatric nurses are high-risk for burnout due to high patient volumes, inadequate staffing, and needing to balance the demands of patients, families and team members. We examined the associations of inpatient pediatric nurse burnout with their perspectives on the importance of quality at the hospital, patient experience measurement, quality improvement (QI), unit culture, and staffing. METHODS: We conducted a cross-sectional study at an urban children's hospital. We surveyed pediatric nurses about their perspectives including the single-item Maslach Burnout Inventory. We fit separate regression models, controlling for role, location and unit, predicting outcome measures from the dichotomized burnout scale. RESULTS: Twenty-seven percent of pediatric nurses reported burnout. Nurses who had more confidence in patient experience measurement, received frequent patient experience performance reports, felt included in QI, and experienced QI efforts as integrated into patient care reported not being burned out (compared to those reporting burnout; all p-values<0.05). More open communication among nurses (e.g., about possible problems with care) and unit-level teamwork were also associated with not being burned out, whereas a larger QI workload was associated with burnout (p-values<0.05). CONCLUSIONS: Open communication among nurses and nurses being more involved and valued in QI efforts were related to not being burned out. Research is needed to further examine aspects of QI involvement that reduce burnout. PRACTICE IMPLICATIONS: Supporting open communication among pediatric nurses, engaging them in QI and integrating QI into patient care while minimizing QI workload may decrease burnout.

Shadow Coaching Improves Patient Experience With Care, But Gains Erode Later.

BACKGROUND: Health care organizations strive to improve patient care experiences. Some use one-on-one provider counseling (shadow coaching) to identify and target modifiable provider behaviors. OBJECTIVE: We examined whether shadow coaching improves patient experience across 44 primary care practices in a large urban Federally Qualified Health Center. RESEARCH DESIGN: Seventy-four providers with "medium" (ie, slightly below average) overall provider ratings received coaching and were compared with 246 uncoached providers. We fit mixed-effects regression models with random effects for provider (level of treatment assignment) and fixed effects for time (linear spline with a knot and "jump" at coaching date), patient characteristics and site indicators. By design, coached providers performed worse at selection; models account for the very small (0.2 point) regression-to-the-mean effects. We assessed differential effects by coach. SUBJECTS: A total of 46,452 patients (from 320 providers) who completed the Clinician and Group Consumer Assessment of Healthcare Providers and Systems (CG-CAHPS) Visit Survey 2.0. MEASURES: CAHPS overall provider rating and provider communication composite (scaled 0-100). RESULTS: Providers not chosen for coaching had a nonsignificant change in performance during the period when selected providers were coached. We observed a statistically significant 2-point (small-to-medium) jump among coached providers after coaching on the CAHPS overall provider rating and provider communication score. However, these gains disappeared after 2.5 years; effects differed by coach. CONCLUSIONS: Shadow coaching improved providers' overall performance and communication immediately after being coached. Regularly planned shadow coaching "booster" sessions might maintain or even increase the improvement gained in patient experience scores, but research examining additional coaching and optimal implementation is needed.

Assessing the Significance of Individual Change in 2 Samples of Patients in Treatment for Low Back Pain Using 5 Different Statistical Indicators.

OBJECTIVE: The purpose of this study was to estimate the significance of individual change using 5 statistical indicators in 2 samples of patients treated for low back pain. METHODS: This secondary analysis used observational and clinical trial data from 2 samples of patients with low back pain to compare 5 ways of estimating significant individual change on the Impact Stratification Score (ISS) administered at the following 2 time points: 3 months apart in an observational study of 1680 patients undergoing chiropractic care, and 6 weeks apart in a randomized trial of 750 active-duty military personnel with low back pain. The following 5 methods were compared: (1) standard deviation index; (2) standard error of measurement (SEM); (3) standard error of estimate (SEE); (4) standard error of prediction (SEP); and (5) the reliable change index (RCI). The ISS is the sum of the Patient-Reported Outcomes Measurement Information System (PROMIS)-29 v2.1 physical function, pain interference, and pain intensity scores and is scored to have a possible range of 8 (least impact) to 50 (greatest impact). RESULTS: The amount of change on the ISS needed for significant individual change in both samples was 5 for the SEM and for the SEE and 7 for the SEP and RCI. CONCLUSIONS: The results of the current study provide some preliminary support for use of the SEP or the RCI to identify significant individual change and provide estimated thresholds of individual change that can be used for the ISS. The SEP and RCI estimates of significant change were consistent with retrospective ratings of change of at least moderately better in prior research. These 2 were less likely than other methods to classify people with low back pain as responders who have not actually gotten better (false positive). In contrast, the SEM and SEE were less likely to miss real change (false negative).

Robust estimation of the causal effect of time-varying neighborhood factors on health outcomes.

The fundamental difficulty of establishing causal relationships between an exposure and an outcome in observational data involves disentangling causality from confounding factors. This problem underlies much of neighborhoods research, which abounds with studies that consider associations between neighborhood characteristics and health outcomes in longitudinal data. Such analyses are confounded by selection issues; individuals with above average health outcomes (or associated characteristics) may self-select into advantaged neighborhoods. Techniques commonly used to assess causal inferences in observational longitudinal data, such as inverse probability of treatment weighting (IPTW), may be inappropriate in neighborhoods data due to unique characteristics of such data. We advance the IPTW toolkit by introducing a procedure based on a multivariate kernel density function which is more appropriate for neighborhoods data. The proposed weighting method is applied in conjunction with a marginal structural model. Our empirical analyses use longitudinal data from the Health and Retirement Study; our exposure of interest is an index of neighborhood socioeconomic status (NSES), and we examine its influence on cognitive function. Our findings illustrate the importance of the choice of method for IPTW-the comparison weighting methods provide poor balance across the set of covariates (which is not the case for our preferred procedure) and yield misleading results when applied in the outcomes models. The utility of the multivariate kernel is also validated via simulation. In addition, our findings emphasize the importance of IPTW-controlling for covariates within a regression without IPTW indicates that NSES affects cognition, whereas IPTW-weighted models fail to show a statistically significant effect.

A Cluster-Randomized Trial of Getting To Outcomes' Impact on Sexual Health Outcomes in Community-Based Settings.

The USA has high teen pregnancy rates compared to other developed nations. Many community-based organizations need assistance conducting evidence-based teen pregnancy prevention programs (EBPs) appropriately. This study evaluated the impact of an implementation support intervention called Getting To Outcomes (GTO) designed to help such organizations. This cluster randomized controlled trial compared 16 Boys and Girls Clubs (BGCs) implementing a teen pregnancy prevention EBP called Making Proud Choices for two years, with 16 BGCs implementing MPC augmented with GTO training, tools, and technical assistance. Participating middle school youth were compared on proximal outcomes (knowledge, attitudes, and intentions about sex and condoms from baseline to post) and sexual behaviors (frequency of sex and condom use, from baseline to 6-month follow-up). In year 1, there were no significant effects of GTO for any proximal outcome. After GTO-stimulated quality improvement in year 2, the GTO group improved significantly more on condom attitudes and use intentions. Frequency of sex and condom use did not differ between the two groups in either year; however, base rates of these behaviors in the sample were very low. Findings suggest that in typical community-based settings, detailed manuals and training common to structured EBPs may be sufficient to yield some improvement in key proximal outcomes, but that more systematic implementation support is needed to achieve greater improvement in these outcomes. Using GTO with many communities, as currently supported by various federal agencies, could yield public health impact via improvements in condom attitudes and use intentions.

Engagement in HIV Prevention Advocacy Associated with Increased Consistent Condom Use Among HIV Clients in Uganda.

We examined whether engagement in prevention advocacy among HIV clients is associated with their own condom use and HIV care adherence. Longitudinal data merged from three studies in Uganda produced a sample of 1,882 participants who were administered assessments at baseline and months 6 and 12. The measure of prevention advocacy was the mean of two Likert scale items assessing encouragement of others to (1) use condoms, and (2) get HIV tested. In regression analyses controlling for demographics and known correlates of the dependent variables, increased prevention advocacy from baseline to month 12 was significantly associated with increased consistent condom use and marginally associated with increased antiretroviral adherence and clinic attendance. These results suggest that empowering HIV clients to engage in prevention advocacy with others may benefit their own HIV protective behaviors and should be promoted as a component to interventions targeting positive living among people living with HIV.

Changes in condom use during the first year of HIV treatment in Uganda and the relationship to depression.

PURPOSE: We examined the effect of antiretroviral therapy (ART), and the predictive role of depression, on condom use with primary partners. METHODS: Data from three studies in Uganda were combined into a sample of 750 patients with a primary sex partner, with 502 starting ART and 248 entering HIV care, and followed for 12 months. Random-effects logistic regression models were used to examine the impact of ART, and the influence of baseline level and change in depression, on condom use with primary partners. RESULTS: At month 12, 61 % ART and 67 % non-ART patients were consistent condom users, compared to 44 and 41 % at baseline, respectively. Multivariate analysis revealed that consistent condom use increased similarly for ART and non-ART patients, and that minor depression at baseline and increased depression over time predicted inconsistent condom use. CONCLUSIONS: Improved depression diagnosis and treatment could benefit HIV prevention.

The role of depression in work-related outcomes of HIV treatment in Uganda.

PURPOSE: The primary goal of this analysis was to examine the influence of depression above and beyond the effects of HIV treatment on work activity and function. METHODS: We combined data from three longitudinal studies of patients starting antiretroviral therapy (ART) and/or entering HIV care in Uganda. Assessments were conducted at baseline and months 6 and 12. The nine-item Patient Health Questionnaire (PHQ-9) was used to assess depressive symptoms, as well as Major (scores >9) and Minor (scores 5-9) Depression status; work functioning was assessed using a subscale of the Medical Outcomes Study HIV Health Survey (MOS-HIV). Multivariate random-effects logistic regression models for longitudinal data were used to examine the impact of treatment on work status and optimal work functioning, with measures of both baseline and change in physical health functioning, cognitive functioning and depression in the models, controlling for baseline demographics, and CD4 cell count. RESULTS: The sample of 1,731 participants consisted of 1,204 starting ART and 527 not yet eligible for ART. At baseline, 35 % were not working, and 37 % had sub-optimal work functioning. Intention-to-treat analyses revealed that those on ART experienced greater improvement in both work outcomes over 12 months relative to non-ART patients, and that baseline and change in physical health functioning, continuous and categorical depression were all independently associated with improvement in both work outcomes, even after accounting for the direct effect of ART. CONCLUSIONS: Improvement in physical and mental health plays a key role in the positive impact of HIV treatment on work activity and function, suggesting potential economic benefits of integrating depression treatment into HIV care.

A tutorial on propensity score estimation for multiple treatments using generalized boosted models.

The use of propensity scores to control for pretreatment imbalances on observed variables in non-randomized or observational studies examining the causal effects of treatments or interventions has become widespread over the past decade. For settings with two conditions of interest such as a treatment and a control, inverse probability of treatment weighted estimation with propensity scores estimated via boosted models has been shown in simulation studies to yield causal effect estimates with desirable properties. There are tools (e.g., the twang package in R) and guidance for implementing this method with two treatments. However, there is not such guidance for analyses of three or more treatments. The goals of this paper are twofold: (1) to provide step-by-step guidance for researchers who want to implement propensity score weighting for multiple treatments and (2) to propose the use of generalized boosted models (GBM) for estimation of the necessary propensity score weights. We define the causal quantities that may be of interest to studies of multiple treatments and derive weighted estimators of those quantities. We present a detailed plan for using GBM to estimate propensity scores and using those scores to estimate weights and causal effects. We also provide tools for assessing balance and overlap of pretreatment variables among treatment groups in the context of multiple treatments. A case study examining the effects of three treatment programs for adolescent substance abuse demonstrates the methods.

Evaluation of a protocol for eliciting narrative accounts of pediatric inpatient experiences of care.

OBJECTIVE: To evaluate the measurement properties of a set of six items designed to elicit narrative accounts of pediatric inpatient experience. DATA SOURCES: Data came from 163 participants recruited from a probability-based online panel of U.S. adults. Participants were family members of a child who had an overnight hospital stay in the past 12 months. STUDY DESIGN: Cross-sectional survey with follow-up phone interviews. DATA COLLECTION/EXTRACTION METHODS: Participants completed an online (n = 129) or phone (n = 34) survey about their child's hospitalization experience. The survey contained closed-ended items from the Child Hospital Consumer Assessment of Healthcare Providers and Systems (Child HCAHPS) survey, followed by the six narrative items. Approximately 2 weeks after completing the survey, 47 participants additionally completed a one-hour, semi-structured phone interview, the results of which served as a "gold standard" for evaluating the fidelity of narrative responses. Qualitative content analysis was used to code narrative and interview responses for domains of patient experience and actionability. PRINCIPAL FINDINGS: The average narrative was 248 words (SD = 319). Seventy-nine percent of narratives mentioned a topic included in the Child HCAHPS survey; 89% mentioned a topic not covered by that survey; and 75% included at least one detailed description of an actionable event. Overall, there was 66% correspondence between narrative and interview responses. Correspondence was higher on the phone than in the online condition (75% vs. 59%). CONCLUSIONS: Narratives elicited from rigorously designed multi-item sets can provide detailed, substantive information about pediatric inpatient experiences that hospitals could use to improve child and family experiences during pediatric hospitalization. They add context to closed-ended survey item responses and provide information about experiences of care important to children and families that are not included in quantitative surveys.

Development of items to assess patients' health literacy experiences at hospitals for the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Hospital Survey.

BACKGROUND: The complexity of health information frequently exceeds patients' skills to understand and use it. Improvement in hospital communication has the potential to improve the quality of care. OBJECTIVE: To develop a set of items to supplement the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Hospital Survey (HCAHPS) to assess how well hospitals communicate health information to inpatients. METHODS: We conducted an environmental scan and obtained input from stakeholders to identify domains and survey items, and cognitively tested the item set in English and Spanish. We administered the items to a random sample of adult hospital patients using mail and telephone data collection. We estimate item-scale correlations for hypothesized multi-item composites, internal consistency reliability for composites, correlations among composites, and regressed global rating of the hospital and a would you recommend the hospital items on HCAHPS existing core and the new composites to evaluate the unique contribution of each to these "bottom-line" measures. RESULTS: A total of 1013 surveys were obtained (55% response rate). With some exceptions, correlations between items and scales were consistent with the hypothesized item clusters. Three composites were identified: (1) communication about tests; (2) communication about how to care for self and medicines; and (3) communication about forms. CONCLUSIONS: This study provides support for the measurement properties of the HCAHPS Item Set for Addressing Health Literacy. It can serve as both a measure of whether healthcare providers in a hospital setting have communicated effectively with their patients and as a tool for quality improvement.