Comparing risk prediction models aimed at predicting hospitalizations for adverse drug events in community dwelling older adults: a protocol paper.

Background The objective of this paper is to describe the creation, validation, and comparison of two risk prediction modeling approaches for community-dwelling older adults to identify individuals at highest risk for adverse drug event-related hospitalizations. One approach will use traditional statistical methods, the second will use a machine learning approach. Methods We will construct medication, clinical, health care utilization, and other variables known to be associated with adverse drug event-related hospitalizations. To create the cohort, we will include older adults (≥ 65 years of age) empaneled to a primary care physician within the Cedars-Sinai Health System primary care clinics with polypharmacy (≥ 5 medications) or at least 1 medication commonly implicated in ADEs (certain oral hypoglycemics, anti-coagulants, anti-platelets, and insulins). We will use a Fine-Gray Cox proportional hazards model for one risk modeling approach and DataRobot, a data science and analytics platform, to run and compare several widely used supervised machine learning algorithms, including Random Forest, Support Vector Machine, Extreme Gradient Boosting (XGBoost), Decision Tree, Naïve Bayes, and K-Nearest Neighbors. We will use a variety of metrics to compare model performance and to assess the risk of algorithmic bias. Discussion In conclusion, we hope to develop a pragmatic model that can be implemented in the primary care setting to risk stratify older adults to further optimize medication management.

Comparing Data Collected on Amazon's Mechanical Turk to National Surveys.

OBJECTIVE: In this study, we examined the impact of a range of methods to improve data quality on the demographic and health status representativeness of Amazon Mechanical Turk (MTurk) samples. METHODS: We developed and field-tested a general survey of health on MTurk in 2017 among 5755 participants and 2021 among 6752 participants. We collected information on participant demographic characteristics and health status and implemented different quality checks in 2017 and 2021. RESULTS: Adding data quality checks generally improves the representativeness of the final MTurk sample, but there are persistent differences in mental health and pain conditions, age, education, and income between the MTurk population and the broader US population. CONCLUSION: We conclude that data quality checks improve the data quality and representativeness.

Associations of pediatric nurse burnout with involvement in quality improvement.

PURPOSE: Burnout among nurses negatively impacts patient care experiences and safety. Inpatient pediatric nurses are high-risk for burnout due to high patient volumes, inadequate staffing, and needing to balance the demands of patients, families and team members. We examined the associations of inpatient pediatric nurse burnout with their perspectives on the importance of quality at the hospital, patient experience measurement, quality improvement (QI), unit culture, and staffing. METHODS: We conducted a cross-sectional study at an urban children's hospital. We surveyed pediatric nurses about their perspectives including the single-item Maslach Burnout Inventory. We fit separate regression models, controlling for role, location and unit, predicting outcome measures from the dichotomized burnout scale. RESULTS: Twenty-seven percent of pediatric nurses reported burnout. Nurses who had more confidence in patient experience measurement, received frequent patient experience performance reports, felt included in QI, and experienced QI efforts as integrated into patient care reported not being burned out (compared to those reporting burnout; all p-values<0.05). More open communication among nurses (e.g., about possible problems with care) and unit-level teamwork were also associated with not being burned out, whereas a larger QI workload was associated with burnout (p-values<0.05). CONCLUSIONS: Open communication among nurses and nurses being more involved and valued in QI efforts were related to not being burned out. Research is needed to further examine aspects of QI involvement that reduce burnout. PRACTICE IMPLICATIONS: Supporting open communication among pediatric nurses, engaging them in QI and integrating QI into patient care while minimizing QI workload may decrease burnout.

Access to Health Care Among TRICARE-Covered Children.

TRICARE, the U.S. Department of Defense insurance program for eligible service members and their dependents, provides health care coverage to nearly 2 million children under the age of 18. Survey data and prior evaluations indicate that TRICARE-covered children face challenges in accessing pediatric health care, with the greatest challenges among children who have experienced frequent relocations and children with special health care needs. However, TRICARE has not measured pediatric patient experiences in accessing care since 2010. To fill this gap, RAND researchers analyzed national survey data on the experiences of caregivers of TRICARE-covered children and children with commercial insurance, public insurance, and no insurance to identify differences in access to pediatric care, necessary referrals, care coordination support, ability to pay medical bills, and other factors. Additional analyses highlight variations between children with different TRICARE plans, between children who have changed addresses more and less frequently, and between children with special health care needs and those without. The findings should help inform efforts to increase access to care for children across the Military Health System, as well as improvements to programs designed to support military families during relocations and those with children who have special health care needs.

Definitions of Chronic Low Back Pain From a Scoping Review, and Analyses of Narratives and Self-Reported Health of Adults With Low Back Pain.

Among those with low back pain (LBP), individuals with chronic LBP (CLBP) face different treatment recommendations and incur the majority of suffering and costs. However, the way CLBP has been defined varies greatly. This study used a scoping review and qualitative and quantitative analyses of data from LBP patients to explore this variation. CLBP in most recent randomized controlled trials (RCTs) was defined by duration of pain, most commonly ≥3 months. However, individuals with LBP most often define CLBP by frequency. CLBP has also been defined using a combination of duration and frequency (16% of RCTs and 20% of individuals), including 6% of recent RCTs that followed the NIH Pain Consortium research task force (RTF) definition. Although not a defining characteristic of CLBP for individuals, almost 15% of recent RCTs required CLBP to have a healthcare provider diagnosis. In our LBP sample moving from ≥3 months to the RTF definition reduced the CLBP group size by 25% and resulted in a group that used more pain management options and reported worse health across all outcome measures. A pain duration definition offers ease of application. However, refinements to this definition (eg, RTF) can identify those who may be better intervention targets. Perspective: This article presents the definitions used for CLBP by researchers and individuals, and the impact of these definitions on pain management and health outcomes. This information may help researchers choose better study inclusion criteria and clinicians to better understand their patients' beliefs about CLBP.

Equity as a Guiding Principle for the Public Health Data System.

The growing centering of equity in health has elevated a conversation about how those interests should translate within the systems and sectors that influence health. In particular, the public health data system has been relatively limited in capturing the drivers and consequences of health inequity as well as the varying dimensions of equity. This article examines what it means to use equity as a guiding principle throughout the components and functions of a modern public health data system. As with other articles in this supplement, this article builds from a literature review, environmental scan, and deliberations from the National Commission to Transform Public Health Data Systems to summarize current gaps to integrate equity throughout the system. It outlines opportunities for the technology and data science sectors specifically to engage given the access that these sectors have to information that would illuminate and frame the nuances and impacts of health inequity.

What Data Should Be Included in a Modern Public Health Data System.

The public is inundated with data, both in where data are ubiquitously collected and in how organizations are using data to drive public sector and commercial decisions. The public health data system is no exception to this flood of data, both in growing data volume and variety. However, what are collected and analyzed about the health status of the nation, how particular data and measures are prioritized for parsimony, and how those data provide a signal for where to invest to address health inequities are in dire need of a reboot. As with other articles in this supplement, this article builds from a literature review, an environmental scan, and deliberations from the National Commission to Transform Public Health Data Systems. The article summarizes what data should be included and identifies where the technology and data sectors can contribute to fill current gaps to measure equity, positive health, and well-being.

The Issues of Interoperability and Data Connectedness for Public Health.

An unprecedented amount of data is being collected across a diversity of sectors, which, if harnessed, could transform public health decision-making. Yet significant challenges stand in the way of such a vision, including the need to establish standards of data sharing and interoperability, the need for innovation in both methodological approaches and workforce models, and the need for data stewardship and governance models to ensure the protection and integrity of the public health data system. As with other articles in this supplement, this article builds from a literature review, environmental scan, and deliberations from the National Commission to Transform Public Health Data Systems. The article summarizes some of the challenges around data sharing and reuse and identifies where the technology and data sectors can contribute to fill current gaps to promote interoperability and data stewardship.

Technology and Data Implications for the Public Health Workforce.

Achieving a modern equity-oriented public health system requires the development of a public health workforce with the skills and competencies needed to generate findings and integrate knowledge using diverse data. Yet current workforce capabilities and infrastructure are misaligned with what is needed to harness both new and older forms of data and to translate them into information that is equity contextualized. As with other articles in this supplement, this article builds from a literature review, environmental scan, and deliberations from the National Commission to Transform Public Health Data Systems. The article summarizes some of the challenges around current workforce capabilities and pipeline. The article identifies where the technology and data sectors can contribute skills, expertise, and assets in support of innovative workforce models and augment the development of public health workforce competencies.

Crosswalking the National Institutes of Health Impact Stratification Score to the PEG.

OBJECTIVE: To crosswalk the National Institutes of Health (NIH) Pain Consortium's Research Task Force proposed Impact Stratification Score (ISS) to the PEG (Pain Intensity, Interference With Enjoyment of Life, Interference With General Activity) Scale. DESIGN: Cross-sectional data collected in 2021. Ordinary least squares regression analyses of ISS and PEG. SETTING: Amazon Mechanical Turk workers. PARTICIPANTS: 1931 adults with back pain with an average age of 41 (range, 19-77); 48% were female, 16% Hispanic, 7% non-Hispanic Black, 5% non-Hispanic Asian, and 71% non-Hispanic White (N=1931). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: The Patient-Reported Outcomes Measurement Information System (PROMIS)-29+2 v2.1 survey that includes the ISS, and the 3-item PEG. RESULTS: The ISS and PEG had a correlation coefficient of 0.74. The ISS accounted for 55% of the adjusted variance in the PEG and the standardized average deviation between observed and predicted scores (normalized mean absolute error) was 0.53. Likewise, the PEG explained 55% of the variance in the ISS with a normalized mean absolute error of 0.52. CONCLUSIONS: This study provides a crosswalk between the ISS and PEG that can be used to predict one from the other. The regression equations can facilitate comparisons in studies that use different measures.

A Process Evaluation of Primary Care Behavioral Health Integration in the Military Health System.

Behavioral health (BH) problems are common in the military and can adversely affect force readiness. Research suggests that primary care-behavioral health (PCBH) integration can improve BH outcomes by making high-quality BH care available in more accessible settings. However, sustaining high-quality implementation of PCBH is challenging. The authors conducted a process evaluation of the PCBH program in the military health system to understand why the program is working as it is and provide recommendations for quality improvement. They conducted semistructured interviews, rigorously coded the qualitative data to identify causal links, and created and validated causal loop diagrams that provide a visualization of how the system is working. Findings fall into four key areas: staffing and capabilities, valued tasks, program stewardship, and fostering program awareness and support. Overall, the authors found that the PCBH program is highly valued by primary care staff. However, the PCBH care model is inconsistently adhered to, owing to a combination of staff preferences, local pressures, and lack of knowledge of PCBH staff roles. Recommendations are offered to improve program implementation.

Health Services and Primary Care Research Study: Comprehensive Report.

This study presents the results of a congressionally mandated, independent assessment of federally funded health services research (HSR) and primary care research (PCR) spanning the U.S. Department of Health and Human Services (HHS) and U.S. Department of Veterans Affairs (VA) from FYs 2012 to 2018. Through technical expert panels, stakeholder interviews, and a systematic environmental scan of research grants and contracts funded by HHS and the VA, the authors characterize the distinct contributions of agencies in these departments to the federal HSR and PCR enterprise. The authors also identify opportunities to improve detection and coordination of overlap in agency research portfolios, the impacts of HSR and PCR and how they cumulate across research portfolios, and gaps in research funding, methods, and dissemination. The authors offer recommendations to maximize the outcomes and value of future investments in federal HSR and PCR to better guide and serve the needs of a complex and rapidly changing U.S. health care system.

New York State 1115 Demonstration Independent Evaluation: Interim Report.

The broad goals of New York State's Medicaid Section 1115 Waiver are to enroll a majority of Medicaid beneficiaries into managed care, increase access and service quality, and expand coverage to more low-income New Yorkers. The RAND Corporation was competitively selected as the independent evaluator to assess two components under this 1115 Demonstration Waiver: the Managed Long-Term Care (MLTC) program and the 12-month continuous eligibility policy, which guarantees enrollees Medicaid coverage regardless of changes in income in the 12 months after eligibility determination and enrollment. This final interim evaluation examines whether these two components have helped achieve the program's goals. The RAND team's analyses show that the Demonstration has expanded access to managed care through mandatory MLTC enrollment and 12-month continuous eligibility. The team found no evidence of a significant change in patient safety or quality of care. The authors note that, although this means that there is no evidence the Demonstration achieved the goal of improving quality of care, increasing access without compromising quality of care is a success in its own right.

Motivations of potential anchor businesses to support community development and community health.

INTRODUCTION: Some for-profit businesses act like non-profit anchor institutions in contributing to community development, particularly health-related initiatives. Their motives are not well understood. We aimed to 1) identify and describe potential anchor businesses, 2) determine their motivations to contribute to community development, and 3) highlight motivations behind health-related initiatives. MATERIALS AND METHODS: We identified a national sample of potential anchor businesses, grouped by those that contributed to 1) both health-related and non-health initiatives, 2) non-health initiatives only, and 3) those without substantial contributions. We conducted an environmental scan, semi-structured qualitative interviews and directed content analysis through rapid review methodology. RESULTS: We identified 4,512 potential anchor businesses nationally. Among the 108 of these included in the environmental scan, 48% substantially contributed to community development (12% in health). Interviewees' company philosophies ranged from the idea that economic well-being of the company and community were intertwined, to the idea that commercial success of the company would benefit the community. Motivations for contributions included improving the hiring pool, improved recruitment and retention, and goodwill. Other common sentiments included strategies to focus on core business strengths to address community needs and a desire that companies should not compete in their giving activities. Further, some participants believed health care companies should be investing in health-related initiatives. CONCLUSIONS: The generosity of potential anchor businesses' local contributions may be determined by company philosophy about its relationship with the community. Stakeholders interested in spurring contributions to local communities might consider messaging to leverage businesses' core strengths and encourage cooperation.

Summary of the 2020 AHRQ research meeting on 'advancing methods of implementing and evaluating patient experience improvement using consumer assessment of healthcare providers and systems (CAHPS®) surveys'.

BACKGROUND: The Agency for Healthcare Research and Quality held a research meeting on using Consumer Assessment of Healthcare Providers and Systems (CAHPS®) data for quality improvement (QI) and evaluating such efforts. TOPICS COVERED.: Meeting addressed: 1)What has been learned about organizational factors/environment needed to improve patient experience? 2)How have organizations used data to improve patient experience? 3)What can evaluations using CAHPS data teach us about implementing successful programs to improve patient experience? KEY THEMES: Providers and stakeholders need to be engaged early and often, standardize QI processes, complement CAHPS data with other data, and compile dashboards of CAHPS scores to identify and track improvement. Rigorous study designs are valuable, but much can be learned and accomplished through practical organization-level studies.

Harmonizing units and values of quantitative data elements in a very large nationally pooled electronic health record (EHR) dataset.

OBJECTIVE: The goals of this study were to harmonize data from electronic health records (EHRs) into common units, and impute units that were missing. MATERIALS AND METHODS: The National COVID Cohort Collaborative (N3C) table of laboratory measurement data-over 3.1 billion patient records and over 19 000 unique measurement concepts in the Observational Medical Outcomes Partnership (OMOP) common-data-model format from 55 data partners. We grouped ontologically similar OMOP concepts together for 52 variables relevant to COVID-19 research, and developed a unit-harmonization pipeline comprised of (1) selecting a canonical unit for each measurement variable, (2) arriving at a formula for conversion, (3) obtaining clinical review of each formula, (4) applying the formula to convert data values in each unit into the target canonical unit, and (5) removing any harmonized value that fell outside of accepted value ranges for the variable. For data with missing units for all the results within a lab test for a data partner, we compared values with pooled values of all data partners, using the Kolmogorov-Smirnov test. RESULTS: Of the concepts without missing values, we harmonized 88.1% of the values, and imputed units for 78.2% of records where units were absent (41% of contributors' records lacked units). DISCUSSION: The harmonization and inference methods developed herein can serve as a resource for initiatives aiming to extract insight from heterogeneous EHR collections. Unique properties of centralized data are harnessed to enable unit inference. CONCLUSION: The pipeline we developed for the pooled N3C data enables use of measurements that would otherwise be unavailable for analysis.

Trends In Hospital Prices Paid By Private Health Plans Varied Substantially Across The US.

Commercial health plans pay higher prices than public payers for hospital care, which accounts for more than 5 percent of US gross domestic product. Crafting effective policy responses requires monitoring trends and identifying sources of variation. Relying on data from the Healthcare Provider Cost Reporting Information System, we describe how commercial hospital payment rates changed relative to Medicare rates during 2012-19 and how trends differed by hospital referral region (HRR). We found that average commercial-to-Medicare price ratios were relatively stable, but trends varied substantially across HRRs. Among HRRs with high price ratios in 2012, ratios increased by 38 percentage points in regions in the top quartile of growth and decreased by 38 percentage points in regions in the bottom quartile. Our findings suggest that restraining the growth rate of HRR commercial hospital price ratios to the national average during our sample period would have reduced aggregate spending by $39 billion in 2019.

Protecting the mental and physical well-being of frontline health care workers during COVID-19: Study protocol of a cluster randomized controlled trial.

INTRODUCTION: The COVID-19 pandemic has placed health care workers at unprecedented risk of stress, burnout, and moral injury. This paper describes the design of an ongoing cluster randomized controlled trial to compare the effectiveness of Stress First Aid (SFA) to Usual Care (UC) in protecting the well-being of frontline health care workers. METHODS: We plan to recruit a diverse set of hospitals and health centers (eight matched pairs of hospitals and six pairs of centers), with a goal of approximately 50 HCW per health center and 170 per hospital. Participating sites in each pair are randomly assigned to SFA or UC (i.e., whatever psychosocial support is currently being received by HCW). Each site identified a leader to provide organizational support of the study; SFA sites also identified at least one champion to be trained in the intervention. Using a "train the trainer" model, champions in turn trained their peers in selected HCW teams or units to implement SFA over an eight-week period. We surveyed HCW before and after the implementation period. The primary outcomes are posttraumatic stress disorder and general psychological distress; secondary outcomes include depression and anxiety symptoms, sleep problems, social functioning problems, burnout, moral distress, and resilience. In addition, through in-depth qualitative interviews with leaders, champions, and HCW, we assessed the implementation of SFA, including acceptability, feasibility, and uptake. DISCUSSION: Results from this study will provide initial evidence for the application of SFA to support HCW well-being during a pandemic. TRIAL REGISTRATION: (Clinicaltrials.govNCT04723576).

Content and Actionability of Recommendations to Providers After Shadow Coaching.

BACKGROUND AND OBJECTIVES: Health care organizations track patient experience data, identify areas of improvement, monitor provider performance, and assist providers in improving their interactions with patients. Some practices use one-on-one provider counseling ("shadow coaching") to identify and modify provider behaviors. A recent evaluation of a large shadow coaching program found statistically significant improvements in coached providers' patient experience scores immediately after being coached. This study aimed to examine the content of the recommendations given to those providers aimed at improving provider-patient interactions, characterize these recommendations, and examine their actionability. METHODS: Providers at a large, urban federally qualified health center were selected for coaching based on Clinician and Group Consumer Assessment of Healthcare Providers and Systems (CG-CAHPS) patient experience scores (92 of 320 providers), shadowed by a trained peer coach for a half to full day and received recommendations on how to improve interactions with their patients. We coded 1082 recommendations found in the 92 coaching reports. RESULTS: Reports contained an average of 12 recommendations. About half encouraged consistency of existing behaviors and half encouraged new behaviors. Most recommendations related to behaviors of the provider rather than support staff and targeted actions within the examination room rather than other spaces (eg, waiting room). The most common recommendations mapped to behavioral aspects of provider communication. Most recommendations targeted verbal rather than nonverbal communication behaviors. Most recommendations were actionable (ie, specific, descriptive), with recommendations that encouraged new behaviors being more actionable than those that encouraged existing actions. CONCLUSIONS: Patient experience surveys are effective at identifying where improvement is needed but are not always informative enough to instruct providers on how to modify and improve their interactions with patients. Analyzing the feedback given to coached providers as part of an effective shadow-coaching program provides details about implementation on shadow-coaching feedback. Recommendations to providers aimed at improving their interactions with patients need to not only suggest the exact behaviors defined within patient experience survey items but also include recommended behaviors indirectly associated with those measured behaviors. Attention needs to be paid to supplementing patient experience data with explicit, tangible, and descriptive (ie, actionable) recommendations associated with the targeted, measured behaviors. Research is needed to understand how recommendations are put into practice by providers and what motivates and supports them to sustain changed behaviors.

Worker and employer experiences with COVID-19 and the California Workers' Compensation System: A review of the literature.

BACKGROUND: Given workplace risks from COVID-19, California policymakers passed Senate Bill (SB) 1159 to facilitate access to workers' compensation (WC) benefits for frontline workers. However there has been no review of the available evidence needed to inform policy decisions about COVID-19 and WC. METHODS: We conducted a literature review on worker and employer experiences surrounding COVID-19 and WC, adhering to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. RESULTS: Forty articles were included (16 about worker experiences and 24 about employer practices). Most were not about experiences and practices related to COVID-19 and WC. Worker studies indicated that paid sick leave reduced new COVID-19 cases and COVID-19 activity. Studies also found that rural agricultural and food processing workers lacked sick leave protection and faced severe housing and food insecurity. Studies on workplace health and safety indicated that healthcare workers with access to personal protective equipment had lower stress levels. Studies about employer practices found that unrestricted work in high-contact industries was associated with increased risks to at-risk workers, and with health disparities. No studies examined worker COVID-19 experiences and WC claims or benefits, job loss, retaliation, workers' medical care experiences, and return-to-work or leave practices. CONCLUSIONS: Our review identified experiences and practice related to COVID-19 and the WC system, but not specifically about WC and COVID-19 WC claims or benefits. Further research is needed to document and understand evidence underpinning the need for WC coverage for COVID-19 and to evaluate the impact of the current SB 1159 bill on WC in California.