Developing AHRQ's Feasibility Assessment Criteria for Wide-Scale Implementation of Patient-Centered Outcomes Research Findings.

BACKGROUND: The Agency for Healthcare Research and Quality's (AHRQ) Patient-Centered Outcomes Research (PCOR) Dissemination and Implementation (D&I) Initiative identifies and prioritizes PCOR findings that could improve health care if widely implemented. To inform PCOR implementation investments, AHRQ sought to assess feasibility of widely implementing impactful PCOR findings with good strength of evidence in clinical practice. OBJECTIVE: To develop criteria to assess the feasibility of widely implementing nominated PCOR findings. METHODS: We reviewed literature and interviewed thirteen D&I experts to identify factors affecting feasibility of implementing PCOR findings. We grouped similar factors into themes. Fourteen technical expert panel (TEP) members discussed the face-validity and relative merits of the themes and additional factors, applied themes to fictional case studies, and prioritized themes for assessing feasibility. We developed criteria and guiding questions with a 3-point Likert scale. Seven D&I experts pilot-tested the criteria using sample nominations of PCOR findings. Experts represented diverse views of implementation from federal and state government agencies, research institutions, and quality improvement and advocacy organizations. KEY RESULTS: We developed a set of three essential criteria for AHRQ to assess feasibility of widely implementing PCOR findings to be widely implementable: (1) acceptability to the implementers; (2) generalizability, adaptability, and ease of implementing with fidelity; and (3) alignment with external policies and incentives. Two supplemental criteria, (1) the presence of a plan or toolkit supporting implementation, or (2) evidence supporting implementation outside the research setting, can enhance reviewers' confidence in the intervention's feasibility. Each criterion includes "guiding questions" to parse out specific components that could be more readily assessed. CONCLUSIONS: The criteria and guiding questions are a valuable tool for informing AHRQ's investment decisions regarding implementing PCOR findings. Although developed for AHRQ's needs, the criteria may help other funders and health care organizations determine the feasibility of implementing evidence-based practices.

Opportunities to Improve Informed Consent with AHRQ Training Modules.

BACKGROUND: Informed consent is a process of communication between clinician and patient that results in the patient's decision about whether to undergo a specific intervention. However, patients often do not understand the risks, benefits, and alternatives, even after signing a consent form. METHODS: Mixed-methods pilot test of two Agency for Healthcare Research and Quality (AHRQ) informed consent training modules implemented in four hospitals. Methods included staff and patient surveys, interviews, site visits, and pre- and posttests of the modules. RESULTS: A low proportion of clinicians reported using teach-back (40.0%) or high-quality decision aids (55.0%). Patients reported limited use of best practices, including being asked to teach-back (58.4%), having other options described (54.9%), viewing decision aids (37.4%), and finding the form very easy to understand (66.8%). Content of the training modules aligned well with identified deficiencies. Barriers to completing the modules included staff turnover, competing demands, and lack of accountability. Facilitators included committed champions with available time, motivation, and release time for staff to take modules. Knowledge increased for leaders (p <0.05) and staff (p <0.001) who completed the training modules. Hospitals reported the effects of piloting the modules included fostering dialogue and identifying opportunities for improvements, identifying and rectifying policy ambiguity and noncompliance, reinforcing the use of interpreter services, and using modules' strategies and tools to improve informed consent. CONCLUSION: Many opportunities exist for hospitals to improve their informed consent practices. AHRQ's two training modules, have face validity, addressed demonstrated deficiencies in hospitals' informed consent policies and processes, and stimulated improvement activity in motivated hospitals.

Designing Equitable Health Care Outreach Programs From Machine Learning Patient Risk Scores.

There is growing interest in ensuring equity and guarding against bias in the use of risk scores produced by machine learning and artificial intelligence models. Risk scores are used to select patients who will receive outreach and support. Inappropriate use of risk scores, however, can perpetuate disparities. Commonly advocated solutions to improve equity are nontrivial to implement and may not pass legal scrutiny. In this article, we introduce pragmatic tools that support better use of risk scores for more equitable outreach programs. Our model output charts allow modeling and care management teams to see the equity consequences of different threshold choices and to select the optimal risk thresholds to trigger outreach. For best results, as with any health equity tool, we recommend that these charts be used by a diverse team and shared with relevant stakeholders.

Males at the Tails: How Socioeconomic Status Shapes the Gender Gap.

We document that the female advantage in childhood behavioural and academic outcomes is driven by gender gaps at the extremes of the outcome distribution. Using unconditional quantile regression, we show that family socioeconomic status particularly influences boys' relative to girls' outcomes at the lower tails of the outcome distribution, precisely where gender gaps are most pronounced. These relationships are not explained by school or neighbourhood factors, or parents' differential treatment of boys. The disproportionate effect of socioeconomic status on boys at the tails substantially contributes to the gender gap in high school dropout.

Social support and dental utilization among children of Latina immigrants.

Latino children use fewer professional dental services and experience more dental decay than non-Hispanic White and non-Hispanic Black children. This study tested the association between four types of social support (information, influence, material aid, emotional aid) and dental use among children of Latina immigrants in North Carolina. Latina mothers age 15-44 years (N=174) were sampled from four counties using a multistage church-based sampling design. Each mother reported dental care use for her oldest child younger than 11 years of age. Instrumental aid (information) alone was not associated with dental care use, but receiving any of the other types of social support was associated with dental care use at the bivariate level (p<.01) and at the multivariate level (OR=3.13; 95% CI=1.67-5.87). Over half of the women (65.2%) received at least one of these forms of social support. Interventions expanding dental-related social support could help Latina immigrant mothers overcome barriers to dental care for their children.

Perceptions of quality of reproductive care services in Bolivia: use of photo prompts and surveys as an impetus for change.

Surveys are sometimes used to assess women's perceptions of the quality of reproductive health care, but less empowered women may feel uncomfortable expressing their views in this method. We demonstrate the use of a participatory approach, combining a standard survey with an innovative photonarrative method. Women in Cochabamba, Bolivia, were asked to participate in exit surveys (n = 108). A subsample did photonarratives (n = 20). The survey showed rural women had less access to care, but photonarratives revealed the cause - fear. Women asserted quality of care was high, but photonarratives contradicted survey results. Staff used photonarratives to select action items for quality improvement.

Strategies and cost of recruitment of middle-aged and older unmarried women in a cancer screening study.

OBJECTIVES: We compared strategies and costs associated with recruiting unmarried middle-aged and older women who partner with women (WPW) and women who partner with men (WPM) into an observational study about experiences with cancer screening. METHODS: We used targeted and respondent-driven sampling methods to recruit potential participants. Comparable recruitment strategies were used for WPW and WPM. RESULTS: During 25 months (June 1, 2003, through June 30, 2005), 773 women were screened for study eligibility; 630 were enrolled (213 WPW, 417 WPM). Average staff time spent for recruitment was 100 min per participant. There were no differences by partner gender in average recruitment time (WPW, 90 min; WPM, 100 min). Print media was the most efficient recruitment mode (time per participant: 10 min for WPW, 15 min for WPM). Recruitment costs differed by partner gender ($140 for WPW, $110 for WPM). Costs associated with print media were $10 per WPW and $20 per WPM. Recruitment through community events had higher costs ($490 per WPW, $275 per WPM) but yielded more women with less education and lower incomes, who identified as a racial or ethnic minority, and self-reported a disability. Compared with WPM, WPW had more education and higher incomes, but were less likely to identify as a racial minority and self-report a disability. CONCLUSIONS: There was a trade-off between cost and sample diversity for the different recruitment methods. The per-person costs were lowest for print media, but recruitment through community events ensured a more diverse representation of unmarried heterosexual and sexual minority women.

Use of preventive maternal and child health services by Latina women: a review of published intervention studies.

Some health indicators for Latinos tend to be more positive than socioeconomic status would predict. Yet, Latina women and their young children use fewer preventive health services and have a higher incidence of preventable diseases than non-Hispanic whites. The Institute of Medicine recently called for intervention research among minority subgroups to end racial and ethnic disparities in health care. To help guide future intervention research, this article presents a critique and synthesis of the peer-reviewed literature on interventions that enroll Latina women into preventive reproductive health services (prenatal care, cervical cancer screening, and child immunizations). Results are presented according to three categories of interventions: improvements within formal health care settings, outreach through lay health advisors (promotoras) and media, and interventions combining these approaches. An agenda for intervention research is proposed for preventive-care use by this population.

Evaluating Feasible and Referable Behavioral Counseling Interventions.

The U.S. Preventive Services Task Force (USPTF) recognizes that behaviors have a major impact on health and well-being. Currently, the USPSTF has 11 behavioral counseling intervention (BCI) recommendations. These BCIs can be delivered in a primary care setting or patients can be referred to other clinical or community programs. Unfortunately, many recommended BCIs are infrequently and ineffectually delivered, suggesting that more evidence is needed to understand which BCIs are feasible and referable. In response, the USPSTF convened an expert forum in 2013 to inform the evaluation of BCI feasibility. This manuscript reports on findings from the forum and proposes that researchers use several frameworks to help clinicians and the USPSTF evaluate which BCIs work under usual conditions. A key recommendation for BCI researchers is to use frameworks whose components can support dissemination and implementation efforts. These frameworks include the Template for Intervention Description and Replication (TIDieR), which helps describe the essential components of an intervention, and pragmatic frameworks like Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) or Pragmatic-Explanatory Continuum Indicator Summary (PRECIS), which help to report study design elements and outcomes. These frameworks can both guide the design of more-feasible BCIs and produce clearer feasibility evidence. Critical evidence gaps include a better understanding of which patients will benefit from a BCI, how flexible interventions can be without compromising effectiveness, required clinician expertise, necessary intervention intensity and follow-up, impact of patient and clinician intervention adherence, optimal conditions for BCI delivery, and how new care models will influence BCI feasibility.

Identifying and preventing medical errors in patients with limited English proficiency: key findings and tools for the field.

Since the 1999 Institute of Medicine (IOM) report To Err is Human, progress has been made in patient safety, but few efforts have focused on safety in patients with limited English proficiency (LEP). This article describes the development, content, and testing of two new evidence-based Agency for Healthcare Research and Quality (AHRQ) tools for LEP patient safety. In the content development phase, a comprehensive mixed-methods approach was used to identify common causes of errors for LEP patients, high-risk scenarios, and evidence-based strategies to address them. Based on our findings, Improving Patient Safety Systems for Limited English Proficient Patients: A Guide for Hospitals contains recommendations to improve detection and prevention of medical errors across diverse populations, and TeamSTEPPS Enhancing Safety for Patients with Limited English Proficiency Module trains staff to improve safety through team communication and incorporating interpreters in the care process. The Hospital Guide was validated with leaders in quality and safety at diverse hospitals, and the TeamSTEPPS LEP module was field-tested in varied settings within three hospitals. Both tools were found to be implementable, acceptable to their audiences, and conducive to learning. Further research on the impact of the combined use of the guide and module would shed light on their value as a multifaceted intervention.

Factors affecting adoption and implementation of AHRQ health literacy tools in pharmacies.

BACKGROUND: Pharmacies are key sources of medication information for patients, yet few effectively serve patients with low health literacy. The Agency for Healthcare Research and Quality (AHRQ) supported the development of four health literacy tools for pharmacists to address this problem, and to help assess and improve pharmacies' health literacy practices. OBJECTIVES: This study aimed to understand the facilitators and barriers to the adoption and implementation of AHRQ's health literacy tools, particularly a tool to assess a pharmacy's health literacy practices. METHODS: We conducted a comparative, multiple-case study of eight pharmacies, guided by an adaptation of Rogers's Diffusion of Innovations model. Data were collected and triangulated through interviews, site visit observations, and the review of documents, and analyzed on the factors affecting pharmacies' adoption decisions and implementation of the tools. RESULTS: Factors important to pharmacies' decision to adopt the health literacy tools included awareness of health literacy; a culture of innovation; a change champion; the relative advantage and compatibility of the tools; and an invitation to utilize and receive support to use the tools. The barriers included a lack of leadership support, limited staff time, and a perception of the tools as complex with limited value. For implementation, the primary facilitators were buy-in from leadership, qualified staff, college-affiliated change champions, the adaptability and organization of the tool, and support. Barriers to implementation were limited leadership buy-in, prioritization of other activities, lack of qualified staff, and tool complexity. CONCLUSIONS: If pharmacists are provided tools that could ultimately improve their health literacy practices and patient-centered services; and the tools have a clear relative advantage, are simple as well adaptable, and the pharmacists are supported in their efforts - either by colleagues or by collaborating with colleges of pharmacy-then there could be important progress toward achieving the goals of the National Action Plan for Health Literacy.

Reduction in medication errors in hospitals due to adoption of computerized provider order entry systems.

OBJECTIVE: Medication errors in hospitals are common, expensive, and sometimes harmful to patients. This study's objective was to derive a nationally representative estimate of medication error reduction in hospitals attributable to electronic prescribing through computerized provider order entry (CPOE) systems. MATERIALS AND METHODS: We conducted a systematic literature review and applied random-effects meta-analytic techniques to derive a summary estimate of the effect of CPOE on medication errors. This pooled estimate was combined with data from the 2006 American Society of Health-System Pharmacists Annual Survey, the 2007 American Hospital Association Annual Survey, and the latter's 2008 Electronic Health Record Adoption Database supplement to estimate the percentage and absolute reduction in medication errors attributable to CPOE. RESULTS: Processing a prescription drug order through a CPOE system decreases the likelihood of error on that order by 48% (95% CI 41% to 55%). Given this effect size, and the degree of CPOE adoption and use in hospitals in 2008, we estimate a 12.5% reduction in medication errors, or ∼17.4 million medication errors averted in the USA in 1 year. DISCUSSION: Our findings suggest that CPOE can substantially reduce the frequency of medication errors in inpatient acute-care settings; however, it is unclear whether this translates into reduced harm for patients. CONCLUSIONS: Despite CPOE systems' effectiveness at preventing medication errors, adoption and use in US hospitals remain modest. Current policies to increase CPOE adoption and use will likely prevent millions of additional medication errors each year. Further research is needed to better characterize links to patient harm.

Perspectives on use of mobility aids in a diverse population of seniors: implications for intervention.

BACKGROUND: Many older adults who might benefit from using mobility aids do not or will not use them. Studies show that attitudes and beliefs strongly affect the decision to use mobility aids. Despite the growing diversity of the population, no prior studies have compared attitudes towards and beliefs about mobility aids by race and ethnicity. OBJECTIVE: This study aimed to explore whether and how attitudes towards and beliefs about mobility aid use vary by race and ethnicity. METHODS: We conducted 12 focus groups with 61 community dwelling persons age 65+ years from three groups: White, non-Hispanic Black, and Hispanic. Data were coded and compared across groups. RESULTS: For all groups, perceived benefits of mobility devices in maintaining independence and control produced positive attitudes. However, the association of mobility aid use with aging and physical decline contributed to stigmatizing attitudes. Black and Hispanic participants expressed apprehension about using unsafe or inappropriate secondhand equipment, heightened concerns about mobility aid users becoming subjects of negative biases, and a preference for fashionable aids. Hispanic participants expressed a preference for human assistance. Participants of all groups perceived physicians as influencing their decisions to use aids. CONCLUSIONS: Social pressures and perceived stigma deter mobility aid use, particularly in minority populations. Greater physician involvement, positive peer models and affordable, safe, visually appealing devices would promote greater acceptance of mobility aids.

Social support among Latina immigrant women: bridge persons as mediators of cervical cancer screening.

New Latina immigrants face numerous linguistic, cultural, logistical, and material barriers to cervical cancer screenings. Promotoras (lay health advisors) are a proven strategy to promote utilization of care. Since the mid-1990s, interventions in North Carolina have aimed to connect Latina immigrants to a broader range of bridge persons. This study assessed the effect of bridge persons on utilization of cervical cancer screening by Latina immigrants in North Carolina. Women were recruited in Spanish-language churches in four counties (N = 223). Logistic regression results show that persons known through advocacy organizations appeared to increase probability of recent Pap screening by an average of 10.4 percentage points (p < 0.05). Promotoras remain more effective, increasing probability of screening by 12.9 percentage points (p < 0.05) but few women (14%) knew one. No association was found with other bridge person profiles. Interventions are needed to better engage all bridge persons in linking immigrants to preventive health services.