A pragmatic randomized trial of mailed fecal immunochemical testing to increase colorectal cancer screening among low-income and minoritized populations.

BACKGROUND: Colorectal cancer (CRC) screening is underused, particularly among low-income and minoritized populations, for whom the coronavirus disease 2019 (COVID-19) pandemic has challenged progress in achieving equity. METHODS: A hub-and-spoke model was used. The hub was a nonacademic organization and the spokes were three community health center (CHC) systems overseeing numerous clinic sites. Via a cluster-randomized trial design, nine clinic sites were randomized to intervention and 16 clinic sites were randomized to usual care. Patient-level interventions included invitation letters, mailed fecal immunochemical tests (FITs), and call/text-based reminders. Year 1 intervention impact, which took place during the COVID-19 pandemic, was assessed as the proportion completing screening among individuals not up to date at baseline, which compared intervention and nonintervention clinics accounting for intraclinic cluster variation; confidence intervals (CIs) around differences not including 0 were interpreted as statistically significant. RESULTS: Among 26,736 patients who met eligibility criteria, approximately 58% were female, 55% were Hispanic individuals, and 44% were Spanish speaking. The proportion completing screening was 11.5 percentage points (ppts) (95% CI, 6.1-16.9 ppts) higher in intervention versus usual care clinics. Variation in differences between intervention and usual care clinics was observed by sex (12.6 ppts [95% CI, 7.2-18.0 ppts] for females; 8.8 ppts [95% CI, 4.7-13.9 ppts] for males) and by racial and ethnic group (13.8 ppts [95% CI, 7.0-20.6 ppts] for Hispanic individuals; 13.0 ppts [95% CI, 3.6-22.4 ppts] for Asian individuals; 11.3 ppts [95% CI, 5.8-16.8 ppts] for non-Hispanic White individuals; 6.1 ppts [95% CI, 0.8-10.4 ppts] for Black individuals). CONCLUSIONS: A regional mailed FIT intervention was effective for increasing CRC screening rates across CHC systems serving diverse, low-income populations.

Adaptation of the brainwriting premortem technique to inform the co-creation of COVID-19 testing strategies in underserved communities in South San Diego.

INTRODUCTION: Meaningful engagement of partners in co-creating and refining health-related programs can increase the initial uptake, sustained implementation, broad reach, and effectiveness of these programs. This is especially important for underserved communities where resources are limited and need to be prioritized. Brainwriting premortem is a novel qualitative approach to partner engagement that combines the strengths of individual idea generation with the concept of premortem exercise that addresses failure points prior to the implementation of new programs. METHODS: An adapted form of brainwriting premortem was used to inform iterative refinements to a COVID-19 testing program at a Federally Qualified Health Center (FQHC) in San Diego. Patients and providers from the FQHC participated in interviews at two time points (early- and mid-implementation of the program). Interview data were transcribed, translated, and analyzed using a rapid qualitative approach. Key themes and sub-themes were identified and used to inform refinements to the program. RESULTS: A total of 11 patients (7 Spanish- and 4 English-speaking) and 8 providers participated in the brainwriting premortem interviews. Key themes related to possible reasons for COVID-19 testing program failure: advertising/sharing information; access to testing; handling of test results; staff and patient safety; patient beliefs and views regarding the SARS-CoV-2 virus; and COVID-19 testing options offered. Proposed solutions were offered for the key failures except for patient beliefs and views regarding the SARS-CoV-2 virus. Additional solutions offered were related to education, physical operations, and recruitment strategies. Real-time changes to the program flow and components were made in response to 7 suggestions from patients and 11 from providers. Changes related to the process of returning results were the most common, and included sending results via email with distinct workflows based on the test result. CONCLUSION: The implementation of the adapted brainwriting premortem technique allowed us to incorporate the perspective of key partners in the delivery and iterative refinement of the COVID-19 testing program. This was an effective tool in the context of an FQHC and can be a promising and approach to incorporate iterative input from patients and providers to ensure successful program implementation. Future studies, particularly those requiring rapid response to public health emergencies, should consider the use of this technique.

Understanding feasibility and acceptability of implementation of linking delivery of family planning and infant vaccination care in rural Maharashtra, India: a qualitative study.

BACKGROUND: Linking family planning with infant vaccination care has the potential to increase contraceptive use among postpartum women in rural settings. We explored the multilevel factors that can facilitate or impede uptake of contraception at the time of infant vaccination among postpartum women and couples in rural Maharashtra, India. METHODS: We conducted 60 semi-structured interviews with key stakeholders including: postpartum married women (n = 20), husbands (n = 10), and mothers-in-law (n = 10) of postpartum women, frontline healthcare workers (auxiliary nurse midwives (ANMs) and Accredited Social Health Activists (ASHAs), (n = 10), and community leaders (physician medical officers and village panchayat leaders) (n = 10). We sought to assess the feasibility and acceptability of delivering community-based postpartum family planning care in rural India at the time of infant vaccination. The Consolidated Framework for Implementation Research (CFIR) was used to design a structured interview guide and codebook. Data were analyzed via directed content analysis. RESULTS: Three major themes emerged: (1) Social fertility and gender norms including son preference and male control over contraceptive decision-making influence postpartum contraceptive access and choice. (2) Linking contraceptive care and infant vaccination is perceived as potentially feasible and acceptable to implement by families, health workers, and community leaders. The intervention provides care to women and families in a convenient way where they are in their community. (3) Barriers and facilitators to linked infant postpartum contraception and infant vaccination were identified across the five CFIR domains. Key barriers included limited staff and space (inner setting), and contraceptive method targets for clinics and financial incentives for clinicians who provide specific methods (outer setting). Key facilitators included convenience of timing and location for families (intervention characteristics), the opportunity to engage husbands in decision-making when they attend infant vaccination visits (participant characteristics), and programmatic support from governmental and community leaders (process of implementation). CONCLUSIONS: Linked provision of family planning and infant vaccination care may be feasible and accessible in rural India utilizing strategies identified to reduce barriers and facilitate provision of care. A gender-transformative intervention that addresses gender and social norms has greater potential to impact reproductive autonomy and couples' contraceptive decision-making.

Using ethnographic approaches to document, evaluate, and facilitate virtual community-engaged implementation research.

BACKGROUND: Community Advisory Boards (CABs) have been frequently used to engage diverse partners to inform research projects. Yet, evaluating the quality of engagement has not been routine. We describe a multi-method ethnographic approach documenting and assessing partner engagement in two "virtual" CABs, for which we conducted all meetings remotely. METHODS: Two research projects for increasing equitable COVID-19 testing, vaccination, and clinical trial participation for underserved communities involved remote CAB meetings. Thirty-three partners representing 17 community groups participated in 15 sessions across the two CABs facilitated by a social change organization. We developed ethnographic documentation forms to assess multiple aspects of CAB member engagement (e.g., time spent speaking, modality used, types of interactions). Documenters were trained to observe CAB sub-groups via virtual sessions. Debriefing with the documentation team after CAB meetings supported quality assurance and process refinement. CAB members completed a brief validated survey after each meeting to assess the quality and frequency of engagement. Content and rapid thematic analysis were used to analyze documentation data. Quantitative data were summarized as frequencies and means. Qualitative and quantitative findings were triangulated. RESULTS: A total of 4,540 interactions were identified across 15 meetings. The most frequent interaction was providing information (44%), followed by responding (37-38%). The quality and frequency of stakeholder engagement were rated favorably (average 4.7 of 5). Most CAB members (96%) reported good/excellent engagement. Specific comments included appreciation for the diversity of perspectives represented by the CAB members and suggestions for improved live interpretation. Debriefing sessions led to several methodological refinements for the documentation process and forms. CONCLUSION: We highlight key strategies for documenting and assessing community engagement. Our methods allowed for rich ethnographic data collection that refined our work with community partners. We recommend ongoing trainings, including debriefing sessions and routinely reviewed assessment of data to strengthen meaningful community engagement.

A qualitative analysis of pharmacists' attitudes towards provision of medication abortion.

BACKGROUND: 90% of United States' counties do not have a single clinic offering abortion care, and barriers to care disproportionately affect low-income families. Novel models of abortion care delivery, including provision of medication abortion in pharmacies, with pharmacists prescribing medication, have the potential to expand access to abortion care. Pharmacists are well-positioned to independently provide abortion care and are highly accessible to patients, however medication abortion provision by pharmacists is not currently legal or available in the United States. To assess the potential acceptability of pharmacist provision of medication abortion and to identify anticipated barriers and facilitators to this model of care, we explored pharmacists' attitudes towards providing medication abortion, inclusive of patient selection, counseling, and medication prescribing. METHODS: From May to October 2021, we conducted 20 semi-structured qualitative interviews with pharmacists across the United States, guided by the domains of the Consolidated Framework for Implementation Science Research. RESULTS: Major themes included there is a need for pharmacist provision of medication abortion and pharmacists perceive provision of medication abortion to be potentially acceptable if anticipated barriers are addressed. Anticipated barriers identified included personal, religious, and political beliefs of pharmacists and lack of space and systems to support the model. Ensuring adequate staffing with pharmacists willing to participate, private space, time for counseling, safe follow-up, training, and reimbursement mechanisms were perceived strategies to facilitate successful implementation. CONCLUSIONS: Pharmacist identified implementation strategies are needed to reduce anticipated barriers to pharmacist provision of medication abortion.

Multi-method study of the implementation of Cognitive Symptom Management and Rehabilitation Training (CogSMART) in real-world settings.

Cognitive Symptom Management and Rehabilitation Training (CogSMART) and Compensatory Cognitive Training (CCT) are evidence-based compensatory cognitive training interventions that improve cognition in persons with a history of traumatic brain injury or other neuropsychiatric disorders. Despite demonstrated efficacy, use and effectiveness of CogSMART/CCT in real-world settings is not known.We used a multi-method design to collect and analyze quantitative and qualitative survey data from several domains of the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework to gather information about use of CogSMART/CCT in real-world settings from provider and patient perspectives. Surveys were sent to email addresses from persons who registered on the CogSMART website seeking access to training manuals and other resources. Descriptive statistics were generated, and we used Natural Language Processing methods to study the self-report free responses. Using n-gram analysis, we identified the most frequently reported responses.We found CogSMART/CCT was broadly used in real-world settings and delivered by a variety of providers for several patient groups with high attendance and overall high satisfaction. CogSMART/CCT seemed to be offered in VA- or university-related clinics more than in private practice or rehabilitation centers. The diversity of providers and variety of formats by which to deliver CogSMART/CCT (i.e., individual, group, telehealth) seemed to play a role in its widespread implementation, as did its adaptability. Most providers made adaptations to the intervention that reduced the length or number of sessions. These changes were most likely to be based on client characteristics. The low rates of formal training, however, may have contributed to lower levels of perceived helpfulness among patients.Reach and Adoption of a cognitive rehabilitation intervention improved by increasing access to the manuals. Attention to characteristics of dissemination and implementation in the design of an intervention may enhance its use in real-world settings. The relevant outcomes, easy access to training manuals, and adaptability of CogSMART/CCT seem to have been important factors in its use in a variety of settings and for several disorders with cognitive impairment. The adoption of CogSMART/CCT by a variety of providers other than neuropsychologists suggests its use may be broadened to other healthcare providers, if adequately trained, to increase access to an intervention with demonstrated efficacy for cognitive rehabilitation for several neuropsychiatric disorders.

Using a stakeholder-engaged, iterative, and systematic approach to adapting collaborative decision skills training for implementation in VA psychosocial rehabilitation and recovery centers.

BACKGROUND: Adaptation of interventions is inevitable during translation to new populations or settings. Systematic approach to adaptation can ensure that fidelity to core functions of the intervention are preserved while optimizing implementation feasibility and effectiveness for the local context. In this study, we used an iterative, mixed methods, and stakeholder-engaged process to systematically adapt Collaborative Decision Skills Training for Veterans with psychosis currently participating in VA Psychosocial Rehabilitation and Recovery Centers. METHODS: A modified approach to Intervention Mapping (IM-Adapt) guided the adaptation process. An Adaptation Resource Team of five Veterans, two VA clinicians, and four researchers was formed. The Adaptation Resource Team engaged in an iterative process of identifying and completing adaptations including individual qualitative interviews, group meetings, and post-meeting surveys. Qualitative interviews were analyzed using rapid matrix analysis. We used the modified, RE-AIM enriched expanded Framework for Reporting Adaptations and Modifications to Evidence-based interventions (FRAME) to document adaptations. Additional constructs included adaptation size and scope; implementation of planned adaptation (yes-no); rationale for non-implementation; and tailoring of adaptation for a specific population (e.g., Veterans). RESULTS: Rapid matrix analysis of individual qualitative interviews resulted in 510 qualitative codes. Veterans and clinicians reported that the intervention was a generally good fit for VA Psychosocial Rehabilitation and Recovery Centers and for Veterans. Following group meetings to reach adaptation consensus, 158 adaptations were completed. Most commonly, adaptations added or extended a component; were small in size and scope; intended to improve the effectiveness of the intervention, and based on experience as a patient or working with patients. Few adaptations were targeted towards a specific group, including Veterans. Veteran and clinician stakeholders reported that these adaptations were important and would benefit Veterans, and that they felt heard and understood during the adaptation process. CONCLUSIONS: A stakeholder-engaged, iterative, and mixed methods approach was successful for adapting Collaborative Decision Skills Training for immediate clinical application to Veterans in a psychosocial rehabilitation center. The ongoing interactions among multiple stakeholders resulted in high quality, tailored adaptations which are likely to be generalizable to other populations or settings. We recommend the use of this stakeholder-engaged, iterative approach to guide adaptations.

A Mixed-method Evaluation of the Behavioral Health Integration and Complex Care Initiative Using the Consolidated Framework for Implementation Research.

BACKGROUND: Integrated behavioral health and primary care can improve the health of persons with complex chronic conditions. The Behavioral Health Integration and Complex Care Initiative (BHICCI) implemented integrated care across a large health system. Whether Behavioral Health Organizations (BHOs) and Federally Qualified Health Centers (FQHCs) implemented the BHICCI differently is unclear. OBJECTIVES: The objective of this study was to evaluate integration under the BHICCI and to understand implementation differences between BHOs and FQHCs. METHODS: We used a convergent parallel mixed-method design. Integration was measured quantitatively using the Maine Health Access Site Self-Assessment (SSA), which was completed by clinic teams at baseline and 24 months, and through n=70 qualitative interviews with initiative stakeholders, which were organized using the Consolidated Framework for Implementation Research. Results were compared to understand how qualitative findings explained quantitative results. RESULTS: Data were collected in 7 clinics (n=2 FQHC; n=5 BHOs). FQHCs reported greatest improvement in the client centered subscale, with a baseline score of 4.6 (SD=0.64) and 7.8 (SD=0.89) at 24 months. BHOs reported greatest improvement in the organizational supports for integration subscale, with a baseline score of 4.8 (SD=1.07) and 7.9 (SD=1.1) at 24 months. Our Consolidated Framework for Implementation Research analysis illustrates contextual factors, such as insurance plan supports and clinic-level challenges, that explain these scores. CONCLUSIONS: All clinical settings received support from the health plan, but differences between BHOs and FQHCs affected integration progress. Study results can help identify organizational practices that advance or undermine the delivery of integrated care across multiple clinical settings.

Implementing eScreening technology in four VA clinics: a mixed-method study.

BACKGROUND: Technology-based self-assessment (TB-SA) benefits patients and providers and has shown feasibility, ease of use, efficiency, and cost savings. A promising TB-SA, the VA eScreening program, has shown promise for the efficient and effective collection of mental and physical health information. To assist adoption of eScreening by healthcare providers, we assessed technology-related as well as individual- and system-level factors that might influence the implementation of eScreening in four diverse VA clinics. METHODS: This was a mixed-method, pre-post, quasi-experimental study originally designed as a quality improvement project. The clinics were selected to represent a range of environments that could potentially benefit from TB-SA and that made use of the variety eScreening functions. Because of limited resources, the implementation strategy consisted of staff education, training, and technical support as needed. Data was collected using pre- and post-implementation interviews or focus groups of leadership and clinical staff, eScreening usage data, and post-implementation surveys. Data was gathered on: 1) usability of eScreening; 2) knowledge about and acceptability and 3) facilitators and barriers to the successful implementation of eScreening. RESULTS: Overall, staff feedback about eScreening was positive. Knowledge about eScreening ranged widely between the clinics. Nearly all staff felt eScreening would fit well into their clinical setting at pre-implementation; however some felt it was a poor fit with emergent cases and older adults at post-implementation. Lack of adequate personnel support and perceived leadership support were barriers to implementation. Adequate training and technical assistance were cited as important facilitators. One clinic fully implemented eScreening, two partially implemented, and one clinic did not implement eScreening as part of normal practice after 6 months as measured by usage data and self-report. Organizational engagement survey scores were higher among clinics with full or partial implementation and low in the clinic that did not implement. CONCLUSIONS: Despite some added work load for some staff and perceived lack of leadership support, eScreening was at least partially implemented in three clinics. The technology itself posed no barriers in any of the settings. An implementation strategy that accounts for increased work burden and includes accountability may help in future eScreening implementation efforts. Note. This abstract was previously published (e.g., Annals of Behavioral Medicine 53: S1-S842, 2019).

Financial difficulty, worry about affording care, and benefit finding in long-term survivors of cancer.

OBJECTIVE: To examine the associations of worry about affording care and reporting financial difficulties with benefit finding in long-term cancer survivors. METHODS: Long-term survivors of cancer (n = 547) in 3 integrated health care delivery systems completed the Medical Expenditure Panel Survey Cancer Survivorship Supplement. The relationship between benefit finding (becoming a stronger person, coping better, and making positive changes) and the potentially interacting factors of worry about affording care and financial difficulties was examined using multivariate logistic regression models. RESULTS: Of the total sample, 20% reported worry and 15% reported financial difficulty. Among those who reported no worry, financial difficulty was positively associated with becoming a stronger person (odds ratio [OR] = 2.89, 95% CI: 1.07, 7.80). Coping better was not associated with worry, financial difficulties, or the interaction of the two. Among those with no financial difficulty, worry was positively associated with making positive changes (OR = 2.64, 95% CI: 1.41, 4.96), and among those reporting no worry, financial difficulty had a non-significant positive association with making positive changes (OR = 1.98, 95% CI: 0.91, 4.31). Among those reporting worry, having financial difficulties was associated with lower odds of making positive changes (OR = 0.32, 95% CI: 0.13, 0.78). CONCLUSIONS: Our results suggest a complex relationship between financial difficulty, worry, and benefit finding. The combination of worry about affording care and financial difficulty needs to be addressed and further studied among cancer survivors, as the presence of both, but not alone, was negatively associated with making positive changes, an aspect of benefit finding.

Qualitative approaches to use of the RE-AIM framework: rationale and methods.

BACKGROUND: There have been over 430 publications using the RE-AIM model for planning and evaluation of health programs and policies, as well as numerous applications of the model in grant proposals and national programs. Full use of the model includes use of qualitative methods to understand why and how results were obtained on different RE-AIM dimensions, however, recent reviews have revealed that qualitative methods have been used infrequently. Having quantitative and qualitative methods and results iteratively inform each other should enhance understanding and lessons learned. METHODS: Because there have been few published examples of qualitative approaches and methods using RE-AIM for planning or assessment and no guidance on how qualitative approaches can inform these processes, we provide guidance on qualitative methods to address the RE-AIM model and its various dimensions. The intended audience is researchers interested in applying RE-AIM or similar implementation models, but the methods discussed should also be relevant to those in community or clinical settings. RESULTS: We present directions for, examples of, and guidance on how qualitative methods can be used to address each of the five RE-AIM dimensions. Formative qualitative methods can be helpful in planning interventions and designing for dissemination. Summative qualitative methods are useful when used in an iterative, mixed methods approach for understanding how and why different patterns of results occur. CONCLUSIONS: In summary, qualitative and mixed methods approaches to RE-AIM help understand complex situations and results, why and how outcomes were obtained, and contextual factors not easily assessed using quantitative measures.

Cancer Survivors' Reported Discussions with Health Care Providers About Follow-Up Care and Receipt of Written Care Plans.

Prior studies reveal gaps in cancer survivors' discussions with health care providers about follow-up care and receipt of care plans; however, whether survivorship care planning may vary by cancer type is not known. We surveyed 615 survivors of breast, colorectal, prostate, lung cancer, and melanoma enrolled in three health plans to examine cancer survivors' self-reported discussions of follow-up care, including the need for surveillance, late and long-term effects, emotional needs, and health behaviors. We assessed whether cancer survivors received a written treatment summary and post-treatment care instructions. Most (92%) survivors reported having a discussion about the need for surveillance; 75%, late and long-term effects; 69%, lifestyle and health behaviors; and 53%, emotional and social needs. Most (88%) reported receiving post-treatment care instructions and 47%, a treatment summary. While there was little difference among survivors' receipt of surveillance or health behavior recommendations by cancer type (p = 0.85 and p = 0.66, respectively), discussions of late and long-term effects occurred among 82% of prostate, 78% of breast, 73% of melanoma, 72% of colorectal, and 67% of lung survivors (p = 0.06). Approximately half of survivors reported discussions of emotional needs, with modest differences by cancer type (p = 0.08). Our findings indicate that most patient-provider discussions cover information on surveillance, with less emphasis on late and long-term effects, lifestyle and health behaviors, and substantially less focusing on emotional and social needs. No or modest differences in discussions occurred by cancer type. Whether tailoring information to individual cancer survivor needs is beneficial should be examined.

Association of worry about cancer to benefit finding and functioning in long-term cancer survivors.

PURPOSE: Worry about cancer recurrence or progression is associated with negative effects of cancer, such as worse physical functioning, but associations with positive changes post-cancer, such as benefit finding, are unknown. We measured the proportion of patients reporting frequent worry about cancer recurrence or progression and examined the association between worry about cancer recurrence or progression to benefit finding and functioning in cancer. METHODS: We surveyed 594 long-term (5-10 years post-diagnosis) survivors of cancer (breast, prostate, colorectal, lung, melanoma) in this cross-sectional study. The survey asked about worry about cancer recurrence/progression, negative effects of cancer on mental and physical function, and benefit finding as a result of the cancer (positive effects). Multivariate regressions estimated associations of worry about cancer with negative and positive effects of cancer. RESULTS: Worrying about cancer often or all the time was reported by 19.6% of survivors. Worry about cancer was related to worse functioning (odds ratio (OR) range 1.40 to 1.46, all p's < .01). Worry about recurrence/progression was unrelated to benefit finding (all p's > .10). CONCLUSIONS: Worry about cancer was associated with negative, but not positive, effects of cancer. Treating worry about cancer is unlikely to reduce benefit finding after cancer. Given the high prevalence of worry about cancer and relationship to negative effects of cancer, clinical care should attempt to address this worry for long-term survivors.

Study protocol: improving the transition of care from a non-network hospital back to the patient's medical home.

BACKGROUND: The process of transitioning Veterans to primary care following a non-Veterans Affairs (VA) hospitalization can be challenging. Poor transitions result in medical complications and increased hospital readmissions. The goal of this transition of care quality improvement (QI) project is to identify gaps in the current transition process and implement an intervention that bridges the gap and improves the current transition of care process within the Eastern Colorado Health Care System (ECHCS). METHODS: We will employ qualitative methods to understand the current transition of care process back to VA primary care for Veterans who received care in a non-VA hospital in ECHCS. We will conduct in-depth semi-structured interviews with Veterans hospitalized in 2015 in non-VA hospitals as well as both VA and non-VA providers, staff, and administrators involved in the current care transition process. Participants will be recruited using convenience and snowball sampling. Qualitative data analysis will be guided by conventional content analysis and Lean Six Sigma process improvement tools. We will use VA claim data to identify the top ten non-VA hospitals serving rural and urban Veterans by volume and Veterans that received inpatient services at non-VA hospitals. Informed by both qualitative and quantitative data, we will then develop a transitions care coordinator led intervention to improve the transitions process. We will test the transition of care coordinator intervention using repeated improvement cycles incorporating salient factors in value stream mapping that are important for an efficient and effective transition process. Furthermore, we will complete a value stream map of the transition process at two other VA Medical Centers and test whether an implementation strategy of audit and feedback (the value stream map of the current transition process with the Transition of Care Dashboard) versus audit and feedback with Transition Nurse facilitation of the process using the Resource Guide and Transition of Care Dashboard improves the transition process, continuity of care, patient satisfaction and clinical outcomes. DISCUSSION: Our current transition of care process has shortcomings. An intervention utilizing a transition care coordinator has the potential to improve this process. Transitioning Veterans to primary care following a non-VA hospitalization is a crucial step for improving care coordination for Veterans.

A Framework for Enhancing the Value of Research for Dissemination and Implementation.

A comprehensive guide that identifies critical evaluation and reporting elements necessary to move research into practice is needed. We propose a framework that highlights the domains required to enhance the value of dissemination and implementation research for end users. We emphasize the importance of transparent reporting on the planning phase of research in addition to delivery, evaluation, and long-term outcomes. We highlight key topics for which well-established reporting and assessment tools are underused (e.g., cost of intervention, implementation strategy, adoption) and where such tools are inadequate or lacking (e.g., context, sustainability, evolution) within the context of existing reporting guidelines. Consistent evaluation of and reporting on these issues with standardized approaches would enhance the value of research for practitioners and decision-makers.

The Effects of a Single-Session Virtual Rumination Intervention to Enhance Cognitive Functioning in Veterans With Subjective Cognitive Symptoms: Multimethod Pilot Study.

BACKGROUND: Subjective cognitive concerns (SCCs) entail perceived difficulties in thinking or memory, often reported without substantial objective evidence of cognitive impairment. These concerns are prevalent among individuals with a history of brain injuries, neurological conditions, or chronic illnesses, contributing to both psychological distress and functional limitations. They are increasingly considered to be a risk factor for future objective decline. A considerable number of individuals reporting SCCs also exhibit mental health symptoms, such as a history of trauma, depression, or anxiety. Interventions that address modifiable emotional and cognitive factors related to SCC could improve functioning and quality of life. Therefore, the use of emotion regulation strategies, especially those directed at minimizing rumination, could serve as a promising focus for interventions aimed at mitigating subjective cognitive concerns in veteran populations. OBJECTIVE: This pilot study explored the feasibility, acceptability, and preliminary efficacy of a brief, 1-session emotion regulation intervention called "Worry Less, Remember More." The Worry Less, Remember More intervention was designed to reduce rumination and improve subjective cognitive functioning in veterans with subjective cognitive changes (N=15). METHODS: We randomized 15 veterans to either the active telehealth condition or waitlist control and completed the intervention. Participants were aged between 31 and 67 (mean 49.5, SD 10.1) years, and the sample was primarily male (12/15, 83%) and White (10/15, 67%). The most common diagnoses were posttraumatic stress disorder and depression. Following the intervention, veteran input was sought through semistructured interviews with a subset of 12 participants, examining feasibility, acceptability, and perceived efficacy. Preliminary efficacy was also measured using pre- and postintervention self-report measures. RESULTS: Veterans reported that this intervention was acceptable, with 92% (11/12) of the sample reporting that they benefited from the intervention and would recommend the intervention to others with similar difficulties. Semistructured interviews revealed difficulties with feasibility, including problems with the remote consenting process, forgetting appointments, and needing additional strategies to remember to consistently use the interventions. The intervention improved self-reported cognitive symptoms on quantitative measures but did not improve self-reported rumination. CONCLUSIONS: This pilot study establishes the preliminary feasibility, acceptability, and efficacy of the Worry Less, Remember More intervention for veterans with subjective cognitive symptoms. Future iterations of the intervention may benefit from simplifying the electronic consent process, providing reminders for appointments, and incorporating compensatory cognitive strategies to assist with using the telehealth system, as well as applying the strategies learned in the intervention. While future research is needed with larger samples, including nonveteran populations, the intervention may also be a useful clinical tool to bridge care between neuropsychology clinics and mental health treatment.

Use of the iPRISM webtool in a learning community to assess implementation context and fit of a novel clinical decision support tool for physical therapy triage in acute care hospitals.

BACKGROUND: The iPRISM webtool is an interactive tool designed to aid the process of applying the Practical, Robust Implementation and Sustainability Model (PRISM) for the assessment of and fit with context. A learning community (LC) is a multidisciplinary group of partners addressing a complex problem. Our LC coproduced the Physical TheraPy frEqueNcy Clinical decIsion support tooL (PT-PENCIL) to guide the use of physical therapist services in acute care hospitals. OBJECTIVE: To describe our LC's activities to co-produce the PT-PENCIL, use of the iPRISM webtool to assess its preimplementation context and fit, and develop a multicomponent implementation strategy for the PT-PENCIL. DESIGN: A descriptive research design. SETTING: Three tertiary care hospitals. PARTICIPANTS: Thirteen LC partners: six clinical physical therapists, three rehabilitation managers, three researchers, and a bioinformaticist. INTERVENTIONS: Not applicable. OUTCOME MEASURES: Using the iPRISM webtool, expected fit of the PT-PENCIL was rated 1 (not aligned) to 6 (well aligned) for each PRISM domain and expected reach, effectiveness, adoption, implementation, and maintenance were rated 1 (not likely at all) to 6 (very likely). Discrete implementation strategies were identified from the Expert Recommendations for Implementing Change. RESULTS: The process spanned 18 meetings over 8 months. Ten LC partners completed the iPRISM webtool. PRISM domains with the lowest expected alignment were the "implementation and sustainability infrastructure" (mean = 4.7 out of 6; range = 3-6) and the "external environment" (mean = 4.9 of 6; range = 4-6). Adoption was the outcome with the lowest expected likelihood (mean = 4.5 out of 6; range = 1-6). Six discrete implementation strategies were identified and combined into a multicomponent strategy. CONCLUSIONS: Within a LC, we used existing implementation science resources to co-produce a novel clinical decision support tool for acute care physical therapists and develop a strategy for its implementation. Our methodology can be replicated for similar projects given the public availability of each resource used.

An implementation strategy postmortem method developed in the VA rural Transitions Nurse Program to inform spread and scale-up.

BACKGROUND: High-quality implementation evaluations report on intervention fidelity and adaptations made, but a practical process for evaluating implementation strategies is needed. A retrospective method for evaluating implementation strategies is also required as prospective methods can be resource intensive. This study aimed to establish an implementation strategy postmortem method to identify the implementation strategies used, when, and their perceived importance. We used the rural Transitions Nurse Program (TNP) as a case study, a national care coordination intervention implemented at 11 hospitals over three years. METHODS: The postmortem used a retrospective, mixed method, phased approach. Implementation team and front-line staff characterized the implementation strategies used, their timing, frequency, ease of use, and their importance to implementation success. The Expert Recommendations for Implementing Change (ERIC) compilation, the Quality Enhancement Research Initiative phases, and Proctor and colleagues' guidance were used to operationalize the strategies. Survey data were analyzed descriptively, and qualitative data were analyzed using matrix content analysis. RESULTS: The postmortem method identified 45 of 73 ERIC strategies introduced, including 41 during pre-implementation, 37 during implementation, and 27 during sustainment. External facilitation, centralized technical assistance, and clinical supervision were ranked as the most important and frequently used strategies. Implementation strategies were more intensively applied in the beginning of the study and tapered over time. CONCLUSIONS: The postmortem method identified that more strategies were used in TNP than planned and identified the most important strategies from the perspective of the implementation team and front-line staff. The findings can inform other implementation studies as well as dissemination of the TNP intervention.

RE-AIM for rural health innovations: perceptions of (mis) alignment between the RE-AIM framework and evaluation reporting in the Department of Veterans Affairs Enterprise-Wide Initiatives program.

Background: The Department of Veterans Affairs (VA) Office of Rural Health (ORH) supports national VA program offices' efforts to expand health care to rural Veterans through its Enterprise-Wide Initiatives (EWIs) program. In 2017, ORH selected Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM), an implementation science framework, to structure the EWI evaluation and reporting process. As part of its mandate to improve EWI program evaluation, the Center for the Evaluation of Enterprise-Wide Initiatives conducted a qualitative evaluation to better understand EWI team' perceptions of, and barriers and facilitators to, the EWI evaluation process. Methods: We conducted 43 semi-structured interviews with 48 team members (e.g., evaluators, program office leads, and field-based leads) representing 21 EWIs from April-December 2020. Questions focused on participants' experiences using strategies targeting each RE-AIM dimension. Interviews were inductively analyzed in MAXQDA. We also systematically reviewed 51 FY19-FY20 EWI annual reports to identify trends in misapplications of RE-AIM. Results: Participants had differing levels of experience with RE-AIM. While participants understood ORH's rationale for selecting a common framework to structure evaluations, the perceived misalignment between RE-AIM and EWIs' work emerged as an important theme. Concerns centered around 3 sub-themes: (1) (Mis)Alignment with RE-AIM Dimensions, (2) (Mis)Alignment between RE-AIM and the EWI, and (3) (Mis)Alignment with RE-AIM vs. other Theories, Models, or Frameworks. Participants described challenges differentiating between and operationalizing dimensions in unique contexts. Participants also had misconceptions about RE-AIM and its relevance to their work, e.g., that it was meant for established programs and did not capture aspects of initiative planning, adaptations, or sustainability. Less commonly, participants shared alternative models or frameworks to RE-AIM. Despite criticisms, many participants found RE-AIM useful, cited training as important to understanding its application, and identified additional training as a future need. Discussion: The selection of a shared implementation science framework can be beneficial, but also challenging when applied to diverse initiatives or contexts. Our findings suggest that establishing a common understanding, operationalizing framework dimensions for specific programs, and assessing training needs may better equip partners to integrate a shared framework into their evaluations.

Enhancing patient-clinician collaboration during treatment decision-making: study protocol for a community-engaged, mixed method hybrid type 1 trial of collaborative decision skills training (CDST) for veterans with psychosis.

BACKGROUND: Patient participation in treatment decision making is a pillar of recovery-oriented care and is associated with improvements in empowerment and well-being. Although demand for increased involvement in treatment decision-making is high among veterans with serious mental illness, rates of involvement are low. Collaborative decision skills training (CDST) is a recovery-oriented, skills-based intervention designed to support meaningful patient participation in treatment decision making. An open trial among veterans with psychosis supported CDST's feasibility and demonstrated preliminary indications of effectiveness. A randomized control trial (RCT) is needed to test CDST's effectiveness in comparison with an active control and further evaluate implementation feasibility. METHODS: The planned RCT is a hybrid type 1 trial, which will use mixed methods to systematically evaluate the effectiveness and implementation feasibility of CDST among veterans participating in a VA Psychosocial Rehabilitation and Recovery Center (PRRC) in Southern California. The first aim is to assess the effectiveness of CDST in comparison with the active control via the primary outcome, collaborative decision-making behavior during usual care appointments between veterans and their VA mental health clinicians, and secondary outcomes (i.e., treatment engagement, satisfaction, and outcome). The second aim is to characterize the implementation feasibility of CDST within the VA PRRC using the Practical Robust Implementation and Sustainability Model framework, including barriers and facilitators within the PRRC context to support future implementation. DISCUSSION: If CDST is found to be effective and feasible, implementation determinants gathered throughout the study can be used to ensure sustained and successful implementation at this PRRC and other PRRCs and similar settings nationally. TRIAL REGISTRATION: ClinicalTrials.gov NCT04324944. Registered on March 27, 2020. Trial registration data can be found in Appendix 1.