ABSTRACT
Transferring successful implementation strategies from research to practice requires approaches for assessing fidelity to the strategy's core components. Implementation facilitation (IF) is a strategy involving an interactive process of problem-solving, enabling, and supporting individuals in efforts to implement clinical innovations that occurs in the context of a recognized need for improvement and supportive interpersonal relationships. Because IF is a dynamic strategy involving numerous activities, our objective was to conduct a rigorous consensus development process to identify core activities for monitoring fidelity to IF when applied in clinical settings. We first conducted a scoping literature review to identify the range of activities used when IF has been applied in clinical settings, searching multiple citation databases for English-language articles including "facilitation" or other commonly-used terms for the strategy published from 1996-2015. Through multi-stage screening, 135 articles (from 94 studies) were identified for data extraction on IF activities, frequency with which IF activities were identified as 'core' by study authors, and study outcomes. From the literature review, we identified 32 distinct IF activities and developed definitions/examples for each. Next, we conducted a 3-stage, modified-Delphi expert panel consensus development process to identify core IF activities across three implementation phases (i.e., Pre-Implementation, Implementation, Sustainment). The expert panel identified 8 core activities for the Pre-Implementation Phase, 8 core activities for the Implementation Phase, and 4 core activities for the Sustainment Phase. This work provides an important foundation for developing measures/tools to assess use of core IF activities to ensure the strategy is delivered with fidelity.
ABSTRACT
Importance: Caring letters is an evidence-based suicide prevention intervention in acute care settings, but its outcomes among individuals who contact a national crisis line have not previously been evaluated. Objective: To examine the outcomes of the Veterans Crisis Line (VCL) caring letters intervention and determine whether there are differences in outcomes by signatory. Design, Setting, and Participants: This parallel randomized clinical trial compared signatories of caring letters and used an observational design to compare no receipt of caring letters with any caring letters receipt. Participants included veterans who contacted the VCL. Enrollment occurred between June 11, 2020, and June 10, 2021, with 1 year of follow-up. Analyses were completed between July 2022 and August 2023. Intervention: Veterans were randomized to receive 9 caring letters for 1 year from either a clinician or peer veteran signatory. Main Outcomes and Measures: The primary outcome measure was suicide attempt incidence in the 12 months following the index VCL contact. Incidence of Veterans Health Administration (VHA) inpatient, outpatient, and emergency health care use were secondary outcomes. All-cause mortality was an exploratory outcome. Wilcoxon rank-sum tests and χ2 tests were used to assess the differences in outcomes among the treatment and comparison groups. Results: A total of 102â¯709 veterans (86â¯942 males [84.65%]; 15â¯737 females [15.32%]; mean [SD] age, 53.82 [17.35] years) contacted the VCL and were randomized. No association was found among signatory and suicide attempts, secondary outcomes, or all-cause mortality. In the analysis of any receipt of caring letters, there was no evidence of an association between caring letters receipt and suicide attempt incidence. Caring letters receipt was associated with increased VHA health care use (any outpatient: hazard ratio [HR], 1.10; 95% CI, 1.08-1.13; outpatient mental health: HR, 1.19; 95% CI, 1.17-1.22; any inpatient: HR, 1.13; 95% CI, 1.08-1.18; inpatient mental health: HR, 1.14; 95% CI, 1.07-1.21). Caring letters receipt was not associated with all-cause mortality. Conclusions and Relevance: Among VHA patients who contacted the VCL, caring letters were not associated with suicide attempts, but were associated with a higher probability of health care use. No differences in outcomes were identified by signatory. Trial Registration: isrctn.org Identifier: ISRCTN27551361.
Subject(s)
Correspondence as Topic , Suicide Prevention , Veterans , Humans , Male , Female , Veterans/psychology , Veterans/statistics & numerical data , Middle Aged , United States , Adult , United States Department of Veterans Affairs , Peer Group , Suicide, Attempted/psychology , Suicide, Attempted/statistics & numerical data , Crisis Intervention/methods , AgedABSTRACT
Transgender and gender diverse (TGD) veterans in the Veterans Health Administration experience health and health care disparities, and research with this population is needed to improve gender-affirming care in Veterans Health Administration. However, TGD veterans may experience hesitancy to participate in research. We must address barriers to participation through feasible and acceptable methods. Opt-out letters are an effective tool used to recruit veterans in mental health research. The present study examined the feasibility and acceptability of opt-out letters modified for TGD veterans. Opt-out letters were sent to 54 potential TGD participants at three sites. The letters stated the research team would begin contacting veterans by phone in 2 weeks if they did not opt out of being contacted. Feasibility was measured through response rate. Acceptability was assessed through qualitative template analysis of interview data. Of the 54 potential participants, two opted out, three letters were undeliverable, and eight veterans called to opt in. Veterans reported that they found the letters to be clear and useful. The responses to the opt-out letters resulted in completing recruitment for two of the three sites. The research team then called the veterans who received the letter at the third site (three veterans) and recruited one additional veteran, for a total of nine TGD veterans. Opt-out letters may be a helpful tool to recruit TGD veterans to participate in research. Although these letters were designed to opt out, 89% of participants called the research team to opt in. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
ABSTRACT
OBJECTIVE: In 2017, the Veterans Health Administration (VHA) implemented a national suicide prevention program, called Recovery Engagement and Coordination for Health-Veterans Enhanced Treatment (REACH VET), that uses a predictive algorithm to identify, attempt to reach, assess, and care for patients at the highest risk for suicide. The authors aimed to evaluate whether facilitation enhanced implementation of REACH VET at VHA facilities not meeting target completion rates. METHODS: In this hybrid effectiveness-implementation type 2 program evaluation, a quasi-experimental pre-post design was used to assess changes in implementation outcome measures evaluated 6 months before and 6 months after onset of facilitation of REACH VET implementation at 23 VHA facilities. Measures included percentages of patients with documented coordinator and provider acknowledgment of receipt, care evaluation, and outreach attempt. Generalized estimating equations were used to compare differences in REACH VET outcome measures before and after facilitation. Qualitative interviews were conducted with personnel and were explored via template analysis. RESULTS: Time had a significant effect in all outcomes models (p<0.001). An effect of facilitation was significant only for the outcome of attempted outreach. Patients identified by REACH VET had significantly higher odds of having a documented outreach attempt after facilitation of REACH VET implementation, compared with before facilitation. Site personnel felt supported and reported that the external facilitators were helpful and responsive. CONCLUSIONS: Facilitation of REACH VET implementation was associated with an improvement in outreach attempts to veterans identified as being at increased risk for suicide. Outreach is critical for engaging veterans in care.
Subject(s)
Program Evaluation , Suicide Prevention , United States Department of Veterans Affairs , Veterans , Humans , Veterans/psychology , United States , Adult , Female , Male , Middle AgedABSTRACT
Suicide prevention is a clinical priority for the US Veterans Health Administration. Evidence-based interventions, including developing a suicide safety plan, are recommended practices and are becoming more widespread. Adaptations to further augment safety planning include a manualized group intervention (Project Life Force, PLF) that combines safety planning with the teaching of skills to maximize use of the plan. A multi-year randomized controlled trial to test efficacy of PLF compared to treatment as usual is currently in progress. However, approximately a year into the study, in-person groups were converted to telehealth groups due to the COVID-19 pandemic. This study compares the per-veteran cost of PLF when delivered in-person versus by telehealth using preliminary trial data from the first 2.5 years of the trial. Cost to deliver PLF was obtained from the Veterans Health Administration's Managerial Cost Accounting data, which relies on activity-based costing. We found no significant differences in the average number of sessions or average group size between in-person and telehealth. However, the cost per group session was lower for the telehealth modality and this led to significant overall per-veteran savings. While efficacy data comparing from the two arms is still underway and we await the ongoing RCT results, our interim cost analysis highlights potential savings with the telehealth modality.
ABSTRACT
Introduction: Engaging service users or consumers in quality improvement or implementing a new service is important across settings and may reduce health inequities. Implementation strategies leveraging consumer engagement are neither commonly used nor robustly operationalized in implementation science. Implementers (e.g., middle managers, facilitators) want to involve consumers in implementation activities, but do not always feel confident in how to proceed. We developed a compendium of tools called Consumer Voice to guide others how to engage consumers in design/delivery of implementation strategies. Although generalizable to other settings, we developed Consumer Voice within the context of implementing suicide prevention treatments in healthcare to reach rural U.S. military veterans, as there are suicide inequities for people in rural areas. Methods: We developed Consumer Voice using a multistep process and human-centered design methods. In between steps, a design team met to generate insights from data, and decide which prototypes to create/refine. In preliminary work, we conducted a scan of examples in healthcare of patient engagement in implementation activities and interviewed two implementation experts about preferred learning styles. In Step 1, we interviewed 26 participants with experience in community engagement, implementation, or lived experience as a rural U.S. veteran with suicidal thoughts/behavior. In Step 2, 11 implementers beta tested prototypes then share feedback in focus groups. In Step 3, we reconvened participants from prior steps to review tools and, using nominal group technique, prioritized remaining recommendations. Results: Consumer Voice is online, modular, and nonlinear for self-guided learning tailored to beginner, intermediate, or advanced experience with consumer engagement. Tools consist of slides, audiovisual content with written text, and templates. Findings indicated there is not one "right" way to engage consumers in implementation activities, rather that implementers wanted tools showcasing core principles for consumer engagement and practical ideas. Discussion: Consumer Voice can be used by implementers to reflect and decide on how to apply consumer engagement implementation strategies to improve equitable dissemination and uptake of evidence-based practices. Most insights generated by user data were explicitly to build trust between consumers and professionals representing institutions, which may be one component to reducing healthcare inequities.
ABSTRACT
Background: Evidence-Based Quality Improvement (EBQI) involves researchers and local partners working collaboratively to support the uptake of an evidence-based intervention (EBI). To date, EBQI has not been consistently included in community-engaged dissemination and implementation literature. The purpose of this paper is to illustrate the steps, activities, and outputs of EBQI in the pre-implementation phase. Methods: The research team applied comparative case study methods to describe key steps, activities, and outputs of EBQI across seven projects. Our approach included: (1) specification of research questions, (2) selection of cases, (3) construction of a case codebook, (4) coding of cases using the codebook, and (5) comparison of cases. Results: The cases selected included five distinct settings (e.g., correction facilities, community pharmacies), seven EBIs (e.g., nutrition promotion curriculum, cognitive processing therapy) and five unique lead authors. Case examples include both community-embedded and clinically-oriented projects. Key steps in the EBQI process included: (1) forming a local team of partners and experts, (2) prioritizing implementation determinants based on existing literature/data, (3) selecting strategies and/or adaptations in the context of key determinants, (4) specifying selected strategies/adaptations, and (5) refining strategies/adaptations. Examples of activities are included to illustrate how each step was achieved. Outputs included prioritized determinants, EBI adaptations, and implementation strategies. Conclusions: A primary contribution of our comparative case study is the delineation of various steps and activities of EBQI, which may contribute to the replicability of the EBQI process across other implementation research projects.
ABSTRACT
OBJECTIVE: The authors sought to determine the effectiveness of a self-administered computerized mental health screening tool in a general acute care emergency department (ED). METHODS: Changes in patient care (diagnosis of a past-year psychiatric disorder, request for psychiatric consultation, psychiatric referral at discharge, or transfer to psychiatric facility) and patient ED return visits (3 months after discharge vs. 3 months before) were assessed among ED physicians (N=451) who received patients' computerized screening reports (N=207) and those who did not (N=244). All patients received copies of screening results. RESULTS: The computerized mental health screening tool identified previously undiagnosed psychiatric problems. However, no statistically significant differences were found in physician care or patient ED return visits. CONCLUSIONS: Computerized mental health screening did not result in further psychiatric diagnoses or treatment; it also did not significantly reduce patient ED return visits. Collaboration among EDs and mental health treatment agencies, organizations, and researchers is needed to facilitate appropriate treatment referrals and linkage.
Subject(s)
Mental Disorders , Mental Health , Humans , Mental Disorders/therapy , Emergency Service, Hospital , Mass Screening/methods , Patient DischargeABSTRACT
OBJECTIVE: Suicide is a leading cause of death in the United States. This has prompted the U.S. surgeon general to issue a report describing actionable items to reduce suicide rates, including a recommendation to increase the use of the caring letters intervention. This intervention involves mailing brief, nondemanding messages of care. As part of the Department of Veterans Affairs' (VA's) efforts to reduce suicide rates among veterans, a caring letters project was developed for veterans who contact the Veterans Crisis Line (VCL). This article describes the results of qualitative interviews conducted to better understand the experiences of veterans who received caring letters. METHODS: Beginning in 2020, all identifiable veterans who used Veterans Health Administration services and contacted the VCL received nine letters over 1 year, along with a list of mental health resources. Semistructured interviews (N=23) were conducted, and content analysis was used to identify veterans' perspectives and suggestions for improving the intervention. RESULTS: Sixteen men and seven women participated (mean age=53 years). Feedback varied, with most participants reporting that receiving caring letters had a positive impact and others noting aspects that could be improved to enhance the intervention's caring intent. Some also reported that the letters helped them engage with community resources and made them more likely to seek VA care. CONCLUSIONS: The caring letters intervention, received after contact with the VCL, was well received by participants. They described feeling appreciated, cared for, encouraged, and connected. The results of this study will inform future evaluation examining veteran outcomes.
Subject(s)
Suicide , Veterans , Male , Humans , Female , United States , Middle Aged , Suicide Prevention , Veterans/psychology , United States Department of Veterans Affairs , Suicide/psychology , Mental HealthABSTRACT
Mental illness and suicide are significant public health problems. Limited resources put individuals at greater risk, particularly in rural areas with fewer health providers. Community pharmacists are the most accessible health professionals in rural communities and are interested in addressing mental health concerns. Research is limited on how to implement mental health interventions in community pharmacy settings. The objectives of this study were to assess community pharmacists' perceptions of mental health interventions and barriers and facilitators to implementation and prioritize interventions to be pilot tested. Qualitative interviews were conducted with community pharmacists (N=17). Interviews focused on perceptions of mental health interventions in pharmacy settings. Data were analyzed using template analysis. A stakeholder meeting reviewed data and prioritized interventions to be pilot tested. Pharmacists viewed implementing mental health interventions positively. Barriers included lack of mental health knowledge, time, diagnosis, and concerns about workflow. Facilitators included accessible settings, knowing the community, and seeing patients frequently. The most common needs for implementation were education and payment. Pharmacists preferred progress monitoring in collaboration with a prescriber and mental health first aid training. Further research is needed to gather feedback from prescribers to inform implementation.
ABSTRACT
INTRODUCTION: Dialectical behavior therapy (DBT) is a multimodal evidence-based suicide prevention psychotherapy with barriers to full implementation. This study qualitatively examined barriers and facilitators to the DBT skills group treatment mode, which can be implemented as a stand-alone intervention. Using data from a national mixed-methods program evaluation of DBT in the Veterans Health Administration (VHA), this is the first article to examine barriers and facilitators to DBT skills groups implemented with a DBT consultation team or as a stand-alone intervention. MATERIALS AND METHODS: A subset of data from semi-structured telephone interviews of six clinicians and three administrators (n = 9 respondents) was analyzed to provide complementarity and expansion on prior quantitative findings. The data were coded using an iterative process based on content analysis and a codebook based on the Promoting Action on Research Implementation in Health Services framework. The study was approved by the institutional review board for the Palo Alto VA Health Care System. RESULTS: Barriers and facilitators were organized by Promoting Action on Research Implementation in Health Services domains of evidence, context, and facilitation. Results showed how reduced leadership support and low receptivity to providing DBT skills groups functioned as barriers and also identified a barrier not described earlier in the literature: the perception that this group could conflict with expanding access to care for more veterans. The results showed how leadership supported implementation, including by mapping clinic grids and supporting training, and also revealed how a supportive culture among providers facilitated division of labor between skills group providers, and how offering a treatment that filled a gap in services supported the group. At some sites, a provider with prior DBT experience was instrumental in starting DBT skills groups or developing ongoing training. CONCLUSIONS: Qualitatively analyzed barriers and facilitators to a group-delivered suicide prevention intervention, DBT skills groups, expanded on quantitative findings on the importance of leadership support, culture, and training as facilitators. Future work implementing DBT skills group as a stand-alone treatment will need to address the barrier of receptivity and perceived barriers about access to care.
ABSTRACT
Importance: The months after psychiatric hospital discharge are a time of high risk for suicide. Intensive postdischarge case management, although potentially effective in suicide prevention, is likely to be cost-effective only if targeted at high-risk patients. A previously developed machine learning (ML) model showed that postdischarge suicides can be predicted from electronic health records and geospatial data, but it is unknown if prediction could be improved by adding additional information. Objective: To determine whether model prediction could be improved by adding information extracted from clinical notes and public records. Design, Setting, and Participants: Models were trained to predict suicides in the 12 months after Veterans Health Administration (VHA) short-term (less than 365 days) psychiatric hospitalizations between the beginning of 2010 and September 1, 2012 (299â¯050 hospitalizations, with 916 hospitalizations followed within 12 months by suicides) and tested in the hospitalizations from September 2, 2012, to December 31, 2013 (149â¯738 hospitalizations, with 393 hospitalizations followed within 12 months by suicides). Validation focused on net benefit across a range of plausible decision thresholds. Predictor importance was assessed with Shapley additive explanations (SHAP) values. Data were analyzed from January to August 2022. Main Outcomes and Measures: Suicides were defined by the National Death Index. Base model predictors included VHA electronic health records and patient residential data. The expanded predictors came from natural language processing (NLP) of clinical notes and a social determinants of health (SDOH) public records database. Results: The model included 448â¯788 unique hospitalizations. Net benefit over risk horizons between 3 and 12 months was generally highest for the model that included both NLP and SDOH predictors (area under the receiver operating characteristic curve range, 0.747-0.780; area under the precision recall curve relative to the suicide rate range, 3.87-5.75). NLP and SDOH predictors also had the highest predictor class-level SHAP values (proportional SHAP = 64.0% and 49.3%, respectively), although the single highest positive variable-level SHAP value was for a count of medications classified by the US Food and Drug Administration as increasing suicide risk prescribed the year before hospitalization (proportional SHAP = 15.0%). Conclusions and Relevance: In this study, clinical notes and public records were found to improve ML model prediction of suicide after psychiatric hospitalization. The model had positive net benefit over 3-month to 12-month risk horizons for plausible decision thresholds. Although caution is needed in inferring causality based on predictor importance, several key predictors have potential intervention implications that should be investigated in future studies.
Subject(s)
Suicide Prevention , Suicide , Humans , Suicide/psychology , Patient Discharge , Inpatients , AftercareABSTRACT
The U.S. Veterans Health Administration developed a suicide prediction statistical model and implemented a novel clinical program, Recovery Engagement and Coordination for Health-Veterans Enhanced Treatment (REACH VET). This high-value suicide prevention program aims to efficiently identify patients at risk and connect them with care. Starting in April 2017, national REACH VET metric data were collected from electronic health records to evaluate required task completion. By October 2020, 98% of veterans identified (N=6,579) were contacted by providers and had their care evaluated. In the nation's largest health care system, it was feasible to implement a clinical program based on a suicide prediction model.
Subject(s)
Suicide , Veterans , United States , Humans , Veterans Health , United States Department of Veterans Affairs , Suicide PreventionABSTRACT
Background: In the United States Department of Veterans Affairs (VA), veterans who are lesbian, gay, bisexual, transgender, queer, and similar gender and sexual minoritized people (LGBTQ+) experience health disparities compared to cisgender, heterosexual veterans. VA's LGBTQ+ Health Program created two healthcare policies on providing LGBTQ+ affirming care (healthcare that is inclusive, validating, and understanding of the LGBTQ+ population). The current project examines providers' barriers and facilitators to providing LGBTQ+ affirming care and LGBTQ+ veterans' barriers and facilitators to receiving LGBTQ+ affirming care. Methods: Data collection and analysis were informed by the Consolidated Framework for Implementation Research, which was adapted to include three health equity domains. Data collection involved telephone interviews conducted with 11 VA providers and 12 LGBTQ+ veterans at one rural and one urban VA medical center, and one rural VA community clinic. Qualitative data were rapidly analyzed using template analysis, a data reduction technique. Results: Providers described limited education, limited time, lack of experience with the population, and a lack of awareness of resources as barriers. Providers discussed comfort with consulting trusted peers, interest in learning more about providing LGBTQ+ affirming care, and openness and acceptance of the LGBTQ+ community as facilitators. LGBTQ+ veterans described a lack of provider awareness of their needs, concerns related to safety and discrimination, and structural discrimination as barriers. LGBTQ+ veterans described positive relationships with providers, knowledge of their own healthcare needs, and ability to advocate for their healthcare needs as facilitators. Although VA's LGBTQ+ affirming care policies are in place, providers and veterans noted a lack of awareness regarding specific healthcare processes. Conclusion: Allowing more time and capacity for education and engaging LGBTQ+ veterans in determining how to improve their healthcare may be the path forward to increase adherence to LGBTQ+ affirming care policies. Engaging patients, especially those from marginalized backgrounds, in strategies focused on the uptake of policy may be a path to improve policy implementation. It is possible that creating truly collaborative structures in which patients, staff, providers, leadership, and policymakers can work together towards policy implementation may be a useful strategy. In turn, improved policy implementation would result in increased physical and mental health for LGBTQ+ veterans.
Subject(s)
Sexual and Gender Minorities , Veterans Health , Female , Humans , United States , Delivery of Health Care , Sexual Behavior , PolicyABSTRACT
Trauma exposure and mental health problems adversely affect work functioning. Sexual minority women are at increased risk for trauma exposure, depression, and PTSD. Sexual minority women also experience unique stressors related to their sexual orientation, which can directly impact work functioning. However, little research to date has examined the impact of trauma exposure and mental health problems among sexual minority women on their occupational outcomes. The goal of the current study was to examine whether trauma exposure, mental health problems, and minority stressors were associated with occupational functioning one year later in a large sample of young adult lesbian and bisexual women. The study utilized a subset of data (N = 304) from a larger longitudinal study on health risk behaviors among young adult lesbian and bisexual women. Results indicated that trauma exposure, posttraumatic stress, depression, and perceived heterosexism were each associated with subsequent work limitations, but after accounting for shared variance between predictors, only perceived heterosexism and depression were uniquely associated with subsequent work functioning. These findings highlight the roles of mental health and sexual orientation-related stress in the challenges that lesbian and bisexual women experience at work and point to a need for additional research to better understand risk and protective factors related to negative employment outcomes among lesbian and bisexual women.
ABSTRACT
Introduction: Lethal means safety counseling (LMSC) is an evidence-based suicide prevention intervention during which providers encourage patients to limit their access to lethal means (e.g., firearms, medications). Despite agreement about the importance of LMSC, it is underutilized in clinical practice. Methods: To better understand the individual and contextual factors that influence LMSC and its implementation, we conducted a systematic review of qualitative studies examining stakeholder perceptions of the intervention. PubMed and PsycInfo were searched up to February 2021 using terms related to: (1) LMSC, firearms, or medications; (2) suicide, safety, or injury; and (3) qualitative methodology. Two coders used thematic synthesis to analyze findings from eligible papers, including developing a codebook and coding using an inductive and iterative approach (reliability k > 0.70). Confidence in review findings were evaluated using the Confidence in the Evidence from Reviews of Qualitative Research (CERQual) Approach. Subthemes were assigned to domains in the Consolidated Framework for Implementation Research. Findings: Of the 19 papers identified, 18 discussed LMSC for firearms and 1 focused exclusively on LMSC for medications. The firearm-related studies explored perspectives of a variety of stakeholders (patients, providers, members of the firearms community, healthcare leaders, and family members) across multiple settings (emergency departments, pediatric and adult primary care, and outpatient mental health). Seven overarching themes emerged, including the: (1) importance of firearms to owners' identities and perceptions of ownership as a value and right, which can lead to perceived cultural tensions in clinical settings; (2) importance of patients understanding the context and rationale for LMSC; (3) value of providers showing cultural competency when discussing firearms; (4) influence of safety and risk beliefs on firearm behaviors; (5) need to navigate logistical concerns when implementing LMSC; (6) value of individualizing LMSC; (7) potential for trusted family members and friends to be involved in implementing LMSC. Conclusion: This synthesis of the qualitative literature informs clinical, operational, and research endeavors aimed at increasing the reach and effectiveness of LMSC. Future research should address the perspectives of individuals underrepresented in the literature (e.g., those from racial/ethnic minority groups) and further examine stakeholders' perceptions of LMSC for medication. [-2pt]. Systematic review registration: [https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021237515], identifier [CRD42021237515].
ABSTRACT
BACKGROUND: The Integrated-Promoting Action on Research Implementation in Health Services (i-PARIHS) framework and its predecessor, PARIHS, have been widely utilized in implementation studies. Although i-PARIHS developers have focused on creating tools to guide facilitators in its application in practice, tools are also needed for evaluation and research. Codebooks with clear and meaningful code labels and definitions are an important component of qualitative data analysis and have been developed for other widely used frameworks. There is no such codebook for i-PARIHS. Additionally, sub-constructs for the Innovation, Recipients, and Context constructs lack definitions, and there is no sub-classification of facilitation activities for the Facilitation construct. The lack of a standardized codebook hinders our ability to synthesize research findings across studies, explore and test the range of activities that are utilized in facilitation efforts, and potentially validate and further refine i-PARIHS. This paper describes a rigorous process of developing a detailed qualitative codebook informed by the i-PARIHS framework. METHODS: A workgroup of qualitative researchers conducted a rigorous four-phase process to develop a codebook informed by i-PARIHS. In phase 1, workgroup members reviewed and discussed literature, consulted an organizational scientist, and drafted and refined subcodes and definitions for i-PARIHS constructs. In phase 2, they obtained feedback from an expert panel and further refined subcodes and definitions. In phase 3, they obtained feedback from i-PARIHS developers/experts and incorporated it into the codebook. Finally, two studies piloted the application of the codebook which informed the final version. RESULTS: The resulting i-PARIHS-informed codebook includes definitions for the four main constructs of the framework: Innovation, Recipients, Context, and Facilitation; subcodes and definitions for characteristics of each of these constructs; and instructions for the suggested application of individual codes and use of the codebook generally. CONCLUSIONS: The standardized codes and definitions in the codebook can facilitate data exploration, pattern identification, and insight development informed by the i-PARIHS framework. Qualitative analysts can also use them to explore interactions between i-PARIHS constructs, maximize the potential for comparing findings across studies, and support the refinement of the i-PARIHS framework using empirical findings from multiple studies.
ABSTRACT
OBJECTIVE: To describe the design, implementation, and plans to evaluate the Veterans Crisis Line (VCL) Caring Letters intervention. DATA SOURCES: Veterans with VCL contact and VHA service utilization. STUDY DESIGN: Caring Letters is an evidence-based post-acute care suicide prevention intervention in which brief messages are mailed to individuals at high risk of suicide repeatedly over time to communicate that people care about them and are concerned for their well-being. An effectiveness-implementation hybrid type 1 trial using the RE-AIM evaluation framework is underway to examine the use of Caring Letters with veterans who contact the VCL. A team of suicide prevention subject matter experts, researchers, and operational partners from the VCL will evaluate the effects of Caring Letters on clinical outcomes and Department of Veterans Affairs - Veterans Health Administration (VHA) clinical utilization rates and examine facilitators and barriers to implementing the Caring Letters campaign. DATA COLLECTION METHODS: Veterans who contact the VCL are linked with national administrative VHA data. Semi-structured interviews were conducted as part of a qualitative formative evaluation. PRINCIPAL FINDINGS: In the first 12 months of the intervention, Caring Letters have been sent to over 100,000 veterans with VCL contact (over 500,000 letters mailed). A formative qualitative evaluation early in implementation revealed a variety of positive veteran perspectives on the intervention. CONCLUSIONS: Partnered program design and evaluation with a high level of stakeholder engagement and participant feedback can result in a rigorous and feasible evaluation plan that improves implementation processes and produces actionable results. The initial results of this evaluation will be used to better inform care in the VHA and, specifically, the VCL.
Subject(s)
Suicide Prevention , Veterans , Humans , Postal Service , United States , United States Department of Veterans AffairsABSTRACT
Caring Letters is recommended in multiple best practice guidelines; however, the Caring Letters intervention has not been widely implemented. The process of tracking, scheduling, and mailing letters for multiple patients over many months may represent a significant barrier for busy clinicians. This evaluation examined whether the use of centralized administrative support (Centralized Caring Letters; CCL) was associated with increased utilization of the intervention. These procedures were tested in the Department of Veterans Affairs (VA) Recovery Engagement and Coordination for Health-Veterans Enhanced Treatment (REACH VET) program. In REACH VET, VA clinicians are routinely asked to consider Caring Letters as one option for veterans identified as at-risk. In this evaluation, clinicians at two VA facilities were offered assistance in the tracking, preparation, mailing, and documentation of Caring Letters for veterans they chose to enroll in CCL. The utilization of Caring Letters increased more than 14-fold after CCL was implemented. In the year that preceded CCL, 3% of REACH VET veterans were sent Caring Letters at the two sites; this increased to 43% of cases after the implementation of CCL (45% at Site 1 and 41% at Site 2). In qualitative interviews with providers, clinicians described Caring Letters as beneficial and stated that the centralized features of the program were helpful. Caring Letters were discontinued for 30% of enrolled veterans, often because of a bad address (9% of enrolled) or relocation (8% of enrolled). Although there are barriers for the use of Caring Letters, CCL was associated with a very large increase in the use of Caring Letters. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
ABSTRACT
INTRODUCTION: Implementation researchers could draw from participatory research to engage patients (consumers of healthcare) in implementation processes and possibly reduce healthcare disparities. There is a little consumer involvement in healthcare implementation, partially because no formal guidance exists. We will create and pilot a toolkit of methods to engage consumers from the US' Veterans Health Administration (VHA) in selecting and tailoring implementation strategies. This toolkit, Consumer Voice, will provide guidance on what, when, where, how and why an implementer might engage consumers in implementing treatments. We will pilot the toolkit by implementing Safety Planning Intervention for suicide prevention with rural veterans, a population with suicide disparities. Safety Planning Intervention is effective for reducing suicidal behaviours. METHODS AND ANALYSIS: In Aim 1, we will use participatory approaches and user-centred design to develop Consumer Voice and its methods. In Aim 2, we will pilot Consumer Voice by implementing the Safety Planning Intervention in two clinics serving rural VHA patients. One site will receive a current implementation strategy (Implementation Facilitation) only; the second will receive Implementation Facilitation plus Consumer Voice. We will use mixed methods to assess feasibility and acceptability of Consumer Voice. We will compare sites on preliminary implementation (reach, adoption, fidelity) and clinical outcomes (depression severity, suicidal ideation, suicidal behaviour). In Aim 3, we will evaluate Aim 2 outcomes at 20 months to assess sustained impact. We will gather qualitative data on sustainability of the Safety Planning Intervention. ETHICS AND DISSEMINATION: These studies are overseen by the Institutional Review Board at the Central Arkansas Veterans Healthcare System. We plan to use traditional academic modalities of dissemination (eg, conferences, publications). We plan to disseminate findings through meetings with other trainers in implementation practice so they may adopt Consumer Voice. We plan to share results with local community boards.