Preimplementation Evaluation of a Self-Directed Care Program in a Veterans Health Administration Regional Network: Protocol for a Mixed Methods Study.

BACKGROUND: The Veteran-Directed Care (VDC) program serves to assist veterans at risk of long-term institutional care to remain at home by providing funding to hire veteran-selected caregivers. VDC is operated through partnerships between Department of Veterans Affairs (VA) Medical Centers (VAMCs) and third-party Aging and Disability Network Agency providers. OBJECTIVE: We aim to identify facilitators, barriers, and adaptations in VDC implementation across 7 VAMCs in 1 region: Veterans Integrated Service Network (VISN) 8, which covers Florida, South Georgia, Puerto Rico, and the US Virgin Islands. We also attempted to understand leadership and stakeholder perspectives on VDC programs' reach and implementation and identify veterans served by VISN 8's VDC programs and describe their home- and community-based service use. Finally, we want to compare veterans served by VDC programs in VISN 8 to the veterans served in VDC programs across the VA. This information is intended to be used to identify strategies and propose recommendations to guide VDC program expansion in VISN 8. METHODS: The mixed methods study design encompasses electronically delivered surveys, semistructured interviews, and administrative data. It is guided by the Consolidated Framework for Implementation Research (CFIR version 2.0). Participants included the staff of VAMCs and partnering aging and disability network agencies across VISN 8, leadership at these VAMCs and VISN 8, veterans enrolled in VDC, and veterans who declined VDC enrollment and their caregivers. We interviewed selected VAMC site leaders in social work, Geriatrics and Extended Care, and the Caregiver Support Program. Each interviewee will be asked to complete a preinterview survey that includes information about their personal characteristics, experiences with the VDC program, and perceptions of program aspects according to the CFIR (version 2.0) framework. Participants will complete a semistructured interview that covers constructs relevant to the respondent and facilitators, barriers, and adaptations in VDC implementation at their site. RESULTS: We will calculate descriptive statistics including means, SDs, and percentages for survey responses. Facilitators, barriers, number of patients enrolled, and staffing will also be presented. Interviews will be analyzed using rapid qualitative techniques guided by CFIR domains and constructs. Findings from VISN 8 will be collated to identify strategies for VDC expansion. We will use administrative data to describe veterans served by the programs in VISN 8. CONCLUSIONS: The VA has prioritized VDC rollout nationwide and this study will inform these expansion efforts. The findings from this study will provide information about the experiences of the staff, leadership, veterans, and caregivers in the VDC program and identify program facilitators and barriers. These results may be used to improve program delivery, facilitate growth within VISN 8, and inform new program establishment at other sites nationwide as the VDC program expands. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/57341.

Multisite Agricultural Veterans Affairs Farming and Recovery Mental Health Services (VA FARMS) Pilot Program: Protocol for a Responsive Mixed Methods Evaluation Study.

BACKGROUND: Veterans Affairs Farming and Recovery Mental Health Services (VA FARMS) is an innovative pilot program to provide supportive resources for veterans with interests in agricultural vocations. Implemented at 10 pilot sites, VA FARMS will provide mental health services and resources for veterans while supporting training in gardening and agriculture. As each pilot site project has unique goals, outreach strategies, and implementation efforts based on the local environment and veteran population, evaluating the pilot program provides a unique challenge for evaluators. This paper describes the protocol to evaluate VA FARMS, which was specifically designed to enable site variation by providing both site-specific and cross-site understanding of site implementation processes and outcomes. OBJECTIVE: The objectives of this paper are to (1) describe the protocol used for evaluating VA FARMS, as an innovative Department of Veterans Affairs (VA) agriculturally based, mental health, and employment pilot program serving veterans at 10 pilot sites across the Veterans Health Administration enterprise; and (2) provide guidance to other evaluators assessing innovative programs. METHODS: This evaluation uses the context, inputs, process, product (CIPP) model, which evaluates a program's content and implementation to identify strengths and areas for improvement. Data collection will use a concurrent mixed methods approach. Quantitative data collection will involve quarterly program surveys, as well as three individual veteran participant surveys administered upon the veteran's entrance and exit of the pilot program and 3 months postexit. Quantitative data will include baseline descriptive statistics and follow-up statistics on veteran health care utilization, health care status, and agriculture employment status. Qualitative data collection will include participant observation at each pilot site, and interviews with participants, staff, and community stakeholders. Qualitative data will provide insights about pilot program implementation processes, veterans' experiences, and short-term participation outcomes. RESULTS: Evaluation efforts began in December 2018 and are ongoing. Between October 2018 and September 2020, 494 veterans had enrolled in VA FARMS and 1326 veterans were reached through program activities such as demonstrations, informational presentations, and town-hall discussions. A total of 1623 community members and 655 VA employees were similarly reached by VA FARMS programming during that time. Data were collected between October 2018 and September 2020 in the form of 336 veteran surveys, 30 veteran interviews, 27 staff interviews, and 11 community partner interviews. Data analysis is expected to be completed by October 2022. CONCLUSIONS: This evaluation protocol will provide guidance to other evaluators assessing innovative programs. In its application to the VA FARMS pilot, the evaluation aims to add to existing literature on nature-based therapies and the rehabilitation outcomes of agricultural training programs for veterans. Results will provide programmatic insights on the implementation of pilot programs, along with needed improvements and modifications for the future expansion of VA FARMS and other veteran-focused agricultural programs. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/40496.