Interprofessional education in the clinical learning environment: a mixed-methods evaluation of a longitudinal experience in the primary care setting.

Team collaboration in our healthcare workforce is necessary to effectively address multifaceted medical and social needs, especially for those impacted by systemic inequities. Effective interprofessional practice and education models including curricula are needed to prepare a practice ready healthcare workforce for team collaboration. Most healthcare trainee interprofessional experiences take place episodically in classroom settings. However, creating a culture that supports team-based learning and interprofessional clinical practice requires teaching skills (e.g., communication, collaboration, shared decision-making, coordination of care) longitudinally in the clinical setting. A weekly interprofessional clinic for patients/clients with chronic health conditions was organized in three primary care practices. Trainees from nutrition, social work, medicine, and physician assistant programs worked with supervising clinicians from each field. Surveys, interviews, and focus groups assessed the effects of interprofessional education and training in the primary care setting. Results show the longitudinal experiential IPE program significantly improved knowledge, attitudes, skills, and values addressing key interprofessional competencies. Qualitative results complement survey data and highlight key themes addressing patient-centered care and team dynamics. These findings demonstrate the importance of longitudinal, immersive team-based interprofessional training in the clinical learning environment.

[Promoting physical activity in women during breast cancer therapy: A mixed methods evaluation of a nursing counselling intervention]. / Bewegungsförderung bei Frauen während der Brustkrebstherapie.

Promoting physical activity in women during breast cancer therapy: A mixed methods evaluation of a nursing counselling intervention Abstract. Background: Physical activity is associated with improved quality of life in women during breast cancer treatment. However, how physical activity behaviour of patients changes in the first months after the start of the treatment and what role nursing counselling can play has not yet been sufficiently investigated. Aim: To observe differences in physical activity behaviour in women with breast cancer at the time of the initiation of the therapy and six months later, and to explore patients' and health professionals' perspective on a nursing counselling intervention on physical activity. Methods: A mixed-methods evaluation was conducted. In the quantitative part, the physical activity behaviour was assessed at two time points (t0 and t1) with the SQUASH instrument (30-2Wendel-Vos, 2003). In the qualitative part, one focus group interview was conducted with patients and health professionals separately. The quantitative data were analyzed using descriptive and inductive statistics. The qualitative data were analyzed thematically. Results: The sample (N = 47) showed a slight, but not significant increase in the extent of physical activity comparing t1 with t0. A statistically significant increase in the amount of exercise between t0 and t1 was only found in the category "work" (p = 0,002). The central theme of the women was that they felt encouraged by the nursing counselling intervention to "do something for themselves". For the health professionals, in the context of counselling it was important that they themselves were convinced of the importance of physical activity. Conclusions: The integration of physical activity into everyday life is a challenge for women with breast cancer during therapy. A counselling intervention is perceived as supportive but could have a more lasting effect through a longer-term physical activity programme.

Effects of transition on HIV and non-HIV services and health systems in Kenya: a mixed methods evaluation of donor transition.

BACKGROUND: In 2015 the US President's Emergency Plan for AIDS Relief (PEPFAR) initiated its Geographic Prioritization (GP) process whereby it prioritized high burden areas within countries, with the goal of more rapidly achieving the UNAIDS 90-90-90 targets. In Kenya, PEPFAR designated over 400 health facilities in Northeastern Kenya to be transitioned to government support (known as central support (CS)). METHODS: We conducted a mixed methods evaluation exploring the effect of GP on health systems, and HIV and non-HIV service delivery in CS facilities. Quantitative data from a facility survey and health service delivery data were gathered and combined with data from two rounds of interviews and focus group discussions (FGDs) conducted at national and sub-national level to document the design and implementation of GP. The survey included 230 health facilities across 10 counties, and 59 interviews and 22 FGDs were conducted with government officials, health facility providers, patients, and civil society. RESULTS: We found that PEPFAR moved quickly from announcing the GP to implementation. Despite extensive conversations between the US government and the Government of Kenya, there was little consultation with sub-national actors even though the country had recently undergone a major devolution process. Survey and qualitative data identified a number of effects from GP, including discontinuation of certain services, declines in quality and access to HIV care, loss of training and financial incentives for health workers, and disruption of laboratory testing. Despite these reports, service coverage had not been greatly affected; however, clinician strikes in the post-transition period were potential confounders. CONCLUSIONS: This study found similar effects to earlier research on transition and provides additional insights about internal country transitions, particularly in decentralized contexts. Aside from a need for longer planning periods and better communication and coordination, we raise concerns about transitions driven by epidemiological criteria without adaptation to the local context and their implication for priority-setting and HIV investments at the local level.

Family-based Intervention for Legal System-involved Girls: A Mixed Methods Evaluation.

The increased proportion of juvenile court-involved girls has spurred interest to implement and evaluate services to reduce girls' system involvement. The purpose of this study was to examine the effectiveness of a family-based intervention by using a dominant sequential mixed methods evaluation approach. First, we examined quantitative data using a quasi-experimental design to determine whether the family-based intervention reduced recidivism among court-involved girls. Propensity score matching (PSM) was used to construct statistically equivalent groups to compare one-year recidivism outcomes for girls who received the court-run family-based intervention (n = 181) to a group of girls on probation who did not receive the intervention (n = 803). Qualitative interviews (n = 39) were conducted to contextualize the quantitative findings and highlighted the circumstances that family-focused interventions for court-involved girls. Girls who received the program had slightly lower recidivism rates following the intervention. The qualitative findings contextualized the quasi-experimental results by providing an explanation as to the girls' family circumstances and insights into the mechanisms of the intervention. Results highlighted the importance of family-focused interventions for juvenile justice-involved girls. These findings have practical and policy implications for the use interventions-beyond the individual level-with adjudicated girls and offer suggestions for ways to improve their effectiveness using a community psychology lens. In addition, this paper includes a discussion of evaluating of juvenile court programming from a community psychology perspective including strengths, challenges, and considerations for future work in this area.

Improving systems of care during and after a pregnancy complicated by hyperglycaemia: A protocol for a complex health systems intervention.

BACKGROUND: Many women with hyperglycaemia in pregnancy do not receive care during and after pregnancy according to standards recommended in international guidelines. The burden of hyperglycaemia in pregnancy falls disproportionately upon Indigenous peoples worldwide, including Aboriginal and Torres Strait Islander women in Australia. The remote and regional Australian context poses additional barriers to delivering healthcare, including high staff turnover and a socially disadvantaged population with a high prevalence of diabetes. METHODS: A complex health systems intervention to improve care for women during and after a pregnancy complicated by hyperglycaemia will be implemented in remote and regional Australia (the Northern Territory and Far North Queensland). The Theoretical Domains Framework was used during formative work with stakeholders to identify intervention components: (1) increasing workforce capacity, skills and knowledge and improving health literacy of health professionals and women; (2) improving access to healthcare through culturally and clinically appropriate pathways; (3) improving information management and communication; (4) enhancing policies and guidelines; (5) embedding use of a clinical register as a quality improvement tool. The intervention will be evaluated utilising the RE-AIM framework at two timepoints: firstly, a qualitative interim evaluation involving interviews with stakeholders (health professionals, champions and project implementers); and subsequently a mixed-methods final evaluation of outcomes and processes: interviews with stakeholders; survey of health professionals; an audit of electronic health records and clinical register; and a review of operational documents. Outcome measures include changes between pre- and post-intervention in: proportion of high risk women receiving recommended glucose screening in early pregnancy; diabetes-related birth outcomes; proportion of women receiving recommended postpartum care including glucose testing; health practitioner confidence in providing care, knowledge and use of relevant guidelines and referral pathways, and perception of care coordination and communication systems; changes to health systems including referral pathways and clinical guidelines. DISCUSSION: This study will provide insights into the impact of health systems changes in improving care for women with hyperglycaemia during and after pregnancy in a challenging setting. It will also provide detailed information on process measures in the implementation of such health system changes.

Implementation Research as Applied Science: Bridging the Research to Practice Gap.

Implementation research is intended to address challenges posed by the slow adoption of evidence-based science by the medical and health promotion practice community. A case study approach is used to illustrate and discuss the use of Quality improvement and Evaluation as an applied approach to implementation science in contrast of more classic purposes of research. Quality improvement was the implementation model used to facilitate organizational change needed to adopt the use of texting to report sexually transmitted infection test results in over a fifth of Florida's larger county health departments. Both quantitative and qualitative methods were used to evaluate implementation. All seven participating county health departments were successful in enrolling clients in texting with extensive variation (24% to 72%) in texting enrollment at the end of the 10-month study. Statistically significant outcomes for those enrolled in texting were recorded through Florida's online sexually transmitted infection reporting system in the form of increased number of people receiving early (1-4 days) treatment and reductions in delayed (≥8 days) or no treatment. This study illustrates an applied approach to implementation research which may be critical to adapt emerging evidence and technologies to the multiple and complex characteristics of the diverse populations served by health promotion institutions.

Mixed-methods evaluation of a transition and young adult clinic for kidney transplant recipients.

The aims of the present study were to describe the experiences of kidney transplant patients attending a young adult clinic or a regular adult clinic, to explore similarities and differences between the groups, and to conduct an evaluation of the clinical and psychosocial outcomes of the young adult clinic, by comparing these outcomes to those of the regular adult clinic. A mixed-methods design combining qualitative and quantitative data was used. Empirically validated questionnaires measuring self-determination theory variables, quality of life, and adherence were distributed to all consenting patients attending the YAC (n = 17) and RAC (n = 16). Semi-structured interviews were conducted with a subsample of the first (n = 10) and second group (n = 8), and analyzed using thematic analysis. Clinical outcomes were retrieved from medical records. Descriptive, correlational, and comparative analyses were performed. We found clinically significant differences on tacrolimus blood levels variability, self-reported adherence, and physical quality of life. Small and medium effect sizes were detected. No statistical differences were found. Statistically significant correlations were found between self-determination theory variables and both physical quality of life and different measures of adherence. Four themes characterized patients' experiences: resilience; relational needs and the therapeutic alliance; quest for balance; and quest for normalcy. The young adult clinic seems to meet its initial objectives and to make a difference particularly in the early period post-transition, but over time what matters most for patients is therapeutic alliance. Mental health issues need to be better addressed, and special attention should be paid to youths transplanted in an adult setting.

A mixed methods evaluation of an integrated adult mental health service model.

BACKGROUND: The Floresco integrated service model was designed to address the fragmentation of community mental health treatment and support services. Floresco was established in Queensland, Australia, by a consortium of non-government organisations that sought to partner with general practitioners (GPs), private mental health providers and public mental health services to operate a 'one-stop' mental health service hub. METHODS: We conducted an independent mixed-methods evaluation of client outcomes following engagement with Floresco (outcome evaluation) and factors influencing service integration (process evaluation). The main data sources were: (1) routinely-collected Recovery Assessment Scale - Domains and Stages (RAS-DS) scores at intake and review (n = 108); (2) RAS-DS scores, mental health inpatient admissions and emergency department (ED) presentations among clients prospectively assessed at intake and six-month follow-up (n = 37); (3) semi-structured interviews with staff from Floresco, consortium partners, private practitioners and the local public mental health service (n = 20); and (4) program documentation. RESULTS: Interviews identified staff commitment, co-location of services, flexibility in problem-solving, and anecdotal evidence of positive client outcomes as important enablers of service integration. Barriers to integration included different organisational practices, difficulties in information-sharing and in attracting and retaining GPs and private practitioners, and systemic constraints on integration with public mental health services. Of 1129 client records, 108 (9.6%) included two RAS-DS measurements, averaging 5 months apart. RAS-DS 'total recovery' scores improved significantly (M = 63.3%, SD = 15.6 vs. M = 69.2%, SD = 16.1; p < 0.001), as did scores on three of the four RAS-DS domains ('Looking forward', p < 0.001; 'Mastering my illness', p < 0.001; and 'Connecting and belonging', p = 0.001). Corresponding improvements, except in 'Connecting and belonging', were seen in the 37 follow-up study participants. Decreases in inpatient admissions (20.9% vs. 7.0%), median length of inpatient stay (8 vs. 3 days), ED presentations (34.8% vs. 6.3%) and median duration of ED visits (187 vs. 147 min) were not statistically significant. CONCLUSIONS: Despite the lack of a control group and small follow-up sample size, Floresco's integrated service model showed potential to improve client outcomes and reduce burden on the public mental health system. Horizontal integration of non-government and private services was achieved, and meaningful progress made towards integration with public mental health services.

The impact of a small-group educational intervention for allied health professionals to enhance evidence-based practice: mixed methods evaluation.

BACKGROUND: Healthcare professionals are recommended to use evidence-based practice (EBP) principles to update and improve clinical practice. Well-designed educational initiatives, together with practice and feedback opportunities can improve individuals' EBP knowledge, skills and attitudes. METHODS: A concurrent mixed methods assessment was designed to evaluate the effectiveness and feasibility of four monthly workshops on allied health professionals' knowledge, skills, self-efficacy and behaviour. In between workshops, professionals were encouraged to practice and integrate EBP learnings with colleagues in their workplace. Participants completed three pre and post intervention assessments: Evidence-based Practice Confidence Scale; adapted Fresno test; and an adapted EBP Implementation Scale. A purpose designed satisfaction questionnaire was completed immediately after the educational intervention and follow up focus groups were conducted after 3 months. Mean change in assessment data was quantitatively assessed and comments from the clinician satisfaction questionnaire and focus groups were thematically analysed and interpreted together with quantitative data using the Classification Rubric for EBP Assessment tools in Education (CREATE). RESULTS: Sixteen allied health professionals participated in the EBP workshops and completed all baseline and post intervention assessments. Seven clinicians participated in follow up focus groups. All clinicians reported a positive reaction to the learning experience, preferring short monthly workshops to a full day session. They self-reported improvements in self-efficacy (mean change 15 p < 0.001) and implementing EBP behaviours (mean change 7, p < 0.001) from pre- to post-intervention. Although the positive change in EBP knowledge measured by the adapted Fresno test was not statistically significant (mean change 10, p = 0.21), clinicians described examples of improved knowledge and skills across all five key steps of EBP during the focus groups. A further, post hoc analysis of individual questions in the two self-reported scales indicated consistent improvement across key EBP knowledge and skills. CONCLUSIONS: A tailored small group EBP education intervention can enhance AHPs' self-efficacy to develop answerable questions, search the literature, critically appraise, apply and evaluate research evidence. Through practicing these behaviours and sharing new learning with their peers, allied health professionals can enhance their capability and motivation to use research evidence to potentially improve clinical practice.

Supporting the implementation of stroke quality-based procedures (QBPs): a mixed methods evaluation to identify knowledge translation activities, knowledge translation interventions, and determinants of implementation across Ontario.

BACKGROUND: In 2013, Health Quality Ontario introduced stroke quality-based procedures (QBPs) to promote use of evidence-based practices for patients with stroke in Ontario hospitals. The study purpose was to: (a) describe the knowledge translation (KT) interventions used to support stroke QBP implementation, (b) assess differences in the planned and reported KT interventions by region, and (c) explore determinants perceived to have affected outcomes. METHODS: A mixed methods approach was used to evaluate: activities, KT interventions, and determinants of stroke QBP implementation. In Phase 1, a document review of regional stroke network work plans was conducted to capture the types of KT activities planned at a regional level; these were mapped to the knowledge to action framework. In Phase 2, we surveyed Ontario hospital staff to identify the KT interventions used to support QBP implementation at an organizational level. Phase 3 involved qualitative interviews with staff to elucidate deeper understanding of survey findings. RESULTS: Of the 446 activities identified in the document review, the most common were 'dissemination' (24.2%; n = 108), 'implementation' (22.6%; n = 101), 'implementation planning' (15.0%; n = 67), and 'knowledge tools' (10.5%; n = 47). Based on survey data (n = 489), commonly reported KT interventions included: staff educational meetings (43.1%; n = 154), champions (41.5%; n = 148), and staff educational materials (40.6%; n = 145). Survey participants perceived stroke QBP implementation to be successful (median = 5/7; interquartile range = 4-6; range = 1-7; n = 335). Forty-four people (e.g., managers, senior leaders, regional stroke network representatives, and frontline staff) participated in interviews/focus groups. Perceived facilitators to QBP implementation included networks and collaborations with external organizations, leadership engagement, and hospital prioritization of stroke QBP. Perceived barriers included lack of funding, size of the hospital (i.e., too small), lack of resources (i.e., staff and time), and simultaneous implementation of other QBPs. CONCLUSIONS: Information on the types of activities and KT interventions used to support stroke QBP implementation and the key determinants influencing uptake of stroke QBPs can be used to inform future activities including the development and evaluation of interventions to address barriers and leverage facilitators.

Impact of the Macmillan specialist Care at Home service: a mixed methods evaluation across six sites.

BACKGROUND: The Midhurst Macmillan Specialist Palliative Care at Home Service was founded in 2006 to improve community-based palliative care provision. Principal components include; early referral; home-based clinical interventions; close partnership working; and flexible teamwork. Following a successful introduction, the model was implemented in six further sites across England. This article reports a mixed methods evaluation of the implementation across these 'Innovation Centres'. The evaluation aimed to assess the process and impact on staff, patients and carers of providing Macmillan Specialist Care at Home services across the six sites. METHODS: The study was set within a Realist Evaluation framework and used a longitudinal, mixed methods research design. Data collection over 15 months (2014-2016) included: Quantitative outcome measures - Palliative Performance Scale [PPS] and Palliative Prognostic Index [PPI] (n = 2711); Integrated Palliative Outcome Scales [IPOS] (n = 1157); Carers Support Needs Assessment Tool [CSNAT] (n = 241); Views of Informal Carers -Evaluation of Services [VOICES-SF] (n = 102); a custom-designed Service Data Tool [SDT] that gathered prospective data from each site (n = 88). Qualitative data methods included: focus groups with project team and staff (n = 32 groups with n = 190 participants), and, volunteers (n = 6 groups with n = 32 participants). Quantitative data were analysed using SPPS Vs. 21 and qualitative data was examined via thematic analysis. RESULTS: Comparison of findings across the six sites revealed the impact of their unique configurations on outcomes, compounded by variations in stage and mode of implementation. PPS, PPI and IPOS data revealed disparity in early referral criteria, complicated by contrasting interpretations of palliative care. The qualitative analysis, CSNAT and VOICES-SF data confirmed the value of the Macmillan model of care but uptake of specialist home-based clinical interventions was limited. The Macmillan brand engendered patient and carer confidence, bringing added value to existing services. Significant findings included better co-ordination of palliative care through project management and a single referral point and multi-disciplinary teamwork including leadership from consultants in palliative medicine, the role of health care assistants in rapid referral, and volunteer support. CONCLUSIONS: Macmillan Specialist Care at Home increases patient choice about place of death and enhances the quality of end of life experience. Clarification of key components is advocated to aid consistency of implementation across different sites and support future evaluative work.

Models of reablement evaluation (MoRE): a study protocol of a quasi-experimental mixed methods evaluation of reablement services in England.

BACKGROUND: Reablement is a time-limited intervention that aims to support people to regain independence and enable them to resume their daily activities after they return home from an in-patient care setting, or to maintain independence to enable them to remain at home. There is some evidence that reablement can enhance independence and has the potential to contain costs. However, reablement services are funded and provided in different ways and by different organisations, and there is limited research evidence about the effectiveness of different reablement service models. This study will evaluate the effectiveness and cost-effectiveness of different reablement service models and service users' and carers' experiences of reablement in England, UK. METHODS/DESIGN: The study will use a quasi-experimental mixed methods design that comprises three work packages (WP) extending over a period of 34 months. WP1 will conduct cluster analysis on survey data to develop a typology of current models of reablement services in order to describe the current reablement service landscape. WP2 will comprise a quantitative outcomes evaluation of the effectiveness of the different service models; a process evaluation and an economic evaluation. WP2 will be set within generic reablement services, where providers are using the most commonly employed generic reablement service types identified in WP1; the primary outcome measure is health-related quality of life measured by the EQ-5D-5L. WP3 will provide evidence about specialist reablement services and how specialist approaches and practices are organised and delivered. DISCUSSION: Managing demands on care services is, and will remain, a crucial factor for the UK National Health Service as the number of people with long-term conditions rise. There has been, and will continue to be, significant investment in reablement services. The proposed study will address several key areas where there is limited evidence regarding the organisation and delivery of reablement services in England, UK. Specifically, it will provide new evidence on different models of reablement services that will be of direct benefit to health and social care managers, commissioners and their partner organisations.

Can comprehensive specialised end-of-life care be provided at home? Lessons from a study of an innovative consultant-led community service in the UK.

The Midhurst Macmillan Specialist Palliative Care Service (MMSPCS) is a UK, medical consultant-led, multidisciplinary team aiming to provide round-the-clock advice and care, including specialist interventions, in the home, community hospitals and care homes. Of 389 referrals in 2010/11, about 85% were for cancer, from a population of about 155 000. Using a mixed method approach, the evaluation comprised: a retrospective analysis of secondary-care use in the last year of life; financial evaluation of the MMSPCS using an Activity Based Costing approach; qualitative interviews with patients, carers, health and social care staff and MMSPCS staff and volunteers; a postal survey of General Practices; and a postal survey of bereaved caregivers using the MMSPCS. The mean cost is about 3000 GBP (3461 EUR) per patient with mean cost of interventions for cancer patients in the last year of life 1900 GBP (2192 EUR). Post-referral, overall costs to the system are similar for MMSPCS and hospice-led models; however, earlier referral avoided around 20% of total costs in the last year of life. Patients and carers reported positive experiences of support, linked to the flexible way the service worked. Seventy-one per cent of patients died at home. This model may have application elsewhere.

The health mentors program: three years experience with longitudinal, patient-centered interprofessional education.

Increased emphasis on team care has accelerated interprofessional education (IPE) of health professionals. The health mentors program (HMP) is a required, longitudinal, interprofessional curriculum for all matriculating students from medicine, nursing, occupational therapy, physical therapy, pharmacy, and couple and family therapy. Volunteer lay health mentors serve as educators. Student teams complete four modules over 2 years. A mixed-methods approach has been employed since program inception, evaluating 2911 students enrolled in HMP from 2007 to 2013. Program impact on 577 students enrolled from 2009-2011 is reported. Two interprofessional scales were employed to measure attitudes toward IPE and attitudes toward interprofessional practice. Focus groups and reflection papers provide qualitative data. Students enter professional training with very positive attitudes toward IPE, which are maintained over 2 years. Students demonstrated significantly improved attitudes toward team care, which were not different across programs. Qualitative data suggested limited tolerance for logistic challenges posed by IPE, but strongly support that students achieved the major program goals of understanding the roles of colleagues and understanding the perspective of patients. Ongoing longitudinal evaluation will further elucidate the impact on future practice and patient outcomes.

Investigating innovations in outpatient services: a mixed-methods rapid evaluation.

Background: Within outpatient services, a broad range of innovations are being pursued to better manage care and reduce unnecessary appointments. One of the least-studied innovations is Patient-Initiated Follow-Up, which allows patients to book appointments if and when they need them, rather than follow a standard schedule. Objectives: To use routine national hospital data to identify innovations in outpatient services implemented, in recent years, within the National Health Service in England. To carry out a rapid mixed-methods evaluation of the implementation and impact of Patient-Initiated Follow-Up. Methods: The project was carried out in four sequential workstreams: (1) a rapid scoping review of outpatient innovations; (2) the application of indicator saturation methodology for scanning national patient-level data to identify potentially successful local interventions; (3) interviews with hospitals identified in workstream 2; and (4) a rapid mixed-methods evaluation of Patient-Initiated Follow-Up. The evaluation of Patient-Initiated Follow-Up comprised an evidence review, interviews with 36 clinical and operational staff at 5 National Health Service acute trusts, a workshop with staff from 13 National Health Service acute trusts, interviews with four patients, analysis of national and local data, and development of an evaluation guide. Results: Using indicator saturation, we identified nine services with notable changes in follow-up to first attendance ratios. Of three sites interviewed, two queried the data findings and one attributed the change to a clinical assessment service. Models of Patient-Initiated Follow-Up varied widely between hospital and clinical specialty, with a significant degree of variation in the approach to patient selection, patient monitoring and discharge. The success of implementation was dependent on several factors, for example, clinical condition, staff capacity and information technology systems. From the analysis of national data, we found evidence of an association between greater use of Patient-Initiated Follow-Up and a lower frequency of outpatient attendance within 15 out of 29 specialties and higher frequency of outpatient attendance within 7 specialties. Four specialties had less frequent emergency department visits associated with increasing Patient-Initiated Follow-Up rates. Patient-Initiated Follow-Up was viewed by staff and the few patients we interviewed as a positive intervention, although there was varied impact on individual staff roles and workload. It is important that sites and services undertake their own evaluations of Patient-Initiated Follow-Up. To this end we have developed an evaluation guide to support trusts with data collection and methods. Limitations: The Patient-Initiated Follow-Up evaluation was affected by a lack of patient-level data showing who is on a Patient-Initiated Follow-Up pathway. Engagement with local services was also challenging, given the pressures facing sites and staff. Patient recruitment was low, which affected the ability to understand experiences of patients directly. Conclusions: The study provides useful insights into the evolving national outpatient transformation policy and for local practice. Patient-Initiated Follow-Up is often perceived as a positive intervention for staff and patients, but the impact on individual outcomes, health inequalities, wider patient experience, workload and capacity is still uncertain. Future research: Further research should include patient-level analysis to determine clinical outcomes for individual patients on Patient-Initiated Follow-Up and health inequalities, and more extensive investigation of patient experiences. Study registration: This study is registered with the Research Registry (UIN: researchregistry8864). Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (NIHR award ref: 16/138/17) and is published in full in Health and Social Care Delivery Research; Vol. 12, No. 38. See the NIHR Funding and Awards website for further award information.

When someone visits hospital for an operation or an ongoing condition, they are given follow-up appointments at clinics, often after 6 months. The National Health Service thinks that many of these appointments are not necessary because they are not useful to patients. Also, outside fixed appointments, patients are not always being seen when they are most in need. Hospitals have been testing new ways to improve services. We looked at hospital data and discussed interesting findings with hospitals themselves to see if we could find approaches that worked. We then looked at one new approach called Patient-Initiated Follow-Up. Patients using Patient-Initiated Follow-Up can book appointments when they are needed, rather than at a pre-planned time. We explored how Patient-Initiated Follow-Up was being used in hospitals, what effect it was having and what patients and National Health Service staff thought about it. We studied hospital data and interviewed patients and National Health Service staff. We found that Patient-Initiated Follow-Up works differently depending on the hospital and the patient's condition. Patient-Initiated Follow-Up is most frequently used for patients needing short-term follow-up, such as after an operation. It is also starting to be used for patients with long-term chronic conditions. National Health Service staff think that Patient-Initiated Follow-Up can benefit patients, although some may find it easier to use than others. Patients appear to like Patient-Initiated Follow-Up, but some still prefer to let the hospital schedule appointments. From data it appears that for some conditions, where more patients use Patient-Initiated Follow-Up, fewer follow-up visits are required. For a few conditions, there is evidence of fewer emergency department visits, but the overall impact is small. We interviewed staff from a small number of hospitals and four patients, so what we found may not apply across the National Health Service. We also developed a guide to help hospitals evaluate the success of their own Patient-Initiated Follow-Up services.

Family-based education and follow-up program for patients with burns: A mixed assessment study.

BACKGROUND: Burn injuries are a major cause of morbidity and mortality worldwide, affecting not only the patients but also their families. Family-based education and follow-up program are interventions that aim to improve the quality of life and psychosocial outcomes of patients with burns and their families. However, we find a lack of evidence on the effectiveness and feasibility of these programs in different settings and populations. This study aimed to evaluate the features of the family-based education and follow-up program (FBEFP), a pilot project that was developed and implemented at the Tabriz Sina Teaching Hospital in 2020 to improve its burn care system. DESIGN: A mixed-methods approach was used to collect and analyze both quantitative and qualitative data from various sources, such as, questionnaires, medical records, interviews and observation notes, to assess the content, process, and outcome of the program. The study followed the three steps of the CDC's framework for program evaluation: describing the program, measuring its effectiveness, and providing recommendations for improvement. RESULTS: The results of this study revealed the positive impacts of the FBEFP on the patients' physical, psychological, and social outcomes and quality of life. 4.8% of the people in the follow-up group were re-admitted, while this amount was 7.2% in the group without follow-up. Although the number of readmissions was less in the non-follow-up group, statistically no significant difference was observed between the two ratios before and after follow-up. In order to evaluate satisfaction rates, In the follow-up group, 72 patients and in the non-follow-up group, 38 patients were reached. After converting these data to normal distribution, using t-tests, it was determined that the difference between the two studied groups was highly significant. In other words, the follow-up process had favorable results on satisfaction of the studied people. However, the study also identified some challenges and barriers in implementing the program, such as lack of resources, staff training, and family involvement. CONCLUSION: FBEFP is a promising intervention that enhances the well-being of patients with burns and their families. However, more evidence is needed to support its effectiveness and feasibility in different contexts and populations. The study also provided valuable insights into the benefits and challenges of implementing a Family-Based Education and Follow-up Program for patients with burns in a low-resource setting. The study contributed to the development of guidelines and recommendations for future research and practice in this field.

Digital Interventions for Reducing Loneliness and Depression in Korean College Students: Mixed Methods Evaluation.

BACKGROUND: The COVID-19 pandemic has exacerbated the prevalence of loneliness and depression among college students. Digital interventions, such as Woebot (Woebot Health, Inc) and Happify (Twill Inc), have shown promise in alleviating these symptoms. OBJECTIVE: This study aims to investigate the effectiveness and acceptability of Woebot and Happify in reducing loneliness and depression among college students after the COVID-19 pandemic. METHODS: A mixed methods approach was used over 4 months. A total of 63 participants aged 18 to 27 years from Sungkyunkwan University in Seoul, South Korea, were initially recruited, with an inclusion criterion of University of California, Los Angeles (UCLA) Loneliness Scale score ≥34. The final sample consisted of 27 participants due to attrition. Participants were randomly assigned to Woebot (15/27, 55%); Happify (9/27, 33%); or a control group using Bondee (Metadream), a metaverse social network messenger app (3/27, 11%). Quantitative measures (UCLA Loneliness Scale and Patient Health Questionnaire-9) and qualitative assessments (user feedback and focused interviews) were used. RESULTS: Although mean decreases in loneliness and depression were observed in the control and intervention groups after the intervention, the differences between the control and intervention groups were not statistically significant (UCLA Loneliness: P=.67; Patient Health Questionnaire-9: P=.35). Qualitative data indicated user satisfaction, with suggestions for improved app effectiveness and personalization. CONCLUSIONS: Despite limitations, this study highlights the potential of well-designed digital interventions in alleviating college students' loneliness and depression. The findings contribute to the growing body of research on accessible digital mental health tools and underscore the importance of comprehensive support systems. Further research with larger and more diverse samples is needed to better understand the effectiveness and optimization of such interventions. TRIAL REGISTRATION: Clinical Research Information Service KCT0009449; https://bit.ly/4d2e4Bu.

Veteran Experiences With an mHealth App to Support Measurement-Based Mental Health Care: Results From a Mixed Methods Evaluation.

BACKGROUND: Mental health conditions are highly prevalent among US veterans. The Veterans Health Administration (VHA) is committed to enhancing mental health care through the integration of measurement-based care (MBC) practices, guided by its Collect-Share-Act model. Incorporating the use of remote mobile apps may further support the implementation of MBC for mental health care. OBJECTIVE: This study aims to evaluate veteran experiences with Mental Health Checkup (MHC), a VHA mobile app to support remote MBC for mental health. METHODS: Our mixed methods sequential explanatory evaluation encompassed mailed surveys with veterans who used MHC and follow-up semistructured interviews with a subset of survey respondents. We analyzed survey data using descriptive statistics. We then compared responses between veterans who indicated having used MHC for ≥3 versus <3 months using χ2 tests. We analyzed interview data using thematic analysis. RESULTS: We received 533 surveys (533/2631, for a 20% response rate) and completed 20 interviews. Findings from these data supported one another and highlighted 4 key themes. (1) The MHC app had positive impacts on care processes for veterans: a majority of MHC users overall, and a greater proportion who had used MHC for ≥3 months (versus <3 months), agreed or strongly agreed that using MHC helped them be more engaged in their health and health care (169/262, 65%), make decisions about their treatment (157/262, 60%), and set goals related to their health and health care (156/262, 60%). Similarly, interviewees described that visualizing progress through graphs of their assessment data over time motivated them to continue therapy and increased self-awareness. (2) A majority of respondents overall, and a greater proportion who had used MHC for ≥3 months (versus <3 months), agreed/strongly agreed that using MHC enhanced their communication (112/164, 68% versus 51/98, 52%; P=.009) and rapport (95/164, 58% versus 42/98, 43%; P=.02) with their VHA providers. Likewise, interviewees described how MHC helped focus therapy time and facilitated trust. (3) However, veterans also endorsed some challenges using MHC. Among respondents overall, these included difficulty understanding graphs of their assessment data (102/245, 42%), not receiving enough training on the app (73/259, 28%), and not being able to change responses to assessment questions (72/256, 28%). (4) Interviewees offered suggestions for improving the app (eg, facilitating ease of log-in, offering additional reminder features) and for increasing adoption (eg, marketing the app and its potential advantages for veterans receiving mental health care). CONCLUSIONS: Although experiences with the MHC app varied, veterans were positive overall about its use. Veterans described associations between the use of MHC and engagement in their own care, self-management, and interactions with their VHA mental health providers. Findings support the potential of MHC as a technology capable of supporting the VHA's Collect-Share-Act model of MBC.

"Hypertension is such a difficult disease to manage": federally qualified health center staff- and leadership-perceived readiness to implement a technology-facilitated team-based hypertension model.

BACKGROUND: Despite decades of evidence demonstrating the efficacy of hypertension care delivery in reducing morbidity and mortality, a majority of hypertension cases remain uncontrolled. There is an urgent need to elucidate and address multilevel facilitators and barriers clinical staff face in delivering evidence-based hypertension care, patients face in accessing it, and clinical systems face in sustaining it. Through a rigorous pre-implementation evaluation, we aimed to identify facilitators and barriers bearing the potential to affect the planned implementation of a multilevel technology-facilitated hypertension management trial across six primary care sites in a large federally qualified health center (FQHC) in New York City. METHODS: During a dedicated pre-implementation period (3-9 months/site, 2021-2022), a capacity assessment was conducted by trained practice facilitators, including (1) online anonymous surveys (n = 124; 70.5% of eligible), (2) hypertension training analytics (n = 69; 94.5% of assigned), and (3) audio-recorded semi-structured interviews (n = 67; 48.6% of eligible) with FQHC leadership and staff. Surveys measured staff sociodemographic characteristics, adaptive reserve, evidence-based practice attitudes, and implementation leadership scores via validated scales. Training analytics, derived from end-of-course quizzes, included mean score and number attempts needed to pass. Interviews assessed staff-reported facilitators and barriers to current hypertension care delivery and uptake; following audio transcription, trained qualitative researchers employed a deductive coding approach, informed by the Consolidated Framework for Implementation Research (CFIR). RESULTS: Most survey respondents reported moderate adaptive reserve (mean = 0.7, range = 0-1), evidence-based practice attitudes (mean = 2.7, range = 0-4), and implementation leadership (mean = 2.5, range = 0-4). Most staff passed training courses on first attempt and demonstrated high scores (means > 80%). Findings from interviews identified potential facilitators and barriers to implementation; specifically, staff reported that complex barriers to hypertension care, control, and clinical communication exist; there is a recognized need to improve hypertension care; in-clinic challenges with digital tool access imposes workflow delays; and despite high patient loads, staff are motivated to provide high-quality cares. CONCLUSIONS: This study serves as one of the first to apply the CFIR to a rigorous pre-implementation evaluation within the understudied context of a FQHC and can serve as a model for similar trials seeking to identify and address contextual factors known to impact implementation success. TRIAL REGISTRATION: ClinicalTrials.gov NCT03713515 , date of registration: October 19, 2018.

The Cystic Fibrosis Learning Network: A mixed methods evaluation of program goals, attributes, and impact.

Introduction: The Cystic Fibrosis (CF) Foundation sponsored the design, pilot testing, and implementation of the CF Learning Network (CFLN) to explore how the Foundation's Care Center Network (CCN) could become a learning health system. Six years after the design, the Foundation commissioned a formative mixed methods evaluation of the CFLN to assess: CFLN participants' understanding of program goals, attributes, and perceptions of current and future impact. Methods: We performed semi-structured interviews with CFLN participants to identify perceived goals, attributes, and impact of the network. Following thematic analyses, we developed and distributed a survey to CFLN members and a matched sample of CCN programs to understand whether the themes were unique to the CFLN. Results: Interviews with 24 CFLN participants were conducted. Interviewees identified the primary CFLN goal as improving outcomes for people living with CF, with secondary goals of providing training in quality improvement (QI), creating a learning community, engaging all stakeholders in improvement, and spreading best practices to the CCN. Project management, use of data, common QI methods, and the learning community were seen as critical to success. Survey responses were collected from 103 CFLN members and 25 CCN members. The data revealed that CFLN respondents were more likely than CCN respondents to connect with other CF programs, routinely use data for QI, and engage patient and family partners in QI. Conclusions: Our study suggests that the CFLN provides value beyond that achieved by the CCN. Key questions remain about whether spread of the CFLN could improve outcomes for more people living with CF.