Evaluation of a complex intervention for prisoners with common mental health problems, near to and after release: the Engager randomised controlled trial.

BACKGROUND: Many male prisoners have significant mental health problems, including anxiety and depression. High proportions struggle with homelessness and substance misuse. AIMS: This study aims to evaluate whether the Engager intervention improves mental health outcomes following release. METHOD: The design is a parallel randomised superiority trial that was conducted in the North West and South West of England (ISRCTN11707331). Men serving a prison sentence of 2 years or less were individually allocated 1:1 to either the intervention (Engager plus usual care) or usual care alone. Engager included psychological and practical support in prison, on release and for 3-5 months in the community. The primary outcome was the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM), 6 months after release. Primary analysis compared groups based on intention-to-treat (ITT). RESULTS: In total, 280 men were randomised out of the 396 who were potentially eligible and agreed to participate; 105 did not meet the mental health inclusion criteria. There was no mean difference in the ITT complete case analysis between groups (92 in each arm) for change in the CORE-OM score (1.1, 95% CI -1.1 to 3.2, P = 0.325) or secondary analyses. There were no consistent clinically significant between-group differences for secondary outcomes. Full delivery was not achieved, with 77% (108/140) receiving community-based contact. CONCLUSIONS: Engager is the first trial of a collaborative care intervention adapted for prison leavers. The intervention was not shown to be effective using standard outcome measures. Further testing of different support strategies for prison with mental health problems is needed.

Economic evaluation of a complex intervention (Engager) for prisoners with common mental health problems, near to and after release: a cost-utility and cost-consequences analysis.

BACKGROUND: People in prison experience a range of physical and mental health problems. Evaluating the effectiveness and efficiency of prison-based interventions presents a number of methodological challenges. We present a case study of an economic evaluation of a prison-based intervention ("Engager") to address common mental health problems. METHODS: Two hundred and eighty people were recruited from prisons in England and randomised to Engager plus usual care or usual care. Participants were followed up for 12 months following release from prison. The primary analysis is the cost per quality-adjusted life year (QALY) gained of Engager compared to usual care from a National Health Service (NHS) perspective with QALYs calculated using the CORE 6 Dimension. A cost-consequences analysis evaluated cross-sectoral costs and a range of outcomes. RESULTS: From an NHS perspective, Engager cost an additional £2737 per participant (95% of iterations between £1029 and £4718) with a mean QALY difference of - 0.014 (95% of iterations between - 0.045 and 0.017). For the cost-consequences, there was evidence of improved access to substance misuse services 12 months post-release (odds ratio 2.244, 95% confidence Interval 1.304-3.861). CONCLUSION: Engager provides a rare example of a cost-utility analysis conducted in prisons and the community using patient-completed measures. Although the results from this trial show no evidence that Engager is cost-effective, the results of the cost-consequences analysis suggest that follow-up beyond 12 months post-release using routine data may provide additional insights into the effectiveness of the intervention and the importance of including a wide range of costs and outcomes in prison-based economic evaluations. TRIAL REGISTRATION: (ISRCTN11707331).

Interrogating intervention delivery and participants' emotional states to improve engagement and implementation: A realist informed multiple case study evaluation of Engager.

BACKGROUND: 'Engager' is an innovative 'through-the-gate' complex care intervention for male prison-leavers with common mental health problems. In parallel to the randomised-controlled trial of Engager (Trial registration number: ISRCTN11707331), a set of process evaluation analyses were undertaken. This paper reports on the depth multiple case study analysis part of the process evaluation, exploring how a sub-sample of prison-leavers engaged and responded to the intervention offer of one-to-one support during their re-integration into the community. METHODS: To understand intervention delivery and what response it elicited in individuals, we used a realist-informed qualitative multiple 'case' studies approach. We scrutinised how intervention component delivery lead to outcomes by examining underlying causal pathways or 'mechanisms' that promoted or hindered progress towards personal outcomes. 'Cases' (n = 24) were prison-leavers from the intervention arm of the trial. We collected practitioner activity logs and conducted semi-structured interviews with prison-leavers and Engager/other service practitioners. We mapped data for each case against the intervention logic model and then used Bhaskar's (2016) 'DREIC' analytic process to categorise cases according to extent of intervention delivery, outcomes evidenced, and contributing factors behind engagement or disengagement and progress achieved. RESULTS: There were variations in the dose and session focus of the intervention delivery, and how different participants responded. Participants sustaining long-term engagement and sustained change reached a state of 'crises but coping'. We found evidence that several components of the intervention were key to achieving this: trusting relationships, therapeutic work delivered well and over time; and an in-depth shared understanding of needs, concerns, and goals between the practitioner and participants. Those who disengaged were in one of the following states: 'Crises and chaos', 'Resigned acceptance', 'Honeymoon' or 'Wilful withdrawal'. CONCLUSIONS: We demonstrate that the 'implementability' of an intervention can be explained by examining the delivery of core intervention components in relation to the responses elicited in the participants. Core delivery mechanisms often had to be 'triggered' numerous times to produce sustained change. The improvements achieved, sustained, and valued by participants were not always reflected in the quantitative measures recorded in the RCT. The compatibility between the practitioner, participant and setting were continually at risk of being undermined by implementation failure as well as changing external circumstances and participants' own weaknesses. TRIAL REGISTRATION NUMBER: ISRCTN11707331, Wales Research Ethics Committee, Registered 02-04-2016-Retrospectively registered https://doi.org/10.1186/ISRCTN11707331.

Using multiple case studies of health and justice services to inform the development of a new complex intervention for prison-leavers with common mental health problems (Engager).

BACKGROUND: People in the criminal justice system have complex needs but often do not make use of services outside of prison, in many cases due to poorly joined up working between health and criminal justice services. The 'Engager' programme aimed to develop a complex collaborative care intervention for people leaving prison with common mental health problems that could support their transition into the community and facilitate joined up working between health, justice and social services. To augment our core intervention theory, we wanted to learn from innovative and forward-thinking services providing interagency support and/or treatment for people experiencing common mental health problems within the criminal justice system. We wanted to identify key elements of interagency practice to understand what was and was not effective in engaging people, maintaining their contact and improving mental health and other aspects of their lives. METHOD: We used a multiple case study design with a focused ethnographic approach in four study sites. Data came from three sources (documents, field notes and semi-structured interviews) underwent a framework analysis. RESULTS: We identified seven main themes, namely: collaboration, client engagement, client motivation, supervision, therapeutic approach, peers and preparations for ending. Engaging and motivating clients was dependent on the relationship built with the professional. This relationship was developed through building trust and rapport, which required time and respectful, open and honest communication. Professionals were often unable to build this relationship effectively if they did not work in effective interagency collaborations, particularly those which included shared practices and were supported by effective supervision. CONCLUSIONS: The multiple case study design contributed insights as to how health and justice services work together. The main themes identified are well known factors in health and justice co-working. However, the novel insights were gleaned examining interdependence and interactions in complex, multifactorial phenomena and practice, in particular the importance of shared practice and supervision models. The approach of selecting a small number of cases representing identified knowledge gaps contributed a valuable addition to the program theory and delivery for an innovative complex intervention.

Consensus methodology to determine minor ailments appropriate to be directed for management within community pharmacy.

BACKGROUND: National Health Service (NHS) 111, a medical helpline for urgent care used within the England and Scotland, receives significant numbers of patient calls yearly for a range of clinical conditions. Some are considered high acuity and mainly directed to urgent and emergency care. Low acuity conditions are also directed to these costly, overburdened services. Community pharmacy is a recognised setting for effective low acuity condition management and could offer an alternative. OBJECTIVE: To design and evaluate a new NHS111 pathway re-directing patients with low acuity conditions to community pharmacy. METHODS: Two consensus development stakeholder workshops were undertaken. A "low acuity" condition was defined as one that can be clinically assessed by a community pharmacist and requires a treatment and/or advice available within a community pharmacy. Retrospective NHS111 patient data (February-August 2016) from the North East of England and access to the NHS Pathways clinical decision support software were available to stakeholders. The NHS111 data demonstrated the volume of patient calls for these conditions that could have been redirected to community pharmacy. RESULTS: Stakeholders reached consensus that 64 low acuity conditions could be safely redirected to community pharmacy via NHS111. This represented approximately 35,000 patients (11.5% of total) being shifted away from the higher cost settings in the North East region alone during February-August 2016. The stakeholder group discussions provided rationale behind their classifications of conditions to ensure patient safety, the care experience and added value. CONCLUSIONS: The resulting definitive list of low acuity conditions that could be directed to community pharmacy via NHS111 could result in a shift of workload from urgent and emergency care settings. Future work needs to evaluate the cost, clinical outcomes, patient satisfaction of a community pharmacy referral service that has the potential to improve integration of community pharmacy in the wider NHS.

The feasibility of following up prisoners, with mental health problems, after release: a pilot trial employing an innovative system, for engagement and retention in research, with a harder-to-engage population.

BACKGROUND: Following up released prisoners is demanding, particularly for those prisoners with mental health problems, for whom stigma and chaotic lifestyles are problematic. Measurement of mental health outcomes after release is challenging. To evaluate mental healthcare for offender populations, using high-quality randomised controlled trials, evidenced-based methods must be developed to engage them while in custody, to locate and re-interview them after release, and to collect potentially stigmatising mental health outcomes data. METHODS: We developed an initial theoretical model and operational procedures for collecting baseline and follow-up data informed by a literature search, focus groups, and case studies. Male prisoners from five prisons in two sites were invited to participate. The inclusion criteria included individuals who were above threshold on nine-item Patient Health Questionnaire, seven-item Generalized Anxiety Disorder, or post-traumatic stress disorder scales, or who had reported mental health problems in the past 2 years or had been assessed with a likely personality disorder. Potential participants were interviewed to generate baseline data and were re-contacted before their release. We then contacted them for a follow-up interview, which included repeating the earlier data collection measures 2-8 weeks after release. A qualitative formative process evaluation produced and refined a model procedure for the recruitment and retention of male prison leavers in trials, identified the mechanisms which promoted engagement and retention, and mapped these against a theoretical behaviour change model. RESULTS: We developed a flexible procedure which was successful in recruiting male prison leavers to a pilot trial: 185/243 (76%, 95% confidence interval (CI) 70-81%) of those approached agreed to participate. We also retained 63% (95% CI 54-71%) of those eligible to participate in a follow-up interview 2-8 weeks after release. Mental health outcomes data was collected at both these time points. CONCLUSIONS: It is possible to design acceptable procedures to achieve sustained engagement critical for delivering and evaluating interventions in prison and in the community and to collect mental health outcomes data. These procedures may reduce attrition bias in future randomised controlled trials of mental health interventions for prison leavers. This procedure has been replicated and successfully delivered in a subsequent pilot trial and a definitive randomised controlled trial.

Pilot randomised controlled trial of the ENGAGER collaborative care intervention for prisoners with common mental health problems, near to and after release.

BACKGROUND: Rates of common mental health problems are much higher in prison populations, but access to primary care mental health support falls short of community equivalence. Discontinuity of care on release is the norm and is further complicated by substance use and a range of social problems, e.g. homelessness. To address these problems, we worked with criminal justice, third sector social inclusion services, health services and people with lived experiences (peer researchers), to develop a complex collaborative care intervention aimed at supporting men with common mental health problems near to and following release from prison. This paper describes an external pilot trial to test the feasibility of a full randomised controlled trial. METHODS: Eligible individuals with 4 to 16 weeks left to serve were screened to assess for common mental health problems. Participants were then randomised at a ratio of 2:1 allocation to ENGAGER plus standard care (intervention) or standard care alone (treatment as usual). Participants were followed up at 1 and 3 months' post release. Success criteria for this pilot trial were to meet the recruitment target sample size of 60 participants, to follow up at least 50% of participants at 3 months' post release from prison, and to deliver the ENGAGER intervention. Estimates of recruitment and retention rates and 95% confidence intervals (CIs) are reported. Descriptive analyses included summaries (percentages or means) for participant demographics, and baseline characteristics are reported. RESULTS: Recruitment target was met with 60 participants randomised in 9 months. The average retention rates were 73% at 1 month [95% CI 61 to 83] and 47% at 3 months follow-up [95% CI 35 to 59]. Ninety percent of participants allocated to the intervention successfully engaged with a practitioner before release and 70% engaged following release. CONCLUSIONS: This pilot confirms the feasibility of conducting a randomised trial for prison leavers with common mental health problems. Based on this pilot study and some minor changes to the trial design and intervention, a full two-centre randomised trial assessing the clinical and cost-effectiveness of the ENGAGER intervention is currently underway.