Adverse Events Reporting in Digital Interventions Evaluations for Psychosis: A Systematic Literature Search and Individual Level Content Analysis of Adverse Event Reports.

BACKGROUND: Digital health interventions (DHIs) have significant potential to upscale treatment access to people experiencing psychosis but raise questions around patient safety. Adverse event (AE) monitoring is used to identify, record, and manage safety issues in clinical trials, but little is known about the specific content and context contained within extant AE reports. This study aimed to assess current AE reporting in DHIs. STUDY DESIGN: A systematic literature search was conducted by the iCharts network (representing academic, clinical, and experts by experience) to identify trials of DHIs in psychosis. Authors were invited to share AE reports recorded in their trials. A content analysis was conducted on the shared reports. STUDY RESULTS: We identified 593 AE reports from 18 DHI evaluations, yielding 19 codes. Only 29 AEs (4.9% of total) were preidentified by those who shared AEs as being related to the intervention or trial procedures. While overall results support the safety of DHIs, DHIs were linked to mood problems and psychosis exacerbation in a few cases. Additionally, 27% of studies did not report information on relatedness for all or at least some AEs; 9.6% of AE reports were coded as unclear because it could not be determined what had happened to participants. CONCLUSIONS: The results support the safety of DHIs, but AEs must be routinely monitored and evaluated according to best practice. Individual-level analyses of AEs have merit to understand safety in this emerging field. Recommendations for best practice reporting in future studies are provided.

Measurement of Adverse Events in Studies of Digital Health Interventions for Psychosis: Guidance and Recommendations Based on a Literature Search and Framework Analysis of Standard Operating Procedures.

BACKGROUND: Given the rapid expansion of research into digital health interventions (DHIs) for severe mental illness (SMI; eg, schizophrenia and other psychosis diagnoses), there is an emergent need for clear safety measures. Currently, measurement and reporting of adverse events (AEs) are inconsistent across studies. Therefore, an international network, iCharts, was assembled to systematically identify and refine a set of standard operating procedures (SOPs) for AE reporting in DHI studies for SMI. DESIGN: The iCharts network comprised experts on DHIs for SMI from seven countries (United Kingdom, Belgium, Germany, Pakistan, Australia, United States, and China) and various professional backgrounds. Following a literature search, SOPs of AEs were obtained from authors of relevant studies, and from grey literature. RESULTS: A thorough framework analysis of SOPs (n = 32) identified commonalities for best practice for certain domains, along with significant gaps in others; particularly around the classification of AEs during trials, and the provision of training/supervision for research staff in measuring and reporting AEs. Several areas which could lead to the observed inconsistencies in AE reporting and handling were also identified. CONCLUSIONS: The iCharts network developed best-practice guidelines and a practical resource for AE monitoring in DHI studies for psychosis, based on a systematic process which identified common features and evidence gaps. This work contributes to international efforts to standardize AE measurement and reporting in this emerging field, ensuring that safety aspects of DHIs for SMI are well-studied across the translational pathway, with monitoring systems set-up from the outset to support safe implementation in healthcare systems.

SAFETEL: a pilot randomised controlled trial to assess the feasibility and acceptability of a safety planning and telephone follow-up intervention to reduce suicidal behaviour.

BACKGROUND: A previous suicide attempt is an important predictor of future suicide. However, there are no evidence-based interventions administered in UK general hospital contexts to reduce suicidal behaviour in patients admitted following a suicide attempt. Consequently, the objective of this pilot randomised controlled trial was to explore whether a safety planning and telephone follow-up intervention (SAFETEL) was feasible and acceptable for individuals treated in hospital following a suicide attempt. METHODS: In this three-phase study with an embedded process evaluation, a safety planning intervention was tailored to the UK context (Phase I), piloted (Phase II, n = 32), and tested in a feasibility randomised controlled trial (Phase III). In Phase III, participants were allocated to either the intervention (n = 80) or control group (n = 40) using telephone randomisation with a 2:1 ratio. The acceptability and feasibility of the trial and intervention procedures were evaluated using both qualitative (interviews and focus groups) and quantitative data. The number of hospital representations of suicidal behaviour was also collected 6 months after study recruitment based on electronic patient records. RESULTS: Findings indicated that SAFETEL was both acceptable and feasible. Hospital staff reported the intervention fitted and complemented existing services, and patients reported that they favoured the simplicity and person-centred approach of the safety planning intervention. CONCLUSIONS: All progression criteria were met supporting further evaluation of the intervention in a full-scale clinical effectiveness trial. TRIAL REGISTRATION: ISRCT, ISRCTN62181241 , 5/5/2017.

SAFETEL randomised controlled feasibility trial of a safety planning intervention with follow-up telephone contact to reduce suicidal behaviour: study protocol.

INTRODUCTION: There are no evidence-based interventions that can be administered in hospital settings following a general hospital admission after a suicide attempt. AIM: To determine whether a safety planning intervention (SPI) with follow-up telephone support (SAFETEL) is feasible and acceptable to patients admitted to UK hospitals following a suicide attempt. METHODS AND ANALYSIS: Three-phase development and feasibility study with embedded process evaluation. Phase I comprises tailoring an SPI with telephone follow-up originally designed for veterans in the USA, for use in the UK. Phase II involves piloting the intervention with patients (n=30) who have been hospitalised following a suicide attempt. Phase III is a feasibility randomised controlled trial of 120 patients who have been hospitalised following a suicide attempt with a 6-month follow-up. Phase III participants will be recruited from across four National Health Service hospitals in Scotland and randomised to receive either the SPI with telephone follow-up and treatment as usual (n=80) or treatment as usual only (n=40). The primary outcomes are feasibility outcomes and include the acceptability of the intervention to participants and intervention staff, the feasibility of delivery in this setting, recruitment, retention and intervention adherence as well as the feasibility of collecting the self-harm re-admission to hospital outcome data. Statistical analyses will include description of recruitment rates, intervention adherence/use, response rates and estimates of the primary outcome event rates, and intervention effect size (Phase III). Thematic analyses will be conducted on interview and focus group data. ETHICS AND DISSEMINATION: The East of Scotland Research Ethics Service (EoSRES) approved this study in March 2017 (GN17MH101 Ref: 17/ES/0036). The study results will be disseminated via peer-reviewed publication and conference presentations. A participant summary paper will also be disseminated to patients, service providers and policy makers alongside the main publication. TRIAL REGISTRATION NUMBER: ISRCTN62181241.

Cognitive-behavioural therapy for clozapine-resistant schizophrenia: the FOCUS RCT.

BACKGROUND: Clozapine (clozaril, Mylan Products Ltd) is a first-choice treatment for people with schizophrenia who have a poor response to standard antipsychotic medication. However, a significant number of patients who trial clozapine have an inadequate response and experience persistent symptoms, called clozapine-resistant schizophrenia (CRS). There is little evidence regarding the clinical effectiveness of pharmacological or psychological interventions for this population. OBJECTIVES: To evaluate the clinical effectiveness and cost-effectiveness of cognitive-behavioural therapy (CBT) for people with CRS and to identify factors predicting outcome. DESIGN: The Focusing on Clozapine Unresponsive Symptoms (FOCUS) trial was a parallel-group, randomised, outcome-blinded evaluation trial. Randomisation was undertaken using permuted blocks of random size via a web-based platform. Data were analysed on an intention-to-treat (ITT) basis, using random-effects regression adjusted for site, age, sex and baseline symptoms. Cost-effectiveness analyses were carried out to determine whether or not CBT was associated with a greater number of quality-adjusted life-years (QALYs) and higher costs than treatment as usual (TAU). SETTING: Secondary care mental health services in five cities in the UK. PARTICIPANTS: People with CRS aged ≥ 16 years, with an International Classification of Diseases, Tenth Revision (ICD-10) schizophrenia spectrum diagnoses and who are experiencing psychotic symptoms. INTERVENTIONS: Individual CBT included up to 30 hours of therapy delivered over 9 months. The comparator was TAU, which included care co-ordination from secondary care mental health services. MAIN OUTCOME MEASURES: The primary outcome was the Positive and Negative Syndrome Scale (PANSS) total score at 21 months and the primary secondary outcome was PANSS total score at the end of treatment (9 months post randomisation). The health benefit measure for the economic evaluation was the QALY, estimated from the EuroQol-5 Dimensions, five-level version (EQ-5D-5L), health status measure. Service use was measured to estimate costs. RESULTS: Participants were allocated to CBT (n = 242) or TAU (n = 245). There was no significant difference between groups on the prespecified primary outcome [PANSS total score at 21 months was 0.89 points lower in the CBT arm than in the TAU arm, 95% confidence interval (CI) -3.32 to 1.55 points; p = 0.475], although PANSS total score at the end of treatment (9 months) was significantly lower in the CBT arm (-2.40 points, 95% CI -4.79 to -0.02 points; p = 0.049). CBT was associated with a net cost of £5378 (95% CI -£13,010 to £23,766) and a net QALY gain of 0.052 (95% CI 0.003 to 0.103 QALYs) compared with TAU. The cost-effectiveness acceptability analysis indicated a low likelihood that CBT was cost-effective, in the primary and sensitivity analyses (probability < 50%). In the CBT arm, 107 participants reported at least one adverse event (AE), whereas 104 participants in the TAU arm reported at least one AE (odds ratio 1.09, 95% CI 0.81 to 1.46; p = 0.58). CONCLUSIONS: Cognitive-behavioural therapy for CRS was not superior to TAU on the primary outcome of total PANSS symptoms at 21 months, but was superior on total PANSS symptoms at 9 months (end of treatment). CBT was not found to be cost-effective in comparison with TAU. There was no suggestion that the addition of CBT to TAU caused adverse effects. Future work could investigate whether or not specific therapeutic techniques of CBT have value for some CRS individuals, how to identify those who may benefit and how to ensure that effects on symptoms can be sustained. TRIAL REGISTRATION: Current Controlled Trials ISRCTN99672552. FUNDING: This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 23, No. 7. See the NIHR Journals Library website for further project information.

Cognitive behavioural therapy in clozapine-resistant schizophrenia (FOCUS): an assessor-blinded, randomised controlled trial.

BACKGROUND: Although clozapine is the treatment of choice for treatment-refractory schizophrenia, 30-40% of patients have an insufficient response, and others are unable to tolerate it. Evidence for any augmentation strategies is scarce. We aimed to determine whether cognitive behavioural therapy (CBT) is an effective treatment for clozapine-resistant schizophrenia. METHODS: We did a pragmatic, parallel group, assessor-blinded, randomised controlled trial in community-based and inpatient mental health services in five sites in the UK. Patients with schizophrenia who were unable to tolerate clozapine, or whose symptoms did not respond to the drug, were randomly assigned 1:1 by use of randomised-permuted blocks of size four or six, stratified by centre, to either CBT plus treatment as usual or treatment as usual alone. Research assistants were masked to allocation to protect against rater bias and allegiance bias. The primary outcome was the Positive and Negative Syndrome Scale (PANSS) total score at 21 months, which provides a continuous measure of symptoms of schizophrenia; PANSS total was also assessed at the end of treatment (9 months). The primary analysis was by randomised treatment based on intention to treat, for all patients for whom data were available. This study was prospectively registered, number ISRCTN99672552. The trial is closed to accrual. FINDINGS: From Jan 1, 2013, to May 31, 2015, we randomly assigned 487 participants to either CBT and treatment as usual (n=242) or treatment as usual alone (n=245). Analysis included 209 in the CBT group and 216 in the treatment as usual group. No difference occurred in the primary outcome (PANSS total at 21 months, mean difference -0·89, 95% CI -3·32 to 1·55; p=0·48), although the CBT group improved at the end of treatment (PANSS total at 9 months, mean difference -2·40, -4·79 to -0·02; p=0·049). During the trial, 107 (44%) of 242 participants in the CBT arm and 104 (42%) of 245 in the treatment as usual arm had at least one adverse event (odds ratio 1·09, 95% CI 0·81 to 1·46; p=0·58). Only two (1%) of 242 participants in the CBT arm and one (<1%) of 245 in the treatment as usual arm had a trial-related serious adverse event. INTERPRETATION: At 21-month follow-up, CBT did not have a lasting effect on total symptoms of schizophrenia compared with treatment as usual; however, CBT produced statistically, though not clinically, significant improvements on total symptoms by the end of treatment. There was no indication that the addition of CBT to treatment as usual caused adverse effects. The results of this trial do not support a recommendation to routinely offer CBT to all people who meet criteria for clozapine-resistant schizophrenia; however, a pragmatic individual trial might be indicated for some. FUNDING: National Institute for Health Research Technology Assessment programme.

Design and protocol for the Focusing on Clozapine Unresponsive Symptoms (FOCUS) trial: a randomised controlled trial.

BACKGROUND: For around a third of people with a diagnosis of schizophrenia, the condition proves to respond poorly to treatment with many typical and atypical antipsychotics. This is commonly referred to as treatment-resistant schizophrenia. Clozapine is the only antipsychotic with convincing efficacy for people whose symptoms are considered treatment-resistant to antipsychotic medication. However, 30-40 % of such conditions will have an insufficient response to the drug. Cognitive behavioural therapy has been shown to be an effective treatment for schizophrenia when delivered in combination with antipsychotic medication, with several meta-analyses showing robust support for this approach. However, the evidence for the effectiveness of cognitive behavioural therapy for people with a schizophrenia diagnosis whose symptoms are treatment-resistant to antipsychotic medication is limited. There is a clinical and economic need to evaluate treatments to improve outcomes for people with such conditions. METHODS/DESIGN: A parallel group, prospective randomised, open, blinded evaluation of outcomes design will be used to compare a standardised cognitive behavioural therapy intervention added to treatment as usual versus treatment as usual alone (the comparator group) for individuals with a diagnosis of schizophrenia for whom an adequate trial of clozapine has either not been possible due to tolerability problems or was not associated with a sufficient therapeutic response. The trial will be conducted across five sites in the United Kingdom. DISCUSSION: The recruitment target of 485 was achieved, with a final recruitment total of 487. This trial is the largest definitive, pragmatic clinical and cost-effectiveness trial of cognitive behavioural therapy for people with schizophrenia whose symptoms have failed to show an adequate response to clozapine treatment. Using a prognostic risk model, baseline information will be used to explore whether there are identifiable subgroups for which the treatment effect is greatest. TRIAL REGISTRATION: Current Controlled Trials ISRCTN99672552 . Registered 29(th) November 2012.