Implementing and Evaluating a National Integrated Digital Registry and Clinical Decision Support System in Early Intervention in Psychosis Services (Early Psychosis Informatics Into Care): Co-Designed Protocol.

BACKGROUND: Early intervention in psychosis (EIP) services are nationally mandated in England to provide multidisciplinary care to people experiencing first-episode psychosis, which disproportionately affects deprived and ethnic minority youth. Quality of service provision varies by region, and people from historically underserved populations have unequal access. In other disease areas, including stroke and dementia, national digital registries coupled with clinical decision support systems (CDSSs) have revolutionized the delivery of equitable, evidence-based interventions to transform patient outcomes and reduce population-level disparities in care. Given psychosis is ranked the third most burdensome mental health condition by the World Health Organization, it is essential that we achieve the same parity of health improvements. OBJECTIVE: This paper reports the protocol for the program development phase of this study, in which we aimed to co-design and produce an evidence-based, stakeholder-informed framework for the building, implementation, piloting, and evaluation of a national integrated digital registry and CDSS for psychosis, known as EPICare (Early Psychosis Informatics into Care). METHODS: We conducted 3 concurrent work packages, with reciprocal knowledge exchange between each. In work package 1, using a participatory co-design framework, key stakeholders (clinicians, academics, policy makers, and patient and public contributors) engaged in 4 workshops to review, refine, and identify a core set of essential and desirable measures and features of the EPICare registry and CDSS. Using a modified Delphi approach, we then developed a consensus of data priorities. In work package 2, we collaborated with National Health Service (NHS) informatics teams to identify relevant data currently captured in electronic health records, understand data retrieval methods, and design the software architecture and data model to inform future implementation. In work package 3, observations of stakeholder workshops and individual interviews with representative stakeholders (n=10) were subject to interpretative qualitative analysis, guided by normalization process theory, to identify factors likely to influence the adoption and implementation of EPICare into routine practice. RESULTS: Stage 1 of the EPICare study took place between December 2021 and September 2022. The next steps include stage 2 building, piloting, implementation, and evaluation of EPICare in 5 demonstrator NHS Trusts serving underserved and diverse populations with substantial need for EIP care in England. If successful, this will be followed by stage 3, in which we will seek NHS adoption of EPICare for rollout to all EIP services in England. CONCLUSIONS: By establishing a multistakeholder network and engaging them in an iterative co-design process, we have identified essential and desirable elements of the EPICare registry and CDSS; proactively identified and minimized potential challenges and barriers to uptake and implementation; and addressed key questions related to informatics architecture, infrastructure, governance, and integration in diverse NHS Trusts, enabling us to proceed with the building, piloting, implementation, and evaluation of EPICare. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/50177.

Digital smartphone intervention to recognise and manage early warning signs in schizophrenia to prevent relapse: the EMPOWER feasibility cluster RCT.

BACKGROUND: Relapse is a major determinant of outcome for people with a diagnosis of schizophrenia. Early warning signs frequently precede relapse. A recent Cochrane Review found low-quality evidence to suggest a positive effect of early warning signs interventions on hospitalisation and relapse. OBJECTIVE: How feasible is a study to investigate the clinical effectiveness and cost-effectiveness of a digital intervention to recognise and promptly manage early warning signs of relapse in schizophrenia with the aim of preventing relapse? DESIGN: A multicentre, two-arm, parallel-group cluster randomised controlled trial involving eight community mental health services, with 12-month follow-up. SETTINGS: Glasgow, UK, and Melbourne, Australia. PARTICIPANTS: Service users were aged > 16 years and had a schizophrenia spectrum disorder with evidence of a relapse within the previous 2 years. Carers were eligible for inclusion if they were nominated by an eligible service user. INTERVENTIONS: The Early signs Monitoring to Prevent relapse in psychosis and prOmote Wellbeing, Engagement, and Recovery (EMPOWER) intervention was designed to enable participants to monitor changes in their well-being daily using a mobile phone, blended with peer support. Clinical triage of changes in well-being that were suggestive of early signs of relapse was enabled through an algorithm that triggered a check-in prompt that informed a relapse prevention pathway, if warranted. MAIN OUTCOME MEASURES: The main outcomes were feasibility of the trial and feasibility, acceptability and usability of the intervention, as well as safety and performance. Candidate co-primary outcomes were relapse and fear of relapse. RESULTS: We recruited 86 service users, of whom 73 were randomised (42 to EMPOWER and 31 to treatment as usual). Primary outcome data were collected for 84% of participants at 12 months. Feasibility data for people using the smartphone application (app) suggested that the app was easy to use and had a positive impact on motivations and intentions in relation to mental health. Actual app usage was high, with 91% of users who completed the baseline period meeting our a priori criterion of acceptable engagement (> 33%). The median time to discontinuation of > 33% app usage was 32 weeks (95% confidence interval 14 weeks to ∞). There were 8 out of 33 (24%) relapses in the EMPOWER arm and 13 out of 28 (46%) in the treatment-as-usual arm. Fewer participants in the EMPOWER arm had a relapse (relative risk 0.50, 95% confidence interval 0.26 to 0.98), and time to first relapse (hazard ratio 0.32, 95% confidence interval 0.14 to 0.74) was longer in the EMPOWER arm than in the treatment-as-usual group. At 12 months, EMPOWER participants were less fearful of having a relapse than those in the treatment-as-usual arm (mean difference -4.29, 95% confidence interval -7.29 to -1.28). EMPOWER was more costly and more effective, resulting in an incremental cost-effectiveness ratio of £3041. This incremental cost-effectiveness ratio would be considered cost-effective when using the National Institute for Health and Care Excellence threshold of £20,000 per quality-adjusted life-year gained. LIMITATIONS: This was a feasibility study and the outcomes detected cannot be taken as evidence of efficacy or effectiveness. CONCLUSIONS: A trial of digital technology to monitor early warning signs that blended with peer support and clinical triage to detect and prevent relapse is feasible. FUTURE WORK: A main trial with a sample size of 500 (assuming 90% power and 20% dropout) would detect a clinically meaningful reduction in relapse (relative risk 0.7) and improvement in other variables (effect sizes 0.3-0.4). TRIAL REGISTRATION: This trial is registered as ISRCTN99559262. FUNDING: This project was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 27. See the NIHR Journals Library website for further project information. Funding in Australia was provided by the National Health and Medical Research Council (APP1095879).

WHAT WAS THE PROBLEM?: Relapse is a considerable problem for people with a diagnosis of schizophrenia. Relapse can be predicted by early warning signs that are unique to the person. They include withdrawal, fear and paranoia. WHAT WAS THE QUESTION?: Is it possible to investigate the effectiveness of an intervention to recognise and promptly manage early warning signs of relapse in schizophrenia with the aim of preventing relapse? WHAT DID WE DO?: We spoke with 88 mental health staff, 40 carers and 21 service users before we designed a system that used a mobile phone to help people monitor early warning signs. We included peer support to help people using the system reflect on their experiences. We hoped the overall system, called EMPOWER, would help people to be more in charge of their mental health. After consenting 86 people to the study, we were able to randomly assign 73 people either to use the EMPOWER system (42 people) or to receive their normal treatment alone (31 people). We used research measures over 1 year to help us better understand people's experiences. We also involved carers (for example family or friends) and mental health service providers in the research. WHAT DID WE FIND?: We found that it was possible to recruit people to the study and to gather research data. We also found that people used the EMPOWER system and found it acceptable. We found that those who used EMPOWER had a lower rate of relapse over 12 months than people who did not. They were also less likely to be fearful of relapse. We found that EMPOWER was likely to be cost-effective. WHAT DOES THIS MEAN?: This means that a study to investigate the effectiveness of a system to recognise and respond to early warning signs of relapse in schizophrenia is possible.

The EMPOWER blended digital intervention for relapse prevention in schizophrenia: a feasibility cluster randomised controlled trial in Scotland and Australia.

BACKGROUND: Early warning signs monitoring by service users with schizophrenia has shown promise in preventing relapse but the quality of evidence is low. We aimed to establish the feasibility of undertaking a definitive randomised controlled trial to determine the effectiveness of a blended digital intervention for relapse prevention in schizophrenia. METHODS: This multicentre, feasibility, cluster randomised controlled trial aimed to compare Early signs Monitoring to Prevent relapse in psychosis and prOmote Well-being, Engagement, and Recovery (EMPOWER) with treatment as usual in community mental health services (CMHS) in Glasgow and Melbourne. CMHS were the unit of randomisation, selected on the basis of those that probably had five or more care coordinators willing to participate. Participants were eligible if they were older than 16 years, had a schizophrenia or related diagnosis confirmed via case records, were able to provide informed consent, had contact with CMHS, and had had a relapse within the previous 2 years. Participants were randomised within stratified clusters to EMPOWER or to continue their usual approach to care. EMPOWER blended a smartphone for active monitoring of early warning signs with peer support to promote self-management and clinical triage to promote access to relapse prevention. Main outcomes were feasibility, acceptability, usability, and safety, which was assessed through face-to-face interviews. App usage was assessed via the smartphone and self-report. Primary end point was 12 months. Participants, research assistants and other team members involved in delivering the intervention were not masked to treatment conditions. Assessment of relapse was done by an independent adjudication panel masked to randomisation group. The study is registered at ISRCTN (99559262). FINDINGS: We identified and randomised eight CMHS (six in Glasgow and two in Melbourne) comprising 47 care coordinators. We recruited 86 service users between Jan 19 and Aug 8, 2018; 73 were randomised (42 [58%] to EMPOWER and 31 [42%] to treatment as usual). There were 37 (51%) men and 36 (49%) women. At 12 months, main outcomes were collected for 32 (76%) of service users in the EMPOWER group and 30 (97%) of service users in the treatment as usual group. Of those randomised to EMPOWER, 30 (71%) met our a priori criterion of more than 33% adherence to daily monitoring that assumed feasibility. Median time to discontinuation of these participants was 31·5 weeks (SD 14·5). There were 29 adverse events in the EMPOWER group and 25 adverse events in the treatment as usual group. There were 13 app-related adverse events, affecting 11 people, one of which was serious. Fear of relapse was lower in the EMPOWER group than in the treatment as usual group at 12 months (mean difference -7·53 (95% CI -14·45 to 0·60; Cohen's d -0·53). INTERPRETATION: A trial of digital technology to monitor early warning signs blended with peer support and clinical triage to detect and prevent relapse appears to be feasible, safe, and acceptable. A further main trial is merited. FUNDING: UK National Institute for Health Research Health Technology Assessment programme and the Australian National Health and Medical Research Council.

Abdominal aortic aneurysm clinical practice guidelines: a methodological assessment using the AGREE II instrument.

OBJECTIVES: Abdominal aortic aneurysm (AAA) clinical practice guidelines (CPGs) provide evidence-based information on patient management; however, methodological differences exist in the development of CPGs. This study examines the methodological quality of AAA CPGs using a validated assessment tool. METHODS: Medline, EMBASE and online CPG databases were searched from 1946 to 31 October 2021. Full-text, English language, evidence-based AAA CPGs were included. Consensus-based CPGs, summaries of CPGs or CPGs which were only available on purchase were excluded. Five reviewers assessed their quality using the Appraisal of Guidelines for Research and Evaluation II instrument. An overall guideline assessment scaled score of ≥80% was considered as the threshold to recommend CPG use in clinical practice. RESULTS: Seven CPGs were identified. Scores showed good inter-reviewer reliability (intraclass correlation coefficient 0.943, 95% CI 0.915 to 0.964). On average, CPGs performed adequately with mean scaled scores of over 50% in all domains. However, between CPGs, significant methodological heterogeneity was observed in all domains. Four CPGs scored ≥80% (European Society of Cardiology, the Society of Vascular Surgery, the European Society of Vascular Surgery and the National Institute of Health and Care Excellence), supporting their use in clinical practice. CONCLUSIONS: Four CPGs were considered of adequate methodological quality to recommend their use in clinical practice; nonetheless, these still showed areas for improvement, potentially through performing economic analysis and trial application of recommendations. A structured approach employing validated CPG creation tools should be used to improve rigour of AAA CPGs. Future work should also evaluate recommendation accuracy using validated appraisal tools.

What are the benefits and harms of risk stratified screening as part of the NHS breast screening Programme? Study protocol for a multi-site non-randomised comparison of BC-predict versus usual screening (NCT04359420).

BACKGROUND: In principle, risk-stratification as a routine part of the NHS Breast Screening Programme (NHSBSP) should produce a better balance of benefits and harms. The main benefit is the offer of NICE-approved more frequent screening and/ or chemoprevention for women who are at increased risk, but are unaware of this. We have developed BC-Predict, to be offered to women when invited to NHSBSP which collects information on risk factors (self-reported information on family history and hormone-related factors via questionnaire; mammographic density; and in a sub-sample, Single Nucleotide Polymorphisms). BC-Predict produces risk feedback letters, inviting women at high risk (≥8% 10-year) or moderate risk (≥5 to < 8% 10-year) to have discussion of prevention and early detection options at Family History, Risk and Prevention Clinics. Despite the promise of systems such as BC-Predict, there are still too many uncertainties for a fully-powered definitive trial to be appropriate or ethical. The present research aims to identify these key uncertainties regarding the feasibility of integrating BC-Predict into the NHSBSP. Key objectives of the present research are to quantify important potential benefits and harms, and identify key drivers of the relative cost-effectiveness of embedding BC-Predict into NHSBSP. METHODS: A non-randomised fully counterbalanced study design will be used, to include approximately equal numbers of women offered NHSBSP (n = 18,700) and BC-Predict (n = 18,700) from selected screening sites (n = 7). In the initial 8-month time period, women eligible for NHSBSP will be offered BC-Predict in four screening sites. Three screening sites will offer women usual NHSBSP. In the following 8-months the study sites offering usual NHSBSP switch to BC-Predict and vice versa. Key potential benefits including uptake of risk consultations, chemoprevention and additional screening will be obtained for both groups. Key potential harms such as increased anxiety will be obtained via self-report questionnaires, with embedded qualitative process analysis. A decision-analytic model-based cost-effectiveness analysis will identify the key uncertainties underpinning the relative cost-effectiveness of embedding BC-Predict into NHSBSP. DISCUSSION: We will assess the feasibility of integrating BC-Predict into the NHSBSP, and identify the main uncertainties for a definitive evaluation of the clinical and cost-effectiveness of BC-Predict. TRIAL REGISTRATION: Retrospectively registered with clinicaltrials.gov (NCT04359420).

Providing 'the bigger picture': benefits and feasibility of integrating remote monitoring from smartphones into the electronic health record.

OBJECTIVES: To establish the acceptability and feasibility of collecting daily patient-generated health data (PGHD) using smartphones and integrating PGHD into the electronic health record, using the example of RA. METHODS: The Remote Monitoring of RA smartphone app was co-designed with patients, clinicians and researchers using qualitative semi-structured interviews and focus groups, including selection of question sets for symptoms and disease impact. PGHD were integrated into the electronic health record of one hospital and available in graphical form during consultations. Acceptability and feasibility were assessed with 20 RA patients and two clinicians over 3 months. A qualitative evaluation included semi-structured interviews with patients and clinicians before and after using the app, and audio-recordings of consultations to explore impact on the consultation. PGHD completeness was summarized descriptively, and qualitative data were analysed thematically. RESULTS: Patients submitted data on a median of 91% days over 3 months. Qualitative analysis generated three themes: RA as an invisible disease; providing the bigger picture of RA; and enabling person-centred consultations. The themes demonstrated that the system helped render patients' RA more visible by providing the 'bigger picture', identifying real-time changes in disease activity and capturing symptoms that would otherwise have been missed. Graphical summaries during consultations enabled a more person-centred approach whereby patients felt better able to participate in consultations and treatment plans. CONCLUSION: Remote Monitoring of RA has uniquely integrated daily PGHD from smartphones into the electronic health record. It has delivered proof-of-concept that such integrated remote monitoring systems are feasible and can transform consultations for clinician and patient benefit.

The temporal association between self-injurious thoughts and psychotic symptoms: a mobile phone assessment study.

The relationship between psychotic symptoms and self-injurious thoughts (SITs) remains unclear. The short-term temporal associations between psychotic symptoms and SITs were explored. A sample of 36 people with a diagnosis of a psychotic disorder or at-risk mental state completed mobile phone-based measures at multiple times each day for 1 week. Clustered regression with time-lagged variables supported a relationship between paranoia and subsequent SITs. Hallucinations did not predict these thoughts when controlling for paranoia. The role of specific psychotic symptoms in triggering SITs is highlighted and the importance of considering these factors in risk management is discussed.

A comparison of two delivery modalities of a mobile phone-based assessment for serious mental illness: native smartphone application vs text-messaging only implementations.

BACKGROUND: Mobile phone-based assessment may represent a cost-effective and clinically effective method of monitoring psychotic symptoms in real-time. There are several software options, including the use of native smartphone applications and text messages (short message service, SMS). Little is known about the strengths and limitations of these two approaches in monitoring symptoms in individuals with serious mental illness. OBJECTIVE: The objective of this study was to compare two different delivery modalities of the same diagnostic assessment for individuals with non-affective psychosis-a native smartphone application employing a graphical, touch user interface against an SMS text-only implementation. The overall hypothesis of the study was that patient participants with sewrious mental illness would find both delivery modalities feasible and acceptable to use, measured by the quantitative post-assessment feedback questionnaire scores, the number of data points completed, and the time taken to complete the assessment. It was also predicted that a native smartphone application would (1) yield a greater number of data points, (2) take less time, and (3) be more positively appraised by patient participant users than the text-based system. METHODS: A randomized repeated measures crossover design was employed. Participants with currently treated Diagnostic and Statistical Manual (Fourth Edition) schizophrenia or related disorders (n=24) were randomly allocated to completing 6 days of assessment (four sets of questions per day) with a native smartphone application or the SMS text-only implementation. There was then a 1-week break before completing a further 6 days with the alternative delivery modality. Quantitative feedback questionnaires were administered at the end of each period of sampling. RESULTS: A greater proportion of data points were completed with the native smartphone application in comparison to the SMS text-only implementation (ß = -.25, SE=.11, P=.02), which also took significantly less time to complete (ß =.78, SE= .09, P<.001). Although there were no significant differences in participants' quantitative feedback for the two delivery modalities, most participants reported preferring the native smartphone application (67%; n=16) and found it easier to use (71%; n=16). 33% of participants reported that they would be willing to complete mobile phone assessment for 5 weeks or longer. CONCLUSIONS: Native smartphone applications and SMS text are both valuable methods of delivering real-time assessment in individuals with schizophrenia. However, a more streamlined graphical user interface may lead to better compliance and shorter entry times. Further research is needed to test the efficacy of this technology within clinical services, to assess validity over longer periods of time and when delivered on patients' own phones.