Medical Mobile App Classification Using the National Institute for Health and Care Excellence Evidence Standards Framework for Digital Health Technologies: Interrater Reliability Study.

BACKGROUND: Clinical governance of medical mobile apps is challenging, and there is currently no standard method for assessing the quality of such apps. In 2018, the National Institute for Health and Care Excellence (NICE) developed a framework for assessing the required level of evidence for digital health technologies (DHTs), as determined by their clinical function. The framework can potentially be used to assess mobile apps, which are a subset of DHTs. To be used reliably in this context, the framework must allow unambiguous classification of an app's clinical function. OBJECTIVE: The objective of this study was to determine whether mobile health apps could be reliably classified using the NICE evidence standards framework for DHTs. METHODS: We manually extracted app titles, screenshots, and content descriptions for all apps listed on the National Health Service (NHS) Apps Library website on July 12, 2019; none of the apps were downloaded. Using this information, 2 mobile health (mHealth) researchers independently classified each app to one of the 4 functional tiers (ie, 1, 2, 3a, and 3b) described in the NICE digital technologies evaluation framework. Coders also answered contextual questions from the framework to identify whether apps were deemed to be higher risk. Agreement between coders was assessed using Cohen κ statistic. RESULTS: In total, we assessed 76 apps from the NHS Apps Library. There was classification agreement for 42 apps. Of these, 0 apps were unanimously classified into Tier 1; 24, into Tier 2; 15, into Tier 3a; and 3, into Tier 3b. There was disagreement between coders in 34/76 cases (45%); interrater agreement was poor (Cohen κ=0.32, 95% CI 0.16-0.47). Further investigation of disagreements highlighted 5 main explanatory themes: apps that did not correspond to any tier, apps that corresponded to multiple tiers, ambiguous tier descriptions, ambiguous app descriptions, and coder error. CONCLUSIONS: The current iteration of the NICE evidence standards framework for DHTs did not allow mHealth researchers to consistently and unambiguously classify digital health mobile apps listed on the NHS app library according to their functional tier.

Clinicians' Concerns About Mobile Ecological Momentary Assessment Tools Designed for Emerging Psychiatric Problems: Prospective Acceptability Assessment of the MEmind App.

BACKGROUND: Many mental disorders are preceded by a prodromal phase consisting of various attenuated and unspecific symptoms and functional impairment. Electronic health records are generally used to capture these symptoms during medical consultation. Internet and mobile technologies provide the opportunity to monitor symptoms emerging in patients' environments using ecological momentary assessment techniques to support preventive therapeutic decision making. OBJECTIVE: The objective of this study was to assess the acceptability of a Web-based app designed to collect medical data during appointments and provide ecological momentary assessment features. METHODS: We recruited clinicians at 4 community psychiatry departments in France to participate. They used the app to assess patients and to collect data after viewing a video of a young patient's emerging psychiatric consultation. We then asked them to answer a short anonymous self-administered questionnaire that evaluated their experience, the acceptability of the app, and their habit of using new technologies. RESULTS: Of 24 practitioners invited, 21 (88%) agreed to participate. Most of them were between 25 and 45 years old, and greater age was not associated with poorer acceptability. Most of the practitioners regularly used new technologies, and 95% (20/21) connected daily to the internet, with 70% (15/21) connecting 3 times a day or more. However, only 57% (12/21) reported feeling comfortable with computers. Of the clinicians, 86% (18/21) would recommend the tool to their colleagues and 67% (14/21) stated that they would be interested in daily use of the app. Most of the clinicians (16/21, 76%) found the interface easy to use and useful. However, several clinicians noted the lack of readability (8/21, 38%) and the need to improve ergonometric features (4/21, 19%), in particular to facilitate browsing through various subsections. Some participants (5/21, 24%) were concerned about the storage of medical data and most of them (11/21, 52%) seemed to be uncomfortable with this. CONCLUSIONS: We describe the first step of the development of a Web app combining an electronic health record and ecological momentary assessment features. This online tool offers the possibility to assess patients and to integrate medical data easily into face-to-face conditions. The acceptability of this app supports the feasibility of its broader implementation. This app could help to standardize assessment and to build up a strong database. Used in conjunction with robust data mining analytic techniques, such a database would allow exploration of risk factors, patterns of symptom evolution, and identification of distinct risk subgroups.

The Use of Virtual Reality in Patients with Eating Disorders: Systematic Review.

BACKGROUND: Patients with eating disorders are characterized by pathological eating habits and a tendency to overestimate their weight and body shape. Virtual reality shows promise for the evaluation and management of patients with eating disorders. This technology, when accepted by this population, allows immersion in virtual environments, assessment, and therapeutic approaches, by exposing users to high-calorie foods or changes in body shape. OBJECTIVE: To better understand the value of virtual reality, we conducted a review of the literature, including clinical studies proposing the use of virtual reality for the evaluation and management of patients with eating disorders. METHODS: We searched PubMed, PsycINFO, ScienceDirect, the Cochrane Library, Scopus, and Web of Science up to April 2017. We created the list of keywords based on two domains: virtual reality and eating disorders. We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses to identify, select, and critically appraise relevant research while minimizing bias. RESULTS: The initial database searches identified 311 articles, 149 of which we removed as duplicates. We analyzed the resulting set of 26 unique studies that met the inclusion criteria. Of these, 8 studies were randomized controlled trials, 13 were nonrandomized studies, and 5 were clinical trials with only 1 participant. Most articles focused on clinical populations (19/26, 73%), with the remainder reporting case-control studies (7/26, 27%). Most of the studies used visual immersive equipment (16/26, 62%) with a head-mounted display (15/16, 94%). Two main areas of interest emerged from these studies: virtual work on patients' body image (7/26, 27%) and exposure to virtual food stimuli (10/26, 38%). CONCLUSIONS: We conducted a broad analysis of studies on the use of virtual reality in patients with eating disorders. This review of the literature showed that virtual reality is an acceptable and promising therapeutic tool for patients with eating disorders.

Issues for eHealth in Psychiatry: Results of an Expert Survey.

BACKGROUND: Technology has changed the landscape in which psychiatry operates. Effective, evidence-based treatments for mental health care are now available at the fingertips of anyone with Internet access. However, technological solutions for mental health are not necessarily sought by consumers nor recommended by clinicians. OBJECTIVE: The objectives of this study are to identify and discuss the barriers to introducing eHealth technology-supported interventions within mental health. METHODS: An interactive polling tool was used to ask "In this brave new world, what are the key issues that need to be addressed to improve mental health (using technology)?" Respondents were the multidisciplinary attendees of the "Humans and Machines: A Quest for Better Mental Health" conference, held in Sydney, Australia, in 2016. Responses were categorized into 10 key issues using team-based qualitative analysis. RESULTS: A total of 155 responses to the question were received from 66 audience members. Responses were categorized into 10 issues and ordered by importance: access to care, integration and collaboration, education and awareness, mental health stigma, data privacy, trust, understanding and assessment of mental health, government and policy, optimal design, and engagement. In this paper, each of the 10 issues are outlined, and potential solutions are discussed. Many of the issues were interrelated, having implications for other key areas identified. CONCLUSIONS: As many of the issues identified directly related to barriers to care, priority should be given to addressing these issues that are common across mental health delivery. Despite new challenges raised by technology, technology-supported mental health interventions represent a tremendous opportunity to address in a timely way these major concerns and improve the receipt of effective, evidence-based therapy by those in need.

Mobile Apps for Bipolar Disorder: A Systematic Review of Features and Content Quality.

BACKGROUND: With continued increases in smartphone ownership, researchers and clinicians are investigating the use of this technology to enhance the management of chronic illnesses such as bipolar disorder (BD). Smartphones can be used to deliver interventions and psychoeducation, supplement treatment, and enhance therapeutic reach in BD, as apps are cost-effective, accessible, anonymous, and convenient. While the evidence-based development of BD apps is in its infancy, there has been an explosion of publicly available apps. However, the opportunity for mHealth to assist in the self-management of BD is only feasible if apps are of appropriate quality. OBJECTIVE: Our aim was to identify the types of apps currently available for BD in the Google Play and iOS stores and to assess their features and the quality of their content. METHODS: A systematic review framework was applied to the search, screening, and assessment of apps. We searched the Australian Google Play and iOS stores for English-language apps developed for people with BD. The comprehensiveness and quality of information was assessed against core psychoeducation principles and current BD treatment guidelines. Management tools were evaluated with reference to the best-practice resources for the specific area. General app features, and privacy and security were also assessed. RESULTS: Of the 571 apps identified, 82 were included in the review. Of these, 32 apps provided information and the remaining 50 were management tools including screening and assessment (n=10), symptom monitoring (n=35), community support (n=4), and treatment (n=1). Not even a quarter of apps (18/82, 22%) addressed privacy and security by providing a privacy policy. Overall, apps providing information covered a third (4/11, 36%) of the core psychoeducation principles and even fewer (2/13, 15%) best-practice guidelines. Only a third (10/32, 31%) cited their information source. Neither comprehensiveness of psychoeducation information (r=-.11, P=.80) nor adherence to best-practice guidelines (r=-.02, P=.96) were significantly correlated with average user ratings. Symptom monitoring apps generally failed to monitor critical information such as medication (20/35, 57%) and sleep (18/35, 51%), and the majority of self-assessment apps did not use validated screening measures (6/10, 60%). CONCLUSIONS: In general, the content of currently available apps for BD is not in line with practice guidelines or established self-management principles. Apps also fail to provide important information to help users assess their quality, with most lacking source citation and a privacy policy. Therefore, both consumers and clinicians should exercise caution with app selection. While mHealth offers great opportunities for the development of quality evidence-based mobile interventions, new frameworks for mobile mental health research are needed to ensure the timely availability of evidence-based apps to the public.

Promoting Engagement With Smartphone Apps for Suicidal Ideation in Young People: Development of an Adjunctive Strategy Using a Lived Experience Participatory Design Approach.

BACKGROUND: Suicide among young people is a worrying public health concern. Despite this, there is a lack of suitable interventions aligned with the needs of this priority population. Emerging evidence supports the effectiveness of digital interventions in alleviating the severity of suicidal thoughts. However, their efficacy may be undermined by poor engagement. Technology-supported strategies (eg, electronic prompts and reminders) have been deployed alongside digital interventions to increase engagement with the latter. However, evidence of their efficacy is inconclusive. User-centered design approaches may be key to developing feasible and effective engagement strategies. Currently, no study has been published on how such an approach might be expressly applied toward developing strategies for promoting engagement with digital interventions. OBJECTIVE: This study aimed to detail the processes and activities involved in developing an adjunctive strategy for promoting engagement with LifeBuoy-a smartphone app that helps young people manage suicidal thoughts. METHODS: Development of the engagement strategy took place in 2 phases. The discovery phase aimed to create an initial prototype by synthesizing earlier findings-from 2 systematic reviews and a cross-sectional survey of the broader mental health app user population-with qualitative insights from LifeBuoy users. A total of 16 web-based interviews were conducted with young people who participated in the LifeBuoy trial. Following the discovery phase, 3 interviewees were invited by the research team to take part in the workshops in the design phase, which sought to create a final prototype by making iterative improvements to the initial prototype. These improvements were conducted over 2 workshops. Thematic analysis was used to analyze the qualitative data obtained from the interviews and workshops. RESULTS: Main themes from the interviews centered around the characteristics of the strategy, timing of notifications, and suitability of social media platforms. Subsequently, themes that emerged from the design workshops emphasized having a wider variety of content, greater visual consistency with LifeBuoy, and a component with more detailed information to cater to users with greater informational needs. Thus, refinements to the prototype were focused on (1) improving the succinctness, variety, and practical value of Instagram content, (2) creating a blog containing articles contributed by mental health professionals and young people with lived experience of suicide, and (3) standardizing the use of marine-themed color palettes across the Instagram and blog components. CONCLUSIONS: This is the first study to describe the development of a technology-supported adjunctive strategy for promoting engagement with a digital intervention. It was developed by integrating perspectives from end users with lived experience of suicide with evidence from the existing literature. The development process documented in this study may be useful for guiding similar projects aimed at supporting the use of digital interventions for suicide prevention or mental health.

Examining the Feasibility of Implementing Digital Mental Health Innovations Into Hospitals to Support Youth in Suicide Crisis: Interview Study With Young People and Health Professionals.

BACKGROUND: Hospitals are insufficiently resourced to appropriately support young people who present with suicidal crises. Digital mental health innovations have the potential to provide cost-effective models of care to address this service gap and improve care experiences for young people. However, little is currently known about whether digital innovations are feasible to integrate into complex hospital settings or how they should be introduced for sustainability. OBJECTIVE: This qualitative study explored the potential benefits, barriers, and collective action required for integrating digital therapeutics for the management of suicidal distress in youth into routine hospital practice. Addressing these knowledge gaps is a critical first step in designing digital innovations and implementation strategies that enable uptake and integration. METHODS: We conducted a series of semistructured interviews with young people who had presented to an Australian hospital for a suicide crisis in the previous 12 months and hospital staff who interacted with these young people. Participants were recruited from the community nationally via social media advertisements on the web. Interviews were conducted individually, and participants were reimbursed for their time. Using the Normalization Process Theory framework, we developed an interview guide to clarify the processes and conditions that influence whether and how an innovation becomes part of routine practice in complex health systems. RESULTS: Analysis of 29 interviews (n=17, 59% young people and n=12, 41% hospital staff) yielded 4 themes that were mapped onto 3 Normalization Process Theory constructs related to coherence building, cognitive participation, and collective action. Overall, digital innovations were seen as a beneficial complement to but not a substitute for in-person clinical services. The timing of delivery was important, with the agreement that digital therapeutics could be provided to patients while they were waiting to be assessed or shortly before discharge. Staff training to increase digital literacy was considered key to implementation, but there were mixed views on the level of staff assistance needed to support young people in engaging with digital innovations. Improving access to technological devices and internet connectivity, increasing staff motivation to facilitate the use of the digital therapeutic, and allowing patients autonomy over the use of the digital therapeutic were identified as other factors critical to integration. CONCLUSIONS: Integrating digital innovations into current models of patient care for young people presenting to hospital in acute suicide crises is challenging because of several existing resource, logistical, and technical barriers. Scoping the appropriateness of new innovations with relevant key stakeholders as early as possible in the development process should be prioritized as the best opportunity to preemptively identify and address barriers to implementation.

Passive Sensing in the Prediction of Suicidal Thoughts and Behaviors: Protocol for a Systematic Review.

BACKGROUND: Suicide is a severe public health problem, resulting in a high number of attempts and deaths each year. Early detection of suicidal thoughts and behaviors (STBs) is key to preventing attempts. We discuss passive sensing of digital and behavioral markers to enhance the detection and prediction of STBs. OBJECTIVE: The paper presents the protocol for a systematic review that aims to summarize existing research on passive sensing of STBs and evaluate whether the STB prediction can be improved using passive sensing compared to prior prediction models. METHODS: A systematic search will be conducted in the scientific databases MEDLINE, PubMed, Embase, PsycINFO, and Web of Science. Eligible studies need to investigate any passive sensor data from smartphones or wearables to predict STBs. The predictive value of passive sensing will be the primary outcome. The practical implications and feasibility of the studies will be considered as secondary outcomes. Study quality will be assessed using the Prediction Model Risk of Bias Assessment Tool (PROBAST). If studies are sufficiently homogenous, we will conduct a meta-analysis of the predictive value of passive sensing on STBs. RESULTS: The review process started in July 2022 with data extraction in September 2022. Results are expected in December 2022. CONCLUSIONS: Despite intensive research efforts, the ability to predict STBs is little better than chance. This systematic review will contribute to our understanding of the potential of passive sensing to improve STB prediction. Future research will be stimulated since gaps in the current literature will be identified and promising next steps toward clinical implementation will be outlined. TRIAL REGISTRATION: OSF Registries osf-registrations-hzxua-v1; https://osf.io/hzxua. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/42146.

The Use of Closed-Circuit Television and Video in Suicide Prevention: Narrative Review and Future Directions.

BACKGROUND: Suicide is a recognized public health issue, with approximately 800,000 people dying by suicide each year. Among the different technologies used in suicide research, closed-circuit television (CCTV) and video have been used for a wide array of applications, including assessing crisis behaviors at metro stations, and using computer vision to identify a suicide attempt in progress. However, there has been no review of suicide research and interventions using CCTV and video. OBJECTIVE: The objective of this study was to review the literature to understand how CCTV and video data have been used in understanding and preventing suicide. Furthermore, to more fully capture progress in the field, we report on an ongoing study to respond to an identified gap in the narrative review, by using a computer vision-based system to identify behaviors prior to a suicide attempt. METHODS: We conducted a search using the keywords "suicide," "cctv," and "video" on PubMed, Inspec, and Web of Science. We included any studies which used CCTV or video footage to understand or prevent suicide. If a study fell into our area of interest, we included it regardless of the quality as our goal was to understand the scope of how CCTV and video had been used rather than quantify any specific effect size, but we noted the shortcomings in their design and analyses when discussing the studies. RESULTS: The review found that CCTV and video have primarily been used in 3 ways: (1) to identify risk factors for suicide (eg, inferring depression from facial expressions), (2) understanding suicide after an attempt (eg, forensic applications), and (3) as part of an intervention (eg, using computer vision and automated systems to identify if a suicide attempt is in progress). Furthermore, work in progress demonstrates how we can identify behaviors prior to an attempt at a hotspot, an important gap identified by papers in the literature. CONCLUSIONS: Thus far, CCTV and video have been used in a wide array of applications, most notably in designing automated detection systems, with the field heading toward an automated detection system for early intervention. Despite many challenges, we show promising progress in developing an automated detection system for preattempt behaviors, which may allow for early intervention.

Performance, Cost-Effectiveness, and Representativeness of Facebook Recruitment to Suicide Prevention Research: Online Survey Study.

BACKGROUND: Researchers are increasingly using social media advertisements to recruit participants because of their many advantages over traditional methods. Although there is growing evidence for the effectiveness and cost-effectiveness of social media recruitment in the health sciences, no studies have yet examined this in the context of suicide prevention, which remains to be a highly stigmatized and sensitive topic. OBJECTIVE: This study aims to recruit a general community sample to complete a survey on suicide literacy, stigma, and risk via Facebook advertisements. Specifically, we aim to establish the performance of the advertisements, cost-effectiveness, sample representativeness, and the impact of gender-specific advertising on recruiting men into the study. METHODS: From June 2017 to March 2019, we released Facebook advertisements targeted at adults 18 years or older, residing in the New South Wales (NSW) trial or control regions, and involved in the LifeSpan suicide prevention trial. Cost-effectiveness was examined descriptively using metrics provided by Facebook. Chi-square analyses were conducted to determine demographic differences between our sample and the general NSW population as well as the impact of gender-specific advertisements on gender engagement. RESULTS: The 14 Facebook advertisement campaigns reached a total of 675,199 people, yielding 25,993 link clicks and resulting in 9603 individuals initiating the survey (7487 completions) at an overall cost of Aus $2.81 (US $2.01) per participant. There was an overrepresentation of younger (P=.003), female (P=.003), highly educated (P<.001) participants and mental health conditions (P<.001) compared with the total NSW population. The use of male-specific advertisements resulted in a significantly higher proportion of men completing the survey relative to gender-neutral advertisements (38.2% vs 24.6%; P<.001). CONCLUSIONS: This study demonstrates the potential of Facebook to be an effective, low-cost strategy for recruiting a large sample of general community participants for suicide prevention research. Strategies to improve sample representativeness warrant further investigation in future research.

Using science to sell apps: Evaluation of mental health app store quality claims.

Despite the emergence of curated app libraries for mental health apps, personal searches by consumers remain a common method for discovering apps. App store descriptions therefore represent a key channel to inform consumer choice. This study examined the claims invoked through these app store descriptions, the extent to which scientific language is used to support such claims, and the corresponding evidence in the literature. Google Play and iTunes were searched for apps related to depression, self-harm, substance use, anxiety, and schizophrenia. The descriptions of the top-ranking, consumer-focused apps were coded to identify claims of acceptability and effectiveness, and forms of supporting statement. For apps which invoked ostensibly scientific principles, a literature search was conducted to assess their credibility. Seventy-three apps were coded, and the majority (64%) claimed effectiveness at diagnosing a mental health condition, or improving symptoms, mood or self-management. Scientific language was most frequently used to support these effectiveness claims (44%), although this included techniques not validated by literature searches (8/24 = 33%). Two apps described low-quality, primary evidence to support the use of the app. Only one app included a citation to published literature. A minority of apps (14%) described design or development involving lived experience, and none referenced certification or accreditation processes such as app libraries. Scientific language was the most frequently invoked form of support for use of mental health apps; however, high-quality evidence is not commonly described. Improved knowledge translation strategies may improve the adoption of other strategies, such as certification or lived experience co-design.

An Approach for Data Mining of Electronic Health Record Data for Suicide Risk Management: Database Analysis for Clinical Decision Support.

BACKGROUND: In an electronic health context, combining traditional structured clinical assessment methods and routine electronic health-based data capture may be a reliable method to build a dynamic clinical decision-support system (CDSS) for suicide prevention. OBJECTIVE: The aim of this study was to describe the data mining module of a Web-based CDSS and to identify suicide repetition risk in a sample of suicide attempters. METHODS: We analyzed a database of 2802 suicide attempters. Clustering methods were used to identify groups of similar patients, and regression trees were applied to estimate the number of suicide attempts among these patients. RESULTS: We identified 3 groups of patients using clustering methods. In addition, relevant risk factors explaining the number of suicide attempts were highlighted by regression trees. CONCLUSIONS: Data mining techniques can help to identify different groups of patients at risk of suicide reattempt. The findings of this study can be combined with Web-based and smartphone-based data to improve dynamic decision making for clinicians.

Toward mHealth Brief Contact Interventions in Suicide Prevention: Case Series From the Suicide Intervention Assisted by Messages (SIAM) Randomized Controlled Trial.

BACKGROUND: Research indicates that maintaining contact either via letter or postcard with at-risk adults following discharge from care services after a suicide attempt (SA) can reduce reattempt risk. Pilot studies have demonstrated that interventions using mobile health (mHealth) technologies are feasible in a suicide prevention setting. OBJECTIVE: The aim of this study was to report three cases of patients recruited in the Suicide Intervention Assisted by Messages (SIAM) study to describe how a mobile intervention may influence follow-up. METHODS: SIAM is a 2-year, multicenter randomized controlled trial conducted by the Brest University Hospital, France. Participants in the intervention group receive SIAM text messages 48 hours after discharge, then at day 8 and day 15, and months 1, 2, 3, 4, 5, and 6. The study includes participants aged 18 years or older, who have attended a participating hospital for an SA, and have been discharged from the emergency department (ED) or a psychiatric unit (PU) for a stay of less than 7 days. Eligible participants are randomized between the SIAM intervention messages and a control group. In this study, we present three cases from the ongoing SIAM study that demonstrate the capability of a mobile-based brief contact intervention for triggering patient-initiated contact with a crisis support team at various time points throughout the mobile-based follow-up period. RESULTS: Out of the 244 patients recruited in the SIAM randomized controlled trial, three cases were selected to illustrate the impact of mHealth on suicide risk management. Participants initiated contact with the emergency crisis support service after receiving text messages up to 6 months following discharge from the hospital. Contact was initiated immediately following receipt of a text message or up to 6 days following a message. CONCLUSIONS: This text message-based brief contact intervention has demonstrated the potential to reconnect suicidal individuals with crisis support services while they are experiencing suicidal ideation as well as in a period after receiving messages. As follow-up phone calls over an extended period of time may not be feasible, this intervention has the potential to offer simple technological support for individuals following discharge from the ED. TRIAL REGISTRATION: ClinicalTrials.gov NCT02106949; https://clinicaltrials.gov/ct2/show/NCT02106949 (Archived by WebCite at http://www.webcitation.org/6wMtAFL49).

A Mobile Text Message Intervention to Reduce Repeat Suicidal Episodes: Design and Development of Reconnecting After a Suicide Attempt (RAFT).

BACKGROUND: Suicide is a leading cause of death, particularly among young people. Continuity of care following discharge from hospital is critical, yet this is a time when individuals often lose contact with health care services. Offline brief contact interventions following a suicide attempt can reduce the number of repeat attempts, and text message (short message service, SMS) interventions are currently being evaluated. OBJECTIVE: The aim of this study was to extend postattempt caring contacts by designing a brief Web-based intervention targeting proximal risk factors and the needs of this population during the postattempt period. This paper details the development process and describes the realized system. METHODS: To inform the design of the intervention, a lived experience design group was established. Participants were asked about their experiences of support following their suicide attempt, their needs during this time, and how these could be addressed in a brief contact eHealth intervention. The intervention design was also informed by consultation with lived experience panels external to the project and a clinical design group. RESULTS: Prompt outreach following discharge, initial distraction activities with low cognitive demands, and ongoing support over an extended period were identified as structural requirements of the intervention. Key content areas identified included coping with distressing feelings, safety planning, emotional regulation and acceptance, coping with suicidal thoughts, connecting with others and interpersonal relationships, and managing alcohol consumption. CONCLUSIONS: The RAFT (Reconnecting AFTer a suicide attempt) text message brief contact intervention combines SMS contacts with additional Web-based brief therapeutic content targeting key risk factors. It has the potential to reduce the number of repeat suicidal episodes and to provide accessible, acceptable, and cost-effective support for individuals who may not otherwise seek face-to-face treatment. A pilot study to test the feasibility and acceptability of the RAFT intervention is underway.

A Systematic Assessment of Smartphone Tools for Suicide Prevention.

BACKGROUND: Suicide is a leading cause of death globally, and there has been a rapid growth in the use of new technologies such as mobile health applications (apps) to help identify and support those at risk. However, it is not known whether these apps are evidence-based, or indeed contain potentially harmful content. This review examines the concordance of features in publicly available apps with current scientific evidence of effective suicide prevention strategies. METHODS: Apps referring to suicide or deliberate self-harm (DSH) were identified on the Android and iOS app stores. Systematic review methodology was employed to screen and review app content. App features were labelled using a coding scheme that reflected the broad range of evidence-based medical and population-based suicide prevention interventions. Best-practice for suicide prevention was based upon a World Health Organization report and supplemented by other reviews of the literature. RESULTS: One hundred and twenty-three apps referring to suicide were identified and downloaded for full review, 49 of which were found to contain at least one interactive suicide prevention feature. Most apps focused on obtaining support from friends and family (n = 27) and safety planning (n = 14). Of the different suicide prevention strategies contained within the apps, the strongest evidence in the literature was found for facilitating access to crisis support (n = 13). All reviewed apps contained at least one strategy that was broadly consistent with the evidence base or best-practice guidelines. Apps tended to focus on a single suicide prevention strategy (mean = 1.1), although safety plan apps provided the opportunity to provide a greater number of techniques (mean = 3.9). Potentially harmful content, such as listing lethal access to means or encouraging risky behaviour in a crisis, was also identified. DISCUSSION: Many suicide prevention apps are available, some of which provide elements of best practice, but none that provide comprehensive evidence-based support. Apps with potentially harmful content were also identified. Despite the number of apps available, and their varied purposes, there is a clear need to develop useful, pragmatic, and multifaceted mobile resources for this population. Clinicians should be wary in recommending apps, especially as potentially harmful content can be presented as helpful. Currently safety plan apps are the most comprehensive and evidence-informed, for example, "Safety Net" and "Mood-Tools--Depression Aid".

Quantifying App Store Dynamics: Longitudinal Tracking of Mental Health Apps.

BACKGROUND: For many mental health conditions, mobile health apps offer the ability to deliver information, support, and intervention outside the clinical setting. However, there are difficulties with the use of a commercial app store to distribute health care resources, including turnover of apps, irrelevance of apps, and discordance with evidence-based practice. OBJECTIVE: The primary aim of this study was to quantify the longevity and rate of turnover of mental health apps within the official Android and iOS app stores. The secondary aim was to quantify the proportion of apps that were clinically relevant and assess whether the longevity of these apps differed from clinically nonrelevant apps. The tertiary aim was to establish the proportion of clinically relevant apps that included claims of clinical effectiveness. We performed additional subgroup analyses using additional data from the app stores, including search result ranking, user ratings, and number of downloads. METHODS: We searched iTunes (iOS) and the Google Play (Android) app stores each day over a 9-month period for apps related to depression, bipolar disorder, and suicide. We performed additional app-specific searches if an app no longer appeared within the main search RESULTS: On the Android platform, 50% of the search results changed after 130 days (depression), 195 days (bipolar disorder), and 115 days (suicide). Search results were more stable on the iOS platform, with 50% of the search results remaining at the end of the study period. Approximately 75% of Android and 90% of iOS apps were still available to download at the end of the study. We identified only 35.3% (347/982) of apps as being clinically relevant for depression, of which 9 (2.6%) claimed clinical effectiveness. Only 3 included a full citation to a published study. CONCLUSIONS: The mental health app environment is volatile, with a clinically relevant app for depression becoming unavailable to download every 2.9 days. This poses challenges for consumers and clinicians seeking relevant and long-term apps, as well as for researchers seeking to evaluate the evidence base for publicly available apps.