Feasibility of a Mobile Health App for Routine Outcome Monitoring and Feedback in SMART Recovery Mutual Support Groups: Stage 1 Mixed Methods Pilot Study.

BACKGROUND: Mutual support groups are an important source of long-term help for people impacted by addictive behaviors. Routine outcome monitoring (ROM) and feedback are yet to be implemented in these settings. SMART Recovery mutual support groups focus on self-empowerment and use evidence-based techniques (eg, motivational and behavioral strategies). Trained facilitators lead all SMART Recovery groups, providing an opportunity to implement ROM. OBJECTIVE: The aim of this stage 1 pilot study is to explore the feasibility, acceptability, and preliminary outcomes of a novel, purpose-built mobile health ROM and feedback app (SMART Track) in mutual support groups coordinated by SMART Recovery Australia (SRAU) over 8 weeks. METHODS: SMART Track was developed during phase 1 of this study using participatory design methods and an iterative development process. During phase 2, 72 SRAU group participants were recruited to a nonrandomized, prospective, single-arm trial of the SMART Track app. Four modes of data collection were used: ROM data directly entered by participants into the app; app data analytics captured by Amplitude Analytics (number of visits, number of unique users, visit duration, time of visit, and user retention); baseline, 2-, and 8-week follow-up assessments conducted through telephone; and qualitative telephone interviews with a convenience sample of study participants (20/72, 28%) and facilitators (n=8). RESULTS: Of the 72 study participants, 68 (94%) created a SMART Track account, 64 (88%) used SMART Track at least once, and 42 (58%) used the app for more than 5 weeks. During week 1, 83% (60/72) of participants entered ROM data for one or more outcomes, decreasing to 31% (22/72) by the end of 8 weeks. The two main screens designed to provide personal feedback data (Urges screen and Overall Progress screen) were the most frequently visited sections of the app. Qualitative feedback from participants and facilitators supported the acceptability of SMART Track and the need for improved integration into the SRAU groups. Participants reported significant reductions between the baseline and 8- week scores on the Severity of Dependence Scale (mean difference 1.93, SD 3.02; 95% CI 1.12-2.73) and the Kessler Psychological Distress Scale-10 (mean difference 3.96, SD 8.31; 95% CI 1.75-6.17), but no change on the Substance Use Recovery Evaluator (mean difference 0.11, SD 7.97; 95% CI -2.02 to 2.24) was reported. CONCLUSIONS: Findings support the feasibility, acceptability, and utility of SMART Track. Given that sustained engagement with mobile health apps is notoriously difficult to achieve, our findings are promising. SMART Track offers a potential solution for ROM and personal feedback, particularly for people with substance use disorders who attend mutual support groups. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN12619000686101; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/15113.

Developing a mHealth Routine Outcome Monitoring and Feedback App ("SMART Track") to Support Self-Management of Addictive Behaviours.

Background: Routine outcome monitoring (ROM) has been implemented across a range of addiction treatment services, settings and organisations. Mutual support groups are a notable exception. Innovative solutions are needed. SMART Track is a purpose built smartphone app designed to capture ROM data and provide tailored feedback to adults attending Australian SMART Recovery groups for addictive behaviour(s). Objective: Details regarding the formative stage of app development is essential, but often neglected. Improved consideration of the end-user is vital for curtailing app attrition and enhancing engagement. This paper provides a pragmatic example of how principles embedded in published frameworks can be operationalised to address these priorities during the design and development of the SMART Track app. Methods: Three published frameworks for creating digital health technologies ("Person-Based Approach," "BIT" Model and IDEAS framework) were integrated and applied across two stages of research to inform the development, design and content of SMART Track. These frameworks were chosen to ensure that SMART Track was informed by the needs and preferences of the end-user ("Person-Based"); best practise recommendations for mHealth development ("BIT" Model) and a collaborative, iterative development process between the multi-disciplinary research team, app developers and end-users (IDEAS framework). Results: Stage one of the research process generated in-depth knowledge to inform app development, including a comprehensive set of aims (clinical, research/organisation, and usage); clear articulation of the target behaviour (self-monitoring of recovery related behaviours and experiences); relevant theory (self-determination and social control); appropriate behavioural strategies (e.g., behaviour change taxonomy and process motivators) and key factors that may influence engagement (e.g., transparency, relevance and trust). These findings were synthesised into guiding principles that were applied during stage two in an iterative approach to app design, content and development. Conclusions: This paper contributes new knowledge on important person-centred and theoretical considerations that underpin a novel ROM and feedback app for people with addictive behaviour(s). Although person-centred design and best-practise recommendations were employed, further research is needed to determine whether this leads to improved usage outcomes. Clinical Trial Registration: Pilot Trial: http://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336.

SMART Recovery International and COVID-19: Expanding the reach of mutual support through online groups.

BACKGROUND: Mutual support groups play an extremely important role in providing opportunities for people to engage in alcohol and other drug (AOD) treatment and support. SMART Recovery groups employ cognitive, behavioural and motivational principles and strategies to offer support for a range of addictive behaviours. COVID-19 fundamentally changed the way that these groups could be delivered. METHODS: A series of online meetings were conducted by the lead author (PK) and the SMART Recovery International Executive Officer (KM), with representatives from the SMART Recovery National Offices in the Ireland (DO), United States (MR), Australia (RM), and Denmark (BSH, DA), and the United Kingdom (AK). The meetings focused on discussing the impacts of COVID-19 on SMART Recovery in each of the regions. RESULTS: As a result of restrictions to prevent the transmission of COVID-19, the vast majority of SMART Recovery face-to-face meetings were required to cease globally. To ensure people still had access to AOD mutual support, SMART Recovery rapidly scaled up the provision of online groups. This upscaling has increased the number of groups in countries that had previously provided a limited number of online meetings (i.e., United States, England, Australia), and has meant that online groups are available for the first time in Denmark, Ireland, Hong Kong, Spain, Malaysia and Brazil. DISCUSSION: Whilst the urgent and rapid expansion of online groups was required to support people during the pandemic, it has also created an opportunity for the ongoing availability of online mutual support post-pandemic. The challenge for the research community is to critically evaluate the online delivery of mutual support groups, to better understand the mechanisms through which they may work, and to help understand the experience of people accessing the groups.

A qualitative exploration of SMART Recovery meetings in Australia and the role of a digital platform to support routine outcome monitoring.

Previous research has reported on the benefits of mutual support groups. However, such groups do not routinely collect data on participant outcomes. Moreover, the effect of collecting outcomes measures on these groups is unknown. The objective of this mixed methods study was to elicit participant views on using a novel, purpose built digital platform for routine outcome monitoring (ROM) as a standard component of a mutual support group. SMART Recovery, or the Self-Management and Recovery Training program, is group-based and uses professional clinicians to facilitate discussion and foster mutual support for a range of addictive behaviours, alongside Cognitive Behavioural Therapy and Motivational Interviewing techniques. This paper reports on the qualitative component of this study and how participants perceive ROMs, and the potential shift to technological resources. Twenty semi-structured telephone interviews were conducted with participants from SMART Recovery groups across New South Wales, Australia. Participants discussed their use of mutual support within group meetings to manage their recovery, including: naming their goals in front of peers; learning from clinicians and group discussion; and developing reciprocal and caring relationships. They also described any previous experience with routine outcomes measures and how digital technologies might enhance or hinder group function. Participants valued mutual support groups and reported that digital technologies could be complementary to physical, weekly group meetings. They were also concerned that the introduction of technological resources might pose a threat to physical meetings, thereby risking their access to mutual support. Findings have implications for the implementation of ROM when delivered via digital mechanisms, and indicate threats and opportunities that warrant consideration for future initiatives.

Feasibility of a Mobile Health App for Routine Outcome Monitoring and Feedback in Mutual Support Groups Coordinated by SMART Recovery Australia: Protocol for a Pilot Study.

BACKGROUND: Despite the importance and popularity of mutual support groups, there have been no systematic attempts to implement and evaluate routine outcome monitoring (ROM) in these settings. Unlike other mutual support groups for addiction, trained facilitators lead all Self-Management and Recovery Training (SMART Recovery) groups, thereby providing an opportunity to implement ROM as a routine component of SMART Recovery groups. OBJECTIVE: This study protocol aims to describe a stage 1 pilot study designed to explore the feasibility and acceptability of a novel, purpose-built mobile health (mHealth) ROM and feedback app (Smart Track) in SMART Recovery groups coordinated by SMART Recovery Australia (SRAU) The secondary objectives are to describe Smart Track usage patterns, explore psychometric properties of the ROM items (ie, internal reliability and convergent and divergent validity), and provide preliminary evidence for participant reported outcomes (such as alcohol and other drug use, self-reported recovery, and mental health). METHODS: Participants (n=100) from the SMART Recovery groups across New South Wales, Australia, will be recruited to a nonrandomized, prospective, single-arm trial of the Smart Track app. There are 4 modes of data collection: (1) ROM data collected from group participants via the Smart Track app, (2) data analytics summarizing user interactions with Smart Track, (3) quantitative interview and survey data of group participants (baseline, 2-week follow-up, and 2-month follow-up), and (4) qualitative interviews with group participants (n=20) and facilitators (n=10). Feasibility and acceptability (primary objectives) will be analyzed using descriptive statistics, a cost analysis, and a qualitative evaluation. RESULTS: At the time of submission, 13 sites (25 groups per week) had agreed to be involved. Funding was awarded on August 14, 2017, and ethics approval was granted on April 26, 2018 (HREC/18/WGONG/34; 2018/099). Enrollment is due to commence in July 2019. Data collection is due to be finalized in October 2019. CONCLUSIONS: To the best of our knowledge, this study is the first to use ROM and tailored feedback within a mutual support group setting for addictive behaviors. Our study design will provide an opportunity to identify the acceptability of a novel mHealth ROM and feedback app within this setting and provide detailed information on what factors promote or hinder ROM usage within this context. This project aims to offer a new tool, should Smart Track prove feasible and acceptable, that service providers, policy makers, and researchers could use in the future to understand the impact of SMART Recovery groups. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12619000686101; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/15113.