Greek validation of the user version of the Mobile Application Rating Scale (uMARS).

OBJECTIVE: The original user version of the Mobile Application Rating Scale (uMARS) is an English-language questionnaire that was designed to allow non-expert app users to assess the quality of health apps. We aimed to translate into the Greek language and validate the uMARS. METHODS: This was a qualitative prospective study. The World Health Organization translation process was followed and a readily available and free-of-charge app was used for the validation process. Internal consistency and reliability were tested twice within one month by 91 Greek medical students. RESULTS: The total uMARS score showed excellent internal consistency (Cronbach's alpha = 0.86). The internal consistencies of its subscales were also very high (engagement alpha = 0.71; functionality alpha = 0.71; aesthetics alpha = 0.67; information alpha = 0.63), with the notable exception of the satisfaction alpha, which was 0.61. The uMARS total score demonstrated almost perfect agreement levels in most of the subscales according to the rWG index from baseline to 1 month. CONCLUSIONS: The Greek uMARS is a reliable and valid tool for assessing the quality of mobile apps.

The Persian Version of the Mobile Application Rating Scale (MARS-Fa): Translation and Validation Study.

BACKGROUND: Approximately 110 million Farsi speakers worldwide have access to a growing mobile app market. Despite restrictions and international sanctions, Iran's internal mobile health app market is growing, especially for Android-based apps. However, there is a need for guidelines for developing health apps that meet international quality standards. There are also no tools in Farsi that assess health app quality. Developers and researchers who operate in Farsi could benefit from such quality assessment tools to improve their outputs. OBJECTIVE: This study aims to translate and culturally adapt the Mobile Application Rating Scale in Farsi (MARS-Fa). This study also evaluates the validity and reliability of the newly developed MARS-Fa tool. METHODS: We used a well-established method to translate and back translate the MARS-Fa tool with a group of Iranian and international experts in Health Information Technology and Psychology. The final translated version of the tool was tested on a sample of 92 apps addressing smartphone addiction. Two trained reviewers completed an independent assessment of each app in Farsi and English. We reported reliability and construct validity estimates for the objective scales (engagement, functionality, aesthetics, and information quality). Reliability was based on the evaluation of intraclass correlation coefficients, Cronbach α and Spearman-Brown split-half reliability indicators (for internal consistency), as well as Pearson correlations for test-retest reliability. Construct validity included convergent and discriminant validity (through item-total correlations within the objective scales) and concurrent validity using Pearson correlations between the objective and subjective scores. RESULTS: After completing the translation and cultural adaptation, the MARS-Fa tool was used to assess the selected apps for smartphone addiction. The MARS-Fa total scale showed good interrater reliability (intraclass correlation coefficient=0.83, 95% CI 0.74-0.89) and good internal consistency (Cronbach α=.84); Spearman-Brown split-half reliability for both raters was 0.79 to 0.93. The instrument showed excellent test-retest reliability (r=0.94). The correlations among the MARS-Fa subdomains and the total score were all significant and above r=0.40, suggesting good convergent and discriminant validity. The MARS-Fa was positively and significantly correlated with subjective quality (r=0.90, P<.001), and so were the objective subdomains of engagement (r=0.85, P<.001), information quality (r=0.80, P<.001), aesthetics (r=0.79, P<.001), and functionality (r=0.57, P<.001), indicating concurrent validity. CONCLUSIONS: The MARS-Fa is a reliable and valid instrument to assess mobile health apps. This instrument could be adopted by Farsi-speaking researchers and developers who want to evaluate the quality of mobile apps. While we tested the tool with a sample of apps addressing smartphone addiction, the MARS-Fa could assess other domains or issues since the Mobile App Rating Scale has been used to rate apps in different contexts and languages.

Development and validation of the Japanese version of the uMARS (user version of the mobile app rating system).

BACKGROUND: Although the global market of Mobile Health Apps (mHealth apps) continues to grow dramatically, most mHealth apps still not only lack evidence base but have even not been evaluated for the basic usability or functionality. The User Version of the Mobile App Rating Scale (uMARS) was developed to allow end users to assess mHealth apps objectively and subjectively. However, there is no Japanese version of uMARS to date. OBJECTIVE: The purpose of this study is (1) to develop a validated Japanese version of uMARS and (2) to assess the translated version's reliability and validity in evaluating mHealth apps. METHODS: The original uMARS was adapted for Japanese use by four specialists using universalist cross-cultural methods. Translation/back-translation was reviewed by the author of the original version of uMARS, and confirmed. Its reliability and validity were further evaluated as part of a prospective cohort study of postoperative patients using a new mHealth app. RESULTS: Conceptual equivalence was analyzed and all items in all subcategories of the original uMARS were included in the Japanese version. Internal consistency was deemed acceptable for all subscales of objective and subjective quality with a Cronbach's alpha of 0.75-0.85. Test-retest reliability of all subscales was also acceptable with intraclass correlation coefficients (ICCs) of 0.57-0.88. Convergent/divergent validity and concurrent validity were also considered acceptable. CONCLUSION: A Japanese version of uMARS was cross-culturally validated and found to be as reliable as the original uMARS. This Japanese version of uMARS is expected to become a standard tool in assessing the quality of mHealth apps in Japan.

Validation of a Korean version of mobile app rating scale (MARS) for apps targeting disease management.

The mobile app rating scale (MARS) is a widely used instrument for evaluating smartphone app quality. We aimed to examine the reliability and validity of the Korean version of MARS (MARS-K). Two independent raters performed the assessment using the translated 23-item questionnaire. We applied intraclass correlation coefficient analysis (ICC) to examine inter-rater reliability, Omega, and item-total correlation for internal consistency, and Pearson's r for test-retest reliability and correlation between subscales and the total score of MARS-K. Most items showed moderate to good ICC (0.447-1.000). The MARS-K showed excellent internal consistency and all subscales exceeded the acceptable level of omega. Results indicated MARS-K to be a valid and reliable instrument for evaluating disease management apps offered in the Korean app store. However, upgrades are recommended to further improve MARS-K's rating accuracy and reliability.

Japanese Version of the Mobile App Rating Scale (MARS): Development and Validation.

BACKGROUND: The number of mobile health (mHealth) apps continues to rise each year. Widespread use of the Mobile App Rating Scale (MARS) has allowed objective and multidimensional evaluation of the quality of these apps. However, no Japanese version of MARS has been made available to date. OBJECTIVE: The purposes of this study were (1) to develop a Japanese version of MARS and (2) to assess the translated version's reliability and validity in evaluating mHealth apps. METHODS: To develop the Japanese version of MARS, cross-cultural adaptation was used using a universalist approach. A total of 50 mental health apps were evaluated by 2 independent raters. Internal consistency and interrater reliability were then calculated. Convergent and divergent validity were assessed using multitrait scaling analysis and concurrent validity. RESULTS: After cross-cultural adaptation, all 23 items from the original MARS were included in the Japanese version. Following translation, back-translation, and review by the author of the original MARS, a Japanese version of MARS was finalized. Internal consistency was acceptable by all subscales of objective and subjective quality (Cronbach α=.78-.89). Interrater reliability was deemed acceptable, with the intraclass correlation coefficient (ICC) ranging from 0.61 to 0.79 for all subscales, except for "functionality," which had an ICC of 0.40. Convergent/divergent validity and concurrent validity were also considered acceptable. The rate of missing responses was high in several items in the "information" subscale. CONCLUSIONS: A Japanese version of MARS was developed and shown to be reliable and valid to a degree that was comparable to the original MARS. This Japanese version of MARS can be used as a standard to evaluate the quality and credibility of mHealth apps.

Development of the Niggle App for Supporting Young People on Their Dynamic Journey to Well-being: Co-design and Qualitative Research Study.

BACKGROUND: Adolescence is a life stage characterized by intense development and increased vulnerability. Yet, young people rarely seek help for mental health, often due to stigma and embarrassment. Alarmingly, even those who do seek help may not be able to receive it. Interventions focused on well-being offer a protective factor against adversity. Highly effective, innovative, theoretically sound, accessible, and engaging mobile health (mHealth) interventions that can be used to look beyond mental ill-health and toward mental well-being are urgently needed. OBJECTIVE: We aimed to explore how young Australians conceptualize and construct recovery journeys from feeling unwell to being well in order to inform the conceptual design of a youth-led information-, resource-, and support-focused mHealth intervention. METHODS: A sample of young people, grouped by age (12-15 years, 16-19 years, and 20-25 years), took part in 3 in-person participatory design workshops (per group). Young people's understanding and representation of well-being, feeling unwell, and the recovery journey were investigated using visual and linguistic data collection methods: photo elicitation and journey mapping. A social constructionist perspective was used for thematic analysis to produce a conceptual model of the recovery journey. A mobile app was co-designed and all app functions were mapped through iterative development and testing by young people and a team of psychology, research, design and information technology experts. RESULTS: Young people (n=25) described a 6-stage journey with specific barriers and coping strategies. The findings, when situated within the personal recovery framework in mental health, emphasize the cyclic and iterative model of change. Through co-design, the new app-Niggle-was conceptualized as a visual representation of an amorphous problem, which can be addressed through app functions corresponding to the most helpful strategies that young people used to progress through the stages of their recovery journey. CONCLUSIONS: Niggle is available to offer support to young people for a range of problems and provides a hot link to counseling services in Australia. This paper elaborates on the process of in-depth qualitative data collection through visual, linguistic, and co-design methods. The findings of this study give insight into young people's understanding of well-being and recovery. This paper could aid the development of high-quality personalized mHealth interventions and support resources.

A Web-Based Program for Cannabis Use and Psychotic Experiences in Young People (Keep It Real): Protocol for a Randomized Controlled Trial.

BACKGROUND: Young Australians (16-25 years) have the highest rates of past-month cannabis use in the world. Cannabis use increases the risk of alcohol and other drug disorders and depressive disorders, and has a robust dose-response association with psychotic experiences (PEs) and disorders. PEs are subthreshold positive psychotic symptoms, including delusions and hallucinations, which increase the risk of substance use, depressive or anxiety disorders, and psychotic disorders. Access to effective web-based early interventions targeting both cannabis use and PEs could reduce such risk in young people. OBJECTIVE: The objective of this study is to determine the efficacy and cost-effectiveness of the Keep it Real web-based program compared to an information-only control website among young cannabis users (16-25 years) with PEs. METHODS: Participants are recruited online, and consenting individuals meeting inclusion criteria (aged 16-25 years, who have used cannabis in the past month and experienced PEs in the past 3 months) are automatically randomized to either the Keep it Real web-based program (n=249) or an information-only control website (n=249). Both websites are self-guided (fully automated). The baseline and follow-up assessments at 3, 6, 9, and 12 months are self-completed online. Primary outcome measures are weekly cannabis use, PEs, and the relative cost-effectiveness for quality-adjusted life years. Secondary outcomes include other substance use and related problems, PE-related distress, cannabis intoxication experiences, severity of cannabis dependence, depression/anxiety symptoms, suicidality, and mental well-being and functioning. RESULTS: Recruitment commenced in February 2019, and the results are expected to be submitted for publication in mid-2021. CONCLUSIONS: This study protocol describes a large randomized controlled trial of a new web-based program for young cannabis users experiencing PEs. If effective, the accessibility and scalability of Keep it Real could help reduce growing public health concerns about the significant social, economic, and health impacts of cannabis use. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN12618001107213; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=374800. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/15803.

The Arabic Version of the Mobile App Rating Scale: Development and Validation Study.

BACKGROUND: With thousands of health apps in app stores globally, it is crucial to systemically and thoroughly evaluate the quality of these apps due to their potential influence on health decisions and outcomes. The Mobile App Rating Scale (MARS) is the only currently available tool that provides a comprehensive, multidimensional evaluation of app quality, which has been used to compare medical apps from American and European app stores in various areas, available in English, Italian, Spanish, and German. However, this tool is not available in Arabic. OBJECTIVE: This study aimed to translate and adapt MARS to Arabic and validate the tool with a sample of health apps aimed at managing or preventing obesity and associated disorders. METHODS: We followed a well-established and defined "universalist" process of cross-cultural adaptation using a mixed methods approach. Early translations of the tool, accompanied by confirmation of the contents by two rounds of separate discussions, were included and culminated in a final version, which was then back-translated into English. Two trained researchers piloted the MARS in Arabic (MARS-Ar) with a sample of 10 weight management apps obtained from Google Play and the App Store. Interrater reliability was established using intraclass correlation coefficients (ICCs). After reliability was ascertained, the two researchers independently evaluated a set of additional 56 apps. RESULTS: MARS-Ar was highly aligned with the original English version. The ICCs for MARS-Ar (0.836, 95% CI 0.817-0.853) and MARS English (0.838, 95% CI 0.819-0.855) were good. The MARS-Ar subscales were highly correlated with the original counterparts (P<.001). The lowest correlation was observed in the area of usability (r=0.685), followed by aesthetics (r=0.827), information quality (r=0.854), engagement (r=0.894), and total app quality (r=0.897). Subjective quality was also highly correlated (r=0.820). CONCLUSIONS: MARS-Ar is a valid instrument to assess app quality among trained Arabic-speaking users of health and fitness apps. Researchers and public health professionals in the Arab world can use the overall MARS score and its subscales to reliably evaluate the quality of weight management apps. Further research is necessary to test the MARS-Ar on apps addressing various health issues, such as attention or anxiety prevention, or sexual and reproductive health.

Study protocol: a randomised controlled trial of a telephone delivered social wellbeing and engaged living (SWEL) psychological intervention for disengaged youth.

BACKGROUND: Internationally, from 12.2-23.4% of youth (aged 16-24 years) are not in employment, education or training (NEET). These disengaged youth are more likely to experience social exclusion, increased psychological distress and poor quality of life. Youth at risk of disengagement are less likely to access traditional support services, requiring development of innovative interventions. METHODS: The trial is a single blind, three arm, randomised controlled trial evaluating the effectiveness of a telephone delivered psychological intervention for disengaged youth (12-25 years). Participants will be randomised to receive either (i) SWEL, (ii) Befriending, or (iii) Single Session Psycho-Education. Therapy will be over an 8 week period with a minimum of four and maximum of eight sessions for the SWEL or Befriending conditions, or a single session for the Psycho-Education condition. Outcomes will be assessed at baseline and at 2, 8 and 14-month follow-up with the primary outcome being re-engagement in education, training or employment. DISCUSSION: This large, multi-site, randomised controlled trial will inform the delivery of services for young people at risk of disengaging from education or training. The provision of psychological therapy by telephone increases access by youth - especially those in rural and remote areas - both to the trial and the treatment, if adopted by services. The outcomes of this trial could have meaningful societal impact for a vulnerable population. It is expected that recruitment, intervention and retention will present challenges for the trial given the focus on disengaged youth. TRIAL REGISTRATION: ANZCTR, ACTRN12614001212640 , Registered 18 Nov 2014. Retrospectively registered. ETHICS AND DISSEMINATION: Ethics approval has been obtained from the participating institutions. Results of the trial will be submitted for publication in peer reviewed journals and findings presented at scientific conferences and to key service providers and policy makers.

Efficacy and Outcomes of a Music-Based Emotion Regulation Mobile App in Distressed Young People: Randomized Controlled Trial.

BACKGROUND: Emotion dysregulation increases the risk of depression, anxiety, and substance use disorders. Music can help regulate emotions, and mobile phones provide constant access to it. The Music eScape mobile app teaches young people how to identify and manage emotions using music. OBJECTIVE: This study aimed to examine the effects of using Music eScape on emotion regulation, distress, and well-being at 1, 2, 3, and 6 months. Moderators of outcomes and user ratings of app quality were also examined. METHODS: A randomized controlled trial compared immediate versus 1-month delayed access to Music eScape in 169 young people (aged 16 to 25 years) with at least mild levels of mental distress (Kessler 10 score>17). RESULTS: No significant differences between immediate and delayed groups on emotion regulation, distress, or well-being were found at 1 month. Both groups achieved significant improvements in 5 of the 6 emotion regulation skills, mental distress, and well-being at 2, 3, and 6 months. Unhealthy music use moderated improvements on 3 emotion regulation skills. Users gave the app a high mean quality rating (mean 3.8 [SD 0.6]) out of 5. CONCLUSIONS: Music eScape has the potential to provide a highly accessible way of improving young people's emotion regulation skills, but further testing is required to determine its efficacy. Targeting unhealthy music use in distressed young people may improve their emotion regulation skills. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN12615000051549; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=365974.

The Quality and Accuracy of Mobile Apps to Prevent Driving After Drinking Alcohol.

BACKGROUND: Driving after the consumption of alcohol represents a significant problem globally. Individual prevention countermeasures such as personalized mobile app aimed at preventing such behavior are widespread, but there is little research on their accuracy and evidence base. There has been no known assessment investigating the quality of such apps. OBJECTIVE: This study aimed to determine the quality and accuracy of apps for drink driving prevention by conducting a review and evaluation of relevant mobile apps. METHODS: A systematic app search was conducted following PRISMA guidelines. App quality was assessed using the Mobile App Rating Scale (MARS). Apps providing blood alcohol calculators (hereafter "calculators") were reviewed against current alcohol advice for accuracy. RESULTS: A total of 58 apps (30 iOS and 28 Android) met inclusion criteria and were included in the final analysis. Drink driving prevention apps had significantly lower engagement and overall quality scores than alcohol management apps. Most calculators provided conservative blood alcohol content (BAC) time until sober calculations. None of the apps had been evaluated to determine their efficacy in changing either drinking or driving behaviors. CONCLUSIONS: This novel study demonstrates that most drink driving prevention apps are not engaging and lack accuracy. They could be improved by increasing engagement features, such as gamification. Further research should examine the context and motivations for using apps to prevent driving after drinking in at-risk populations. Development of drink driving prevention apps should incorporate evidence-based information and guidance, lacking in current apps.

Development and Validation of the User Version of the Mobile Application Rating Scale (uMARS).

BACKGROUND: The Mobile Application Rating Scale (MARS) provides a reliable method to assess the quality of mobile health (mHealth) apps. However, training and expertise in mHealth and the relevant health field is required to administer it. OBJECTIVE: This study describes the development and reliability testing of an end-user version of the MARS (uMARS). METHODS: The MARS was simplified and piloted with 13 young people to create the uMARS. The internal consistency and test-retest reliability of the uMARS was then examined in a second sample of 164 young people participating in a randomized controlled trial of a mHealth app. App ratings were collected using the uMARS at 1-, 3,- and 6-month follow up. RESULTS: The uMARS had excellent internal consistency (alpha = .90), with high individual alphas for all subscales. The total score and subscales had good test-retest reliability over both 1-2 months and 3 months. CONCLUSIONS: The uMARS is a simple tool that can be reliably used by end-users to assess the quality of mHealth apps.

Young Love: Romantic Concerns and Associated Mental Health Issues among Adolescent Help-Seekers.

Over 50% of young people have dated by age 15. While romantic relationship concerns are a major reason for adolescent help-seeking from counselling services, we have a limited understanding of what types of relationship issues are most strongly related to mental health issues and suicide risk. This paper used records of 4019 counselling sessions with adolescents (10-18 years) seeking help from a national youth counselling service for a romantic relationship concern to: (i) explore what types and stage (pre, during, post) of romantic concerns adolescents seek help for; (ii) how they are associated with mental health problems, self-harm and suicide risk; and (iii) whether these associations differ by age and gender. In line with developmental-contextual theory, results suggest that concerns about the initiation of relationships are common in early adolescence, while concerns about maintaining and repairing relationships increase with age. Relationship breakups were the most common concern for both male and female adolescents and for all age groups (early, mid, late adolescence). Data relating to a range of mental health issues were available for approximately half of the sample. Post-relationship concerns (including breakups) were also more likely than pre- or during-relationship concerns to be associated with concurrent mental health issues (36.8%), self-harm (22.6%) and suicide (9.9%). Results draw on a staged developmental theory of adolescent romantic relationships to provide a comprehensive assessment of relationship stressors, highlighting post-relationship as a particularly vulnerable time for all stages of adolescence. These findings contribute to the development of targeted intervention and support programs.

Review and Evaluation of Mindfulness-Based iPhone Apps.

BACKGROUND: There is growing evidence for the positive impact of mindfulness on wellbeing. Mindfulness-based mobile apps may have potential as an alternative delivery medium for training. While there are hundreds of such apps, there is little information on their quality. OBJECTIVE: This study aimed to conduct a systematic review of mindfulness-based iPhone mobile apps and to evaluate their quality using a recently-developed expert rating scale, the Mobile Application Rating Scale (MARS). It also aimed to describe features of selected high-quality mindfulness apps. METHODS: A search for "mindfulness" was conducted in iTunes and Google Apps Marketplace. Apps that provided mindfulness training and education were included. Those containing only reminders, timers or guided meditation tracks were excluded. An expert rater reviewed and rated app quality using the MARS engagement, functionality, visual aesthetics, information quality and subjective quality subscales. A second rater provided MARS ratings on 30% of the apps for inter-rater reliability purposes. RESULTS: The "mindfulness" search identified 700 apps. However, 94 were duplicates, 6 were not accessible and 40 were not in English. Of the remaining 560, 23 apps met inclusion criteria and were reviewed. The median MARS score was 3.2 (out of 5.0), which exceeded the minimum acceptable score (3.0). The Headspace app had the highest average score (4.0), followed by Smiling Mind (3.7), iMindfulness (3.5) and Mindfulness Daily (3.5). There was a high level of inter-rater reliability between the two MARS raters. CONCLUSIONS: Though many apps claim to be mindfulness-related, most were guided meditation apps, timers, or reminders. Very few had high ratings on the MARS subscales of visual aesthetics, engagement, functionality or information quality. Little evidence is available on the efficacy of the apps in developing mindfulness.

Mobile app rating scale: a new tool for assessing the quality of health mobile apps.

BACKGROUND: The use of mobile apps for health and well being promotion has grown exponentially in recent years. Yet, there is currently no app-quality assessment tool beyond "star"-ratings. OBJECTIVE: The objective of this study was to develop a reliable, multidimensional measure for trialling, classifying, and rating the quality of mobile health apps. METHODS: A literature search was conducted to identify articles containing explicit Web or app quality rating criteria published between January 2000 and January 2013. Existing criteria for the assessment of app quality were categorized by an expert panel to develop the new Mobile App Rating Scale (MARS) subscales, items, descriptors, and anchors. There were sixty well being apps that were randomly selected using an iTunes search for MARS rating. There were ten that were used to pilot the rating procedure, and the remaining 50 provided data on interrater reliability. RESULTS: There were 372 explicit criteria for assessing Web or app quality that were extracted from 25 published papers, conference proceedings, and Internet resources. There were five broad categories of criteria that were identified including four objective quality scales: engagement, functionality, aesthetics, and information quality; and one subjective quality scale; which were refined into the 23-item MARS. The MARS demonstrated excellent internal consistency (alpha = .90) and interrater reliability intraclass correlation coefficient (ICC = .79). CONCLUSIONS: The MARS is a simple, objective, and reliable tool for classifying and assessing the quality of mobile health apps. It can also be used to provide a checklist for the design and development of new high quality health apps.