Determination of Markers of Successful Implementation of Mental Health Apps for Young People: Systematic Review.

BACKGROUND: Smartphone apps have the potential to address some of the current issues facing service provision for young people's mental health by improving the scalability of evidence-based mental health interventions. However, very few apps have been successfully implemented, and consensus on implementation measurement is lacking. OBJECTIVE: This review aims to determine the proportion of evidence-based mental health and well-being apps that have been successfully adopted and sustained in real-world settings. A secondary aim is to establish if key implementation determinants such as coproduction, acceptability, feasibility, appropriateness, and engagement contribute toward successful implementation and longevity. METHODS: Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, an electronic search of 5 databases in 2021 yielded 18,660 results. After full-text screening, 34 articles met the full eligibility criteria, providing data on 29 smartphone apps studied with individuals aged 15 to 25 years. RESULTS: Of 34 studies, only 10 (29%) studies were identified that were evaluating the effectiveness of 8 existing, commercially available mental health apps, and the remaining 24 (71%) studies reported the development and evaluation of 21 newly developed apps, of which 43% (9/21) were available, commercially or otherwise (eg, in mental health services), at the time of enquiry. Most studies addressed some implementation components including adoption, acceptability, appropriateness, feasibility, and engagement. Factors including high cost, funding constraints, and lengthy research processes impeded implementation. CONCLUSIONS: Without addressing common implementation drivers, there is considerable redundancy in the translation of mobile mental health research findings into practice. Studies should embed implementation strategies from the outset of the planned research, build collaborations with partners already working in the field (academic and commercial) to capitalize on existing interventions and platforms, and modify and evaluate them for local contexts or target problems and populations. TRIAL REGISTRATION: PROSPERO CRD42021224365; https://tinyurl.com/4umpn85f.

Users' experiences of trauma-focused cognitive behavioural therapy for children and adolescents: a systematic review and metasynthesis of qualitative research.

Trauma-focused cognitive behavioural therapy (TF-CBT) is an effective intervention for post-traumatic stress disorder, yet implementation may be hindered by practitioners' concerns about how treatment is experienced by users. This metasynthesis systematically reviews qualitative evidence on youth and caregivers' experiences of TF-CBT to better understand user perspectives on process and outcomes of treatment. A systematic review and metasynthesis were undertaken for qualitative studies of treatment experience related to TF-CBT. Data were extracted according to Evidence for Policy and Practice Information and Coordinating Centre guidelines, and studies were critically appraised using Critical Appraisal Skills Programme checklists. Findings from included studies were coded and synthesized using thematic synthesis methodology. Eight studies were selected after a full-text review of 39 papers. Findings were organised around nine sub-themes, under three broad thematic categories: 'engagement in TF-CBT'; 'experience of treatment components'; and 'therapeutic outcomes'. Youth were often unclear about what to expect from treatment and concerned about (in)compatibility with their therapist. Youth reports indicated how such misgivings can be addressed through early psychoeducation and efforts to strengthen the therapeutic alliance. Once underway, treatment was viewed as a place of refuge and validation, aided by therapist competence and confidentiality. Youth and caregivers felt that constructing a trauma narrative was instrumental for recovery. Cognitive-behavioural coping techniques were useful during treatment and in the long-term. While participants in TF-CBT may begin treatment with unclear expectancies, careful attention to early engagement and other process issues can optimise process and outcomes. Implications for clinical practice and further research are discussed.

Preferences on Governance Models for Mental Health Data: Qualitative Study With Young People.

BACKGROUND: Improving access to mental health data to accelerate research and improve mental health outcomes is a potentially achievable goal given the substantial data that can now be collected from mobile devices. Smartphones can provide a useful mechanism for collecting mental health data from young people, especially as their use is relatively ubiquitous in high-resource settings such as the United Kingdom and they have a high capacity to collect active and passive data. This raises the interesting opportunity to establish a large bank of mental health data from young people that could be accessed by researchers worldwide, but it is important to clarify how to ensure that this is done in an appropriate manner aligned with the values of young people. OBJECTIVE: In this study, we discussed the preferences of young people in the United Kingdom regarding the governance, sharing, and use of their mental health data with the establishment of a global data bank in mind. We aimed to determine whether young people want and feel safe to share their mental health data; if so, with whom; and their preferences in doing so. METHODS: Young people (N=46) were provided with 2 modules of educational material about data governance models and background in scientific research. We then conducted 2-hour web-based group sessions using a deliberative democracy methodology to reach a consensus where possible. Findings were analyzed using the framework method. RESULTS: Young people were generally enthusiastic about contributing data to mental health research. They believed that broader availability of mental health data could be used to discover what improves or worsens mental health and develop new services to support young people. However, this enthusiasm came with many concerns and caveats, including distributed control of access to ensure appropriate use, distributed power, and data management that included diverse representation and sufficient ethical training for applicants and data managers. CONCLUSIONS: Although it is feasible to use smartphones to collect mental health data from young people in the United Kingdom, it is essential to carefully consider the parameters of such a data bank. Addressing and embedding young people's preferences, including the need for robust procedures regarding how their data are managed, stored, and accessed, will set a solid foundation for establishing any global data bank.

Measuring Violence Against Children: A COSMIN Systematic Review of the Psychometric and Administrative Properties of Adult Retrospective Self-report Instruments on Child Abuse and Neglect.

Valid, meaningful, and reliable adult retrospective measures of violence against children (VAC) are essential for establishing the prevalence, risk factors, and long-term effects of VAC. We aim to summarize the available evidence on the psychometric properties of adult retrospective VAC measures and to provide evidence-based recommendations for appropriate measure selection. We searched six electronic databases and gray literature for studies that report on the development, content validity, or psychometric properties of adult retrospective child abuse and neglect measures for this review (PROSPERO: CRD4201706). We used the 2018 Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) criteria to evaluate each included study and measure. We assessed if measures included questions on frequency or severity, the perpetrator, or the location of the violence, and noted the administrative practicalities for each instrument such as length, readability, available translations, and cost to access. We identified 288 studies and 77 measures. The quality of evidence ranged from "low" to "high," depending on the measure and the psychometric properties assessed. The measures with the most robust evidence available across multiple contexts are the: ACE and ACE-IQ; FBQ and FBQ-U; CTQ and CTQ-SF; and ICAST-R. This review shows the strengths and weaknesses of retrospective VAC measures. The substantial evidence presented in this review can be used by researchers to make psychometrically sound decisions for measurement selection which should be supported by extensive piloting and adaptation to the respective local context.

"We don't know how to talk": Adolescent meaning making and experiences of participating in research on violence in Romania, South Africa, and the Philippines.

BACKGROUND: Current evidence on adolescent participation in violence research has primarily measured distress, harm or upset using quantitative methods. There are relatively few studies which have employed qualitative methods to understand adolescent emotional experiences, and to articulate the experiences of participation from their own perspective. OBJECTIVE: This study aimed to assess adolescents' experiences of participating in research on violence in different contexts, namely Romania, South Africa, and the Philippines. METHODS: A purposive sample of adolescents (N = 53, 51 % female) were recruited from rural, urban, and peri-urban areas in Romania, the Eastern Cape Province of South Africa, and Metro Manila, Philippines. Semi-structured one-on-one in-depth interviews and drawings sought adolescent perspectives on their experiences of participation, including the emotions they felt, and their perceptions of research on violence. RESULTS: Drawing on analysis of interviews and drawings, adolescents reported a layered emotional experience, ranging from sadness, anger, apprehension, and upset, to joy, relief, and laughter. Their emotional experiences were driven by participation as a relational encounter, both with the researchers involved, as well as with other children and young people they encountered. Adolescents emphasized participation as enabling disclosure of difficult experiences, and the creation of awareness of violence. CONCLUSIONS: Adolescent perspectives of participation in research on violence are nuanced and encompass their lived experience as well as the fundamentally relational nature of participation. Adolescents experienced increased awareness of topics in violence and perceived research participation as enabling disclosure and possible help-seeking. Measures of participation impact developed along with adolescents, which reflect this complexity, are needed.

Unpacking School-Based Child Sexual Abuse Prevention Programs: A Realist Review.

Background: Existing efforts to understand school-based child sexual abuse (CSA) prevention programs mainly focus on the effectiveness of these programs in increasing participants' CSA knowledge and self-protective skills. There are currently no reviews addressing the underpinning pathways leading to these outcomes. In order to increase our understanding about the underpinning causal and contextual factors and inform the further development of school-based CSA prevention programs, a realist review was conducted to synthesize existing evidence from a broad range of data. Methods: An iterative search of electronic databases and grey literature was conducted, supplemented with citation tracking to locate relevant literature. For quantitative evidence, we considered evaluation studies that focused on students aged 5-18 years, who were enrolled in primary or secondary schools; for other types/formats of studies/documents, no population restrictions were applied. We included school-based CSA prevention programs that focused on improving knowledge of CSA or self-protective skills. Outcomes of interest included knowledge of CSA or self-protective skills. We did not apply methodological filters in terms of the types of studies to be included. Thematic content analysis was conducted to synthesize data. Results: Sixty-two studies were included. Five themes and five overarching Context-Strategy-Mechanism-Outcome configurations (CSMOs) that contributed to the success of school-based CSA interventions were identified, including tailoring programs to participants' cognitive developmental levels, repeated exposure of key concepts and skills, utilization of interactive delivery methods and positive feedback, delivery of positive information and application of the 'train-the-trainer' model. Implications: Findings from this realist review provide insights into the underlying program theory of school-based CSA prevention programs, which can aid in the development and implementation of these programs in the future.

Adolescents' Experiences of Participating in Sensitive Research: A Scoping Review of Qualitative Studies.

Despite an increasing emphasis on adolescents' participation rights, there are concerns about their participation in research on sensitive topics, such as trauma and violence. This review reports findings of a scoping review that examined the nature and extent of qualitative studies conducted with adolescents about their experiences of participating in research on sensitive topics. Studies were identified by searching electronic databases and grey literature and reported on qualitative and mixed-methods studies eliciting adolescents' experiences of participating in research on sensitive topics. Seventeen (17) studies were included after screening 4426 records. The scoping review revealed significant adolescent benefits from participation, relating to positive emotions, skill acquisition and enhanced self-efficacy and interpersonal relationships. To a lesser extent, participants also experienced burdens relating to negative emotions, concerns about confidentiality and privacy and inconvenience of participation, which were mitigated by careful attention to research design and researcher engagement and training. Participants shared insights into their motivation to participate, and factors that impacted their experiences of research, such as ethical considerations, including consent procedures, safety and connection in research, study procedures and documentation and researcher characteristics. There were tangible benefits and some burdens involved in adolescents' participation in sensitive research. This review considers implications for research and practice, such as the need to regularly publish findings of consultations, assessing caregiver consent requirements, obtaining adolescent views on study documents and measures and building on existing research, differentiated by age, gender and dis/ability status, especially in diverse and under-represented regions.

Measuring Violence Against Children: A COSMIN Systematic Review of the Psychometric Properties of Child and Adolescent Self-Report Measures.

Research on violence against children (VAC) requires meaningful, valid, and reliable self-report by children. Many instruments have been used globally and decisions to select suitable measures are complex. This review identifies child and adolescent self-report measures that are most likely to yield valid, reliable, and comparable data in this field. A systematic review (PROSPERO: CRD4201706) was conducted using the 2018 Consensus-based Standards for the selection of health Measurement Instrument (COSMIN) criteria. Six electronic databases and gray literature were searched. Manuscripts published in English and describing the development and psychometric qualities of child/adolescent self-report instruments were included. Thirty-nine original instruments and 13 adaptations were identified in 124 studies. The quality of evidence ranged from "very low" to "high" depending on the measure and the psychometric properties assessed. Most measures were not widely used, and some have been applied in many settings despite limited evidence of their psychometric rigor. Few studies assessed content validity, particularly with children. The ACE, CTQ, CTS-PC, CECA, ICAST, and JVQ have the best psychometric properties. An overview of items measuring frequency, onset, duration, perpetrators, and locations is provided as well as an assessment of the practicalities for administration to help researchers select the instrument best suited for their research questions. This comprehensive review shows the strengths and weaknesses of VAC research instruments. Six measures that have sufficient psychometric properties are recommended for use in research, with the caveat that extensive piloting is carried out to ensure sufficient content validity for the local context and population.

Evidencing the Impact of Web-Based Coproduction With Youth on Mental Health Research: Qualitative Findings From the MindKind Study.

BACKGROUND: Public involvement in research is a growing phenomenon as well as a condition of research funding, and it is often referred to as coproduction. Coproduction involves stakeholder contributions at every stage of research, but different processes exist. However, the impact of coproduction on research is not well understood. Web-based young people's advisory groups (YPAGs) were established as part of the MindKind study at 3 sites (India, South Africa, and the United Kingdom) to coproduce the wider research study. Each group site, led by a professional youth advisor, conducted all youth coproduction activities collaboratively with other research staff. OBJECTIVE: This study aimed to evaluate the impact of youth coproduction in the MindKind study. METHODS: To measure the impact of web-based youth coproduction on all stakeholders, the following methods were used: analysis of project documents, capturing the views of stakeholders using the Most Significant Change technique, and impact frameworks to assess the impact of youth coproduction on specific stakeholder outcomes. Data were analyzed in collaboration with researchers, advisors, and YPAG members to explore the impact of youth coproduction on research. RESULTS: The impact was recorded on 5 levels. First, at the paradigmatic level, a novel method of conducting research allowed for a widely diverse group of YPAG representations, influencing study priorities, conceptualization, and design. Second, at the infrastructural level, the YPAG and youth advisors meaningfully contributed to the dissemination of materials; infrastructural constraints of undertaking coproduction were also identified. Third, at the organizational level, coproduction necessitated implementing new communication practices, such as a web-based shared platform. This meant that materials were easily accessible to the whole team and communication streams remained consistent. Fourth, at the group level, authentic relationships developed between the YPAG members, advisors, and the rest of the team, facilitated by regular web-based contact. Finally, at the individual level, participants reported enhanced insights into mental well-being and appreciation for the opportunity to engage in research. CONCLUSIONS: This study revealed several factors that shape the creation of web-based coproduction, with clear positive outcomes for advisors, YPAG members, researchers, and other project staff. However, several challenges of coproduced research were also encountered in multiple contexts and amid pressing timelines. For systematic reporting of the impact of youth coproduction, we propose that monitoring, evaluation, and learning systems be designed and implemented early.

Young people's data governance preferences for their mental health data: MindKind Study findings from India, South Africa, and the United Kingdom.

Mobile devices offer a scalable opportunity to collect longitudinal data that facilitate advances in mental health treatment to address the burden of mental health conditions in young people. Sharing these data with the research community is critical to gaining maximal value from rich data of this nature. However, the highly personal nature of the data necessitates understanding the conditions under which young people are willing to share them. To answer this question, we developed the MindKind Study, a multinational, mixed methods study that solicits young people's preferences for how their data are governed and quantifies potential participants' willingness to join under different conditions. We employed a community-based participatory approach, involving young people as stakeholders and co-researchers. At sites in India, South Africa, and the UK, we enrolled 3575 participants ages 16-24 in the mobile app-mediated quantitative study and 143 participants in the public deliberation-based qualitative study. We found that while youth participants have strong preferences for data governance, these preferences did not translate into (un)willingness to join the smartphone-based study. Participants grappled with the risks and benefits of participation as well as their desire that the "right people" access their data. Throughout the study, we recognized young people's commitment to finding solutions and co-producing research architectures to allow for more open sharing of mental health data to accelerate and derive maximal benefit from research.

"What does that mean?": The content validity of the ISPCAN Child Abuse Screening Tool - Child version (ICAST-C) in Romania, South Africa, and the Philippines.

BACKGROUND: The International Society for Prevention of Child Abuse and Neglect (ISPCAN) Child Abuse Screening Tool (Children's Version), known as the ICAST-C Version 3, is used widely to assess violence against children, but there is limited psychometric evidence, especially on content validity. OBJECTIVE: This study aimed to assess the content validity of the ICAST-C with adolescents in Romania, South Africa, and the Philippines. METHODS: A purposive sample of adolescents (N = 53, 51 % female) were recruited from urban areas in Romania, the Eastern Cape Province of South Africa, and Metro Manila, Philippines. Semi-structured one-on-one in-depth cognitive interviews sought adolescent perspectives on the relevance, comprehensibility, and comprehensiveness of the ICAST-C. Data were analysed using template analysis. RESULTS: The ICAST-C was broadly perceived to be relevant and comprehensive in measuring violence against children in all study locations. However, there were issues with the comprehensibility of the measure, described at three levels: interpreting items, undertaking coherent elaborations of relevant behaviors and places, and generating a coherent response to the questions. CONCLUSIONS: Suggestions to revise the ICAST-C include, among others, adding a practice or how-to section on answering the survey, clarifying the intent of questions, especially on neglect and sexual abuse, emphasizing that questions cover all locations, and asking more positive questions. Pilot studies testing the content validity and cultural appropriateness are needed as a matter of practice in large self-report surveys.