Assessing the effectiveness and implementation of a universal classroom-based set of educator practices to improve preschool children's social-emotional outcomes: Protocol for a cluster randomized controlled type 2 hybrid trial in Singapore.

BACKGROUND: Providing high-quality early childhood care and education is understood as key to maximizing children's potential to succeed later in life, as it stimulates young children's development of skills and competencies needed to promote optimal outcomes and success later in life. Despite the government's efforts to support the early childhood sector, educators in Singapore continue to report difficulties in implementing practices in classrooms that promote children's social, emotional, and cognitive development. To enhance educators' skills in these domains, we developed the Enhancing And Supporting Early development to better children's Lives (EASEL) Approach, a set of universal, educator-delivered practices for use with 3-6-year-old children in early childhood settings to improve social, emotional, behavioral, and executive functioning (SEB+EF) outcomes. METHODS: This study will evaluate the effectiveness and implementation of the EASEL Approach in improving early childhood educators' teaching practices and, in turn, children's SEB+EF outcomes. We will conduct a cluster randomized controlled trial with a type 2 hybrid effectiveness-implementation study in 16 childcare centers. The EPIS (Explore, Prepare, Implement, Sustain) Framework will be used to inform the implementation of the EASEL Approach. Implementation strategies include training, educator self-assessments, practice-based coaching, and data monitoring. Our primary outcome is educators' teaching practices. Secondary outcomes include educators' adoption of the EASEL Approach in everyday practice, the acceptability and feasibility of the EASEL Approach, and children's SEB+EF outcomes. Quantitative and qualitative data will be collected at baseline, six months, and after implementation. CONCLUSION: Findings from this study will provide significant evidence on the effectiveness of the EASEL Approach in improving educators' teaching practices and its impact on children's SEB+EF outcomes and the implementation of the EASEL Approach in early childhood classrooms in Singapore. TRIAL REGISTRATION: This study was prospectively registered on ClinicalTrials.gov, Identifier: NCT05445947 on 6th July 2022.

Problem-solving interventions and depression among adolescents and young adults: A systematic review of the effectiveness of problem-solving interventions in preventing or treating depression.

Problem-solving (PS) has been identified as a therapeutic technique found in multiple evidence-based treatments for depression. To further understand for whom and how this intervention works, we undertook a systematic review of the evidence for PS's effectiveness in preventing and treating depression among adolescents and young adults. We searched electronic databases (PsycINFO, Medline, and Cochrane Library) for studies published between 2000 and 2022. Studies meeting the following criteria were included: (a) the intervention was described by authors as a PS intervention or including PS; (b) the intervention was used to treat or prevent depression; (c) mean or median age between 13-25 years; (d) at least one depression outcome was reported. Risk of bias of included studies was assessed using the Cochrane Risk of Bias 2.0 tool. A narrative synthesis was undertaken given the high level of heterogeneity in study variables. Twenty-five out of 874 studies met inclusion criteria. The interventions studied were heterogeneous in population, intervention, modality, comparison condition, study design, and outcome. Twelve studies focused purely on PS; 13 used PS as part of a more comprehensive intervention. Eleven studies found positive effects in reducing depressive symptoms and two in reducing suicidality. There was little evidence that the intervention impacted PS skills or that PS skills acted as a mediator or moderator of effects on depression. There is mixed evidence about the effectiveness of PS as a prevention and treatment of depression among AYA. Our findings indicate that pure PS interventions to treat clinical depression have the strongest evidence, while pure PS interventions used to prevent or treat sub-clinical depression and PS as part of a more comprehensive intervention show mixed results. Possible explanations for limited effectiveness are discussed, including missing outcome bias, variability in quality, dosage, and fidelity monitoring; small sample sizes and short follow-up periods.

Translation of an evidence-based virtual reality simulation-based interprofessional education into health education curriculums: An implementation science method.

BACKGROUND: The development of interprofessional competencies through an evidence-based program is paramount to nurture a collaborative practice-ready workforce for patient-centered care and safety. AIMS: To describe an implementation science approach for translation of an evidence-based virtual reality simulation-based interprofessional education (VR-Sim-IPE) program into medical and nursing curriculums, and to evaluate the implementation outcomes. METHODS: Implementation strategies from the "Expert Recommendations for Implementing Change" were used to support implementation of the VR-Sim-IPE program. This included recruiting and training 28 practicing clinicians as facilitators to deliver the program to 599 medical and nursing students. Proctor's conceptual framework for implementation outcomes was applied with multiple data collection methods to evaluate the VR-Sim-IPE program. An online survey was administered to measure the levels of acceptability, appropriateness, feasibility, and adoption. Forty-four sessions of structured observations were carried out to examine the facilitators' implementation fidelity. Individual interviews were conducted with 15 facilitators to identify the facilitators and barriers to the program implementation. An implementation cost analysis was also conducted. RESULTS: Both facilitators and students had positive perceptions of the acceptability, adoption, appropriateness, and feasibility of the VR-Sim-IPE program. Facilitators were observed to implement the program with high fidelity, including program adherence, dosage, quality of delivery, and student responsiveness. While opportunities to contribute and learn, as well as receiving training and support, were identified as facilitators to implementation, the lack of familiarity with the virtual environment, varying levels of student participation, and facilitating interprofessional groups were reported barriers. The implementation costs amounted to USD45,648.50. CONCLUSION: The evaluation of implementation outcomes identifies strategies for future implementation that could potentially enhance program acceptance, reduce implementation cost, improve penetration, and achieve program sustainability. These include increasing facilitation group size, preparing students to be active participants, and incorporating interprofessional facilitation skills in facilitators' training.

Interventions that address institutional child maltreatment: An evidence and gap map.

Background: Child maltreatment has serious short and long-term negative impacts for those experiencing it. Child maltreatment occurring in institutional settings has recently received substantial attention. However, evidence about the effectiveness of interventions that prevent, disclose, respond to, or treat maltreatment that has occurred in these environments is fragmented and can be difficult to access. This evidence and gap map (EGM) collates this research evidence. It was developed as a resource for stakeholders operating in the child health, welfare and protection sectors, including practitioners, organisational leaders, policy developers and researchers, wanting to access high quality evidence on interventions addressing institutional child maltreatment. Objectives: The objectives of this EGM were twofold: (a) To provide a structured and accessible collection of existing evidence from finalised and ongoing overviews of systematic reviews, systematic reviews and effectiveness studies of interventions addressing institutional child maltreatment-for those who work to fund, develop, implement and evaluate interventions aimed at ensuring children's safety in institutional settings; (b) to identify gaps in the available evidence on interventions addressing institutional child maltreatment-thereby helping to inform the research agendas of funders and other organisations. Search Methods: A comprehensive search strategy identified relevant studies from published and grey literature, comprising: (1) 10 electronic academic databases; (2) five trial and systematic review registries; (3) nine organisational websites; (4) websites and reference lists of inquiry reports associated with seven international inquiries into child abuse and (4) the lists of included studies within systematic reviews identified by the search strategy. Members of this EGM's Subject Matter Experts group were also invited to forward relevant unpublished studies or grey literature. Selection Criteria: The selection criteria were developed to identify finalised and ongoing overviews of reviews, systematic reviews and primary studies that reported on the effectiveness of interventions addressing child maltreatment (including sexual abuse, physical abuse, neglect and emotional abuse) within institutional settings. Eligible effectiveness study designs included: randomised controlled trials (RCTs), nonrandomised trials, controlled before-and-after studies and quasi-experimental studies. Reviews were eligible if they reported a systematic literature search strategy. Data Collection and Analysis: All screening, data extraction, coding and critical appraisals were undertaken by two or more reviewers working independently, with discrepancies resolved via consensus or by a third reviewer. The titles and abstracts of studies identified by the search strategy were screened, and each full text of potentially relevant studies was further assessed for inclusion. Key data were extracted from all included studies and reviews. This included information about: publication details (e.g., year, author, country), inclusion/exclusion criteria (for reviews), study design, institutional setting, target population, type of maltreatment, intervention type and outcomes. Critical appraisal of included systematic reviews was achieved using the AMSTAR 2 tool, and completed RCTs were assessed using the updated Cochrane Risk of Bias 2.0 tool. Main Results: Number of studies The electronic database search yielded 6318 citations, and a further 2375 records were identified from additional sources. Following deduplication and title/abstract screening, 256 studies remained for full text review. A total of 73 eligible studies (reported across 84 publications) met the inclusion criteria, including: 11 systematic reviews (plus, one update); 62 primary studies (including, three protocols for primary studies). Study characteristics The studies were conducted across 18 countries, however more than half (52%) were undertaken in the United States. Overall, most studies evaluated curriculum-based interventions delivered in educational settings, primarily aimed at the prevention of sexual abuse. Institutional setting: Most studies evaluated interventions in school or early learning environments (n = 8 systematic reviews; n = 58 primary studies). Far fewer studies examined other organisational settings. Out of home care (including foster care, residential care and orphanages), and social service organisations servicing children were minimally represented. No studies were identified where the primary setting was sports clubs, churches/religious organisations, summer/vacation camps, detention centres/juvenile justice settings, or primary/secondary health care facilities. Target population: Most interventions targeted children rather than adults (n = 7 systematic reviews; n = 47 primary studies) from the general population. Fewer studies included populations known to be at an increased risk, or those already exposed to maltreatment. Just over a third of the primary studies conducted an analysis to ascertain differences in the effect of an intervention between the genders. Intervention type: Prevention interventions were the most studied (n = 5 systematic reviews; n = 57 primary studies), with additional studies including prevention approaches alongside other intervention types. Fewer studies evaluated interventions targeting disclosure, institutional responses, or treatment interventions. Type of maltreatment: The vast majority of the studies assessed interventions solely addressing the sexual abuse of children (n = 8 systematic reviews; n = 45 primary studies). The remaining studies addressed other forms of maltreatment, including physical and emotional abuse, or neglect, either in combination or as a sole focus. Outcomes: Primary reported outcomes reflected the bias toward child targeted interventions. Outcome measures captured child wellbeing and knowledge outcomes, including measures of mental health, children's knowledge retention and/or self-protective skills. Measures of maltreatment disclosure or maltreatment occurrence/reoccurrence were less common, and all other outcome categories included in the EGM were minimally or not reported. A third of studies reported on some measure of implementation. Study quality The overall quality of the studies was low to moderate. Most systematic reviews were low-quality (n = 10), with only one high quality review (and update) identified. Most completed RCTs had some concerns relating to the risk of bias (n = 30), and the remainder were considered to be at a high risk of bias (n = 19). Authors' Conclusions: This EGM has highlighted a substantial need for more high quality studies that evaluate interventions across a broader range of institutional contexts and maltreatment types. The current evidence base does not represent countries with large populations and the greatest incidence of child maltreatment. Few studies focussed on perpetrators or the organisational environment. Further evidence gaps were identified for interventions relating to disclosure, organisational responses and treatment, and few studies assessed interventions targeting perpetrators' maltreatment behaviours, recidivism or desistence. Future studies should also include measure of programme implementation.

Advancing successful implementation of task-shifted mental health care in low-resource settings (BASIC): protocol for a stepped wedge cluster randomized trial.

BACKGROUND: The mental health treatment gap-the difference between those with mental health need and those who receive treatment-is high in low- and middle-income countries. Task-shifting has been used to address the shortage of mental health professionals, with a growing body of research demonstrating the effectiveness of mental health interventions delivered through task-shifting. However, very little research has focused on how to embed, support, and sustain task-shifting in government-funded systems with potential for scale up. The goal of the Building and Sustaining Interventions for Children (BASIC) study is to examine implementation policies and practices that predict adoption, fidelity, and sustainment of a mental health intervention in the education sector via teacher delivery and the health sector via community health volunteer delivery. METHODS: BASIC is a Hybrid Type II Implementation-Effectiveness trial. The study design is a stepped wedge, cluster randomized trial involving 7 sequences of 40 schools and 40 communities surrounding the schools. Enrollment consists of 120 teachers, 120 community health volunteers, up to 80 site leaders, and up to 1280 youth and one of their primary guardians. The evidence-based mental health intervention is a locally adapted version of Trauma-focused Cognitive Behavioral Therapy, called Pamoja Tunaweza. Lay counselors are trained and supervised in Pamoja Tunaweza by local trainers who are experienced in delivering the intervention and who participated in a Train-the-Trainer model of skills transfer. After the first sequence completes implementation, in-depth interviews are conducted with initial implementing sites' counselors and leaders. Findings are used to inform delivery of implementation facilitation for subsequent sequences' sites. We use a mixed methods approach including qualitative comparative analysis to identify necessary and sufficient implementation policies and practices that predict 3 implementation outcomes of interest: adoption, fidelity, and sustainment. We also examine child mental health outcomes and cost of the intervention in both the education and health sectors. DISCUSSION: The BASIC study will provide knowledge about how implementation of task-shifted mental health care can be supported in government systems that already serve children and adolescents. Knowledge about implementation policies and practices from BASIC can advance the science of implementation in low-resource contexts. TRIAL REGISTRATION: Trial Registration: ClinicalTrials.gov Identifier: NCT03243396. Registered 9th August 2017, https://clinicaltrials.gov/ct2/show/NCT03243396.

Optimisation: defining and exploring a concept to enhance the impact of public health initiatives.

BACKGROUND: Repeated, data-driven optimisation processes have been applied in many fields to rapidly transform the performance of products, processes and interventions. While such processes may similarly be employed to enhance the impact of public health initiatives, optimisation has not been defined in the context of public health and there has been little exploration of its key concepts. METHODS: We used a modified, three-round Delphi study with an international group of researchers, public health policy-makers and practitioners to (1) generate a consensus-based definition of optimisation in the context of public health and (2i) describe key considerations for optimisation in that context. A pre-workshop literature review and elicitation of participant views regarding optimisation in public health (round 1) were followed by a daylong workshop and facilitated face-to-face group discussions to refine the definition and generate key considerations (round 2); finally, post-workshop discussions were undertaken to refine and finalise the findings (round 3). A thematic analysis was performed at each round. Study findings reflect an iterative consultation process with study participants. RESULTS: Thirty of 33 invited individuals (91%) participated in the study. Participants reached consensus on the following definition of optimisation in public health: "A deliberate, iterative and data-driven process to improve a health intervention and/or its implementation to meet stakeholder-defined public health impacts within resource constraints". A range of optimisation considerations were explored. Optimisation was considered most suitable when existing public health initiatives are not sufficiently effective, meaningful improvements from an optimisation process are anticipated, quality data to assess impacts are routinely available, and there are stable and ongoing resources to support it. Participants believed optimisation could be applied to improve the impacts of an intervention, an implementation strategy or both, on outcomes valued by stakeholders or end users. While optimisation processes were thought to be facilitated by an understanding of the mechanisms of an intervention or implementation strategy, no agreement was reached regarding the best approach to inform decisions about modifications to improve impact. CONCLUSIONS: The study findings provide a strong basis for future research to explore the potential impact of optimisation in the field of public health.

Methodological pluralism in the age of evidence-informed practice and policy.

The use of evidence in practice and policy in public health and social services is a tricky endeavour. While virtually every practitioner, manager, or policy maker would agree that evidence should be used, there is disagreement about the nature of evidence and which evidence should be used, how, when, in what circumstances, and for whom. Within these disagreements, however, can be found some essential truths: (1) scientific knowledge evolves over time; (2) different types of evidence are needed for different purposes; (3) evidence has a range of quality; (4) synthesising multiple forms of evidence is difficult and inevitably includes some level of subjectivity; and (5) effective implementation of evidence is as important as the decision to use evidence in the first place. This paper will discuss the use of evidence in practice in what is arguably the most complex helping environment - social services - detailing the emergence and evolution of evidence-informed practice, dispelling some myths about its structure and application, and linking it to the broader origins and structure of the social and governmental systems in which it operates. Using this expanded view, the paper will then describe some useful approaches for incorporating these larger considerations into the use of evidence in practice.

Parenting with disabilities: experiences from implementing a parenting support programme in Sweden.

This article reports on the initial stages of implementing an Australian-based education programme for parents with intellectual disabilities (IDs) in Sweden. The clinical utility of the programme, Parenting Young Children (PYC), in the new country context is explored through Swedish professionals' experiences in learning and using it. Study participants found PYC well suited for use in their working environment. Most of them reported the programme to have strengthened their work with parents. The programme was seen as benefiting both the study participants in their work with parents with IDs and these parents themselves, and its structure and content were found to be helpful in several ways. The checklists forming part of PYC were considered useful, but their purpose was sometimes misunderstood. The reported study helps to identify what is needed to improve the translation of the programme into the new country context, to promote appropriate and more effective use of programme materials.

Bridge over troubled water: using implementation science to facilitate effective services in child welfare.

To maximize benefits to children and their families, effective practices need to be used competently in child welfare settings. Since the 1990s, researchers and policy makers have focused attention on empirically supported interventions (ESIs). Much less attention has been paid to what is needed to implement these in a range of real-world settings. Without proper implementation, which includes an evaluation strategy from feasibility to fidelity to on-going work on moderators and mediators of program effects, established effective programs can be rendered ineffective in practical application. The paper will touch on progress, to date, of implementation science, its application to child welfare programs and practices, and will highlight a set of practical strategies for implementing empirically supported interventions in child welfare.