Development and psychometric evaluation of the Implementation Support Competencies Assessment.

BACKGROUND: Implementation support practitioners (ISPs) are professionals that support others to implement evidence-informed practices, programs, and policies in various service delivery settings to achieve population outcomes. Measuring the use of competencies by ISPs provides a unique opportunity to assess an understudied facet of implementation science-how knowledge, attitudes, and skills used by ISPs affects sustainable change in complicated and complex service systems. This study describes the development and validation of a measure-the Implementation Support Competencies Assessment (ISCA)-that assesses implementation support competencies, with versatile applications across service contexts. METHODS: Recently developed practice guide materials included operationalizations of core competencies for ISPs across three domains: co-creation and engagement, ongoing improvement, and sustaining change. These operationalizations, in combination with recent empirical and conceptual work, provided an initial item pool and foundation on which to advance measurement development, largely from a confirmatory perspective (as opposed to exploratory). The measure was further refined through modified cognitive interviewing with three highly experienced ISPs and pilot-testing with 39 individuals enrolled in a university-based certificate program in implementation practice. To recruit a sample for validation analyses, we leveraged a listserv of nearly 4,000 individuals who have registered for or expressed interest in various events and trainings focused on implementation practice offered by an implementation science collaborative housed within a research-intensive university in the Southeast region of the United States. Our final analytic sample included 357 participants who self-identified as ISPs. RESULTS: Assessments of internal consistency reliability for each competency-specific item set yielded evidence of strong reliability. Results from confirmatory factor analyses provided evidence for the factorial and construct validity of all three domains and associated competencies in the ISCA. CONCLUSIONS: The findings suggest that one's possession of high levels of competence across each of the three competency domains is strongly associated with theorized outcomes that can promote successful and sustainable implementation efforts among those who receive implementation support from an ISP. The ISCA serves as a foundational tool for workforce development to formally measure and assess improvement in the skills that are required to tailor a package of implementation strategies situated in context.

Systematic Review and Meta-Analysis of Policies and Interventions that Improve Health, Psychosocial, and Economic Outcomes for Young People Leaving the Out-of-Home Care System.

Young people who transition to adulthood from out-of-home care (OOHC) are more likely to experience a range of poorer outcomes relative to their same-age peers in the community. This systematic review assessed the effectiveness of policies or interventions (hereafter "interventions") aimed at improving housing, health, education, economic, and psychosocial outcomes for youth leaving OOHC (hereafter "care leavers"). Eleven databases of published literature were reviewed along with gray literature. Eligible studies used randomized or quasi-experimental designs and assessed interventions that provided support to care leavers prior to, during, or after they left OOHC. Primary outcomes were housing and homelessness, health and well-being, education, economic and employment, criminal and delinquent behavior, and risky behavior, while secondary outcomes were supportive relationships and life skills. Where possible, results were pooled in a meta-analysis. Certainty of evidence was assessed using Grading of Recommendations Assessment, Development and Evaluation. Fourteen studies published in 27 reports were identified that examined independent living programs (ILPs) (n = 5), intensive support services (n = 2), coaching and peer support (C&PSP) (n = 2), transitional housing (n = 1), health information or coaching (n = 2), and extended care (n = 2). All but one study was conducted in the United States. Twenty small meta-analyses were undertaken encompassing ILPs and C&PSP, with two showing results that favored the intervention with certainty. The level of confidence in each meta-analysis was considered very low. A significant risk of bias was identified in each of the included studies. While some interventions showed promise, particularly extended care, the scope and strength of included evidence is insufficient to recommend any included approach.

Characterising processes and outcomes of tailoring implementation strategies in healthcare: a protocol for a scoping review.

Background: Tailoring strategies to target the salient barriers to and enablers of implementation is considered a critical step in supporting successful delivery of evidence based interventions in healthcare. Theory, evidence, and stakeholder engagement are considered key ingredients in the process however, these ingredients can be combined in different ways. There is no consensus on the definition of tailoring or on a single method for tailoring strategies to optimize impact, ensure transparency, and facilitate replication. Aim: The purpose of this scoping review is to describe how tailoring has been undertaken within healthcare to answer questions about how it has been conceptualised, described, and conducted in practice, and to identify research gaps. Methods: The review will be conducted in accordance with best practice guidelines and the Preferred Reporting Items for Systematic Reviews and Meta-analysis extension for scoping reviews (PRISMA-ScR) will be used to guide the reporting. Searches will be conducted of MEDLINE, Embase, Web of Science, Scopus, from 2005 to present. Reference lists of included articles will be searched. Grey literature will be searched on Google Scholar. Screening and data extraction will be conducted by two or more members of the research team, with any discrepancies resolved by consensus discussion with a third reviewer. Initial analysis will be quantitative involving a descriptive numerical summary of the characteristics of the studies and the tailoring process. Qualitative content analysis aligned to the research questions will also be conducted, and data managed using NVivo where applicable. This scoping review is pre-registered with the Open Science Framework. Conclusions: The findings will serve as a resource for implementation researchers and practitioners to guide future research in this field and facilitate systematic, transparent, and replicable development of tailored implementation strategies.