Getting More Out of Clinical Documentation: Can Clinical Dashboards Yield Clinically Useful Information?

This study investigated coded data retrieved from clinical dashboards, which are decision-support tools that include a graphical display of clinical progress and clinical activities. Data were extracted from clinical dashboards representing 256 youth (M age = 11.9) from 128 practitioners who were trained in the Managing and Adapting Practice (MAP) system (Chorpita & Daleiden in BF Chorpita EL Daleiden 2014 Structuring the collaboration of science and service in pursuit of a shared vision. 43(2):323 338. 2014, Chorpita & Daleiden in BF Chorpita EL Daleiden 2018 Coordinated strategic action: Aspiring to wisdom in mental health service systems. 25(4):e12264. 2018) in 55 agencies across 5 regional mental health systems. Practitioners labeled up to 35 fields (i.e., descriptions of clinical activities), with the options of drawing from a controlled vocabulary or writing in a client-specific activity. Practitioners then noted when certain activities occurred during the episode of care. Fields from the extracted data were coded and reliability was assessed for Field Type, Practice Element Type, Target Area, and Audience (e.g., Caregiver Psychoeducation: Anxiety would be coded as Field Type = Practice Element; Practice Element Type = Psychoeducation; Target Area = Anxiety; Audience = Caregiver). Coders demonstrated moderate to almost perfect interrater reliability. On average, practitioners recorded two activities per session, and clients had 10 unique activities across all their sessions. Results from multilevel models showed that clinical activity characteristics and sessions accounted for the most variance in the occurrence, recurrence, and co-occurrence of clinical activities, with relatively less variance accounted for by practitioners, clients, and regional systems. Findings are consistent with patterns of practice reported in other studies and suggest that clinical dashboards may be a useful source of clinical information. More generally, the use of a controlled vocabulary for clinical activities appears to increase the retrievability and actionability of healthcare information and thus sets the stage for advancing the utility of clinical documentation.

Development and Initial Psychometrics of a Generic Treatment Integrity Measure Designed to Assess Practice Elements Targeting Social, Emotional, and Behavioral Outcomes in Early Childhood Settings.

Though treatment integrity measurement is important for research intended to promote social and behavioral outcomes of children at risk for emotional and behavioral disorders (EBDs) in early childhood settings, measurement gaps exist in the field. This paper reports on the development and preliminary psychometric assessment of the treatment integrity measure for early childhood settings (TIMECS), an observational measure designed to address existing measurement gaps related to treatment integrity with tier 2 interventions in the early childhood field. To assess the preliminary score reliability (interrater) and validity (construct, discriminant) of the TIMECS, live observations (N = 650) in early childhood classrooms from 54 teachers (92.6% female, 7.4% male; 61.1% White) and 91 children (M age = 4.53 years, SD = .44; 45.1% female, 54.9% male; 45.1% Black) at risk for EBDs were scored by 12 coders using the TIMECS and an observational measure designed to assess teacher-child interactions. Teachers also self-reported on the quality of the teacher-child relationship. Interrater reliability (intraclass correlation coefficients, ICC [2,2]) for the quantity (i.e., adherence) item scores had a mean of .81 (SD = .07; range from .68 to .95), and the quality (i.e., competence) item scores had a mean of .69 (SD = .08; range from .52 to .80). Scores on the TIMECS Quantity and Quality items and scales showed evidence of construct validity, with the magnitude of the correlations suggesting that the quantity and quality items assess distinct components of treatment integrity. A TIMECS quantity scale also showed promise for intervention evaluation research by discriminating between teachers who had and had not been trained in a specific evidence-based intervention targeting social and behavioral skills in early childhood. The findings support the potential of the TIMECS to assess treatment integrity of teacher-delivered practices designed to address child social and behavioral outcomes of children at risk for EBDs in early childhood settings.

Toward tailored care for families with multiple problems: A quasi-experimental study on effective elements of care.

Several effective interventions have been developed for families with multiple problems (FMP), but knowledge is lacking as to which specific practice and program elements of these interventions deliver positive outcomes. The aim of this study is to assess the degree to which practice and program elements (contents of and structure in which care is provided) contribute to the effectiveness of interventions for FMP in general and for subgroups with child and/or parental psychiatric problems, intellectual disabilities, or substance use. We performed a quasi-experimental study on the effectiveness of practice and program elements provided in attested FMP interventions. Using self-report questionnaires, we measured primary (child's internalizing and externalizing problems) and secondary (parental stress and social contacts) outcomes at the beginning, end, and three months thereafter. By means of Latent Profile Analysis, we identified groups of families receiving similar combinations of practice elements ("profiles"), and we calculated propensity scores. Next, we assessed how practice element profiles and program elements affected improvement in outcomes, and whether these effects were moderated by subgroup characteristics. We found three practice element profiles (explorative/supportive, action-oriented, and their combination), which were equally effective. Regarding program elements, effects were enhanced by more frequent telephone contact between visits and more frequent intervision. Effectiveness of practice and program elements varied for specific FMP subgroups. Variations in the content of care for FMP do not affect its effectiveness, but variations in the structure of the care do. This finding can help to further improve effective interventions.

Se han desarrollado varias intervenciones eficaces para familias multiproblemáticas, pero se sabe poco acerca de qué elementos específicos de la práctica y de los programas de estas intervenciones producen resultados positivos. El objetivo de este estudio es evaluar el grado en el cual los elementos de la práctica y de los programas (los contenidos de la asistencia y la estructura en la cual se presta) contribuyen a la eficacia de las intervenciones para familias multiproblemáticas en general, y para subgrupos de padres o hijos con problemas psiquiátricos, discapacidades intelectuales o consumo de sustancias. Realizamos un estudio cuasiexperimental sobre la eficacia de los elementos de la práctica y de los programas proporcionados en intervenciones certificadas para familias multiproblemáticas. Utilizando cuestionarios de autoinforme, medimos los resultados primarios (los problemas de interiorización y de exteriorización de los niños) y secundarios (estrés de los padres y contactos sociales) al comienzo, al final y tres meses a partir de entonces. Por medio del análisis de perfiles latentes, identificamos grupos de familias que recibían combinaciones similares de elementos de la práctica ("perfiles") y calculamos los puntajes de propensión. Después, evaluamos cómo los perfiles de los elementos de la práctica y los elementos del programa afectaron las mejoras en los resultados, y si estos efectos estuvieron moderados por las características de los subgrupos. Encontramos tres perfiles de elementos de la práctica (exploratorio/comprensivo, orientado a la acción y su combinación) que fueron igualmente eficaces. Con respecto a los elementos de los programas, los efectos mejoraron con el contacto telefónico más frecuente entre visitas y una intervisión más frecuente. La eficacia de los elementos de la práctica y de los programas varió según los subgrupos específicos de familias multiproblemáticas. Las variaciones en el contenido de la asistencia para las familias multiproblemáticas no afectan su eficacia, pero las variaciones en la estructura de la asistencia, sí. Estos resultados pueden ayudar a mejorar aún más las intervenciones eficaces.

Pediatric Consultation-Liaison: Patient Characteristics and Considerations for Training in Evidence-Based Practices.

Consultation-liaison services are an integral part of many pediatric hospital settings, yet characteristics of this patient population have not been extensively documented. The current study is a retrospective one-year chart review of the consultation-liaison service at a large pediatric hospital in the Southwestern United States. The purpose of this study is twofold: (1) to characterize this hospital's CL population and (2) to use these characteristics to identify preliminary evidence-based practices that should be considered for CL provider training. Identifying evidence-based practice elements that align with the characteristics of consultation-liaison patient populations may inform trainings for consultation-liaison staff. This would help to ensure that youth seen in hospital consultation-liaison services are getting the best available services, which is critical given the shortened time frame available to work with this patient population.

Where Does It Begin? Community-Based Therapists' Intentions for Treating Non-comorbid Youth.

This study examined patterns and predictors of 79 public sector therapists' practice element (PE) intentions for treating hypothetical single problem area youth with either anxiety or disruptive behavior problems. Analyses of intention profiles suggested that PE intentions varied by diagnosis and included both a majority of practices derived from the evidence base (PDEBs) and a large number of practices with minimal evidence support (PMESs) for each problem area. Hierarchical multiple regression results indicated the only significant predictor of higher PDEB intentions for both problem areas was reporting more PMES intentions. Implications for community-based research and implementation efforts are discussed.

Practices Derived from the Evidence Base for Depression Predict Disruptive Behavior Progress in Adolescent Community Mental Health Care.

Disruptive behavior problems develop along multiple causal pathways and are associated with a wide variety of co-occurring problems, including mood disorders. In usual care, effective treatment practices for youth disruptive behavior might differ from what the efficacy research suggests, given treatment setting and population demographic differences. The current study examined whether practices derived from the evidence base for disruptive behavior and/or depressed mood predicted progress on disruptive behavior problems in an adolescent usual care sample. Monthly clinical data, including therapeutic practices, treatment targets, and progress on selected treatment targets, for 1210 youth ages 13-17 who received intensive in-home services and were treated for disruptive behavior problems were examined utilizing multilevel modeling techniques. Practices derived from the evidence base for only depressed mood and practices derived from both disruptive behavior and depressed mood literatures predicted disruptive behavior progress, while practices derived from only the disruptive behavior evidence-based literature did not. All five practice elements exclusive to depressed mood treatment predicted positive disruptive behavior progress, while two of eleven disruptive behavior practices and four of seven practices derived from both problem areas predicted positive progress. Findings held when other predictors were included as covariates, including youth age and functional impairment. Although directionality remains unclear and further research is vital, usual care settings might present barriers to disruptive behavior treatment as prescribed by the evidence base, and youth-focused treatments based on depressed mood treatments merit further examination as a potentially promising route to effective treatment in such settings.

Common Elements of Practice, Process and Implementation in Out-of-School-Time Academic Interventions for At-risk Children: a Systematic Review.

Academic achievement is a strong preventive factor against marginalization. Children at risk of academic failure and drop out can benefit from out-of-school-time academic (OSTA) interventions. Wide-scaled implementation and sustainment of effective interventions remain a struggle across education, welfare, and health. The need for approaches to increase implementability, effectiveness, and efficiency of interventions is pressing. Advancements in the field of education and mental health suggest identifying and studying discrete elements that are common across interventions for the purpose of hypothesis generation, intervention optimization, design improvement, and implementation. This review identified OSTA interventions for primary school children at risk of academic failure. Common elements methodology was used to code practice elements (n = 62), process elements (n = 49), and implementation elements (n = 36) in 30 effective and six ineffective OSTA interventions in matrices. Based on frequency counts, common practice, process, and implementation elements across the interventions were identified, and given frequency count values (FV) reflecting how often elements were included in effective studies as opposed to in ineffective studies. The five common practice elements with the highest FVs were homework support, training in positive parental school involvement, positive reinforcement, structured tutoring, and psychoeducation. The most common process element was regular support to intervention receiver, and the most common implementation element was quality monitoring. Common combinations of elements were also identified and given FVs. Results from this review can inform efforts to design or optimize OSTA interventions, and inform education, implementation, and practice to improve academic achievement for children at risk.

Common Elements of Childhood Universal Mental Health Programming.

Despite the availability of multiple mental health prevention and promotion programs for children, challenges related to their dissemination limit their reach and impact. This review identifies the most common practice elements of effective childhood universal mental health programming for children ages 3-11, based on a structured interpretation and coding of program manuals and descriptions in peer-reviewed articles. Across a range of program goals and targeted outcomes, psychoeducation and problem solving emerged as the most common practice elements, followed by social skills training, insight building, and communication skills. These skills were largely taught via role-plays and modeling. Synthesizing what we know from the universal mental health programming literature has potential to facilitate dissemination of information to inform the development, adaptation or adoption of programs for children.

Patterns of practice in community mental health treatment of adult depression.

OBJECTIVE: Community mental health therapists often endorse an eclectic orientation, but few studies reveal how therapists utilize elements of evidence-based psychotherapies. This study aimed to characterize treatment as usual patterns of practice among therapists treating depressed adults in community mental health settings. METHOD: Therapists (N = 165) from the USA's largest not-for-profit provider of community-based mental health services completed surveys assessing their demographics and practice element use with depressed adult clients. Specifically, therapists indicated whether they utilized each of 45 unique practice elements from the following evidence-based psychotherapies: Acceptance and Commitment Therapy, Behavioral Activation, Brief Psychodynamic Therapy, Cognitive Behavioral Therapy (CBT), Interpersonal Therapy, Mindfulness-Based CBT, Problem-Solving Therapy, and Self-Control Therapy. Principal component analysis was employed to identify practice patterns. RESULTS: The principal component analysis included 31 practice elements and revealed a three-factor model with distinct patterns of practice that did not align with traditional evidence-based practice approaches, including: (i) Planning, Practice, and Monitoring; (ii) Cognitive, Didactic, and Interpersonal; and (iii) Between Session Activities. CONCLUSIONS: Therapist-reported practice patterns confirmed an eclectic approach that brought together elements from theoretically distinct evidence-based psychotherapies. Future research is needed to explore how these patterns of practice relate to client outcomes to inform focused training and/or de-implementation efforts.

Predicting Youth Improvement in Community-Based Residential Settings with Practices Derived from the Evidence-Base.

The current investigation conducted descriptive analyses on key variables in community-based residential (CBR) settings and investigated the extent to which disruptive youth between the ages of 13 and 17 years improved based on therapists' reported alignment with using practices derived from the evidence-base (PDEBs). Results from both the descriptive analyses and multilevel modeling suggested that therapists are using practices that both do and do not align with the evidence-base for disruptive youth. In addition, both PDEBs and practices with minimal evidence-support predicted or marginally predicted final average progress rating for these youth. Findings are discussed as they relate to the importance of continued exploration of treatment outcomes for CBR youth.

Therapist and Youth Predictors of Specific Practices Derived from the Evidence-Base in Community Mental Health.

Over the past several years, youth treatment research has moved toward understanding the dissemination and implementation of evidence-based practices (EBPs). As a result, studies have focused on identifying predictors that aid in successful adoption and sustainment of EBPs. Theories of behavior change posit that therapist knowledge and attitudes play a fundamental role in EBP adoption; however, studies have produced mixed findings, which may be an artifact of broad definitions of both EBP knowledge and EBP itself. The current study was an examination of 46 youth community therapists and the extent to which varying types of knowledge and attitudes as well as youth characteristics predicted specific practices derived from the evidence-base. Results suggested that specific EBP knowledge predicted specific practices, highlighting the need for more specificity when examining predictors of EBP use. Therapists' attitudes, demographic characteristics, and youth characteristics were also significant predictors of EBP use. Future research should consider examining discrete and specific practices to better understand and predict therapists' future behavior.

Characterizing Intervention Strategies Used in Community-Based Mental Health Care for Infants and Their Families.

Mental health interventions for infants typically target high-risk groups and can prevent long-term negative outcomes. Despite federal initiatives promoting early intervention, minimal research has examined usual care services for infants, which is important to improve routine care. The current study characterized usual care practices in infant mental health through the adaptation and administration of a provider survey. Providers (n = 126) reported using a wide range of intervention strategies and few intervention programs with varied evidence. Findings can inform future research to identify quality improvement targets of usual mental health care for high-risk infants and their families.

Identifying Common Practice Elements to Improve Social, Emotional, and Behavioral Outcomes of Young Children in Early Childhood Classrooms.

Educators are increasingly being encouraged to implement evidence-based interventions and practices to address the social, emotional, and behavioral needs of young children who exhibit problem behavior in early childhood settings. Given the nature of social-emotional learning during the early childhood years and the lack of a common set of core evidence-based practices within the early childhood literature, selection of instructional practices that foster positive social, emotional, and behavioral outcomes for children in early childhood settings can be difficult. The purpose of this paper is to report findings from a study designed to identify common practice elements found in comprehensive intervention models (i.e., manualized interventions that include a number of components) or discrete practices (i.e., a specific behavior or action) designed to target social, emotional, and behavioral learning of young children who exhibit problem behavior. We conducted a systematic review of early childhood classroom interventions that had been evaluated in randomized group designs, quasi-experimental designs, and single-case experimental designs. A total of 49 published articles were identified, and an iterative process was used to identify common practice elements. The practice elements were subsequently reviewed by experts in social-emotional and behavioral interventions for young children. Twenty-four practice elements were identified and classified into content (the goal or general principle that guides a practice element) and delivery (the way in which a teacher provides instruction to the child) categories. We discuss implications that the identification of these practice elements found in the early childhood literature has for efforts to implement models and practices.

Identifying the common elements of psychological and psychosocial interventions for preventing postpartum depression: Application of the distillation and matching model to 37 winning protocols from 36 intervention studies.

AIM: Postpartum depression is prevalent worldwide and seriously endangers maternal and child health. Previous studies have demonstrated the effectiveness of psychological and psychosocial intervention programmes in preventing postpartum depression. However, the literature offers limited practice guidance. Therefore, this study aimed to deeply analyse prior findings to gather rich evidence-based information on this topic. METHODS: Using the distillation and matching model, we conducted a systematic review of psychological and psychosocial interventions used to effectively prevent postpartum depression. Four researchers trained in coding system independently read eligible studies and identified reliable (Cohen's kappa >0.40) and frequently occurring (frequency ≥3 winning study groups) practice elements. RESULTS: Our review included 36 studies containing 37 winning study groups. Fourteen practice elements were identified and subsequently divided into six categories: postpartum practical problems-related, social support-related, interpersonal psychotherapy-related, cognitive behavioural therapy-related, labour trauma-related and non-specific techniques. The most common practice elements were baby care skills and mother-infant bonding/interaction enhancement. Inter-rater reliability averaged 0.86, ranging from 0.48 to 1. CONCLUSION: The practice elements identified in this study provide rich evidence-based information that can guide clinical practitioners in selecting or developing effective, realistically available intervention programmes.

Distilling Common History and Practice Elements to Inform Dissemination: Hanf-Model BPT Programs as an Example.

There is a shift in evidence-based practice toward an understanding of the treatment elements that characterize empirically supported interventions in general and the core components of specific approaches in particular. The evidence base for behavioral parent training (BPT) and the standard of care for early-onset disruptive behavior disorders (oppositional defiant disorder and conduct disorder), which frequently co-occur with attention deficit hyperactivity disorder, are well established, yet an ahistorical, program-specific lens tells little regarding how leaders, University of Oregon Medical School, shaped the common practice elements of contemporary evidence-based BPT. Accordingly, this review summarizes the formative work of Hanf, as well as the core elements, evolution, and extensions of her work, represented in Community Parent Education (COPE; (Cunningham et al. in J Child Psychol Psychiatry 36:1141-1159, 1995; Cunningham et al. in COPE, the community parent education program: large group community-based workshops for parents of 3- to 18-year-olds, COPE Works, Hamilton, 2009), Defiant Children (DC; (Barkley in Defiant children: a clinician's manual for assessment and parent training, Guilford Press, New York, 1987; Barkley in Defiant children: a clinician's manual for assessment and parent training, Guilford Press, New York, 2013), Helping the Noncompliant Child (HNC; Forehand and McMahon in Helping the noncompliant child: a clinician's guide to parent training, Guilford Press, New York, 1981; McMahon and Forehand in Helping the noncompliant child: family-based treatment for oppositional behavior, 2nd ed., Guilford Press, New York, 2003), Parent-child interaction therapy (PCIT; Eyberg and Robinson in J Clin Child Adolesc Psychol 11:130-137, 1982. doi:10.1080/15374418209533076; Eyberg in Child Fam Behav Ther 10:33-46, 1988; Eyberg and Funderburk in Parent-child interaction therapy protocol, PCIT International, Gainesville, 2011), and the Incredible Years (IY; (Webster-Stratton in Behav Ther 12:634-642, 1981. doi:10.1016/S0005-7894(81)80135-9; Webster-Stratton in J Pediatr Psychol 7:279-294, 1982. doi:10.1093/jpepsy/7.3.279; Webster-Stratton in The incredible years: parents and children series. Leader's guide: preschool version of BASIC (ages 3-6 years, The Incredible Years, Seattle, 2008). Our goal is not to provide an exhaustive review of the evidence base for the Hanf-Model programs, rather our intention is to provide a template of sorts from which agencies and clinicians can make informed choices about how and why they are using one program versus another, as well as how to make inform flexible use one program or combination of practice elements across programs, to best meet the needs of child clients and their families. Clinical implications and directions for future work are discussed.