The role of implementation organizations in scaling evidence-based psychosocial interventions.

BACKGROUND: To bring evidence-based interventions (EBIs) to individuals with behavioral health needs, psychosocial interventions must be delivered at scale. Despite an increasing effort to implement effective treatments in communities, most individuals with mental health and behavioral problems do not receive EBIs. We posit that organizations that commercialize EBIs play an important role in disseminating EBIs, particularly in the USA. The behavioral health and implementation industry is growing, bringing the implementation field to an important inflection point: how to scale interventions to improve access while maintaining EBI effectiveness and minimizing inequities in access to psychosocial intervention. MAIN BODY: We offer a first-hand examination of five illustrative organizations specializing in EBI implementation: Beck Institute for Cognitive Behavioral Therapy; Incredible Years, Inc.; the PAXIS Institute; PracticeWise, LLC; and Triple P International. We use the Five Stages of Small Business Growth framework to organize themes. We discuss practical structures (e.g., corporate structures, intellectual property agreements, and business models) and considerations that arise when trying to scale EBIs including balancing fidelity and reach of the intervention. Business models consider who will pay for EBI implementation and allow organizations to scale EBIs. CONCLUSION: We propose research questions to guide scaling: understanding the level of fidelity needed to maintain efficacy, optimizing training outcomes, and researching business models to enable organizations to scale EBIs.

An Individual Participant Data Meta-analysis: Behavioral Treatments for Children and Adolescents With Attention-Deficit/Hyperactivity Disorder.

OBJECTIVE: Behavioral interventions are well established treatments for children with attention-deficit/hyperactivity disorder (ADHD). However, insight into moderators of treatment outcome is limited. METHOD: We conducted an individual participant data meta-analysis (IPDMA), including data of randomized controlled behavioral intervention trials for individuals with ADHD <18 years of age. Outcomes were symptoms of ADHD, oppositional defiant disorder (ODD), and conduct disorder (CD) and impairment. Moderators investigated were symptoms and impairment severity, medication use, age, IQ, sex, socioeconomic status, and single parenthood. RESULTS: For raters most proximal to treatment, small- to medium-sized effects of behavioral interventions were found for symptoms of ADHD, inattention, hyperactivity/impulsivity (HI), ODD and CD, and impairment. Blinded outcomes were available only for small preschool subsamples and limited measures. CD symptoms and/or diagnosis moderated outcome on ADHD, HI, ODD, and CD symptoms. Single parenthood moderated ODD outcome, and ADHD severity moderated impairment outcome. Higher baseline CD or ADHD symptoms, a CD diagnosis, and single parenthood were related to worsening of symptoms in the untreated but not in the treated group, indicating a protective rather than an ameliorative effect of behavioral interventions for these children. CONCLUSION: Behavioral treatments are effective for reducing ADHD symptoms, behavioral problems, and impairment as reported by raters most proximal to treatment. Those who have severe CD or ADHD symptoms, a CD diagnosis, or are single parents should be prioritized for treatment, as they may evidence worsening of symptoms in the absence of intervention.

Improvements in Negative Parenting Mediate Changes in Children's Autonomic Responding Following a Preschool Intervention for ADHD.

Abnormal patterns of sympathetic- and parasympathetic- linked cardiac activity and reactivity are observed among externalizing children, and mark deficiencies in central nervous system regulation of behavior and emotion. Although changes in these biomarkers have been observed following treatment, mechanisms remain unexplored. We used MEMORE-a new approach to analyzing intervening variable effects-to evaluate improvements in parenting as mediators of changes in SNS- and PNS-linked cardiac activity and reactivity among 99 preschoolers with attention-deficit hyperactivity disorder who were treated using an empirically supported intervention. Decreases in negative parenting (criticism, negative commands, physical intrusions) were associated with increases in resting RSA and PEP reactivity to incentives from pre- to post-intervention. Increases in positive parenting were not associated with changes in autonomic function. These findings suggest socially-induced plasticity in peripheral biomarkers of behavior and emotion regulation, and underscore the importance of reducing aversive interactions between parents and children when treating externalizing behavior.

Quantifying respiratory sinus arrhythmia: Effects of misspecifying breathing frequencies across development.

Low resting respiratory sinus arrhythmia (RSA), and to a lesser extent excessive RSA reactivity to emotion evocation, are observed in many psychiatric disorders characterized by emotion dysregulation, including syndromes spanning the internalizing and externalizing spectra, and other conditions such as nonsuicidal self-injury. Nevertheless, some inconsistencies exist. For example, null outcomes in studies of RSA-emotion dysregulation relations are sometimes observed among younger participants. Such findings may derive from use of age inappropriate frequency bands in calculating RSA. We combine data from five published samples (N = 559) spanning ages 4 to 17 years, and reanalyze RSA data using age-appropriate respiratory frequencies. Misspecifying respiratory frequencies results in overestimates of resting RSA and underestimates of RSA reactivity, particularly among young children. Underestimates of developmental shifts in RSA and RSA reactivity from preschool to adolescence were also observed. Although correlational analyses revealed weak negative associations between resting RSA and aggression, those with clinical levels of externalizing exhibited lower resting RSA than their peers. No associations between RSA reactivity and externalizing were observed. Results confirm that age-corrected frequency bands should be used when estimating RSA, and that literature-wide overestimates of resting RSA, underestimates of RSA reactivity, and underestimates of developmental shifts in RSA and RSA reactivity may exist.

Impact of Incredible Years® on teacher perceptions of parental involvement: A latent transition analysis.

The purpose of the present study was to examine the impact of the Incredible Years® Teacher Classroom Management (IY TCM) training on teacher perceptions of parental involvement. A cluster randomized design was used to assign 42 classroom teachers to either an IY TCM training (n=19) or a control condition (n=23). Teachers rated parental involvement (i.e., bonding with teacher, parental involvement at school) for the families of 805 low income students (IY TCM=504, control=301). A latent profile transition analysis framework was used to model the effect of IY TCM on teacher perceptions of parental involvement from pre to posttest. Four profiles consisting of various patterns of high, medium, and low teacher perceptions of bonding with and involvement of parents emerged. Analyses of teacher profiles at baseline revealed teachers who felt parental involvement and bonding was low were also likely to rate students as having more externalizing behaviors, fewer social competencies, more attention deficit symptoms, and disruptive behaviors towards adults and peers compared to teachers with more adaptive profiles. Further analysis revealed that parents of teachers randomly assigned to IY TCM were more likely to transition to a more adaptive view of parental involvement at follow-up compared to teachers in the control condition. Because teacher perceptions of parental involvement may adversely impact teacher attitudes towards difficult students, findings from the present study support the promise of teacher training as an avenue for conferring protections for struggling students.

Bringing The Incredible Years® Programs to Scale.

The Incredible Years(®) (IY) program series is a set of interlocking and comprehensive training programs for parents, teachers, and children. This article briefly reviews the theoretical foundations, goals, and research underlying these programs. The main purpose of the paper is to describe how the IY programs have been scaled up slowly and carefully with fidelity by engaging in a collaborative building project with strong links between the developer, agency or school administrator, mentors, coaches, clinicians, and families using eight foundational building blocks or fidelity tools.

Electrodermal responding predicts responses to, and may be altered by, preschool intervention for ADHD.

OBJECTIVES: To evaluate electrodermal activity (EDA) as a prospective biomarker of treatment response, to determine whether patterns of EDA are altered by treatment, and to assess oppositional defiant disorder (ODD) as a possible moderator of trajectories in EDA after an empirically supported behavioral intervention for attention-deficit hyperactivity disorder (ADHD) in preschool. METHOD: Nonspecific fluctuations (NSFs) in skin conductance, which index sympathetic nervous system activity, were assessed among 4-6 year old children with ADHD (n = 99) before they participated with their parents in 1 of 2 versions of the Incredible Years intervention. All were reassessed at posttreatment, and a subgroup (n = 49) were assessed again at 1-year follow-up. RESULTS: No difference in pretreatment NSFs was observed between ADHD participants and a group of normal control children (n = 41). Nevertheless, among those with ADHD, fewer NSFs at pretest predicted poorer treatment response on 4 of 7 externalizing outcomes. Furthermore, treatment was associated with increasing NSFs across time, but not for those who scored high on ODD at pretest. CONCLUSIONS: Low EDA appears to mark resistance to treatment among preschoolers with ADHD. Furthermore, although our study was not experimental, treatment was associated with longitudinal increases in EDA, which were not observed in a normal control group. This may suggest increased sensitivity to discipline, with positive implications for long term outcome. In contrast to treated participants as a whole, however, those who scored high on ODD at pretest exhibited reduced EDA over time. (PsycINFO Database Record

Assessing the effectiveness of the 'Incredible Years(®) parent training' to parents of young children with ADHD symptoms - a preliminary report.

This study examined the effectiveness of an evidence-based parent training program in a real-world Scandinavian setting. Parents of 36 young children with or at risk of Attention Deficit Hyperactive Disorder (ADHD) self-referred to participate in the Incredible Years(®) Parent Training Program (IYPT) through a Danish early intervention clinic. Using a benchmarking approach, we compared self-report data with data from a recent efficacy study. Eight out of nine outcome measures showed comparable or higher magnitude of effect from pretest to posttest. Effects were maintained or improved across six months. The methodology of this study exemplifies a rigorous but feasible approach to assessing effectiveness when evidence-based US protocols are transferred into the existing Scandinavian service delivery. Findings suggest that IYPT can be implemented successfully as an easy-access early intervention to families of children with or at risk of ADHD.

Parent training: equivalent improvement in externalizing behavior for children with and without familial risk.

OBJECTIVE: The Incredible Years Series intervention has demonstrated efficacy for decreasing conduct disorder (CD) symptomatology in clinically affected youth in multiple randomized controlled trials. Because children with family psychiatric histories of antisocial behavior are at markedly increased risk for enduring symptoms of antisocial behavior (compared with their counterparts with a negative family history), the authors examined whether intervention effects across studies would prevail in that subgroup or would be relatively restricted to children without genetic risk. METHOD: A reanalysis was conducted of 5 randomized controlled trials of Incredible Years involving 280 clinically affected children 3 to 8 years of age for whom a family psychiatric history of externalizing behavior in first- and second-degree relatives was ascertained from at least 1 parent. RESULTS: Incredible Years equally benefitted children with CD with and without family psychiatric histories of externalizing behavior. Family psychiatric history of externalizing behavior and parental depressive symptomatology predicted greater severity of CD symptomatology at baseline. CONCLUSION: The beneficial effects of IY are evident in children with CD, irrespective of whether their conditions are more or less attributable to inherited susceptibility to enduring antisocial syndromes. A next phase of research should address whether earlier implementation of group-based education for parents of young children at increased familial risk for antisocial behavior syndromes-before the development of disruptive patterns of behavior-would result in even more pronounced effects and thereby constitute a cost-effective, targeted, preventive intervention for CD.

Improving therapist fidelity during implementation of evidence-based practices: Incredible years program.

OBJECTIVE: The aim of the study was to extend research on the potential benefits of adding ongoing feedback, coaching, and consultation to initial therapist training workshops to ensure fidelity of delivery of evidence-based practices, specifically for the Incredible Years parenting program. METHODS: A randomized controlled trial compared two models for training therapists to deliver the parenting program for children at high risk of developing conduct problems. Therapists (N=56) from ten community-based mental health service organizations in California were trained in either a three-day workshop model (N=25), based on active, experiential, self-reflective, principle-based learning, video modeling, and manuals, or an enhanced training model (N=31) that included all elements of the workshop model plus ongoing expert coaching, video review of and feedback on group sessions, and consultation for therapists and agency supervisors. RESULTS: Overall fidelity across both conditions was rated >3 on a 5-point scale in seven of eight domains measured. Therapists in the condition that received ongoing coaching and consultation were significantly stronger in four of the domains: practical support, collaboration, knowledge, and skill at mediating vignettes. CONCLUSIONS: Consultation and expert coaching for training therapists beyond the standard three-day training enhanced skills and therapists' adherence to the model.

Latent profile analysis of observed parenting behaviors in a clinic sample.

We examined typologies of parenting practices using latent profile analysis (LPA) in a sample of families with young children who had externalizing behavior disorders. We also examined mother and child characteristics associated with class membership using ratings from multiple informants. The sample included pooled data from five parenting treatment outcome research studies on oppositional defiant disorder (ODD) and/or conduct disorder (CD) conducted throughout the past 20 years. These studies included 21 separate cohorts of children resulting in a total of 514 families. All children met diagnostic criteria for ODD or CD and 78 % were male. Parenting practices were observed by independent raters using the Dyadic Parent-child Interactive Coding System-Revised (DPICS-R). Four summary scores (i.e., total critical statements, total commands, total positive, total supportive) from the DPICS-R were used as class indictors in the LPA. Four classes best characterized the parenting practices of this clinic sample, roughly comprising a quarter of the sample each: Positive Only, Negative Only, Positive/Negative, and Neither Positive/Negative. High observed child negative behaviors, low observed child warmth, high socioeconomic status, and low academic performance distinguished the two classes with high negative behaviors (Negative Only, Positive/Negative) from the other classes. These results provide markers of the most common parenting profiles at entry into treatment programs for behavior disorders in young children. Findings have significant implications for the tailoring parenting interventions and supports to specific family needs.

Sympathetic- and parasympathetic-linked cardiac function and prediction of externalizing behavior, emotion regulation, and prosocial behavior among preschoolers treated for ADHD.

OBJECTIVE: To evaluate measures of cardiac activity and reactivity as prospective biomarkers of treatment response to an empirically supported behavioral intervention for attention-deficit/hyperactivity disorder (ADHD). METHOD: Cardiac preejection period (PEP), an index of sympathetic-linked cardiac activity, and respiratory sinus arrhythmia (RSA), an index of parasympathetic-linked cardiac activity, were assessed among 99 preschool children (ages 4-6 years) with ADHD both at rest and in response to behavioral challenge, before participants and their parents completed 1 of 2 versions of the Incredible Years parent and child interventions. RESULTS: Main effects of PEP activity and reactivity and of RSA activity and reactivity were found. Although samplewide improvements in behavior were observed at posttreatment, those who exhibited lengthened cardiac PEP at rest and reduced PEP reactivity to incentives scored higher on measures of conduct problems and aggression both before and after treatment. In contrast, children who exhibited lower baseline RSA and greater RSA withdrawal scored lower on prosocial behavior before and after treatment. Finally, children who exhibited greater RSA withdrawal scored lower on emotion regulation before and after treatment. CONCLUSIONS: We discuss these findings in terms of (a) individual differences in underlying neurobiological systems subserving appetitive (i.e., approach) motivation, emotion regulation, and social affiliation and (b) the need to develop more intensive interventions targeting neurobiologically vulnerable children.

Efficacy of the Incredible Years group parent program with families in Head Start who self-reported a history of child maltreatment.

OBJECTIVE: A prevention form of the Incredible Years (IY) parenting program was offered to parents who had children enrolled in Head Start, regardless of whether they reported having a history of child maltreatment. This study compared whether parenting practices and child behavioral outcomes differed in families who self reported a history of child maltreatment relative to families who did not. METHODS: A site-randomized controlled trial of the IY parenting program was conducted in 64 classrooms in seven Head Start centers in Seattle, Washington. Families of 481 children took part in the study, with 335 in the IY condition and 146 in the control condition. Parenting practices and child behavior were measured by blinded raters through in-home observations and self-report questionnaires prior to the start of the IY program, in the spring after the IY program had concluded, and 12-18 months after study enrollment when children were in kindergarten. Analyses examine the impact of the IY program on parenting practices and children's behavior, exploring whether the program had differential impacts for parents with and without a self-reported history of child maltreatment. RESULTS: The IY program resulted in improvements along many parenting dimensions and on characteristics of observed child behavior. Program impacts were similar for parents who did and did not report a history of child maltreatment. However, parents with a reported history of prior maltreatment had greater initial room for improvement in areas such as harsh/critical parenting, nurturing/supportive parenting, and discipline competence than parents without such a history. CONCLUSIONS: The IY parenting program has positive impacts for parents who self-reported a history of child maltreatment. While similar benefits were observed for both groups of parents in this study, results support delivering evidence-based parenting programs of longer duration and higher intensity than often used by agencies serving parents in contact with child welfare. PRACTICE: Agencies serving parents referred for child maltreatment should carefully examine the characteristics of the parenting programs they deliver. Use of a parenting program that has a sound base of empirical support, such as IY, and sufficient intensity and duration, is likely to make substantial changes in parents' child-rearing practices.

One-year follow-up of combined parent and child intervention for young children with ADHD.

Efficacies of the Incredible Years (IY) interventions are well-established in children with oppositional defiant disorder (ODD) but not among those with a primary diagnosis of attention-deficit/hyperactivity disorder (ADHD). We sought to evaluate 1-year follow-up outcomes among young children with ADHD who were treated with the IY interventions. Four- to 6-year-olds with ADHD (n = 49, 73% male) participated in 6 months of treatment using the IY parent and child interventions. Immediate posttreatment results indicated improvements in parenting, children's externalizing and attention problems, and social contact at school. At 1-year follow up, 22 of 27 variables that showed significant posttreatment effects demonstrated maintenance to 1-year follow up. Children with higher ODD symptoms at baseline showed more improvement in oppositionality and total behavior problems, and their mothers showed more improvement on harsh discipline scores. Approximately 70 to 75% of children were reported by their parents and teachers to fall below clinical cutoffs on measures of externalizing symptoms at the 1-year follow up (compared to 50% at baseline), and more than 50% fell below clinical cutoffs on measures of hyperactivity and inattentiveness (all were in the clinical range at baseline). Children with ADHD who were treated with the IY parent and child treatment programs showed maintenance of treatment effects 1 year after treatment.

Parent discrepancies in ratings of young children's co-occurring internalizing symptoms.

We examined the agreement between mothers and fathers with regard to their children's internalizing symptoms and tested predictors of rating discrepancies. The clinic sample included 181 children (ages 3 to 8) and their mothers and fathers who were participating in a parenting treatment study for children with behavioral problems. Mother-father agreement for ratings of internalizing problems was found to be moderate and consistent with previous research. Regression analyses revealed that parental stress, but not depression, predicted some of the variance associated with mother-father rating discrepancies. A gender effect was also found such that parent discrepancies were larger for girls than for boys. Much of the variance associated with rating discrepancies was left unexplained. Implications for both research and practice are discussed.

Long-Term Outcomes of Incredible Years Parenting Program: Predictors of Adolescent Adjustment.

BACKGROUND AND METHOD: Fifty-eight boys and 20 girls with early onset conduct problems whose parents received the Incredible Years (IY) parent treatment program when they were 3-8 years (mean 58.7 months) were contacted and reassessed regarding their social and emotional adjustment 8-12 years later. Assessments included home interviews with parents and teenagers separately. RESULTS AND CONCLUSION: Adolescent reports indicated that 10% were in the clinical range on internalising behaviours, 23% had engaged in major delinquent acts, and 46% reported some substance use. Eighteen percent of children had criminal justice system involvement and 42% had elevated levels of externalising behaviours (mother report). Post-treatment factors predicting negative outcomes (delinquent acts) were maternal reports of behaviour problems and observed mother-child coercion.

Combining parent and child training for young children with ADHD.

The efficacy of the Incredible Years parent and child training programs is established in children diagnosed with oppositional defiant disorder but not among young children whose primary diagnosis is attention-deficit/hyperactivity disorder (ADHD). We conducted a randomized control trial evaluating the combined parent and child program interventions among 99 children diagnosed with ADHD (ages 4-6). Mother reported significant treatment effects for appropriate and harsh discipline, use of physical punishment, and monitoring, whereas fathers reported no significant parenting changes. Independent observations revealed treatment effects for mothers' praise and coaching, mothers' critical statements, and child total deviant behaviors. Both mothers and fathers reported treatment effects for children's externalizing, hyperactivity, inattentive and oppositional behaviors, and emotion regulation and social competence. There were also significant treatment effects for children's emotion vocabulary and problem-solving ability. At school teachers reported treatment effects for externalizing behaviors and peer observations indicated improvements in treated children's social competence.

The impact of the Incredible Years parent, child, and teacher training programs on children's co-occurring internalizing symptoms.

The Incredible Years (IY) Series includes separate group interventions to improve parenting interactions, teacher classroom management, and child social-emotional regulation. Although originally developed to treat early onset conduct problems, IY targets many of the proposed mechanisms and risk factors for internalizing distress in early childhood. Prior studies have demonstrated the effects of the IY parent intervention on co-occurring depressive symptoms. We attempted to extend these findings by examining the unique and combined effects of IY interventions on children's co-occurring internalizing symptoms. One-hundred and fifty-nine families with children ages 4- to 8-years-old were randomly assigned to parent training (PT); parent plus teacher training (PT + TT); child training (CT); child plus teacher training (CT + TT); parent, child, plus teacher training (PT + CT + TT); or a waiting list control group. Children who received any of the intervention components were more likely to have lower mother-rated internalizing symptoms at posttreatment compared to children in a wait-list control group. Implications for future research and for designing interventions and prevention strategies for children with internalizing symptoms are discussed. (PsycINFO Database Record

Korean immigrant parents' evaluation of the delivery of a parenting program for cultural and linguistic appropriateness and usefulness.

The goal of this study was to evaluate the delivery of a parenting program to 17 Korean immigrants for cultural and linguistic appropriateness and usefulness regarding recruitment, retention, program content, and delivery methods. Focus group interview data were audiotaped, transcribed, and analyzed. Themes identified included fit between the parents' desire and what the program offered, effective recruitment and retention strategies, program content and videotapes: based on Western cultural background but useful, helpful role-play and homework, and recommendations (Korean language videotapes, longer classes, extended learning). The findings can be used in adopting the program to increase cultural and linguistic appropriateness.

Computer-based intervention with coaching: an example using the Incredible Years program.

Increases in personal computer ownership and Internet use patterns provide a potential avenue for dissemination of evidence-based prevention and treatment interventions. The authors describe the implementation of a psychoeducational intervention (the Incredible Years parenting program, which is designed to promote behavioral change in parents and children) using a hybrid model combining computer- and web-based delivery with professional intervention via phone calls, electronic messages, and home visits. The model attempted to simulate many of the parent training methods shown to be successful in the original program. The intervention was implemented with 90 Head Start families who reported elevated levels of child behavior problems. Of the 45 families offered the intervention in the final year of the project, 37 (82%) completed at least half the program and 34 (76%) completed the entire intervention using procedures refined in light of the initial year's experience. These participants reported high achievement of their self-determined goals and were highly satisfied with the intervention. The combination of technology with professional coaching represents a potential model for adapting and disseminating evidence-based interventions.