Developing an Evidence-Based Technical Assistance Model: a Process Evaluation of the National Training and Technical Assistance Center for Child, Youth, and Family Mental Health.

The National Training and Technical Assistance Center for Child, Youth, and Family Mental Health (NTTAC) supports the development and implementation of systems of care (SOC) for youth with serious emotional disorders (SED) and their families. This article presents results from a process evaluation of NTTAC, conducted to support the Center's quality improvement and contribute to the knowledge base around provision of technical assistance (TA). The evaluation used a mixed methods approach with data collection focused on a defined subset of NTTAC TA recipients-recipients of federal Comprehensive Community Mental Health Services for Children SOC grants. Data sources included coded administrative records from SOC grant sites, administrative data from NTTAC, standardized measures of SOC development, and stakeholder survey data. Results indicate that TA dosage matched needs and goals of TA recipients (SOC sites), overall levels of satisfaction with TA were high, and TA content was generally aligned with need. TA recipients reported significant progress on indicators of SOC development over time. Together, these findings suggest that it is possible to develop TA methods that reflect the level and type of TA recipients' goals and needs, and, in turn, positively impact SOC development and behavioral health service delivery.

Impact of a Web-Based Electronic Health Record on Behavioral Health Service Delivery for Children and Adolescents: Randomized Controlled Trial.

BACKGROUND: Electronic health records (EHRs) have been widely proposed as a mechanism for improving health care quality. However, rigorous research on the impact of EHR systems on behavioral health service delivery is scant, especially for children and adolescents. OBJECTIVE: The current study evaluated the usability of an EHR developed to support the implementation of the Wraparound care coordination model for children and youth with complex behavioral health needs, and impact of the EHR on service processes, fidelity, and proximal outcomes. METHODS: Thirty-four Wraparound facilitators working in two programs in two states were randomized to either use the new EHR (19/34, 56%) or to continue to implement Wraparound services as usual (SAU) using paper-based documentation (15/34, 44%). Key functions of the EHR included standard fields such as youth and family information, diagnoses, assessment data, and progress notes. In addition, there was the maintenance of a coordinated plan of care, progress measurement on strategies and services, communication among team members, and reporting on services, expenditures, and outcomes. All children and youth referred to services for eight months (N=211) were eligible for the study. After excluding those who were ineligible (69/211, 33%) and who declined to participate (59/211, 28%), a total of 83/211 (39%) children and youth were enrolled in the study with 49/211 (23%) in the EHR condition and 34/211 (16%) in the SAU condition. Facilitators serving these youth and families and their supervisors completed measures of EHR usability and appropriateness, supervision processes and activities, work satisfaction, and use of and attitudes toward standardized assessments. Data from facilitators were collected by web survey and, where necessary, by phone interviews. Parents and caregivers completed measures via phone interviews. Related to fidelity and quality of behavioral health care, including Wraparound team climate, working alliance with providers, fidelity to the Wraparound model, and satisfaction with services. RESULTS: EHR-assigned facilitators from both sites demonstrated the robust use of the system. Facilitators in the EHR group reported spending significantly more time reviewing client progress (P=.03) in supervision, and less time overall sending reminders to youth/families (P=.04). A trend toward less time on administrative tasks (P=.098) in supervision was also found. Facilitators in both groups reported significantly increased use of measurement-based care strategies overall, which may reflect cross-group contamination (given that randomization of staff to the EHR occurred within agencies and supervisors supervised both types of staff). Although not significant at P<.05, there was a trend (P=.10) toward caregivers in the EHR group reporting poorer shared agreement on tasks on the measure of working alliance with providers. No other significant between-group differences were found. CONCLUSIONS: Results support the proposal that use of EHR systems can promote the use of client progress data and promote efficiency; however, there was little evidence of any impact (positive or negative) on overall service quality, fidelity, or client satisfaction. The field of children's behavioral health services would benefit from additional research on EHR systems using designs that include larger sample sizes and longer follow-up periods. TRIAL REGISTRATION: ClinicalTrials.gov NCT02421874; https://clinicaltrials.gov/ct2/show/NCT02421874 (Archived by WebCite at http://www.webcitation.org/6yyGPJ3NA).