Putting Implementation Science into Practice: Lessons from the Creation of the National Maternal and Child Health Workforce Development Center.

Purpose This article describes how implementation science informed the design of a national training and technical assistance (TA) center, and how implementation best practices have been used to improve the quality of training and technical assistance services offered to states/jurisdictions. Description An existing tool, based on the Implementation Drivers Framework (in: Fixsen et al., Implementation research: a synthesis of the literature, University of South Florida, The National Implementation Research Network, Tampa, 2005), was adapted to assess efforts of the National MCH Workforce Development Center (the Center) against known implementation best practices. Staff identified specific examples of effective practice and gaps for inclusion in this article. Assessment Using implementation science to establish, assess and improve Center practice was both feasible and practical, requiring intentionality, dedicated time, and staff committed to deepening their understanding of implementation science. The Implementation Drivers framework proved useful for creating a shared approach to analysis and identification of opportunities for improvement of Center practice. Conclusion Policymakers and funding agencies should consider how training and technical assistance programs demonstrate knowledge and use of implementation science best practices among other evidence based practices in their work. Increasing attention to the use of implementation science can contribute to a higher quality of service among technical assistance centers, with the long term goal of improving outcomes for training and assistance recipients and the communities they serve. Establishing the link between customer satisfaction and quality of technical assistance, on the one hand, and long term outcomes, on the other, remains a challenge and an area of focus and learning for the Center.

Injuries among young workers in career-technical-vocational education and associations with per pupil spending.

BACKGROUND: New Jersey Department of Education (NJDOE) requires by law for accidents/incidents (injury) involving career-technical-vocational education (CTE) students and staff to be reported within five business days to the NJ Safe Schools Program (NJSS) using an online surveillance system. NJ public schools and charter schools (CS) through school districts (SD) or county offices report school data annually to NJDOE, including per pupil spending (PPS). In this study, we examined potential associations of PPS with several variables on injury in NJ: injury cause, injury location on the body, injury type, injury severity, use of PPE, and location of treatment for injury. METHODS: PPS data for December 1998-June 2015 from CTE SDs (one per NJ county, n = 21), four CS SD and eight county special services districts were analyzed. T-test examined potential differences in PPS regarding injury severity and use of personal protective equipment (PPE). Stepwise logistic regression assessed potential associations between PPS and various injury surveillance variables. RESULTS: There were more CTE injuries reported among SD with lower PPS than among SD with higher PPS. Relatively less severe injuries, e.g., bruise/bumps and cuts/lacerations, more often occurred at schools and SD with higher PPS. Conversely, relatively more severe injuries, e.g., fractures, more often occurred at schools and SD with lower PPS. CONCLUSION: Future research should further investigate disparities regarding younger worker injuries reported within school-based career-technical-vocational education programs by PPS and other factors like sex or gender, severity, safety training provided and work experience at time of injury.

Using Behavior Over Time Graphs to Spur Systems Thinking Among Public Health Practitioners.

Public health practitioners can use Behavior Over Time (BOT) graphs to spur discussion and systems thinking around complex challenges. Multiple large systems, such as health care, the economy, and education, affect chronic disease rates in the United States. System thinking tools can build public health practitioners' capacity to understand these systems and collaborate within and across sectors to improve population health. BOT graphs show a variable, or variables (y axis) over time (x axis). Although analyzing trends is not new to public health, drawing BOT graphs, annotating the events and systemic forces that are likely to influence the depicted trends, and then discussing the graphs in a diverse group provides an opportunity for public health practitioners to hear each other's perspectives and creates a more holistic understanding of the key factors that contribute to a trend. We describe how BOT graphs are used in public health, how they can be used to generate group discussion, and how this process can advance systems-level thinking. Then we describe how BOT graphs were used with groups of maternal and child health (MCH) practitioners and partners (N = 101) during a training session to advance their thinking about MCH challenges. Eighty-six percent of the 84 participants who completed an evaluation agreed or strongly agreed that they would use this BOT graph process to engage stakeholders in their home states and jurisdictions. The BOT graph process we describe can be applied to a variety of public health issues and used by practitioners, stakeholders, and researchers.

Title V Workforce Development in the Era of Health Transformation.

Purpose The National Maternal and Child Health Workforce Development Center at UNC Chapel Hill (the Center), funded by the Maternal and Child Health Bureau, provides Title V state/jurisdiction leaders and staff and partners from other sectors with opportunities to develop skills in quality improvement, systems mapping and analysis, change management, and strategies to enhance access to care to leverage and implement health transformation opportunities to improve the health of women and children. Description Since 2013, the Center has utilized a variety of learning platforms to reach state and jurisdiction Title V leaders. In the intensive training program, new skills and knowledge are applied to a state-driven health transformation project and include distance-based learning opportunities, multi-day, in-person training and/or onsite consultation, as well as individualized coaching to develop workforce skills. Assessment The first intensive cohort of eight states reported enhanced skills in the core areas of quality improvement, systems mapping and analysis, change management, and strategies to enhance access to care which guided changes at state system and policy levels. In addition, teams reported new and/or enhanced partnerships with many sectors, thereby leveraging Title V resources to increase its impact. Conclusion The Center's provision of core workforce skills and application to state-defined goals has enabled states to undertake projects and challenges that not only have a positive impact on population health, but also encourage collaborative, productive partnerships that were once found to be challenging-creating a workforce capable of advancing the health and wellbeing of women and children.

Comparing Online and In-Person Delivery Formats of the OSHA 10-Hour General Industry Health and Safety Training for Young Workers.

Seven school districts or comprehensive high schools were enrolled in online OSHA 10-hour General Industry or Construction health and safety training via CareerSafe to determine the feasibility of online training for students, given limited resources for in-person trainings. A two-campus school district was analyzed comparing OSHA 10 for General Industry across in-person, supervisor-level teachers as authorized trainers, and online course formats. The online training courses were completed by 86 of 91 students, while another 53 of 57 students completed in-person training. Both groups completed identical OSHA-approved quizzes for "Introduction to OSHA," the initial 2-h module consistently provided in OSHA 10 courses across topics and formats. Results indicated teacher supervision was critical, and girls had higher online course completion rates, overall quiz scores, and never failed. Though both cohorts passed, in-person had significantly higher scores than online; both struggled with two questions. Online OSHA 10 for General Industry can be an efficient learning tool for students when limited resources prevent widespread availability of in-person courses.

Comparing Efficacy of Online and In-Person Versions of a Training on U.S. Federal Wage and Hour, Child Labor Laws, and Hazardous Occupations Orders for Secondary School Professionals.

BACKGROUND: The New Jersey Safe Schools Program (NJSS) offers courses required for secondary school vocational-career-technical education teachers to become school-sponsored structured learning experience supervisors. The "Federal Wage and Hour and Child Labor Laws, Regulations and Hazardous Order Course" (FWH) was originally conducted in-person by U.S. Department of Labor-Wage and Hour Division from 2005 to Summer 2013, and then NJSS began conducting this course in-person (October 2013-April 2015). Staring in March 2015, this course was conducted online; beta-/pilot tests were conducted in Winter 2014-2015. Starting in May 2015, this course was offered exclusively online. This paper analyzes data from the in-person and online versions of the FWH, including overall course evaluation data comparing two versions with similar questions/constructs. METHODS: The New Jersey Safe Schools Program modifications to FWH included adding information regarding the Fair Labor Standards Act's Section 14(c) and supplemental case studies. The online version included information/resources provided during the in-person training plus assessments to supplement each module; the online version was split into modules to allow participants scheduling flexibility. Participants were given multiple possible attempts to achieve a minimum passing grade of 70%, excluding two ungraded activities (crossword puzzles simply completed). Descriptive statistics evaluated user satisfaction online compared to the in-person version of FWH and performance on aforementioned online assessments replacing in-person discussions/interactions. RESULTS: Between October 2013 and April 2015, 160 participants completed the training in person; 156 had complete data. Between April and November 2015, 78 participants completed the training online; 74 participants had complete data. Other enrolled participants were in progress (not done as of 12/23/2015). Overall satisfaction was similarly high for in-person and online versions of FWH; over 95% of responding participants recommended this course to colleagues. Course evaluations for in-person participants indicated 83% felt the course objectives were completely met, whereas 95% of the responding online cohort felt course objectives were completely met. Further analyses examined performance of online assessments regarding number of attempts and scores achieved and performance on highlighted questions in certain module lessons. CONCLUSION: Data suggested the online format as a viable alternative to an in-person version of this training and provided NJSS and agency partners with ideas on how modifications/improvements can be made.

Injury surveillance and associations with socioeconomic status indicators among youth/young workers in New Jersey secondary schools.

BACKGROUND: Injuries involving career-technical-vocational education (CTE) are reported to the New Jersey Safe Schools Program online reporting system, the only U.S. State law-based surveillance data for young workers (ages twenty-one and younger), a susceptible, vulnerable adolescent sub-population. METHODS: We examined potential associations between socioeconomic status (SES) indicators and high school student injuries reported between 12/1998-12/2013, excluding injuries acquired by staff members. Associations between DFG score-a proxy for school/district SES-and variables relating to reported injuries, including severity, injury type, injury cause, body parts injured, injury treatment setting and demographics were examined with chi square test (X(2)) for independence and logistic regression. To assess potential associations between SES and personal protective equipment (PPE), data were stratified by 2003-2008 and 2008-2013, given mandated payment by employers of PPE for employees. RESULTS: Statistically significant associations were found between SES and injury cause [X(2) = (7, 14.74), p = 0.04] and SES and injury treatment setting [X(2) = (1, 4.76), p = 0.03]. Adjusted odds ratio suggested students from low SES schools were at a higher odds of being treated at a hospital emergency department (ED) than students from high SES schools (95 % CI 1.3-4.3, p < 0.01). CONCLUSIONS: These findings indicated low SES schools/districts have increased odds of being treated at ED, after controlling for injury severity. Future research should focus on implications such associations have on health care access and insurance for young workers and their families. With small sample sizes representing lower DFG scoring (SES) schools/districts, additional efforts should be enacted to increase injury reporting in these schools/districts.