A Refined Teach-back Observation Tool: Validity Evidence in a Pediatric Setting.

BACKGROUND: Teach Back (TB) is recommended to assess and ensure patient understanding, thereby promoting safety, quality, and equity. There are many TB trainings, typically lacking assessment tools with validity evidence. We used a pediatric resident competency-based communication curriculum to develop initial validity evidence and refinement recommendations for a Teach-back Observation Tool (T-BOT). OBJECTIVE: This study aimed to develop initial validity evidence for a refined T-BOT and provide guidance for further enhancements to improve essential TB skills training among pediatric residents. METHODS: After an interactive health literacy (HL) training, residents participated in recorded standardized patient (SP) encounters. Raters developed T-BOT scoring criteria, then scored a gold standard TB video and resident SP encounters. For agreement, Fleiss' Kappa was computed for >2 raters, and Cohen's Kappa for two raters. Percent agreement and intraclass correlation (ICC) were calculated. Statistics were calculated for gold standard (GS) and TB items overall for all six raters, and for five faculty raters. Agreement was based on Kappa: no agreement (≤0), none to slight (0.01-0.20), fair (0.21-0.40), moderate (0.41-0.60), substantial (0.61-0.80), almost perfect (0.81-1.00). KEY RESULTS: For six raters, Kappa for the GS was 0.554 (moderate agreement) with 71.4% agreement; ICC = .597; for SP encounters, it was 0.637 (substantial) with 65.4% agreement; ICC = .647. Individual item agreement for SP encounters average was 0.605 (moderate), ranging from 0.142 (slight) to 1 (perfect). For five faculty raters, Kappa for the GS was 0.779 (substantial) with 85.7% agreement; ICC = .824; for resident SP encounters, it was 0.751 (substantial), with 76.9% agreement; ICC = .759. Individual item agreement on SP encounters average was 0.718 (substantial), ranging from 0.156 (slight) to 1 (perfect). CONCLUSION: We provide initial validity evidence for a modified T-BOT and recommendations for improvement. With further refinements to increase validity evidence, accompanied by shared understanding of TB and rating criteria, the T-BOT may be useful in strengthening approaches to teaching and improving essential TB skills among health care team members, thereby increasing organizational HL and improving outcomes. [HLRP: Health Literacy Research and Practice. 2023;7(4):e187-e196.].

PLAIN LANGUAGE SUMMARY: We provide initial validity evidence for a refined T-BOT and recommendations for further enhancements to improve essential TB skills among pediatric residents. With attention to a shared understanding of TB and rating criteria, this tool may be used to improve HL training, thereby increasing organizational HL and improving outcomes.

Physical abuse re-reporting during the COVID-19 pandemic: The kids are not okay.

BACKGROUND: Child physical abuse (PA) is a significant societal concern with limited research into predictors of re-reports. OBJECTIVE: Our research explores correlations between sociodemographic variables and re-reported PA. Our aim was to characterize populations at higher risk and identify changes in presentation during the COVID-19 pandemic. PARTICIPANTS AND SETTING: This retrospective descriptive study focused on 238 patients with re-reports of PA made by a pediatric hospital from January 2019 through April 2021. METHODS: We analyzed sociodemographic information and details of reports made to child protective services (CPS) obtained from the electronic health record. RESULTS: Females were 2.5 years older than males (mean 11.0 and 8.5 years, respectively) (p < .001, 95%CI 1.21-3.76). Males were more likely to have observable injuries (OR 2.61, p < .001) and a CPS response (OR = 2.70, p = .003). Patients categorized as "Other" races were less likely to have observable injuries (OR = 0.32, p = .006). Presentation changed during the pandemic: a quadrupling of re-reports by behavioral health clinicians caused the percentage of reports made by them to increase significantly (OR = 3.46, p < .001) and the mean age increased by 2.0 years (8.2 years before, 10.2 years during) (p = .009, 95%CI 0.5-3.5), though females remained approximately 2.2 years older than males (p = .003, 95%CI 0.8-3.7). CONCLUSIONS: Males experienced higher rates of re-reported PA and were younger at the time of re-report. Changes to presentation during the pandemic suggest an increase in PA among older children. Future research should further explore differences in sex/race, while current prevention efforts should focus on children receiving behavioral health care.

Timely Recognition of Abusive Injuries (TRAIN): Results from a Statewide Quality Improvement Collaborative.

Early recognition of physical abuse is critical as children often experience recurrent abuse if their environment remains unchanged. The Timely Recognition of Abusive Injuries (TRAIN) Collaborative was a quality improvement network of 6 Ohio children's hospitals created in 2015 to improve the management of injuries concerning for abuse in infants. TRAIN's first phase sought to reduce recurrent abuse by recognizing and responding to injured infants. This study aimed to reduce reinjury rate among infants ≤6 months by 10% at 1 year and 50% by 2 years and sustain improvement for 1 year as reflected in 3- and 12-month reinjury rates. Methods: The TRAIN Collaborative adopted the Institute for Healthcare Improvement's Breakthrough Series Collaborative Model, where partnerships between organizations facilitate learning from each other and experts. Collaborative members identified opportunities to improve injury recognition, implemented changes, responded to data, and reconvened to share successes and obstacles. As a result, institutions implemented different interventions, including education for clinical staff, increased social work involvement, and scripting for providers. Results: Data collected over 3 years were compared to a 12-month baseline. The number of injuries increased from 51 children with concerning injuries identified monthly to 76 children sustained throughout the collaborative. However, within 2 years, the 3- and 12-month reinjury rates ultimately significantly decreased from 5.7% to 2.1% and 6.5% to 3.7%, respectively. Conclusion: Our data suggest the Institute for Healthcare Improvement's Breakthrough Series model can be applied across large populations to improve secondary injury prevention in infants.

ICD-10-CM Codes for the Identification of Abusive Head Trauma in Administrative Datasets.

OBJECTIVE: We sought to develop and validate a list of ICD-10-CM codes identifying abusive head trauma (AHT). METHODS: Subjects included all children under 2 years with head trauma seen in the emergency department or admitted to one of 5 medical centers. Cases were classified as AHT, accidental head injury, or indeterminate based on chart review of the medical record. ICD-10-CM code list to identify cases of AHT was developed based on prior head injury code lists. Sensitivity and specificity of the final code list were calculated. RESULTS: There were 2883 patients in the study population of whom 524 had AHT, 2123 had accidental injury, and 236 were indeterminate cases. The final list of AHT codes had a sensitivity of 76.1% (95% CI 72.5-79.8) and a specificity of 98.5% (95% CI 98.0-99.0) when limiting analyses to the groups with identified cause of injury (accidental vs abusive). Misclassification of cases based on codes resulting in false positives and false negatives was due to coding errors. CONCLUSIONS: The list of ICD-10-CM codes can be utilized to identify and track cases of AHT at a national level in large administrative datasets though likely underestimates true injury burden.

A national survey on the use of screening tools to detect physical child abuse.

PURPOSE: Recognition of physical child abuse is imperative for ensuring children's safety. Screening tools (ST) may increase identification of physical abuse; however, the extent of their use is unknown. This study assessed use of STs for physical abuse in children's hospitals and determined attitudes regarding STs. METHODS: A web-based survey was sent to child abuse program contacts at 103 children's hospitals. The survey assessed institutional use of a ST for physical abuse and characteristics of the ST used. Respondents were asked to identify benefits and liabilities of STs used or barriers to ST use. RESULTS: Seventy-two respondents (70 %) completed the survey; most (64 %) were child abuse pediatricians. Nine (13 %) respondents reported using a ST for physical abuse; STs varied in length, population, administration, and outcomes of a positive screen. Most respondents (86 %) using a ST felt that it increased detection of abuse. Barriers noted included lack of time for development and provider completion of a ST. CONCLUSIONS: While few respondents endorsed use of a ST for physical abuse, most believed that it increased detection of abuse. Future research should focus on development of a brief, uniform ST for physical abuse which may increase detection in at-risk children.