Screening residents for infant lumbar puncture readiness with just-in-time simulation-based assessments.

Background: Determining when to entrust trainees to perform procedures is fundamental to patient safety and competency development. Objective: To determine whether simulation-based readiness assessments of first year residents immediately prior to their first supervised infant lumbar punctures (LPs) are associated with success. Methods: This prospective cohort study enrolled paediatric and other first year residents who perform LPs at 35 academic hospitals from 2012 to 2014. Within a standardised LP curriculum, a validated 4-point readiness assessment of first year residents was required immediately prior to their first supervised LP. A score ≥3 was required for residents to perform the LP. The proportion of successful LPs (<1000 red blood cells on first attempt) was determined. Process measures included success on any attempt, number of attempts, analgesia usage and use of the early stylet removal technique. Results: We analysed 726 LPs reported from 1722 residents (42%). Of the 432 who underwent readiness assessments, 174 (40%, 95% CI 36% to 45%) successfully performed their first LP. Those who were not assessed succeeded in 103/294 (35%, 95% CI 30% to 41%) LPs. Assessed participants reported more frequent direct attending supervision of the LP (diff 16%; 95% CI 8% to 22%), greater use of topical analgesia (diff 6%; 95% CI 1% to 12%) and greater use of the early stylet removal technique (diff 11%; 95% CI 4% to 19%) but no difference in number of attempts or overall procedural success. Conclusions: Simulation-based readiness assessments performed in a point-of-care fashion were associated with several desirable behaviours but were not associated with greater clinical success with LP.

The Correlation of Workplace Simulation-Based Assessments With Interns' Infant Lumbar Puncture Success: A Prospective, Multicenter, Observational Study.

INTRODUCTION: Little data are available to guide supervisors' decisions regarding when trainees are prepared to safely perform their first procedure on a patient. We aimed to describe the correlation of simulation-based assessments, in the workplace, with interns' first clinical infant lumbar puncture (ILP) success. METHODS: This is a prospective, observational subcomponent of a larger study of incoming interns at 33 academic medical centers (July 2010 to June 2012) assessing the impact of just-in-time training. When an intern's patient required an ILP, a just-in-time simulation-based skills refresher was conducted with his or her supervisor. At the end of the refresher, supervisors assessed interns' ILP skills on a simulator in the workplace before clinical performance using a four point anchored scale. The primary outcome was the correlation of supervisors' assessment and interns' procedural success. The number needed to assess for this instrument (1 / absolute risk reduction) was calculated. RESULTS: A total of 1600 interns were eligible to participate, and 1215 were enrolled. A total of 297 completed an assessment and a subsequent clinical ILP. Success rates for each scale rating were 29% (18/63) for novice, 39% (51/130) for beginner, 55% (46/83) for competent, and 43% (9/21) for proficient. The correlation coefficient was 0.161 (95% confidence interval, 0.057-0.265), indicating a weak correlation between supervisor rating and success. Success rate was 53% for the ratings of competent or proficient compared with 35% for the ratings of novice or beginner. Using the global rating scale for the summative assessment to determine procedural readiness could lead to 1 fewer patient experiencing a failed ILP for every 6 interns tested (6.2; 95% confidence interval, 4.0-8.5). CONCLUSIONS: A simulation-based assessment of interns conducted in the workplace before their first ILP has some value in predicting clinical ILP success.

Impact of Just-in-Time and Just-in-Place Simulation on Intern Success With Infant Lumbar Puncture.

BACKGROUND AND OBJECTIVE: Simulation-based skill trainings are common; however, optimal instructional designs that improve outcomes are not well specified. We explored the impact of just-in-time and just-in-place training (JIPT) on interns' infant lumbar puncture (LP) success. METHODS: This prospective study enrolled pediatric and emergency medicine interns from 2009 to 2012 at 34 centers. Two distinct instructional design strategies were compared. Cohort A (2009-2010) completed simulation-based training at commencement of internship, receiving individually coached practice on the LP simulator until achieving a predefined mastery performance standard. Cohort B (2010-2012) had the same training plus JIPT sessions immediately before their first clinical LP. Main outcome was LP success, defined as obtaining fluid with first needle insertion and <1000 red blood cells per high-power field. Process measures included use of analgesia, early stylet removal, and overall attempts. RESULTS: A total of 436 first infant LPs were analyzed. The LP success rate in cohort A was 35% (13/37), compared with 38% (152/399) in cohort B (95% confidence interval for difference [CI diff], -15% to +18%). Cohort B exhibited greater analgesia use (68% vs 19%; 95% CI diff, 33% to 59%), early stylet removal (69% vs 54%; 95% CI diff, 0% to 32%), and lower mean number of attempts (1.4 ± 0.6 vs 2.1 ± 1.6, P < .01) compared with cohort A. CONCLUSIONS: Across multiple institutions, intern success rates with infant LP are poor. Despite improving process measures, adding JIPT to training bundles did not improve success rate. More research is needed on optimal instructional design strategies for infant LP.

Calling 911! What role does the pediatrician play?

OBJECTIVE: The objective of this study was to compare admission rates and medical interventions among children whose caregivers called their child's primary care provider (PCP) before taking an ambulance to the pediatric emergency department (PED) versus those who did not. METHODS: This was a prospective cohort study of patients brought to an urban, public hospital PED via emergency medical system (EMS). Children were included if the caregiver called 911 to have them transported via EMS and was present in the PED. The main variable was whether the child's PCP was called before EMS utilization. Study outcomes were medical interventions, such as intravenous line insertion or laboratory tests, and hospital admission. χ Test and logistic regression were used to evaluate the relationship of the main variable to the study outcomes. RESULTS: Six hundred fourteen patients met inclusion criteria and were enrolled. Five hundred eighty-five patients (95.3%) were reported to have a PCP. Seventy-four caregivers (12.1%) called their child's PCP before calling EMS. Two hundred seventy-seven patients (45.1%) had medical interventions performed; of these, 42 (15.2%) called their PCP (P = 0.03). Forty-two patients (6.8%) were admitted; among these, 14 (33.3%) called their PCP (P < 0.01). Adjusting for triage level, patients whose caregiver called the PCP before calling EMS were 3.2 times (95% confidence interval, 1.9-5.2 times) more likely to be admitted and 1.7 times (95% confidence interval, 1.1-2.9 times) more likely to have a medical intervention compared with patients whose caregivers did not call their child's PCP. CONCLUSIONS: Children were more likely to be admitted or require a medical intervention if their caregiver called their PCP before calling EMS. The availability of a PCP for telephone triage may help to optimize EMS utilization.

Screening for developmental delay in high-risk users of an urban pediatric emergency department.

OBJECTIVE: To determine whether screening children in an urban pediatric emergency department (PED) would lead to identification of previously undiagnosed developmental delay. METHODS: This was a cross-sectional study of families presenting to an urban public hospital PED with children 6 to 36 months and no history of developmental delay. Children were screened for possible developmental delay using the Ages and Stages Questionnaire; parents completed an instrument that assesses 5 domains: communication, gross motor, fine motor, problem solving, and personal-social. Sociodemographic data were also obtained. RESULTS: One hundred thirty-eight children were enrolled, all accompanied by their mothers. Mean age of the children was 18.9 months; 51.5% were female; 56.8% of the mothers were high-school graduates; 59.9% were immigrants; 75.4% were Latino. Twenty-one percent did not have a regular source of primary care; 26.8% (95% confidence interval, 20.1%-34.8%) screened positive in at least 1 domain, with a trend toward the highest percentage of positive screens on the communication domain (z = 1.89, P = 0.059). In a simultaneous multiple logistic regression model including all predictor variables, child age of 12 to 30 months was associated with increased adjusted odds of positive screen (adjusted odds ratio, 8.4; 95% confidence interval, 1.4-48.9). Having a primary caregiver born in the United States was statistically significant for screening positive in at least 1 Ages and Stages Questionnaire domain (P = 0.03). CONCLUSIONS: Almost 30% of 6- to 36-month-old children presenting to an urban PED without prior developmental concerns screened positive for possible delay, suggesting the utility of performing routine developmental screening in the PED. Pediatric emergency department use alone may be an indication for screening. Further study is needed for feasibility of screening for delay in the PED.