Recommendations for Choosing Wisely in Pediatric Emergency Medicine: Five Opportunities to Improve Value.

Unnecessary diagnostic tests and treatments in children cared for in emergency departments (EDs) do not benefit patients, increase costs, and may result in harm. To address this low-value care, a taskforce of pediatric emergency medicine (PEM) physicians was formed to create the first PEM Choosing Wisely recommendations. Using a systematic, iterative process, the taskforce collected suggested items from an interprofessional group of 33 ED clinicians from 6 academic pediatric EDs. An initial review of 219 suggested items yielded 72 unique items. Taskforce members independently scored each item for its extent of overuse, strength of evidence, and potential for harm. The 25 highest-rated items were sent in an electronic survey to all 89 members of the American Academy of Pediatrics PEM Committee on Quality Transformation (AAP COQT) to select their top ten recommendations. The AAP COQT survey had a 63% response rate. The five most selected items were circulated to over 100 stakeholder and specialty groups (within the AAP, CW Canada, and CW USA organizations) for review, iterative feedback, and approval. The final 5 items were simultaneously published by Choosing Wisely United States and Choosing Wisely Canada on December 1, 2022. All recommendations focused on decreasing diagnostic testing related to respiratory conditions, medical clearance for psychiatric conditions, seizures, constipation, and viral respiratory tract infections. A multinational PEM taskforce developed the first Choosing Wisely recommendation list for pediatric patients in the ED setting. Future activities will include dissemination efforts and interventions to improve the quality and value of care specific to recommendations.

Baseline Performance of Real-World Clinical Practice Within a Statewide Emergency Medicine Quality Network: The Michigan Emergency Department Improvement Collaborative (MEDIC).

STUDY OBJECTIVE: Large-scale quality and performance measurement across unaffiliated hospitals is an important strategy to drive practice change. The Michigan Emergency Department Improvement Collaborative (MEDIC), established in 2015, has baseline performance data to identify practice variation across 15 diverse emergency departments (EDs) on key emergency care quality indicators. METHODS: MEDIC is a unique physician-led partnership supported by a major third-party payer. Member sites contribute electronic health record data and trained abstractors add supplementary data for eligible cases. Quality measures include computed tomography (CT) appropriateness for minor head injury, using the Canadian CT Head Rule for adults and Pediatric Emergency Care Applied Network rules for children; chest radiograph use for children with asthma, bronchiolitis, and croup; and diagnostic yield of CTs for suspected pulmonary embolism. Baseline performance was established with statistical process control charts. RESULTS: From June 1, 2016, to October 31, 2017, the MEDIC registry contained 1,124,227 ED visits, 23.2% for children (<18 years). Overall baseline performance included the following: 40.9% of adult patients with minor head injury (N=11,857) had appropriate CTs (site range 24.3% to 58.6%), 10.3% of pediatric minor head injury cases (N=11,183) exhibited CT overuse (range 5.8% to 16.8%), 38.1% of pediatric patients with a respiratory condition (N=18,190) received a chest radiograph (range 9.0% to 62.1%), and 8.7% of pulmonary embolism CT results (N=16,205) were positive (range 7.5% to 14.3%). CONCLUSION: Performance varied greatly, with demonstrated opportunity for improvement. MEDIC provides a robust platform for emergency physician engagement across ED practice settings to improve care and is a model for other states.

Making Improvements in the ED: Does ED Busyness Affect Time to Antibiotics in Febrile Pediatric Oncology Patients Presenting to the Emergency Department?

OBJECTIVES: Febrile neutropenic pediatric patients are at heightened risk for serious bacterial infections, and rapid antibiotic administration (in <60 minutes) improves survival. Our objectives were to reduce the time-to-antibiotic (TTA) administration and to evaluate the effect of overall emergency department (ED) busyness on TTA. METHODS: This study was a quality improvement initiative with retrospective chart review to reduce TTA in febrile children with underlying diagnosis of cancer or hematologic immunodeficiency who visited the pediatric ED. A multidisciplinary clinical practice guideline (CPG) was implemented to improve TTA. The CPG's main focus was delivery of antibiotics before availability of laboratory data. We collected data on TTA during baseline and intervention periods. Concurrent patient arrivals to the ED per hour served as a proxy of busyness. Time to antibiotic was compared with the number of concurrent arrivals per hour. Analyses included scatter plot and regression analysis. RESULTS: There were 253 visits from October 1, 2010 to March 30, 2012. Median TTA administration dropped from 207 to 89 minutes (P < 0.001). Eight months after completing all intervention periods, the median had dropped again to 44 minutes with 70% of patients receiving antibiotics within 60 minutes of ED arrival. There was no correlation between concurrent patient arrivals and TTA administration during the historical or intervention periods. CONCLUSIONS: Implementation of a CPG and process improvements significantly reduced median TTA administration. Total patient arrivals per hour as a proxy of ED crowding did not affect TTA administration. Our data suggest that positive improvements in clinical care can be successful despite fluctuations in ED patient volume.

Essentials of PEM Fellowship Part 2: The Profession in Entrustable Professional Activities.

This article is the second in a 7-part series that aims to comprehensively describe the current state and future directions of pediatric emergency medicine (PEM) fellowship training from the essential requirements to considerations for successfully administering and managing a program to the careers that may be anticipated upon program completion. This article describes the development of PEM entrustable professional activities (EPAs) and the relationship of these EPAs with existing taxonomies of assessment and learning within PEM fellowship. It summarizes the field in concepts that can be taught and assessed, packaging the PEM subspecialty into EPAs.

The role of high-fidelity simulation in training pediatric emergency medicine fellows in the United States and Canada.

OBJECTIVES: The American Academy of Pediatrics Section on Emergency Medicine's Simulation Interest Group developed a survey targeting pediatric emergency medicine (PEM) fellowship program directors to assess the use of high-fidelity simulation (HFS) in PEM fellow training. METHODS: Content experts in simulation and in PEM developed a 38-item Internet-based questionnaire that was distributed to PEM program directors via e-mail though www.surveymonkey.com. RESULTS: Seventy-seven percent (51/66) of PEM program directors in the United States and Canada responded to the survey. Sixty-three percent of programs incorporate HFS in PEM fellowship training. For programs with HFS, the most frequent uses of HFS include (1) decision making for trauma resuscitations (97%, 31/32) and medical emergencies (91%, 29/32), and for the application of advanced life support (84%, 27/32); (2) technical skills: intubation (100%, 31/31), bag-mask ventilation (94%, 29/31), cardioversion/defibrillation (90%, 28/31), and difficult airway management (84%, 26/31). Of program directors without simulation, a majority valued simulation for PEM fellow training, and 59% (11/19) plan on expanding efforts. Perceived barriers to an active simulation program exist: lack of financial support (79%, 15/19), lack of simulator equipment (74%, 14/19), lack of a dedicated physical space (68%, 13/19), and insufficiently experienced simulation faculty (58% 11/19). CONCLUSIONS: Sixty-three percent of PEM fellowship programs integrate HFS-based activities. The majority of PEM fellowship program directors value the role of HFS in augmenting clinical experience and documenting procedural skills. Regional simulation centers are one possible solution to offer HFS training to fellowships with limited financial support and/or lack of experienced simulation faculty.

Emergency Department Care for Children During the 2022 Viral Respiratory Illness Surge.

Importance: Pediatric readiness is essential for all emergency departments (EDs). Children's experience of care may differ according to operational challenges in children's hospitals, community hospitals, and rural EDs caused by recurring and sometimes unpredictable viral illness surges. Objective: To describe wait times, lengths of stay (LOS), and ED revisits across diverse EDs participating in a statewide quality collaborative during a surge in visits in 2022. Design, Setting, and Participants: This retrospective cohort study included 25 EDs from the Michigan Emergency Department Improvement Collaborative data registry from January 1, 2021, through December 31, 2022. Pediatric (patient age <18 years) encounters for viral and respiratory conditions were analyzed, comparing wait times, LOS, and ED revisit rates for children's hospital, urban pediatric high-volume (≥10% of overall visits), urban pediatric low-volume (<10% of overall visits), and rural EDs. Exposures: Surge in ED visit volumes for children with viral and respiratory illnesses from September 1 through December 31, 2022. Main Outcomes and Measures: Prolonged ED visit wait times (arrival to clinician assigned, >4 hours), prolonged LOS (arrival to departure, >12 hours), and ED revisit rate (ED discharge and return within 72 hours). Results: A total of 2 761 361 ED visits across 25 EDs in 2021 and 2022 were included. From September 1 to December 31, 2022, there were 301 688 pediatric visits for viral and respiratory illness, an increase of 71.8% over the 4 preceding months and 15.7% over the same period in 2021. At children's hospitals during the surge, 8.0% of visits had prolonged wait times longer than 4 hours, 8.6% had prolonged LOS longer than 12 hours, and 42 revisits occurred per 1000 ED visits. Prolonged wait times were rare among other sites. However, prolonged LOS affected 425 visits (2.2%) in urban high-pediatric volume EDs, 133 (2.6%) in urban pediatric low-volume EDs, and 176 (3.1%) in rural EDs. High visit volumes were associated with increased ED revisits across sites. Conclusions and Relevance: In this cohort study of more than 2.7 million ED visits, a pediatric viral illness surge was associated with different pediatric acute care across EDs in the state. Clinical management pathways and quality improvement efforts may more effectively mitigate dangerous clinical conditions with strong collaborative relationships across EDs and setting of care.

Reducing Computed Tomography Scan Utilization for Pediatric Minor Head Injury in the Emergency Department: A Quality Improvement Initiative.

BACKGROUND: The validated Pediatric Emergency Care Applied Research Network (PECARN) prediction rules are meant to aid clinicians in safely reducing unwarranted imaging in children with minor head injuries (MHI). Even so, computed tomography (CT) scan utilization remains high, especially in intermediate-risk (per PECARN) MHI patients. The primary objective of this quality improvement initiative was to reduce CT utilization rates in the intermediate-risk MHI patients. METHODS: This project was conducted in a Level I trauma pediatric emergency department (ED). Children < 18 years evaluated for intermediate-risk MHI from June 2016 through July 2019 were included. Our key drivers were provider education, decision support, and performance feedback. Our primary outcome was change in head CT utilization rate (%). Balancing measures included return visit within 72 hours of the index visit, ED length of stay (LOS), and clinically important traumatic brain injury (ciTBI) on the revisit. We used statistical process control methodology to assess head CT rates over time. RESULTS: A total of 1,535 eligible intermediate-risk MHI patients were analyzed. Our intervention bundle was associated with a decrease in CT use from 18.5% (95% confidence interval [CI] = 14.5% to 22.5%) in the preintervention period to 13.9% (95% CI = 13.8% to 14.1%) in the postintervention period, an absolute reduction of 4.6% (p = 0.015). Over time, no difference was noted in either ED LOS or return visit rate. There was only one revisit with a ciTBI to our institution during the study period. CONCLUSIONS: Our multifaceted quality improvement initiative was both safe and effective in reducing our CT utilization rates in children with intermediate-risk MHI.

A Global Survey of Emergency Department Responses to the COVID-19 Pandemic.

INTRODUCTION: Emergency departments (ED) globally are addressing the coronavirus disease 2019 (COVID-19) pandemic with varying degrees of success. We leveraged the 17-country, Emergency Medicine Education & Research by Global Experts (EMERGE) network and non-EMERGE ED contacts to understand ED emergency preparedness and practices globally when combating the COVID-19 pandemic. METHODS: We electronically surveyed EMERGE and non-EMERGE EDs from April 3-June 1, 2020 on ED capacity, pandemic preparedness plans, triage methods, staffing, supplies, and communication practices. The survey was available in English, Mandarin Chinese, and Spanish to optimize participation. We analyzed survey responses using descriptive statistics. RESULTS: 74/129 (57%) EDs from 28 countries in all six World Health Organization global regions responded. Most EDs were in Asia (49%), followed by North America (28%), and Europe (14%). Nearly all EDs (97%) developed and implemented protocols for screening, testing, and treating patients with suspected COVID-19 infections. Sixty percent responded that provider staffing/back-up plans were ineffective. Many sites (47/74, 64%) reported staff missing work due to possible illness with the highest provider proportion of COVID-19 exposures and infections among nurses. CONCLUSION: Despite having disaster plans in place, ED pandemic preparedness and response continue to be a challenge. Global emergency research networks are vital for generating and disseminating large-scale event data, which is particularly important during a pandemic.

Are Rural and Urban Emergency Departments Equally Prepared to Reduce Avoidable Hospitalizations?

INTRODUCTION: Attempts to reduce low-value hospital care often focus on emergency department (ED) hospitalizations. We compared rural and urban EDs in Michigan on resources designed to reduce avoidable admissions. METHODS: A cross-sectional, web-based survey was emailed to medical directors and/or nurse managers of the 135 hospital-based EDs in Michigan. Questions included presence of clinical pathways, services to reduce admissions, and barriers to connecting patients to outpatient services. We performed chi-squared comparisons, regression modeling, and predictive margins. RESULTS: Of 135 EDs, 64 (47%) responded with 33 in urban and 31 in rural counties. Clinical pathways were equally present in urban and rural EDs (67% vs 74%, p=0.5). Compared with urban EDs, rural EDs reported greater access to extended care facilities (21% vs 52%, p=0.02) but less access to observation units (52% vs 35%, p=0.04). Common barriers to connecting ED patients to outpatient services exist in both settings, including lack of social support (88% and 76%, p=0.20), and patient/family preference (68% and 68%, p=1.0). However, rural EDs were more likely to report time required for care coordination (88% vs 66%, p=0.05) and less likely to report limitations to home care (21% vs 48%, p=0.05) as barriers. In regression modeling, ED volume was predictive of the presence of clinical pathways rather than rurality. CONCLUSION: While rural-urban differences in resources and barriers exist, ED size rather than rurality may be a more important indicator of ability to reduce avoidable hospitalizations.

Michigan Emergency Department Leader Attitudes Toward and Experiences With Clinical Pathways to Guide Admission Decisions: A Mixed-methods Study.

OBJECTIVES: The objective was to characterize emergency department (ED) leader's attitudes toward potentially avoidable admissions and experiences with the use of clinical pathways to guide admission decisions, including the challenges and successes with implementation of these pathways. METHODS: A mixed-methods study of Michigan ED leaders was conducted. First, a cross-sectional Web-based survey was distributed via e-mail to all 135 hospital-based EDs in the state. Descriptive statistics were calculated. Survey participants who provided contact information were considered eligible for follow-up. Semistructured interviews were conducted by telephone until thematic saturation was reached. Interviews were recorded, transcribed verbatim, reviewed for accuracy, and thematically coded. Representative quotes were extracted for reporting. RESULTS: Survey responses were received from 64 ED leaders (48% eligible response rate). Semistructured interviews were conducted with a purposeful sample of 11 of the 29 representatives willing to be contacted. Eight sites implemented clinical care pathways as a strategy to reduce avoidable admissions. Pathways were developed for high-frequency conditions. Many pathways were multidisciplinary, incorporating case managers and outpatient care providers, which was thought to improve acceptability. Five models of care emerged 1) standardized care, 2) observation medicine, 3) enhanced follow-up, 4) care coordination, and 5) comprehensive programs. We identified barriers to and facilitators of discharging a patient from the ED when an admission otherwise could be avoided. Barriers included limited access to follow-up, lack of care coordination, and lack of trust in patient's ability to provide self-care or navigate the system. Facilitators included strong relationships with outpatient providers, care coordination, and shared decision making. CONCLUSIONS: Potential solutions to help avoid hospitalization from the ED include multidisciplinary clinical care pathways. Successful pathways emerged from bringing stakeholders from the ED, hospital, and health care community together. Additionally, emergency providers need systems and supports in place to help their patients navigate follow-up care in a timely fashion.

Successful emergency department interventions that reduce time to antibiotics in febrile pediatric cancer patients.

Children with cancer and fever are at high risk for sepsis related death. Rapid antibiotic delivery (< 60 minutes) has been shown to reduce mortality. We compared patient outcomes and describe interventions from three separate quality improvement (QI) projects conducted in three United States (US) tertiary care pediatric emergency departments (EDs) with the shared aim to reduce time to antibiotic (TTA) to < 60 minutes in febrile pediatric oncology patients (Temperature > 38.0 C). A secondary objective was to identify interventions amenable to translation to other centers. We conducted a post project analysis of prospectively collected observational data from children < 18 years visiting these EDs during independently conducted QI projects. Comparisons were made pre to post intervention periods within each institution. All interventions were derived independently using QI methods by each institution. Successful as well as unsuccessful interventions were described and common interventions adopted by all sites identified. A total of 1032 ED patient visits were identified from the three projects. Improvement in median TTA delivery (min) pre to post intervention(s) was 118.5-57.0 at site 1, 163.0-97.5 at site 2, and 188.0-111.5 at site 3 (p<.001 all sites). The eight common interventions were 1) Triage application of topical anesthetic 2) Rapid room placement & triage 3) Resuscitation room placement of ill appearing children 4) Close proximity to central line equipment 5) Antibiotic administration before laboratory analyses 6) Consensus clinical practice guideline establishment 7) Family pre-ED education for fever and 8) Staff project updates. This core set of eight low cost, high yield QI interventions were developed independently by the three ED's which led to substantial reduction in time to antibiotic delivery in children with cancer presenting with fever. These interventions may inform future QI initiatives in other settings caring for febrile pediatric oncology patients.

A randomized controlled trial of an emergency department-based interactive computer program to prevent alcohol misuse among injured adolescents.

STUDY OBJECTIVE: To determine whether an emergency department (ED)-based laptop computer intervention reduces the normative age-related increase in alcohol misuse compared with standard of care. METHODS: This was a randomized controlled trial conducted from October 11, 1999, to April 14, 2001, in a community teaching hospital and university medical center. Subjects were aged 14 to 18 years and with a minor injury. Controls and intervention participants completed a computer-based questionnaire. Intervention participants also completed a laptop-based interactive computer program to affect alcohol misuse. Main outcome measures were Alcohol Misuse Index (Amidx) and binge-drinking episodes. Follow-up occurred by telephone at 3 and 12 months. Analysis included repeated-measures analysis of variance (alpha=0.05; power 0.80; effect size 0.10). RESULTS: Three hundred twenty-nine participants were randomized to the intervention group, and 326 participants were randomized to the control group. Two hundred ninety-five (89.7%) intervention subjects and 285 (87.4%) control subjects completed 3- and 12-month follow-ups. For intervention and control groups, respectively, mean age was 16.0 and 15.9 years and men composed 66.8% and 66.3% of the groups; Amidx scores were 2.2 and 2.0; binge-drinking episodes were 1.2 and 1.0. Outcomes for intervention and control, respectively, were Amidx (3 months) 1.5 and 1.4; Amidx (12 months) 1.8 and 2.1; binge drinking (3 months) 0.9 and 0.8; and binge drinking (12 months) 1.4 and 1.2. Overall, there were no significant effects (effect size 0.04). No detrimental effects were noted. Subgroup analysis suggested that the intervention may have an effect among subjects with experience drinking and driving (5% of the sample). CONCLUSION: The intervention was not effective in decreasing alcohol misuse among the study population. Further research will be required to determine effectiveness among the subgroup of adolescent minor injury patients who have experience drinking and driving.

Implementation of an Education Value Unit (EVU) System to Recognize Faculty Contributions.

INTRODUCTION: Faculty educational contributions are hard to quantify, but in an era of limited resources it is essential to link funding with effort. The purpose of this study was to determine the feasibility of an educational value unit (EVU) system in an academic emergency department and to examine its effect on faculty behavior, particularly on conference attendance and completion of trainee evaluations. METHODS: A taskforce representing education, research, and clinical missions was convened to develop a method of incentivizing productivity for an academic emergency medicine faculty. Domains of educational contributions were defined and assigned a value based on time expended. A 30-hour EVU threshold for achievement was aligned with departmental goals. Targets included educational presentations, completion of trainee evaluations and attendance at didactic conferences. We analyzed comparisons of performance during the year preceding and after implementation. RESULTS: Faculty (N=50) attended significantly more didactic conferences (22.7 hours v. 34.5 hours, p<0.005) and completed more trainee evaluations (5.9 v. 8.8 months, p<0.005). During the pre-implementation year, 84% (42/50) met the 30-hour threshold with 94% (47/50) meeting post-implementation (p=0.11). Mean total EVUs increased significantly (94.4 hours v. 109.8 hours, p=0.04) resulting from increased conference attendance and evaluation completion without a change in other categories. CONCLUSION: In a busy academic department there are many work allocation pressures. An EVU system integrated with an incentive structure to recognize faculty contributions increases the importance of educational responsibilities. We propose an EVU model that could be implemented and adjusted for differing departmental priorities at other academic departments.

Simulation in Pediatric Emergency Medicine Fellowships.

BACKGROUND AND OBJECTIVES: Graduate medical education faces challenges as programs transition to the next accreditation system. Evidence supports the effectiveness of simulation for training and assessment. This study aims to describe the current use of simulation and barriers to its implementation in pediatric emergency medicine (PEM) fellowship programs. METHODS: A survey was developed by consensus methods and distributed to PEM program directors via an anonymous online survey. RESULTS: Sixty-nine (95%) fellowship programs responded. Simulation-based training is provided by 97% of PEM fellowship programs; the remainder plan to within 2 years. Thirty-seven percent incorporate >20 simulation hours per year. Barriers include the following: lack of faculty time (49%) and faculty simulation experience (39%); limited support for learner attendance (35%); and lack of established curricula (32%). Of those with written simulation curricula, most focus on resuscitation (71%), procedures (63%), and teamwork/communication (38%). Thirty-seven percent use simulation to evaluate procedural competency and resuscitation management. PEM fellows use simulation to teach (77%) and have conducted simulation-based research (33%). Thirty percent participate in a fellows' "boot camp"; however, finances (27%) and availability (15%) limit attendance. Programs receive simulation funding from hospitals (47%), academic institutions (22%), and PEM revenue (17%), with 22% reporting no direct simulation funding. CONCLUSIONS: PEM fellowships have rapidly integrated simulation into their curricula over the past 5 years. Current limitations primarily involve faculty and funding, with equipment and dedicated space less significant than previously reported. Shared curricula and assessment tools, increased faculty and financial support, and regionalization could ameliorate barriers to incorporating simulation into PEM fellowships.

Model for Developing Educational Research Productivity: The Medical Education Research Group.

INTRODUCTION: Education research and scholarship are essential for promotion of faculty as well as dissemination of new educational practices. Educational faculty frequently spend the majority of their time on administrative and educational commitments and as a result educators often fall behind on scholarship and research. The objective of this educational advance is to promote scholarly productivity as a template for others to follow. METHODS: We formed the Medical Education Research Group (MERG) of education leaders from our emergency medicine residency, fellowship, and clerkship programs, as well as residents with a focus on education. First, we incorporated scholarship into the required activities of our education missions by evaluating the impact of programmatic changes and then submitting the curricula or process as peer-reviewed work. Second, we worked as a team, sharing projects that led to improved motivation, accountability, and work completion. Third, our monthly meetings served as brainstorming sessions for new projects, research skill building, and tracking work completion. Lastly, we incorporated a work-study graduate student to assist with basic but time-consuming tasks of completing manuscripts. RESULTS: The MERG group has been highly productive, achieving the following scholarship over a three-year period: 102 abstract presentations, 46 journal article publications, 13 MedEd Portal publications, 35 national didactic presentations and five faculty promotions to the next academic level. CONCLUSION: An intentional focus on scholarship has led to a collaborative group of educators successfully improving their scholarship through team productivity, which ultimately leads to faculty promotions and dissemination of innovations in education.

Baclofen toxicity in an 8-year-old with an intrathecal baclofen pump.

Baclofen delivered by intrathecal pumps (ITB) is increasingly being utilized in the pediatric population, however, resources and education to support problems with these devices are limited. Typical management strategies for systemic baclofen overdose include removal of baclofen from the device reservoir or removal of cerebrospinal fluid from the adjacent device catheter. Appropriate care of these patients requires awareness of the clinical patterns of toxicity and mechanics of the ITB pump delivery system. This report describes the clinical presentation, unfamiliar dilemmas, and the management of a pediatric patient with intrathecal baclofen toxicity, noting problems that may arise in the care of these patients.

Assessing the validity evidence of an objective structured assessment tool of technical skills for neonatal lumbar punctures.

BACKGROUND: The lumbar puncture (LP) is a procedural competency deemed necessary by the Accreditation Council for Graduate Medical Education and the Emergency Medicine and Pediatric Residency Review Committees. The emergency department (ED) is a primary site for residents to be evaluated performing neonatal LPs. Current evaluation methods lack validity evidence as assessment tools. OBJECTIVES: This was a pilot study to develop an objective structured assessment of technical skills for neonatal LP (OSATS-LP) and to document validity evidence for the instrument in regard to five sources of test validity: content, response process, relation to other variables, inter-rater reliability, and consequences of testing. METHODS: Pediatric residents were videotaped in the fall of 2011 for comparison of faculty evaluation of resident performance during a neonatal LP using a video-delayed format. Residents completed a demographic experience survey evaluating relations to other variables. Content and response process validity was obtained through expert panel meetings and resulted in the following seven domains of performance for the OSATS-LP: preparation, positioning, analgesia, needle insertion, cerebrospinal fluid (CSF) collection, management of laboratory studies, and sterility. t-tests assessed significance between level of training, previous intensive care unit experience, and residents' self-assessed confidence in comparison with their total performance score. The inter-rater agreement of the OSATS-LP was obtained using the Fleiss' kappa for each domain. RESULTS: Sixteen pediatric residents completed the simulation with six raters evaluating each resident (96 ratings). The domains of sterility and CSF collection had moderate statistical reliability (κ = 0.41 and 0.51, respectively). The domains of preparation, analgesia, and management of laboratories had substantial reliability (κ = 0.60, 0.62, and 0.62, respectively). The domains of positioning and needle insertion were less reliable (κ = 0.16 and 0.16, respectively). Individuals who had completed one or more rotations in the neonatal intensive care unit (NICU) had a higher total score (12.5 vs. 16.9; p < 0.01). The residents' own perception of ability to perform an LP unsupervised did not result in a higher total score. CONCLUSIONS: The OSATS-LP has reasonable evidence in four of the five sources for test validity. This study serves as a launching point for using this tool in clinical environments such as the ED and, therefore, has the potential to provide real-time formative and summative feedback to improve resident skills and ultimately lead to improvements in patient care.

Prospective comparison of live evaluation and video review in the evaluation of operator performance in a pediatric emergency airway simulation.

INTRODUCTION: Real-time assessment of operator performance during procedural simulation is a common practice that requires undivided attention by 1 or more reviewers, potentially over many repetitions of the same case. OBJECTIVE: To determine whether reviewers display better interrater agreement of procedural competency when observing recorded, rather than live, performance; and to develop an assessment tool for pediatric rapid sequence intubation (pRSI). METHODS: A framework of a previously established Objective Structured Assessment of Technical Skills (OSATS) tool was modified for pRSI. Emergency medicine residents (postgraduate year 1-4) were prospectively enrolled in a pRSI simulation scenario and evaluated by 2 live raters using the modified tool. Sessions were videotaped and reviewed by the same raters at least 4 months later. Raters were blinded to their initial rating. Interrater agreement was determined by using the Krippendorff generalized concordance method. RESULTS: Overall interrater agreement for live review was 0.75 (95% confidence interval [CI], 0.72-0.78) and for video was 0.79 (95% CI, 0.73-0.82). Live review was significantly superior to video review in only 1 of the OSATS domains (Preparation) and was equivalent in the other domains. Intrarater agreement between the live and video evaluation was very good, greater than 0.75 for all raters, with a mean of 0.81 (95% CI, 0.76-0.85). CONCLUSION: The modified OSATS assessment tool demonstrated some evidence of validity in discriminating among levels of resident experience and high interreviewer reliability. With this tool, intrareviewer reliability was high between live and 4-months' delayed video review of the simulated procedure, which supports feasibility of delayed video review in resident assessment.

Best educational practices in pediatric emergency medicine during emergency medicine residency training: guiding principles and expert recommendations.

The state of pediatric emergency medicine (PEM) education within emergency medicine (EM) residency programs is reviewed and discussed in the context of shifting practice environments and new demands for a greater focus on the availability and quality of PEM services. The rapid growth of PEM within pediatrics has altered the EM practice landscape with regard to PEM. The authors evaluate the composition, quantity, and quality of PEM training in EM residency programs, with close attention paid to the challenges facing programs. A set of best practices is presented as a framework for discussion of future PEM training that would increase the yield and relevance of knowledge and experiences within the constraints of 3- and 4-year residencies. Innovative educational modalities are discussed, as well as the role of simulation and pediatric-specific patient safety education. Finally, barriers to PEM fellowship training among EM residency graduates are discussed in light of the shortage of practitioners from this training pathway and in recognition of the ongoing importance of the EM voice in PEM.

Feasibility of using an interactive laptop program in the emergency department to prevent alcohol misuse among adolescents.

STUDY OBJECTIVE: Alcohol, the most commonly used substance among adolescents, is frequently associated with injury. Effective interventions to prevent adolescent alcohol use and misuse in acute care settings are lacking. A laptop-based alcohol prevention program could reinforce other prevention efforts that adolescents may receive. We determined the feasibility of using an interactive laptop program with adolescent emergency department (ED) patients to prevent alcohol use and misuse. METHODS: We used the recruitment phase of a randomized controlled trial at an academic medical center and an urban teaching hospital. Patients were aged 14 to 18 years and presented within 24 hours of an acute injury. Measures included patient recruitment, mechanism of injury, injury severity score, alcohol use characteristics, and patients' opinion of the computer program. RESULTS: Of 843 eligible patients, 671 (79.6%) were enrolled and 655 (77.7%) completed the program. Parent or guardian reluctance was the most frequent reason for refusal. The participants averaged 16.0 years of age (range 14 to 18 years; SD 1.5 years), 66.9% were male, and 68.3% were white. Approximately 71% reported "ever" drinking. Recent alcohol use (past 3 months) by those "ever" drinking was as follows: 62.3% drank, 31.2% got drunk, and 37.4% binge drank. Seventy-four percent of recent drinkers reported that the program made them rethink their alcohol use. Ninety-four percent of participants liked the program. Only 5.3% required assistance with the program. CONCLUSION: Use of an interactive computer program in the ED appears feasible. Further work is being done to evaluate the effectiveness of the program in reducing alcohol-related behaviors among adolescents.