Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment.

BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment. OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale. RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05). CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.

Spanish-Speaking Caregivers' Perception of Emergency Physicians' Interpersonal and Communication Skills in a Pediatric Emergency Department.

OBJECTIVES: Medical communication is more than just the delivery of information; language differences between physicians and patients/caregivers create a challenge to providing effective care in the pediatric emergency department (ED). Overcoming this barrier is vital to providing high-quality care. We evaluated Spanish- versus English-speaking caregivers' perception of their pediatric ED physicians' interpersonal and communication skills. We also compared perceptions of Spanish- versus English-speaking caregivers who self-identified as Hispanic. METHODS: This study is a retrospective analysis of data from surveys administered in an urban, free-standing children's hospital ED. Surveys were administered in English and Spanish to pediatric patient caregivers. In person, video, and telephonic interpretations were available during patient encounters. RESULTS: There were 2542 (82.4%) surveys completed in English and 543 (17.6%) in Spanish. There were significant differences in demographic data of English versus Spanish survey respondents, including level of education, insurance status, and rates of nonpublic insurance. Spanish survey respondents rated their physicians' interpersonal skills lower than English survey respondents. There were 1455 (47%) surveys completed by the respondents who self-identified as Hispanic. Within this group, 928 (63.8%) respondents completed the survey in English and 527 (36.2%) in Spanish. Among this Hispanic population, the Spanish survey respondents rated their physicians' interpersonal and communication skills lower than English survey respondents. After adjusting for education level and insurance type, these differences persisted. CONCLUSIONS: Language barriers have a meaningful impact on physician ability to communicate effectively in the pediatric ED. Improving physicians' ability to overcome this barrier is essential toward enriching patient outcomes and experience in the ED.

Pediatric Emergency Medicine Fellowship Program Directors' Viewpoint: Minimum Levels of Entrustment for Graduating Fellows and Practicing Physicians to Perform the Subspecialty's Professional Activities.

OBJECTIVES: Entrustable Professional Activities (EPAs) are essential tasks physicians perform within their professions. Entrustment levels that pediatric emergency medicine (PEM) fellowship program directors (FPDs) expect graduating fellows to achieve for PEM-specific and common pediatric subspecialty EPAs remain unreported. This study aims to determine minimum entrustment levels FPDs require fellows to achieve to graduate from fellowship and to compare FPD expectations for fellows versus practicing PEM physicians. METHODS: Secondary analysis of PEM-specific data from a national multispecialty cross-sectional survey of pediatric subspecialty FPDs. For 6 PEM-specific and 7 common pediatric subspecialty EPAs, PEM FPDs indicated (1) minimum entrustment levels fellows should achieve by training completion, (2) whether they would allow a fellow to graduate below these minimum levels, and (3) minimum levels for safe and effective practice by PEM physicians. Minimum levels were defined as the level that more than 80% of FPDs would not drop below. RESULTS: Sixty of 77 PEM FPDs (78%) completed the survey. Most respondents did not require fellows to achieve the highest level (level 5-no supervision) by graduation for any PEM-specific EPAs. The median level FPDs expected for practicing PEM physicians was 5 (trusted to perform without supervision) for EPAs 1 and 4 and level 4 (indirect supervision for complex cases) for the remaining PEM-specific EPAs. Minimum levels expected by FPDs for common subspecialty pediatric EPAs were lower for both groups. CONCLUSIONS: Most PEM FPDs indicated that they would graduate fellows before their achievement of the highest entrustment level for all EPAs. Most also indicated that they do not expect practicing PEM physicians to perform all EPAs without supervision. These findings indicate need for stakeholders to evaluate current structure and outcomes of PEM fellowship programs and for institutions and organizations to ensure adequate support in time and resources for ongoing learning for practicing PEM physicians.

Career Development in Pediatric Emergency Medicine: What Do We Need?

OBJECTIVES: The Women in Pediatric Emergency Medicine (PEM) subcommittee of the American Academy of Pediatrics Section on Emergency Medicine identified 2 top priorities for 2021: career development and mentorship/sponsorship. The objective of this study was to catalog and delineate the career development domains for women physicians in PEM. METHODS: After a review of the literature to identify the key areas for gaps for women in PEM, we used Q sort methodology to elicit domains for this subcommittee to address by survey of a national sample. RESULTS: One hundred fourteen discrete potential areas of interest for career development were identified by the working group based on salient themes from the literature and personal experiences. Forty-one Women in PEM subcommittee members (27%) completed the survey. The career development topics were sorted into the domains of personal (40.4%; n = 46), administrative (28.1%; n = 32), research (10.5%; n = 12), teaching (10.5%; n = 12), service (7.0%; n = 8), and clinical (3.5%; n = 4). CONCLUSIONS: This study demonstrates that the career development needs of women in PEM include a range of personal, teaching, research, administrative, clinical, and service domains. However, more than two-thirds of the career development topics were categorized into just 2 domains, administrative and personal.

Impact of a Pediatric-Focused Communication Course on Patient/Caregiver-Perceived Physician Communication Skills in a Pediatric Emergency Department.

OBJECTIVES: To evaluate the impact of a pediatric-focused, relationship-centered communication course on patient/caregiver assessment of emergency department (ED) physician communication skills. METHODS: This was a prospective study; a previously validated assessment tool (Pediatric Physician Interpersonal Communication Skills Assessment [P-PICSA]) was used to collect pediatric patient/caregiver evaluation of ED physician communication skills. Emergency department physicians were required to attend a 5.5-hour communication course. Differences in precourse/postcourse P-PICSA and top-box scores were analyzed to determine course impact on ED physician communication skills. RESULTS: From July 2016 to August 2017, 49 pediatric ED physicians participated in the course, and 24 physicians (49%) had 6-month precourse/postcourse P-PICSA data. Postcourse scores were higher for all 13 items, with 3 items achieving statistical significance: (1) the doctor used words I could understand; (2) the way the doctor involved me in making decisions about my child's care in the ED; (3) how the doctor discussed next steps and/or follow-up plans for my child's care after we leave the ED (P < 0.05). Additionally, postcourse, top-box score percentages were higher for 12 items, with 1 item achieving statistical significance (P = 0.0386). CONCLUSIONS: An organization-wide, pediatric-focused, relationship-centered communication course improved patient/caregiver-perceived ED physician communication. Further research is necessary to assess long-term sustainability.

Maintenance of Certification Pediatrics: Pediatric Emergency Medicine (PEM): The New Part 3 Maintenance of Certification Assessment Option.

ABSTRACT: Starting in 2022, the American Board of Pediatrics will launch the Maintenance of Certification Assessment for Pediatrics: Pediatric Emergency Medicine (MOCA-Peds: PEM) longitudinal assessment, which will provide an at-home alternative to the point-in-time examination. This longitudinal assessment will help engage PEM physicians participating in continuing certification in a more flexible and continuous lifelong, self-directed learning process while still providing a summative assessment of their knowledge. This commentary provides background information on MOCA-Peds and an introduction to MOCA-Peds: PEM and how it gives the PEM physician another option to participate in continuing certification.

Emergency Medicine Providers' Knowledge and Management of Pediatric Tropical Diseases: A Needs Assessment.

OBJECTIVE: The aim of this study was to perform a needs assessment of pediatric (PEM) and general emergency medicine (EM) provider knowledge, comfort, and current practice patterns in the evaluation of pediatric tropical infectious diseases. METHODS: An online survey was developed based on educational priorities identified by an expert panel via modified Delphi methodology. The survey included assessment of providers' typical evaluation, diagnosis, and treatment of tropical diseases and was distributed to PEM and EM providers in 2 large professional organizations. RESULTS: A total of 333 physicians (285 PEM, 32 EM, 8 combined PEM/EM, and 8 general pediatricians in emergency department) participated. Fifty-five percent of vignettes were answered correctly. Those who trained outside the United States or Canada (odds ratio [OR], 1.8; 95% confidence interval [CI], 1.1-3.0) and PEM-trained providers (OR, 2.6; 95% CI, 1.2-5.9) were more likely to answer questions correctly. Providers answered more questions correctly about dengue (76%) and tuberculosis (77%) than typhoid (53%) and malaria (39%) (OR, 3.8; 95% CI, 3.0-4.9). Diagnostic evaluation for tropical diseases was variable with greater than 75% agreement for only 2 tests: blood smears in febrile patients from Africa (86%) and bacterial stool cultures in patients with bloody stools from Africa, Asia, or Latin America (94%). Providers had low (62%) or medium (35%) comfort level with pediatric tropical diseases, and 93% were interested in accessing emergency department-specific resources. CONCLUSIONS: Pediatric EM and EM providers' knowledge and evaluation for pediatric tropical diseases are variable. Providers recognized their knowledge gaps and expressed interest in gaining access to resources and guidelines to standardize and improve evaluation and treatment of these diseases.

Improved Team Performance During Pediatric Resuscitations After Rapid Cycle Deliberate Practice Compared With Traditional Debriefing: A Pilot Study.

INTRODUCTION: Simulation-based medical education (SBME) improves medical knowledge compared with no intervention. In traditional SBME, more time is spent debriefing than practicing skills. Rapid cycle deliberate practice (RCDP) simulation allows learners to practice skills repetitively, receive brief interspersed feedback, and has been shown to improve individual performance of resuscitation skills in simulation; it has not been compared with traditional simulation methods. OBJECTIVE: The aim of the study was to compare traditional and RCDP SBME. METHODS: Four pediatric resuscitation cases (3 for teaching and 1 for testing) were developed. For the RCDP arm, traditional cases were deconstructed into sequences of progressively difficult rounds. The last RCDP round served as the traditional arm scenario.Learners received 1 type of instruction on 2 separate days. Pretest and posttest performance during simulation were video recorded and scored using the Simulation Team Assessment Tool; satisfaction surveys were collected. RESULTS: Pretest team performance was similar in both groups. Simulation Team Assessment Tool score improvement for RCDP was 7.2% (95% confidence interval, 3.4% to 11%) and traditional was 0.8% (95% confidence interval, -11% to 13%). The difference in improvement of the human factors subscore was statistically significant; RCDP improved 10.2% and traditional improved 1.7% (P = 0.013). The RCDP technique was well received by learners but caused fatigue. CONCLUSIONS: This pilot study showed a trend toward greater improvement in team performance and significantly greater improvement for human factors with RCDP compared with traditional simulation. Future studies comparing RCDP with other methods are needed to identify best practices and applications of RCDP, including which learners and learning objectives are best suited to RCDP.

Pediatric Emergency Medicine Online Curriculum Improves Resident Knowledge Scores, But Will They Use It?

OBJECTIVE: Shift work on a pediatric emergency medicine (PEM) rotation makes didactic scheduling difficult, thereby limiting teaching opportunities. These constraints make this rotation an ideal setting to supplement resident education with an online curriculum. We aimed to determine if implementation of an online curriculum during a resident PEM rotation improves posttest performance and increases satisfaction with resident educational experience. METHODS: This was a prospective before/after study of pediatric and emergency medicine residents on a 1-month rotation in a tertiary care pediatric emergency department. A curriculum was developed consisting of 17 online modules. In the first 5 months of the study, 42 control residents received traditional bedside teaching. In the last 12 months, 80 intervention residents completed at least 8 modules during their rotation. Both groups completed a pretest at rotation start and a posttest and end-of-rotation survey at rotation end. RESULTS: Control group pretest and posttest scores were not significantly different. In the intervention group, posttest scores were significantly increased compared with pretest scores (68 vs 59, P < 0.01). A low percentage of residents completed the study. Only 42% of the 189 residents enrolled in the intervention group completed the posttest and 28% completed the survey. CONCLUSIONS: Implementing an online PEM curriculum significantly improved knowledge. As residency programs face new duty hour requirements, online curricula may provide an effective way to supplement teaching. However, to capitalize on this self-directed curriculum, the low participation rates in this study suggest we must first determine and establish ways to overcome barriers to online learning.

Continuing Medical Education for Air Medical Providers: The Successes and Challenges.

OBJECTIVE: Research has shown that patients transported by nonpediatric teams have higher rates of morbidity and mortality. There is currently a paucity of pediatric standardized ongoing medical education for emergency medical service providers, thus we aimed to develop a model curriculum to increase their knowledge regarding pediatric respiratory distress and failure. METHODS: The curriculum was based on the Kolb Learning Cycle to optimize learning. Target learners were flight nurses (registered nurse) and emergency medical technicians of a private helicopter emergency transport team. The topics included were pediatric stridor, wheezing, and respiratory failure. Online modules were developed for continued spaced education. Knowledge gained from the interventions was measured by precurricular and postcurricular testing and compared with paired t tests. A linear mixed regression model was used to investigate covariates of interest. RESULTS: Sixty-two learners attended the workshop. Fifty-nine learners completed both precurricular and postcurricular testing. The mean increase between pretest and posttest scores was 12.1% (95% confidence interval, 9.4, 14.8; P < 0.001). Type of licensure (private emergency medical technician vs registered nurse) and number of years experience had no association with the level of knowledge gained. Learners who had greater than 1 year of pediatric transport experience scored higher on their pretests. There was no significant retention shown by those who participated in spaced education. CONCLUSIONS: The curriculum was associated with a short term increased knowledge regarding pediatric respiratory distress and failure for emergency helicopter transport providers and could be used as an alternative model to develop standardized ongoing medical education in pediatrics. Further work is needed to achieve knowledge retention in this learner population.

Essentials of Pediatric Emergency Medicine Fellowship: Part 1: An Overview.

This article is the first in a 7-part series (Table 1) that aims to comprehensively describe the current state and future directions of pediatric emergency medicine fellowship training from the essential requirements to considerations for successfully administering and managing a program to the careers that may be anticipated on program completion. This overview article provides a framework for the series.

A Novel Approach to Combining Pediatric Emergency Medicine and Global Health Fellowships.

OBJECTIVES: To describe the creation of the first known combined Pediatric Emergency Medicine-Global Health (PEM-GH) fellowship for graduates of pediatric or emergency medicine residency programs. METHODS: We detail the necessary infrastructure for a successfully combined PEM-GH fellowship including goals, objectives, curriculum, timeline, and funding. The fellowship is jointly supported by the department of pediatrics, section of pediatric emergency medicine (PEM), and the hospital. Fellows complete all requirements for the PEM fellowship and Global Health, the latter requiring an additional 12 months of training. Components of the Global Health fellowship include international fieldwork, scholarly activity abroad, advanced degree coursework, disaster training, and didactic curricula. RESULTS: Since 2005, 9 fellows (8 pediatric-trained and 1 emergency medicine-trained) have completed or are enrolled in the PEM-GH fellowship; 3 have graduated. All fellows have completed or are working toward advanced degrees and have or will participate in the disaster management course. Fellows have had 7 presentations at national or international meetings and have published 6 articles in peer-reviewed journals. Of the three graduates, all are working in academic PEM-GH programs and work internationally in Africa and/or Latin America. CONCLUSIONS: Our response to a global trend toward improvement in PEM care was the development of the first combined PEM-GH fellowship program. Recognizing the value of this program within our own institution, we now offer it as a model for building such programs in the future. This fellowship program promises to be a paradigm that can be used nationally and internationally, and it establishes a foundation for a full-fledged accredited and certified subspecialty.

Essentials of Pediatric Emergency Medicine Fellowship: Part 6: Program Administration.

This article is the sixth in a 7-part series that aims to comprehensively describe the current state and future directions of pediatric emergency medicine (PEM) fellowship training from the essential requirements to considerations for successfully administering and managing a program to the careers that may be anticipated upon program completion. This article provides a broad overview of administering and supervising a PEM fellowship program. It explores 3 topics: the principles of program administration, committee management, and recommendations for minimum time allocated for PEM fellowship program directors to administer their programs.

Essentials of PEM Fellowship Part 2: The Profession in Entrustable Professional Activities.

This article is the second in a 7-part series that aims to comprehensively describe the current state and future directions of pediatric emergency medicine (PEM) fellowship training from the essential requirements to considerations for successfully administering and managing a program to the careers that may be anticipated upon program completion. This article describes the development of PEM entrustable professional activities (EPAs) and the relationship of these EPAs with existing taxonomies of assessment and learning within PEM fellowship. It summarizes the field in concepts that can be taught and assessed, packaging the PEM subspecialty into EPAs.

A novel briefing checklist at shift handoff in an emergency department improves situational awareness and safety event identification.

OBJECTIVES: Emergency department (ED) shift handoffs are sources of potential medical error, delays in care, and medicolegal liabilities. Few handoff studies exist in the ED literature. We aimed to describe the implementation of a standardized checklist for improving situational awareness during physician handoffs in a pediatric ED. METHODS: This is a descriptive observational study in a large academic pediatric ED. Checklists were evaluated for rates of use, completion, and identification of potential safety events. We defined a complete checklist as 80% or more of items checked. A user perception survey was used. After 1 year, all checklist users (residents, fellows, faculty, and charge nurses with ED experience before and after checklist implementation) were anonymously surveyed to assess the checklist's usability, perceived contributions to Institute of Medicine quality domains, and situational awareness. The electronically administered survey used Likert frequency scales. RESULTS: Of 732 handoffs, 98% used the checklist, and 89% were complete. A mean of 1.7 potential safety events were identified per handoff. The most frequent potential safety events were identification of intensive care unit-level patients in the ED (48%), equipment problems (46%), staffing issues (21%), and intensive care unit-level patients in transport (16%). Eighty-one subjects (88%) responded to the survey. The users agreed that the checklist promoted better communication, safety, efficiency, effective care, and situational awareness. CONCLUSIONS: The Physician Active Shift Signout in the Emergency Department briefing checklist was used often and at a high completion rate, frequently identifying potential safety events. The users found that it improved the quality of care and team communication. Future studies on outcomes and processes are needed.

Implementing Entrustable Professional Activities in Pediatric Fellowships: Facilitating the Process.

BACKGROUND AND OBJECTIVES: Entrustable professional activities (EPAs) will be used for initial certification by the American Board of Pediatrics by 2028. Less than half of pediatric fellowships currently use EPAs for assessment, yet all will need to adopt them. Our objectives were to identify facilitators and barriers to the implementation of EPAs to assess pediatric fellows and to determine fellowship program directors' (FPD) perceptions of EPAs and Milestones. METHODS: We conducted a survey of FPDs from 15 pediatric subspecialties. EPA users were asked about their implementation of EPAs, barriers encountered, and perceptions of EPAs. Nonusers were queried about deterrents to using EPAs. Both groups were asked about potential facilitators of implementation and their perceptions of Milestones. RESULTS: The response rate was 65% (575/883). Of these, 344 (59.8%) were EPA users and 231 (40.2%) were nonusers. Both groups indicated work burden as a barrier to implementation. Nonusers reported more barriers than users (mean [SD]: 7 [3.8] vs 5.8 [3.4], P < .001). Both groups identified training materials and premade assessment forms as facilitators to implementation. Users felt that EPAs were easier to understand than Milestones (89%) and better reflected what it meant to be a practicing subspecialty physician (90%). In contrast, nonusers felt that Milestones were easy to understand (57%) and reflected what it meant to be a practicing subspecialist (58%). CONCLUSIONS: Implementing EPA-based assessment will require a substantial investment by FPDs, facilitated by guidance and easily accessible resources provided by multiple organizations. Perceived barriers to be addressed include FPD time constraints, a need for additional assessment tools, and outcomes data.

Fellow Entrustment for the Common Pediatric Subspecialty Entrustable Professional Activities Across Subspecialties.

OBJECTIVE: To determine the relationship between level of supervision (LOS) ratings for the Common Pediatric Subspecialty Entrustable Professional Activities (EPAs) with their associated subcompetency milestones across subspecialties and by fellowship training year. METHODS: Clinical Competency Committees (CCCs) in 14 pediatric subspecialties submitted LOS ratings for 6 Common Subspecialty EPAs and subcompetency milestone levels mapped to these EPAs. We examined associations between these subcompetency milestone levels and LOS ratings across subspecialty training year by fitting per-EPA linear mixed effects models, regressing LOS rating on milestone level and on training year. RESULTS: CCCs from 211 pediatric fellowship programs provided data for 369 first, 336 second, and 331 third year fellows. Mean subcompetency milestone levels increased similarly among subspecialties for most EPAs compared with the reference, Adolescent Medicine. Mean subcompetency milestones mapped to each EPA and mean EPA LOS ratings generally increased by training year across all subspecialties. CONCLUSIONS: Subcompetency milestones levels mapped to each Common Subspecialty EPA and the EPA LOS ratings increase similarly across subspecialties and by training year, providing validity evidence for using EPA LOS to assess pediatric subspecialty trainee performance. This study supports the development of tools to facilitated the CCC evaluation process across all pediatric subspecialties.

Efficacy of a near-infrared light device in pediatric intravenous cannulation: a randomized controlled trial.

OBJECTIVES: To determine whether the use of a near-infrared light venipuncture aid (VeinViewer; Luminetx Corporation, Memphis, Tenn) would improve the rate of successful first-attempt placement of intravenous (IV) catheters in a high-volume pediatric emergency department (ED). METHODS: Patients younger than 20 years with standard clinical indications for IV access were randomized to have IV placement by ED nurses (in 3 groups stratified by 5-year blocks of nursing experience) using traditional methods (standard group) or with the aid of the near-infrared light source (device group). If a vein could not be cannulated after 3 attempts, patients crossed over from one study arm to the other, and study nurses attempted placement with the alternative technique. The primary end point was first-attempt success rate for IV catheter placement. After completion of patient enrollment, a questionnaire was completed by study nurses as a qualitative assessment of the device. RESULTS: A total of 123 patients (median age, 3 years) were included in the study: 62 in the standard group and 61 in the device group. There was no significant difference in first-attempt success rate between the standard (79.0%, 95% confidence interval [CI], 66.8%-88.3%) and device (72.1%, 95% CI, 59.2%-82.9%) groups. Of the 19 study nurses, 14 completed the questionnaire of whom 70% expressed neutral or unfavorable assessments of the device in nondehydrated patients without chronic underlying medical conditions and 90% found the device a helpful tool for patients in whom IV access was difficult. CONCLUSIONS: First-attempt success rate for IV placement was nonsignificantly higher without than with the assistance of a near-infrared light device in a high-volume pediatric ED. Nurses placing IVs did report several benefits to use of the device with specific patient groups, and future research should be conducted to demonstrate the role of the device in these patients.

Design of a point-of-care ultrasound curriculum for pediatric emergency medicine fellows: A Delphi study.

OBJECTIVES: There has been a steady increase in the growth and utilization of point-of-care ultrasound (POCUS) in pediatric emergency medicine (PEM). POCUS has been established as an Accreditation Council for Graduate Medical Education (ACGME) core requirement for accreditation of PEM fellowship programs. Despite this requirement, training guidelines regarding POCUS knowledge and skills have yet to be developed. The purpose of this project was to develop a curriculum and a competency checklist for PEM fellow POCUS education. METHODS: We formed a core leadership group based on expertise in one or more key areas: PEM, POCUS, curriculum development, or Delphi methods. We recruited 29 PEM POCUS or ultrasound education experts from North America to participate in a three-round electronic Delphi project. The first Delphi round asked experts to generate a list of the core POCUS knowledge and skills that a PEM fellow would need during training to function as an autonomous practitioner. Subsequent rounds prioritized the list of knowledge and skills, and the core leadership group organized knowledge and skills into global competencies and subcompetencies. RESULTS: The first Delphi round yielded 61 POCUS areas of knowledge and skills considered important for PEM fellow learning. After two subsequent Delphi rounds, the list of POCUS knowledge and skills was narrowed to 38 items that addressed elements of six global competencies. The core leadership group then revised items into subcompetencies and categorized them under global competencies, developing a curriculum that defined the scope (depth of content) and sequence (order of teaching) of these POCUS knowledge and skill items. CONCLUSIONS: This expert, consensus-generated POCUS curriculum provides detailed guidance for PEM fellowships to incorporate POCUS education into their programs. Our curriculum also identifies core ultrasound knowledge and skills needed by PEM fellows to perform the specific POCUS applications recommended in prior publications.

Development of a novel pediatric point-of-care ultrasound question bank using a modified Delphi process.

BACKGROUND AND OBJECTIVES: Measuring pediatric emergency medicine (PEM) fellow competency in point-of-care ultrasound (POCUS) is important for ensuring adequate training and performance. Assessment may include direct observation, image review, quality assessment, and written examination. The purpose of this study was to develop a pediatric POCUS question bank that could subsequently be used as a POCUS assessment for graduating PEM fellows. METHODS: We organized a 10-person question writing group (QWG). Eight hold expertise in POCUS and two hold expertise in medical education. Members of the QWG created questions within four domains: interpretation/diagnosis (50% of questions), anatomy (30%), physics (10%), and pitfalls (10%). POCUS faculty ascertained content validity and the medical education faculty revised questions for syntax and readability. In 2016, we recruited 31 pediatric POCUS experts. The majority were members of the P2 Network, an international group of experts and leaders in PEM POCUS, to participate in three iterative rounds of a modified Delphi process to review, revise, and establish consensus on the question bank. RESULTS: Thirty-one pediatric POCUS experts participated in the three rounds of the modified Delphi process and evaluated 437 questions developed by the expert panel. Forty-nine percent (n = 216) of the questions were accepted in round 1, 30% (n = 130) in round 2, and 11% (n = 47) in the final round. The final question bank included 393 questions covering 17 pediatric POCUS applications. CONCLUSION: We developed a 393-question bank to aid in the assessment of PEM POCUS competency. Future work includes piloting the questions with PEM fellows to evaluate the response process and implementing the assessment tool to establish a minimum passing score.