Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment.

BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment. OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale. RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05). CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.

Pediatric Emergency Medicine Fellowship Program Directors' Viewpoint: Minimum Levels of Entrustment for Graduating Fellows and Practicing Physicians to Perform the Subspecialty's Professional Activities.

OBJECTIVES: Entrustable Professional Activities (EPAs) are essential tasks physicians perform within their professions. Entrustment levels that pediatric emergency medicine (PEM) fellowship program directors (FPDs) expect graduating fellows to achieve for PEM-specific and common pediatric subspecialty EPAs remain unreported. This study aims to determine minimum entrustment levels FPDs require fellows to achieve to graduate from fellowship and to compare FPD expectations for fellows versus practicing PEM physicians. METHODS: Secondary analysis of PEM-specific data from a national multispecialty cross-sectional survey of pediatric subspecialty FPDs. For 6 PEM-specific and 7 common pediatric subspecialty EPAs, PEM FPDs indicated (1) minimum entrustment levels fellows should achieve by training completion, (2) whether they would allow a fellow to graduate below these minimum levels, and (3) minimum levels for safe and effective practice by PEM physicians. Minimum levels were defined as the level that more than 80% of FPDs would not drop below. RESULTS: Sixty of 77 PEM FPDs (78%) completed the survey. Most respondents did not require fellows to achieve the highest level (level 5-no supervision) by graduation for any PEM-specific EPAs. The median level FPDs expected for practicing PEM physicians was 5 (trusted to perform without supervision) for EPAs 1 and 4 and level 4 (indirect supervision for complex cases) for the remaining PEM-specific EPAs. Minimum levels expected by FPDs for common subspecialty pediatric EPAs were lower for both groups. CONCLUSIONS: Most PEM FPDs indicated that they would graduate fellows before their achievement of the highest entrustment level for all EPAs. Most also indicated that they do not expect practicing PEM physicians to perform all EPAs without supervision. These findings indicate need for stakeholders to evaluate current structure and outcomes of PEM fellowship programs and for institutions and organizations to ensure adequate support in time and resources for ongoing learning for practicing PEM physicians.

Fellow Entrustment for the Common Pediatric Subspecialty Entrustable Professional Activities Across Subspecialties.

OBJECTIVE: To determine the relationship between level of supervision (LOS) ratings for the Common Pediatric Subspecialty Entrustable Professional Activities (EPAs) with their associated subcompetency milestones across subspecialties and by fellowship training year. METHODS: Clinical Competency Committees (CCCs) in 14 pediatric subspecialties submitted LOS ratings for 6 Common Subspecialty EPAs and subcompetency milestone levels mapped to these EPAs. We examined associations between these subcompetency milestone levels and LOS ratings across subspecialty training year by fitting per-EPA linear mixed effects models, regressing LOS rating on milestone level and on training year. RESULTS: CCCs from 211 pediatric fellowship programs provided data for 369 first, 336 second, and 331 third year fellows. Mean subcompetency milestone levels increased similarly among subspecialties for most EPAs compared with the reference, Adolescent Medicine. Mean subcompetency milestones mapped to each EPA and mean EPA LOS ratings generally increased by training year across all subspecialties. CONCLUSIONS: Subcompetency milestones levels mapped to each Common Subspecialty EPA and the EPA LOS ratings increase similarly across subspecialties and by training year, providing validity evidence for using EPA LOS to assess pediatric subspecialty trainee performance. This study supports the development of tools to facilitated the CCC evaluation process across all pediatric subspecialties.

Achieving Entrustable Professional Activities During Fellowship.

BACKGROUND AND OBJECTIVES: Entrustable Professional Activities (EPAs) were developed to assess pediatric fellows. We previously showed that fellowship program directors (FPDs) may graduate fellows who still require supervision. How this compares with their expectations for entrustment of practicing subspecialists is unknown. METHODS: We surveyed US FPDs in 14 pediatric subspecialties through the Subspecialty Pediatrics Investigator Network between April and August 2017. For each of 7 common pediatric subspecialty EPAs, we compared the minimum level of supervision that FPDs required for graduation with the level they expected of subspecialists for safe and effective practice using the Friedman rank sum test and paired t test. We compared differences between subspecialties using linear regression. RESULTS: We collected data from 660 FPDs (response rate 82%). For all EPAs, FPDs did not require fellows to reach the level of entrustment for graduation that they expected of subspecialists to practice (P < .001). FPDs expected the least amount of supervision for the EPAs consultation and handovers. Mean differences between supervision levels for graduation and practice were smaller for clinical EPAs (consultation, handovers, lead a team) when compared with nonclinical EPAs (quality improvement, management, lead the profession and scholarship; P = .001) and were similar across nearly all subspecialties. CONCLUSIONS: Fellowship graduates may need continued development of clinical and nonclinical skills in their early practice period, underscoring a need for continued assessment and mentoring. Graduation readiness must be based on clear requirements, with alignment of FPD expectations and regulatory standards, to ensure quality care for patients.

Impact of a Pediatric-Focused Communication Course on Patient/Caregiver-Perceived Physician Communication Skills in a Pediatric Emergency Department.

OBJECTIVES: To evaluate the impact of a pediatric-focused, relationship-centered communication course on patient/caregiver assessment of emergency department (ED) physician communication skills. METHODS: This was a prospective study; a previously validated assessment tool (Pediatric Physician Interpersonal Communication Skills Assessment [P-PICSA]) was used to collect pediatric patient/caregiver evaluation of ED physician communication skills. Emergency department physicians were required to attend a 5.5-hour communication course. Differences in precourse/postcourse P-PICSA and top-box scores were analyzed to determine course impact on ED physician communication skills. RESULTS: From July 2016 to August 2017, 49 pediatric ED physicians participated in the course, and 24 physicians (49%) had 6-month precourse/postcourse P-PICSA data. Postcourse scores were higher for all 13 items, with 3 items achieving statistical significance: (1) the doctor used words I could understand; (2) the way the doctor involved me in making decisions about my child's care in the ED; (3) how the doctor discussed next steps and/or follow-up plans for my child's care after we leave the ED (P < 0.05). Additionally, postcourse, top-box score percentages were higher for 12 items, with 1 item achieving statistical significance (P = 0.0386). CONCLUSIONS: An organization-wide, pediatric-focused, relationship-centered communication course improved patient/caregiver-perceived ED physician communication. Further research is necessary to assess long-term sustainability.

Focused Research Infrastructure for Postgraduate Pediatric Emergency Medicine Fellows Increases Dissemination of Scholarly Work.

BACKGROUND: Many fellows in clinically driven subspecialties may have difficulty completing and publishing their scholarly projects due to lack of prior experience in research, selection of projects that are difficult to complete during fellowship, or mentorship challenges. This may be particularly true in pediatric emergency medicine (PEM) because research time may be longitudinally integrated with clinical rotations, rather than blocked as is common in other subspecialties. We describe the creation and outcomes of a structured program to increase academic productivity of PEM fellows. METHODS: This was a retrospective cohort study of scholarly productivity (publications in peer-reviewed journals, presentation at national meetings) for PEM fellows over 17 years in one fellowship program, before and after the implementation of a structured program. We reviewed obstacles to publication for prior fellow projects when developing the curriculum. Our multifaceted program consisted of milestone development, four in-person committee meetings, and abstract and manuscript development workshops. We utilized existing faculty members, most of whom were junior faculty, as committee members. Our primary outcome was the percentage of fellows who were first authors for peer-reviewed publications for their fellowship projects. National conference presentations were the secondary outcome. RESULTS: Data for 76 PEM fellows were eligible for analysis: 44 (58%) before and 32 after programmatic implementation. There was a statistically significant increase in the percentage of fellows who published their studies (32% vs. 63%; odds ratio [OR] = 3.6, 95% confidence interval [CI] = 1.4 to 9.3) after programmatic implementation. There were no differences in conference presentations (45% vs. 63%; OR = 2.0, 95% CI = 0.8-5.1) after implementation. CONCLUSIONS: Utilizing a small group of existing, predominantly junior faculty members, we created a structured program that enhanced PEM fellows' scholarly productivity and increased publications. We believe that this model is sustainable for and generalizable to other PEM fellowship programs.

Emergency Medicine Providers' Knowledge and Management of Pediatric Tropical Diseases: A Needs Assessment.

OBJECTIVE: The aim of this study was to perform a needs assessment of pediatric (PEM) and general emergency medicine (EM) provider knowledge, comfort, and current practice patterns in the evaluation of pediatric tropical infectious diseases. METHODS: An online survey was developed based on educational priorities identified by an expert panel via modified Delphi methodology. The survey included assessment of providers' typical evaluation, diagnosis, and treatment of tropical diseases and was distributed to PEM and EM providers in 2 large professional organizations. RESULTS: A total of 333 physicians (285 PEM, 32 EM, 8 combined PEM/EM, and 8 general pediatricians in emergency department) participated. Fifty-five percent of vignettes were answered correctly. Those who trained outside the United States or Canada (odds ratio [OR], 1.8; 95% confidence interval [CI], 1.1-3.0) and PEM-trained providers (OR, 2.6; 95% CI, 1.2-5.9) were more likely to answer questions correctly. Providers answered more questions correctly about dengue (76%) and tuberculosis (77%) than typhoid (53%) and malaria (39%) (OR, 3.8; 95% CI, 3.0-4.9). Diagnostic evaluation for tropical diseases was variable with greater than 75% agreement for only 2 tests: blood smears in febrile patients from Africa (86%) and bacterial stool cultures in patients with bloody stools from Africa, Asia, or Latin America (94%). Providers had low (62%) or medium (35%) comfort level with pediatric tropical diseases, and 93% were interested in accessing emergency department-specific resources. CONCLUSIONS: Pediatric EM and EM providers' knowledge and evaluation for pediatric tropical diseases are variable. Providers recognized their knowledge gaps and expressed interest in gaining access to resources and guidelines to standardize and improve evaluation and treatment of these diseases.

Improved Team Performance During Pediatric Resuscitations After Rapid Cycle Deliberate Practice Compared With Traditional Debriefing: A Pilot Study.

INTRODUCTION: Simulation-based medical education (SBME) improves medical knowledge compared with no intervention. In traditional SBME, more time is spent debriefing than practicing skills. Rapid cycle deliberate practice (RCDP) simulation allows learners to practice skills repetitively, receive brief interspersed feedback, and has been shown to improve individual performance of resuscitation skills in simulation; it has not been compared with traditional simulation methods. OBJECTIVE: The aim of the study was to compare traditional and RCDP SBME. METHODS: Four pediatric resuscitation cases (3 for teaching and 1 for testing) were developed. For the RCDP arm, traditional cases were deconstructed into sequences of progressively difficult rounds. The last RCDP round served as the traditional arm scenario.Learners received 1 type of instruction on 2 separate days. Pretest and posttest performance during simulation were video recorded and scored using the Simulation Team Assessment Tool; satisfaction surveys were collected. RESULTS: Pretest team performance was similar in both groups. Simulation Team Assessment Tool score improvement for RCDP was 7.2% (95% confidence interval, 3.4% to 11%) and traditional was 0.8% (95% confidence interval, -11% to 13%). The difference in improvement of the human factors subscore was statistically significant; RCDP improved 10.2% and traditional improved 1.7% (P = 0.013). The RCDP technique was well received by learners but caused fatigue. CONCLUSIONS: This pilot study showed a trend toward greater improvement in team performance and significantly greater improvement for human factors with RCDP compared with traditional simulation. Future studies comparing RCDP with other methods are needed to identify best practices and applications of RCDP, including which learners and learning objectives are best suited to RCDP.

Validity of Level of Supervision Scales for Assessing Pediatric Fellows on the Common Pediatric Subspecialty Entrustable Professional Activities.

PURPOSE: Entrustable professional activities (EPAs) represent the routine and essential activities that physicians perform in practice. Although some level of supervision scales have been proposed, they have not been validated. In this study, the investigators created level of supervision scales for EPAs common to the pediatric subspecialties and then examined their validity in a study conducted by the Subspecialty Pediatrics Investigator Network (SPIN). METHOD: SPIN Steering Committee members used a modified Delphi process to develop unique scales for six of the seven common EPAs. The investigators sought validity evidence in a multisubspecialty study in which pediatric fellowship program directors and Clinical Competency Committees used the scales to evaluate fellows in fall 2014 and spring 2015. RESULTS: Separate scales for the six EPAs, each with five levels of progressive entrustment, were created. In both fall and spring, more than 300 fellows in each year of training from over 200 programs were assessed. In both periods and for each EPA, there was a progressive increase in entrustment levels, with second-year fellows rated higher than first-year fellows (P < .001) and third-year fellows rated higher than second-year fellows (P < .001). For each EPA, spring ratings were higher (P < .001) than those in the fall. Interrater reliability was high (Janson and Olsson's iota = 0.73). CONCLUSIONS: The supervision scales developed for these six common pediatric subspecialty EPAs demonstrated strong validity evidence for use in EPA-based assessment of pediatric fellows. They may also inform the development of scales in other specialties.

Creation and Assessment of a Bad News Delivery Simulation Curriculum for Pediatric Emergency Medicine Fellows.

Background  Bad news in the context of health care has been broadly defined as significant information that negatively alters people's perceptions of the present or future. Effectively delivering bad news (DBN) in the setting of the emergency department requires excellent communication skills. Evidence shows that bad news is frequently given inadequately. Studies show that trainees need to devote more time to developing this skill through formalized training. This program's objectives were to utilize trained standardized patients in a simulation setting to assist pediatric emergency medicine (PEM) fellows in the development of effective, sensitive, and compassionate communication with patients and family members when conveying bad news, and to recognize and respond to the patient/parent's reaction to such news. Methods PEM fellows participated in a novel curriculum utilizing simulated patients (SPs) acting as the patient's parent and immersive techniques in a realistic and supportive environment. A baseline survey was conducted to ascertain participant demographics and previous experience with simulation and DBN. Experienced, multi-disciplinary faculty participated in a training workshop with the SPs one week prior to course delivery. Three scenarios were developed for bad news delivery. Instructors watched via remote video feed while the fellows individually interacted with the SPs and then participated in a confidential debriefing. Fellows later joined for group debriefing. Fellow characteristics, experience, and self-perceived comfort pre/post-course were collected.   Results Baseline data demonstrated that 78% of fellows reported DBN two or more times per month. Ninety-three percent of fellows in this study were present during the delivery of news about the death of a child to a parent or family member in the six-month period preceding this course. Fellows' self-reported comfort level in DBN to a patient/family and dealing with patient and parent emotions improved significantly (p=0.034 and p=0.046, respectively). Conclusions Pediatric emergency medicine fellows frequently deliver bad news. A course using SPs was well received by trainees and resulted in improvement in self-assessed skills and comfort. This curriculum provides the opportunity for fellows to receive patient/parent feedback of their communication skills and observations from skilled instructors. This methodology should be considered when creating training curricula for bad news delivery skills.

Continuing Medical Education for Air Medical Providers: The Successes and Challenges.

OBJECTIVE: Research has shown that patients transported by nonpediatric teams have higher rates of morbidity and mortality. There is currently a paucity of pediatric standardized ongoing medical education for emergency medical service providers, thus we aimed to develop a model curriculum to increase their knowledge regarding pediatric respiratory distress and failure. METHODS: The curriculum was based on the Kolb Learning Cycle to optimize learning. Target learners were flight nurses (registered nurse) and emergency medical technicians of a private helicopter emergency transport team. The topics included were pediatric stridor, wheezing, and respiratory failure. Online modules were developed for continued spaced education. Knowledge gained from the interventions was measured by precurricular and postcurricular testing and compared with paired t tests. A linear mixed regression model was used to investigate covariates of interest. RESULTS: Sixty-two learners attended the workshop. Fifty-nine learners completed both precurricular and postcurricular testing. The mean increase between pretest and posttest scores was 12.1% (95% confidence interval, 9.4, 14.8; P < 0.001). Type of licensure (private emergency medical technician vs registered nurse) and number of years experience had no association with the level of knowledge gained. Learners who had greater than 1 year of pediatric transport experience scored higher on their pretests. There was no significant retention shown by those who participated in spaced education. CONCLUSIONS: The curriculum was associated with a short term increased knowledge regarding pediatric respiratory distress and failure for emergency helicopter transport providers and could be used as an alternative model to develop standardized ongoing medical education in pediatrics. Further work is needed to achieve knowledge retention in this learner population.

A Novel Approach to Combining Pediatric Emergency Medicine and Global Health Fellowships.

OBJECTIVES: To describe the creation of the first known combined Pediatric Emergency Medicine-Global Health (PEM-GH) fellowship for graduates of pediatric or emergency medicine residency programs. METHODS: We detail the necessary infrastructure for a successfully combined PEM-GH fellowship including goals, objectives, curriculum, timeline, and funding. The fellowship is jointly supported by the department of pediatrics, section of pediatric emergency medicine (PEM), and the hospital. Fellows complete all requirements for the PEM fellowship and Global Health, the latter requiring an additional 12 months of training. Components of the Global Health fellowship include international fieldwork, scholarly activity abroad, advanced degree coursework, disaster training, and didactic curricula. RESULTS: Since 2005, 9 fellows (8 pediatric-trained and 1 emergency medicine-trained) have completed or are enrolled in the PEM-GH fellowship; 3 have graduated. All fellows have completed or are working toward advanced degrees and have or will participate in the disaster management course. Fellows have had 7 presentations at national or international meetings and have published 6 articles in peer-reviewed journals. Of the three graduates, all are working in academic PEM-GH programs and work internationally in Africa and/or Latin America. CONCLUSIONS: Our response to a global trend toward improvement in PEM care was the development of the first combined PEM-GH fellowship program. Recognizing the value of this program within our own institution, we now offer it as a model for building such programs in the future. This fellowship program promises to be a paradigm that can be used nationally and internationally, and it establishes a foundation for a full-fledged accredited and certified subspecialty.

Development and assessment of a pediatric emergency medicine simulation and skills rotation: meeting the demands of a large pediatric clerkship.

OBJECTIVE: To implement a curriculum using simulation and skills training to augment a Pediatric Emergency Medicine (PEM) rotation within a pediatric clerkship. BACKGROUND: PEM faculty are often challenged with a high learner to teacher ratio in a chaotic clinical setting. This challenge was heightened when our pediatric clerkship's traditional 1-week PEM rotation (consisting of 4 students completing four 8-hour ED shifts/week) expanded to 8 students every 2 weeks. We sought to meet this challenge by integrating simulation-based education into the rotation. METHODS: Clerkship students from March to June 2012 completed our traditional rotation. Students between July and October 2012 completed the new PEM-SIM curriculum with 19 hours ED shifts/week and 16 hours/week of simulation/skills training. Pre/post-tests evaluated 1) medical management/procedural comfort (five-point Likert scale); and 2) PEM knowledge (15 multiple-choice questions). RESULTS: One hundred and nine students completed the study (48 traditional, 61 PEM-SIM). Improvement in comfort was significantly higher for the PEM-SIM group than the traditional group for 6 of 8 (75%) medical management items (p<0.05) and 3 of 7 (43%) procedures, including fracture splinting, lumbar puncture, and abscess incision/drainage (p<0.05). PEM-SIM students had significantly more improvement in mean knowledge compared to the traditional group (p<0.001). CONCLUSIONS: We have successfully integrated 16 hours/week of faculty-facilitated simulation-based education into a PEM rotation within our clerkship. This curriculum is beneficial in clinical settings with high learner to teacher ratios and when patient care experiences alone are insufficient for all students to meet rotation objectives.

Investing in future pediatric subspecialists: a fellowship curriculum that prepares for the transition to academic careers.

BACKGROUND: The experience of transitioning to an academic faculty position can be improved with standardized educational interventions. Although a number of such interventions have been described, few utilize an evaluation framework, describe a robust evaluation process, and address why their interventions were successful. In this article, the authors apply a logic model to describe their efforts to develop, implement, evaluate, and revise a comprehensive academic career development curriculum among pediatric subspecialty fellows. They describe inputs, activities, outputs, and outcomes using quantitative data from fellow evaluations and qualitative data from faculty interviews. METHODS: Methods are described under the input and activities sections. The curriculum started with collaboration among educational leadership and conducting a needs assessment. Using the needs assessment results and targeted learning objectives, we piloted the curriculum and then implemented the full curriculum 1 year later. RESULTS: Results are described under the outputs and outcomes sections. We present immediate, short-term, and 6-month evaluation data. Cumulative data over 3 years reveal that fellows consistently acquired knowledge relevant to transitioning and that they applied acquired knowledge to prepare for finding jobs and career advancement. The curriculum also benefits faculty instructors who gain a sense of reward by filling a critical knowledge gap and fostering fellows' professional growth. CONCLUSION: The authors relate the success and effectiveness of the curriculum to principles of adult learning, and share lessons learned, including the importance of buy-in from junior and senior fellows and faculty, collaboration, and designating the time to teach and learn.

Mobile pediatric emergency response team: patient satisfaction during the novel H1N1 influenza outbreak.

OBJECTIVES: The objective was to determine child caregiver satisfaction with a nontraditional pediatric emergency department (ED) venue during the 2009 novel H1N1 influenza outbreak. METHODS: Between May 1 and 7, 2009, the Texas Children's Hospital (TCH) ED used a six-bed outdoor facility, the Mobile Pediatric Emergency Response Team (MPERT), to evaluate patients with suspected novel H1N1 influenza. Parents and caregivers of patients evaluated in the MPERT were surveyed by telephone using a validated questionnaire to evaluate satisfaction with the facility. RESULTS: Of 353 patients, 155 caregivers (44%) completed questionnaires; 127 had wrong numbers, 71 did not answer, and 15 were on a no-call list. Survey responders felt that nurses and doctors explained concepts well (nurses 92%, doctors 94%), 91% felt TCH prepared them well for taking care of their children at home, 94% were satisfied with the medical care received, and 88% were not bothered by the outdoor setting. When asked to rate their MPERT experience on a scale of 0 (worst possible) to 10 (best possible), the median score was 9 (range 1 to 10). CONCLUSIONS: The MPERT facility alleviated patient volume surge and potentially prevented transmission during H1N1 outbreak. While these were health care provider goals, caregiver expectations were also met. Caregivers perceived MPERT as an acceptable alternative to receiving care in the regular ED, felt that physicians and nurses communicated well, and felt that medical care was good to excellent. Use of the MPERT did not negatively affect overall caregiver satisfaction with TCH. These findings suggest that families of pediatric patients are amenable to nontraditional ED venues during periods of ED crowding.

Efficacy of a near-infrared light device in pediatric intravenous cannulation: a randomized controlled trial.

OBJECTIVES: To determine whether the use of a near-infrared light venipuncture aid (VeinViewer; Luminetx Corporation, Memphis, Tenn) would improve the rate of successful first-attempt placement of intravenous (IV) catheters in a high-volume pediatric emergency department (ED). METHODS: Patients younger than 20 years with standard clinical indications for IV access were randomized to have IV placement by ED nurses (in 3 groups stratified by 5-year blocks of nursing experience) using traditional methods (standard group) or with the aid of the near-infrared light source (device group). If a vein could not be cannulated after 3 attempts, patients crossed over from one study arm to the other, and study nurses attempted placement with the alternative technique. The primary end point was first-attempt success rate for IV catheter placement. After completion of patient enrollment, a questionnaire was completed by study nurses as a qualitative assessment of the device. RESULTS: A total of 123 patients (median age, 3 years) were included in the study: 62 in the standard group and 61 in the device group. There was no significant difference in first-attempt success rate between the standard (79.0%, 95% confidence interval [CI], 66.8%-88.3%) and device (72.1%, 95% CI, 59.2%-82.9%) groups. Of the 19 study nurses, 14 completed the questionnaire of whom 70% expressed neutral or unfavorable assessments of the device in nondehydrated patients without chronic underlying medical conditions and 90% found the device a helpful tool for patients in whom IV access was difficult. CONCLUSIONS: First-attempt success rate for IV placement was nonsignificantly higher without than with the assistance of a near-infrared light device in a high-volume pediatric ED. Nurses placing IVs did report several benefits to use of the device with specific patient groups, and future research should be conducted to demonstrate the role of the device in these patients.

Rubric evaluation of pediatric emergency medicine fellows.

OBJECTIVES: To develop and validate a rubric assessment instrument for use by pediatric emergency medicine (PEM) faculty to evaluate PEM fellows and for fellows to use to self-assess. METHODS: This is a prospective study at a PEM fellowship program. The assessment instrument was developed through a multistep process: (1) development of rubric format items, scaled on the modified Dreyfus model proficiency levels, corresponding to the 6 Accreditation Council for Graduate Medical Education core competencies; (2) determination of content and construct validity of the items through structured input and item refinement by subject matter experts and focus group review; (3) collection of data using a 61-item form; (4) evaluation of psychometrics; (5) selection of items for use in the final instrument. RESULTS: A total of 261 evaluations were collected from 2006 to 2007; exploratory factor analysis yielded 5 factors with Eigenvalues >1.0; each contained ≥4 items, with factor loadings >0.4 corresponding with the following competencies: (1) medical knowledge and practice-based learning and improvement, (2) patient care and systems-based practice, (3) interpersonal skills, (4) communication skills, and (5) professionalism. Cronbach α for the final 53-item instrument was 0.989. There was also significant responsiveness of the tool to the year of training. CONCLUSION: A substantively and statistically validated rubric evaluation of PEM fellows is a reliable tool for formative and summative evaluation.