Implicit Bias and Health Disparities Education in the Neonatal Intensive Care Unit.

OBJECTIVE: This study aimed to characterize implicit bias (IB) and health disparities (HD) education in neonatal-perinatal medicine (NPM), including current educational opportunities, resources, and barriers. STUDY DESIGN: A national web-based survey was sent to NPM fellows, neonatologists, and frontline providers after iterative review by education experts from the National Neonatology Curriculum Committee. Quantitative data were analyzed with chi-square and Fisher's exact tests. Qualitative data were evaluated using thematic analysis. RESULTS: Of the 452 NPM survey respondents, most desired additional IB (76%) and HD (83%) education. A greater proportion of neonatologists than fellows received IB (83 vs. 57%) and HD (87 vs. 74%) education. Only 41% of neonatologists reported that their institution requires IB training. A greater proportion of fellows than neonatologists expressed dissatisfaction with the current approaches for IB (51 vs. 25%, p < 0.001) and HD (43 vs. 25%, p = 0.015) education. The leading drivers of dissatisfaction included insufficient time spent on the topics, lack of specificity to NPM, inadequate curricular scope or depth, and lack of local educator expertise. A minority of faculty who were tasked to educate others have received specific educator training on IB (21%) and HD (16%). Thematic analysis of survey free-text responses identified three main themes on the facilitators and barriers to successful IB and HD education: individual, environmental, and curricular design variables. CONCLUSION: NPM trainees and neonatologists desire tailored, active, and expert-guided IB and HD education. Identified barriers are important to address in developing an effective IB/HD curriculum for the NPM community. KEY POINTS: · There is a gap between the current delivery of IB/HD education and the needs of the NPM community.. · NPM trainees and neonatologists desire tailored, active, and expert-guided IB and HD education.. · A successful curriculum should be widely accessible, NPM-specific, and include facilitator training..

Best Practices and Educator Strategies for Facilitating a Flipped Classroom in Graduate Medical Education.

OBJECTIVE: Effective flipped classroom (FC) education fosters learner engagement, promoting higher-level cognitive skills. FC learning in graduate medical education (GME) has increased, but few educators have significant experience with FC facilitation. There are no evidence-based practices to support professional development of FC facilitation skills in GME. The objective of this study is to identify best practices for effective FC facilitation in GME. STUDY DESIGN: We conducted a mixed-methods, cross-sectional study of faculty educators who participated in a randomized controlled trial (RCT) using FC for physiology education in neonatal-perinatal medicine. Educators completed a 25-question survey about effective strategies for FC facilitation. A subset of educators participated in interviews to share their FC facilitation experiences and strategies to maximize learner engagement. Quantitative survey data were analyzed with descriptive statistics. Qualitative survey and interview data were coded and analyzed inductively to identify themes. RESULTS: Seventy-five educators completed the survey (75/136, 55% response rate), and 11 participated in semistructured interviews. While educators facilitated a median of two FC sessions (interquartile range: 1, 5) during the RCT, 43 (57%) had not received prior training in FC facilitation. Qualitative data analyses generated five themes that aligned with quantitative survey results: (1) educator preferences, (2) unique FC facilitation skills, (3) learning environment optimization, (4) subject matter expertise, and (5) learner behavior management. Sixty-two educators (83%) felt they were well prepared to lead FC sessions. Thirty-six educators (48%) reported that unprepared learners disrupt the learning environment, and the provision of clear expectations and adequate time to prepare for FCs improves learner preparation. Strategies to facilitate effective FC sessions included creating a safe learning environment and engaging learners in critical thinking. CONCLUSION: Educators highlighted faculty development needs, strategies, and actions to promote effective FC facilitation. Further exploration through learner interviews will provide additional evidence for the development of best practices and resources for FC facilitation. KEY POINTS: · Educators prefer the FC educational modality over traditional didactic lectures.. · Prior experiences in simulation debriefing provide foundational skills for new FC facilitators.. · Setting learner expectations and ensuring safe space in the classroom encourage learner engagement.. · Educator and learner preparation for FC is essential to optimize the learning experience.. · Unique approaches in facilitation are required to support all types of learners..

Simulation-based Ultrasound Curriculum for Novice Clinicians to Assess Neonatal Endotracheal Tube Position.

Background: To evaluate the efficacy of a simulation-based mastery curriculum to train clinicians with limited-to-no sonography experience how to use ultrasound (US) to assess neonatal endotracheal tube (ETT) positioning. Methods: In a single-centered, prospective, educational study, 29 neonatology clinicians participated in a simulation-based mastery curriculum composed of a didactic lecture, followed by a one-on-one simulation session using a newly designed, three-dimensional (3D) printed US phantom model of the neonatal trachea and aorta. After mastery training, clinicians were evaluated with a performance checklist on their skills obtaining US images and assessing ETT positioning in the US phantom model. They also completed pre- and postcurriculum knowledge assessment tests and self-assessment surveys. The data were analyzed using Wilcoxon signed rank tests and repeated measures analysis of variance. Results: The mean checklist score improved significantly during three attempts (mean difference: 2.6552; 95% confidence interval [CI]: 2.2578-3.0525; P < 0.0001). The mean time to perform US decreased significantly from the first to third attempt (mean difference: -1.8276 min; 95% CI: -3.3391 to - 0.3161; P = 0.0196). In addition, there was a significant improvement in median knowledge assessment scores (50% vs. 80%; P < 0.0001) and survey ratings on knowledge and self-efficacy (P < 0.0001). Conclusion: Clinicians with limited-to-no sonography experience demonstrated improved knowledge and skill acquisition in using US to assess ETT positioning through simulation-based mastery training. The use of 3D modeling enhances simulation experiences and optimizes the quality of training during limited opportunities to achieve procedural competency in a controlled environment before further application into the clinical setting.

Flipping the Teachers: Impact of a Standardized Physiology Curriculum on Neonatology Medical Educators.

OBJECTIVE: Academic physicians must teach elements in an Accreditation Council for Graduate Medical Education (ACGME)-mandated curriculum while balancing career development and clinical workload. Exploring educator perceptions on the learning environment and comparing two instructional methods (traditional didactics [TD] vs. flipped classroom [FC]) in one pediatric subspecialty may elucidate current challenges, barriers, and strategies to optimize learning and educator satisfaction. STUDY DESIGN: A randomized trial comparing effectiveness and learner preference for FC versus TD physiology teaching was conducted in ACGME-accredited neonatal-perinatal medicine (NPM) fellowship programs in 2018 to 2019. Educator preferences were elicited through online surveys pre- and postintervention. Free-text comments were provided for questions exploring strengths, challenges, and opportunities in fellowship education. Statistical analysis included comparisons of demographics and pre-post-intervention educator responses between groups. Thematic analysis of text responses was conducted to identify common subthemes. RESULTS: From 61 participating programs, 114 FC educators and 130 TD educators completed surveys. At baseline, all educators experienced professional satisfaction from teaching fellows, but noted challenges with time available to create and/or deliver educational content, limited content expertise amongst faculty, colleagues' limited enthusiasm toward educating fellows, and lack of perceived value of education by institutions given limited protected time or credit toward promotion. Postintervention, educators in both groups noted a preference to teach physiology using FC due to interactivity, learner enthusiasm, and learner-centeredness. FC educators had a 17% increase in preference to teach using FC (p = 0.001). Challenges with FC included ensuring adequate trainee preparation, protecting educational time, and providing educators with opportunities to develop facilitation skills. CONCLUSION: Overall, NPM educators in a trial evaluating a standardized, peer-reviewed curriculum report professional satisfaction from teaching, but described logistical challenges with developing/delivering content. Educators preferred instruction using FC, but identified challenges with learner preparedness and ensuring adequate educator time and skill. Future efforts should be dedicated to addressing these barriers. KEY POINTS: · Many challenges exist for educators teaching neonatal-perinatal medicine fellows, including time, support, and recognition.. · Many educators preferred using flipped classroom methodology with a standardized curriculum due to interactivity and learner-centeredness.. · Benefits of a standardized, peer-reviewed curriculum include reduced preparation time, adaptability of content, and learning environment enhancement..

Comparison of a dichotomous versus trichotomous checklist for neonatal intubation.

BACKGROUND: To compare validity evidence for dichotomous and trichotomous versions of a neonatal intubation (NI) procedural skills checklist. METHODS: NI skills checklists were developed utilizing an existing framework. Experts were trained on scoring using dichotomous and trichotomous checklists, and rated recordings of 23 providers performing simulated NI. Videolaryngoscope recordings of glottic exposure were evaluated using Cormack-Lehane (CL) and Percent of Glottic Opening scales. Internal consistency and reliability of both checklists were analyzed, and correlations between checklist scores, airway visualization, entrustable professional activities (EPA), and global skills assessment (GSA) were calculated. RESULTS: During rater training, raters gave significantly higher scores on better provider performance in standardized videos (both p < 0.001). When utilized to evaluate study participants' simulated NI attempts, both dichotomous and trichotomous checklist scores demonstrated very good internal consistency (Cronbach's alpha 0.868 and 0.840, respectively). Inter-rater reliability was higher for dichotomous than trichotomous checklists [Fleiss kappa of 0.642 and 0.576, respectively (p < 0.001)]. Sum checklist scores were significantly different among providers in different disciplines (p < 0.001, dichotomous and trichotomous). Sum dichotomous checklist scores correlated more strongly than trichotomous scores with GSA and CL grades. Sum dichotomous and trichotomous checklist scores correlated similarly well with EPA. CONCLUSIONS: Neither dichotomous or trichotomous checklist was superior in discriminating provider NI skill when compared to GSA, EPA, or airway visualization assessment. Sum scores from dichotomous checklists may provide sufficient information to assess procedural competence, but trichotomous checklists may permit more granular feedback to learners and educators. The checklist selected may vary with assessment needs.

Value, Strengths, and Challenges of e-Learning Modules Paired with the Flipped Classroom for Graduate Medical Education: A Survey from the National Neonatology Curriculum.

OBJECTIVE: This study aimed to determine the value, strengths, and challenges of implementing an e-learning based flipped classroom (FC) educational modality as part of the standardized physiology National Neonatology Curriculum (NNC), created for neonatal-perinatal medicine (NPM) fellow learners and faculty educators. STUDY DESIGN: This is a cross-sectional study of NPM fellows and faculty educators who utilized at least one of the e-learning based NNC FC respiratory physiology programs between May and September 2018. Participants were surveyed anonymously regarding their experiences participating in the NNC, including measures of preparation time. A combination of descriptive statistics and proportion comparisons were used for data analysis. RESULTS: Among 172 respondents, the majority of fellow and faculty respondents reported positive attitudes toward the educational content and case discussions, and the majority supported national standardization of NPM physiology education (92%). Fellows reported greater preclass preparation for their FC compared with previous didactic lectures (30-60 vs. 0-15 minutes, p < 0.01). Faculty facilitators reported less preparation time before facilitating a FC compared with the time required for creating a new didactic lecture (median: 60 vs. 240 minutes, p < 0.01). Both fellows and faculty respondents preferred the FC approach to traditional didactics, with fellows showing a greater degree of preference than faculty (68 vs. 52%, respectively, p = 0.04). CONCLUSION: Fellows and faculty educators supported the FC learning, reporting peer-to-peer learning, and the establishment of a learning community which promotes adult learning and critical thinking skills. A national physiology curriculum creates equitable and engaging educational experiences for all NPM fellows while reducing individual program burden of content creation. Our findings further supported the development of an NNC using a flipped classroom modality.

Simulation in Neonatal-Perinatal Medicine Fellowship Programs.

OBJECTIVE: This study aimed to investigate the use of simulation in neonatal-perinatal medicine (NPM) fellowship programs. STUDY DESIGN: This was a cross-sectional survey of program directors (PDs) and simulation educators in Accreditation Council for Graduate Medical Education (ACGME) accredited NPM fellowship programs. RESULTS: Responses were received from 59 PDs and 52 simulation educators, representing 60% of accredited programs. Of responding programs, 97% used simulation, which most commonly included neonatal resuscitation (94%) and procedural skills (94%) training. The time and scope of simulation use varied significantly. The majority of fellows (51%) received ≤20 hours of simulation during training. The majority of PDs (63%) wanted fellows to receive >20 hours of simulation. Barriers to simulation included lack of faculty time, experience, funding, and curriculum. CONCLUSION: While the majority of fellowship programs use simulation, the time and scope of fellow exposure to simulation experiences are limited. The creation of a standardized simulation curriculum may address identified barriers to simulation.

Response to pulmonary vasodilators in infants with congenital diaphragmatic hernia.

BACKGROUND: Congenital diaphragmatic hernia (CDH) is associated with lung hypoplasia, cardiac dysfunction and pulmonary hypertension. Inhaled nitric oxide (iNO) and milrinone are commonly used pulmonary vasodilators in CDH. We studied the hemodynamic effects of iNO and milrinone in infants with CDH. METHODS: A retrospective chart review was performed of all CDH infants admitted to two regional perinatal centers and infants classified into three groups: No-iNO group; iNO-responders and iNO-nonresponders. Oxygenation and hemodynamic effects of iNO and milrinone were assessed by blood gases and echocardiography. RESULTS: Fifty-four percent (39/72) of infants with CDH received iNO and 31% of these infants (12/39) had complete oxygenation response to iNO. Oxygenation response to iNO was not associated with a decrease in right ventricular pressures (RVP) or ECMO use. Four infants (33%) in the iNO-responder group and eight infants (30%) in the iNO-nonresponder group received milrinone. Milrinone lowered RVP and improved ejection fraction (EF). Response to iNO was associated with improved oxygenation to milrinone and increased survival following ECMO (67 vs. 20% among nonresponders). CONCLUSIONS: Response to inhaled nitric oxide in combination with milrinone may be associated with improved oxygenation and better survival after ECMO in infants with CDH.

Simulation to Standardize Patient Care and Maintain Procedural Competency.

Simulation-based training is a means to teach procedural skills and to help advanced practice providers maintain procedural competency and credentialing. There is growing recognition of the importance of requiring providers to demonstrate competency of invasive procedures in a simulated environment prior to performing these high-risk procedures on patients. This article describes the development and implementation of the simulation procedural program at the University of Rochester Medical Center. In addition to contributing to the education of our providers, such a program can lead to improved patient quality, safety, and outcomes through the standardization of patient care. The innovative use of simulation can lead to effective heath care education and improvement in patient safety.

Simulation-based operations testing in new neonatal healthcare environments.

In situ simulations, those conducted in the actual clinical environment, confer a high level of contextual fidelity and have been applied to the operations testing of new healthcare environments (HCE) to identify potential threats to patient, family and staff safety. By conducting simulation-based operations testing, these latent safety threats (LSTs) - which are weaknesses in communications, human factors, system process and technologies, and the way they are linked together - can be identified and corrected prior to moving patients into the new HCE. Simulation-based operations testing has extended to the neonatal HCE, as neonatal intensive care units (NICUs) transition from open-bay to single-family room design. In this section, we define LSTs, review simulation-based operations testing in new neonatal and perinatal HCEs, review challenges associated with conducting simulation-based operations testing, and briefly review pre-construction simulation-based user-centered design of new HCEs.

What are LGBTQI+ parental experiences of healthcare support and decision-making regarding infant feeding options? A grounded theory study.

OBJECTIVE: To explore LGBTQI+ parental experiences regarding their interactions with healthcare professionals as a resource for feeding options during the prenatal-to-neonatal period. STUDY DESIGN: This single-center, interview-based qualitative study of LGBTQI+ parents utilized grounded theory to identify and verify emergent themes and subthemes. We developed a conceptual framework to illustrate relationships among themes and subthemes, as well as opportunities for healthcare professionals and families to improve LGBTQI+ parental support. RESULTS: Thematic saturation was attained after interviewing 21 parents from 12 families. Analyses revealed four main themes representing opportunities for improvement: education, continuity of care, parental engagement and open communication. Personal and interpersonal factors influenced parental experiences and decisions, which shaped ultimate feeding outcomes. CONCLUSIONS: LGBTQI+ parents revealed challenges of establishing feeding practices that best aligned with their values and goals. Recognizing these factors can help healthcare professionals improve their counseling, engagement and support of LGBTQI+ parents.

Fellows as Teachers: Supporting Future Educators.

Teaching is inherent to the practice of medicine, as physicians are relied on to educate those around them, including staff, trainees, colleagues, and the patients and families for whom they provide care. Neonatal-perinatal medicine fellows uniquely serve as both trainee and subspecialty expert and are additionally expected to be strong teachers. In this article, the authors review the benefits of developing fellows as teachers, the challenges and potential mitigating strategies of fulfilling this objective, and the educational foundations and future directions that may inform the development of curricula for training fellows as teachers.

Integrated behavioral health education using simulated patients for pediatric residents engaged in a primary care community of practice.

INTRODUCTION: Novel teaching curricula using simulated patients (SP) and a team-based approach are needed to teach pediatric residents how to approach behavioral health (BH) conditions in an integrated care setting. METHOD: This mixed-methods study evaluated a pilot curriculum on BH integration in pediatric primary care. Two 1-hour didactic sessions and 3 hours of SP encounters focused on attention-deficit/hyperactivity disorder (ADHD) and anxiety, followed by facilitated debriefings that included interdisciplinary team members. Residents completed pre- and postcurriculum surveys on self-efficacy in patient assessment and management. A subset of residents participated in semistructured interviews, reviewing video recordings of their SP encounters to facilitate reflection on their learning. We conducted qualitative analysis of interview transcripts until we reached thematic saturation. RESULTS: Residents (n = 31) reported significantly improved self-efficacy in the majority of BH skills (p ≤ .05 to p ≤ .0001), including assessing and discussing concerns with families, using screening tools, developing management plans, prescribing medications, and performing warm handoffs with BH clinicians. In analysis of 15 interviews, four themes emerged: shared experiences, mutual engagement, contextual meaning, and behavioral change, which aligned with the components of the communities of practice framework. Sharing experiences within an integrated BH-pediatric primary care learning community enhanced activated, self-reflective learning and consequent behavioral change that contributed to identity formation. DISCUSSION: Resident participation in the integrated BH-pediatric curriculum improved self-efficacy in patient care for anxiety and ADHD. Curricula implemented in integrated learning communities could help promote reflection and improve integrated pediatric-BH care, including warm handoffs from pediatric to BH providers. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Implicit Bias Training in Health Professions Education: A Scoping Review.

There is a recurrent call for effective implicit bias (IB) education within health professions education (HPE). We aimed to explore the state of IB education within HPE for clinical learners and IB educators using the Arksey and O'Malley scoping review framework. Thirty publications variable in curricular design met inclusion criteria. No studies assessed learner outcomes at the level of Miller's "shows" or "does" nor reported program evaluation outcomes at the level of Kirkpatrick's "behavior" or "results." Rigorous, theory-guided studies assessing behavioral change, patient care delivery, and patient outcomes are needed to move the field of IB education forward within HPE. Supplementary Information: The online version contains supplementary material available at 10.1007/s40670-022-01673-z.

Part 5: Essentials of Neonatal-Perinatal Medicine Fellowship: evaluation of competence and proficiency using Milestones.

The Accreditation Council for Graduate Medical Education (ACGME) Pediatric Subspecialty Milestone Project competencies are used for Neonatal-Perinatal Medicine (NPM) fellows. Milestones are longitudinal markers that range from novice to expert (levels 1-5). There is no standard approach to the required biannual evaluation of fellows by fellowship programs, resulting in significant variability among programs regarding procedural experience and exposure to pathology during clinical training. In this paper, we discuss the opportunities that Milestones provide, potential strategies to address challenges, and future directions.

Comparison of knowledge acquisition and retention following traditional didactic vs. flipped classroom education utilizing a standardized national curriculum: a randomized controlled trial.

OBJECTIVE: Measure the effectiveness of and preference for a standardized, national curriculum utilizing flipped classrooms (FC) in neonatal-perinatal medicine (NPM) fellowships. STUDY DESIGN: Multicentered equivalence, cluster randomized controlled trial of NPM fellowship programs randomized to receive standardized physiology education as in-class lectures (traditional didactic, TD arm) or as pre-class online videos followed by in-class discussions (FC arm). Four multiple-choice question quizzes and three surveys were administered to measure knowledge acquisition, retention, and educational preferences. RESULTS: 530 fellows from 61 NPM fellowships participated. Quiz performance was comparable between groups at all time points (p = NS, TD vs FC at 4 time points). Post intervention, more fellows in both groups preferred group discussions (pre/post FC 42% vs. 58%, P = 0.002; pre/post TD 43% vs. 60%, P = < 0.001). FC fellows were more likely to rate classroom effectiveness positively (FC/TD, 70% vs. 36%, P < 0.001). CONCLUSIONS: FCs promote knowledge acquisition and retention equivalent to TD and FC modalities are preferred by fellows.

Consensus on an implicit bias and health disparities curriculum in neonatal medicine: a Delphi study.

OBJECTIVE: Despite longstanding and recurrent calls for effective implicit bias (IB) education in health professions education as one mechanism to reduce ongoing racism and health disparities, such curricula for neonatal-perinatal medicine (NPM) are limited. We aim to determine the key curricular elements for educating NPM fellows, advanced practice providers, and attending physicians in the critical topics of IB and health disparities. STUDY DESIGN: A modified Delphi study was performed with content experts in IB and health disparities who had educational relationships to those working and training in the neonatal intensive care unit. RESULT: Three Delphi rounds were conducted from May to November 2021. Experts reached consensus on a variety of items for inclusion in the curriculum, including educational goals, learning objectives, teaching strategies, and educator principles. CONCLUSION: Essential curricular components of an IB and health disparities curriculum for neonatal medicine were defined using rigorous consensus building methodology.

Toll-like receptor 4-deficient mice are resistant to chronic hypoxia-induced pulmonary hypertension.

Current data suggest that Toll-like receptor 4 (TLR4), a key molecule in the innate immune response, may also be activated following tissue injury. Activation of this receptor is known to induce the production of several proinflammatory cytokines. Given that pulmonary inflammation has been shown to be a key contributor to chronic hypoxia-induced pulmonary vascular remodeling, the authors hypothesized that TLR4-deficient mice would be less susceptible to pulmonary hypertension (PH) as compared to mice with intact TLR4. TLR4-deficient and TLR4-intact strains of inbred mice were exposed to 4, 8, and 16 weeks of hypoxia (0.10 FiO(2)) or normoxia (0.21 FiO(2)) in a normobaric chamber. After chronic hypoxic exposure, TLR4-intact mice developed significant PH evidenced by increased right ventricular systolic pressure, right ventricular hypertrophy, and pulmonary artery medial thickening. In contrast, TLR4-deficient mice had no significant change in any of these parameters and this was associated with decreased pulmonary vascular inflammatory response as compared to the TLR4-intact mice. These results suggest that TLR4 deficiency may decrease the susceptibility to developing PH by attenuating the pulmonary vascular inflammatory response to chronic hypoxia.

Qualitative analysis of latent safety threats uncovered by in situ simulation-based operations testing before moving into a single-family-room neonatal intensive care unit.

OBJECTIVES: We aimed to identify: (a) latent safety threats (LSTs) in a new neonatal intensive care unit (NICU) through simulation-based pre-occupancy operations testing, and (b) LSTs that remained unresolved 1-year post-occupancy. STUDY DESIGN: In this qualitative study, 111 healthcare professionals participated in patient care simulations and debriefings in a new NICU. Debriefing transcripts were inductively analyzed to characterize LSTs. Unresolved LSTs were identified 1 year after NICU occupancy. RESULTS: Thematic saturation was attained after analysis of nine debriefings. Four major themes affecting staff function and patient safety emerged from 305 threats: relay of information, workplace design, patient care processes, and patient family and staff focus. One-year post occupancy, 29 (9%) LSTs remained unresolved. CONCLUSION: Team debriefings of simulated patient events uncover LSTs that can largely be resolved before transitioning patient care into a new NICU. Understanding how LSTs interact provides a platform to develop viable strategies to mitigate patient safety risks.

Neonatal Intubation Competency Assessment Tool: Development and Validation.

BACKGROUND: Neonatal tracheal intubation (NTI) is an important clinical skill. Suboptimal performance is associated with patient harm. Simulation training can improve NTI performance. Improving performance requires an objective assessment of competency. Competency assessment tools need strong evidence of validity. We hypothesized that an NTI competency assessment tool with multisource validity evidence could be developed and be used for formative and summative assessment during simulation-based training. METHODS: An NTI assessment tool was developed based on a literature review. The tool was refined through 2 rounds of a modified Delphi process involving 12 subject-matter experts. The final tool included a 22-item checklist, a global skills assessment, and an entrustable professional activity (EPA) level. The validity of the checklist was assessed by having 4 blinded reviewers score 23 videos of health care providers intubating a neonatal simulator. RESULTS: The checklist items had good internal consistency (overall α = 0.79). Checklist scores were greater for providers at greater training levels and with more NTI experience. Checklist scores correlated with global skills assessment (ρ = 0.85; P < .05), EPA levels (ρ = 0.87; P < .05), percent glottic exposure (r = 0.59; P < .05), and Cormack-Lehane scores (ρ = 0.95; P < .05). Checklist scores reliably predicted EPA levels. CONCLUSIONS: We developed an NTI competency assessment tool with multisource validity evidence. The tool was able to discriminate NTI performance based on experience. The tool can be used during simulation-based NTI training to provide formative and summative assessment and can aid with entrustment decisions.