Powerful medical education improves health care quality and return on investment.

INTRODUCTION: Powerful medical education (PME) involves the use of new technologies informed by the science of expertise that are embedded in laboratories and organizations that value evidence-based education and support innovation. This contrasts with traditional medical education that relies on a dated apprenticeship model that yields uneven results. PME involves an amalgam of features, conditions and assumptions, and contextual variables that comprise an approach to developing clinical competence grounded in education impact metrics including efficiency and cost-effectiveness. METHODS: This article is a narrative review based on SANRA criteria and informed by realist review principles. The review addresses the PME model with an emphasis on mastery learning and deliberate practice principles drawn from the new science of expertise. Pub Med, Scopus, and Web of Science search terms include medical education, the science of expertise, mastery learning, translational outcomes, cost effectiveness, and return on investment. Literature coverage is comprehensive with selective citations. RESULTS: PME is described as an integrated set of twelve features embedded in a group of seven conditions and assumptions and four context variables. PME is illustrated via case examples that demonstrate improved ventilator patient management learning outcomes compared to traditional clinical education and mastery learning of breaking bad news communication skills. Evidence also shows that PME of physicians and other health care providers can have translational, downstream effects on patient care practices, patient outcomes, and return on investment. Several translational health care quality improvements that derive from PME include reduced infections; better communication among physicians, patients, and families; exceptional birth outcomes; more effective patient education; and return on investment. CONCLUSIONS: The article concludes with challenges to hospitals, health systems, and medical education organizations that are responsible for producing physicians who are expected to deliver safe, effective, and cost-conscious health care.

Effect of Polypectomy Simulation-Based Mastery Learning on Skill Retention Among Practicing Endoscopists.

PURPOSE: Practicing endoscopists frequently perform and teach screening colonoscopies and polypectomies, but there is no standardized method to train and assess physicians who perform polypectomy procedures. The authors created a polypectomy simulation-based mastery learning (SBML) curriculum and hypothesized that completion of the curriculum would lead to immediate improvement in polypectomy skills and skill retention at 6 and 12 months after training. METHOD: The authors performed a pretest-posttest cohort study with endoscopists who completed SBML and were randomized to follow-up at 6 or 12 months from May 2021 to August 2022. Participants underwent SBML training, including a pretest, a video lecture, deliberate practice, and a posttest. All learners were required to meet or exceed a minimum passing standard on a 17-item skills checklist before completing training and were randomized to follow-up at 6 or 12 months. The authors compared simulated polypectomy skills performance on the checklist from pretest to posttest and posttest to 6- or 12-month follow-up test. RESULTS: Twenty-four of 30 eligible participants (80.0%) completed the SBML intervention, and 20 of 24 (83.3%) completed follow-up testing. The minimum passing standard was set at 93% of checklist items correct. The pretest passing rate was 4 of 24 participants (16.7%) compared with 24 of 24 participants (100%) at posttest ( P < .001). There were no significant differences in passing rates from posttest to combined 6- and 12-month posttest in which 18 of 20 participants (90.0%) passed. CONCLUSIONS: Before training and despite years of clinical experience, practicing endoscopists demonstrated poor performance of polypectomy skills. SBML was an effective method for practicing endoscopists to acquire and maintain polypectomy skills during a 6- to 12-month period.

Simulation-based Mastery Learning Improves Critical Care Skills of Advanced Practice Providers.

Background: Advanced practice providers (APPs) are essential members of intensive care unit (ICU) interprofessional teams and are expected to be competent in performing procedures. There are no published criteria for establishing when APPs can independently perform procedures. Simulation-based mastery learning (SBML) is an effective strategy for improving critical care skills but has not been applied to practicing ICU APPs. Objective: The purpose of this study was to evaluate if an SBML curriculum could improve the critical care skills and procedural self-confidence of ICU APPs. Methods: We performed a pretest-posttest study of central venous catheter (CVC) insertion, thoracentesis, and mechanical ventilation (MV) management skills among ICU APPs who participated in an SBML course at an academic hospital. For each skill, APPs underwent baseline skills assessments (pretests) on a simulator using previously published checklists, followed by didactic sessions and deliberate practice with individualized feedback. Within 2 weeks, participants were required to meet or exceed previously established minimum passing standards (MPS) on simulated skills assessments (posttests) using the same checklists. Further deliberate practice was provided for those unable to meet the MPS until they retested and met this standard. We compared pretest to posttest skills checklist scores and procedural confidence. Results: All 12 eligible ICU APPs participated in internal jugular CVC, subclavian CVC, and MV training. Five APPs participated in thoracentesis training. At baseline, no APPs met the MPS on all skills. At training completion, all APPs achieved the mastery standard. Internal jugular CVC pretest performance improved from a mean of 67.2% (standard deviation [SD], 28.8%) items correct to 97.1% (SD, 3.8%) at posttest (P = 0.005). Subclavian CVC pretest performance improved from 29.2% (SD, 32.7%) items correct to 93.1% (SD 3.9%) at posttest (P < 0.001). Thoracentesis pretest skill improved from 63.9% (SD, 30.6%) items correct to 99.2% (SD, 1.7%) at posttest (P = 0.054). Pretest MV skills improved from 54.8% (SD, 19.7%) items correct to 92.3% (SD, 5.0%) at posttest (P < 0.001). APP procedural confidence improved for each skill from pre to posttest. Conclusion: SBML is effective for training APPs to perform ICU skills. Relying on traditional educational methods does not reliably ensure that APPs are adequately prepared to perform skills such as CVC insertion, thoracentesis, and MV management.

Necessity of Pretests in Central Venous Catheter Insertion Simulation-Based Mastery Learning: A Randomized Controlled Trial.

PURPOSE: Simulation-based mastery learning (SBML) is a rigorous form of competency-based learning. Components of SBML include a pretest, deliberate practice, and a posttest; all learners must meet or exceed a minimum passing standard (MPS) on the posttest before completing training. The authors aimed to explore whether a modified SBML curriculum (without a pretest assessment) was as effective as the standard SBML curriculum (with a pretest assessment). METHOD: The authors performed a randomized controlled trial of internal medicine residents who participated in an internal jugular central venous catheter insertion SBML curriculum at a tertiary care academic medical center in Chicago, Illinois, from December 2018 through December 2021. Residents were randomly assigned to complete the usual SBML intervention (pretest group) or to complete a modified SBML intervention without a pretest (no pretest group). The authors compared initial posttest performance and training time between groups. RESULTS: Eighty-nine of 120 eligible residents (74.1%) completed the study: 43 in the pretest group and 46 in the no pretest group. Median (IQR) initial posttest scores were not statistically different between the pretest group (96.6 [93.1-100]) and the no pretest group (96.6 [92.4-100]). However, all 43 residents (100%) in the pretest group reached the MPS at the initial posttest compared with 41 of the 46 (89%) in the no pretest group ( P = .06). Residents in the pretest group required 16.5 hours more faculty and learning time than the no pretest group. CONCLUSIONS: More residents who completed a pretest reached the MPS at initial posttest. However, incorporating a pretest during the internal jugular central venous catheter SBML curriculum required substantially more learner and faculty time without clear performance benefits.

Performance of peripheral catheters inserted with ultrasound guidance versus landmark technique after a simulation-based mastery learning intervention.

PROBLEM: Ultrasound-guided peripheral intravenous catheter (USGPIV) insertion is an effective method to gain vascular access in patients with difficult intravenous access (DIVA). While USGPIV success rates are reported to be high, some studies have reported a concerning incidence of USGPIV premature failures. AIMS: The purpose of this study was to compare differences in USGPIV and landmark peripheral intravenous catheter (PIV) utilization and failure following a hospital-wide USGPIV training program for nurses. METHODS: The authors performed a retrospective, electronic medical record review of all USGPIVs and PIVs inserted at a tertiary, urban, academic medical center from September 1, 2018, through September 30, 2019. The primary outcome was differences between USGPIV and PIV time to failure. RESULTS: A total of 43,470 short peripheral intravenous catheters (PIVCs) were inserted in 23,713 patients. Of these, 7972 (16.8%) were USGPIV. At 30 days of follow-up, for PIVCs with an indication for removal documented, USGPIVs had higher Kaplan-Meier survival probabilities than PIVs (p < 0.001). CONCLUSIONS: The use of simulation-based mastery associated with USGPIVs, demonstrated lower failure rates than standard PIVs after 2 days and USGPIVs exhibited improved survival rates in patients with DIVA. These findings suggest that rigorous simulation-based insertion training demonstrates improved USGPIV survival when compared to traditional PIVCs. SBML is an extremely useful tool to ensure appropriately trained clinicians acquire the necessary knowledge and skillset to improve USGPIV outcomes.

Clinical Experience Is Not a Proxy for Competence: Comparing Fellow and Medical Student Performance in a Breaking Bad News Simulation-Based Mastery Learning Curriculum.

BACKGROUND: It is unknown whether traditional medical education ensures competence among fellows in the key skill of breaking bad news (BBN). While simulation-based mastery learning (SBML) has been used to train fourth-year medical students (M4s) in BBN, it is unclear if it adds similar value for fellows. OBJECTIVE: We examined the effect of traditional medical training on BBN skills by comparing baseline fellow and M4 skills and confidence and assessed the impact of a BBN SBML curriculum for fellows. METHODS: Fellows training in six programs at Northwestern University from November 2018 to May 2019 were eligible for inclusion. Fellows completed a BBN SBML curriculum including a pretest, individualized feedback using a previously published assessment tool, and ongoing deliberate practice until all achieved a minimum passing standard (MPS). The primary outcomes were checklist and scaled item scores on the assessment tool. Fellow performance was compared to a historical M4 cohort. RESULTS: Twenty-eight of 38 eligible fellows completed the curriculum and were included for analysis. Fellows reported significantly more experience and confidence in BBN compared to M4s, yet their pre-training performance was significantly worse on checklist (57.1% vs 65.0%, P = .02) and scaled items; only 4% reached the MPS. After training, fellow performance significantly improved on checklist (57.1% to 92.6%, SD = 5.2%, P < .001) and scaled items; all reached the MPS. CONCLUSIONS: Despite higher confidence and BBN clinical experience, fellows performed worse than untrained M4s, confirming that experience is not a proxy for skill. Programs must develop competency-based assessments to ensure entrustment of communication skills.

A mastery learning approach to education about fall risk and gait assessment.

Mastery learning is a form of competency-based education in which learning time varies but outcomes are uniform. Trainees must meet a minimum passing standard (MPS) before completing a mastery learning curriculum. The objective of this study was to establish a curriculum for fall risk and gait assessment for medical students, determine an MPS for a fall risk and gait assessment clinical skills examination (CSE), and apply the MPS to a sample of medical students completing a fall risk and gait assessment CSE. Medical students completed an interactive session about fall risk and gait assessment including the Timed Up and Go (TUG) test and completed deliberate practice with 3 patients. Skills were evaluated using an 18-item skills checklist. A panel of clinical experts set the MPS at 82%. Eighty-seven medical students participated. The average score on the checklist was 14.7 of 18 (81.4%.) Although almost all performed the TUG correctly, only 61% met the MPS for the checklist. Our results suggest that a mastery learning approach may better prepare the 39% of students that did not meet MPS to complete a fall risk and gait assessment.

From Passive Gatekeeper to Quarterback: Evolving Perceptions of Primary Care Among Medical Students in Longitudinal Outpatient Clerkships.

BACKGROUND: Longitudinal clerkships provide students with meaningful clinical care roles that promote learning and professional development. It remains unclear how longitudinal primary care clerkships inform students' perceptions of primary care. OBJECTIVE: To explore perceptions of primary care among medical students enrolled in longitudinal primary care clerkships. DESIGN: Qualitative, semi-structured interviews with medical students over 4 years. PARTICIPANTS: Thirty-eight medical students participated at baseline; 35 participated in a 2-year follow-up interview; 24 participated at 4 years. Each student was enrolled in one of two longitudinal primary care clerkships: a team-based Education-Centered Medical Home (ECMH) or a one-on-one individual preceptorship (IP). APPROACH: De-identified interview transcripts were analyzed using a process of open and axial coding, followed by elaborative coding for longitudinal analysis. Codes were compiled into a set of themes and compared across time periods and between clerkships. KEY RESULTS: Students reported that primary care serves as a first point of contact, emphasizing longitudinal care with a wide scope of practice and approaching patient care with a biopsychosocial perspective. Student perceptions of primary care greatly expanded over the course of 4 years: for instance, initial perceptions of primary care physicians evolved from "passive gatekeeper" to a more nuanced "quarterback." Students in ECMH, whose clerkship provided more opportunity for patient continuity, further reflected on the relationships they themselves developed with patients. CONCLUSIONS: Regardless of their eventual specialty choice, longitudinal experiences may aid all students in fostering a sense of the broad scope and importance of primary care. However, without numerous opportunities to witness continuity of care, students may perceive primary care as having limited scope and importance. Longitudinal clerkships, emphasizing continuity with patients and preceptors, may foster in students a broad and nuanced perspective of the scope of primary care as a field.

Ultrasound-Guided Peripheral Intravenous Catheter Insertion Training Reduces Use of Midline Catheters in Hospitalized Patients With Difficult Intravenous Access.

OBJECTIVES: Difficult intravenous (IV) access (DIVA) is a prevalent condition in the hospital setting and increases utilization of midline catheters (MCs) and peripherally inserted central catheters (PICCs). Ultrasound-guided peripheral intravenous (USGPIV) insertion is effective at establishing intravenous access in DIVA but remains understudied in the inpatient setting. We evaluated the effect of an USGPIV simulation-based mastery learning (SBML) curriculum for nurses on MC and PICC utilization for hospitalized patients. METHODS: We performed a quasi-experimental observational study. We trained nurses across all inpatient units at a large tertiary care hospital. We queried the electronic medical record to compare PICC and MC utilization for patients with DIVA during 3 periods: before USGPIV SBML training (control), during pilot testing of the intervention, and during the SBML intervention. To account for variations in insertion practices over time, we performed an interrupted time series (ITS) analysis between 2 periods, the combined control and pilot periods and the intervention period. RESULTS: One hundred forty-eight nurses completed USGPIV SBML training. Midline catheters inserted monthly per 1000 patient-days for DIVA decreased significantly from 1.86 ± 0.51 (control) to 2.31 ± 0.28 (pilot) to 1.33 ± 0.51 (intervention; P = 0.001). The ITS analysis indicated a significant intervention effect (P < 0.001). Peripherally inserted central catheters inserted monthly per 1000 patient-days for DIVA also significantly decreased over the study periods; however, the ITS failed to show an intervention effect as PICC insertions were already decreasing during the control period. CONCLUSIONS: A hospital-wide USGPIV SBML curriculum for inpatient nurses was associated with a significant reduction in MCs inserted for DIVA.

Effect of Ventricular Assist Device Self-care Simulation-Based Mastery Learning on Driveline Exit Site Infections: A Pilot Study.

BACKGROUND: Ventricular assist device simulation-based mastery learning (SBML) results in better patient and caregiver self-care skills compared with usual training. OBJECTIVE: The aim of this study was to evaluate the effect of SBML on driveline exit site infections. METHODS: We compared the probability of remaining infection free at 3 and 12 months between patients randomized to SBML or usual training. RESULTS: The SBML-training group had no infections at 3 months and 2 infections at 12 months, yielding a Kaplan-Meier estimate of the probability of remaining infection free of 0.857 (95% confidence interval [CI], 0.692-1.00) at 12 months. The usual-training group had 6 infections at 3 months with no additional infections by 12 months. Kaplan-Meier estimates of remaining infection free at 3 and 12 months were 0.878 (95% CI, 0.758-1.00) and 0.748 (95% CI, 0.591-0.946), respectively. Time-to-infection distributions for SBML versus usual training showed a difference in 12-month infection rates of 0.109 (P = .07). CONCLUSIONS: Ventricular assist device self-care SBML resulted in fewer 12-month infections.

Development and evaluation of a simulation-based mastery learning maintenance of certification course.

BACKGROUND/OBJECTIVES: To develop and evaluate a post-acute care simulation-based mastery learning (SBML) continuing medical education (CME)/maintenance of certification (MOC) procedure course. DESIGN: Pretest-posttest study of the SBML intervention. SETTING: A 2-day post-acute care procedures course. PARTICIPANTS: Sixteen practicing clinicians (5 physicians,11 advanced practice providers). Participants engaged in a skills pretest on knee aspiration/injection, gastrostomy tube removal/replacement, tracheostomy tube exchange, and basic suturing using a checklist created for each procedure. Participants received a didactic on each procedure followed by deliberate practice with feedback. Using the same checklists, participants completed a skills posttest and were required to meet a minimum passing standard (MPS) to obtain CME/MOC credit. MEASUREMENTS: The MPS for each skills checklist was determined by a multidisciplinary panel of 11 experts. Participants completed surveys on procedure self-confidence and a course evaluation. RESULTS: There was statistically significant improvement between pre- and posttests for all four procedures (p < .001). All participants were able to meet or exceed the MPS for each skill during the 2-day course. Participants' self-confidence regarding each procedure improved significantly (p < .001). CONCLUSION: An SBML training course granting CME/MOC credit for post-acute care providers significantly improves performance of knee aspiration/injection, gastrostomy tube removal/replacement, tracheostomy tube exchange, and basic suturing.

Simulation-based training improves polypectomy skills among practicing endoscopists.

Background and study aims Practicing endoscopists have variable polypectomy skills during colonoscopy and limited training opportunities for improvement. Simulation-based training enhances procedural skill, but its impact on polypectomy is unclear. We developed a simulation-based polypectomy intervention to improve polypectomy competency. Methods All faculty endoscopists at our tertiary care center who perform colonoscopy with polypectomy were recruited for a simulation-based intervention assessing sessile and stalked polypectomy. Endoscopists removed five polyps in a simulation environment at pretest followed by a training intervention including a video, practice, and one-on-one feedback. Within 1-4 weeks, endoscopists removed five new simulated polyps at post-test. We used the Direct Observation of Polypectomy Skills (DOPyS) checklist for assessment, evaluating individual polypectomy skills, and global competency (scale: 1-4). Competency was defined as an average global competency score of ≥ 3. Results 83 % (29/35) of eligible endoscopists participated and 95 % (276/290) of planned polypectomies were completed. Only 17 % (5/29) of endoscopists had average global competency scores that were competent at pretest compared with 52 % (15/29) at post-test ( P  = 0.01). Of all completed polypectomies, the competent polypectomy rate significantly improved from pretest to post-test (55 % vs. 71 %; P  < 0.01). This improvement was significant for sessile polypectomy (37 % vs. 65 %; P  < 0.01) but not for stalked polypectomy (82 % vs. 80 %; P  = 0.70). Conclusions Simulation-based training improved polypectomy skills among practicing endoscopists. Further studies are needed to assess the translation of simulation-based education to clinical practice.

Simulation-Based Assessments and Graduating Neurology Residents' Milestones: Status Epilepticus Milestones.

BACKGROUND: The American Board of Psychiatry and Neurology and the Accreditation Council for Graduate Medical Education (ACGME) developed Milestones that provide a framework for residents' assessment. However, Milestones do not provide a description for how programs should perform assessments. OBJECTIVES: We evaluated graduating residents' status epilepticus (SE) identification and management skills and how they correlate with ACGME Milestones reported for epilepsy and management/treatment by their program's clinical competency committee (CCC). METHODS: We performed a cohort study of graduating neurology residents from 3 academic medical centers in Chicago in 2018. We evaluated residents' skills identifying and managing SE using a simulation-based assessment (26-item checklist). Simulation-based assessment scores were compared to experience (number of SE cases each resident reported identifying and managing during residency), self-confidence in identifying and managing these cases, and their end of residency Milestones assigned by a CCC based on end-of-rotation evaluations. RESULTS: Sixteen of 21 (76%) eligible residents participated in the study. Average SE checklist score was 15.6 of 26 checklist items correct (60%, SD 12.2%). There were no significant correlations between resident checklist performance and experience or self-confidence. The average participant's level of Milestone for epilepsy and management/treatment was high at 4.3 of 5 (SD 0.4) and 4.4 of 5 (SD 0.4), respectively. There were no significant associations between checklist skills performance and level of Milestone assigned. CONCLUSIONS: Simulated SE skills performance of graduating neurology residents was poor. Our study suggests that end-of-rotation evaluations alone are inadequate for assigning Milestones for high-stakes clinical skills such as identification and management of SE.

Short-term Retention of Patient and Caregiver Ventricular Assist Device Self-care Skills after Simulation-based Mastery Learning.

BACKGROUND: We developed a simulation-based mastery learning (SBML) curriculum that boosted self-care skills for patients with a ventricular assist device (VAD). In this study, we evaluated short-term skills retention. METHODS: We assessed skill retention among patients and caregivers who participated in VAD self-care SBML at a tertiary care center. We compared discharge skills tests (immediately after completing SBML) to 1- and 3-month follow-up tests to assess skill retention. RESULTS: Fifteen patients and 15 caregivers completed discharge and follow-up testing. Skills were largely retained at 1- and 3-months. CONCLUSIONS: SBML results in short-term retention of VAD self-care skills.

Barriers and Facilitators to Central Venous Catheter Insertion: A Qualitative Study.

OBJECTIVES: The aims of the study were to identify perceived barriers and facilitators to central venous catheter (CVC) insertion among healthcare providers and to understand the extent to which an existing Simulation-Based Mastery Learning (SBML) program may address barriers and leverage facilitators. METHODS: Providers participating in a CVC insertion SBML train-the-trainer program, in addition to intensive care unit nurse managers, were purposively sampled from Veterans Administration Medical Centers located in geographically diverse areas. We conducted semistructured interviews to assess perceptions of barriers and facilitators to CVC insertion. Deidentified transcripts were analyzed using a grounded theory approach and the constant comparative method. We subsequently mapped identified barriers and facilitators to our SBML curriculum to determine whether or not the curriculum addresses these factors. RESULTS: We interviewed 28 providers at six Veterans Administration Medical Centers, identifying the following five overarching factors of perceived barriers to CVC insertion: (1) equipment, (2) personnel/staff, (3) setting or organizational context, (4) patient or provider, and (5) time-related barriers. Three overarching factors of facilitators emerged: (1) equipment, (2) personnel, and (3) setting or organizational context facilitators. The SBML curriculum seems to address most identified barriers, while leveraging many facilitators; building on the commonly identified facilitator of nursing staff contribution by expanding the curriculum to explicitly include nurse involvement could improve team efficiency and organizational culture of safety. CONCLUSIONS: Many identified facilitators (e.g., ability to use ultrasound, personnel confidence/competence) were also identified as barriers. Evidence-based SBML programs have the potential to amplify these facilitators while addressing the barriers by providing an opportunity to practice and master CVC insertion skills.

Improving cardiology fellow education of right heart catheterization using a simulation based curriculum.

BACKGROUND: Medical procedures are traditionally taught informally at patients' bedside through observation and practice using the adage "see one, do one, teach one." This lack of formalized training can cause trainees to be unprepared to perform procedures independently. Simulation based education (SBE) increases competence, reduces complications, and decreases costs. We developed, implemented, and evaluated the efficacy of a right heart catheterization (RHC) SBE curriculum. METHODS: The RHC curriculum consisted of a pretest, video didactics, deliberate practice, and a posttest. Pre-and posttest skills examinations consisted of a dichotomous 43-item checklist on RHC skills and a 14-item hemodynamic waveform quiz. We enrolled two groups of fellows: 6 first-year, novice cardiology fellows at Northwestern University in their first month of training, and 11 second- and third-year fellows who had completed traditional required, level I training in RHC. We trained the first-year fellows at the beginning of the 2018-2019 year using the SBE curriculum and compared them to the traditionally-trained cardiology fellows who did not complete SBE. RESULTS: The SBE-trained fellows significantly improved RHC skills, hemodynamic knowledge, and confidence from pre- to posttesting. SBE-trained fellows performed similarly to traditionally-trained fellows on simulated RHC skills checklists (88.4% correct vs. 89.2%, p = .84), hemodynamic quizzes (94.0% correct vs. 86.4%, p = .12), and confidence (79.4 vs. 85.9 out of 100, p = .15) despite less clinical experience. CONCLUSIONS: A SBE curriculum for RHC allowed novice cardiology fellows to achieve level I skills and knowledge at the beginning of fellowship and can train cardiology fellows before patient contact.

Psychometric Validation of Central Venous Catheter Insertion Mastery Learning Checklist Data and Decisions.

INTRODUCTION: Resident physicians are expected to acquire competence at central venous catheter (CVC) insertion to a mastery standard. Valid competence decisions about resident physicians' CVC performance rely on reliable data and rigorous achievement standards. This study used data from 3 CVC simulation-based mastery learning studies involving internal medicine (IM) and emergency medicine (EM) residents to address 2 questions: What is the effectiveness of a CVC mastery learning education intervention? Are minimum passing standards (MPSs) set by faculty supported by item response theory (IRT) analyses? METHODS: Pretraining and posttraining skills checklist data were drawn from 3 simulation-based mastery learning research reports about CVC internal jugular (IJ) and subclavian (SC) insertion skill acquisition. Residents were required to meet or exceed a posttest skills MPS. Generalized linear mixed effect models compared checklist performance from pre to postintervention. Minimum passing standards were determined by Angoff and Hofstee standard setting methods. Item response theory models were used for cut-score evaluation. RESULTS: Internal medicine and EM residents improved significantly on every IJ and SC checklist item after mastery learning. Item response theory analyses support the IJ and SC MPSs. CONCLUSIONS: Mastery learning is an effective education intervention to achieve clinical skill acquisition among IM and EM residents. Item response theory analyses reveal desirable measurement properties for the MPSs previously set by expert faculty panels. Item response theory analysis is useful for evaluating standards for mastery learning interventions. The CVC mastery learning curriculum, reliable outcome data, and high achievement standards together contribute to reaching valid decisions about the competence of resident physicians to perform the clinical procedure.