Comparing Male and Female Resident Physicians in Central Venous Catheter Insertion Self-confidence and Competency: A Retrospective Cohort Study.

BACKGROUND: Female physicians often report lower self-confidence in their procedural and clinical competency compared to male physicians. There is limited data regarding self-reported confidence of female versus male trainees and any relation to objective competency in central venous catheter insertion. OBJECTIVE: To analyze differences between male and female trainees in self-confidence and skill-based outcomes in placing central venous catheters. DESIGN: Using data from a central venous catheter simulation training program at a large tertiary medical center, we performed linear regressions to analyze confidence difference pre- and post-training, number of restarts, and number of cannulation attempts while controlling for baseline demographic characteristics of the sample. PARTICIPANTS: PGY-1 physician residents in all residency specialties who insert central venous catheters in the clinical setting at a tertiary academic center with a sample size of 281 residents. MAIN MEASURES: Confidence difference pre- and post-training measured on a Likert scale 1-5, number of restarts (novel global assessment variable), and number of cannulation attempts during the competency evaluation. KEY RESULTS: Female trainees had both lower pre-program confidence (1.35 versus 1.74 out of 5, p < 0.001) and lower post-program confidence (3.77 versus 4.12 out of 5, p = 0.0021) as compared to male trainees. There was no statistically significant difference in number of restarts (95% CI - 0.073 to 0.368, p = 0.185) or cannulation attempts (95% CI - 0.039 to 0.342, p = 0.117) between sexes in linear regressions controlled for age, specialty designation, prior central venous catheter training, prior ultrasound guided vessel cannulation training, and pre-training confidence level. CONCLUSIONS: Female trainees rated their confidence significantly lower than their male counterparts both before and after the training program, despite no significant difference in skill-based outcomes. We discuss potential implications for trainees acquiring procedural skills during residency and for physician educators as they design training programs and delegate procedural opportunities.

Educational and personal impacts of the COVID-19 pandemic on emergency medicine resident physicians: a qualitative study.

BACKGROUND: The COVID-19 pandemic had a significant impact on both the clinical practice and the psychological states of frontline physicians in the emergency department. Trainees, at the beginning of their careers and thus still developing their practice styles and identities as physicians, were uniquely affected. OBJECTIVE: In this qualitative study, we sought to explore how the pandemic environment shaped the experiences of emergency medicine resident physicians. METHODS: This was a qualitative study. We conducted in-depth interviews with emergency medicine faculty, resident physicians, and staff at a single emergency department based at an urban academic institution in the northeastern United States. Interviews were audio recorded and transcribed, and transcripts were then analyzed in an iterative process by our coding team for recurring themes related to the resident experience. RESULTS: We reached data saturation with 27 individuals. Of those who were interviewed, 10 were resident physicians [6 senior residents (PGY-3 or PGY-4) and 4 junior residents (PGY-1 or PGY-2)]. Three major recurring themes regarding resident physician experience emerged during our analysis of the interviews: (1) novel educational experiences dampened by negative structural forces from the pandemic, (2) fracturing of social interactions and mitigation through ad-hoc support systems and community of practice, and (3) development of negative emotions and psychological trauma including fear, resentment, and moral injury causing lasting harm. CONCLUSIONS: Our results suggest that emergency medicine resident physicians training during the COVID-19 pandemic faced unique experiences concerning their education, social support systems, and emotional states. While the educational and social experiences were described as having both negative and positive impacts, the emotional experiences were largely negative. Residency program leadership may use these insights to improve resident preparation, wellness, and resilience in the face of future adverse events.

A comprehensive, simulation-based approach to teaching clinical skills: the medical students' perspective.

The purpose of this study was to determine if third-year medical students participating in a mandatory 12-week simulation course perceived improvement in decision-making, communication, and teamwork skills. Students participated in or observed 24 acute emergency scenarios. At 4-week intervals, students completed 0-10 point Likert scale questionnaires evaluating the curriculum and role of team leader. Linear contrasts were used to examine changes in outcomes. P-values were Bonferroni-corrected for multiple pairwise comparisons. Student evaluations (n = 96) demonstrated increases from week 4 to 12 in educational value (p = 0.006), decision-making (p < 0.001), communication (p = 0.02), teamwork (p = 0.01), confidence in management (p < 0.001), and translation to clinical experience (p < 0.001). Regarding the team leader role, students reported a decrease in stress (p = 0.001) and increase in ability to facilitate team function (p < 0.001) and awareness of team building (p = <0.001). Ratings demonstrate a positive impact of simulation on both clinical management skills and team leadership skills. A simulation curriculum can enhance the ability to manage acute clinical problems and translates well to the clinical experience. These positive perceptions increase as the exposure to simulation increases.

Use of ultrasound guidance improves central venous catheter insertion success rates among junior residents.

OBJECTIVES: The purpose of this study was to determine whether junior residents had higher rates of first cannulation and overall success at central venous catheter insertions with the use of ultrasound (US) guidance compared to the landmark technique. METHODS: We conducted a secondary analysis of data from a prospective randomized controlled study of junior residents from January 2007 through September 2008, which assessed the impact of simulation training on central venous catheter insertion success rates. Blinded independent raters observed in-hospital central venous catheter insertions using a procedural checklist. Success at first cannulation and successful insertion were the primary outcomes. Secondary outcomes included rates of technical errors and mechanical complications. RESULTS: Independent raters observed 480 central venous catheter insertions by 115 residents. Successful first cannulation occurred in 27% of landmark compared to 49% of dynamic US-guided (P < .01), and 50% of static US-guided (P = .01) cannulations. Insertion success occurred for 55% of landmark compared to 80% of dynamic US-guided (P < .01) and 80% of static US-guided (P < .01) cannulations. Dynamic US guidance was associated with increased odds of first cannulation success compared to the landmark technique (odds ratio [OR], 2.24; 95% confidence interval [CI], 1.37-3.67) and successful insertion (OR, 3.80; 95% CI, 2.34-6.19). Static US guidance was associated with increased odds of first cannulation success compared to the landmark technique (OR, 2.59; 95% CI, 1.25-5.39) and successful insertion (OR, 3.48; 95% CI, 1.54-7.87). The results were independent of central venous catheter insertion training, patient comorbidities, and resident specialties. There was no difference related to mechanical complications between the procedures. CONCLUSIONS: Dynamic and static US guidance during central venous catheter insertion was associated with improved in-hospital first cannulation rates and overall success rates of insertions by junior residents.

Creating a surgery clerkship in a changing environment: reality, simulation, and the rules of engagement.

This review describes the current challenges associated with creating a successful surgical clerkship and the ways in which teacher-focused and curriculum-focused initiatives can address these challenges. The challenges are both systemic (reflected by changes in our health care system and training programs) and institutional (reflected by factors that affect curriculum design and faculty advancement). Particular attention is paid to residents as teachers, faculty as mentors, the educational impact of the operating room, and the role of simulation. Strategies for engaging students, residents, and faculty are explored. The premise and impact of a comprehensive simulation course on the clinical education of medical students is detailed. Emphasis is placed on the educational validity of accountability and engagement of both the teachers and the learners.

Burnout and Post-traumatic Stress Disorder Symptoms Among Emergency Medicine Resident Physicians During the COVID-19 Pandemic.

INTRODUCTION: Emergency medicine is characterized by high volume decision-making while under multiple stressors. With the arrival of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) virus in early 2020, physicians across the world were met with a surge of critically ill patients. Emergency physicians (EP) are prone to developing burnout and post-traumatic stress disorder (PTSD), due to experiencing emotional trauma as well as the cumulative stress of practice. Thus, calls have been made for attempts to prevent physician PTSD during this current pandemic. METHODS: From July 2019-January 2020, emergency medicine (EM) resident physicians at a large, academic healthcare system were surveyed for symptoms of burnout using the Maslach Burnout Inventory (MBI). In late April and early May 2020, during the outbreak surge of coronavirus disease 2019 (COVID-19) in the Northeast USA, these same residents and the whole EM residency at the institution were again surveyed for symptoms of burnout as well as post-traumatic stress using the PTSD Checklist for Diagnostic and Statistical Manual of Mental Disorders, 5th Edition (PCL-5). A final survey was administered to the EM residents after the COVID-19 surge had largely subsided in June 2020. RESULTS: Twenty-two residents participated in the pre-pandemic study and completed the MBI. Twelve (55%) completed the two follow-up MBI surveys. In the larger EM residency cohort, 31/60 residents completed the MBI and PCL-5 survey during the pandemic peak and 30/60 (50%) completed the follow-up surveys. There were no significant differences in the three MBI burnout category measures of emotional exhaustion (P = 0.49), depersonalization (P = 0.13), and personal accomplishment (P = 0.70) pre-, during, and post-COVID. Of 31 participants, 11 (35%) scored greater than 31 on the PCL-5. Two residents had scores between 21-30, interpreted as "at risk." At greater than one month follow-up, 2/30 continued to meet criteria for a preliminary PTSD diagnosis, and five were "at risk." CONCLUSION: A significant proportion of residents (35%) experienced post-traumatic symptoms acutely during the COVID-19 pandemic crisis, potentially indicating a high prevalence of acute stress disorder in this population and increased risk of developing PTSD. However, there was no significant difference in burnout levels in this cohort before, during, or after the initial COVID-19 surge. Early screening for physicians at risk and referral for assessment and treatment may be important to mitigate pandemic-related PTSD.

Improving patient and clinician safety during COVID-19 through rapidly adaptive simulation and a randomised controlled trial: a study protocol.

INTRODUCTION: COVID-19 required healthcare systems to iteratively adapt for safe and up-to-date care as knowledge of the disease rapidly evolved. Rates of COVID-19 infections continue to fluctuate and patients without COVID-19 increasingly return to the emergency department (ED) for care. This leads to new challenges and threats to patient and clinician safety as suspected patients with COVID-19 need to be quickly detected and isolated among other patients with non-COVID-19-related illnesses. At the front lines, emergency physicians also face continued personal safety concerns and increased work burden, which heighten stress and anxiety, especially given the prolonged course of the pandemic. Burnout, already a serious concern for emergency physicians due to the cumulative stresses of their daily practice, may present as a longer-term outcome of these acute stressors. METHODS AND ANALYSIS: We will implement a rapidly adaptive simulation-based approach to understand and improve physician preparedness while decreasing physician stress and anxiety. First, we will conduct semi-structured qualitative interviews and human factor observations to determine the challenges and facilitators of COVID-19 preparedness and mitigation of physician stress. Next, we will conduct a randomised controlled trial to test the effectiveness of a simulation preparedness intervention on physician physiological stress as measured by decreased heart rate variability on shift and anxiety as measured by the State-Trait Anxiety Inventory. ETHICS AND DISSEMINATION: The protocol was reviewed and approved by the Agency for Healthcare Research and Quality for funding, and ethics approval was obtained from the Yale University Human Investigation Committee in 2020 (HIC# 2000029370 and 2000029372). To support ongoing efforts to address clinician stress and preparedness, we will strategically disseminate the simulation intervention to areas most impacted by COVID-19. Using a virtual telesimulation and webinar format, the dissemination efforts will provide hands-on learning for ED and hospital administrators as well as simulation educators. TRIAL REGISTRATION NUMBER: NCT04614844.

All clinical stressors are not created equal: Differential task stress in a simulated clinical environment.

Background: A variety of stressors are encountered while working in the emergency department and are often recreated in simulation-based medical education. We seek to examine the physiologic and stress state response of participants in a simulated clinical environment to commonly encountered stressors. Methods: Emergency medicine (EM) residents participated in a randomized, controlled trial of six simulated patient encounters with one of three stressors, medical difficulty, interpersonal challenge, and technology/equipment failure, randomized into each scenario. Participants wore smart shirts to measure heart rate variability (HRV) at rest and just after the introduced stressor and completed the Short Stress State Questionnaire (SSSQ) before and after each scenario. Results: Twenty-seven EM residents participated in the study. Interpersonal challenge resulted in increased distress as measured by SSSQ compared to the other two stressors (one way ANOVA, F[2,144] = 9.95, p < 0.001). There was no difference in worry or task engagement across stressors. HRV decreased significantly from rest for all stressors (p = 0.0003, p = 0.0112, p = 0.0027 for medical difficulty, interpersonal challenge, and equipment failure, respectively), but there was no statistically significant difference between mean change in HRV across stressors (one way ANOVA, F[2,120] = 0.17, p = 0.8452). Conclusions: Interpersonal challenge stressor was significantly associated with an increase in distress in EM residents during the simulated encounters as compared to the other stressors. While heart rate variability decreased from rest for each stressor as expected following stressor introduction, differing stressors did not produce a differential change.

Just-in-time clinical video review improves successful placement of Sengstaken-Blakemore tube by emergency medicine resident physicians: A randomized control simulation-based study.

OBJECTIVE: Successful completion of life-saving procedures may benefit from a concise just-in-time (JIT) intervention. Video is an optimal medium for JIT training, but currently available video-based references are not optimized for a JIT format, especially in time-pressured situations prior to high-risk clinical contexts. We aimed to create and evaluate the efficacy of a brief video review of emergent Sengstaken-Blakemore tube (SBT) insertion for acutely decompensating variceal hemorrhage when used just prior to clinical performance in a simulated setting. METHODS: We created a less than 3-minute audio-optional JIT training video on SBT insertion. We recruited emergency medicine resident physicians to participate in a simulation scenario in which they had to quickly place an SBT. Participants were randomized to either a 3-minute procedure review by any media they chose (control) or review of the JIT video (intervention). Performance on a checklist created by a multidisciplinary group of SBT experts (passing score > 18 and maximum = 28) served as the primary outcome. We analyzed performance in checklist scores controlling level of training through a one-way analysis of covariance (ANCOVA). We analyzed rates of passing scores via a chi-square analysis. RESULTS: We randomized 32 participants to media review (control) or JIT video (intervention). The intervention group had an overall mean (±SD) performance of 19.8 (±9.0) and the control group had a mean (±SD) score of 6.6 (±7.4). After adjusting for postgraduate year, we found a significant difference in final checklist scores between the two groups (mean difference = 12.8, 95% confidence interval [CI] = 7.6 to 18.0). Percentages of participants reaching a minimum passing score were two of 16 (12.5%) in the control group and 10 of 16 (62.5%) in the intervention group (odds ratio = 11.7, 95% CI = 9.9 to 13.5). Cohen's kappa indicated substantial agreement (κ = 0.714) between reviewer scores. CONCLUSIONS: A readily available, focused, audio-optional JIT video increased performance for SBT insertion in a simulated setting. Future work may include testing of this format for more commonly performed emergency procedures and determination of effect on bedside performance in the clinical setting.

A Novel Application of the Modified Angoff Method to Rate Case Difficulty in Simulation-Based Research.

INTRODUCTION: Simulation use in research is often limited by controlling for scenario difficulty when using repeated measures. Our study assesses the feasibility of the Modified Angoff Method to reach expert consensus regarding difficulty of medical simulations. We compared scores with participant physiologic stress. METHODS: Emergency medicine physicians with expertise in simulation education were asked to review 8 scenarios and estimate the percentage of resident physicians who would perform all critical actions using the modified Angoff method. A standard deviation (SD) of less than 10% of estimated percentage correct signified consensus. Twenty-five residents then performed the 6 scenarios that met consensus and heart rate variability (HRV) was measured. RESULTS: During round 1, experts rated 4/8 scenarios within a 10% SD for postgraduate year 3 (PGY3) and 3/8 for PGY4 residents. In round 2, 6/8 simulation scenarios were within an SD of 10% points for both years. Intraclass correlation coefficient was 0.84 for PGY3 ratings and 0.89 for PGY4 ratings. A mixed effects analysis of variance showed no significant difference in HRV change from rest to simulation between teams or scenarios. Modified Angoff Score was not a predictor of HRV (multiple R2 = 0.0176). CONCLUSIONS: Modified Angoff ratings demonstrated consensus in quantifying the estimated percentage of participants who would complete all critical actions for most scenarios. Although participant HRV did decrease during the scenarios, we were unable to significantly correlate this with ratings. This modified Angoff method is a feasible approach to evaluate simulation difficulty for educational and research purposes and may decrease the time and resources necessary for scenario piloting.

Virtual Telesimulation for Medical Students During the COVID-19 Pandemic.

PROBLEM: In March 2020, the novel coronavirus 2019 (COVID-19) became a global pandemic. Medical schools around the United States faced difficult decisions, temporarily suspending hospital-based clerkship rotations for medical students due to potential shortages of personal protective equipment and a need to social distance. This decision created a need for innovative, virtual learning opportunities to support undergraduate medical education. APPROACH: Educators at Yale School of Medicine developed a novel medical student curriculum converting high-fidelity, mannequin-based simulation into a fully online virtual telesimulation format. By using a virtual videoconferencing platform to deliver remote telesimulation as an immersive educational experience for widely dispersed students, this novel technology retains the experiential strengths of simulation-based learning while complying with needs for social distancing during the pandemic. The curriculum comprises simulated clinical scenarios that include live patient actors; facilitator interactions; and real-time assessment of vital signs, labs, and imaging. Each 90-minute session includes 2 sets of simulation scenarios and faculty-led teledebriefs. A team of 3 students performs the first scenario, while an additional team of 3 students observes. Teams reverse roles for the second scenario. OUTCOMES: The 6-week virtual telesimulation elective enrolled the maximum 48 medical students and covered core clinical clerkship content areas. Communication patterns within the virtual telesimulation format required more deliberate turn-taking than normal conversation. Using the chat function within the videoconferencing platform allowed teams to complete simultaneous tasks. A nurse confederate provided cues not available in the virtual telesimulation format. NEXT STEPS: Rapid dissemination of this program, including online webinars and live demonstration sessions with student volunteers, supports the development of similar programs at other universities. Evaluation and process improvement efforts include planned qualitative evaluation of this new format to further understand and refine the learning experience. Future work is needed to evaluate clinical skill development in this educational modality.

An Interprofessional Simulation-Based Orientation Program for Transitioning Novice Nurses to Critical Care Roles in the Emergency Department: Pilot Implementation and Evaluation.

BACKGROUND: The emergency department (ED) relies on high-functioning teams to deliver consistent and safe patient care. Experts recommend that both emergency physicians and ED nurses participate in team training. However, there are currently no nationally accepted curricula for either profession to embed this training in their professional development, particularly for health workers who are novice or transitioning into critical care roles. METHODS: An interprofessional educator team designed and embedded a series of simulation scenarios within a novel orientation program for novice nurses transitioning to critical care roles in the ED to teach clinical and teamwork skills for conjoint groups of resident physician and novice nurse learners. The team created four interprofessional simulations to represent the acuity and breadth of patient populations in the ED critical care bays. INTERVENTION/REFINEMENT: To date, the team has conducted 24 two-week orientation sessions for 48 nurses and 51 resident physicians. Overall mean scores for the Debriefing Assessment for Simulation in Healthcare (DASH) instrument from nursing participants in the first 18 sessions were high. Qualitative evaluation data from both nurses and physicians demonstrated a positive impact of the simulations and provided insight into respective roles, identities, and priorities across professions. Participant feedback led to iterative steps in refinement of the simulations, including adjustments in debriefings and logistics of the orientation program. IMPLICATIONS FOR PRACTICE: A team-based interprofessional simulation program was found to be feasible and acceptable for practicing novice physicians and nurses as part of a nursing critical care orientation program in the ED. Future work will assess the program's long-term impact on teamwork and safety in the actual clinical environment.

Information loss in emergency medical services handover of trauma patients.

INTRODUCTION: Little is known about how effectively information is transferred from emergency medical services (EMS) personnel to clinicians in the emergency department receiving the patient. Information about prehospital events and findings can help ensure expedient and appropriate care. The trauma literature describes 16 prehospital data points that affect outcome and therefore should be included in the EMS report when applicable. OBJECTIVE: To determine the degree to which information presented in the EMS trauma patient handover is degraded. METHODS: At a level I trauma center, patients meeting criteria for the highest level of trauma team activation ("full trauma") were enrolled. As part of routine performance improvement, the physician leadership of the trauma program watched all available video-recorded full trauma responses, checking off whether the data points appropriate to the case were verbally "transmitted" by the EMS provider. Two EMS physicians then each independently reviewed the trauma team's chart notes for 50% of the sample (and a randomly selected 15% of the charts to assess agreement) and checked off whether the same elements were documented ("received") by the trauma team. The focus was on data elements that were "transmitted" but not "received." RESULTS: In 96 patient handovers, a total of 473 elements were transmitted, of which 329 were received (69.6%). On the average chart, 72.9% of the transmitted items were received (95% confidence interval 69.0%-76.8%). The most commonly transmitted data elements were mechanism of injury (94 times), anatomic location of injury (81), and age (67). Prehospital hypotension was received in only 10 of the 28 times it was transmitted; prehospital Glasgow Coma Scale [GCS] score 10 of 22 times; and pulse rate 13 of 49 times. CONCLUSIONS: Even in the controlled setting of a single-patient handover with direct verbal contact between EMS providers and in-hospital clinicians, only 72.9% of the key prehospital data points that were transmitted by the EMS personnel were documented by the receiving hospital staff. Elements such as prehospital hypotension, GCS score, and other prehospital vital signs were often not recorded. Methods of "transmitting" and "receiving" data in trauma as well as all other patients need further scrutiny.

"To Err Is Human" but Disclosure Must be Taught: A Simulation-Based Assessment Study.

INTRODUCTION: Although error disclosure is critical in promoting safety and patient-centered care, physicians are inconsistently trained in its practice, and few objective methods to assess competence exist. We used an immersive simulation scenario to determine whether providers with varying levels of clinical experience adhere to the disclosure safe practice guidelines when exposed to a serious adverse event simulation scenario. METHODS: This was a prospective cohort study with medical students, junior emergency medicine (EM) residents (PGY 1-2), senior EM residents (PGY 3-4), and attending EM physicians participating in a simulated case in which a scripted medication overdose resulted in an adverse event. Each scenario was videotaped and scored by two expert raters based on a 6-component, 21-point disclosure assessment instrument. RESULTS: There were 12 participants in each study group (N = 48). There was good interrater reliability (κ = 0.70). Total scores improved significantly as the level of training increased: medical student = 10.3 (2.7), PGY 1-2 = 12.3 (6.2), PGY 3-4 = 13.7 (3.2), and attending physicians = 12.8 (3.7) (P = 0.03). Seventy-five percent of participants did not address preventing recurrence of the error. Fifty-six percent offered no apology or only offered it with prompting from the patient; only 23% offered an apology with the initial disclosure. CONCLUSIONS: We demonstrated suboptimal adherence to best practices guidelines for error disclosure when providers are assessed in an immersive simulation setting. Despite a correlation in performance of medical error disclosure with increased physician experience, this study suggests that healthcare providers may need additional training to comply with safe practice guidelines for disclosure of unanticipated adverse events.

Open surgical simulation in residency training: a review of its status and a case for its incorporation.

BACKGROUND: With the increase in minimally invasive approaches to surgical disease and nonoperative management for solid organ injury, the open operative experience of current surgical residents has decreased significantly. This deficit poses a potentially adverse impact on both surgical training and surgical care. Simulation technology, with the potential to foster the development of technical skills in a safe, nonclinical environment, could be used to remedy this problem. In this study, we systematically review the current status of simulation technology in the training of open surgical skills with the aim of clarifying its role and promise in the education of surgical residents. METHODS: A systematic search of the PubMed database was performed with keywords: "surgical simulation," "skill," "simulat," "surgery," "surgery training," "validity," "surgical trainer," "technical skill," "surgery teach," "skill assessment," and "operative skill." The retrieved studies were screened, and additional studies identified by a manual search of the reference lists of included studies. RESULTS: Thirty-one studies were identified. Most studies used low fidelity bench models designed to train junior residents in more basic surgical skills. Six studies used complex open models to train senior residents in more advanced surgical techniques. "Boot camp" and workshops have been used by some authors for short periods of intense training in a specialized area, with good results. CONCLUSIONS: Despite the increasing use of simulation in the technical training of surgical residents, few studies have focused on the use of simulation in the training of open surgical skills. This is particularly true with regard to skills required to competently perform technically challenging open maneuvers under urgent, life-threatening circumstances. In an era marked by a decline in open operative experience, there is a need for simulation-based studies that not only promote and evaluate the acquisition of such less commonly performed techniques but also determine the efficacy with which they can be transferred from a simulated environment to a patient in an operating room.

Simulation and patient safety: evaluative checklists for central venous catheter insertion.

In the advent of concerns for patient safety, simulation training is emerging as a method to train healthcare providers to perform invasive procedures such as central venous catheter (CVC) insertion while minimising harmful complications to the patient. New technologies in medical simulation have begun to shift research attention to the performance component of clinical competency. Accurate assessment of healthcare provider competence is a major priority in medical education necessitating the development of valid and reliable assessment tools. In the past year alone, nine evaluative tools, both global rating scales and procedural checklists, have been published in the research literature to evaluate the insertion of CVCs. A review of the advantages of published evaluation tools helps inform users with regard to the critical components necessary for a checklist. Ease of use, ability to be completed by a non-expert, categorical breakdown of critical actions involved in CVC insertion and the need for a comprehensive stepwise procedural checklist are discussed. The development of an ideal checklist may improve future competency-based training and performance evaluation in the clinical setting. A more thorough understanding of the status of checklists as evaluation tools in assessing performance of invasive procedures will lead to better training protocols and ultimately to improved patient safety.

Simulation training in central venous catheter insertion: improved performance in clinical practice.

PURPOSE: To determine whether simulation training of ultrasound (US)-guided central venous catheter (CVC) insertion skills on a partial task trainer improves cannulation and insertion success rates in clinical practice. METHOD: This prospective, randomized, controlled, single-blind study of first- and second-year residents occurred at a tertiary care teaching hospital from January 2007 to September 2008. The intervention group (n = 90) received a didactic and hands-on, competency-based simulation training course in US-guided CVC insertion, whereas the control group (n = 95) received training through a traditional, bedside apprenticeship model. Success at first cannulation and successful CVC insertion served as the primary outcomes. Secondary outcomes included reduction in technical errors and decreased mechanical complications. RESULTS: Blinded independent raters observed 495 CVC insertions by 115 residents over a 21-month period. Successful first cannulation occurred in 51% of the intervention group versus 37% of the control group (P = .03). CVC insertion success occurred for 78% of the intervention group versus 67% of the control group (P = .02). Simulation training was independently and significantly associated with success at first cannulation (odds ratio: 1.7; 95% confidence interval: 1.1-2.8) and with successful CVC insertion (odds ratio: 1.7; 95% confidence interval: 1.1-2.8)--both independent of US use, patient comorbidities, or resident specialty. No significant differences related to technical errors or mechanical complications existed between the two groups. CONCLUSIONS: Simulation training was associated with improved in-hospital performance of CVC insertion. Procedural simulation was associated with improved residents' skills and was more effective than traditional training.

The development of an independent rater system to assess residents' competence in invasive procedures.

PURPOSE: To design an independent rater (IR) direct observation system to monitor invasive procedures performed by residents in the hospital setting. METHOD: The authors recruited, trained, and tested nonphysicians to become IRs for an Agency for Healthcare Research and Quality-funded study evaluating the impact of partial task simulation training of ultrasound-guided central venous catheter (CVC) insertion on skills transfer at a major academic medical center. IR applicants completed four hours of training: a two-hour didactic session and a two-hour testing session, including observation of 5 of 10 choreographed CVC insertion videotapes and completion of a 50-data-point procedural checklist. Eligibility to be hired as an IR included timing the procedure accurately, detecting technical errors and complications, and completing the procedural checklist accurately. RESULTS: Thirty-eight IR trainees completed the training module and videotape examinations. Twenty-seven (71%) trainees met criteria to be hired IRs by accurately assessing the duration of the procedure to within one minute, validating the checklist to within 95% accuracy, and detecting technical errors/complications to within a 3% margin of error. The authors found no association between educational level and hired status, and all 13 IRs assessed after the study had maintained their skills. CONCLUSIONS: Recent innovations in procedural training with partial task simulation trainers necessitate developing methods to measure skills transfer from the simulator to the clinical setting. This description of a nonphysician IR direct observation system for CVC insertion offers a feasible tool that may be generalized to monitoring other invasive procedures.

Attracting surgical clerks to surgical careers: role models, mentoring, and engagement in the operating room.

BACKGROUND: Declining interest in careers in surgery among medical students has contributed to growing concerns about the surgical workforce. Although the medical student clerkship is likely to play an important role in shaping students' impressions of careers in surgery, little is known about the nature of this process. This study was designed to identify those aspects of the clerkship that are associated with medical students expressing an interest in surgery at the end of the clerkship. STUDY DESIGN: Medical students completed a survey at the end of the surgical clerkship assessing characteristics of the clerkship experience and students' level of interest in pursuing a career in surgery. The survey also included open-ended questions about students' reasons for having increased or decreased interest in surgery, which were systematically analyzed to complement quantitative findings. RESULTS: Students who sutured (p = 0.001), drove the camera (p = 0.01), stated that they felt involved in the operating room (p = 0.009), and saw residents (p = 0.03) and attendings (p = 0.0003) as positive role models were more likely to be interested in surgery. After adjusting for covariates, students who sutured in the operating room were 4.8 times as likely to be interested in surgery (95% CI, 1.5 to 14.9) and students who drove the camera were 7.2 times as likely to be interested in surgery (95% CI, 1.1 to 46.8). CONCLUSIONS: Students who participate actively in the operating room and those who are exposed to positive role models are more likely to be interested in pursuing a career in surgery. To optimize students' clerkship experiences and attract top candidates to the field of surgery, clerkship directors should encourage meaningful engagement of students in the operating room and facilitate mentoring experiences.

Teaching and assessing procedural skills using simulation: metrics and methodology.

Simulation allows educators to develop learner-focused training and outcomes-based assessments. However, the effectiveness and validity of simulation-based training in emergency medicine (EM) requires further investigation. Teaching and testing technical skills require methods and assessment instruments that are somewhat different than those used for cognitive or team skills. Drawing from work published by other medical disciplines as well as educational, behavioral, and human factors research, the authors developed six research themes: measurement of procedural skills; development of performance standards; assessment and validation of training methods, simulator models, and assessment tools; optimization of training methods; transfer of skills learned on simulator models to patients; and prevention of skill decay over time. The article reviews relevant and established educational research methodologies and identifies gaps in our knowledge of how physicians learn procedures. The authors present questions requiring further research that, once answered, will advance understanding of simulation-based procedural training and assessment in EM.