Correlation of Objective Assessment Data With General Surgery Resident In-Training Evaluation Reports and Operative Volumes.

OBJECTIVE: Faculty evaluations, ABSITE scores, and operative case volumes often tell little about true resident performance. We developed an objective structured clinical examination called the Surgical X-Games (5 rooms, 15 minutes each, 12-15 tests total, different for each postgraduate [PGY] level). We hypothesized that performance in X-Games will prove more useful in identifying areas of strength or weakness among general surgery (GS) residents than faculty evaluations, ABSITE scores, or operative cases volumes. DESIGN: PGY 2 to 5 GS residents (n = 35) were tested in a semiannual X-Games assessment using multiple simulation tasks: laparoscopic skills, bowel anastomosis, CT/CXR analysis, chest tube placement, etc. over 1 academic year. Resident scores were compared to their ABSITE, in-training evaluation reports, and operating room case numbers. SETTING: Academic medical center. PARTICIPANTS: PGY-2, 3, 4, and 5 GS residents at Mayo Clinic in Rochester, MN. RESULTS: Results varied greatly within each class except for staff evaluations: in-training evaluation reports medians for PGY-2s were 5.3 (range: 5.0-6.0), PGY-3s 5.9 (5.5-6.3), PGY-4s 5.6 (5.0-6.0), and PGY-5s were 6.1 (5.6-6.9). Although ABSITE and operating room case volumes fluctated greatly with each PGY class, only X-Games scores (median: PGY-2 = 82, PGY-3 = 61, PGY-4 = 76, and PGY-5 = 60) correlated positively (p < 0.05) with operative case volume and negatively (p < 0.05) with staff evaluations. CONCLUSIONS: X-Games assessment generated wide differentiation of resident performance quickly, inexpensively, and objectively. Although "Minnesota-nice" surgical staff may feel all GS trainees are "above average," objective assessment tells us otherwise.

Securing a Chest Tube Properly: A Simple Framework for Teaching Emergency Medicine Residents and Assessing Their Technical Abilities.

BACKGROUND: Quality-improvement efforts at our institution have identified chest tube dislodgement as a preventable complication of tube thoracostomy. Because proper fixation techniques are not well described in the literature and are seldom formally taught, techniques vary among residents. OBJECTIVE: Our aim was to develop and test a framework for teaching and assessing chest tube securement. METHODS: A repeated-measures study design was used. At baseline, 19 emergency medicine residents (program years 1-3) placed and secured a chest tube in a cadaver. After a 45-min proficiency-based teaching session using a low-cost chest tube simulator (approximate cost, $5), each resident again placed and secured a chest tube in a cadaver, followed by 3-month retention testing. All securements were evaluated by two raters using a four-point checklist and a five-point global assessment scale (GAS). The checklist addressed suture selection, tying knots down to the tube, wound approximation, and tube displacement relative to skin. RESULTS: After the initial educational intervention, median scores for the group improved significantly over baseline for the GAS (p < 0.001), checklist (p < 0.001), and amount of displacement (p = 0.01). At 3 months, GAS, checklist, and displacement scores did not differ significantly from the immediate post-test scores. Inter-rater reliability was substantial, with weighted κ values of .77 for the GAS and .70 for the checklist. CONCLUSIONS: Quality of chest tube securement by emergency medicine residents can be significantly improved with an inexpensive chest tube simulator and a brief workshop. The four-point checklist served as a reliable and effective means for teaching and assessing chest tube securement.

Maximum cosmesis for patients with primary hyperparathyroidism: a case for larger incisions.

While minimally invasive parathyroidectomy is an advantage to many properly selected patients, longer incisions and even wide skin resection may be optimal in a select few. We present an 80-year-old woman with primary hyperparathyroidism and bothersome excess neck skin and subcutaneous fat. The parathyroid adenoma was easily excised through a vertically-oriented cervical excision that removed an ellipse of fat and skin. Midline wound closure with a small Z-plasty to avoid wound tethering facilitated a cosmetic closure well within the surgical capabilities of endocrine surgeons. This technique is useful for select patients and their surgeons and may avoid the expense of cosmetic surgery. We offer this controversial case to highlight the pros and cons of maximizing efficient surgical care to our endocrine surgery patients.

Basic Cardiac Surgery Skills on Sale for $22.50: An Aortic Anastomosis Simulation Curriculum.

BACKGROUND: Current resident and student duty-hour restrictions necessitate efficient training, which may be aided by simulation. Data on the utility of low-cost simulation in cardiothoracic surgery are scant. We evaluated the effect and value of a low-cost, low-fidelity aortic anastomosis simulation curriculum. METHODS: Twenty participants (11 medical students, 9 residents) completed an aortic anastomosis on a porcine heart as a pretest. Participants were then provided access to a 14-minute online video created by a cardiac surgeon and given a low-cost task trainer for self-directed practice. Five weeks later, participants performed another aortic anastomosis on a porcine heart as a posttest. Pretest and posttest performances were filmed, deidentified, and graded blindly and independently by two cardiac surgeons using a standardized assessment tool (perfect score, 110; passing score, 58 or higher). Participants were surveyed anonymously after the posttest. RESULTS: The mean (SD) aortic anastomosis performance score improved significantly from pretest (53.3 [25.3]) to posttest (83.6 [15.3]; p < 0.001). Pass rates also improved significantly (35% versus 95%, p < 0.001). Medical students' scores improved most (p = 0.01). All 20 participants reported improved confidence in performing the task, and 18 believed that the online video was essential to better performance. The cost of the curriculum totaled $22.50 per participant, with 6 hours of total staff time required for assessment. CONCLUSIONS: An aortic anastomosis training and simulation curriculum improves the skills of student and resident trainees with minimal expense and staff time commitment. Such a curriculum may be of great value to both cardiothoracic training programs and their trainees.

Validity evidence for the Fundamentals of Laparoscopic Surgery (FLS) program as an assessment tool: a systematic review.

BACKGROUND: The Fundamentals of Laparoscopic Surgery (FLS) program uses five simulation stations (peg transfer, precision cutting, loop ligation, and suturing with extracorporeal and intracorporeal knot tying) to teach and assess laparoscopic surgery skills. We sought to summarize evidence regarding the validity of scores from the FLS assessment. METHODS: We systematically searched for studies evaluating the FLS as an assessment tool (last search update February 26, 2013). We classified validity evidence using the currently standard validity framework (content, response process, internal structure, relations with other variables, and consequences). RESULTS: From a pool of 11,628 studies, we identified 23 studies reporting validity evidence for FLS scores. Studies involved residents (n = 19), practicing physicians (n = 17), and medical students (n = 8), in specialties of general (n = 17), gynecologic (n = 4), urologic (n = 1), and veterinary (n = 1) surgery. Evidence was most common in the form of relations with other variables (n = 22, most often expert-novice differences). Only three studies reported internal structure evidence (inter-rater or inter-station reliability), two studies reported content evidence (i.e., derivation of assessment elements), and three studies reported consequences evidence (definition of pass/fail thresholds). Evidence nearly always supported the validity of FLS total scores. However, the loop ligation task lacks discriminatory ability. CONCLUSION: Validity evidence confirms expected relations with other variables and acceptable inter-rater reliability, but other validity evidence is sparse. Given the high-stakes use of this assessment (required for board eligibility), we suggest that more validity evidence is required, especially to support its content (selection of tasks and scoring rubric) and the consequences (favorable and unfavorable impact) of assessment.

Tube Thoracostomy: A Structured Review of Case Reports and a Standardized Format for Reporting Complications.

INTRODUCTION: Although seemingly straightforward, tube thoracostomy (TT) has been associated with complication rates as high as 30 %. A lack of a standardized nomenclature for reporting TT complications makes comparison and evaluation of reports impossible. We aim to develop a classification method in order to standardize the reporting of complications of TT and identify all reported complications of TT and time course in which they occurred to validate the reporting method. METHODS: A systematic search of MEDLINE, Scopus, EMBASE, and Cochrane Central Register of Controlled Trials and Database of Systematic Reviews from each databases inception through November 5, 2013 was conducted. Original articles written in the English language reporting TT complications were searched. This review adhered to preferred reporting items for systematic reviews and meta-analyses (PRISMA) standards. Duplicate reviewers abstracted case reports for inclusion. Cases were then sorted into one of the five complication categories by two reviewers, and in case of disagreements, settled by a third reviewer. RESULTS: Of 751 papers reporting TT complications, 124 case reports were included for analysis. From these reports, five main categories of TT complications were identified: insertional (n = 65); positional (n = 36); removal (n = 11); infective and immunologic (n = 7); and instructional, educational, or equipment related (n = 5). Placement of TT has occurred in nearly every soft tissue and vascular structure in the thoracic cavity and intra-abdominal organs. CONCLUSION: Our classification method provides further clarity and systematic standardization for reporting TT complications.

Video Skills Curricula and Simulation: A Synergistic Way to Teach 2-Layered, Hand-Sewn Small Bowel Anastomosis.

BACKGROUND: We sought to determine if general surgery (GS) interns could learn a side-to-side, 2-layered, hand-sewn small bowel anastomosis (HSBA) using an online instructional video and low-fidelity simulation model. METHODS: A 3-hour HSBA technical skills training session was held among GS interns. Participants were asked to write down the steps for performing a side-to-side, 2-layered HSBA (pretest). An online 13-minute instructional video on HSBA was then viewed. Low-fidelity bowel simulators were then provided for deliberate practice under staff supervision. A posttest (identical to pretest) concluded the session. The maximum test score was 20 points. At 4 months later, a retention test was administered. Trainees were anonymously surveyed to determine the session's educational value. Pretest, posttest, and retention test scores were compared. RESULTS: Participants were 25 GS interns. The mean pretest score was 5 (range: 0-11). Posttest scores improved (mean = 15; range: 11-19, p = 0.016), whereas retention test scores were stable (mean = 14; range: 8-18). Of those who participated in retention testing (24/25), 7 had now performed a 2-layered HSBA, 11 had witnessed HSBA, and 6 had neither performed nor witnessed an HSBA since the educational session. Retention test scores were higher among those who had performed HSBA (mean = 16; range: 13-18) vs those who had not performed nor witnessed an HSBA (mean = 14; range: 8-18, p = 0.04). Mean Likert scores supported the educational value of the session. CONCLUSION: Initial intern performance of HSBA was abysmal. A contemporary online video skills curriculum coupled with low-fidelity bowel simulators improved trainee knowledge of how to perform a 2-layered HSBA. This effect remained stable over 4 months.

Forequarter amputation for recurrent breast cancer.

INTRODUCTION: Localized excision combined with radiation and chemotherapy represents the current standard of care for recurrent breast cancer. However, in certain conditions a forequarter amputation may be employed for these patients. PRESENTATION OF CASE: We present a patient with recurrent breast cancer who had a complicated treatment history including multiple courses of chemotherapy, radiation, and local surgical excision. With diminishing treatment options, she opted for a forequarter amputation in an attempt to limit the spread of cancer. DISCUSSION: In our patient the forequarter amputation was utilized as a last resort to slow disease progression after she had failed multiple rounds of chemotherapy and received maximal radiation. Unfortunately, while she had symptomatic relief in the short-term, she had cutaneous recurrence of metastatic adenocarcinoma within 2 months of the procedure. In comparing this case with other reported forequarter amputations, patients with non-metastatic disease showed a mean survival of approximately two years. Furthermore, among patients who had significant pain prior to surgery, all patients reported pain relief, indicating a significant palliative benefit. This seems to indicate that our patient's unfortunate outcome was anomalous compared to that of most patients undergoing forequarter amputation for recurrent breast cancer. CONCLUSION: Forequarter amputation can be judiciously used for patients with recurrent or metastatic breast cancer. Patients with recurrent disease without evidence of distant metastases may be considered for curative amputation, while others may receive palliative benefit; disappointingly our patient achieved neither of these outcomes. In the long term, these patients may still have significant psychological problems.

Mentor-guided self-directed learning affects resident practice.

OBJECTIVE: Self-directed learning (SDL) can be as effective as instructor-led training. It employs less instructional resources and is potentially a more efficient educational approach. Although SDL is encouraged among residents in our surgical training program via 24-hour access to surgical task trainers and online modules, residents report that they seldom practice. We hypothesized that a mentor-guided SDL approach would improve practice habits among our residents. DESIGN: From 2011 to 2013, 12 postgraduate year (PGY)-2 general surgery residents participated in a 6-week minimally invasive surgery (MIS) rotation. At the start of the rotation, residents were asked to practice laparoscopic skills until they reached peak performance in at least 3 consecutive attempts at a task (individual proficiency). SETTING: Trainees met with the staff surgeon at weeks 3 and 6 to evaluate progress and review a graph of their individual learning curve. All trainees subsequently completed a survey addressing their practice habits and suggestions for improvement of the curriculum. RESULTS: By the end of the rotation, 100% of participants improved in all practiced tasks (p < 0.05), and each reported that they practiced more in this rotation than during rotations without mentor-guided SDL. Additionally, 6 (50%) residents reported that their skill level had improved relative to their peers. Some residents (n = 3) felt that the curriculum could be improved by including task-specific goals and additional practice sessions with the staff surgeon. CONCLUSIONS: Mentor-guided SDL stimulated surgical residents to practice with greater frequency. This repeated deliberate practice led to significantly improved MIS skills without significantly increasing the need for faculty-led instruction. Some residents preferred more discrete goal setting and increased mentor guidance.

Every surgical resident should know how to perform a cricothyrotomy: an inexpensive cricothyrotomy task trainer for teaching and assessing surgical trainees.

OBJECTIVE: Emergency cricothyrotomy is a rare but potentially lifesaving procedure. Training opportunities for surgical residents to learn this skill are limited, and many graduating residents have never performed one during their training. We aimed to develop and validate a novel and inexpensive cricothyrotomy task trainer that can be constructed from household items. DESIGN: A model was constructed using a toilet paper roll (trachea and larynx), Styrofoam (soft tissue), cardboard (thyroid cartilage), zip tie (cricoid), and fabric (skin). Participants were asked to complete a simulated cricothyrotomy procedure using the model. They were then evaluated using a 10-point checklist (5 points total) devised by 6 general surgeons. Participants were also asked to complete an anonymous survey rating the educational value and the degree of enjoyment regarding the model. SETTING: A tertiary care teaching hospital. PARTICIPANTS: A total of 54 students and general surgery residents (11 medical students, 32 interns, and 11 postgraduate year 3 residents). RESULTS: All 54 participants completed the training and assessment. The scores ranged from 0 to 5. The mean (range) scores were 1.8 (1-4) for medical students, 3.5 (1-5) for junior residents, and 4.9 (4-5) for senior-level residents. Medical students were significantly outperformed by junior- and senior-level residents (p < 0.001). Trainees felt that the model was educational (4.5) and enjoyable (4.0). CONCLUSIONS: A low-fidelity, low-cost cricothyrotomy simulator distinguished the performance of emergency cricothyrotomy between medical students and junior- and senior-level general surgery residents. This task trainer may be ideally suited to providing basic skills to all physicians in training, especially in settings with limited resources and clinical opportunities.

Assimilating endocrine anatomy through simulation: a pre-emptive strike!

BACKGROUND: We sought to determine if endocrine anatomy could be learned with the aid of a hands-on, low-cost, low-fidelity surgical simulation curriculum and pre-emptive 60-second YouTube video clip. METHODS: A 3-hour endocrine surgery simulation session was held on back-to-back Fridays. A video clip was made available to the 2nd group of learners. A comprehensive 40-point test was administered before (pre-test) and after (post-test) the sessions. RESULTS: General surgery interns (n = 26) participated. The video was viewed 19 times by 80% (12 of 15) of interns with access. Viewers outperformed nonviewers on subsequent post-testing (mean [SD], 29.7 [1.3] vs 24.4 [1.6]; P = .015). Mean scores on the anatomy section of the post-test were higher among viewers than nonviewers (mean [SD] 14.2 [.9] vs 10.3 [1.0]; P = .012). CONCLUSIONS: Low-cost simulation models can be used to teach endocrine anatomy. Pre-emptive viewing of a 60-second video may have been a key factor resulting in higher post-test scores compared with controls, suggesting that the video intervention improved the educational effectiveness of the session.

Catering to millennial learners: assessing and improving fine-needle aspiration performance.

OBJECTIVES: Fine-needle aspiration (FNA) of a palpable cervical lymph node is a straightforward procedure that should be safely performed by educated general surgery (GS) trainees. Retention of technical skill is suspect, unless sequential learning experiences are provided. However, voluntary learning experiences are no guarantee that trainees will actually use the resource. DESIGN: A 3-minute objective structured assessment of technical skill-type station was created to assess GS trainee performance using FNA. Objective criteria were developed and a checklist was generated (perfect score = 24). Following abysmal performance of 11 postgraduate year (PGY)-4 trainees on the FNA station of our semiannual surgical skills assessment ("X-Games"), we provided all GS residents with electronic access to a 90-second YouTube video clip demonstrating proper FNA technique. PGY-2 (n = 11) and PGY-3 (n = 10) residents subsequently were tested on FNA technique 5 and 12 days later, respectively. RESULTS: All 32 trainees completed the station in less than 3 minutes. Overall scores ranged from 4 to 24 (mean = 14.9). PGY-4 residents assessed before the creation of the video clip scored lowest (range: 4-18, mean = 11.4). PGY-3 residents (range: 10-22, mean = 17.8) and PGY-2 residents (range: 10-24, mean = 15.8) subsequently scored higher (p < 0.05). Ten residents admitted watching the 90-second FNA video clip and scored higher (mean = 21.7) than the 11 residents that admitted they did not watch the clip (mean = 13.1, p < 0.001). Of the 11 trainees who did not watch the video, 6 claimed they did not have time, and 5 felt it would not be useful to them. CONCLUSIONS: Overall performance of FNA was poor in 32 midlevel GS residents. However, a 90-second video clip demonstrating proper FNA technique viewed less than 2 weeks before the examination significantly elevated scores. Half of trainees given the chance to learn online did not take the opportunity to view the video clip. Although preemptive learning is effective, future efforts should attempt to improve self-directed learning habits of trainees and evaluate actual long-term skill retention.

The rationale for combining an online audiovisual curriculum with simulation to better educate general surgery trainees.

BACKGROUND: Surgery interns' training has historically been weighted toward patient care, operative observation, and sleeping when possible. With more protected free time and less clinical time, real educational hours for trainees in 2013 are precious. METHODS: We created a 20-session (3 hours each) simulation curriculum (with pre- and post-tests) and a 24/7 online audiovisual (AV) curriculum for surgery interns. Friday morning simulation sessions emphasize operative skills and judgment. AV clips (using operating room, whiteboard, and simulation center videos) take learners through 20 different general surgery operations with follow-up quizzes. We report our early experience with this novel setup. RESULTS: Thirty-two surgical interns (2012-2013) attended simulation sessions on 20 separate subjects (hernia, breast, hepatobiliary, endocrine, etc). Post-test scores improved (P < .05) and trainees enjoyed using surgical skills for 3 hours each Friday morning (mean, >4.5; Likert scale, 1-5). The AV curriculum feedback is similar (mean, >4.3) and usage is available 24/7 preparing learners for both operating room and simulation sessions. Most simulation sessions utilize low-fidelity models to keep costs <$50 per session. Scores on our semiannual Surgical Olympics (mean score of 49.6 in July vs 82.9 in January; P < .05) improved significantly, suggesting that interns are improving their surgical skills and knowledge. CONCLUSION: Residents enjoy and learn from the step-by-step, in-house, AV curriculum and both appreciate and thrive on the 'hands-on' simulation sessions mimicking operations they see in real operating rooms. The cost of these programs is not prohibitive and the programs offer simulated repetitions for duty-hour-regulated trainees.

Assessment of virtual reality robotic simulation performance by urology resident trainees.

OBJECTIVES: To examine resident performance on the Mimic dV-Trainer (MdVT; Mimic Technologies, Inc., Seattle, WA) for correlation with resident trainee level (postgraduate year [PGY]), console experience (CE), and simulator exposure in their training program to assess for internal bias with the simulator. DESIGN: Residents from programs of the Southeastern Section of the American Urologic Association participated. Each resident was scored on 4 simulator tasks (peg board, camera targeting, energy dissection [ED], and needle targeting) with 3 different outcomes (final score, economy of motion score, and time to complete exercise) measured for each task. These scores were evaluated for association with PGY, CE, and simulator exposure. SETTING: Robotic skills training laboratory. PARTICIPANTS: A total of 27 residents from 14 programs of the Southeastern Section of the American Urologic Association participated. RESULTS: Time to complete the ED exercise was significantly shorter for residents who had logged live robotic console compared with those who had not (p = 0.003). There were no other associations with live robotic console time that approached significance (all p ≥ 0.21). The only measure that was significantly associated with PGY was time to complete ED exercise (p = 0.009). No associations with previous utilization of a robotic simulator in the resident's home training program were statistically significant. CONCLUSIONS: The ED exercise on the MdVT is most associated with CE and PGY compared with other exercises. Exposure of trainees to the MdVT in training programs does not appear to alter performance scores compared with trainees who do not have the simulator.

Synchronous splenectomy during cholecystectomy for hereditary spherocytosis: is it really necessary?

BACKGROUND/PURPOSE: Expert guidelines recommend performing synchronous splenectomy in patients with mild hereditary spherocytosis (HS) and symptoms of gallstone disease. This recommendation has not been widely explored in the literature. The aim of this study is to determine if our data support expert opinion and if different practice patterns should exist. METHODS: This is an IRB-approved retrospective study. All HS patients under 18 years of age who underwent cholecystectomy for symptomatic gallstones at a single institution between 1981 and 2009 were identified. Patients who underwent cholecystectomy without concurrent splenectomy were reviewed retrospectively for future need for splenectomy and evidence of recurrent gallstone disease. RESULTS: Of the 32 patients identified, 27 underwent synchronous splenectomy. The remaining 5 patients underwent cholecystectomy without splenectomy and had a mean age of 9.4 years. One of the 5 patients eventually required splenectomy for left upper quadrant pain. None of the remaining 4 required hospitalization for symptoms related to hemolysis or hepatobiliary disease. Median follow-up is 15.6 years. CONCLUSION: The need for splenectomy in patients with mild HS and symptomatic cholelithiasis should be assessed on a case by case basis. Our recommendation is to not perform synchronous splenectomy in conjunction with cholecystectomy for these patients if no indication for splenectomy exists.

"iTrainers"--novel and inexpensive alternatives to traditional laparoscopic box trainers.

OBJECTIVE: To evaluate the use of 2 inexpensive laparoscopic trainers (iTrainers) constructed of easily attainable materials and portable tablets (iPads). METHODS: Two different laparoscopic trainers were constructed using a cardboard box, thumbtacks, and Velcro tape (box trainer). A separate box was constructed using the same supplies with a 3-ring binder (binder trainer). An iPad was used as the camera and monitor for both trainers. A total of 10 participants, including 4 junior surgical residents, 4 senior surgical residents, and 2 surgical staff, completed 3 Fundamentals of Laparoscopic Surgery (FLS) tasks using the 2 "iTrainers." Participants then completed the same tasks on a traditional FLS box trainer. All 10 participants were asked to complete a 13-question survey after the exercises. RESULTS: All the participants (100%) had access to an "iPad" for the visualization component. The 10 participants completed all 3 tasks on all 3 trainers. Senior residents outperformed junior residents on 6 of the 9 total tasks. Attending surgeons outperformed all residents on all tasks and trainers. Survey results revealed the cardboard box "iTrainer" to be the most practical and easiest to construct. CONCLUSION: "iTrainers" are an inexpensive and easy-to-construct alternative to traditional box trainers that might have construct validity as demonstrated in this trial. The box trainer might be easier to construct and have more similarities to the FLS trainer than the binder iTrainer.