At-home medical student simulation: achieving knot-tying proficiency using video-based assessment.

Purpose: Due to the pandemic, we restructured our medical student knot-tying simulation to a virtual format. This study evaluated curriculum feasibility and effectiveness. Methods: Over 4 weeks, second-year medical students (n = 229) viewed a video tutorial (task demonstration, errors, scoring) and self-practiced to proficiency (no critical errors, < 2 min) using at-home suture kits (simple interrupted suture, instrument tie, penrose drain model). Optional virtual tutoring sessions were offered. Students submitted video performance for proficiency verification. Two sets of 14 videos were viewed by two surgeons until inter-rater reliability (IRR) was established. Students scoring "needs remediation" attended virtual remediation sessions. Non-parametric statistics were performed using RStudio. Results: All 229 medical students completed the curriculum within 1-4 h; 1.3% attended an optional tutorial. All videos were assessed: 4.8% "exceeds expectations", 60.7% "meets expectations", and 34.5% "needs remediation." All 79 needing remediation due to critical errors achieved proficiency during 1-h group sessions. IRR Cohen's κ was 0.69 (initial) and 1.0 (ultimate). Task completion time was 56 (47-68) s (median [IQR]); p < 0.01 between all pairs. Students rated the overall curriculum (79.2%) and overall curriculum and video tutorial effectiveness (92.7%) as "agree" or "strongly agree". No definitive preference emerged regarding virtual versus in-person formats; however, 80.2% affirmed wanting other at-home skills curricula. Comments supported home practice as lower stress; remediation students valued direct formative feedback. Conclusions: A completely virtual 1-month knot-tying simulation is feasible and effective in achieving proficiency using video-based assessment and as-needed remediation strategies for a large student class.

Optimizing Medical Student Clerkship Schedules Using a Novel Application of the Hungarian Algorithm.

PROBLEM: Medical students often have preferences regarding the order of their clinical rotations, but assigning rotations fairly and efficiently can be challenging. To achieve a solution that optimizes assignments (i.e., maximizes student satisfaction), the authors present a novel application of the Hungarian algorithm, designed at the University of Texas Southwestern Medical Center (UTSW), to assign student schedules. APPROACH: Possible schedules were divided into distinct pathway options with k total number of seats. Each of n students submitted a ranked list of their top 5 pathway choices. An n × k matrix was formed, where the location (i, j) represented the cost associated with student i being placed in seat j. Progressively higher costs were assigned to students receiving less desired pathways. The Hungarian algorithm was then used to find the assignments that minimize total cost. The authors compared the performance of the Hungarian algorithm against 2 alternative algorithms (i.e., the rank and lottery algorithms). To evaluate the 3 algorithms, 4 simulations were conducted with different popularity weights for different pathways and were run across 1,000 trials. The algorithms were also compared using 3 years of UTSW student preference data for the classes of 2019, 2020, and 2021. OUTCOMES: In all 4 computer simulations, the Hungarian algorithm resulted in more students receiving 1 of their top 3 choices and fewer students receiving none of their preferences. Similarly, for UTSW student preference data, the Hungarian algorithm resulted in more students receiving 1 of their top 3 preferences and fewer students receiving none of their ranked preferences. NEXT STEPS: This approach may be broadly applied to scheduling challenges in undergraduate and graduate medical education. Furthermore, by manipulating cost values, additional constraints can be enforced (e.g., requiring certain seats to be filled, attempting to avoid schedules that begin with a student's desired specialty).

Assessing quality and resources during campus-wide simulation integration.

INTRODUCTION: Our simulation center, supported by four departments (Surgery, OB/GYN, Urology, and Anesthesiology), is accredited as a comprehensive Accredited Educational Institute (AEI) and is now expanding to accommodate all departments on campus. METHODS: A 61-point questionnaire was administered to 44 stakeholders, representing all of UME and GME. Data were compared for AEI vs. non-AEI activities. RESULTS: Responses were collected from all 44 groups (100% response rate). Overall, 43 simulation activities were hosted within the AEI and 40 were hosted by non-AEI stakeholders. AEI activities were more likely to be mandatory (93% vs. 75%, p = 0.02), have written learning objectives (79% vs 43%, p < 0.001), and use validated assessment metrics (33% vs. 13%, p = 0.03). CONCLUSION: These data suggest that the AEI courses are more robust in terms of structured learning and assessment compared to non-AEI courses. Campus-wide application of uniform quality standards is anticipated to require significant faculty, course, and program development.

Developing a comprehensive, proficiency-based training program for robotic surgery.

INTRODUCTION: Robotically assisted surgery has become very popular for numerous surgical disciplines, yet training practices remain variable with little to no validation. The purpose of this study was to develop a comprehensive, proficiency-based robotic training program. METHODS: A skill deconstruction list was generated by observation of robotic operations and interviews with experts. Available resources were used, and other components were developed as needed to develop a comprehensive, proficiency-based curriculum to teach all deconstructed skills. Preliminary construct and content validity and curriculum feasibility were evaluated. RESULTS: The skill deconstruction list contained 23 items. Curricular components included an online tutorial, a half-day interactive session, and 9 inanimate exercises with objective metrics. Novice (546 ± 26) and expert (923 ± 60) inanimate composite scores were different (P < .001), supporting construct validity, and substantial pre-test to post-test improvement was noted after successful training completion. All 23 deconstructed skills were rated as highly relevant (4.9 ± 0.5; 5-point scale), and no skills were absent from the curriculum, supporting content validity. CONCLUSION: These data suggest that this proficiency-based training curriculum comprehensively addresses the skills necessary to perform robotic operations with early construct and content validity and feasibility demonstrated. Further validation is encouraged.

Comprehensive proficiency-based inanimate training for robotic surgery: reliability, feasibility, and educational benefit.

BACKGROUND: We previously developed a comprehensive proficiency-based robotic training curriculum demonstrating construct, content, and face validity. This study aimed to assess reliability, feasibility, and educational benefit associated with curricular implementation. METHODS: Over an 11-month period, 55 residents, fellows, and faculty (robotic novices) from general surgery, urology, and gynecology were enrolled in a 2-month curriculum: online didactics, half-day hands-on tutorial, and self-practice using nine inanimate exercises. Each trainee completed a questionnaire and performed a single proctored repetition of each task before (pretest) and after (post-test) training. Tasks were scored for time and errors using modified FLS metrics. For inter-rater reliability (IRR), three trainees were scored by two raters and analyzed using intraclass correlation coefficients (ICC). Data from eight experts were analyzed using ICC and Cronbach's α to determine test-retest reliability and internal consistency, respectively. Educational benefit was assessed by comparing baseline (pretest) and final (post-test) trainee performance; comparisons used Wilcoxon signed-rank test. RESULTS: Of the 55 trainees that pretested, 53 (96 %) completed all curricular components in 9-17 h and reached proficiency after completing an average of 72 ± 28 repetitions over 5 ± 1 h. Trainees indicated minimal prior robotic experience and "poor comfort" with robotic skills at baseline (1.8 ± 0.9) compared to final testing (3.1 ± 0.8, p < 0.001). IRR data for the composite score revealed an ICC of 0.96 (p < 0.001). Test-retest reliability was 0.91 (p < 0.001) and internal consistency was 0.81. Performance improved significantly after training for all nine tasks and according to composite scores (548 ± 176 vs. 914 ± 81, p < 0.001), demonstrating educational benefit. CONCLUSION: This curriculum is associated with high reliability measures, demonstrated feasibility for a large cohort of trainees, and yielded significant educational benefit. Further studies and adoption of this curriculum are encouraged.

Proficiency-based training for robotic surgery: construct validity, workload, and expert levels for nine inanimate exercises.

BACKGROUND: We previously developed nine inanimate training exercises as part of a comprehensive, proficiency-based robotic training curriculum that addressed 23 unique skills identified via task deconstruction of robotic operations. The purpose of this study was to evaluate construct validity, workload, and expert levels for the nine exercises. METHODS: Expert robotic surgeons (n = 8, fellows and faculty) and novice trainees (n = 4, medical students) each performed three to five consecutive repetitions of nine previously reported exercises (five FLS models with or without modifications and four custom-made models). Each task was scored for time and accuracy using modified FLS metrics; task scores were normalized to a previously established (preliminary) proficiency level and a composite score equaled the sum of the nine normalized task scores. Questionnaires were administered regarding prior experience. After each exercise, participants completed a validated NASA-TLX Workload Scale to rate the mental, physical, temporal, performance, effort, and frustration levels of each task. RESULTS: Experts had performed 119 (range = 15-600) robotic operations; novices had observed ≤ 1 robotic operation. For all nine tasks and the composite score, experts achieved significantly better performance than novices (932 ± 67 vs. 618 ± 111, respectively; P < 0.001). No significant differences in workload between experts and novices were detected (32.9 ± 3.5 vs. 32.0 ± 9.1, respectively; n.s.). Importantly, frustration ratings were relatively low for both groups (4.0 ± 0.7 vs. 3.8 ± 1.6, n.s.). The mean performance of the eight experts was deemed suitable as a revised proficiency level for each task. CONCLUSION: Using objective performance metrics, all nine exercises demonstrated construct validity. Workload was similar between experts and novices and frustration was low for both groups. These data suggest that the nine structured exercises are suitable for proficiency-based robotic training.

Content and face validity of a comprehensive robotic skills training program for general surgery, urology, and gynecology.

BACKGROUND: The authors previously developed a comprehensive, proficiency-based robotic training curriculum that aimed to address 23 unique skills identified via task deconstruction of robotic operations. The purpose of this study was to determine the content and face validity of this curriculum. METHODS: Expert robotic surgeons (n = 12) rated each deconstructed skill regarding relevance to robotic operations, were oriented to the curricular components, performed 3 to 5 repetitions on the 9 exercises, and rated each exercise. RESULTS: In terms of content validity, experts rated all 23 deconstructed skills as highly relevant (4.5 on a 5-point scale). Ratings for the 9 inanimate exercises indicated moderate to thorough measurement of designated skills. For face validity, experts indicated that each exercise effectively measured relevant skills (100% agreement) and was highly effective for training and assessment (4.5 on a 5-point scale). CONCLUSIONS: These data indicate that the 23 deconstructed skills accurately represent the appropriate content for robotic skills training and strongly support content and face validity for this curriculum.

Laparoscopic esophagomyotomy for achalasia: how I do it.

INTRODUCTION: The pathophysiology, diagnosis, and treatment options for achalasia are briefly discussed, followed by a description of the minimally invasive surgical approaches to this disease, as practiced by the authors. SUMMARY: Laparoscopic myotomy is performed routinely at our institution in the lithotomy position under endoscopic control. The techniques for performing the myotomy, the use of fundoplication, and the adaptation of this approach to use the surgical robot are described. Laparoscopic esophagomyotomy has been highly effective, durable, safe, and widely accepted by patients. There is less data about the robotic approach, but increased degrees of freedom afforded by articulation in the instruments promises finer control and possibly lower perforation rates.

Ultrasound-guided breast biopsy curriculum for surgical residents.

Ultrasound-guided breast biopsy has emerged as a common method for lesion diagnosis. This study sought to instruct and measure surgical residents' performance in ultrasound-guided breast biopsy and evaluate their thoughts regarding it. Thirteen (n = 13) senior residents completed a written pretest or questionnaire and 2.5 hours of simulated breast core and vacuum needle biopsies. Residents then completed the same written exam, and their biopsy performance was rated. There was 13% overall improvement of written test scores, and 73% resident improved comfort levels with performing biopsies. Successfully performed core biopsies and vacuum biopsies were 86% and 83%, respectively. All residents reported that instruction in ultrasound-guided breast biopsy is very important and should be mandatory in residency training programs. With concentrated instruction, residents are able to learn ultrasound-guided breast biopsy with improvement in objective measures and self-confidence levels. Resident feedback was positive and emphasized the importance of this training in surgical residency curriculums.

Costs and utilization of intraoperative cholangiography.

BACKGROUND: Routine intraoperative cholangiography (IOC) has been advocated as a viable strategy to reduce common bile duct injury (CDI) during cholecystectomy. This is predicated, in part, on the low cost of IOC, making it a cost-effective preventive strategy. Using billed hospital charges as a proxy for costs, we sought to estimate costs associated with the performance of IOC. METHODS: The 2001 National Inpatient Survey (NIS) database was assessed for IOC utilization and associated charges. Average charges for hospital admission where the primary procedure was laparoscopic cholecystectomy were compared for those associated with and without the performance of IOC. RESULTS: Eighteen percent of cholecystectomies were performed in facilities that never perform IOC. Routine IOC (defined as >75% of cholecystectomies performed in any one hospital having a concomitant IOC) was performed in only 11% of hospitals. In the remaining 71% of hospitals, selective IOC was performed. IOCs were associated with US $706-739 in additional hospital charges when performed in conjunction with laparoscopic cholecystectomy. We project a cost of US $371,356 to prevent a single bile duct injury by using routine cholangiography. CONCLUSION: We conclude that only a minority of hospitals performs cholecystectomies with routine IOC. Because of the significant amount of hospital charges attributable to IOC, routine IOC is not cost-effective as a preventative measure against bile duct injury during cholecystectomy.

Indications for selective intraoperative cholangiography.

The indications for selective intraoperative cholangiography (IOC) include a clinical history of jaundice, pancreatitis, elevated bilirubin level, abnormal liver function test results, increased amylase levels, a high lipase level, or dilated common bile duct on preoperative ultrasonography. Although these clinical features are widely accepted as indications for IOC, they have not been tested for their ability to predict choledocholithiasis. Charts were reviewed for a 6-month time period in 2003 at Parkland Memorial Hospital for all patients undergoing cholecystectomy. Univariate analysis and logistic regression were used to determine which factors predicted choledocholithiasis. Of the 572 patients undergoing cholecystectomies during the study period, 189 underwent IOC and common bile duct stones were found in 57. Only preoperative hyperbilirubinemia or ultrasonograph identification of common bile duct dilation reliably predicted choledocholithiasis. There were 13 cases of choledocholithiasis that would not have been identified by preoperative hyperbilirubinemia or an enlarged common bile duct. However, common bile duct stones were clinically significant in only 2 of the 13 cases. One of these was treated with postoperative endoscopic retrograde cholangiopancreatography, and the other was treated with laparoscopic common bile duct exploration. Preoperative identification of a dilated common bile duct or elevated bilirubin levels can be the sole criteria for performing IOC on a selective basis in patients without malignancy. Reliance on a history of remote jaundice, pancreatitis, elevated liver function test values, or pancreatic enzymes results in unnecessary IOCs.

Do resident duty hour restrictions reduce technical complications of emergency laparoscopic cholecystectomy?

BACKGROUND: The impact of resident duty hour restrictions on patient care has not been assessed. STUDY DESIGN: We studied 275 patients undergoing emergency cholecystectomy before and after duty hour regulations instituted by the Accreditation Council for Graduate Medical Education. Operations were stratified into 6-hour intervals from the time in-hospital call began. Procedure-related complications (bile duct injury, cystic duct leak, abdominal hemorrhage, trocar injury, intraabdominal/wound infection, unrecognized retained stone) were the primary outcomes variables. RESULTS: Complications occurred after 7 of 107 (6.5%) operations performed before duty hour restrictions, which was not different from 15 of 168 (8.9%) after duty hour restrictions. In both periods, all complications followed operations that began within the first 18 hours of duty. Patients with complications had longer operative times (p = 0.038) and a higher proportion of operations lasting 120 minutes or longer (p = 0.006). Comparing patients with and without complications, there were no significant differences in patient demographics, operative complexity, or PGY level of the surgeon. Only operative time of 120 minutes or longer retained significance in the multivariable model (p = 0.0023; odds ratio, 4.05; 95% CI, 1.65-9.97). CONCLUSIONS: There was no correlation between imposition of duty hour restrictions and technical complication rates in this study. Duration of operative time of 120 minutes or longer was the only independent marker, suggesting that technical complications are a function of operative complexity, not duration of duty. These data suggest that duty hour restrictions might not have a measurable influence on the surgical complication rate after emergency cholecystectomy.

Technical complications are rising as common duct exploration is becoming rare.

BACKGROUND: Both hospital and surgeon volume influence outcomes. With introduction of new technologies, some procedures are now performed less frequently. ERCP has replaced the need for common duct exploration (CDE) in most cases of choledocholithiasis. We explored the secular trends and outcomes of CDE and how they have changed relative to introduction of ERCP. STUDY DESIGN: The National Hospital Discharge Survey database was analyzed for the years 1979 to 2001. Procedural frequency of ERCP and CDE was determined. Charlson and Elixhauser comorbidity indices were used to characterize patients' disease burden for the years 1993 to 2001. Length of stay, mortality, and complication rates for each procedure were determined. RESULTS: At the beginning of the study period, an estimated 47,000 CDEs were performed annually. These declined to 7,700 per year as ERCP increased to 42,500 procedures per year at the end of the study period. CDE complication rates increased from 3.4% to 17.4% over the same period. Comorbidity analysis for the years 1993 to 2001 revealed that ERCP and CDE patients had equivalent disease burdens. Technical complication rates rose in parallel to the increased overall CDE complication rate. CONCLUSIONS: ERCP has replaced the need for most but not all CDE. With diminished CDE experience at a national level, the complication rate has markedly increased, at least in part from technical complications. Both choledocholithiasis treatment algorithms and clinical training paradigms need to account for the rarity of CDE and high complication rates associated with it, by incorporation of training modules in surgical residencies and advocating referral to centers having expertise in biliary tract operations from surgeons with little CDE experience.