Establishing validity evidence for device-assisted advanced laparoscopic suturing tasks using simulation.

BACKGROUND: Laparoscopic suturing (LS) is an essential technique required for a wide range of procedures, and it is one of the most challenging for surgical trainees to master. We designed and collected validity evidence for advanced LS tasks using an automated suturing device and evaluated the perceived educational value of the tasks. METHODS: This project was a multicentre prospective study involving McGill University, University of Toronto (UofT), and Louisiana State University (LSU) Health New Orleans. Novice (NS) and experienced (ES) surgeons performed suturing under tension (UT) and continuous suturing (CS) tasks. ES performed the tasks twice to establish proficiency benchmarks, and they were interviewed to develop formative feedback tools (FFT). Participants were assessed on completion time, error, Global Operative Assessment of Laparoscopic Skills (GOALS), and FFT. Data were analyzed using descriptive and inferential statistical methods. RESULTS: Twenty-seven participants (13 ES, 14 NS, median age 34 years; 85% male) completed the study. Eight were attending surgeons, 7 fellows, 4 PGY5, 5 PGY4, and 3 PGY3 (18 from McGill, 5 UofT, and 4 LSU). Comparing ES and NS, for UT task, ES had significantly greater task scores (570 [563-648] vs 323 [130-464], p value 0.00036) and GOALS scores (14 [13-16] vs 10 [8-12], p value 0.0038). Similarly, for CS, ES had significantly greater task scores (976 [959-1010] vs 785 [626-856], p value 0.00009) and GOALS scores (16 [12-17] vs 12.5 [8.25-15], p value 0.028). After FFTs were developed, comparing ES and NS, for both UT and CS tasks, ES had significantly greater FFT scores (UT 25 [24-26] vs 17 [14-20], p value 0.0016 and CS 30 [27-32] vs 22[17.2-25.8], p value 0.00061). CONCLUSION: In conclusion, preliminary validity evidence was provided for the tasks. Once further validity evidence is established, incorporating the tasks into the training curricula could improve trainee skills and help to meet the need for better advanced suturing models.

Development of a simulation curriculum to teach and assess advanced laparoscopic suturing skills using telesimulation: a feasibility study.

BACKGROUND: Telesimulation helps overcome limitations in time and local expertise by eliminating the need for the learner and educator to be physically co-located, especially important during COVID-19. We investigated whether teaching advanced laparoscopic suturing (ALS) through telesimulation is feasible, effective, and leads to improved suturing in the operating room (OR). METHODS: In this prospective feasibility study, three previously developed 3D-printed ALS tasks were used: needle handling (NH), suturing under tension (UT), and continuous suturing (CS). General surgery residents (PGY4-5) underwent 1-month of telesimulation training, during which an expert educator at one site remotely trained residents at the other site over 2-3 teaching sessions. Trainees were assessed in the three tasks and in the OR at three time points: baseline(A1), control period(A2), and post-intervention(A3) and completed questionnaires regarding educational value and usability of telesimulation. Paired t-test was used to compare scores between the three assessment points. RESULTS: Six residents were included. Scores for UT improved significantly post-intervention A3(568 ± 60) when compared to baseline A1(416 ± 133) (p < 0.019). Similarly, scores for CS improved significantly post-intervention A3(756 ± 113) vs. baseline A1(539 ± 211) (p < 0.02). For intraoperative assessments, scores improved significantly post-intervention A3(21 ± 3) when compared to both A1(17 ± 4) (p < 0.018) and A2(18 ± 4) (p < 0.0008). All residents agreed that tasks were relevant to practice, helped improve technical competence, and adequately measured suturing skill. All residents found telesimulation easy to use, had strong educational value, and want the system to be incorporated into their training. CONCLUSION: The use of telesimulation for remotely training residents using ALS tasks was feasible and effective. Residents found value in training using the tasks and telesimulation system, and improved ALS skills in the OR. As the pandemic has caused a major structural shift in resident education, telesimulation can be an effective alternative to on-site simulation programs. Future research should focus on how telesimulation can be effectively incorporated into training programs.

Defining the key skills required to perform advanced laparoscopic procedures: a qualitative descriptive study.

BACKGROUND: Simulation is widely used to teach and assess fundamental laparoscopic skills; however, program directors have reported that current simulation programs do not meet the needs for trainees and surgeons learning advanced laparoscopic procedures (ALP). The purpose of our study was to identify the key skills required to perform ALP, to serve as the basis to establish an advanced laparoscopic skills training program. METHODS: Semi-structured interviews were conducted with attending surgeons, fellows, and senior residents in general surgery, gynaecology, and urology. The questions were developed through an iterative process using relevant literature, expert opinions, and in consultation with a qualitative researcher. Interviews were conducted in person, over the phone, or by videoconference, and inductive thematic analysis was performed. RESULTS: 25 interviews were conducted with 16 attending surgeons and 9 fellows/residents from 9 institutions in Canada and USA. Twenty-one skills were identified to be important when performing ALP. The skills most commonly described by faculty were the following : (a) suturing, (b) dissection, (c) procedural expertise, (d) retraction and exposure, and (e) familiarity with relevant anatomy as viewed through the laparoscope. The skills most commonly described by trainees were the following: (a) suturing, (b) dissection, (c) procedural expertise, (d) trocar positioning, and (e) patient factors. There was a large difference between the importance the faculty attributed to the 'Retraction and Exposure' skill compared to the trainees. CONCLUSION: This study identified key skills that are important when performing ALP. In order to address the current needs of trainees/surgeons learning ALP, this work provides the building blocks for the development of an advanced laparoscopic surgery simulation program.

Is there a gender bias in the advancement to SAGES leadership?

BACKGROUND: The proportion of women in surgery has risen significantly yet there remains gender discrepancies in upper leadership positions in academia. Specialty societies play an important role in academic advancement but the progression of women in surgical societies has not been studied. The purpose of this study was to determine if there are gender differences in advancement within the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) leadership. METHODS: A retrospective audit of all SAGES committee members (CM) from 1992 to 2018 was performed. The overall membership gender distribution was available from 2010 to 2018. Leadership positions included Committee Chair/Co-chair, Board of Governors, and Executive Committee. Three phenomena were investigated: "pipeline," by determining the change in women CMs compared to overall membership over time; "sticky floors," by comparing advancement beyond CM by gender; "glass-ceiling," by analyzing the promotion trajectory and time to leadership positions between genders. Statistical analysis comparing trends over time was performed using Kendall-tau. RESULTS: There were 1546 surgeons who served on at least one committee during the study period. Women represented 21% of CMs, 18% of chairs/co-chairs, 16% of board members and 14% of executives, with one woman President. The proportion of women CMs has significantly increased over time from 3% in 1992 to 27% in 2018 (p-trend < 0.001). A similar proportion of women and men advanced beyond CM (17% vs. 14%, p = 0.194), with no difference in time to advancement. From 2010 to 2018, the increase in the proportion of women CMs and board members outpaced that of overall women members (p < 0.05). Women executives surpassed overall women members in 2018 (29% vs. 19%). A similar proportion of men and women "skipped ranks" to reach the Board/Executive (37% vs. 25%, p = 0.307). CONCLUSION: The proportion of women in leadership positions within SAGES is higher than in the overall membership. There were no gender differences in the advancement of CMs to leadership positions. While these data are encouraging, SAGES should continue to foster the advancement of women surgeons.

Simulation platforms to assess laparoscopic suturing skills: a scoping review.

BACKGROUND: Laparoscopic suturing (LS) has become a common technique used in a variety of advanced laparoscopic procedures. However, LS is a challenging skill to master, and many trainees may not be competent in performing LS at the end of their training. The purpose of this review is to identify simulation platforms available for assessment of LS skills, and determine the characteristics of the platforms and the LS skills that are targeted. METHODS: A scoping review was conducted between January 1997 and October 2018 for full-text articles. The search was done in various databases. Only articles written in English or French were included. Additional studies were identified through reference lists. The search terms included "laparoscopic suturing" and "clinical competence." RESULTS: Sixty-two studies were selected. The majority of the simulation platforms were box trainers with inanimate tissue, and targeted basic suturing and intracorporeal knot-tying techniques. Most of the validation came from internal structure (rater reliability) and relationship to other variables (compare training levels/case experience, and various metrics). Consequences were not addressed in any of the studies. CONCLUSION: We identified many types of simulation platforms that were used for assessing LS skills, with most being for assessment of basic skills. Platforms assessing the competence of trainees for advanced LS skills were limited. Therefore, future research should focus on development of LS tasks that better reflect the needs of the trainees.

Assessment of surgical performance of laparoscopic benign hiatal surgery: a systematic review.

BACKGROUND: Operative skills correlate with patient outcomes, yet at the completion of training or after learning a new procedure, these skills are rarely formally evaluated. There is interest in the use of summative video assessment of laparoscopic benign foregut and hiatal surgery (LFS). If this is to be used to determine competency, it must meet the robust criteria established for high-stakes assessments. The purpose of this review is to identify tools that have been used to assess performance of LFS and evaluate the available validity evidence for each instrument. METHODS: A systematic search was conducted up to July 2017. Eligible studies reported data on tools used to assess performance in the operating room during LFS. Two independent reviewers considered 1084 citations for eligibility. The characteristics and testing conditions of each assessment tool were recorded. Validity evidence was evaluated using five sources of validity (content, response process, internal structure, relationship to other variables, and consequences). RESULTS: There were six separate tools identified. Two tools were generic to laparoscopy, and four were specific to LFS [two specific to Nissen fundoplication (NF), one heller myotomy (HM), and one paraesophageal hernia repair (PEH)]. Overall, only one assessment was supported by moderate evidence while the others had limited or unknown evidence. Validity evidence was based mainly on internal structure (all tools reporting reliability and item analysis) and content (two studies referencing previous papers for tool development in the context of clinical assessment, and four listing items without specifying the development procedures). There was little or no evidence supporting test response process (one study reporting rater training), relationship to other variables (two comparing scores in subjects with different clinical experience), and consequences (no studies). Two tools were identified to have evidence for video assessment, specific to NF. CONCLUSION: There is limited evidence supporting the validity of assessment tools for laparoscopic foregut surgery. This precludes their use for summative video-based assessment to verify competency. Further research is needed to develop an assessment tool designed for this purpose.

Trends in the Fundamentals of Laparoscopic Surgery® (FLS) certification exam over the past 9 years.

BACKGROUND: The Fundamentals of Laparoscopic Surgery® (FLS) certification exam assesses both cognitive and manual skills, and has been administered for over a decade. The purpose of this study is to report results over the past 9 years of testing in order to identify trends over time and evaluate the need to update scoring practices. This is a quality initiative of the SAGES FLS committee. METHODS: A representative sample of FLS exam data from 2008 to 2016 was analyzed. The de-identified data included demographics and scores for the cognitive and manual tests. Standard descriptive statistics were used to compare trends over the years, training levels, and to assess the pass/fail rate. RESULTS: A total of 7232 FLS tests were analyzed [64% male, 6.4% junior (postgraduate year-PGY1-2), 84% senior (PGY3-5), 2.8% fellows (PGY6), and 6.7% attending surgeons (PGY7)]. Specialties included 93% general surgery (GS), 6.2% gynecology, and 0.9% urology. The Pearson correlation between cognitive and manual scores was 0.09. For the cognitive exam, there was an increase in scores over the years, and the most junior residents scored the lowest. For the manual skills, there were marginal differences in scores over the years, and junior residents scored the highest. The odds ratio of PGY3+ passing was 1.8 (CI 1.2-2.8) times higher than that of a PGY1-2. The internal consistency between tasks on the manual skills exam was 0.73. If any one of the tasks was removed, the Cronbach's alpha dropped to between 0.65 and 0.71, depending on the task being removed. CONCLUSION: The cognitive and manual components of FLS test different aspects of laparoscopy and demonstrate evidence for reliability and validity. More experienced trainees have a higher likelihood of passing the exam and tend to perform better on the cognitive skills. Each component of the manual skills contributes to the exam and should continue to be part of the test.

A scoping review of assessment tools for laparoscopic suturing.

BACKGROUND: A needs assessment identified a gap in teaching and assessment of laparoscopic suturing (LS) skills. The purpose of this review is to identify assessment tools that were used to assess LS skills, to evaluate validity evidence available, and to provide guidance for selecting the right assessment tool for specific assessment conditions. METHODS: Bibliographic databases were searched till April 2017. Full-text articles were included if they reported on assessment tools used in the operating room/simulation to (1) assess procedures that require LS or (2) specifically assess LS skills. RESULTS: Forty-two tools were identified, of which 26 were used for assessing LS skills specifically and 26 for procedures that require LS. Tools had the most evidence in internal structure and relationship to other variables, and least in consequences. CONCLUSION: Through identification and evaluation of assessment tools, the results of this review could be used as a guideline when implementing assessment tools into training programs.

Development of a Model for the Acquisition and Assessment of Advanced Laparoscopic Suturing Skills Using an Automated Device.

BACKGROUND: Needs assessment identified a gap regarding laparoscopic suturing skills targeted in simulation. This study collected validity evidence for an advanced laparoscopic suturing task using an Endo StitchTM device. METHODS: Experienced (ES) and novice surgeons (NS) performed continuous suturing after watching an instructional video. Scores were based on time and accuracy, and Global Operative Assessment of Laparoscopic Surgery. Data are shown as medians [25th-75th percentiles] (ES vs NS). Interrater reliability was calculated using intraclass correlation coefficients (confidence interval). RESULTS: Seventeen participants were enrolled. Experienced surgeons had significantly greater task (980 [964-999] vs 666 [391-711], P = .0035) and Global Operative Assessment of Laparoscopic Surgery scores (25 [24-25] vs 14 [12-17], P = .0029). Interrater reliability for time and accuracy were 1.0 and 0.9 (0.74-0.96), respectively. All experienced surgeons agreed that the task was relevant to practice. CONCLUSION: This study provides validity evidence for the task as a measure of laparoscopic suturing skill using an automated suturing device. It could help trainees acquire the skills they need to better prepare for clinical learning.

What Are the Principles That Guide Behaviors in the Operating Room?: Creating a Framework to Define and Measure Performance.

OBJECTIVE: To identify the core principles that guide expert intraoperative behaviors and to use these principles to develop a universal framework that defines intraoperative performance. BACKGROUND: Surgical outcomes are associated with intraoperative cognitive skills. Yet, our understanding of factors that control intraoperative judgment and decision-making are limited. As a result, current methods for training and measuring performance are somewhat subjective-more task rather than procedure-oriented-and usually not standardized. They thus provide minimal insight into complex cognitive processes that are fundamental to patient safety. METHODS: Cognitive task analyses for 6 diverse surgical procedures were performed using semistructured interviews and field observations to describe the thoughts, behaviors, and actions that characterize and guide expert performance. Verbal data were transcribed, supplemented with content from published literature, coded, thematically analyzed using grounded-theory by 4 independent reviewers, and synthesized into a list of items. RESULTS: A conceptual framework was developed based on 42 semistructured interviews lasting 45 to 120 minutes, 5 expert panels and 51 field observations involving 35 experts, and 135 sources from the literature. Five domains of intraoperative performance were identified: psychomotor skills, declarative knowledge, advanced cognitive skills, interpersonal skills, and personal resourcefulness. Within the advanced cognitive skills domain, 21 themes were perceived to guide the behaviors of surgeons: 18 for surgical planning and error prevention, and 3 for error/injury recognition, rescue, and recovery. The application of these thought patterns was highly case-specific and variable amongst subspecialties, environments, and individuals. CONCLUSIONS: This study provides a comprehensive definition of intraoperative expertise, with greater insight into the complex cognitive processes that seem to underlie optimal performance. This framework provides trainees and other nonexperts with the necessary information to use in deliberate practice and the creation of effective thought habits that characterize expert performance. It may help to identify gaps in performance, and to isolate root causes of surgical errors with the ultimate goal of improving patient safety.

Establishing meaningful benchmarks: the development of a formative feedback tool for advanced laparoscopic suturing.

BACKGROUND: Time and accuracy are commonly used metrics to assess laparoscopic skills in a simulated environment. However, they do not provide trainees with meaningful information about how to improve their skills. The objective of this study was to provide preliminary validity evidence for the creation a formative feedback tool (FFT) for advanced laparoscopic suturing skills. METHODS: Videotapes of senior surgical residents (PGY3-5; SRs) and minimally invasive surgeons (MIS) performing 3 advanced laparoscopic suturing tasks were analyzed: needle handling (NH), suturing under tension (UT), and continuous suturing (CS). A FFT was created based on a grounded theory analysis of interviews with MIS surgeons about the key technical aspects of each task. The FFT was used to assess the videotaped performances of SRs and MIS surgeons by two blinded independent raters. RESULTS: The FFT is composed of three parts: NH contains 10 items, UT 18, and CS 20. Each item was classified according to seven key surgical principles: depth perception, safety, bimanual dexterity, exposure, tissue handling, instrument manipulation, and forward planning. The videotaped performance of SR and MIS surgeons was graded on a 3-point Likert scale ("does well," "needs some improvement," and "does poorly") and scores were calculated as a sum of the points. ICCs for all three tasks were high (NH 0.90, UT 0.87, and CS 0.90). FFT score correlated strongly with combined time and accuracy measurements for UT (0.82, p < 0.01) and CS (0.81, p < 0.01), and moderately for NH (0.65, p < 0.01). MIS surgeons performed significantly better than SRs on UT (p = 0.02) and CS (p = 0.05), while scores on NH were similar (p = 0.57). CONCLUSIONS: A comprehensive tool for providing feedback about advanced laparoscopic suturing skills was developed. The FFT demonstrates evidence for validity as a measure of suturing skills and experience, and provides meaningful information to trainees about how to improve their skills and engage in more deliberate and efficient practice.

Biologic mesh for repair of ventral hernias in contaminated fields: long-term clinical and patient-reported outcomes.

BACKGROUND: Guidelines recommend biologic prosthetics for ventral hernia repair (VHR) in contaminated fields, yet long-term and patient-reported data are limited. We aimed to determine the long-term rate of hernia recurrence, and other clinical and patient-reported outcomes following the use of porcine small intestine submucosa (PSIS) for VHR in a contaminated field. METHODS: Consecutive patients undergoing open VHR with PSIS mesh in a contaminated field from 2004 to 2014 were prospectively evaluated for hernia recurrence and other post-operative complications. Multivariate logistic and Cox regression analyses identified predictors of hernia recurrence and surgical site infection. Patient-reported outcomes were evaluated using SF-36, Hernia-Related Quality-of-Life Survey (HerQLes) and Body Image Questionnaire instruments. RESULTS: Forty-six hernias were repaired in clean-contaminated [16 (35 %)], contaminated [11 (24 %)] and dirty [19 (41 %)] fields. Median follow-up was 47 months [interquartile range: 31-79] and all patients had greater than 12-month follow-up. Sixteen patients (35 %) were not re-examined. Incidence of surgical site events and surgical site infection were 43 % (n = 20) and 56 % (n = 25), respectively. American Society of Anesthesiologists score 3 or greater was an independent predictor of surgical site infection (odds ratio 5.34 [95 % confidence interval 1.01-41.80], p = 0.04). Hernia recurrence occurred in 61 % (n = 28) with a median time to diagnosis of 16 months [interquartile range 8-26]. After bridged repair, 16 of 18 patients (89 %) recurred, compared to 12 of 28 (43 %) when fascia was approximated (p < 0.01). Bridged repair was an independent predictor of recurrence (odds ratio 10.67 [95 % confidence interval 2.42-76.08], p < 0.01). Patients with recurrences had significantly worse scores on the SF-36 mental health component and self-perceived body image, whereas HerQLes scores were similar. CONCLUSIONS: Hernia recurrences and wound infections are high with the use of biologic PSIS mesh in contaminated surgical fields. Careful consideration is warranted using this approach.

Measuring intra-operative decision-making during laparoscopic cholecystectomy: validity evidence for a novel interactive Web-based assessment tool.

BACKGROUND: Errors in judgment during laparoscopic cholecystectomy can lead to bile duct injuries and other complications. Despite correlations between outcomes, expertise and advanced cognitive skills, current methods to evaluate these skills remain subjective, rater- and situation-dependent and non-systematic. The purpose of this study was to develop objective metrics using a Web-based platform and to obtain validity evidence for their assessment of decision-making during laparoscopic cholecystectomy. METHODS: An interactive online learning platform was developed ( www.thinklikeasurgeon.com ). Trainees and surgeons from six institutions completed a 12-item assessment, developed based on a cognitive task analysis. Five items required subjects to draw their answer on the surgical field, and accuracy scores were calculated based on an algorithm derived from experts' responses ("visual concordance test", VCT). Test-retest reliability, internal consistency, and correlation with self-reported experience, Global Operative Assessment of Laparoscopic Skills (GOALS) score and Objective Performance Rating Scale (OPRS) score were calculated. Questionnaires were administered to evaluate the platform's usability, feasibility and educational value. RESULTS: Thirty-nine subjects (17 surgeons, 22 trainees) participated. There was high test-retest reliability (intraclass correlation coefficient = 0.95; n = 10) and internal consistency (Cronbach's α = 0.87). The assessment demonstrated significant differences between novices, intermediates and experts in total score (p < 0.01) and VCT score (p < 0.01). There was high correlation between total case number and total score (ρ = 0.83, p < 0.01) and between total case number and VCT (ρ = 0.82, p < 0.01), and moderate to high correlations between total score and GOALS (ρ = 0.66, p = 0.05), VCT and GOALS (ρ = 0.83, p < 0.01), total score and OPRS (ρ = 0.67, p = 0.04), and VCT and OPRS (ρ = 0.78, p = 0.01). Most subjects agreed or strongly agreed that the platform and assessment was easy to use [n = 29 (78 %)], facilitates learning intra-operative decision-making [n = 28 (81 %)], and should be integrated into surgical training [n = 28 (76 %)]. CONCLUSION: This study provides preliminary validity evidence for a novel interactive platform to objectively assess decision-making during laparoscopic cholecystectomy.

Impact of miniport laparoscopic cholecystectomy versus standard port laparoscopic cholecystectomy on recovery of physical activity: a randomized trial.

INTRODUCTION: We conducted a randomized trial comparing minilaparoscopic cholecystectomy (MLC) to conventional laparoscopic cholecystectomy (CLC) to determine whether MLC accelerated recovery of physical activity after elective surgery (NCT01397565). METHODS: A total of 115 patients scheduled for elective cholecystectomy were randomized to either CLC or MLC. Both procedures used a 10-mm umbilical port, but the three upper abdominal ports were 5 mm in CLC and 3 mm in MLC. Primary outcome was self-reported physical activity 1 month after surgery as estimated by Community Health Activities Model Program for Seniors questionnaire (kcal/kg/week). Secondary outcomes were umbilical pain, abdominal pain, nausea and fatigue (VAS, 1-10), and cosmetic result at one and 3 months. Patients received identical surgical dressings for 1 week, and assessors were blinded to group allocation. RESULTS: Forty-two patients randomized to CLC group and 33 patients randomized to MLC remained in the trial and were analyzed. Both groups were similar at baseline characteristics. In the MLC group, at least one 5-mm port was used in 17 (51.5 %) mainly due to unavailability of ML equipment. Median (IQR) physical activity for the CLC and MLC groups was similar at baseline (23.4 [13.1, 44.6] vs 23.6 [14.2, 66.9] kcal/kg/week, p = 0.35) and at 1 month (20 [7.9, 52.5] vs 16.8 [11.8, 28.6] kcal/kg/week, p = 0.90). One month post-op, umbilical pain and abdominal pain were similar, but the CLC group reported higher fatigue (4 [1-5] vs 1 [0-4], p = 0.05) and worse scar appearance scores (4 [3, 4] vs 4.5 [4, 5], p = 0.009). At 3 months, the CLC group had worse scar appearance (4 [3-5] vs 5 [4-5], p = 0.02) and lower scar satisfaction scores (4 [3, 4] vs 4 [3.5-4], p = 0.04). CONCLUSION: Recovery of physical activity was similar after MLC and CLC. MLC resulted in less fatigue and better scar appearance and satisfaction. These benefits were seen despite the need to upsize one or more ports in more than half of patients related to availability of the miniature instruments.

Don't fix it if it isn't broken: a survey of preparedness for practice among graduates of Fellowship Council-accredited fellowships.

BACKGROUND: General surgery residency may not adequately prepare residents for independent practice. It is unclear; however, if non-ACGME-accredited fellowships are better meeting training needs. The purpose of this mixed-method study was to determine perceived preparedness for practice and to identify gaps in fellowship training. METHODS: A survey was developed using an iterative qualitative methodology based on interviews and focus groups of graduated fellows and program directors. Five central themes emerged and were used as a framework: professional development, job marketability, autonomy, networking, and practice management. The survey was then circulated by email to fellows who graduated from Fellowship Council (FC)-accredited programs within the past 3 years. RESULTS: Of 201 respondents (response rate = 41 %), 95 and 97 % were highly satisfied with their operative and non-operative experiences; 83 % acquired jobs aligned with their skills and expectations, while 17 % sought additional training after fellowship. Respondents who intended to learn a given procedure felt competent after fellowship to perform 51(85 %) of the 60 procedures listed. They would have liked more experience in advanced therapeutic endoscopy, complex and revisional bariatric surgery, and uncommon laparoscopic procedures such as esophagectomy, adrenalectomy, and common bile duct exploration. Thirty-one percent expressed the desire for more autonomy in the management of complications. Educational gaps existed mostly in areas of coding and billing (42 %), hiring administrative staff (42 %), and managing insurance issues (34 %). CONCLUSIONS: FC-accredited fellowships seem to adequately prepare surgeons for independent practice and bridge training gaps after residency. Graduates are highly satisfied with the individualized training experience and acquire desired jobs aligned with their career goals.

Effectiveness of Telementoring in Surgery Compared With On-site Mentoring: A Systematic Review.

BACKGROUND: Mentorship is important but may not be feasible for distance learning. To bridge this gap, telementoring has emerged. The purpose of this systematic review was to evaluate the effectiveness of telementoring compared with on-site mentoring. METHODS: A search was done up to March 2015. Studies were included if they used telementoring between surgeons during a clinical encounter and if they compared on-site mentoring and telementoring. RESULTS: A total of 11 studies were included. All reported no difference in complication rates, and 9 (82%) reported similar operative times; 4 (36%) reported technical issues, which was 3% of the total number of cases in the 11 studies. No study reported on higher levels of evidence for effectiveness of telementoring as an educational intervention. CONCLUSION: Studies reported that telementoring is associated with similar complication rates and operative times compared with on-site mentoring. However, the level of evidence to support the effectiveness of telementoring as a training tool is limited. There is a need for studies that provide evidence for the equivalence of the effectiveness of telementoring as an educational intervention in comparison with on-site mentoring.

A systematic review of performance assessment tools for laparoscopic cholecystectomy.

BACKGROUND: Multiple tools are available to assess clinical performance of laparoscopic cholecystectomy (LC), but there are no guidelines on how best to implement and interpret them in educational settings. The purpose of this systematic review was to identify and critically appraise LC assessment tools and their measurement properties, in order to make recommendations for their implementation in surgical training. METHODS: A systematic search (1989-2013) was conducted in MEDLINE, Embase, Scopus, Cochrane, and grey literature sources. Evidence for validity (content, response process, internal structure, relations to other variables, and consequences) and the conditions in which the evidence was obtained were evaluated. RESULTS: A total of 54 articles were included for qualitative synthesis. Fifteen technical skills and two non-technical skills assessment tools were identified. The 17 tools were used for either: recorded procedures (nine tools, 60%), direct observation (five tools, 30%), or both (three tools, 18%). Fourteen (82%) tools reported inter-rater reliability and one reported a Generalizability Theory coefficient. Nine (53%) had evidence for validity based on clinical experience and 11 (65%) compared scores to other assessments. Consequences of scores, educational impact, applications to residency training, and how raters were trained were not clearly reported. No studies mentioned cost. CONCLUSIONS: The most commonly reported validity evidence was inter-rater reliability and relationships to other known variables. Consequences of assessments and rater training were not clearly reported. These data and the evidence for validity should be taken into consideration when deciding how to select and implement a tool to assess performance of LC, and especially how to interpret the results.

Validity evidence for a new portable, lower-cost platform for the fundamentals of endoscopic surgery skills test.

BACKGROUND: The fundamentals of endoscopic surgery (FES) examination measures the knowledge and skills required to perform safe flexible endoscopy. A potential limitation of the FES skills test is the size and cost of the simulator on which it was developed (GI Mentor II virtual reality endoscopy simulator; Simbionix LTD, Israel). A more compact and lower-cost alternative (GI Mentor Express) was developed to address this issue. The purpose of this study was to obtain evidence for the validity of scores obtained on the Express platform, so that it can be used for testing. STUDY DESIGN: General surgery residents at various levels of training and practicing endoscopists at five institutions participated. Each completed the five FES tasks on both simulator platforms in random order, with 3-14 days between tests. Scores were calculated using the same standardized computer-generated algorithm and compared using Pearson's correlation coefficient. RESULTS: There were 58 participants (mean age 32; 76% male) with a broad range of endoscopic experience. The mean (95% confidence interval) FES scores were 72 (67:77) on the GI Mentor II and 66 (60:71) on the Express. The correlation between scores on the two platforms was 0.86 (0.77:0.91; p < 0.0001). CONCLUSION: There is a high correlation between FES manual skills scores measured on the original platform and the new Express, providing evidence to support the use of the GI Mentor Express for FES testing.

Long-term knowledge retention following simulation-based training for electrosurgical safety: 1-year follow-up of a randomized controlled trial.

BACKGROUND: Despite the value of simulation for surgical training, it is unclear whether acquired competencies persist long term. A prior randomized trial showed that structured simulation improves knowledge of the safe use of electrosurgery (ES) amongst trainees up to 3 months after the curriculum (Madani et al. in Surg Endosc 28(10):2772-2782, 2014). We now analyse long-term knowledge retention. This study estimates the effects of a structured simulation-based curriculum to teach the safe use of ES on knowledge after 1 year. METHODS: Trainees previously participated in a 1-h didactic ES course, followed by randomization into one of two groups: an unstructured hands-on session where trainees used ES devices (control group) or a goal-directed hands-on training session (Sim group). Knowledge of pre- and post-curriculum (immediate, 3 months and 1 year) and knowledge of ES safety were assessed using different multiple-choice examinations. Data are expressed as median (interquartile range), *p < 0.05. RESULTS: Fifty-nine trainees participated (30 control group; 29 Sim group). Despite equal baseline examination scores, Sim group demonstrated higher scores compared to control immediately (89% [83; 94] vs. 83% [71; 86]*), 3 months (77% [69; 90] vs. 60% [51; 80]*) and 1 year after curriculum (70% [61; 74] vs. 60% [31; 71]*). One-year score remained significantly greater compared to baseline in the Sim group (70% [61; 74] vs. 49% [43; 57]*), but was similar to baseline in the control group (60% [31; 71] vs. 45% [34; 52]). CONCLUSIONS: After ES simulation training, retention of competencies persists longer when the hands-on component is designed to reinforce specific learning objectives in a structured curriculum. Despite routine clinical use of ES devices, knowledge degrades overtime, suggesting the need for ongoing formal educational activities to reinforce curricular objectives.

New models for advanced laparoscopic suturing: taking it to the next level.

BACKGROUND: Current simulations for laparoscopic suturing do not reflect the complexity of the skills required in the operating room. The purpose of this study was to develop three novel advanced suturing tasks with assessment metrics and to collect validity evidence for their measures of suturing skill. METHODS: We developed three tasks based on training gaps identified through a previous needs assessment: needle handling (NH), suturing under tension (UT), and continuous suturing (CS). Minimally invasive surgeons (MIS) and senior surgical residents (SR) completed these tasks and a questionnaire regarding their educational value. Performance was assessed by two raters based on time and accuracy. Validity was assessed by comparing performance according to the level of training and self-reported experience. The inter-rater reliability and internal consistency of the tasks were calculated. RESULTS: Thirty-one subjects (13 MIS, 18 SR) were enrolled in the study (median age 32; 77% male). Compared to the SR group, the MIS group had significantly greater scores on all tasks. While all MIS surgeons completed the three tasks within the allotted time, six (33%) residents could not complete at least one out of the three tasks. Laparoscopic suturing experience correlated positively with the scores of all tasks (NH 0.51, UT 0.70, CS 0.65. p < 0.01). Inter-rater reliability for all tasks was 0.99, and internal consistency was 0.80. The majority of participants agreed that the tasks were relevant to practice, helped improve technical competence, and adequately measured suturing ability. CONCLUSIONS: This study provides validity evidence for three novel advanced laparoscopic suturing tasks. Performance on all tasks correlated significantly with training level and self-reported experience. Integrating these tasks into educational curricula may help improve residents' suturing skills and better prepare residents for the operating room.