Generating a Prioritized List of Operative Procedures for Simulation-based Assessment of General Surgery Trainees Through Consensus.

OBJECTIVE: To develop appropriate content for high-stakes simulation-based assessments of operative competence in general surgery training through consensus. BACKGROUND: Valid methods of summative operative competence assessment are required by competency-based training programs in surgery. METHOD: An online Delphi consensus study was conducted. Procedures were derived from the competency expectations outlined by the Joint Committee on Surgical Training Curriculum 2021, and subsequent brainstorming. Procedures were rated according to their perceived importance, perceived procedural risk, how frequently they are performed, and simualtion feasibility by a purposive sample of 30 surgical trainers and a 5-person steering group. A modified Copenhagen Academy for Medical Education and Simulation Needs Assessment Formula was applied to the generated data to produce ranked procedural lists, which were returned to participants for re-prioritization. RESULTS: Prioritized lists were generated for simulation-based operative competence assessments at 2 key stages of training; the end of 'phase 2' prior to the development of a sub-specialty interest, and the end of 'phase 3', that is, end-of-training certification. A total of 21 and 16 procedures were deemed suitable for assessments at each of these stages, respectively. CONCLUSIONS: This study describes a national needs assessment approach to content generation for simulation-based assessments of operative competence in general surgery using Delphi consensus methodology. The prioritized procedural lists generated by this study can be used to further develop operative skill assessments for use in high-stakes scenarios, such as trainee progression, entrustment, and end-of-training certification, before subsequent validity testing.

Solid validity evidence for two tools assessing competences in musculoskeletal ultrasound: a validity study.

OBJECTIVES: Musculoskeletal ultrasound (MSUS) is increasingly used by rheumatologists in daily clinical practice. However, MSUS is only valuable in trained hands, and assessment of trainee competences is therefore essential before independent practice. Thus, this study aimed to establish validity evidence for the EULAR and the Objective Structured Assessment of Ultrasound Skills (OSAUS) tools used for assessing MSUS competences. METHODS: Thirty physicians with different levels of MSUS experience (novices, intermediates, and experienced) performed four MSUS examinations of different joint areas on the same rheumatoid arthritis patient. All examinations were video recorded (n = 120), anonymized, and subsequently assessed in random order by two blinded raters using first the OSAUS assessment tool followed by the EULAR tool 1 month after. RESULTS: The inter-rater reliability between the two raters was high for both the OSAUS and EULAR tools, with a Pearson correlation coefficient (PCC) of 0.807 and 0.848, respectively. Both tools demonstrated excellent inter-case reliability, with a Cronbach's alpha of 0.970 for OSAUS and 0.964 for EULAR. Furthermore, there was a strong linear correlation between the OSAUS and the EULAR performance scores and the participants' experience levels (R2 = 0.897 and R2 = 0.868, respectively) and a significant discrimination between different MSUS experience levels (P < 0.001 for both). CONCLUSIONS: MSUS operator competences can be assessed reliably and valid using either the OSAUS or the EULAR assessment tool, thereby allowing a uniform competency-based MSUS education in the future. Although both tools demonstrated high inter-rater reliability, the EULAR tool was superior to OSAUS. TRIAL REGISTRATION: ClinicalTrials.gov, http://clinicaltrials.gov, NCT05256355.

Development and validation of a new tool for assessment of trainees' interventional musculoskeletal ultrasound skills.

OBJECTIVES: Interventional musculoskeletal ultrasound (MSUS) procedures are routinely performed in rheumatology practice. However, the efficacy and safety of the procedures rely on the competence of the physician, and assessment of skills is crucial. Thus, this study aimed to develop and establish validity evidence for a tool assessing trainees' interventional MSUS skills. METHODS: An expert panel of rheumatologists modified an existing tool for assessing competences in invasive abdominal and thoracic ultrasound procedures. The new tool (the Assessment of Interventional Musculoskeletal Ultrasound Skills (AIMUS) tool) reflects the essential steps in interventional MSUS. To establish validity evidence, physicians with different levels of interventional MSUS experience were enrolled and performed two procedures on a rubber fantom, simulating real patient cases. All performances were video recorded, anonymized, and assessed in random order by two blinded raters using the AIMUS tool. RESULTS: Sixty-five physicians from 21 different countries were included and categorized into groups based on their experience, resulting in 130 videos for analysis. The internal consistency of the tool was excellent, with a Cronbach's alpha of 0.96. The inter-case reliability was good with a Pearson's correlation coefficient (PCC) of 0.74 and the inter-rater reliability was moderate to good (PCC 0.58). The ability to discriminate between different levels of experience was highly significant (p< 0.001). CONCLUSIONS: We have developed and established validity evidence for a new interventional MSUS assessment tool. The tool can be applied in future competency-based educational programs, provide structured feedback to trainees in daily clinical practice, and ensure end-of-training competence.

Computer-aided quality assessment of endoscopist competence during colonoscopy: A systematic review.

BACKGROUND AND AIMS: Endoscopists' competence can vary widely, as shown in the variation in adenoma detection rate (ADR). Computer-aided quality assessment (CAQ) can automatically assess performance during individual procedures. This review aims to identify and describe different CAQ systems for colonoscopy. METHODS: A systematic review of the literature was done using MEDLINE, EMBASE, and SCOPUS based on three blocks of terms according to the inclusion criteria: Colonoscopy, Competence assessment, and Automatic evaluation. Articles were systematically reviewed by two reviewers, first by abstract and then in full text. The methodological quality was assessed using the Medical Education Research Study Quality Instrument (MERSQI). RESULTS: 12,575 studies were identified, 6,831 remained after removal of duplicates, and 6,806 did not pass the eligibility criteria and were excluded, leaving thirteen studies for final analysis. Five categories of CAQ systems were identified: Withdrawal speedometer (seven studies), Scope movement analysis (three studies), Effective withdrawal time (one study), Fold examination quality (one study), and Visual gaze pattern (one study). The withdrawal speedometer was the only CAQ system that tested its feedback by examining changes in ADR. Three studies observed an improvement in ADR, and two studies did not. The methodological quality of the studies was high (mean MERSQI 15.2 points, maximum 18 points). CONCLUSIONS: Thirteen studies developed or tested CAQ systems, most frequently by correlating it to ADR. Only five studies tested feedback by implementing the CAQ system. A meta-analysis was impossible due to the heterogeneous study designs, and more studies are warranted.

Training and assessment for colorectal surgery and appendicectomy- a systematic review.

AIM: There is currently an increased focus on competency-based training, in which training and assessment play a crucial role. The aim of this systematic review is to create an overview of hands-on training methods and assessment tools for appendicectomy and colon and rectal surgery procedures using either an open, laparoscopic or robot-assisted approach. METHOD: A systematic review of Medline, Embase, Cochrane and Scopus databases was conducted following the PRISMA guidelines. We conducted the last search on 9 March 2023. All published papers describing hands-on training, evaluation of performance data and development of assessment tools were eligible. The quality of studies and the validity evidence of assessment tools are reported. RESULTS: Fifty-one studies were identified. Laparoscopic assessment tools are abundant, but the literature still lacks good-quality assessment tools for open appendicectomy, robotic colectomy and open rectal surgery. Overall, there is a lack of discussion regarding the establishment of pass/fail standards and the consequences of assessment. Virtual reality simulation is used more for appendicectomy than colorectal procedures. Only a few of the studies investigating training were of acceptable quality. There is a need for high-quality studies in open and robotic-assisted colon surgery and all approaches to rectal surgery. CONCLUSION: This review provides an overview of current training methods and assessment tools and identifies where more research is needed based on the quality of the studies and the current validity evidence.

Variable practice is superior to self-directed training for laparoscopic simulator training: a randomized trial.

BACKGROUND: Mastering laparoscopy is challenging-it requires specific psychomotor skills which are difficult to obtain in the operating room without potentially compromising patient safety. Proficiency-based training programs using virtual reality simulators allow novices to practice and develop their skills in a patient-safe learning environment. Variable practice leads to stronger retention and skills transfer in a non-surgical setting. The objective of this trial was to investigate if variable practice was superior to self-directed training. METHODS: A randomized trial where participants (n = 36) were randomized to proficiency-based laparoscopic simulator training of basic skills using either variable practice or self-directed training, followed by a transfer test with proficiency-based training on a procedural task (a salpingectomy). All participants returned after a period of 3-5 weeks to perform a retention test. RESULTS: The mean time to proficiency for the basic skills tasks were 119 min (SD: 93) for the variable practice group versus 182 min (SD: 46) for the self-directed training group (p = 0.015). The time to reach proficiency during the transfer test was 103 min (SD: 57) versus 183 min (SD: 64) for the variable practice group versus the self-directed training group, respectively (p < 0.001). The mean time to proficiency for the retention test was 51 min (SD: 26) and 109 min (SD: 53) for the variable practice group and self-directed training group, respectively (p < 0.001). CONCLUSION: Variable practice is superior to self-directed training for proficiency-based laparoscopic training. With variable time to practice proficiency is reduced, there is higher transfer to a procedural task, and retention is improved.

Using neuroimaging to assess brain activity and areas associated with surgical skills: a systematic review.

BACKGROUND: Surgical skills acquisition is under continuous development due to the emergence of new technologies, and there is a need for assessment tools to develop along with these. A range of neuroimaging modalities has been used to map the functional activation of brain networks while surgeons acquire novel surgical skills. These have been proposed as a method to provide a deeper understanding of surgical expertise and offer new possibilities for the personalized training of future surgeons. With studies differing in modalities, outcomes, and surgical skills there is a need for a systematic review of the evidence. This systematic review aims to summarize the current knowledge on the topic and evaluate the potential use of neuroimaging in surgical education. METHODS: We conducted a systematic review of neuroimaging studies that mapped functional brain activation while surgeons with different levels of expertise learned and performed technical and non-technical surgical tasks. We included all studies published before July 1st, 2023, in MEDLINE, EMBASE and WEB OF SCIENCE. RESULTS: 38 task-based brain mapping studies were identified, consisting of randomized controlled trials, case-control studies, and observational cohort or cross-sectional studies. The studies employed a wide range of brain mapping modalities, including electroencephalography, functional magnetic resonance imaging, positron emission tomography, and functional near-infrared spectroscopy, activating brain areas involved in the execution and sensorimotor or cognitive control of surgical skills, especially the prefrontal cortex, supplementary motor area, and primary motor area, showing significant changes between novices and experts. CONCLUSION: Functional neuroimaging can reveal how task-related brain activity reflects technical and non-technical surgical skills. The existing body of work highlights the potential of neuroimaging to link task-related brain activity patterns with the individual level of competency or improvement in performance after training surgical skills. More research is needed to establish its validity and usefulness as an assessment tool.

No difference between using short and long intervals for distributed proficiency-based laparoscopy simulator training: a randomized trial.

BACKGROUND: Simulation-based training is increasingly used to acquire basic laparoscopic skills. Multiple factors can influence training, e.g., distributed practice is superior to massed practice in terms of efficiency. However, the optimal interval between training sessions is unclear. The objective of this trial was to investigate if shorter intervals between sessions are more efficient than longer intervals during proficiency-based laparoscopy simulator training. METHODS: A randomized simulation-based trial where medical students (n = 39) were randomized to proficiency-based training with either 1-2 days (intervention group) or 6-8 days (control group) between training sessions. Both groups practiced a series of basic tasks and a procedural module until proficiency level on the LapSim® simulator. Both groups were given instructor feedback upon request. After reaching proficiency, participants were invited back for a retention test 3-5 weeks later and practiced the same tasks to proficiency again. RESULTS: The mean time to reach proficiency during training was 291 (SD 89) and 299 (SD 89) min in the intervention and control group, respectively (p = 0.81). During the retention test, the mean time to reach proficiency was 94 (SD 53) and 96 (SD 39) minutes in the intervention and control groups, respectively (p = 0.91). CONCLUSION: We found no difference whether practicing with shorter intervals or longer intervals between training sessions when examining time to proficiency or retention.

First experience with the Hugo™ robot-assisted surgery system for endometriosis: A descriptive study.

INTRODUCTION: The Medtronic Hugo™ Robot-assisted Surgery (RAS) system was recently approved for clinical use. We explored the safety and feasibility of this system for endometriosis surgery. The primary outcome was safe case completion without major surgical complications (Clavien-Dindo grade ≤2) and no conversion to open surgery or laparoscopy. MATERIAL AND METHODS: Surgeries for endometriosis performed at the Department of Gynecology, Rigshospitalet, on the Medtronic Hugo™ RAS system were included. Two experienced robotic surgeons performed all surgeries with their usual robotic team. The variables included were patient demographics, peri- and postoperative data, complications and 30-day readmission rate. We used the IDEAL framework 1/2a for surgical innovation in this descriptive study. RESULTS: The first 12 patients were included. All cases were completed without intraoperative complications or conversion. Four patients experienced Clavien-Dindo grade 1 postoperative complications. No patients were re-admitted within 30 days. Median docking time (17 minutes), console time (87.5 minutes), blood loss (40 mL) and length of hospital stay (1 day) were acceptable compared with previous literature. CONCLUSIONS: In this pilot study, we found the Medtronic Hugo™ RAS system safe and feasible for robot-assisted surgery for endometriosis. The advent of new robotic systems is welcomed to accelerate the development of technology that will advance surgical care for patients across the globe.

A view from the top: A qualitative exploration of top-level health care leaders' perceptions on the implementation of simulation-based education in postgraduate medical education.

INTRODUCTION: Although there is substantial evidence supporting the benefits of simulation-based education (SBE), its widespread and effective implementation remains challenging. The aim of this study was to explore the perceptions of top-level health care leaders regarding SBE and the barriers and facilitators that influence its wide implementation as part of the postgraduate surgical curricula in Denmark. METHODS: We conducted semi-structured interviews with top-level health care leaders who were chosen based on their roles in ensuring high-quality patient care delivery and developing strategies to achieve the goals of the entire health care system. The interview transcripts were translated into English, and a thematic approach was used to code and inductively analyse the data. We used the Consolidated Framework for Implementation Research to identify and understand the determinants to a successful implementation of SBE. RESULTS: We interviewed 13 participants from different political and administrative levels. We found that the participants had limited knowledge about SBE, which highlighted a disconnection between these leaders and the educational environment. This was further compounded by a lack of effective communication and inadequate information dissemination between simulation centres and higher-level organisations. While participants recognised the benefits of SBE for doctors in training, they expressed concerns about the implementation given the already strained health care system and limited resources. The need for evidence, particularly in the context of patient safety, was emphasised to facilitate SBE implementation. Although participants supported the implementation of SBE, it was unclear who should initiate action. DISCUSSION: This study highlighted the perspectives of top-level health care leaders regarding SBE and identified the determinant factors for a successful implementation. Effective communication channels are crucial to enhance collaborations and reduce the disconnection between the different health care organisational levels. Strategic implementation processes, including the roles and responsibilities, should be defined and established. These will inform decisions regarding the implementation strategies to effectively integrate SBE into the residency training curricula.

Ultrasound in anesthesiology in the Nordic countries-Protocol of an international survey on availability, frequency of use, operator training, and certification.

BACKGROUND: Over the past decade, ultrasound utilization has increased within anesthesia and intensive care medicine, enhancing patient safety and diagnostic accuracy. However, the frequency of ultrasound usage and operator training in the Nordic countries remain unclear. This project aims to perform a survey on ultrasound availability, daily clinical use, and how ultrasound skills are trained and assessed, among anesthesiologists. METHODS: This online cross-sectional survey will include anesthesiologists from the Nordic countries. The survey will adhere to the CROSS checklist. Survey items will be developed based on a formative model with a conceptual model, consisting of three main parts, including demographics, ultrasound machines and use, and skills development and assessment. The clinical relevance of items will be secured by including anesthesiologists of various levels of experience in the development of the survey. Furthermore, experienced researchers in medical education will participate in the development, contributing with relevant medical educational perspectives. Data will be summarized using a non-parametric descriptive approach. A chi-squared test will examine relevant relationships between certain answers. RESULTS: Results will be published in a peer-reviewed journal and presented at relevant scientific conferences and meetings. CONCLUSION: This study may find a high availability of ultrasound machines and frequent use in the clinical departments. Despite this expected daily use of ultrasound, missing standardized structured skills acquisition and assessment could be uncovered. The results of this study may contribute to mapping various aspects of clinical ultrasound and skills development for further use in research.

Training and assessment of skills in neuraxial access-Protocol of a scoping review.

BACKGROUND: Access to the neuraxial space, including lumbar punctures and neuraxial anaesthesia, is an everyday procedure in clinical practice. Traditionally these procedures rely on manual palpation technique, but ultrasound is a useful tool when patients prove challenging. Presently, there is a lack of evidence-based guidelines for technical skills acquisition, both with and without ultrasound, and likewise, competency assessment approaches vary globally. Accordingly, we aim to assess the current evidence regarding learning and assessment in neuraxial access ± $$ \pm $$ ultrasound, for future educational recommendations. METHODS: This scoping review will be conducted in accordance with the Preferred Reporting Items for Systematic and Meta-Analysis (PRISMA) statement, together with the PRISMA Extension for Scoping Reviews. A systematic search strategy will be based on a PICO approach, focusing on physicians, medical students, or nurses being exposed to education, training, or assessment in procedural neuraxial access ± $$ \pm $$ ultrasound. No comparators are obligated, but outcomes should be assessable using the Kirkpatrick four levels of training evaluation. The search will be performed in Cochrane Library, Embase, Medline, Scopus, PubMed, and CINAHL. Independently, two authors will screen the studies and conflicts will be resolved by a third author. Relevant predefined data will be extracted and analysed using a descriptive approach. The quality of the studies will be assessed using the Medical Education Research Study Quality Instrument. DISCUSSION: This scoping review will contribute by presenting gathered evidence of an overview of the different approaches to achieving education and training of technical skills in neuraxial access, and how skills are tested, which could guide research and future recommendations for skills development and assessment.

Anesthesiologists' skills in emergency cricothyroidotomy mandate a brush-up training after 3 months-A randomized controlled trial.

BACKGROUND: In the Difficult Airway Society's 2015 "cannot intubate, cannot oxygenate" guideline, the emergency cricothyroidotomy is the final option when managing an unanticipated difficult airway. How often training for maintenance of this skill is required for anesthesiologists remains unknown. We aimed to assess if specialist-trained anesthesiologists' skills improved from a brush-up intervention and if skills were retained after 3 months. METHODS: In this multicenter, randomized, controlled trial, participants were randomized to either a simulation-based brush-up or no brush-up. Both groups performed a mannequin-based technical skills emergency cricothyroidotomy test twice and were assessed by a blinded rater using a structured assessment tool that included time, positioning, palpation, appropriate employment of instruments, and stepwise progression. After 3 months of non-training, participants completed identical tests of retention. RESULTS: A total of 54 anesthesiologists were included from three hospitals in the Region of Southern Denmark. Thirty-seven percent of the participants had received skills training in emergency cricothyroidotomy in the prior 12 months. The intervention group (N = 27) performed better in the initial tests, with a mean time of 51.5 s (SD = 10.82), a total score per minute of 15.9 points (SD = 4.91), and 93% passing both initial tests compared to the control group (N = 27) with a mean time of 76.8 s (SD = 35.82), a total score per minute of 6.6 (SD = 4.68) and only 15% passing both initial tests. The intervention group managed to retain overall performance in retention tests in terms of performance time (48.9 s, p = .26), total score per minute (13.6 points, p = .094), and passing the tests (75%, p = .059). CONCLUSION: Exposure to simulation-based brush-up training in emergency cricothyroidotomy improved anesthesiologists' technical performance and was overall retained after 3 months. Some loss of skill concerning specific items was observed, highlighting the need for regular training in emergency cricothyroidotomy. Simulation-based training should be prioritized to improve and maintain technical skills in infrequent high-stakes procedures.

Developing a phantom for simulating robotic-assisted complete mesocolic excision using 3D printing and medical imaging.

BACKGROUND: Robotic-assisted complete mesocolic excision is an advanced procedure mainly because of the great variability in anatomy. Phantoms can be used for simulation-based training and assessment of competency when learning new surgical procedures. However, no phantoms for robotic complete mesocolic excision have previously been described. This study aimed to develop an anatomically true-to-life phantom, which can be used for training with a robotic system situated in the clinical setting and can be used for the assessment of surgical competency. METHODS: Established pathology and surgical assessment tools for complete mesocolic excision and specimens were used for the phantom development. Each assessment item was translated into an engineering development task and evaluated for relevance. Anatomical realism was obtained by extracting relevant organs from preoperative patient scans and 3D printing casting moulds for each organ. Each element of the phantom was evaluated by two experienced complete mesocolic excision surgeons without influencing each other's answers and their feedback was used in an iterative process of prototype development and testing. RESULTS: It was possible to integrate 35 out of 48 procedure-specific items from the surgical assessment tool and all elements from the pathological evaluation tool. By adding fluorophores to the mesocolic tissue, we developed an easy way to assess the integrity of the mesocolon using ultraviolet light. The phantom was built using silicone, is easy to store, and can be used in robotic systems designated for patient procedures as it does not contain animal-derived parts. CONCLUSIONS: The newly developed phantom could be used for training and competency assessment for robotic-assisted complete mesocolic excision surgery in a simulated setting.

Setting proficiency standards for simulation-based mastery learning of short antegrade femoral nail osteosynthesis: a multicenter study.

BACKGROUND AND PURPOSE: Orthopedic trainees frequently perform short antegrade femoral nail osteosynthesis of trochanteric fractures, but virtual reality simulation-based training (SBT) with haptic feedback has been unavailable. We explored a novel simulator, with the aim of gathering validity evidence for an embedded test and setting a credible pass/fail standard allowing trainees to practice to proficiency. PATIENTS AND METHODS: The research, conducted from May to September 2020 across 3 Danish simulation centers, utilized the Swemac TraumaVision simulator for short antegrade femoral nail osteosynthesis. The validation process adhered to Messick's framework, covering all 5 sources of validity evidence. Participants included novice groups, categorized by training to plateau (n = 14) or to mastery (n = 10), and experts (n = 9), focusing on their performance metrics and training duration. RESULTS: The novices in the plateau group and experts had hands-on training for 77 (95% confidence interval [CI] 59-95) and 52 (CI 36-69) minutes while the plateau test score, defined as the average of the last 4 scores, was 75% (CI 65-86) and 96% (CI 94-98) respectively. The pass/fail standard was established at the average expert plateau test score of 96%. All novices in the mastery group could meet this standard and interestingly without increased hands-on training time (65 [CI 46-84] minutes). CONCLUSION: Our study provides supporting validity evidence from all sources of Messick's framework for a simulation-based test in short antegrade nail osteosynthesis of intertrochanteric hip fracture and establishes a defensible pass/fail standard for mastery learning of SBT. Novices who practiced using mastery learning were able to reach the pre-defined pass/fail standard and outperformed novices without a set goal for external motivation.

E-learning and practical performance in musculoskeletal ultrasound: a multicentre randomized study.

OBJECTIVES: To examine the effect of pre-course e-learning on residents' practical performance in musculoskeletal ultrasound (MSUS). METHODS: This was a multicentre, randomized controlled study following the Consolidated Standards of Reporting Trials (CONSORT) statement. Residents with no or little MSUS experience were randomized to either an e-learning group or a traditional group. One week before a 2-day face-to-face MSUS course, the e-learning group received access to an interactive platform consisting of online lectures, assignments, and practical instruction videos aligned with the content of the course. The traditional group only received standard pre-course information (program, venue, and time). All participants performed a pre- and post-course practical MSUS examination and were assessed by two individual raters, blinded to the group allocation, using the validated Objective Structured Assessment of Ultrasound Skills (OSAUS) tool. RESULTS: Twenty-eight participants completed the study. There were no statistically significant differences in the pre- or post-course practical MSUS performance between the e-learning group and the traditional group; the mean pre-course OSAUS score (s.d.) in the -learning group was 5.4 (3.7) compared with 5.2 (2.4) in the traditional group (P = 0.8), whereas the post-course OSAUS score in the e-learning group was 11.1 (2.8) compared with 10.9 (2.4) in the traditional group (P = 0.8). There was a significant difference between the mean pre- and post-course scores (5.74 points, P < 0.001). The OSAUS assessment tool demonstrated good inter-rater reliability (intra-class correlation = 0.84). CONCLUSION: We found no significant impact of pre-course e-learning on novices' acquisition of practical MSUS skills. Hands-on training is of the utmost importance and improves MSUS performance significantly. The OSAUS assessment tool is an applicable tool with high interrater reliability. TRIAL REGISTRATION: https://clinicaltrials.gov/ NCT04959162.

Laypersons versus experienced surgeons in assessing simulated robot-assisted radical prostatectomy.

BACKGROUND: Feedback is important for surgical trainees but it can be biased and time-consuming. We examined crowd-sourced assessment as an alternative to experienced surgeons' assessment of robot-assisted radical prostatectomy (RARP). METHODS: We used video recordings (n = 45) of three RARP modules on the RobotiX, Simbionix simulator from a previous study in a blinded comparative assessment study. A group of crowd workers (CWs) and two experienced RARP surgeons (ESs) evaluated all videos with the modified Global Evaluative Assessment of Robotic Surgery (mGEARS). RESULTS: One hundred forty-nine CWs performed 1490 video ratings. Internal consistency reliability was high (0.94). Inter-rater reliability and test-retest reliability were low for CWs (0.29 and 0.39) and moderate for ESs (0.61 and 0.68). In an Analysis of Variance (ANOVA) test, CWs could not discriminate between the skill level of the surgeons (p = 0.03-0.89), whereas ES could (p = 0.034). CONCLUSION: We found very low agreement between the assessments of CWs and ESs when they assessed robot-assisted radical prostatectomies. As opposed to ESs, CWs could not discriminate between surgical experience using the mGEARS ratings or when asked if they wanted the surgeons to perform their robotic surgery.

Massed Training is Logistically Superior to Distributed Training in Acquiring Basic Endovascular Skills.

OBJECTIVE: A "PROficiency based StePwise Endovascular Curricular Training" (PROSPECT) has proven its superiority over traditional training in a randomised controlled trial to acquire basic endovascular skills outside theatre, but real life adherence is low. This study aimed to compare the original distributed training format, where trainees learn at their own pace, with a massed training format offering the same content within a limited time span while exempt from clinical duties. Secondly, long term skills retention was evaluated. METHODS: A multicentre, prospective study allocated participants to the distributed D-PROSPECT or to a massed, compact version (C-PROSPECT) based on logistics such as travel time, participant and instructor availability. A multiple choice question (MCQ) test (max. score 20) tested cognitive skills. Technical skills were assessed using a global rating scale (GRS) (max. score 55), examiner's checklist (max. score 85), and validated simulator metrics. Data were collected pre- and post-programme and at three, six, and 12 months after programme completion. RESULTS: Over four years and in two countries, D-PROSPECT was implemented in two centres and C-PROSPECT in three. A total of 22 participants completed D-PROSPECT with a 41% dropout rate, and 21 completed C-PROSPECT with 0% dropout rate. All participants showed significant improvement for all performance parameters after programme completion: MCQ test (median 14.5 vs. 18; p < .001), GRS (median 20 vs. 41; p < .001), examiner's checklist (median 49 vs. 78.5; p < .001), and simulation metrics (p < .001). Scores of C- or D-PROSPECT participants were not significantly different. No significant differences were seen between groups during the retention period. CONCLUSION: PROSPECT significantly improves the quality of simulated endovascular performances using a massed or distributed training format. A massed training format of PROSPECT may be preferred to decrease dropout during standardised training to obtain basic endovascular skills in existing surgical curricula.

Facilitators and Barriers to Implementation of Simulation Based Education in Vascular Surgery in Europe.

OBJECTIVE: This study explored the status and availability of simulation based education (SBE) for learning vascular surgical procedures identified in the 2019 General Needs Assessment in vascular surgery in Europe (GNA-2019) and identified facilitators and barriers to SBE implementation in vascular surgery. METHODS: A three round iterative survey was distributed via the European Society for Vascular Surgery and the Union Européenne des Médecins Spécialistes. Members from leading committees and organisations within the European vascular surgical community were invited to participate as key opinion leaders (KOLs). Three online survey rounds explored demographics, SBE availability, and facilitators and barriers to SBE implementation. RESULTS: Overall, 147 KOLs (target population 338) accepted invitation to round 1, representing 30 European countries. The dropout rates for rounds 2 and 3 were 29% and 40%, respectively. Most respondents (88%) were senior, consultant level or higher. No mandatory SBE training was required in their department before training on patients, according to 84% of the KOLs. There was high consensus on the need for structured SBE (87%) and mandatory SBE (81%). SBE is available for the top three prioritised procedures in GNA-2019 (basic open skills, basic endovascular skills, and vascular imaging interpretation) in 24, 23, and 20 of the 30 represented European countries, respectively. The highest ranking facilitators were structured SBE programmes, availability of simulation equipment locally and regionally, good quality simulators, and having a dedicated person running the SBE. The highest ranked barriers were lack of structured SBE curriculum, equipment costs, lack of SBE culture, no or limited dedicated time for faculty to teach in SBE, and clinical work overload. CONCLUSION: Based largely on the opinions of KOLs in vascular surgery in Europe, this study revealed that SBE is needed in vascular surgery training and that systematic and structured programmes are required to ensure successful implementation.

Haptic simulators accelerate laparoscopic simulator training, but skills are not transferable to a non-haptic simulator: a randomized trial.

BACKGROUND: Laparoscopy requires specific psychomotor skills and can be challenging to learn. Most proficiency-based laparoscopic training programs have used non-haptic virtual reality simulators; however, haptic simulators can provide the tactile sensations that the surgeon would experience in the operating room. The objective was to investigate the effect of adding haptic simulators to a proficiency-based laparoscopy training program. METHODS: A randomized controlled trial was designed where residents (n = 36) were randomized to proficiency-based laparoscopic simulator training using haptic or non-haptic simulators. Subsequently, participants from the haptic group completed a follow-up test, where they had to reach proficiency again using the non-haptic simulator. Participants from the non-haptic group returned to train until reaching proficiency again using the non-haptic simulator. RESULTS: Mean completion times during the intervention were 120 min (SD 38.7 min) and 183 min (SD 66.3 min) for the haptic group and the non-haptic group, respectively (p = 0.001). The mean times to proficiency during the follow-up test were 107 min (SD 41.0 min) and 58 min (SD 23.7 min) for the haptic and the non-haptic group, respectively (p < 0.001). The haptic group was not faster to reach proficiency in the follow-up test than during the intervention (p = 0.22). In contrast, the non-haptic group reached the required proficiency level significantly faster in the follow-up test (p < 0.001). CONCLUSION: Haptic virtual reality simulators reduce the time to reach proficiency compared to non-haptic simulators. However, the acquired skills are not transferable to the conventional non-haptic setting.