Computer-aided quality assessment of endoscopist competence during colonoscopy: A systematic review.

BACKGROUND AND AIMS: Endoscopists' competence can vary widely, as shown in the variation in adenoma detection rate (ADR). Computer-aided quality assessment (CAQ) can automatically assess performance during individual procedures. This review aims to identify and describe different CAQ systems for colonoscopy. METHODS: A systematic review of the literature was done using MEDLINE, EMBASE, and SCOPUS based on three blocks of terms according to the inclusion criteria: Colonoscopy, Competence assessment, and Automatic evaluation. Articles were systematically reviewed by two reviewers, first by abstract and then in full text. The methodological quality was assessed using the Medical Education Research Study Quality Instrument (MERSQI). RESULTS: 12,575 studies were identified, 6,831 remained after removal of duplicates, and 6,806 did not pass the eligibility criteria and were excluded, leaving thirteen studies for final analysis. Five categories of CAQ systems were identified: Withdrawal speedometer (seven studies), Scope movement analysis (three studies), Effective withdrawal time (one study), Fold examination quality (one study), and Visual gaze pattern (one study). The withdrawal speedometer was the only CAQ system that tested its feedback by examining changes in ADR. Three studies observed an improvement in ADR, and two studies did not. The methodological quality of the studies was high (mean MERSQI 15.2 points, maximum 18 points). CONCLUSIONS: Thirteen studies developed or tested CAQ systems, most frequently by correlating it to ADR. Only five studies tested feedback by implementing the CAQ system. A meta-analysis was impossible due to the heterogeneous study designs, and more studies are warranted.

Training and assessment for colorectal surgery and appendicectomy- a systematic review.

AIM: There is currently an increased focus on competency-based training, in which training and assessment play a crucial role. The aim of this systematic review is to create an overview of hands-on training methods and assessment tools for appendicectomy and colon and rectal surgery procedures using either an open, laparoscopic or robot-assisted approach. METHOD: A systematic review of Medline, Embase, Cochrane and Scopus databases was conducted following the PRISMA guidelines. We conducted the last search on 9 March 2023. All published papers describing hands-on training, evaluation of performance data and development of assessment tools were eligible. The quality of studies and the validity evidence of assessment tools are reported. RESULTS: Fifty-one studies were identified. Laparoscopic assessment tools are abundant, but the literature still lacks good-quality assessment tools for open appendicectomy, robotic colectomy and open rectal surgery. Overall, there is a lack of discussion regarding the establishment of pass/fail standards and the consequences of assessment. Virtual reality simulation is used more for appendicectomy than colorectal procedures. Only a few of the studies investigating training were of acceptable quality. There is a need for high-quality studies in open and robotic-assisted colon surgery and all approaches to rectal surgery. CONCLUSION: This review provides an overview of current training methods and assessment tools and identifies where more research is needed based on the quality of the studies and the current validity evidence.

Variable practice is superior to self-directed training for laparoscopic simulator training: a randomized trial.

BACKGROUND: Mastering laparoscopy is challenging-it requires specific psychomotor skills which are difficult to obtain in the operating room without potentially compromising patient safety. Proficiency-based training programs using virtual reality simulators allow novices to practice and develop their skills in a patient-safe learning environment. Variable practice leads to stronger retention and skills transfer in a non-surgical setting. The objective of this trial was to investigate if variable practice was superior to self-directed training. METHODS: A randomized trial where participants (n = 36) were randomized to proficiency-based laparoscopic simulator training of basic skills using either variable practice or self-directed training, followed by a transfer test with proficiency-based training on a procedural task (a salpingectomy). All participants returned after a period of 3-5 weeks to perform a retention test. RESULTS: The mean time to proficiency for the basic skills tasks were 119 min (SD: 93) for the variable practice group versus 182 min (SD: 46) for the self-directed training group (p = 0.015). The time to reach proficiency during the transfer test was 103 min (SD: 57) versus 183 min (SD: 64) for the variable practice group versus the self-directed training group, respectively (p < 0.001). The mean time to proficiency for the retention test was 51 min (SD: 26) and 109 min (SD: 53) for the variable practice group and self-directed training group, respectively (p < 0.001). CONCLUSION: Variable practice is superior to self-directed training for proficiency-based laparoscopic training. With variable time to practice proficiency is reduced, there is higher transfer to a procedural task, and retention is improved.

Using neuroimaging to assess brain activity and areas associated with surgical skills: a systematic review.

BACKGROUND: Surgical skills acquisition is under continuous development due to the emergence of new technologies, and there is a need for assessment tools to develop along with these. A range of neuroimaging modalities has been used to map the functional activation of brain networks while surgeons acquire novel surgical skills. These have been proposed as a method to provide a deeper understanding of surgical expertise and offer new possibilities for the personalized training of future surgeons. With studies differing in modalities, outcomes, and surgical skills there is a need for a systematic review of the evidence. This systematic review aims to summarize the current knowledge on the topic and evaluate the potential use of neuroimaging in surgical education. METHODS: We conducted a systematic review of neuroimaging studies that mapped functional brain activation while surgeons with different levels of expertise learned and performed technical and non-technical surgical tasks. We included all studies published before July 1st, 2023, in MEDLINE, EMBASE and WEB OF SCIENCE. RESULTS: 38 task-based brain mapping studies were identified, consisting of randomized controlled trials, case-control studies, and observational cohort or cross-sectional studies. The studies employed a wide range of brain mapping modalities, including electroencephalography, functional magnetic resonance imaging, positron emission tomography, and functional near-infrared spectroscopy, activating brain areas involved in the execution and sensorimotor or cognitive control of surgical skills, especially the prefrontal cortex, supplementary motor area, and primary motor area, showing significant changes between novices and experts. CONCLUSION: Functional neuroimaging can reveal how task-related brain activity reflects technical and non-technical surgical skills. The existing body of work highlights the potential of neuroimaging to link task-related brain activity patterns with the individual level of competency or improvement in performance after training surgical skills. More research is needed to establish its validity and usefulness as an assessment tool.

No difference between using short and long intervals for distributed proficiency-based laparoscopy simulator training: a randomized trial.

BACKGROUND: Simulation-based training is increasingly used to acquire basic laparoscopic skills. Multiple factors can influence training, e.g., distributed practice is superior to massed practice in terms of efficiency. However, the optimal interval between training sessions is unclear. The objective of this trial was to investigate if shorter intervals between sessions are more efficient than longer intervals during proficiency-based laparoscopy simulator training. METHODS: A randomized simulation-based trial where medical students (n = 39) were randomized to proficiency-based training with either 1-2 days (intervention group) or 6-8 days (control group) between training sessions. Both groups practiced a series of basic tasks and a procedural module until proficiency level on the LapSim® simulator. Both groups were given instructor feedback upon request. After reaching proficiency, participants were invited back for a retention test 3-5 weeks later and practiced the same tasks to proficiency again. RESULTS: The mean time to reach proficiency during training was 291 (SD 89) and 299 (SD 89) min in the intervention and control group, respectively (p = 0.81). During the retention test, the mean time to reach proficiency was 94 (SD 53) and 96 (SD 39) minutes in the intervention and control groups, respectively (p = 0.91). CONCLUSION: We found no difference whether practicing with shorter intervals or longer intervals between training sessions when examining time to proficiency or retention.

First experience with the Hugo™ robot-assisted surgery system for endometriosis: A descriptive study.

INTRODUCTION: The Medtronic Hugo™ Robot-assisted Surgery (RAS) system was recently approved for clinical use. We explored the safety and feasibility of this system for endometriosis surgery. The primary outcome was safe case completion without major surgical complications (Clavien-Dindo grade ≤2) and no conversion to open surgery or laparoscopy. MATERIAL AND METHODS: Surgeries for endometriosis performed at the Department of Gynecology, Rigshospitalet, on the Medtronic Hugo™ RAS system were included. Two experienced robotic surgeons performed all surgeries with their usual robotic team. The variables included were patient demographics, peri- and postoperative data, complications and 30-day readmission rate. We used the IDEAL framework 1/2a for surgical innovation in this descriptive study. RESULTS: The first 12 patients were included. All cases were completed without intraoperative complications or conversion. Four patients experienced Clavien-Dindo grade 1 postoperative complications. No patients were re-admitted within 30 days. Median docking time (17 minutes), console time (87.5 minutes), blood loss (40 mL) and length of hospital stay (1 day) were acceptable compared with previous literature. CONCLUSIONS: In this pilot study, we found the Medtronic Hugo™ RAS system safe and feasible for robot-assisted surgery for endometriosis. The advent of new robotic systems is welcomed to accelerate the development of technology that will advance surgical care for patients across the globe.

Developing a phantom for simulating robotic-assisted complete mesocolic excision using 3D printing and medical imaging.

BACKGROUND: Robotic-assisted complete mesocolic excision is an advanced procedure mainly because of the great variability in anatomy. Phantoms can be used for simulation-based training and assessment of competency when learning new surgical procedures. However, no phantoms for robotic complete mesocolic excision have previously been described. This study aimed to develop an anatomically true-to-life phantom, which can be used for training with a robotic system situated in the clinical setting and can be used for the assessment of surgical competency. METHODS: Established pathology and surgical assessment tools for complete mesocolic excision and specimens were used for the phantom development. Each assessment item was translated into an engineering development task and evaluated for relevance. Anatomical realism was obtained by extracting relevant organs from preoperative patient scans and 3D printing casting moulds for each organ. Each element of the phantom was evaluated by two experienced complete mesocolic excision surgeons without influencing each other's answers and their feedback was used in an iterative process of prototype development and testing. RESULTS: It was possible to integrate 35 out of 48 procedure-specific items from the surgical assessment tool and all elements from the pathological evaluation tool. By adding fluorophores to the mesocolic tissue, we developed an easy way to assess the integrity of the mesocolon using ultraviolet light. The phantom was built using silicone, is easy to store, and can be used in robotic systems designated for patient procedures as it does not contain animal-derived parts. CONCLUSIONS: The newly developed phantom could be used for training and competency assessment for robotic-assisted complete mesocolic excision surgery in a simulated setting.

Laypersons versus experienced surgeons in assessing simulated robot-assisted radical prostatectomy.

BACKGROUND: Feedback is important for surgical trainees but it can be biased and time-consuming. We examined crowd-sourced assessment as an alternative to experienced surgeons' assessment of robot-assisted radical prostatectomy (RARP). METHODS: We used video recordings (n = 45) of three RARP modules on the RobotiX, Simbionix simulator from a previous study in a blinded comparative assessment study. A group of crowd workers (CWs) and two experienced RARP surgeons (ESs) evaluated all videos with the modified Global Evaluative Assessment of Robotic Surgery (mGEARS). RESULTS: One hundred forty-nine CWs performed 1490 video ratings. Internal consistency reliability was high (0.94). Inter-rater reliability and test-retest reliability were low for CWs (0.29 and 0.39) and moderate for ESs (0.61 and 0.68). In an Analysis of Variance (ANOVA) test, CWs could not discriminate between the skill level of the surgeons (p = 0.03-0.89), whereas ES could (p = 0.034). CONCLUSION: We found very low agreement between the assessments of CWs and ESs when they assessed robot-assisted radical prostatectomies. As opposed to ESs, CWs could not discriminate between surgical experience using the mGEARS ratings or when asked if they wanted the surgeons to perform their robotic surgery.

Haptic simulators accelerate laparoscopic simulator training, but skills are not transferable to a non-haptic simulator: a randomized trial.

BACKGROUND: Laparoscopy requires specific psychomotor skills and can be challenging to learn. Most proficiency-based laparoscopic training programs have used non-haptic virtual reality simulators; however, haptic simulators can provide the tactile sensations that the surgeon would experience in the operating room. The objective was to investigate the effect of adding haptic simulators to a proficiency-based laparoscopy training program. METHODS: A randomized controlled trial was designed where residents (n = 36) were randomized to proficiency-based laparoscopic simulator training using haptic or non-haptic simulators. Subsequently, participants from the haptic group completed a follow-up test, where they had to reach proficiency again using the non-haptic simulator. Participants from the non-haptic group returned to train until reaching proficiency again using the non-haptic simulator. RESULTS: Mean completion times during the intervention were 120 min (SD 38.7 min) and 183 min (SD 66.3 min) for the haptic group and the non-haptic group, respectively (p = 0.001). The mean times to proficiency during the follow-up test were 107 min (SD 41.0 min) and 58 min (SD 23.7 min) for the haptic and the non-haptic group, respectively (p < 0.001). The haptic group was not faster to reach proficiency in the follow-up test than during the intervention (p = 0.22). In contrast, the non-haptic group reached the required proficiency level significantly faster in the follow-up test (p < 0.001). CONCLUSION: Haptic virtual reality simulators reduce the time to reach proficiency compared to non-haptic simulators. However, the acquired skills are not transferable to the conventional non-haptic setting.

Competency assessment for the Versius surgical robot: a validity investigation study of a virtual reality simulator-based test.

BACKGROUND: When introducing new equipment like robotic surgical systems, it is essential to ensure that surgeons have the basic skills before operating on patients. The objective was to investigate the validity evidence for a competency-based test for basic robotic surgical skills using the Versius® trainer. METHODS: We recruited medical students, residents, and surgeons which were classified based on data on clinical experience with the Versius system as either novices (0 min), intermediates (1-1000 min), or experienced (> 1000 min). All participants completed three rounds of eight basic exercises on the Versius trainer, where the first was used for familiarization and the final two for data analysis. The simulator automatically recorded data. Validity evidence was summarized using Messick's framework, and the contrasting groups' standard-setting method was used to define pass/fail levels. RESULTS: 40 participants completed the three rounds of exercises. The discriminatory abilities of all parameters were tested, and five exercises including relevant parameters were selected to be part of the final test. 26 of 30 parameters could differentiate between novices and experienced surgeons but none of the parameters could discriminate between the intermediate and experienced surgeons. Test-retest reliability analysis using Pearson's r or Spearman's rho showed only 13 of 30 parameters had moderate or higher reliability. Non-compensatory pass/fail levels were defined for each exercise and showed that all novices failed all the exercises and that most experienced surgeons either passed or nearly passed all five exercises. CONCLUSION: We identified relevant parameters for five exercises that could be used to assess basic robotic skills for the Versius robotic system and defined a credible pass/fail level. This is the first step in developing a proficiency-based training program for the Versius system.

Acquisition and usage of robotic surgical data for machine learning analysis.

BACKGROUND: The increasing use of robot-assisted surgery (RAS) has led to the need for new methods of assessing whether new surgeons are qualified to perform RAS, without the resource-demanding process of having expert surgeons do the assessment. Computer-based automation and artificial intelligence (AI) are seen as promising alternatives to expert-based surgical assessment. However, no standard protocols or methods for preparing data and implementing AI are available for clinicians. This may be among the reasons for the impediment to the use of AI in the clinical setting. METHOD: We tested our method on porcine models with both the da Vinci Si and the da Vinci Xi. We sought to capture raw video data from the surgical robots and 3D movement data from the surgeons and prepared the data for the use in AI by a structured guide to acquire and prepare video data using the following steps: 'Capturing image data from the surgical robot', 'Extracting event data', 'Capturing movement data of the surgeon', 'Annotation of image data'. RESULTS: 15 participant (11 novices and 4 experienced) performed 10 different intraabdominal RAS procedures. Using this method we captured 188 videos (94 from the surgical robot, and 94 corresponding movement videos of the surgeons' arms and hands). Event data, movement data, and labels were extracted from the raw material and prepared for use in AI. CONCLUSION: With our described methods, we could collect, prepare, and annotate images, events, and motion data from surgical robotic systems in preparation for its use in AI.

Transfer of skills between laparoscopic and robot-assisted surgery: a systematic review.

BACKGROUND: Robot-assisted surgery is today well-implemented in many surgical specialties, but requires another skill set than laparoscopy. Most often, robot-assisted surgery is considered add-on to laparoscopic skills but very little is known about the transfer of skills. The aim of the study was to examine to what extent surgical skills are transferable between laparoscopic and robot-assisted surgery. METHODS: A systematic search was conducted in three databases (Ovid Medline, Embase, and Web of Science). Studies investigating transfer of skills between laparoscopy and robot-assisted surgery in either a phantom-based, simulation-based, animal model, or clinical setting were eligible for inclusion. Quality assessment was done using the Medical education research study quality instrument and educational New Ottawa Scale. RESULTS: Of 15,610 studies identified, 89 studies continued to full-text reading, and 37 studies were included. Four studies were found non-comparable and were left out of the results for the primary outcome. All 33 studies explored transfer from laparoscopy to robot-assisted surgery and 17 found a positive transfer whereas 15 did not. Only 11 studies explored transfer from robot-assisted surgery to laparoscopy, of which only three found a positive transfer. CONCLUSION: An almost equal number of publications found a positive transfer and no transfer from laparoscopic to robot-assisted surgery. Fewer studies explored the transfer from robot-assisted surgery to laparoscopy. Very little evidence supports that surgeons trained solely in robot-assisted surgery can perform laparoscopy. This must be considered in future training programs as robot-assisted surgery is expected to become the first-in-line modality for many future surgeons.

Identifying curriculum content for operating room nurses involved in robotic-assisted surgery: a Delphi study.

BACKGROUND: Currently, no generally accepted curriculum for operating room nurses (OR nurses) working with robotic-assisted surgery (RAS) exists. OR nurses working with RAS require different competencies than regular OR nurses, e.g. knowledge of the robotic system and equipment and specific emergency undocking procedures. The objective of this study was to identify learning goals for a curriculum for OR nurses working with RAS and to investigate which learning methods should be used. METHODS: A three-round Delphi approach, with an additional survey, was used in this study. Four OR nurses from every department in gynecology, urology, and surgical gastroenterology doing RAS in Denmark were invited to participate. RESULTS: The response rates were 93%, 81%, and 79%, respectively, in the three rounds of the Delphi survey and 68% in the additional survey. After the processing of data, a list of 57 learning goals, sorted under 11 domains, was produced. 41 learning goals were rated Relevant, Very relevant, or Essential spread over 10 of the 11 domains. The top 3 learning goals rated as Essential: Identify the most common injuries related to patient positioning during robotic-assisted surgery and know how to avoid them, Connect, calibrate and handle the scope, Perform an emergency undocking procedure. The panel rated Supervised training during surgery on patients as the most relevant learning method, followed by Dry lab and Team training. CONCLUSIONS: The learning goals identified in this study, can be used as the basis for a curriculum for OR nurses working with RAS. During the processing, it became clear that there is a need to further investigate issues such as communication challenges, awareness of emergency procedures, and differences in the skills required depending on the role of the RAS nurse.

Preparing for Reality: A Randomized Trial on Immersive Virtual Reality for Bronchoscopy Training.

BACKGROUND: Bronchoscopy is an essential procedure in the diagnosis and treatment of pulmonary diseases. However, the literature suggests that distractions affect the quality of bronchoscopy and affect inexperienced doctors more than experienced. OBJECTIVES: The objective of the study was as follows: does simulation-based bronchoscopy training with immersive virtual reality (iVR) improve the doctors' ability to handle distractions and thereby increase the quality, measured in procedure time, structured progression score, diagnostic completeness (%), and hand motor movements of a diagnostic bronchoscopy in a simulated scenario. Exploratory outcomes were heart rate variability and a cognitive load questionnaire (Surg-TLX). METHODS: Participants were randomized. The intervention group practiced in an iVR environment with a head-mounted display (HMD) while using the bronchoscopy simulator, while the control group trained without the HMD. Both groups were tested in the iVR environment using a scenario with distractions. RESULTS: 34 participants completed the trial. The intervention group scored significantly higher in diagnostic completeness (100 i.q.r. 100-100 vs. 94 i.q.r. 89-100, p value = 0.03) and structured progress (16 i.q.r. 15-18 vs. 12 i.q.r. 11-15, p value 0.03) but not in procedure time (367 s standard deviation [SD] 149 vs. 445 s SD 219, p value = 0.06) or hand motor movements (-1.02 i.q.r. -1.03-[-1.02] versus -0.98 i.q.r. -1.02-[-0.98], p value = 0.27). The control group had a tendency toward a lower heart rate variability (5.76 i.q.r. 3.77-9.06 vs. 4.12 i.q.r. 2.68-6.27, p = 0.25). There was no significant difference in total Surg-TLX points between the two groups. CONCLUSION: iVR simulation training increases the quality of diagnostic bronchoscopy in a simulated scenario with distractions compared with conventional simulation-based training.

Standard Setting in Simulation-based Training of Surgical Procedures: A Systematic Review.

OBJECTIVE: This systematic review aims to examine the use of standard-setting methods in the context of simulation-based training of surgical procedures. SUMMARY OF BACKGROUND: Simulation-based training is increasingly used in surgical education. However, it is important to determine which level of competency trainees must reach during simulation-based training before operating on patients. Therefore, pass/fail standards must be established using systematic, transparent, and valid methods. METHODS: Systematic literature search was done in 4 databases (Ovid MEDLINE, Embase, Web of Science, and Cochrane Library). Original studies investigating simulation-based assessment of surgical procedures with the application of a standard setting were included. Quality of evidence was appraised using GRADE. RESULTS: Of 24,299 studies identified by searches, 232 studies met the inclusion criteria. Publications using already established standard settings were excluded (N = 70), resulting in 162 original studies included in the final analyses. Most studies described how the standard setting was determined (N = 147, 91%) and most used the mean or median performance score of experienced surgeons (n = 65, 40%) for standard setting. We found considerable differences across most of the studies regarding study design, setup, and expert level classification. The studies were appraised as having low and moderate evidence. CONCLUSION: Surgical education is shifting toward competency-based education, and simulation-based training is increasingly used for acquiring skills and assessment. Most studies consider and describe how standard settings are established using more or less structured methods but for current and future educational programs, a critical approach is needed so that the learners receive a fair, valid, and reliable assessment.

Simulation-based VATS resection of the five lung lobes: a technical skills test.

BACKGROUND: Video-Assisted Thoracoscopic Surgery (VATS) lobectomy is an advanced procedure and to maximize patient safety it is important to ensure the competency of thoracic surgeons before performing the procedure. The objective of this study was to investigate validity evidence for a virtual reality simulator-based test including multiple lobes of the lungs. METHOD: VATS experts from the department of Cardiothoracic Surgery at Rigshospitalet, Copenhagen, Denmark, worked with Surgical Science (Gothenburg, Sweden) to develop VATS lobectomy modules for the LapSim® virtual reality simulator covering all five lobes of the lungs. Participants with varying experience in VATS were recruited and classified as either novice, intermediate, or experienced surgeons. Each participant performed VATS lobectomy on the simulator for three different randomly chosen lobes. Nine predefined simulator metrics were automatically recorded on the simulator. RESULTS: Twenty-two novice, ten intermediate, and nine experienced surgeons performed the test resulting in a total of 123 lobectomies. Analysis of Variances (ANOVA) found significant differences between the three groups for parameters: blood loss (p < 0.001), procedure time (p < 0.001), and total instrument path length (p = 0.03). These three metrics demonstrated high internal consistency and significant test-retest reliability was found between each of them. Relevant pass/fail levels were established for each of the three metrics, 541 ml, 30 min, and 71 m, respectively. CONCLUSION: This study provides validity evidence for a simulator-based test of VATS lobectomy competence including multiple lobes of the lungs. The test can be used to ensure basic competence at the end of a simulation-based training program for thoracic surgery trainees.

Identifying curriculum content for a cross-specialty robotic-assisted surgery training program: a Delphi study.

BACKGROUND: Robotic-assisted surgery is increasing and there is a need for a structured and evidence-based curriculum to learn basic robotic competencies. Relevant training tasks, eligible trainees, realistic learning goals, and suitable training methods must be identified. We sought to develop a common curriculum that can ensure basic competencies across specialties. METHODS: Two robotic surgeons from all departments in Denmark conducting robotic-assisted surgery within gynecology, urology, and gastrointestinal surgery, were invited to participate in a three-round Delphi study to identify learning goals and rank them according to relevance for a basic curriculum. An additional survey was conducted after the Delphi rounds on what training methods were considered best for each learning goal and who (console surgeon/patient-side assistant) should master each learning goal. RESULTS: Fifty-six robotic surgeons participated and the response rates were 86%, 89%, and 77%, for rounds 1, 2 and 3, respectively. The Delphi study identified 40 potential learning goals, of which 29 were ranked as essential, e.g., Understand the link between arm placement and freedom of movement or Be able to perform emergency un-docking. In the additional survey, the response rate was 70%. Twenty-two (55%) of the identified learning goals were found relevant for the patient-side assistant and twenty-four (60%) were linked to a specific suitable learning method with > 75% agreement. CONCLUSIONS: Our findings can help training centers plan their training programs concerning educational content and methods for training/learning. Furthermore, patient-side assistants should also receive basic skills training in robotic surgery.

Assessing VATS competence based on simulated lobectomies of all five lung lobes.

OBJECTIVES: To determine the number of procedures and expert raters necessary to provide a reliable assessment of competence in Video-Assisted Thoracoscopic Surgery (VATS) lobectomy. METHODS: Three randomly selected VATS lobectomies were performed on a virtual reality simulator by participants with varying experience in VATS. Video recordings of the procedures were independently rated by three blinded VATS experts using a modified VATS lobectomy assessment tool (VATSAT). The unitary framework of validity was used to describe validity evidence, and generalizability theory was used to explore the reliability of different assessment options. RESULTS: Forty-one participants (22 novices, 10 intermediates, and 9 experienced) performed a total of 123 lobectomies. Internal consistency reliability, inter-rater reliability, and test-retest reliability were 0.94, 0.85, and 0.90, respectively. Generalizability theory found that a minimum of two procedures and four raters or three procedures and three raters were needed to ensure the overall reliability of 0.8. ANOVA showed significant differences in test scores between the three groups (P < 0.001). A pass/fail level of 19 out of 25 points was established using the contrasting groups' standard setting method, leaving one false positive (one novice passed) and zero false negatives (all experienced passed). CONCLUSION: We demonstrated validity evidence for a VR simulator test with different lung lobes, and a credible pass/fail level was identified. Our results can be used to implement a standardized mastery learning training program for trainees in VATS lobectomies that ensures that everyone reaches basic competency before performing supervised operations on patients.

Cognitive load and performance in immersive virtual reality versus conventional virtual reality simulation training of laparoscopic surgery: a randomized trial.

BACKGROUND: Virtual reality simulators combined with head-mounted displays enable highly immersive virtual reality (VR) for surgical skills training, potentially bridging the gap between the simulation environment and real-life operating room conditions. However, the increased complexity of the learning situation in immersive VR could potentially induce high cognitive load thereby inhibiting performance and learning. This study aims to compare cognitive load and performance in immersive VR and conventional VR simulation training. METHODS: A randomized controlled trial of residents (n = 31) performing laparoscopic salpingectomies with an ectopic pregnancy in either immersive VR or conventional VR simulation. Cognitive load was estimated by secondary-task reaction time at baseline, and during nonstressor and stressor phases of the procedure. Simulator metrics were used to evaluate performance. RESULTS: Cognitive load was increased by 66% and 58% during immersive VR and conventional VR simulation, respectively (p < 0.001), compared to baseline. A light stressor induced a further increase in cognitive load by 15.2% and a severe stressor by 43.1% in the immersive VR group compared to 23% (severe stressor) in the conventional VR group. Immersive VR also caused a significantly worse performance on most simulator metrics. CONCLUSION: Immersive VR simulation training induces a higher cognitive load and results in a poorer performance than conventional VR simulation training in laparoscopy. High extraneous load and element interactivity in the immersive VR are suggested as mechanisms explaining this finding. However, immersive VR offers some potential advantages over conventional VR such as more real-life conditions but we only recommend introducing immersive VR in surgical skills training after initial training in conventional VR.

The role of non-invasive imaging techniques in detecting intra-abdominal adhesions: a systematic review.

BACKGROUND: Intra-abdominal adhesions after surgery are highly prevalent. Adhesions implicate complications during subsequent surgery and can cause chronic abdominal pain. The objective of this review was to investigate the usefulness of non-invasive diagnostic methods for detection of adhesions. METHODS: We searched the electronic databases: MEDLINE, Embase, and The Cochrane Central Register of Controlled Trials for studies investigating the use of non-invasive diagnostic imaging techniques for detecting adhesions. Main outcome was the sensitivity and specificity of each technique. We used the Quality Assessment of Diagnostic Accuracy studies tool to assess bias. RESULTS: In total, 25 studies were included: 18 using ultrasound (US), 5 using magnetic resonance imaging (MRI), 1 using computed tomography (CT), and 1 using both US and MRI. A total of 2195 patients were included. Overall accuracy ranged between 76 and 100% for US studies and between 79 and 90% for MRI and was 66% for CT. Sensitivity ranged between 21 and 100% for US and between 22 and 93% for MRI and was 61% for CT. Specificity was 32-100% for US, 25-93% for MRI, and 63% for CT. Bias analysis revealed that in most studies, investigators were blinded to the reference standard but not to the index test and 11 of 25 studies had a high risk of selection bias. CONCLUSIONS: Currently, abdominal US can be used to determine the presence of adhesions between bowel and the abdominal wall. MRI is also an accurate diagnostic modality and can in addition visualize adhesions between viscera, however, with a tendency to over diagnose adhesions. There is insufficient evidence to support CT as a diagnostic modality for adhesions.