LapBot-Safe Chole: validation of an artificial intelligence-powered mobile game app to teach safe cholecystectomy.

BACKGROUND: Gaming can serve as an educational tool to allow trainees to practice surgical decision-making in a low-stakes environment. LapBot is a novel free interactive mobile game application that uses artificial intelligence (AI) to provide players with feedback on safe dissection during laparoscopic cholecystectomy (LC). This study aims to provide validity evidence for this mobile game. METHODS: Trainees and surgeons participated by downloading and playing LapBot on their smartphone. Players were presented with intraoperative LC scenes and required to locate their preferred location of dissection of the hepatocystic triangle. They received immediate accuracy scores and personalized feedback using an AI algorithm ("GoNoGoNet") that identifies safe/dangerous zones of dissection. Player scores were assessed globally and across training experience using non-parametric ANOVA. Three-month questionnaires were administered to assess the educational value of LapBot. RESULTS: A total of 903 participants from 64 countries played LapBot. As game difficulty increased, average scores (p < 0.0001) and confidence levels (p < 0.0001) decreased significantly. Scores were significantly positively correlated with players' case volume (p = 0.0002) and training level (p = 0.0003). Most agreed that LapBot should be incorporated as an adjunct into training programs (64.1%), as it improved their ability to reflect critically on feedback they receive during LC (47.5%) or while watching others perform LC (57.5%). CONCLUSIONS: Serious games, such as LapBot, can be effective educational tools for deliberate practice and surgical coaching by promoting learner engagement and experiential learning. Our study demonstrates that players' scores were correlated to their level of expertise, and that after playing the game, most players perceived a significant educational value.

Education in Laparoscopic Cholecystectomy: Design and Feasibility Study of the LapBot Safe Chole Mobile Game.

BACKGROUND:  Major bile duct injuries during laparoscopic cholecystectomy (LC), often stemming from errors in surgical judgment and visual misperception of critical anatomy, significantly impact morbidity, mortality, disability, and health care costs. OBJECTIVE:  To enhance safe LC learning, we developed an educational mobile game, LapBot Safe Chole, which uses an artificial intelligence (AI) model to provide real-time coaching and feedback, improving intraoperative decision-making. METHODS:  LapBot Safe Chole offers a free, accessible simulated learning experience with real-time AI feedback. Players engage with intraoperative LC scenarios (short video clips) and identify ideal dissection zones. After the response, users receive an accuracy score from a validated AI algorithm. The game consists of 5 levels of increasing difficulty based on the Parkland grading scale for cholecystitis. RESULTS:  Beta testing (n=29) showed score improvements with each round, with attendings and senior trainees achieving top scores faster than junior residents. Learning curves and progression distinguished candidates, with a significant association between user level and scores (P=.003). Players found LapBot enjoyable and educational. CONCLUSIONS:  LapBot Safe Chole effectively integrates safe LC principles into a fun, accessible, and educational game using AI-generated feedback. Initial beta testing supports the validity of the assessment scores and suggests high adoption and engagement potential among surgical trainees.

Educational value of a novel telestration device for surgical coaching-a randomized controlled trial.

INTRODUCTION: Communication is fundamental to effective surgical coaching. This can be challenging for training during image-guided procedures where coaches and trainees need to articulate technical details on a monitor. Telestration devices that annotate on monitors remotely could potentially overcome these limitations and enhance the coaching experience. This study aims to evaluate the value of a novel telestration device in surgical coaching. METHODS: A randomized-controlled trial was designed. All participants watched a video demonstrating the task followed by a baseline performance assessment and randomization into either control group (conventional verbal coaching without telestration) or telestration group (verbal coaching with telestration). Coaching for a simulated laparoscopic small bowel anastomosis on a dry lab model was done by a faculty surgeon. Following the coaching session, participants underwent a post-coaching performance assessment of the same task. Assessments were recorded and rated by blinded reviewers using a modified Global Rating Scale of the Objective Structured Assessment of Technical Skills (OSATS). Coaching sessions were also recorded and compared in terms of mentoring moments; guidance misinterpretations, questions/clarifications by trainees, and task completion time. A 5-point Likert scale was administered to obtain feedback. RESULTS: Twenty-four residents participated (control group 13, telestration group 11). Improvements in some elements of the OSATS scale were noted in the Telestration arm but there was no statistical significance in the overall score between the two groups. Mentoring moments were more in the telestration Group. Amongst the telestration Group, 55% felt comfortable that they could perform this task independently, compared to only 8% amongst the control group and 82% would recommend the use of telestration tools here. CONCLUSION: There is demonstrated educational value of this novel telestration device mainly in the non-technical aspects of the interaction by enhancing the coaching experience with improvement in communication and greater mentoring moments between coach and trainee.

Training for excellence: using a multimodal videoconferencing platform to coach surgeons and improve intraoperative performance.

INTRODUCTION: Continuing Professional Development opportunities for lifelong learning are fundamental to the acquisition of surgical expertise. However, few opportunities exist for longitudinal and structured learning to support the educational needs of surgeons in practice. While peer-to-peer coaching has been proposed as a potential solution, there remains significant logistical constraints and a lack of evidence to support its effectiveness. The purpose of this study is to determine whether the use of remote videoconferencing for video-based coaching improves operative performance. METHODS: Early career surgeon mentees participated in a remote coaching intervention with a surgeon coach of their choice and using a virtual telestration platform (Zoom Video Communications, San Jose, CA). Feedback was articulated through annotating videos. The coach evaluated mentee performance using a modified Intraoperative Performance Assessment Tool (IPAT). Participants completed a 5-point Likert scale on the educational value of the coaching program. RESULTS: Eight surgeons were enrolled in the study, six of whom completed a total of two coaching sessions (baseline, 6-month). Subspecialties included endocrine, hepatopancreatobiliary, and surgical oncology. Mean age of participants was 39 (SD 3.3), with mean 5 (SD 4.1) years in independent practice. Total IPAT scores increased significantly from the first session (mean 47.0, SD 1.9) to the second session (mean 51.8, SD 2.1), p = 0.03. Sub-category analysis showed a significant improvement in the Advanced Cognitive Skills domain with a mean of 33.2 (SD 2.5) versus a mean of 37.0 (SD 2.4), p < 0.01. There was no improvement in the psychomotor skills category. Participants agreed or strongly agreed that the coaching programs can improve surgical performance and decision-making (coaches 85%; mentees 100%). CONCLUSION: Remote surgical coaching is feasible and has educational value using ubiquitous commercially available virtual platforms. Logistical issues with scheduling and finding cases aligned with learning objectives continue to challenge program adoption and widespread dissemination.

Perceptions of the multidisciplinary operative team on intraoperative telecoaching among surgeons.

Telecoaching, intraoperative coaching through videoconference, has been suggested as a tool to overcome logistical barriers with in-person coaching. However, little is known about the operative team's perception of telecoaching and its unique set of challenges. This qualitative study explores the perceptions of the multidisciplinary operative team on surgical telecoaching. A telecoaching program between peer surgeons was implemented using the Karl Storz Visitor1 remote presence system (Karl Storz, Germany). Semistructured interviews were conducted with the 12 operative team members present during 2 telecoaching sessions completed during the study period. Twelve participants were interviewed. The 4 central themes that emerged from the data were effective communication and collaboration, improving performance, operating room workflow, and culture and optics. Participating surgeon mentees reported that the session met expectations and learning goals and revealed concerns about negative perception of their autonomy and expertise by colleagues and patients. Conversely, team members unanimously reported a positive impression of surgeon mentees for taking additional measures to improve their performance and for patient outcomes. The operative team members reported that telecoaching was conducive to their own learning and relevant for complex cases. Considerations for future implementation of telecoaching include robust privacy standards for patients and staff, strong internet connectivity, coordinating with the operative team, and space constraints. Operative team participants viewed the intervention favorably and identified practical considerations for its continued use in an operating room environment. However, more work is needed on surgical culture as a contributor to low adoption and its impact on coaching programming activity.

Establishing validity evidence for device-assisted advanced laparoscopic suturing tasks using simulation.

BACKGROUND: Laparoscopic suturing (LS) is an essential technique required for a wide range of procedures, and it is one of the most challenging for surgical trainees to master. We designed and collected validity evidence for advanced LS tasks using an automated suturing device and evaluated the perceived educational value of the tasks. METHODS: This project was a multicentre prospective study involving McGill University, University of Toronto (UofT), and Louisiana State University (LSU) Health New Orleans. Novice (NS) and experienced (ES) surgeons performed suturing under tension (UT) and continuous suturing (CS) tasks. ES performed the tasks twice to establish proficiency benchmarks, and they were interviewed to develop formative feedback tools (FFT). Participants were assessed on completion time, error, Global Operative Assessment of Laparoscopic Skills (GOALS), and FFT. Data were analyzed using descriptive and inferential statistical methods. RESULTS: Twenty-seven participants (13 ES, 14 NS, median age 34 years; 85% male) completed the study. Eight were attending surgeons, 7 fellows, 4 PGY5, 5 PGY4, and 3 PGY3 (18 from McGill, 5 UofT, and 4 LSU). Comparing ES and NS, for UT task, ES had significantly greater task scores (570 [563-648] vs 323 [130-464], p value 0.00036) and GOALS scores (14 [13-16] vs 10 [8-12], p value 0.0038). Similarly, for CS, ES had significantly greater task scores (976 [959-1010] vs 785 [626-856], p value 0.00009) and GOALS scores (16 [12-17] vs 12.5 [8.25-15], p value 0.028). After FFTs were developed, comparing ES and NS, for both UT and CS tasks, ES had significantly greater FFT scores (UT 25 [24-26] vs 17 [14-20], p value 0.0016 and CS 30 [27-32] vs 22[17.2-25.8], p value 0.00061). CONCLUSION: In conclusion, preliminary validity evidence was provided for the tasks. Once further validity evidence is established, incorporating the tasks into the training curricula could improve trainee skills and help to meet the need for better advanced suturing models.

Development of a simulation curriculum to teach and assess advanced laparoscopic suturing skills using telesimulation: a feasibility study.

BACKGROUND: Telesimulation helps overcome limitations in time and local expertise by eliminating the need for the learner and educator to be physically co-located, especially important during COVID-19. We investigated whether teaching advanced laparoscopic suturing (ALS) through telesimulation is feasible, effective, and leads to improved suturing in the operating room (OR). METHODS: In this prospective feasibility study, three previously developed 3D-printed ALS tasks were used: needle handling (NH), suturing under tension (UT), and continuous suturing (CS). General surgery residents (PGY4-5) underwent 1-month of telesimulation training, during which an expert educator at one site remotely trained residents at the other site over 2-3 teaching sessions. Trainees were assessed in the three tasks and in the OR at three time points: baseline(A1), control period(A2), and post-intervention(A3) and completed questionnaires regarding educational value and usability of telesimulation. Paired t-test was used to compare scores between the three assessment points. RESULTS: Six residents were included. Scores for UT improved significantly post-intervention A3(568 ± 60) when compared to baseline A1(416 ± 133) (p < 0.019). Similarly, scores for CS improved significantly post-intervention A3(756 ± 113) vs. baseline A1(539 ± 211) (p < 0.02). For intraoperative assessments, scores improved significantly post-intervention A3(21 ± 3) when compared to both A1(17 ± 4) (p < 0.018) and A2(18 ± 4) (p < 0.0008). All residents agreed that tasks were relevant to practice, helped improve technical competence, and adequately measured suturing skill. All residents found telesimulation easy to use, had strong educational value, and want the system to be incorporated into their training. CONCLUSION: The use of telesimulation for remotely training residents using ALS tasks was feasible and effective. Residents found value in training using the tasks and telesimulation system, and improved ALS skills in the OR. As the pandemic has caused a major structural shift in resident education, telesimulation can be an effective alternative to on-site simulation programs. Future research should focus on how telesimulation can be effectively incorporated into training programs.

Impact of a Mobile App to Support Home Recovery of Patients Undergoing Bariatric Surgery.

BACKGROUND: Perioperative patient education and engagement are critical components of care in patients undergoing bariatric surgery, given the short length of stay and the requirements to adhere to various instructions. The use of patient engagement mobile technology may promote adherence to perioperative protocols and improve care by potentially identifying complications earlier and reducing associated health care costs. MATERIALS AND METHODS: We introduced a mobile app that provides bariatric patients with access to educational materials and the ability to report on their symptoms. Using the data from the app and linking the data to patient outcomes collected in the Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program database, we examined the effects of the app on readmission, length of stay, visits to the emergency department (ED), and patient satisfaction. RESULTS: A total of 505 patients were enrolled in the app between July 2017 and March 2019. Among them, 396 patients who met the inclusion criteria for the study were compared with 458 patients in the Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program database who were not enrolled in the app for the same study period. While the use of the app was not associated with the rates of prolonged length of stay, ED visits, and readmission, patients who completed a survey at 30 d after discharge reported that the app helped them avoid phone calls to the hospital (48.5%) and ED visits (13.0%). Furthermore, 94.8% of these patients reported that they would recommend the app to other patients undergoing the same surgery. CONCLUSIONS: Additional features, such as the ability for patients to directly communicate with the health care providers within the app, may be effective in decreasing unnecessary health care utilization.

The impact of telemedicine on greenhouse gas emissions at an academic health science center in Canada.

OBJECTIVE: This study estimates the reduction in greenhouse gas (GHG) emissions resulting from 840 telemedicine consultations completed in a 6-month time period. Our model considers GHG emissions for both vehicle and videoconferencing unit energy use. Cost avoidance factors are also discussed. MATERIALS AND METHODS: Travel distances in kilometers were calculated for each appointment using postal code data and Google Maps™ Web-based map calculator tools. RESULTS: Including return travel, an estimated 757,234 km were avoided, resulting in a GHG emissions savings of 185,159 kg (185 metric tons) of carbon dioxide equivalents in vehicle emissions. Approximately 360,444 g of other air pollutant emissions was also avoided. The GHG emissions produced by energy consumption for videoconference units were estimated to be 42 kg of carbon dioxide equivalents emitted for this sample. CONCLUSIONS: The overall GHG emissions associated with videoconferencing unit energy is minor when compared with those avoided from vehicle use. In addition to improved patient-centered care and cost savings, environmental benefits provide additional incentives for the adoption of telemedicine services.