Surgeons vs ChatGPT: Assessment and Feedback Performance Based on Real Surgical Scenarios.

INTRODUCTION: Artificial intelligence tools are being progressively integrated into medicine and surgical education. Large language models, such as ChatGPT, could provide relevant feedback aimed at improving surgical skills. The purpose of this study is to assess ChatGPT´s ability to provide feedback based on surgical scenarios. METHODS: Surgical situations were transformed into texts using a neutral narrative. Texts were evaluated by ChatGPT 4.0 and 3 surgeons (A, B, C) after a brief instruction was delivered: identify errors and provide feedback accordingly. Surgical residents were provided with each of the situations and feedback obtained during the first stage, as written by each surgeon and ChatGPT, and were asked to assess the utility of feedback (FCUR) and its quality (FQ). As control measurement, an Education-Expert (EE) and a Clinical-Expert (CE) were asked to assess FCUR and FQ. RESULTS: Regarding residents' evaluations, 96.43% of times, outputs provided by ChatGPT were considered useful, comparable to what surgeons' B and C obtained. Assessing FQ, ChatGPT and all surgeons received similar scores. Regarding EE's assessment, ChatGPT obtained a significantly higher FQ score when compared to surgeons A and B (p = 0.019; p = 0.033) with a median score of 8 vs. 7 and 7.5, respectively; and no difference respect surgeon C (score of 8; p = 0.2). Regarding CE´s assessment, surgeon B obtained the highest FQ score while ChatGPT received scores comparable to that of surgeons A and C. When participants were asked to identify the source of the feedback, residents, CE, and EE perceived ChatGPT's outputs as human-provided in 33.9%, 28.5%, and 14.3% of cases, respectively. CONCLUSION: When given brief written surgical situations, ChatGPT was able to identify errors with a detection rate comparable to that of experienced surgeons and to generate feedback that was considered useful for skill improvement in a surgical context performing as well as surgical instructors across assessments made by general surgery residents, an experienced surgeon, and a nonsurgeon feedback expert.

Comparative study of video recordings of non-medical devices in laparoscopic surgery: a cross-sectional study.

INTRODUCTION: Laparoscopic surgery is the approach of choice for multiple procedures, being laparoscopic cholecystectomy one of the most frequently performed surgeries. Likewise, video recording of these surgeries has become widespread. Currently, the market offers medical recording devices (MRD) with an approximate cost of 2000 USD, and alternative non-medical recording devices (NMRD) with a cost ranging from 120 to 200 USD. To our knowledge, no comparative studies between the available recording devices have been done. We aim to compare the perception of the quality of videos recorded by MRD and NMRD in a group of surgeons and surgical residents. METHODS: A cross-sectional study was conducted using an online survey to compare recordings from three NMRDs (Elgato 30 fps, AverMedia 60 fps, Hauppauge 30 fps) and one MRD (MediCap 20 fps) during a laparoscopic cholecystectomy. The survey assessed: definition of anatomical structures (DA), fluidity of movements (FM), similarity with the operating room screen (ORsim), and overall quality (OQ). Descriptive and nonparametric analytical statistics tests were applied. Results were analyzed using JMP-15 software. RESULTS: Forty surveys were collected (80% surgeons, 20% residents). NMRDs scored significantly higher than MRD in DA (p = 0.003), FM (p < 0.001), ORsim (p < 0.001), and OQ (p < 0.001). One NMRD was chosen as the highest quality device (70%), and MRD as the poorest (78%). No significant differences were found when analyzing by surgical experience. CONCLUSIONS: In terms of recording laparoscopic procedures, non-medical video recording devices (NMRDs) outperformed medical-grade recording device (MRD) with a higher overall score. This suggests that NMRDs could serve as a cost-effective alternative with superior video quality for recording laparoscopic surgeries.

Five-Year Experience Training Surgeons with a Laparoscopic Simulation Training Program for Bariatric Surgery: a Quasi-experimental Design.

PURPOSE: Nearly 200,000 laparoscopic Roux-en-Y gastric bypass (LRYGB) are performed yearly. Reported learning curves range between 50 and 150, even 500 cases to decrease the operative risk. Simulation programs could accelerate this learning curve safely; however, trainings for LRYGB are scarce. This study aims to describe and share our 5-year experience of a simulated program designed to achieve proficiency in LRYGB technical skills. MATERIALS AND METHODS: A quasi-experimental design was used. All recruited participants were previously trained with basic and advanced laparoscopic simulation curriculum completing over 50 h of practical training. Ex vivo animal models were used to practice manual and stapled gastrojejunostomy (GJ) and stapled jejunojejunostomy (JJO) in 10, 3, and 4 sessions, respectively. The main outcome was to assess the manual GJ skill acquisition. Pre- and post-training assessments using a Global Rating Scale (GRS; max 25 pts), Specific Rating Scale (SRS; max 20 pts), performance time, permeability, and leakage rates were analyzed. For the stapled GJ and JJO, execution time was registered. Data analysis was performed using parametric tests. RESULTS: In 5 years, 68 trainees completed the program. For the manual GJ's pre- vs post-training assessment, GRS and SRS scores increased significantly (from 17 to 24 and from 13 to 19 points respectively, p-value < 0.001). Permeability rate increased while leakage rate and procedural time decreased significantly. CONCLUSION: This simulated training program showed effectiveness in improving laparoscopic skills for manual GJ and JJO in a simulated scenario. This new training program could optimize the clinical learning curve. Further studies are needed to assess the transfer of skills to the operating room.

Methodological transparency of preoperative clinical practice guidelines for elective surgery. Systematic review.

BACKGROUND: Clinical practice guidelines (CPG) are statements that provide recommendations regarding the approach to different diseases and aim to increase quality while decreasing the risk of complications in health care. Numerous guidelines in the field of perioperative care have been published in the previous decade but their methodological quality and transparency are relatively unknown. OBJECTIVE: To critically evaluate the transparency and methodological quality of published CPG in the preoperative assessment and management of adult patients undergoing elective surgery. DESIGN: Systematic review and methodological appraisal study. DATA SOURCES: We searched for eligible CPG published in English or Spanish between January 1, 2010, and June 30, 2022, in Pubmed MEDLINE, TRIP Database, Embase, the Cochrane Library, as well as in representatives' medical societies of Anaesthesiology and developers of CPG. ELIGIBILITY CRITERIA: CPG dedicated on preoperative fasting, cardiac assessment for non-cardiac surgery, and the use of routine preoperative tests were included. Methodological quality and transparency of CPG were assessed by 3 evaluators using the 6 domains of the AGREE-II tool. RESULTS: We included 20 CPG of which 14 were classified as recommended guidelines. The domain of "applicability" scored the lowest (44%), while the domains "scope and objective" and "editorial interdependence" received the highest median scores of 93% and 97% respectively. The remaining domains received scores ranging from 44% to 84%. The top mean scored CPG in preoperative fasting was ASA 2017 (93%); among cardiac evaluation, CPG for non-cardiac surgery were CCS 2017 (91%), ESC-ESA 2014 (90%), and AHA-ACC 2014 (89%); in preoperative testing ICSI 2020 (97%). CONCLUSIONS: In the last ten years, most published CPG in the preoperative assessment or management of adult patients undergoing elective surgery focused on preoperative fasting, cardiac assessment for non-cardiac surgery, and use of routine preoperative tests, present moderate to high methodological quality and can be recommended for their use or adaptation. Applicability and stakeholder involvement domains must be improved in the development of future guidelines.

Recommendations to Develop a Laparoscopic Surgical Simulation Training Program. Insights Gained After 12 Years of Training Surgeons / Recomendaciones para desarrollar un programa de formación en simulación quirúrgica laparoscópica. Perspectivas obtenidas tras 12 años de formación de cirujanos / Recomendações para o desenvolvimento de um programa de formação em simulação cirúrgica laparoscópica. Perspectivas obtidas após 12 anos de formação de cirurgiões

Introduction. The use of simulation in surgery has made it possible to shorten learning curves through deliberate practice. Although it has been incorporated long ago, there are still no clear recommendations to standardize its development and implementation. This manuscript aims to share recommendations based on our experience of more than twelve years of employing and improving a methodology in laparoscopic surgical simulation. Topics for Reflection. To transfer surgical skills to a trainee, we base our methodology on a three-pillar framework: The hardware and infrastructure (tools to train with), the training program itself (what to do), and the feedback (how to improve). Implementing a cost-effective program is feasible: the hardware does not need to be high fidelity to transfer skills, but the program needs to be validated. These pillars have evolved over time by incorporating technology: the on-site guidance from experts has changed to a remote and asynchronous modality by video recording the trainee's execution, and by enabling remote and asynchronous feedback. The feedback provider does not necessarily have to be an expert clinician in the subject, but a person previously trained to be a trainer. This allows for deliberate practice until mastery has been reached and learning curves are consolidated. Conclusions. Recommendations based on the experience of our center have been presented, explaining the framework of our strategy. Considering these suggestions, it is hoped that our simulation methodology can aid the development and implementation of effective simulationbased programs for other groups and institutions.

Introducción. El uso de la simulación en cirugía ha permitido acortar las curvas de aprendizaje mediante la práctica deliberada. A pesar de que se ha incorporado previamente, aún no existen recomendaciones claras para estandarizar su desarrollo e implementación. Este manuscrito pretende compartir recomendaciones basadas en nuestra experiencia, con más de doce años empleando y mejorando una metodología en la simulación quirúrgica laparoscópica. Temas de reflexión. Para transferir las habilidades quirúrgicas a un aprendiz, basamos nuestra metodología en un marco de tres pilares: El hardware y la infraestructura (herramientas con las que entrenar), el programa de entrenamiento (qué hacer), y la retroalimentación (cómo mejorar). La implementación de un programa rentable es factible: el hardware no necesita ser de alta fidelidad para transferir las habilidades, pero el programa necesita ser validado. Estos pilares han evolucionado a lo largo del tiempo incorporando tecnología: la presencia de expertos ha evolucionado a una modalidad remota y asincrónica mediante la grabación en vídeo de la ejecución del alumno, y permitiendo su retroalimentación. Aquel que entrega retroalimentación no tiene que ser necesariamente un clínico experto en la materia, sino una persona previamente formada como instructor. Esto permite una práctica deliberada hasta dominar la habilidad y establecer curvas de aprendizaje. Conclusiones. Se han presentado recomendaciones basadas en la experiencia de nuestro centro, explicando el marco de nuestra estrategia. Teniendo en cuenta estas sugerencias, se espera que nuestra metodología de simulación pueda ayudar al desarrollo e implementación de programas efectivos basados en la simulación a otros grupos e instituciones.

Introdução. O uso de simulação em cirurgia tornou possível encurtar as curvas de aprendizagem por meio da prática deliberada. Embora tenha sido incorporado anteriormente, ainda não há recomendações claras para padronizar seu desenvolvimento e implementação. Este manuscrito pretende compartilhar recomendações com base em nossa experiência, com mais de doze anos usando e aprimorando uma metodologia em simulação cirúrgica laparoscópica. Temas de reflexão. Para transferir habilidades cirúrgicas para um aprendiz, baseamos nossa metodologia em uma estrutura de três pilares: o hardware e a infraestrutura (ferramentas para treinar), o programa de treinamento (o que fazer) e feedback (como melhorar). A implementação de um programa rentável é viável: o hardware não precisa ser de alta fidelidade para transferir as habilidades, mas o programa precisa ser validado. Esses pilares evoluíram ao longo do tempo incorporando a tecnologia: a presença de especialistas evoluiu para uma modalidade remota e assíncrona por meio da gravação em vídeo do desempenho do aluno e permitindo seu feedback. Quem dá feedback não precisa ser necessariamente um clínico especialista na área, mas sim uma pessoa previamente treinada como instrutor. Isso permite a prática deliberada até que a habilidade seja dominada e estabeleça curvas de aprendizado. Conclusões. Foram apresentadas recomendações baseadas na experiência do nosso centro, explicando o enquadramento da nossa estratégia. Levando em consideração essas sugestões, espera-se que nossa metodologia de simulação possa ajudar outros grupos e instituições a desenvolver e implementar programas eficazes baseados em simulação.

Adjuvant chemoradiation for resected gallbladder cancer: Treatment strategies for one of the leading causes of cancer death in Chilean women.

BACKGROUND: Gallbladder cancer (GBC) is the second leading cause of cancer death in women in Chile. Even after curative surgery, prognosis is grim. To evaluate acute and late toxicity and efficacy of adjuvant chemoradiation (CRT) after curatively resected GBC. MATERIALS AND METHODS: We retrospectively analyzed the cohort of patients diagnosed between January 1999 and December 2009, treated with adjuvant CRT at our institution. Treatment protocol considered external beam radiation (RT) (45-54 Gy) to tumor bed and regional lymph nodes with or without concurrent 5-fluorouracil (5-FU) (500 mg/m2/day by 120-hours continuous infusion on days 1-5 and 29-33). Data was obtained from medical records, mortality from death certificates. Survival was estimated by Kaplan- Meier curves. RESULTS: 46 patients with curatively resected GBC received adjuvant CRT. Median age was 57 years (range 33-76); 39 patients were female. After diagnosis, a second surgery was performed in 42 patients. Cholecystectomy with hepatic segmentectomy and lymphadenectomy was the curative surgery in 41 patients. All patients received RT with a planned dose of 45 Gy in 25 fractions, 11 patients received a boost to the tumor bed up to 54 Gy and 34 patients had concurrent 5-FU. Therapy was well tolerated. Five patients experienced grade 3 toxicities. No grade 4 or 5 toxicity was observed. No grade >2 late toxicity was observed. Three- and 5-year overall survival (OS) were 57% and 51%, respectively. CONCLUSIONS: Adjuvant chemoradiation is well tolerated and might impact favorably on survival in patients with curatively resected GBC.

[Results of adjuvant chemoradiation after curative surgery for gastric cancer: a retrospective study]. / Quimiorradioterapia adyuvante en el cáncer gástrico resecado con intención curativa: Análisis de supervivencia y toxicidad de pacientes tratados entre 1995 y 2003 en el Instituto Nacional del Cáncer, Chile.

BACKGROUND: Survival rates after curative surgery for gastric cancer are disappointing. Therefore adjuvant therapeutic strategies are required. AIM: To analyze survival and side effects of treatment among gastric cancer patients treated with adjuvant chemo radiotherapy after curative resection of gastric adenocarcinoma. MATERIAL AND METHODS: Retrospective review of medical records of 74 patients aged 20 to 74 years, treated with complete resection of gastric adenocarcinoma followed by adjuvant chemo radiation. Survival analysis was based on the records and information from the National Mortality Registry. RESULTS: Five years survival fluctuated from 50% among patients in stage IB to 25% among those is stage IV. Significant acute toxicity was observed in 23 patients (31%). No patients died due to acute toxicity. Eleven patients (16.4%) developed significant late toxicity, with two possible deaths related to treatment. CONCLUSIONS: Postoperative chemo radiotherapy is feasible in our experience. Continues infusion of 5-fluoruracil is recommended to reduce toxicity.

Quimiorradioterapia adyuvante en el cáncer gástrico resecado con intención curativa: análisis de supervivencia y toxicidad de pacientes tratados entre 1995 y 2003 en el Instituto Nacional del Cáncer, Chile / Results of adjuvant chemoradiation after curative surgery for gastric cancer: a retrospective study

Background: Survival rates after curative surgery for gastric cancer are disappointing. Therefore adjuvant therapeutic strategies are required. Aim: To analyze survival and side effects of treatment among gastric cancer patients treated with adjuvant chemo radiotherapy after curative resection of gastric adenocarcinoma. Material and methods: Retrospective review of medical records of 74 patients aged 20 to 74 years, treated with complete resection of gastric adenocarcinoma followed by adjuvant chemo radiation. Survival analysis was based on the records and information from the National Mortality Registry. Results: Five years survival fluctuated from 50 percent among patients in stage IB to 25 percent among those is stage IV. Significant acute toxicity was observed in 23 patients (31 percent). No patients died due to acute toxicity. Eleven patients (16.4 percent) developed significant late toxicity, with two possible deaths related to treatment. Conclusions: Postoperative chemo radiotherapy is feasible in our experience. Continues infusion of 5-fluoruracil is recommended to reduce toxicity.