Your browser doesn't support javascript.
loading
First-in-human real-time AI-assisted instrument deocclusion during augmented reality robotic surgery.
Hofman, Jasper; De Backer, Pieter; Manghi, Ilaria; Simoens, Jente; De Groote, Ruben; Van Den Bossche, Hannes; D'Hondt, Mathieu; Oosterlinck, Tim; Lippens, Julie; Van Praet, Charles; Ferraguti, Federica; Debbaut, Charlotte; Li, Zhijin; Kutter, Oliver; Mottrie, Alexandre; Decaestecker, Karel.
Afiliação
  • Hofman J; ORSI Academy Melle Belgium.
  • De Backer P; ORSI Academy Melle Belgium.
  • Manghi I; Faculty of Medicine and Health Sciences, Department of Human Structure and Repair Ghent University Ghent Belgium.
  • Simoens J; IBiTech-Biommeda, Faculty of Engineering and Architecture, and CRIG Ghent University Ghent Belgium.
  • De Groote R; Department of Urology Ghent University Hospital Ghent Belgium.
  • Van Den Bossche H; Department of Sciences and Methods for Engineering University of Modena and Reggio Emilia Modena Italy.
  • D'Hondt M; ORSI Academy Melle Belgium.
  • Oosterlinck T; ORSI Academy Melle Belgium.
  • Lippens J; Department of Urology OLV Hospital Aalst Belgium.
  • Van Praet C; Department of Urology AZ West Hospital Veurne Belgium.
  • Ferraguti F; Department of Digestive and Hepatobiliary/Pancreatic Surgery AZ Groeninge Hospital Kortrijk Belgium.
  • Debbaut C; Faculty of Medicine KU Leuven Leuven Belgium.
  • Li Z; Faculty of Medicine and Health Sciences, Department of Human Structure and Repair Ghent University Ghent Belgium.
  • Kutter O; Department of Urology Ghent University Hospital Ghent Belgium.
  • Mottrie A; Department of Sciences and Methods for Engineering University of Modena and Reggio Emilia Modena Italy.
  • Decaestecker K; IBiTech-Biommeda, Faculty of Engineering and Architecture, and CRIG Ghent University Ghent Belgium.
Healthc Technol Lett ; 11(2-3): 33-39, 2024.
Article em En | MEDLINE | ID: mdl-38638494
ABSTRACT
The integration of Augmented Reality (AR) into daily surgical practice is withheld by the correct registration of pre-operative data. This includes intelligent 3D model superposition whilst simultaneously handling real and virtual occlusions caused by the AR overlay. Occlusions can negatively impact surgical safety and as such deteriorate rather than improve surgical care. Robotic surgery is particularly suited to tackle these integration challenges in a stepwise approach as the robotic console allows for different inputs to be displayed in parallel to the surgeon. Nevertheless, real-time de-occlusion requires extensive computational resources which further complicates clinical integration. This work tackles the problem of instrument occlusion and presents, to the authors' best knowledge, the first-in-human on edge deployment of a real-time binary segmentation pipeline during three robot-assisted surgeries partial nephrectomy, migrated endovascular stent removal, and liver metastasectomy. To this end, a state-of-the-art real-time segmentation and 3D model pipeline was implemented and presented to the surgeon during live surgery. The pipeline allows real-time binary segmentation of 37 non-organic surgical items, which are never occluded during AR. The application features real-time manual 3D model manipulation for correct soft tissue alignment. The proposed pipeline can contribute towards surgical safety, ergonomics, and acceptance of AR in minimally invasive surgery.
Palavras-chave

Texto completo: 1 Coleções: 01-internacional Base de dados: MEDLINE Idioma: En Revista: Healthc Technol Lett Ano de publicação: 2024 Tipo de documento: Article

Texto completo: 1 Coleções: 01-internacional Base de dados: MEDLINE Idioma: En Revista: Healthc Technol Lett Ano de publicação: 2024 Tipo de documento: Article