RESUMO
Laser microsurgery is the current gold standard surgical technique for the treatment of selected diseases in delicate organs such as the larynx. However, the operations require large surgical expertise and dexterity, and face significant limitations imposed by available technology, such as the requirement for direct line of sight to the surgical field, restricted access, and direct manual control of the surgical instruments. To change this status quo, the European project µRALP pioneered research towards a complete redesign of current laser microsurgery systems, focusing on the development of robotic micro-technologies to enable endoscopic operations. This has fostered awareness and interest in this field, which presents a unique set of needs, requirements and constraints, leading to research and technological developments beyond µRALP and its research consortium. This paper reviews the achievements and key contributions of such research, providing an overview of the current state of the art in robot-assisted endoscopic laser microsurgery. The primary target application considered is phonomicrosurgery, which is a representative use case involving highly challenging microsurgical techniques for the treatment of glottic diseases. The paper starts by presenting the motivations and rationale for endoscopic laser microsurgery, which leads to the introduction of robotics as an enabling technology for improved surgical field accessibility, visualization and management. Then, research goals, achievements, and current state of different technologies that can build-up to an effective robotic system for endoscopic laser microsurgery are presented. This includes research in micro-robotic laser steering, flexible robotic endoscopes, augmented imaging, assistive surgeon-robot interfaces, and cognitive surgical systems. Innovations in each of these areas are shown to provide sizable progress towards more precise, safer and higher quality endoscopic laser microsurgeries. Yet, major impact is really expected from the full integration of such individual contributions into a complete clinical surgical robotic system, as illustrated in the end of this paper with a description of preliminary cadaver trials conducted with the integrated µRALP system. Overall, the contribution of this paper lays in outlining the current state of the art and open challenges in the area of robot-assisted endoscopic laser microsurgery, which has important clinical applications even beyond laryngology.
RESUMO
Purpose: We explain our concept for customization of a guidance instrument, present a prototype, and describe a set of experiments to evaluate its positioning and drilling accuracy. Methods: Our concept is characterized by the use of bone cement, which enables fixation of a specific configuration for each individual surgical template. This well-established medical product was selected to ensure future intraoperative fabrication of the template under sterile conditions. For customization, a manually operated alignment device is proposed that temporary defines the planned trajectory until the bone cement is hardened. Experiments ( n = 10 ) with half-skull phantoms were performed. Analysis of accuracy comprises targeting validations and experiments including drilling in bone substitutes. Results: The resulting mean positioning error was found to be 0.41 ± 0.30 mm at the level of the target point whereas drilling was possible with a mean accuracy of 0.35 ± 0.30 mm . Conclusion: We proposed a cost-effective, easy-to-use approach for accurate instrument guidance that enables template fabrication under sterile conditions. The utilization of bone cement was proven to fulfill the demands of an easy, quick, and prospectively intraoperatively doable customization. We could demonstrate sufficient accuracy for many surgical applications, e.g., in neurosurgery. The system in this early development stage already outperforms conventional stereotactic frames and image-guided surgery systems in terms of targeting accuracy.
RESUMO
OBJECTIVES: Transoral surgery of the larynx with rigid instruments is not always possible. This may result in insufficient therapy or in an increased need for open surgery. For these patients, alternative surgical systems are needed. Here, we demonstrate a curved prototype for laryngeal surgery equipped with flexible instruments. STUDY DESIGN: Pre-clinical user study in an ex vivo porcine laryngeal model. METHODS: The prototype was built from established medical devices, namely a hyperangulated videolaryngoscope and modified flexible instruments as well as three-dimensional printed parts. Feasibility of laryngeal manipulation was evaluated in a user study (n = 19) with a porcine ex vivo laryngeal model. Using three different visualization technologies, the participants performed various fine motor skills tasks and rated the usability of the system on a 5-point Likert scale. RESULTS: Exposure, accessibility, and manipulation of important laryngeal structures were always possible using the new prototype. The participants needed considerably less time (mean, 96.4 seconds ± 6.4 seconds vs. 111.5 seconds ± 4.5 seconds, P = .18), reported significantly better general impression (mean score 3.0 vs. 3.8, P = .041) and significantly lower user head and neck strain (2.6 vs. 1.7, P = .022) using a 40-inch television screen as compared to a standard videolaryngoscope monitor. CONCLUSION: The results indicate that our curved prototype and large monitor visualization may provide a cost-effective minimally invasive alternative for difficult laryngeal exposure. Its special advantages include avoiding the need for a straight line of sight and a simple and cost-effective construction. The system could be further improved through advances in camera chip technology and smaller instruments. Laryngoscope, 131:E561-E568, 2021.
Assuntos
Laringoscópios , Laringe/cirurgia , Cirurgia Vídeoassistida/instrumentação , Animais , Laringoscopia/instrumentação , Laringoscopia/métodos , Suínos , Cirurgia Vídeoassistida/métodosRESUMO
PURPOSE: Minimally invasive cochlear implant surgery is a challenging procedure due to high demands on accuracy. For clinical success, an according assistance system has to compete against the traditional approach in terms of risk, operating time and cost. It has not yet been determined what kind of system is the most suited. The purpose of this study is a proof of concept of surgical process modeling as a preclinical development tool and the comparison of workflow concepts for this new approach. METHODS: Three preclinical systems (two stereotactic and one robotic) for minimally invasive cochlear implant surgery are compared using the method of surgical process modeling. All three systems were successfully tested with ex vivo human specimen to create minimally invasive surgical access to the cochlea. Those systems where chosen for comparison, because they represent three diverse approaches with different corresponding workflows for the same intervention. The experiments were used to create a process model for each system by recording the interventions. RESULTS: All three conceptual systems developed by our group have shown their eligibility. The recorded process models provide a convenient method for direct comparison. Reduction in the surgical time has a higher impact on the process, than time that is needed for setting up a system beforehand. The stereotactic approaches have little preparation effort and are low cost in terms of hardware compared to the robotic approach, which in return is beneficial in terms of workload reduction for the surgeon. CONCLUSION: Surgical process modeling is suitable for comparison of different assistant systems for minimally invasive cochlear implantation. The benefit of reduced trauma, compared to the traditional mastoidectomy, can now be assessed with consideration of the workflow of each technique. The process models enable an assessment in the regard of surgical time and workload.
Assuntos
Cóclea/cirurgia , Implante Coclear/métodos , Implantes Cocleares , Procedimentos Cirúrgicos Minimamente Invasivos/métodos , Fluxo de Trabalho , Algoritmos , Cadáver , Simulação por Computador , Desenho de Equipamento , Humanos , Robótica , Gravação em VídeoRESUMO
PURPOSE: Automated segmentation of anatomical structures in medical image analysis is a prerequisite for autonomous diagnosis as well as various computer- and robot-aided interventions. Recent methods based on deep convolutional neural networks (CNN) have outperformed former heuristic methods. However, those methods were primarily evaluated on rigid, real-world environments. In this study, existing segmentation methods were evaluated for their use on a new dataset of transoral endoscopic exploration. METHODS: Four machine learning-based methods SegNet, UNet, ENet and ErfNet were trained with supervision on a novel 7-class dataset of the human larynx. The dataset contains 536 manually segmented images from two patients during laser incisions. The Intersection-over-Union (IoU) evaluation metric was used to measure the accuracy of each method. Data augmentation and network ensembling were employed to increase segmentation accuracy. Stochastic inference was used to show uncertainties of the individual models. Patient-to-patient transfer was investigated using patient-specific fine-tuning. RESULTS: In this study, a weighted average ensemble network of UNet and ErfNet was best suited for the segmentation of laryngeal soft tissue with a mean IoU of 84.7%. The highest efficiency was achieved by ENet with a mean inference time of 9.22 ms per image. It is shown that 10 additional images from a new patient are sufficient for patient-specific fine-tuning. CONCLUSION: CNN-based methods for semantic segmentation are applicable to endoscopic images of laryngeal soft tissue. The segmentation can be used for active constraints or to monitor morphological changes and autonomously detect pathologies. Further improvements could be achieved by using a larger dataset or training the models in a self-supervised manner on additional unlabeled data.
Assuntos
Laringoscopia , Laringe/patologia , Redes Neurais de Computação , Endoscopia , Humanos , Processamento de Imagem Assistida por Computador , Aprendizado de Máquina , Semântica , Prega Vocal/patologiaRESUMO
BACKGROUND: The implantation of the acetabular cup essentially determines the clinical outcome of total hip arthroplasty. To address this issue, the aim of this study was to build patient-specific instruments (PSIs) with various reference surfaces, followed by in vitro investigations to examine the inter- and intra-operator reliability as well as the overall precision of these patient-specific templates. METHODS: Seven human hemi-pelvis specimens were used for this study. After a CT scan, PSIs with different imprint heights were created. The overall precision of the templates and the inter- and intra-operator reliabilities were calculated. RESULTS: Strong differences in precision between the PSI designs could be observed. The desired orientation of the acetabular cup could be adjusted with a precision of up to 1.55°. CONCLUSION: Based on our results, we believe that the application of the PSI-based acetabular cup positioning in total hip arthroplasty procedures can potentially increase the precision of cup placement.
Assuntos
Artroplastia de Quadril/métodos , Idoso , Idoso de 80 Anos ou mais , Desenho de Equipamento , Humanos , Reprodutibilidade dos TestesRESUMO
PURPOSE: Assistance of robotic systems in the operating room promises higher accuracy and, hence, demanding surgical interventions become realisable (e.g. the direct cochlear access). Additionally, an intuitive user interface is crucial for the use of robots in surgery. Torque sensors in the joints can be employed for intuitive interaction concepts. Regarding the accuracy, they lead to a lower structural stiffness and, thus, to an additional error source. The aim of this contribution is to examine, if an accuracy needed for demanding interventions can be achieved by such a system or not. METHODS: Feasible accuracy results of the robot-assisted process depend on each work-flow step. This work focuses on the determination of the tool coordinate frame. A method for drill axis definition is implemented and analysed. Furthermore, a concept of admittance feed control is developed. This allows the user to control feeding along the planned path by applying a force to the robots structure. The accuracy is researched by drilling experiments with a PMMA phantom and artificial bone blocks. RESULTS: The described drill axis estimation process results in a high angular repeatability ([Formula: see text]). In the first set of drilling results, an accuracy of [Formula: see text] at entrance and [Formula: see text] at target point excluding imaging was achieved. With admittance feed control an accuracy of [Formula: see text] at target point was realised. In a third set twelve holes were drilled in artificial temporal bone phantoms including imaging. In this set-up an error of [Formula: see text] and [Formula: see text] was achieved. CONCLUSION: The results of conducted experiments show that accuracy requirements for demanding procedures such as the direct cochlear access can be fulfilled with compliant systems. Furthermore, it was shown that with the presented admittance feed control an accuracy of less then [Formula: see text] is achievable.
Assuntos
Cóclea/cirurgia , Imagens de Fantasmas , Robótica/instrumentação , Cirurgia Assistida por Computador/métodos , Osso Temporal/diagnóstico por imagem , Tomografia Computadorizada por Raios X/métodos , Cóclea/diagnóstico por imagem , Humanos , Osso Temporal/cirurgiaRESUMO
Recent research has revealed that image-based methods can enhance accuracy and safety in laser microsurgery. In this study, non-rigid tracking using surgical stereo imaging and its application to laser ablation is discussed. A recently developed motion estimation framework based on piecewise affine deformation modeling is extended by a mesh refinement step and considering texture information. This compensates for tracking inaccuracies potentially caused by inconsistent feature matches or drift. To facilitate online application of the method, computational load is reduced by concurrent processing and affine-invariant fusion of tracking and refinement results. The residual latency-dependent tracking error is further minimized by Kalman filter-based upsampling, considering a motion model in disparity space. Accuracy is assessed in laparoscopic, beating heart, and laryngeal sequences with challenging conditions, such as partial occlusions and significant deformation. Performance is compared with that of state-of-the-art methods. In addition, the online capability of the method is evaluated by tracking two motion patterns performed by a high-precision parallel-kinematic platform. Related experiments are discussed for tissue substitute and porcine soft tissue in order to compare performances in an ideal scenario and in a setup mimicking clinical conditions. Regarding the soft tissue trial, the tracking error can be significantly reduced from 0.72 mm to below 0.05 mm with mesh refinement. To demonstrate online laser path adaptation during ablation, the non-rigid tracking framework is integrated into a setup consisting of a surgical Er:YAG laser, a three-axis scanning unit, and a low-noise stereo camera. Regardless of the error source, such as laser-to-camera registration, camera calibration, image-based tracking, and scanning latency, the ablation root mean square error is kept below 0.21 mm when the sample moves according to the aforementioned patterns. Final experiments regarding motion-compensated laser ablation of structurally deforming tissue highlight the potential of the method for vision-guided laser surgery.
Assuntos
Algoritmos , Terapia a Laser/métodos , Microcirurgia/métodos , Movimento , Técnicas Estereotáxicas , Animais , Laparoscopia/métodos , Laringe/cirurgia , Reprodutibilidade dos Testes , Suínos , Cirurgia TorácicaRESUMO
PURPOSE: Mastoid cells as well as trabecula provide unique bone structures, which can serve as natural landmarks for registration. Preoperative imaging enables sufficient acquisition of these structures, but registration requires an intraoperative counterpart. Since versatile surgical interventions involve drilling into mastoid cells and trabecula, we propose a registration method based on endoscopy inside of these drill holes. METHODS: Recording of the surface of the inner drill hole yields bone-air patterns that provide intraoperative registration features. In this contribution, we discuss an approach that unrolls the drill hole surface into a two-dimensional image. Intraoperative endoscopic recordings are compared to simulated endoscopic views, which originate from preoperative data like computed tomography. Each simulated view corresponds to a different drill pose. The whole registration procedure and workflow is demonstrated, using high-resolution image data to simulate both preoperative and endoscopic image data. RESULTS: As the driving application is minimally invasive cochlear implantation, in which targets are close to the axis of the drill hole, Target Registration Error (TRE) was measured at points near the axis. TRE at increasing depths along the drill trajectory reveals increasing registration accuracy as more bone-air patterns become available as landmarks with the highest accuracy obtained at the center point. At the facial recess and the cochlea, TREs are ([Formula: see text]) mm and ([Formula: see text]) mm, respectively. CONCLUSION: This contribution demonstrates a new method for registration via endoscopic acquisition of small features like trabecula or mastoid cells for image-guided procedures. It has the potential to revolutionize bone registration because it requires only a preoperative dataset and intraoperative endoscopic exploration. Endoscopic recordings of at least 20 mm length and isotropic voxel sizes of 0.2 mm or smaller of the preoperative image data are recommended.
Assuntos
Osso Esponjoso/diagnóstico por imagem , Implante Coclear/métodos , Processo Mastoide/diagnóstico por imagem , Cirurgia Assistida por Computador/métodos , Fluxo de Trabalho , Osso Esponjoso/cirurgia , Humanos , Processamento de Imagem Assistida por Computador/métodos , Processo Mastoide/citologia , Processo Mastoide/cirurgia , Procedimentos Cirúrgicos Minimamente Invasivos/métodos , Tomografia Computadorizada por Raios X/métodosRESUMO
Patient-specific instruments (PSIs) are clinically used to support the surgeon during a planned intervention. The planning is typically done based on volumetric image data from medical imaging systems, e.g. computed tomography (CT). The PSI uses the known surface structure of a bone for orientation during the intervention. Some surfaces of human bone are covered with a layer of cartilage which is hardly visible in clinically applied CT-imaging. This experimental study investigates ten different PSI designs and their effect to the overall accuracy when neglecting the cartilage in the design process. Therefore, a model of an acetabulum is used to simulate the use case of PSI in total hip arthroplasty. The concept of the different designs is to create structural elasticities in the PSI to avoid shifting of the whole instrument and rather have a small part of it deformed by cartilage. A needle array structure, for instance, should also be able to oust or penetrate remaining soft tissue in the acetabulum.
Assuntos
Acetábulo/cirurgia , Artroplastia de Quadril , Cartilagem/fisiologia , Prótese de Quadril/normas , Imageamento Tridimensional/métodos , Cirurgia Assistida por Computador/métodos , Tomografia Computadorizada por Raios X/métodos , Artroplastia de Quadril/métodos , HumanosRESUMO
PURPOSE: Processing stereoscopic image data is an emerging field. Especially in microsurgery that requires sub-millimeter accuracy, application of stereo-based methods on endoscopic and microscopic scenarios is of major interest. In this context, direct comparison of stereo-based surface reconstruction applied to several camera settings is presented. METHODS: A method for stereo matching is proposed and validated on in-vitro data. Demonstrating suitability for surgical scenarios, this method is applied to two custom-made stereo cameras, a miniaturized, bendable surgical endoscope and an operating microscope. Reconstruction accuracy is assessed on a custom-made reference sample. Subsequent to its fabrication, a coordinate measuring arm is used to acquire ground truth. Next, the sample is positioned by a robot at varying distances to each camera. Surface estimation is performed, while the specimen is localized based on. markers. Finally, the error between estimated surface and ground truth is computed. RESULTS: Sample measurement with the coordinate measuring arm yields reliable ground truth data with a root-mean-square error of 11.2 µm. Overall surface reconstruction with analyzed cameras is quantified by a root-mean-square error of less than 0.18 mm. Microscope setting with the highest magnification yields the most accurate measurement, while the maximum deviation does not exceed 0.5 mm. Custom-made stereo cameras perform similar but with outliers of increased magnitude. Miniaturized, bendable surgical endoscope produces the maximum error of approximately 1.2 mm. CONCLUSIONS: Reconstruction results reveal that microscopic imaging outperforms investigated chip-on-the-tip solutions, i.e., at higher magnification. Nonetheless, custom-made cameras are suitable for application in microsurgery. Although reconstruction with the miniaturized endoscope is more inaccurate, it provides a good trade-off between accuracy, outer dimensions and accessibility to hard-to-reach surgical sites.
Assuntos
Endoscópios , Endoscopia/métodos , Microcirurgia/instrumentação , Humanos , Microcirurgia/métodosRESUMO
PURPOSE: During guided drilling for minimally invasive cochlear implantation and related applications, typically forces and torques act on the employed tool guides, which result from both the surgeon's interaction and the bone drilling process. Such loads propagate through the rigid mechanisms and result in deformations of compliant parts, which in turn affect the achievable accuracy. In this paper, the order of magnitude as well as the factors influencing such loads are studied experimentally to facilitate design and optimization of future drill guide prototypes. METHODS: The experimental setup to evaluate the occurring loads comprises two six degree of freedom force/torque sensors: one mounted between a manually operated, linearly guided drill handpiece and one below the specimens into which the drilling is carried out. This setup is used to analyze the influences of drilling tool geometry, spindle speed as well as experience of the operator on the resulting loads. RESULTS: The results reveal that using a spiral drill results in lower process loads compared with a surgical Lindemann mill. Moreover, in this study, an experienced surgeon applied lower interaction forces compared with untrained volunteers. The measured values further indicate that both the intraoperative handling of the bone-attached drill guide as well as the tool removal after completing the hole can be expected to cause temporary load peaks which exceed the values acquired during the drilling procedure itself. CONCLUSIONS: The results obtained using the proposed experimental setup serve as realistic design criteria with respect to the development of future drill guide prototypes. Furthermore, the given values can be used to parameterize simulations for profound stiffness analyses of existing mechanisms.
Assuntos
Implante Coclear/métodos , Craniotomia/métodos , Crânio/cirurgia , Humanos , TorqueRESUMO
PURPOSE: Introducing computational methods to laser surgery are an emerging field. Focusing on endoscopic laser interventions, a novel approach is presented to enhance intraoperative incision planning and laser focusing by means of tissue surface information obtained by stereoscopic vision. METHODS: Tissue surface is estimated with stereo-based methods using nonparametric image transforms. Subsequently, laser-to-camera registration is obtained by ablating a pattern on tissue substitutes and performing a principle component analysis for precise laser axis estimation. Furthermore, a virtual laser view is computed utilizing trifocal transfer. Depth-based laser focus adaptation is integrated into a custom experimental laser setup in order to achieve optimal ablation morphology. Experimental validation is conducted on tissue substitutes and ex vivo animal tissue. RESULTS: Laser-to-camera registration gives an error between planning and ablation of less than 0.2 mm. As a result, the laser workspace can accurately be highlighted within the live views and incision planning can directly be performed. Experiments related to laser focus adaptation demonstrate that ablation geometry can be kept almost uniform within a depth range of 7.9 mm, whereas cutting quality significantly decreases when the laser is defocused. CONCLUSIONS: An automatic laser focus adjustment on tissue surfaces based on stereoscopic scene information is feasible and has the potential to become an effective methodology for optimal ablation. Laser-to-camera registration facilitates advanced surgical planning for prospective user interfaces and augmented reality extensions.
Assuntos
Endoscopia/métodos , Terapia a Laser/métodos , Lasers , Cirurgia Assistida por Computador/métodos , Percepção de Profundidade , HumanosRESUMO
PURPOSE: Minimally invasive cochlear implantation is a surgical technique which requires drilling a canal from the mastoid surface toward the basal turn of the cochlea. The choice of an appropriate drilling strategy is hypothesized to have significant influence on the achievable targeting accuracy. Therefore, a method is presented to analyze the contribution of the drilling process and drilling tool to the targeting error isolated from other error sources. METHODS: The experimental setup to evaluate the borehole accuracy comprises a drill handpiece attached to a linear slide as well as a highly accurate coordinate measuring machine (CMM). Based on the specific requirements of the minimally invasive cochlear access, three drilling strategies, mainly characterized by different drill tools, are derived. The strategies are evaluated by drilling into synthetic temporal bone substitutes containing air-filled cavities to simulate mastoid cells. Deviations from the desired drill trajectories are determined based on measurements using the CMM. RESULTS: Using the experimental setup, a total of 144 holes were drilled for accuracy evaluation. Errors resulting from the drilling process depend on the specific geometry of the tool as well as the angle at which the drill contacts the bone surface. Furthermore, there is a risk of the drill bit deflecting due to synthetic mastoid cells. CONCLUSIONS: A single-flute gun drill combined with a pilot drill of the same diameter provided the best results for simulated minimally invasive cochlear implantation, based on an experimental method that may be used for testing further drilling process improvements.