RESUMO
Partially automated robotic systems, such as camera holders, represent a pivotal step towards enhancing efficiency and precision in surgical procedures. Therefore, this paper introduces an approach for real-time tool localization in laparoscopy surgery using convolutional neural networks. The proposed model, based on two Hourglass modules in series, can localize up to two surgical tools simultaneously. This study utilized three datasets: the ITAP dataset, alongside two publicly available datasets, namely Atlas Dione and EndoVis Challenge. Three variations of the Hourglass-based models were proposed, with the best model achieving high accuracy (92.86%) and frame rates (27.64 FPS), suitable for integration into robotic systems. An evaluation on an independent test set yielded slightly lower accuracy, indicating limited generalizability. The model was further analyzed using the Grad-CAM technique to gain insights into its functionality. Overall, this work presents a promising solution for automating aspects of laparoscopic surgery, potentially enhancing surgical efficiency by reducing the need for manual endoscope manipulation.
Assuntos
Laparoscopia , Redes Neurais de Computação , Laparoscopia/métodos , Humanos , Procedimentos Cirúrgicos Robóticos/métodos , AlgoritmosRESUMO
The effectiveness of EMG biofeedback with neurorehabilitation robotic platforms has not been previously addressed. The present work evaluates the influence of an EMG-based visual biofeedback on the user performance when performing EMG-driven bilateral exercises with a robotic hand exoskeleton. Eighteen healthy subjects were asked to perform 1-min randomly generated sequences of hand gestures (rest, open and close) in four different conditions resulting from the combination of using or not (1) EMG-based visual biofeedback and (2) kinesthetic feedback from the exoskeleton movement. The user performance in each test was measured by computing similarity between the target gestures and the recognized user gestures using the L2 distance. Statistically significant differences in the subject performance were found in the type of provided feedback (p-value 0.0124). Pairwise comparisons showed that the L2 distance was statistically significantly lower when only EMG-based visual feedback was present (2.89 ± 0.71) than with the presence of the kinesthetic feedback alone (3.43 ± 0.75, p-value = 0.0412) or the combination of both (3.39 ± 0.70, p-value = 0.0497). Hence, EMG-based visual feedback enables subjects to increase their control over the movement of the robotic platform by assessing their muscle activation in real time. This type of feedback could benefit patients in learning more quickly how to activate robot functions, increasing their motivation towards rehabilitation.
Assuntos
Exoesqueleto Energizado , Reabilitação Neurológica , Humanos , Biorretroalimentação Psicológica , Retroalimentação Sensorial , Terapia por ExercícioRESUMO
Medical instruments detection in laparoscopic video has been carried out to increase the autonomy of surgical robots, evaluate skills or index recordings. However, it has not been extended to surgical gauzes. Gauzes can provide valuable information to numerous tasks in the operating room, but the lack of an annotated dataset has hampered its research. In this article, we present a segmentation dataset with 4003 hand-labelled frames from laparoscopic video. To prove the dataset potential, we analyzed several baselines: detection using YOLOv3, coarse segmentation, and segmentation with a U-Net. Our results show that YOLOv3 can be executed in real time but provides a modest recall. Coarse segmentation presents satisfactory results but lacks inference speed. Finally, the U-Net baseline achieves a good speed-quality compromise running above 30 FPS while obtaining an IoU of 0.85. The accuracy reached by U-Net and its execution speed demonstrate that precise and real-time gauze segmentation can be achieved, training convolutional neural networks on the proposed dataset.
Assuntos
Fenômenos Biológicos , Laparoscopia , Mãos , Processamento de Imagem Assistida por Computador/métodos , Procedimentos Cirúrgicos Minimamente Invasivos , Redes Neurais de ComputaçãoRESUMO
In this study, new low-cost neck-mounted sensorized wearable device is presented to help farmers detect the onset of calving in extensive livestock farming by continuously monitoring cow data. The device incorporates three sensors: an inertial measurement unit (IMU), a global navigation satellite system (GNSS) receiver, and a thermometer. The hypothesis of this study was that onset calving is detectable through the analyses of the number of transitions between lying and standing of the animal (lying bouts). A new algorithm was developed to detect calving, analysing the frequency and duration of lying and standing postures. An important novelty is that the proposed algorithm has been designed with the aim of being executed in the embedded microcontroller housed in the cow's collar and, therefore, it requires minimal computational resources while allowing for real time data processing. In this preliminary study, six cows were monitored during different stages of gestation (before, during, and after calving), both with the sensorized wearable device and by human observers. It was carried out on an extensive livestock farm in Salamanca (Spain), during the period from August 2020 to July 2021. The preliminary results obtained indicate that lying-standing animal states and transitions may be useful to predict calving. Further research, with data obtained in future calving of cows, is required to refine the algorithm.
Assuntos
Parto , Dispositivos Eletrônicos Vestíveis , Animais , Comportamento Animal , Bovinos , Fazendas , Feminino , Humanos , Gado , Projetos Piloto , GravidezRESUMO
Depending on their use, electrodes must have a certain size and design so as not to compromise their electrical characteristics. It is fundamental to be aware of all dependences on external factors that vary the electrochemical characteristics of the electrodes. When using implantable electrodes, the maximum charge injection capacity (CIC) is the total amount of charge that can be injected into the tissue in a reversible way. It is fundamental to know the relations between the characteristics of the microelectrode itself and its maximum CIC in order to develop microelectrodes that will be used in biomedical applications. CIC is a very complex measure that depends on many factors: material, size (geometric and effectiveness area), and shape of the implantable microelectrode and long-term behavior, composition, and temperature of the electrolyte. In this paper, our previously proposed measurement setup and automated calculation method are used to characterize a graphene microelectrode and to measure the behavior of a set of microelectrodes that have been developed in the Fraunhofer Institute for Biomedical Engineering (IBMT) labs. We provide an electrochemical evaluation of CIC for these microelectrodes by examining the role of the following variables: pulse width of the stimulation signal, electrode geometry and size, roughness factor, solution, and long-term behavior. We hope the results presented in this paper will be useful for future studies and for the manufacture of advanced implantable microelectrodes.
RESUMO
The design of safe stimulation protocols for functional electrostimulation requires knowledge of the "maximum reversible charge injection capacity" of the implantable microelectrodes. One of the main difficulties encountered in characterizing such microelectrodes is the calculation of the access voltage Va. This paper proposes a method to calculate Va that does not require prior knowledge of the overpotential terms and of the electrolyte (or excitable tissue) resistance, which is an advantage for in vivo electrochemical characterization of microelectrodes. To validate this method, we compare the calculated results with those obtained from conventional methods for characterizing three flexible platinum microelectrodes by cyclic voltammetry and voltage transient measurements. This paper presents the experimental setup, the required instrumentation, and the signal processing.
Assuntos
Eletrodos Implantados , Microeletrodos , HumanosRESUMO
Current blood pressure (BP) estimation methods have not achieved an accurate and adaptable approach for ambulatory diagnosis and monitoring applications of populations at risk of cardiovascular disease, generally due to a limited sample size. This paper introduces an algorithm for BP estimation solely reliant on photoplethysmography (PPG) signals and demographic features. It automatically obtains signal features and employs the Markov Blanket (MB) feature selection to discern informative and transmissible features, achieving a robust space adaptable to the population shift. This approach was validated with the Aurora-BP database, compromising ambulatory wearable cuffless BP measurements for over 500 individuals. After evaluating several machine-learning regression methods, Gradient Boosting emerged as the most effective. According to the MB feature selection, temporal, frequency, and demographic features ranked highest in importance, while statistical ones were deemed non-significant. A comparative assessment of a generic model (trained on unclassified BP data) and specialized models (tailored to each distinct BP population), demonstrated a consistent superiority of our proposed MB feature space with a mean absolute error of 10.2 mmHg (0.28) for systolic BP and 6.7 mmHg (0.18) for diastolic BP on the whole dataset. Moreover, we present a first comparison of in-clinic vs. ambulatory models, with performance significantly lower for the latter with a drop of 2.85 mmHg in systolic ( ) and 2.82 mmHg for diastolic ( ) estimation errors. This work contributes to the resilient understanding of BP estimation algorithms from PPG signals, providing causal features in the signal and quantifying the disparities between ambulatory and in-clinic measurements.
RESUMO
Background: Prolonged hospitalization in severe COVID-19 cases can lead to substantial muscle loss and functional deterioration. While rehabilitation is essential, conventional approaches face capacity challenges. Therefore, evaluating the effectiveness of robotic-assisted rehabilitation for patients with post-COVID-19 fatigue syndrome to enhance both motor function and overall recovery holds paramount significance. Our objective is to assess the effectiveness of rehabilitation in post-COVID-19 patients with upper extremity impairment through the utilization of a hand exoskeleton-based robotic system. Methods: A total of 13 participants experiencing acute or limited functional or strength impairment in an upper extremity due to COVID-19 were enrolled in the study. A structured intervention consisted of 45 min therapy sessions, conducted four times per week over a six-week period, utilizing a hand exoskeleton. The research employed standardized health assessments, motion analysis, and semi-structured interviews for pre-intervention and follow-up evaluations. Paired sample t-tests were employed to statistically analyze the outcomes. Results: The outcomes showed a reduction in overall dependence levels across participants, positive changes in various quality of life-related measurements, and an average increase of 60.4 ± 25.7% and 28.7 ± 11.2% for passive and active flexion, respectively. Conclusions: Our data suggest that hand exoskeleton-based robotic systems hold promise to optimize the rehabilitation outcomes following severe COVID-19. Trial registration: ID NCT06137716 at ClinicalTrials.gov.
RESUMO
Introduction: Laparoscopic surgery often relies on a fixed Remote Center of Motion (RCM) for robot mobility control, which assumes that the patient's abdominal walls are immobile. However, this assumption is inaccurate, especially in collaborative surgical environments. In this paper, we present a force-based strategy for the mobility of a robotic camera-holder system for laparoscopic surgery based on a pivoting motion. This strategy re-conceptualizes the conventional mobility control paradigm of surgical robotics. Methods: The proposed strategy involves direct control of the Tool Center Point's (TCP) position and orientation without any constraints associated with the spatial position of the incision. It is based on pivoting motions to minimize contact forces between the abdominal walls and the laparoscope. The control directly relates the measured force and angular velocity of the laparoscope, resulting in the reallocation of the trocar, whose position becomes a consequence of the natural accommodation allowed by this pivoting. Results: The effectiveness and safety of the proposed control were evaluated through a series of experiments. The experiments showed that the control was able to minimize an external force of 9 N to ±0.2 N in 0.7 s and reduce it to 2 N in just 0.3 s. Furthermore, the camera was able to track a region of interest by displacing the TCP as desired, leveraging the strategy's property that dynamically constrains its orientation. Discussion: The proposed control strategy has proven to be effective minimizing the risk caused by sudden high forces resulting from accidents and maintaining the field of view despite any movements in the surgical environment, such as physiological movements of the patient or undesired movements of other surgical instruments. This control strategy can be implemented for laparoscopic robots without mechanical RCMs, as well as commercial collaborative robots, thereby improving the safety of surgical interventions in collaborative environments.
RESUMO
Introduction: The RobHand (Robot for Hand Rehabilitation) is a robotic neuromotor rehabilitation exoskeleton that assists in performing flexion and extension movements of the fingers. The present case study assesses changes in manual function and hand muscle strength of four selected stroke patients after completion of an established training program. In addition, safety and user satisfaction are also evaluated. Methods: The training program consisted of 16 sessions; two 60-minute training sessions per week for eight consecutive weeks. During each session, patients moved through six consecutive rehabilitation stages using the RobHand. Manual function assessments were applied before and after the training program and safety tests were carried out after each session. A user evaluation questionnaire was filled out after each patient completed the program. Results: The safety test showed the absence of significant adverse events, such as skin lesions or fatigue. An average score of 4 out of 5 was obtained on the Quebec User Evaluation of Satisfaction with Assistive Technology 2.0 Scale. Users were very satisfied with the weight, comfort, and quality of professional services. A Kruskal-Wallis test revealed that there were not statistically significant changes in the manual function tests between the beginning and the end of the training program. Discussion: It can be concluded that the RobHand is a safe rehabilitation technology and users were satisfied with the system. No statistically significant differences in manual function were found. This could be due to the high influence of the stroke stage on motor recovery since the study was performed with chronic patients. Hence, future studies should evaluate the rehabilitation effectiveness of the repetitive use of the RobHand exoskeleton on subacute patients. Clinical Trial Registration: https://clinicaltrials.gov/ct2/show/NCT05598892?id=NCT05598892&draw=2&rank=1, identifier NCT05598892.
RESUMO
Cerebrovascular accidents have physical, cognitive and emotional effects. During rehabilitation, the main focus is placed on motor recovery, yet the patient's emotional state should also be considered. For this reason, validating robotic rehabilitation systems should not only focus on their effectiveness related to the physical recovery but also on the patient's emotional response. A case series study has been conducted with five stroke patients to assess their emotional response towards therapies using RobHand, a robotic hand rehabilitation platform. Emotional state was evaluated in three dimensions (arousal, valence and dominance) using a computer-based Self-Assessment Manikin (SAM) test. It was verified that the emotions induced by the RobHand platform were successfully distributed in the three-dimensional emotional space. The increase in dominance and the decrease in arousal during sessions reflects that patients had become familiar with the rehabilitation platform, resulting in an increased feeling of control and finding the platform less attractive. The results also reflect that patients found a therapy based on a virtual environment with a realistic scenario more pleasant and attractive.