Closing the loop in minimally supervised human-robot interaction: formative and summative feedback.

Human instructors fluidly communicate with hand gestures, head and body movements, and facial expressions, but robots rarely leverage these complementary cues. A minimally supervised social robot with such skills could help people exercise and learn new activities. Thus, we investigated how nonverbal feedback from a humanoid robot affects human behavior. Inspired by the education literature, we evaluated formative feedback (real-time corrections) and summative feedback (post-task scores) for three distinct tasks: positioning in the room, mimicking the robot's arm pose, and contacting the robot's hands. Twenty-eight adults completed seventy-five 30-s-long trials with no explicit instructions or experimenter help. Motion-capture data analysis shows that both formative and summative feedback from the robot significantly aided user performance. Additionally, formative feedback improved task understanding. These results show the power of nonverbal cues based on human movement and the utility of viewing feedback through formative and summative lenses.

Influence of different position modal parameters on milling chatter stability of orthopedic surgery robots.

This research is dedicated to exploring the dynamics of milling chatter stability in orthopedic surgery robots, focusing on the impact of position modal parameters on chatter stability. Initially, we develop a dynamic milling force model for the robotic milling process that integrates both modal coupling and regenerative effects. We then employ the zero-order frequency domain method to derive a chatter stability domain model, visually represented through stability lobe diagrams (SLDs). Through conducting hammer test experiments, we ascertain the robot's modal parameters at varying positions, enabling the precise generation of SLDs. This study also includes experimental validation of the chatter SLD analysis method, laying the groundwork for further examination of chatter stability across different positional modal parameters. Finally, our analysis of the variations in modal parameters on the stability of robot milling chatter yields a theoretical framework for optimizing cutting parameters and developing control strategies within the context of orthopedic surgery robots.

A fully autonomous robotic ultrasound system for thyroid scanning.

The current thyroid ultrasound relies heavily on the experience and skills of the sonographer and the expertise of the radiologist, and the process is physically and cognitively exhausting. In this paper, we report a fully autonomous robotic ultrasound system, which is able to scan thyroid regions without human assistance and identify malignant nod- ules. In this system, human skeleton point recognition, reinforcement learning, and force feedback are used to deal with the difficulties in locating thyroid targets. The orientation of the ultrasound probe is adjusted dynamically via Bayesian optimization. Experimental results on human participants demonstrated that this system can perform high-quality ultrasound scans, close to manual scans obtained by clinicians. Additionally, it has the potential to detect thyroid nodules and provide data on nodule characteristics for American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI-RADS) calculation.

A Nanorobotics-Based Approach of Breast Cancer in the Nanotechnology Era.

We are living in an era of advanced nanoscience and nanotechnology. Numerous nanomaterials, culminating in nanorobots, have demonstrated ingenious applications in biomedicine, including breast cancer (BC) nano-theranostics. To solve the complicated problem of BC heterogeneity, non-targeted drug distribution, invasive diagnostics or surgery, resistance to classic onco-therapies and real-time monitoring of tumors, nanorobots are designed to perform multiple tasks at a small scale, even at the organelles or molecular level. Over the last few years, most nanorobots have been bioengineered as biomimetic and biocompatible nano(bio)structures, resembling different organisms and cells, such as urchin, spider, octopus, fish, spermatozoon, flagellar bacterium or helicoidal cyanobacterium. In this review, readers will be able to deepen their knowledge of the structure, behavior and role of several types of nanorobots, among other nanomaterials, in BC theranostics. We summarized here the characteristics of many functionalized nanodevices designed to counteract the main neoplastic hallmark features of BC, from sustaining proliferation and evading anti-growth signaling and resisting programmed cell death to inducing angiogenesis, activating invasion and metastasis, preventing genomic instability, avoiding immune destruction and deregulating autophagy. Most of these nanorobots function as targeted and self-propelled smart nano-carriers or nano-drug delivery systems (nano-DDSs), enhancing the efficiency and safety of chemo-, radio- or photodynamic therapy, or the current imagistic techniques used in BC diagnosis. Most of these nanorobots have been tested in vitro, using various BC cell lines, as well as in vivo, mainly based on mice models. We are still waiting for nanorobots that are low-cost, as well as for a wider transition of these favorable effects from laboratory to clinical practice.

Optimizing Human-Robot Teaming Performance through Q-Learning-Based Task Load Adjustment and Physiological Data Analysis.

The transition to Industry 4.0 and 5.0 underscores the need for integrating humans into manufacturing processes, shifting the focus towards customization and personalization rather than traditional mass production. However, human performance during task execution may vary. To ensure high human-robot teaming (HRT) performance, it is crucial to predict performance without negatively affecting task execution. Therefore, to predict performance indirectly, significant factors affecting human performance, such as engagement and task load (i.e., amount of cognitive, physical, and/or sensory resources required to perform a particular task), must be considered. Hence, we propose a framework to predict and maximize the HRT performance. For the prediction of task performance during the development phase, our methodology employs features extracted from physiological data as inputs. The labels for these predictions-categorized as accurate performance or inaccurate performance due to high/low task load-are meticulously crafted using a combination of the NASA TLX questionnaire, records of human performance in quality control tasks, and the application of Q-Learning to derive task-specific weights for the task load indices. This structured approach enables the deployment of our model to exclusively rely on physiological data for predicting performance, thereby achieving an accuracy rate of 95.45% in forecasting HRT performance. To maintain optimized HRT performance, this study further introduces a method of dynamically adjusting the robot's speed in the case of low performance. This strategic adjustment is designed to effectively balance the task load, thereby enhancing the efficiency of human-robot collaboration.

Anthropomorphic Tendon-Based Hands Controlled by Agonist-Antagonist Corticospinal Neural Network.

This article presents a study on the neurobiological control of voluntary movements for anthropomorphic robotic systems. A corticospinal neural network model has been developed to control joint trajectories in multi-fingered robotic hands. The proposed neural network simulates cortical and spinal areas, as well as the connectivity between them, during the execution of voluntary movements similar to those performed by humans or monkeys. Furthermore, this neural connection allows for the interpretation of functional roles in the motor areas of the brain. The proposed neural control system is tested on the fingers of a robotic hand, which is driven by agonist-antagonist tendons and actuators designed to accurately emulate complex muscular functionality. The experimental results show that the corticospinal controller produces key properties of biological movement control, such as bell-shaped asymmetric velocity profiles and the ability to compensate for disturbances. Movements are dynamically compensated for through sensory feedback. Based on the experimental results, it is concluded that the proposed biologically inspired adaptive neural control system is robust, reliable, and adaptable to robotic platforms with diverse biomechanics and degrees of freedom. The corticospinal network successfully integrates biological concepts with engineering control theory for the generation of functional movement. This research significantly contributes to improving our understanding of neuromotor control in both animals and humans, thus paving the way towards a new frontier in the field of neurobiological control of anthropomorphic robotic systems.

Magnetic steering continuum robot for transluminal procedures with programmable shape and functionalities.

Millimeter-scale soft continuum robots offer safety and adaptability in transluminal procedures due to their passive compliance, but this feature necessitates interactions with surrounding lumina, leading to potential medical risks and restricted mobility. Here, we introduce a millimeter-scale continuum robot, enabling apical extension while maintaining structural stability. Utilizing phase transition components, the robot executes cycles of tip-based elongation, steered accurately through programmable magnetic fields. Each motion cycle features a solid-like backbone for stability, and a liquid-like component for advancement, thereby enabling autonomous shaping without reliance on environmental interactions. Together with clinical imaging technologies, we demonstrate the capability of navigating through tortuous and fragile lumina to transport microsurgical tools. Once it reaches larger anatomical spaces such as stomach, it can morph into functional 3D structures that serve as surgical tools or sensing units, overcoming the constraints of initially narrow pathways. By leveraging this design paradigm, we anticipate enhanced safety, multi-functionality, and cooperative capabilities among millimeter-scale continuum robots, opening new avenues for transluminal robotic surgery.

Optimizing shoulder elevation assist rate in exoskeletal rehabilitation based on muscular activity indices: a clinical feasibility study.

BACKGROUND: Restoring shoulder function is critical for upper-extremity rehabilitation following a stroke. The complex musculoskeletal anatomy of the shoulder presents a challenge for safely assisting elevation movements through robotic interventions. The level of shoulder elevation assistance in rehabilitation is often based on clinical judgment. There is no standardized method for deriving an optimal level of assistance, underscoring the importance of addressing abnormal movements during shoulder elevation, such as abnormal synergies and compensatory actions. This study aimed to investigate the effectiveness and safety of a newly developed shoulder elevation exoskeleton robot by applying a novel optimization technique derived from the muscle synergy index. METHODS: Twelve chronic stroke participants underwent an intervention consisting of 100 robot-assisted shoulder elevation exercises (10 × 10 times, approximately 40 min) for 10 days (4-5 times/week). The optimal robot assist rate was derived by detecting the change points using the co-contraction index, calculated from electromyogram (EMG) data obtained from the anterior deltoid and biceps brachii muscles during shoulder elevation at the initial evaluation. The primary outcomes were the Fugl-Meyer assessment-upper extremity (FMA-UE) shoulder/elbow/forearm score, kinematic outcomes (maximum angle of voluntary shoulder flexion and elbow flexion ratio during shoulder elevation), and shoulder pain outcomes (pain-free passive shoulder flexion range of motion [ROM] and visual analogue scale for pain severity during shoulder flexion). The effectiveness and safety of robotic therapy were examined using the Wilcoxon signed-rank sum test. RESULTS: All 12 patients completed the procedure without any adverse events. Two participants were excluded from the analysis because the EMG of the biceps brachii was not obtained. Ten participants (five men and five women; mean age: 57.0 [5.5] years; mean FMA-UE total score: 18.7 [10.5] points) showed significant improvement in the FMA-UE shoulder/elbow/forearm score, kinematic outcomes, and pain-free passive shoulder flexion ROM (P < 0.05). The shoulder pain outcomes remained unchanged or improved in all patients. CONCLUSIONS: The study presents a method for deriving the optimal robotic assist rate. Rehabilitation using a shoulder robot based on this derived optimal assist rate showed the possibility of safely improving the upper-extremity function in patients with severe stroke in the chronic phase.

Firing feature-driven neural circuits with scalable memristive neurons for robotic obstacle avoidance.

Neural circuits with specific structures and diverse neuronal firing features are the foundation for supporting intelligent tasks in biology and are regarded as the driver for catalyzing next-generation artificial intelligence. Emulating neural circuits in hardware underpins engineering highly efficient neuromorphic chips, however, implementing a firing features-driven functional neural circuit is still an open question. In this work, inspired by avoidance neural circuits of crickets, we construct a spiking feature-driven sensorimotor control neural circuit consisting of three memristive Hodgkin-Huxley neurons. The ascending neurons exhibit mixed tonic spiking and bursting features, which are used for encoding sensing input. Additionally, we innovatively introduce a selective communication scheme in biology to decode mixed firing features using two descending neurons. We proceed to integrate such a neural circuit with a robot for avoidance control and achieve lower latency than conventional platforms. These results provide a foundation for implementing real brain-like systems driven by firing features with memristive neurons and put constructing high-order intelligent machines on the agenda.

Oscillating latent dynamics in robot systems during walking and reaching.

Sensorimotor control of complex, dynamic systems such as humanoids or quadrupedal robots is notoriously difficult. While artificial systems traditionally employ hierarchical optimisation approaches or black-box policies, recent results in systems neuroscience suggest that complex behaviours such as locomotion and reaching are correlated with limit cycles in the primate motor cortex. A recent result suggests that, when applied to a learned latent space, oscillating patterns of activation can be used to control locomotion in a physical robot. While reminiscent of limit cycles observed in primate motor cortex, these dynamics are unsurprising given the cyclic nature of the robot's behaviour (walking). In this preliminary investigation, we consider how a similar approach extends to a less obviously cyclic behaviour (reaching). This has been explored in prior work using computational simulations. But simulations necessarily make simplifying assumptions that do not necessarily correspond to reality, so do not trivially transfer to real robot platforms. Our primary contribution is to demonstrate that we can infer and control real robot states in a learnt representation using oscillatory dynamics during reaching tasks. We further show that the learned latent representation encodes interpretable movements in the robot's workspace. Compared to robot locomotion, the dynamics that we observe for reaching are not fully cyclic, as they do not begin and end at the same position of latent space. However, they do begin to trace out the shape of a cycle, and, by construction, they are driven by the same underlying oscillatory mechanics.

A wirelessly programmable, skin-integrated thermo-haptic stimulator system for virtual reality.

Sensations of heat and touch produced by receptors in the skin are of essential importance for perceptions of the physical environment, with a particularly powerful role in interpersonal interactions. Advances in technologies for replicating these sensations in a programmable manner have the potential not only to enhance virtual/augmented reality environments but they also hold promise in medical applications for individuals with amputations or impaired sensory function. Engineering challenges are in achieving interfaces with precise spatial resolution, power-efficient operation, wide dynamic range, and fast temporal responses in both thermal and in physical modulation, with forms that can extend over large regions of the body. This paper introduces a wireless, skin-compatible interface for thermo-haptic modulation designed to address some of these challenges, with the ability to deliver programmable patterns of enhanced vibrational displacement and high-speed thermal stimulation. Experimental and computational investigations quantify the thermal and mechanical efficiency of a vertically stacked design layout in the thermo-haptic stimulators that also supports real-time, closed-loop control mechanisms. The platform is effective in conveying thermal and physical information through the skin, as demonstrated in the control of robotic prosthetics and in interactions with pressure/temperature-sensitive touch displays.

Design and control of jumping microrobots with torque reversal latches.

Jumping microrobots and insects power their impressive leaps through systems of springs and latches. Using springs and latches, rather than motors or muscles, as actuators to power jumps imposes new challenges on controlling the performance of the jump. In this paper, we show how tuning the motor and spring relative to one another in a torque reversal latch can lead to an ability to control jump output, producing either tuneable (variable) or stereotyped jumps. We develop and utilize a simple mathematical model to explore the underlying design, dynamics, and control of a torque reversal mechanism, provides the opportunity to achieve different outcomes through the interaction between geometry, spring properties, and motor voltage. We relate system design and control parameters to performance to guide the design of torque reversal mechanisms for either variable or stereotyped jump performance. We then build a small (356 mg) microrobot and characterize the constituent components (e.g. motor and spring). Through tuning the actuator and spring relative to the geometry of the torque reversal mechanism, we demonstrate that we can achieve jumping microrobots that both jump with different take-off velocities given the actuator input (variable jumping), and those that jump with nearly the same take-off velocity with actuator input (stereotyped jumping). The coupling between spring characteristics and geometry in this system has benefits for resource-limited microrobots, and our work highlights design combinations that have synergistic impacts on output, compared to others that constrain it. This work will guide new design principles for enabling control in resource-limited jumping microrobots.

Effects of robot-assisted gait training using the Welwalk on gait independence for individuals with hemiparetic stroke: an assessor-blinded, multicenter randomized controlled trial.

BACKGROUND: Gait disorder remains a major challenge for individuals with stroke, affecting their quality of life and increasing the risk of secondary complications. Robot-assisted gait training (RAGT) has emerged as a promising approach for improving gait independence in individuals with stroke. This study aimed to evaluate the effect of RAGT in individuals with subacute hemiparetic stroke using a one-leg assisted gait robot called Welwalk WW-1000. METHODS: An assessor-blinded, multicenter randomized controlled trial was conducted in the convalescent rehabilitation wards of eight hospitals in Japan. Participants with first-ever hemiparetic stroke who could not walk at pre-intervention assessment were randomized to either the Welwalk group, which underwent RAGT with conventional physical therapy, or the control group, which underwent conventional physical therapy alone. Both groups received 80 min of physical therapy per day, 7 days per week, while the Welwalk group received 40 min of RAGT per day, 6 days per week, as part of their physical therapy. The primary outcome was gait independence, as assessed using the Functional Independence Measure Walk Score. RESULTS: A total of 91 participants were enrolled, 85 of whom completed the intervention. As a result, 91 participants, as a full analysis set, and 85, as a per-protocol set, were analyzed. The primary outcome, the cumulative incidence of gait-independent events, was not significantly different between the groups. Subgroup analysis revealed that the interaction between the intervention group and stroke type did not yield significant differences in either the full analysis or per-protocol set. However, although not statistically significant, a discernible trend toward improvement with Welwalk was observed in cases of cerebral infarction for the full analysis and per-protocol sets (HR 4.167 [95%CI 0.914-18.995], p = 0.065, HR 4.443 [95%CI 0.973-20.279], p = 0.054, respectively). CONCLUSIONS: The combination of RAGT using Welwalk and conventional physical therapy was not significantly more effective than conventional physical therapy alone in promoting gait independence in individuals with subacute hemiparetic stroke, although a trend toward earlier gait independence was observed in individuals with cerebral infarction. TRIAL REGISTRATION: This study was registered with the Japan Registry of Clinical Trials ( https://jrct.niph.go.jp ; jRCT 042180078) on March 3, 2019.

Letter to editor: Bridging the gap: robotic applications in cerebral aneurysms neurointerventions - a systematic review.

The letter critically evaluates the role of robotic applications in cerebral aneurysm neurointerventions, synthesizing a diverse array of studies to elucidate both the potential benefits and inherent limitations of this emerging technology. The review highlights the advancements in precision, efficiency, and patient outcomes facilitated by robotic platforms, while also acknowledging challenges such as the steep learning curve and the need for further research to establish long-term efficacy and cost-effectiveness. By navigating through the complexities of robotic-assisted neurosurgery, the review provides valuable insights into the transformative potential of robotics in optimizing treatment paradigms and improving patient care.

Learning agile soccer skills for a bipedal robot with deep reinforcement learning.

We investigated whether deep reinforcement learning (deep RL) is able to synthesize sophisticated and safe movement skills for a low-cost, miniature humanoid robot that can be composed into complex behavioral strategies. We used deep RL to train a humanoid robot to play a simplified one-versus-one soccer game. The resulting agent exhibits robust and dynamic movement skills, such as rapid fall recovery, walking, turning, and kicking, and it transitions between them in a smooth and efficient manner. It also learned to anticipate ball movements and block opponent shots. The agent's tactical behavior adapts to specific game contexts in a way that would be impractical to manually design. Our agent was trained in simulation and transferred to real robots zero-shot. A combination of sufficiently high-frequency control, targeted dynamics randomization, and perturbations during training enabled good-quality transfer. In experiments, the agent walked 181% faster, turned 302% faster, took 63% less time to get up, and kicked a ball 34% faster than a scripted baseline.

Impaired proprioception and magnified scaling of proprioceptive error responses in chronic stroke.

BACKGROUND: Previous work has shown that ~ 50-60% of individuals have impaired proprioception after stroke. Typically, these studies have identified proprioceptive impairments using a narrow range of reference movements. While this has been important for identifying the prevalence of proprioceptive impairments, it is unknown whether these error responses are consistent for a broad range of reference movements. The objective of this study was to characterize proprioceptive accuracy as function of movement speed and distance in stroke. METHODS: Stroke (N = 25) and controls (N = 21) completed a robotic proprioception test that varied movement speed and distance. Participants mirror-matched various reference movement speeds (0.1-0.4 m/s) and distances (7.5-17.5 cm). Spatial and temporal parameters known to quantify proprioception were used to determine group differences in proprioceptive accuracy, and whether patterns of proprioceptive error were consistent across testing conditions within and across groups. RESULTS: Overall, we found that stroke participants had impaired proprioception compared to controls. Proprioceptive errors related to tested reference movement scaled similarly to controls, but some errors showed amplified scaling (e.g., significantly overshooting or undershooting reference speed). Further, interaction effects were present for speed and distance reference combinations at the extremes of the testing distribution. CONCLUSIONS: We found that stroke participants have impaired proprioception and that some proprioceptive errors were dependent on characteristics of the movement (e.g., speed) and that reference movements at the extremes of the testing distribution resulted in significantly larger proprioceptive errors for the stroke group. Understanding how sensory information is utilized across a broad spectrum of movements after stroke may aid design of rehabilitation programs.

Real-world humanoid locomotion with reinforcement learning.

Humanoid robots that can autonomously operate in diverse environments have the potential to help address labor shortages in factories, assist elderly at home, and colonize new planets. Although classical controllers for humanoid robots have shown impressive results in a number of settings, they are challenging to generalize and adapt to new environments. Here, we present a fully learning-based approach for real-world humanoid locomotion. Our controller is a causal transformer that takes the history of proprioceptive observations and actions as input and predicts the next action. We hypothesized that the observation-action history contains useful information about the world that a powerful transformer model can use to adapt its behavior in context, without updating its weights. We trained our model with large-scale model-free reinforcement learning on an ensemble of randomized environments in simulation and deployed it to the real-world zero-shot. Our controller could walk over various outdoor terrains, was robust to external disturbances, and could adapt in context.

A meta-analysis of unilateral axillary approach for robotic surgery compared with open surgery for differentiated thyroid carcinoma.

OBJECTIVE: The Da Vinci Robot is the most advanced micro-control system in endoscopic surgical instruments and has gained a lot of valuable experience today. However, the technical feasibility and oncological safety of the robot over open surgery are still uncertain. This work is to systematically evaluate the efficacy of the unilateral axillary approach for robotic surgery compared to open surgery for differentiated thyroid carcinoma. METHODS: PubMed, Embase, Cochrane Library, and Web of Science databases were utilized to search for relevant literatures of robotic thyroid surgery using unilateral axillary approach compared to open thyroid surgery, and a meta-analysis was performed using RevMan software version 5.3. Statistical analysis was performed through Mantle-Haenszel and inverse variance methods. RESULTS: Twelve studies with a total of 2660 patients were included in the meta-analysis. The results showed that compared with the open group, the robotic group had a longer total thyroidectomy time, shorter hospital stay, less intraoperative bleeding, more postoperative drainage, fewer retrieved central lymph nodes, and higher cosmetic satisfaction (all P < 0.05). In contrast, temporary and permanent laryngeal recurrent nerve injury, temporary and permanent hypoparathyroidism or hypocalcemia, brachial plexus nerve injury, number of retrieved central lymph nodes, number of retrieved lymph nodes in the lateral cervical region, number of lymph node metastases in the lateral cervical region, hematoma, seroma, lymphatic leak, stimulated thyroglobulin (sTg) and unstimulated thyroglobulin (uTg), and the number and recurrence rate of patients with sTg <1ng/ml were not statistically different between the two groups (P > 0.05). CONCLUSIONS: The unilateral axillary approach for robotic thyroid surgery may achieve outcomes similar to those of open surgery. Further validation is required in a prospective randomized controlled trial.

The evolution of robotics: research and application progress of dental implant robotic systems.

The use of robots to augment human capabilities and assist in work has long been an aspiration. Robotics has been developing since the 1960s when the first industrial robot was introduced. As technology has advanced, robotic-assisted surgery has shown numerous advantages, including more precision, efficiency, minimal invasiveness, and safety than is possible with conventional techniques, which are research hotspots and cutting-edge trends. This article reviewed the history of medical robot development and seminal research papers about current research progress. Taking the autonomous dental implant robotic system as an example, the advantages and prospects of medical robotic systems would be discussed which would provide a reference for future research.

A six degrees-of-freedom cable-driven robotic platform for head-neck movement.

This paper introduces a novel cable-driven robotic platform that enables six degrees-of-freedom (DoF) natural head-neck movements. Poor postural control of the head-neck can be a debilitating symptom of neurological disorders such as amyotrophic lateral sclerosis and cerebral palsy. Current treatments using static neck collars are inadequate, and there is a need to develop new devices to empower movements and facilitate physical rehabilitation of the head-neck. State-of-the-art neck exoskeletons using lower DoF mechanisms with rigid linkages are limited by their hard motion constraints imposed on head-neck movements. By contrast, the cable-driven robot presented in this paper does not constrain motion and enables wide-range, 6-DoF control of the head-neck. We present the mechatronic design, validation, and control implementations of this robot, as well as a human experiment to demonstrate a potential use case of this versatile robot for rehabilitation. Participants were engaged in a target reaching task while the robot applied both assistive and resistive moments on the head during the task. Our results show that neck muscle activation increased by 19% when moving the head against resistance and decreased by 28-43% when assisted by the robot. Overall, these results provide a scientific justification for further research in enabling movement and identifying personalized rehabilitation for motor training. Beyond rehabilitation, other applications such as applying force perturbations on the head to study sensory integration and applying traction to achieve pain relief may benefit from the innovation of this robotic platform which is capable of applying controlled 6-DoF forces/moments on the head.