Eye-gaze control of a wheelchair mounted 6DOF assistive robot for activities of daily living.

BACKGROUND: Building control architecture that balances the assistive manipulation systems with the benefits of direct human control is a crucial challenge of human-robot collaboration. It promises to help people with disabilities more efficiently control wheelchair and wheelchair-mounted robot arms to accomplish activities of daily living. METHODS: In this study, our research objective is to design an eye-tracking assistive robot control system capable of providing targeted engagement and motivating individuals with a disability to use the developed method for self-assistance activities of daily living. The graphical user interface is designed and integrated with the developed control architecture to achieve the goal. RESULTS: We evaluated the system by conducting a user study. Ten healthy participants performed five trials of three manipulation tasks using the graphical user interface and the developed control framework. The 100% success rate on task performance demonstrates the effectiveness of our system for individuals with motor impairments to control wheelchair and wheelchair-mounted assistive robotic manipulators. CONCLUSIONS: We demonstrated the usability of using this eye-gaze system to control a robotic arm mounted on a wheelchair in activities of daily living for people with disabilities. We found high levels of acceptance with higher ratings in the evaluation of the system with healthy participants.

A Novel Multi-Modal Teleoperation of a Humanoid Assistive Robot with Real-Time Motion Mimic.

This research shows the development of a teleoperation system with an assistive robot (NAO) through a Kinect V2 sensor, a set of Meta Quest virtual reality glasses, and Nintendo Switch controllers (Joycons), with the use of the Robot Operating System (ROS) framework to implement the communication between devices. In this paper, two interchangeable operating models are proposed. An exclusive controller is used to control the robot's movement to perform assignments that require long-distance travel. Another teleoperation protocol uses the skeleton joints information readings by the Kinect sensor, the orientation of the Meta Quest, and the button press and thumbstick movements of the Joycons to control the arm joints and head of the assistive robot, and its movement in a limited area. They give image feedback to the operator in the VR glasses in a first-person perspective and retrieve the user's voice to be spoken by the assistive robot. Results are promising and can be used for educational and therapeutic purposes.

Hand Rehabilitation Devices: A Comprehensive Systematic Review.

A cerebrovascular accident, or a stroke, can cause significant neurological damage, inflicting the patient with loss of motor function in their hands. Standard rehabilitation therapy for the hand increases demands on clinics, creating an avenue for powered hand rehabilitation devices. Hand rehabilitation devices (HRDs) are devices designed to provide the hand with passive, active, and active-assisted rehabilitation therapy; however, HRDs do not have any standards in terms of development or design. Although the categorization of an injury's severity can guide a patient into seeking proper assistance, rehabilitation devices do not have a set standard to provide a solution from the beginning to the end stages of recovery. In this paper, HRDs are defined and compared by their mechanical designs, actuation mechanisms, control systems, and therapeutic strategies. Furthermore, devices with conducted clinical trials are used to determine the future development of HRDs. After evaluating the abilities of 35 devices, it is inferred that standard characteristics for HRDs should include an exoskeleton design, the incorporation of challenge-based and coaching therapeutic strategies, and the implementation of surface electromyogram signals (sEMG) based control.

Evaluation of Objective Functions for the Optimal Design of an Assistive Robot.

The number of individuals with upper or lower extremities dysfunction (ULED) has considerably increased in the past few decades, resulting in a high economic burden for their families and society. Individuals with ULEDs require assistive robots to fulfill all their activities of daily living (ADLs). However, a theory for the optimal design of assistive robots that reduces energy consumption while increasing the workspace is unavailable. Thus, this research presents an algorithm for the optimal link length selection of an assistive robot mounted on a wheelchair to minimize the torque demands of each joint while increasing the workspace coverage. For this purpose, this research developed a workspace to satisfy a list of 18 ADLs. Then, three torque indices from the literature were considered as performance measures to minimize; the three torque measures are the quadratic average torque (QAT), the weighted root square mean (WRMS), and the absolute sum of torques (AST). The proposed algorithm evaluates any of the three torque measures within the workspace, given the robot dimensions. This proposed algorithm acts as an objective function, which is optimized using a genetic algorithm for each torque measure. The results show that all tree torque measures are suitable criteria for assistance robot optimization. However, each torque measures yield different optimal results; in the case of the QAT optimization, it produces the least workspace with the minimum overall torques of all the joints. Contrarily, the WRMS and AST optimization yield similar results generating the maximum workspace coverage but with a greater overall torque of all joints. Thus, the selection between the three methods depends on the designer's criteria. Based on the results, the presented methodology is a reliable tool for the optimal dimensioning of assistive robots.

Control of a Wheelchair-Mounted 6DOF Assistive Robot With Chin and Finger Joysticks.

Throughout the last decade, many assistive robots for people with disabilities have been developed; however, researchers have not fully utilized these robotic technologies to entirely create independent living conditions for people with disabilities, particularly in relation to activities of daily living (ADLs). An assistive system can help satisfy the demands of regular ADLs for people with disabilities. With an increasing shortage of caregivers and a growing number of individuals with impairments and the elderly, assistive robots can help meet future healthcare demands. One of the critical aspects of designing these assistive devices is to improve functional independence while providing an excellent human-machine interface. People with limited upper limb function due to stroke, spinal cord injury, cerebral palsy, amyotrophic lateral sclerosis, and other conditions find the controls of assistive devices such as power wheelchairs difficult to use. Thus, the objective of this research was to design a multimodal control method for robotic self-assistance that could assist individuals with disabilities in performing self-care tasks on a daily basis. In this research, a control framework for two interchangeable operating modes with a finger joystick and a chin joystick is developed where joysticks seamlessly control a wheelchair and a wheelchair-mounted robotic arm. Custom circuitry was developed to complete the control architecture. A user study was conducted to test the robotic system. Ten healthy individuals agreed to perform three tasks using both (chin and finger) joysticks for a total of six tasks with 10 repetitions each. The control method has been tested rigorously, maneuvering the robot at different velocities and under varying payload (1-3.5 lb) conditions. The absolute position accuracy was experimentally found to be approximately 5 mm. The round-trip delay we observed between the commands while controlling the xArm was 4 ms. Tests performed showed that the proposed control system allowed individuals to perform some ADLs such as picking up and placing items with a completion time of less than 1 min for each task and 100% success.

A Novel Framework for Mixed Reality-Based Control of Collaborative Robot: Development Study.

BACKGROUND: Applications of robotics in daily life are becoming essential by creating new possibilities in different fields, especially in the collaborative environment. The potentials of collaborative robots are tremendous as they can work in the same workspace as humans. A framework employing a top-notch technology for collaborative robots will surely be worthwhile for further research. OBJECTIVE: This study aims to present the development of a novel framework for the collaborative robot using mixed reality. METHODS: The framework uses Unity and Unity Hub as a cross-platform gaming engine and project management tool to design the mixed reality interface and digital twin. It also uses the Windows Mixed Reality platform to show digital materials on holographic display and the Azure mixed reality services to capture and expose digital information. Eventually, it uses a holographic device (HoloLens 2) to execute the mixed reality-based collaborative system. RESULTS: A thorough experiment was conducted to validate the novel framework for mixed reality-based control of a collaborative robot. This framework was successfully applied to implement a collaborative system using a 5-degree of freedom robot (xArm-5) in a mixed reality environment. The framework was stable and worked smoothly throughout the collaborative session. Due to the distributed nature of cloud applications, there is a negligible latency between giving a command and the execution of the physical collaborative robot. CONCLUSIONS: Opportunities for collaborative robots in telerehabilitation and teleoperation are vital as in any other field. The proposed framework was successfully applied in a collaborative session, and it can also be applied in other similar potential applications for robust and more promising performance.

Kinematics and Workspace Analysis of xArm6 Robot for Activities of Daily Living.

Recent statistics reveal that the number of individuals with upper or lower extremity dysfunctions has increased alarmingly. It is estimated that approximately 3.3 million Americans use a wheelchair, with an expected 2 million new wheelchair users every year. To assist powered wheelchair users with limited upper limb function, we have been exploring assistive robots that can be mounted on a wheelchair to perform essential activities of daily living (ADL), such as picking/placing an object from out of reach, feeding, etc. In this research, a 6DoF robot, xArm-6 was used as an assistive robot to provide ADL assistance. Experiments were conducted with xArm6 Robot to investigate the motion trajectories and workspace covering essential ADLs. In kinematic analysis, modified Denavit-Hartenberg parameters are used to identify the Robot's motion path and workspace. On the other hand, the iterative Newton-Euler method was used for dynamic analysis to estimate the joint torques corresponding to each ADL. Experimental results show that xArm-6 can be used for some selected ADLs tasks but not for all essential ADLs.

Understanding the nonlinear behavior of EEG with advanced machine learning in artifact elimination.

Steady-state Visually Evoked Potential (SSVEP) based Electroencephalogram (EEG) signal is utilized in brain-computer interface paradigms, diagnosis of brain diseases, and measurement of the cognitive status of the human brain. However, various artifacts such as the Electrocardiogram (ECG), Electrooculogram (EOG), and Electromyogram (EMG) are present in the raw EEG signal, which adversely affect the EEG-based appliances. In this research, Adaptive Neuro-fuzzy Interface Systems (ANFIS) and Hilbert-Huang Transform (HHT) are primarily employed to remove the artifacts from EEG signals. This work proposes Adaptive Noise Cancellation (ANC) and ANFIS based methods for canceling EEG artifacts. A mathematical model of EEG with the aforementioned artifacts is determined to accomplish the research goal, and then those artifacts are eliminated based on their mathematical characteristics. ANC, ANFIS, and HHT algorithms are simulated on the MATLAB platform, and their performances are also justified by various error estimation criteria using hardware implementation.