Acceptability of Social Robots and Adaptation of Hybrid-Face Robot for Dementia Care in India: A Qualitative Study.

OBJECTIVES: This study aims to understand the acceptability of social robots and the adaptation of the Hybrid-Face Robot for dementia care in India. METHODS: We conducted a focus group discussion and in-depth interviews with persons with dementia (PwD), their caregivers, professionals in the field of dementia, and technical experts in robotics to collect qualitative data. RESULTS: This study explored the following themes: Acceptability of Robots in Dementia Care in India, Adaptation of Hybrid-Face Robot and Future of Robots in Dementia Care. Caregivers and PwD were open to the idea of social robot use in dementia care; caregivers perceived it to help with the challenges of caregiving and positively viewed a future with robots. DISCUSSION: This study is the first of its kind to explore the use of social robots in dementia care in India by highlighting user needs and requirements that determine acceptability and guiding adaptation.

An accurate and rapidly calibrating speech neuroprosthesis.

Brain-computer interfaces can enable rapid, intuitive communication for people with paralysis by transforming the cortical activity associated with attempted speech into text on a computer screen. Despite recent advances, communication with brain-computer interfaces has been restricted by extensive training data requirements and inaccurate word output. A man in his 40's with ALS with tetraparesis and severe dysarthria (ALSFRS-R = 23) was enrolled into the BrainGate2 clinical trial. He underwent surgical implantation of four microelectrode arrays into his left precentral gyrus, which recorded neural activity from 256 intracortical electrodes. We report a speech neuroprosthesis that decoded his neural activity as he attempted to speak in both prompted and unstructured conversational settings. Decoded words were displayed on a screen, then vocalized using text-to-speech software designed to sound like his pre-ALS voice. On the first day of system use, following 30 minutes of attempted speech training data, the neuroprosthesis achieved 99.6% accuracy with a 50-word vocabulary. On the second day, the size of the possible output vocabulary increased to 125,000 words, and, after 1.4 additional hours of training data, the neuroprosthesis achieved 90.2% accuracy. With further training data, the neuroprosthesis sustained 97.5% accuracy beyond eight months after surgical implantation. The participant has used the neuroprosthesis to communicate in self-paced conversations for over 248 hours. In an individual with ALS and severe dysarthria, an intracortical speech neuroprosthesis reached a level of performance suitable to restore naturalistic communication after a brief training period.

A novel approach for modelling and classifying sit-to-stand kinematics using inertial sensors.

Sit-to-stand transitions are an important part of activities of daily living and play a key role in functional mobility in humans. The sit-to-stand movement is often affected in older adults due to frailty and in patients with motor impairments such as Parkinson's disease leading to falls. Studying kinematics of sit-to-stand transitions can provide insight in assessment, monitoring and developing rehabilitation strategies for the affected populations. We propose a three-segment body model for estimating sit-to-stand kinematics using only two wearable inertial sensors, placed on the shank and back. Reducing the number of sensors to two instead of one per body segment facilitates monitoring and classifying movements over extended periods, making it more comfortable to wear while reducing the power requirements of sensors. We applied this model on 10 younger healthy adults (YH), 12 older healthy adults (OH) and 12 people with Parkinson's disease (PwP). We have achieved this by incorporating unique sit-to-stand classification technique using unsupervised learning in the model based reconstruction of angular kinematics using extended Kalman filter. Our proposed model showed that it was possible to successfully estimate thigh kinematics despite not measuring the thigh motion with inertial sensor. We classified sit-to-stand transitions, sitting and standing states with the accuracies of 98.67%, 94.20% and 91.41% for YH, OH and PwP respectively. We have proposed a novel integrated approach of modelling and classification for estimating the body kinematics during sit-to-stand motion and successfully applied it on YH, OH and PwP groups.

Dynamics of Long-Range Temporal Correlations in Broadband EEG During Different Motor Execution and Imagery Tasks.

Brain activity is composed of oscillatory and broadband arrhythmic components; however, there is more focus on oscillatory sensorimotor rhythms to study movement, but temporal dynamics of broadband arrhythmic electroencephalography (EEG) remain unexplored. We have previously demonstrated that broadband arrhythmic EEG contains both short- and long-range temporal correlations that change significantly during movement. In this study, we build upon our previous work to gain a deeper understanding of these changes in the long-range temporal correlation (LRTC) in broadband EEG and contrast them with the well-known LRTC in alpha oscillation amplitude typically found in the literature. We investigate and validate changes in LRTCs during five different types of movements and motor imagery tasks using two independent EEG datasets recorded with two different paradigms-our finger tapping dataset with single self-initiated asynchronous finger taps and publicly available EEG dataset containing cued continuous movement and motor imagery of fists and feet. We quantified instantaneous changes in broadband LRTCs by detrended fluctuation analysis on single trial 2 s EEG sliding windows. The broadband LRTC increased significantly (p < 0.05) during all motor tasks as compared to the resting state. In contrast, the alpha oscillation LRTC, which had to be computed on longer stitched EEG segments, decreased significantly (p < 0.05) consistently with the literature. This suggests the complementarity of underlying fast and slow neuronal scale-free dynamics during movement and motor imagery. The single trial broadband LRTC gave high average binary classification accuracy in the range of 70.54±10.03% to 76.07±6.40% for all motor execution and imagery tasks and hence can be used in brain-computer interface (BCI). Thus, we demonstrate generalizability, robustness, and reproducibility of novel motor neural correlate, the single trial broadband LRTC, during different motor execution and imagery tasks in single asynchronous and cued continuous motor-BCI paradigms and its contrasting behavior with LRTC in alpha oscillation amplitude.

Robotic Telemedicine for Mental Health: A Multimodal Approach to Improve Human-Robot Engagement.

COVID-19 has severely impacted mental health in vulnerable demographics, in particular older adults, who face unprecedented isolation. Consequences, while globally severe, are acutely pronounced in low- and middle-income countries (LMICs) confronting pronounced gaps in resources and clinician accessibility. Social robots are well-recognized for their potential to support mental health, yet user compliance (i.e., trust) demands seamless affective human-robot interactions; natural 'human-like' conversations are required in simple, inexpensive, deployable platforms. We present the design, development, and pilot testing of a multimodal robotic framework fusing verbal (contextual speech) and nonverbal (facial expressions) social cues, aimed to improve engagement in human-robot interaction and ultimately facilitate mental health telemedicine during and beyond the COVID-19 pandemic. We report the design optimization of a hybrid face robot, which combines digital facial expressions based on mathematical affect space mapping with static 3D facial features. We further introduce a contextual virtual assistant with integrated cloud-based AI coupled to the robot's facial representation of emotions, such that the robot adapts its emotional response to users' speech in real-time. Experiments with healthy participants demonstrate emotion recognition exceeding 90% for happy, tired, sad, angry, surprised and stern/disgusted robotic emotions. When separated, stern and disgusted are occasionally transposed (70%+ accuracy overall) but are easily distinguishable from other emotions. A qualitative user experience analysis indicates overall enthusiastic and engaging reception to human-robot multimodal interaction with the new framework. The robot has been modified to enable clinical telemedicine for cognitive engagement with older adults and people with dementia (PwD) in LMICs. The mechanically simple and low-cost social robot has been deployed in pilot tests to support older individuals and PwD at the Schizophrenia Research Foundation (SCARF) in Chennai, India. A procedure for deployment addressing challenges in cultural acceptance, end-user acclimatization and resource allocation is further introduced. Results indicate strong promise to stimulate human-robot psychosocial interaction through the hybrid-face robotic system. Future work is targeting deployment for telemedicine to mitigate the mental health impact of COVID-19 on older adults and PwD in both LMICs and higher income regions.

Modeling the Ongoing Dynamics of Short and Long-Range Temporal Correlations in Broadband EEG During Movement.

Electroencephalogram (EEG) undergoes complex temporal and spectral changes during voluntary movement intention. Characterization of such changes has focused mostly on narrowband spectral processes such as Event-Related Desynchronization (ERD) in the sensorimotor rhythms because EEG is mostly considered as emerging from oscillations of the neuronal populations. However, the changes in the temporal dynamics, especially in the broadband arrhythmic EEG have not been investigated for movement intention detection. The Long-Range Temporal Correlations (LRTC) are ubiquitously present in several neuronal processes, typically requiring longer timescales to detect. In this paper, we study the ongoing changes in the dynamics of long- as well as short-range temporal dependencies in the single trial broadband EEG during movement intention. We obtained LRTC in 2 s windows of broadband EEG and modeled it using the Autoregressive Fractionally Integrated Moving Average (ARFIMA) model which allowed simultaneous modeling of short- and long-range temporal correlations. There were significant (p < 0.05) changes in both broadband long- and short-range temporal correlations during movement intention and execution. We discovered that the broadband LRTC and narrowband ERD are complementary processes providing distinct information about movement because eliminating LRTC from the signal did not affect the ERD and conversely, eliminating ERD from the signal did not affect LRTC. Exploring the possibility of applications in Brain Computer Interfaces (BCI), we used hybrid features with combinations of LRTC, ARFIMA, and ERD to detect movement intention. A significantly higher (p < 0.05) classification accuracy of 88.3 ± 4.2% was obtained using the combination of ARFIMA and ERD features together, which also predicted the earliest movement at 1 s before its onset. The ongoing changes in the long- and short-range temporal correlations in broadband EEG contribute to effectively capturing the motor command generation and can be used to detect movement successfully. These temporal dependencies provide different and additional information about the movement.

Exploration of neural correlates of movement intention based on characterisation of temporal dependencies in electroencephalography.

Brain computer interfaces (BCIs) provide a direct communication channel by using brain signals, enabling patients with motor impairments to interact with external devices. Motion intention detection is useful for intuitive movement-based BCI as movement is the fundamental mode of interaction with the environment. The aim of this paper is to investigate the temporal dynamics of brain processes using electroencephalography (EEG) to explore novel neural correlates of motion intention. We investigate the changes in temporal dependencies of the EEG by characterising the decay of autocorrelation during asynchronous voluntary finger tapping movement. The evolution of the autocorrelation function is characterised by its relaxation time, which is used as a robust marker for motion intention. We observed that there was reorganisation of temporal dependencies in EEG during motion intention. The autocorrelation decayed slower during movement intention and faster during the resting state. There was an increase in temporal dependence during movement intention. The relaxation time of the autocorrelation function showed significant (p < 0.05) discrimination between movement and resting state with the mean sensitivity of 78.37 ± 8.83%. The relaxation time provides movement related information that is complementary to the well-known event-related desynchronisation (ERD) by characterising the broad band EEG dynamics which is frequency independent in contrast to ERD. It can also detect motion intention on average 0.51s before the actual movement onset. We have thoroughly compared autocorrelation relaxation time features with ERD in four frequency bands. The relaxation time may therefore, complement the well-known features used in motion-based BCI leading to more robust and intuitive BCI solutions. The results obtained suggest that changes in autocorrelation decay may involve reorganisation of temporal dependencies of brain activity over longer duration during motion intention. This opens the possibilities of investigating further the temporal dynamics of fundamental neural processes underpinning motion intention.

MaLT - Combined Motor and Language Therapy Tool for Brain Injury Patients Using Kinect.

BACKGROUND: The functional connectivity and structural proximity of elements of the language and motor systems result in frequent co-morbidity post brain injury. Although rehabilitation services are becoming increasingly multidisciplinary and "integrated", treatment for language and motor functions often occurs in isolation. Thus, behavioural therapies which promote neural reorganisation do not reflect the high intersystem connectivity of the neurologically intact brain. As such, there is a pressing need for rehabilitation tools which better reflect and target the impaired cognitive networks. OBJECTIVES: The objective of this research is to develop a combined high dosage therapy tool for language and motor rehabilitation. The rehabilitation therapy tool developed, MaLT (Motor and Language Therapy), comprises a suite of computer games targeting both language and motor therapy that use the Kinect sensor as an interaction device. The games developed are intended for use in the home environment over prolonged periods of time. In order to track patients' engagement with the games and their rehabilitation progress, the game records patient performance data for the therapist to interrogate. METHODS: MaLT incorporates Kinect-based games, a database of objects and language parameters, and a reporting tool for therapists. Games have been developed that target four major language therapy tasks involving single word comprehension, initial phoneme identification, rhyme identification and a naming task. These tasks have 8 levels each increasing in difficulty. A database of 750 objects is used to programmatically generate appropriate questions for the game, providing both targeted therapy and unique gameplay every time. The design of the games has been informed by therapists and by discussions with a Public Patient Involvement (PPI) group. RESULTS: Pilot MaLT trials have been conducted with three stroke survivors for the duration of 6 to 8 weeks. Patients' performance is monitored through MaLT's reporting facility presented as graphs plotted from patient game data. Performance indicators include reaction time, accuracy, number of incorrect responses and hand use. The resultant games have also been tested by the PPI with a positive response and further suggestions for future modifications made. CONCLUSION: MaLT provides a tool that innovatively combines motor and language therapy for high dosage rehabilitation in the home. It has demonstrated that motion sensor technology can be successfully combined with a language therapy task to target both upper limb and linguistic impairment in patients following brain injury. The initial studies on stroke survivors have demonstrated that the combined therapy approach is viable and the outputs of this study will inform planned larger scale future trials.