Emotional Models for the Estimation of Arousal and Pleasure in Older Adults During Balance Rehabilitation Training.

Emotional computing has been previously applied to assess physiological behavior in a wide variety of tasks and activities. This study extends for the first time the use of emotional computing in the field of balance rehabilitation training. A proof-of-concept study was conducted to assess arousal and pleasure response to a range of physical exercises from the OTAGO and HOLOBALANCE balance rehabilitation programs with varying levels of difficulty and physical demand. Eleven participants were enrolled and performed a set of exercises wearing an ECG sensor, reporting arousal and pleasure at the end of each session. A dataset of 264 unique sessions was collected and used to extract heart rate variability (HRV) features from the measured RR intervals and automatically assess user arousal and pleasure, evaluating different classification algorithms. The results suggested that assessment of both emotions is feasible, reaching an accuracy of 72% and 74% for arousal and pleasure estimation, resnectively. Clinical Relevance- Arousal and pleasure are clinically useful indicators of patient's experience and engagement while performing balance rehabilitation exercises with novel sensing technologies and monitoring platforms.

Automated Assessment of Balance Rehabilitation Exercises With a Data-Driven Scoring Model: Algorithm Development and Validation Study.

BACKGROUND: Balance rehabilitation programs represent the most common treatments for balance disorders. Nonetheless, lack of resources and lack of highly expert physiotherapists are barriers for patients to undergo individualized rehabilitation sessions. Therefore, balance rehabilitation programs are often transferred to the home environment, with a considerable risk of the patient misperforming the exercises or failing to follow the program at all. Holobalance is a persuasive coaching system with the capacity to offer full-scale rehabilitation services at home. Holobalance involves several modules, from rehabilitation program management to augmented reality coach presentation. OBJECTIVE: The aim of this study was to design, implement, test, and evaluate a scoring model for the accurate assessment of balance rehabilitation exercises, based on data-driven techniques. METHODS: The data-driven scoring module is based on an extensive data set (approximately 1300 rehabilitation exercise sessions) collected during the Holobalance pilot study. It can be used as a training and testing data set for training machine learning (ML) models, which can infer the scoring components of all physical rehabilitation exercises. In that direction, for creating the data set, 2 independent experts monitored (in the clinic) 19 patients performing 1313 balance rehabilitation exercises and scored their performance based on a predefined scoring rubric. On the collected data, preprocessing, data cleansing, and normalization techniques were applied before deploying feature selection techniques. Finally, a wide set of ML algorithms, like random forests and neural networks, were used to identify the most suitable model for each scoring component. RESULTS: The results of the trained model improved the performance of the scoring module in terms of more accurate assessment of a performed exercise, when compared with a rule-based scoring model deployed at an early phase of the system (k-statistic value of 15.9% for sitting exercises, 20.8% for standing exercises, and 26.8% for walking exercises). Finally, the resulting performance of the model resembled the threshold of the interobserver variability, enabling trustworthy usage of the scoring module in the closed-loop chain of the Holobalance coaching system. CONCLUSIONS: The proposed set of ML models can effectively score the balance rehabilitation exercises of the Holobalance system. The models had similar accuracy in terms of Cohen kappa analysis, with interobserver variability, enabling the scoring module to infer the score of an exercise based on the collected signals from sensing devices. More specifically, for sitting exercises, the scoring model had high classification accuracy, ranging from 0.86 to 0.90. Similarly, for standing exercises, the classification accuracy ranged from 0.85 to 0.92, while for walking exercises, it ranged from 0.81 to 0.90. TRIAL REGISTRATION: ClinicalTrials.gov NCT04053829; https://clinicaltrials.gov/ct2/show/NCT04053829.

Exploring the Acceptability and Feasibility of Providing a Balance Tele-Rehabilitation Programme to Older Adults at Risk for Falls: An Initial Assessment.

Falls are a major health concern. The HOLOBALANCE tele-rehabilitation system was developed to deliver an evidence based, multi-sensory balance rehabilitation programme, to the elderly at risk of falls. The system delivers a series of balance physiotherapy exercises and cognitive and auditory training tasks prescribed by an expert balance physiotherapist following an initial balance assessment. The HOLOBALANCE system uses augmented reality (AR) to deliver exercises and games, and records task performance via a combination of body worn sensors and a depth camera. The HOLOBALANCE tele-rehabilitation system provides feedback to the supervising clinical team regarding task performance, participant usage and user feedback. Herewith we present the findings from the first 25 study participants regarding the feasibility and acceptability of the proposed system. The results of the clinical study indicate that the system is acceptable by the end users and also feasible for using in hospital and home environments.

Evaluating the Performance of Balance Physiotherapy Exercises Using a Sensory Platform: The Basis for a Persuasive Balance Rehabilitation Virtual Coaching System.

Rehabilitation programs play an important role in improving the quality of life of patients with balance disorders. Such programs are usually executed in a home environment, due to lack of resources. This procedure usually results in poorly performed exercises or even complete drop outs from the programs, as the patients lack guidance and motivation. This paper introduces a novel system for managing balance disorders in a home environment using a virtual coach for guidance, instruction, and inducement. The proposed system comprises sensing devices, augmented reality technology, and intelligent inference agents, which capture, recognize, and evaluate a patient's performance during the execution of exercises. More specifically, this work presents a home-based motion capture and assessment module, which utilizes a sensory platform to recognize an exercise performed by a patient and assess it. The sensory platform comprises IMU sensors (Mbientlab MMR© 9axis), pressure insoles (Moticon©), and a depth RGB camera (Intel D415©). This module is designed to deliver messages both during the performance of the exercise, delivering personalized notifications and alerts to the patient, and after the end of the exercise, scoring the overall performance of the patient. A set of proof of concept validation studies has been deployed, aiming to assess the accuracy of the different components for the sub-modules of the motion capture and assessment module. More specifically, Euler angle calculation algorithm in 2D (R 2 = 0.99) and in 3D (R 2 = 0.82 in yaw plane and R 2 = 0.91 for the pitch plane), as well as head turns speed (R 2 = 0.96), showed good correlation between the calculated and ground truth values provided by experts' annotations. The posture assessment algorithm resulted to accuracy = 0.83, while the gait metrics were validated against two well-established gait analysis systems (R 2 = 0.78 for double support, R 2 = 0.71 for single support, R 2 = 0.80 for step time, R 2 = 0.75 for stride time (WinTrack©), R 2 = 0.82 for cadence, and R 2 = 0.79 for stride time (RehaGait©). Validation results provided evidence that the proposed system can accurately capture and assess a physiotherapy exercise within the balance disorders context, thus providing a robust basis for the virtual coaching ecosystem and thereby improve a patient's commitment to rehabilitation programs while enhancing the quality of the performed exercises. In summary, virtual coaching can improve the quality of the home-based rehabilitation programs as long as it is combined with accurate motion capture and assessment modules, which provides to the virtual coach the capacity to tailor the interaction with the patient and deliver personalized experience.

A Review of Virtual Coaching Systems in Healthcare: Closing the Loop With Real-Time Feedback.

This review focuses on virtual coaching systems that were designed to enhance healthcare interventions, combining the available sensing and system-user interaction technologies. In total, more than 1,200 research papers have been retrieved and evaluated for the purposes of this review, which were obtained from three online databases (i.e.,PubMed, Scopus and IEEE Xplore) using an extensive set of search keywords. After applying exclusion criteria, the remaining 41 research papers were used to evaluate the status of virtual coaching systems over the past 10 years and assess current and future trends in this field. The results suggest that in home coaching systems were mainly focused in promoting physical activity and a healthier lifestyle, while a wider range of medical domains was considered in systems that were evaluated in lab environment. In home patient monitoring with IoT devices and sensors was mostly limited to activity trackers, pedometers and heart rate monitoring. Real-time evaluations and personalized patient feedback was also found to be rather lacking in home coaching systems and this is the most alarming find of this analysis. Feasibility studies in controlled environment and an ongoing active research on Horizon 2020 funded projects, show that the future trends in this field are aiming to close the loop with automated patient monitoring, real-time evaluations and more precise interventions.