Deep Learning for hand tracking in Parkinson's Disease video-based assessment: Current and future perspectives.

BACKGROUND: Parkinson's Disease (PD) demands early diagnosis and frequent assessment of symptoms. In particular, analysing hand movements is pivotal to understand disease progression. Advancements in hand tracking using Deep Learning (DL) allow for the automatic and objective disease evaluation from video recordings of standardised motor tasks, which are the foundation of neurological examinations. In view of this scenario, this narrative review aims to describe the state of the art and the future perspective of DL frameworks for hand tracking in video-based PD assessment. METHODS: A rigorous search of PubMed, Web of Science, IEEE Explorer, and Scopus until October 2023 using primary keywords such as parkinson, hand tracking, and deep learning was performed to select eligible by focusing on video-based PD assessment through DL-driven hand tracking frameworks RESULTS:: After accurate screening, 23 publications met the selection criteria. These studies used various solutions, from well-established pose estimation frameworks, like OpenPose and MediaPipe, to custom deep architectures designed to accurately track hand and finger movements and extract relevant disease features. Estimated hand tracking data were then used to differentiate PD patients from healthy individuals, characterise symptoms such as tremors and bradykinesia, or regress the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) by automatically assessing clinical tasks such as finger tapping, hand movements, and pronation-supination. CONCLUSIONS: DL-driven hand tracking holds promise for PD assessment, offering precise, objective measurements for early diagnosis and monitoring, especially in a telemedicine scenario. However, to ensure clinical acceptance, standardisation and validation are crucial. Future research should prioritise large open datasets, rigorous validation on patients, and the investigation of new frontiers such as tracking hand-hand and hand-object interactions for daily-life tasks assessment.

Exergames as a rehabilitation tool to enhance the upper limbs functionality and performance in chronic stroke survivors: a preliminary study.

Introduction: Post-stroke hemiplegia commonly occurs in stroke survivors, negatively impacting the quality of life. Despite the benefits of initial specific post-acute treatments at the hospitals, motor functions, and physical mobility need to be constantly stimulated to avoid regression and subsequent hospitalizations for further rehabilitation treatments. Method: This preliminary study proposes using gamified tasks in a virtual environment to stimulate and maintain upper limb mobility through a single RGB-D camera-based vision system (using Microsoft Azure Kinect DK). This solution is suitable for easy deployment and use in home environments. A cohort of 10 post-stroke subjects attended a 2-week gaming protocol consisting of Lateral Weightlifting (LWL) and Frontal Weightlifting (FWL) gamified tasks and gait as the instrumental evaluation task. Results and discussion: Despite its short duration, there were statistically significant results (p < 0.05) between the baseline (T0) and the end of the protocol (TF) for Berg Balance Scale and Time Up-and-Go (9.8 and -12.3%, respectively). LWL and FWL showed significant results for unilateral executions: rate in FWL had an overall improvement of 38.5% (p < 0.001) and 34.9% (p < 0.01) for the paretic and non-paretic arm, respectively; similarly, rate in LWL improved by 19.9% (p < 0.05) for the paretic arm and 29.9% (p < 0.01) for non-paretic arm. Instead, bilateral executions had significant results for rate and speed: considering FWL, there was an improvement in rate with p < 0.01 (31.7% for paretic arm and 37.4% for non-paretic arm), whereas speed improved by 31.2% (p < 0.05) and 41.7% (p < 0.001) for the paretic and non-paretic arm, respectively; likewise, LWL showed improvement in rate with p < 0.001 (29.0% for paretic arm and 27.8% for non-paretic arm) and in speed with 23.6% (p < 0.05) and 23.5% (p < 0.01) for the paretic and non-paretic arms, respectively. No significant results were recorded for gait task, although an overall good improvement was detected for arm swing asymmetry (-22.6%). Hence, this study suggests the potential benefits of continuous stimulation of upper limb function through gamified exercises and performance monitoring over medium-long periods in the home environment, thus facilitating the patient's general mobility in daily activities.

Correction: Masi et al. Stress and Workload Assessment in Aviation-A Narrative Review. Sensors 2023, 23, 3556.

The published publication [...].

Neuronal Spike Shapes (NSS): A straightforward approach to investigate heterogeneity in neuronal excitability states.

The mammalian brain exhibits a remarkable diversity of neurons, contributing to its intricate architecture and functional complexity. The analysis of multimodal single-cell datasets enables the investigation of cell types and states heterogeneity. In this study, we introduce the Neuronal Spike Shapes (NSS), a straightforward approach for the exploration of excitability states of neurons based on their Action Potential (AP) waveforms. The NSS method describes the AP waveform based on a triangular representation complemented by a set of derived electrophysiological (EP) features. To support this hypothesis, we validate the proposed approach on two datasets of murine cortical neurons, focusing it on GABAergic neurons. The validation process involves a combination of NSS-based clustering analysis, features exploration, Differential Expression (DE), and Gene Ontology (GO) enrichment analysis. Results show that the NSS-based analysis captures neuronal excitability states that possess biological relevance independently of cell subtype. In particular, Neuronal Spike Shapes (NSS) captures, among others, a well-characterized fast-spiking excitability state, supported by both electrophysiological and transcriptomic validation. Gene Ontology Enrichment Analysis reveals voltage-gated potassium (K+) channels as specific markers of the identified NSS partitions. This finding strongly corroborates the biological relevance of NSS partitions as excitability states, as the expression of voltage-gated K+ channels regulates the hyperpolarization phase of the AP, being directly implicated in the regulation of neuronal excitability.

Stress and Workload Assessment in Aviation-A Narrative Review.

In aviation, any detail can have massive consequences. Among the potential sources of failure, human error is still the most troublesome to handle. Therefore, research concerning the management of mental workload, attention, and stress is of special interest in aviation. Recognizing conditions in which a pilot is over-challenged or cannot act lucidly could avoid serious outcomes. Furthermore, knowing in depth a pilot's neurophysiological and cognitive-behavioral responses could allow for the optimization of equipment and procedures to minimize risk and increase safety. In addition, it could translate into a general enhancement of both the physical and mental well-being of pilots, producing a healthier and more ergonomic work environment. This review brings together literature on the study of stress and workload in the specific case of pilots of both civil and military aircraft. The most common approaches for studying these phenomena in the avionic context are explored in this review, with a focus on objective methodologies (e.g., the collection and analysis of neurophysiological signals). This review aims to identify the pros, cons, and applicability of the various approaches, to enable the design of an optimal protocol for a comprehensive study of these issues.

Usability of the REHOME Solution for the Telerehabilitation in Neurological Diseases: Preliminary Results on Motor and Cognitive Platforms.

The progressive aging of the population and the consequent growth of individuals with neurological diseases and related chronic disabilities, will lead to a general increase in the costs and resources needed to ensure treatment and care services. In this scenario, telemedicine and e-health solutions, including remote monitoring and rehabilitation, are attracting increasing interest as tools to ensure the sustainability of the healthcare system or, at least, to support the burden for health care facilities. Technological advances in recent decades have fostered the development of dedicated and innovative Information and Communication Technology (ICT) based solutions, with the aim of complementing traditional care and treatment services through telemedicine applications that support new patient and disease management strategies. This is the background for the REHOME project, whose technological solution, presented in this paper, integrates innovative methodologies and devices for remote monitoring and rehabilitation of cognitive, motor, and sleep disorders associated with neurological diseases. One of the primary goals of the project is to meet the needs of patients and clinicians, by ensuring continuity of treatment from healthcare facilities to the patient's home. To this end, it is important to ensure the usability of the solution by elderly and pathological individuals. Preliminary results of usability and user experience questionnaires on 70 subjects recruited in three experimental trials are presented here.

Assessment Tasks and Virtual Exergames for Remote Monitoring of Parkinson's Disease: An Integrated Approach Based on Azure Kinect.

Motor impairments are among the most relevant, evident, and disabling symptoms of Parkinson's disease that adversely affect quality of life, resulting in limited autonomy, independence, and safety. Recent studies have demonstrated the benefits of physiotherapy and rehabilitation programs specifically targeted to the needs of Parkinsonian patients in supporting drug treatments and improving motor control and coordination. However, due to the expected increase in patients in the coming years, traditional rehabilitation pathways in healthcare facilities could become unsustainable. Consequently, new strategies are needed, in which technologies play a key role in enabling more frequent, comprehensive, and out-of-hospital follow-up. The paper proposes a vision-based solution using the new Azure Kinect DK sensor to implement an integrated approach for remote assessment, monitoring, and rehabilitation of Parkinsonian patients, exploiting non-invasive 3D tracking of body movements to objectively and automatically characterize both standard evaluative motor tasks and virtual exergames. An experimental test involving 20 parkinsonian subjects and 15 healthy controls was organized. Preliminary results show the system's ability to quantify specific and statistically significant (p < 0.05) features of motor performance, easily monitor changes as the disease progresses over time, and at the same time permit the use of exergames in virtual reality both for training and as a support for motor condition assessment (for example, detecting an average reduction in arm swing asymmetry of about 14% after arm training). The main innovation relies precisely on the integration of evaluative and rehabilitative aspects, which could be used as a closed loop to design new protocols for remote management of patients tailored to their actual conditions.

Evaluation of Arm Swing Features and Asymmetry during Gait in Parkinson's Disease Using the Azure Kinect Sensor.

Arm swinging is a typical feature of human walking: Continuous and rhythmic movement of the upper limbs is important to ensure postural stability and walking efficiency. However, several factors can interfere with arm swings, making walking more risky and unstable: These include aging, neurological diseases, hemiplegia, and other comorbidities that affect motor control and coordination. Objective assessment of arm swings during walking could play a role in preventing adverse consequences, allowing appropriate treatments and rehabilitation protocols to be activated for recovery and improvement. This paper presents a system for gait analysis based on Microsoft Azure Kinect DK sensor and its body-tracking algorithm: It allows noninvasive full-body tracking, thus enabling simultaneous analysis of different aspects of walking, including arm swing characteristics. Sixteen subjects with Parkinson's disease and 13 healthy controls were recruited with the aim of evaluating differences in arm swing features and correlating them with traditional gait parameters. Preliminary results show significant differences between the two groups and a strong correlation between the parameters. The study thus highlights the ability of the proposed system to quantify arm swing features, thus offering a simple tool to provide a more comprehensive gait assessment.

Kinect-Based Assessment of Lower Limbs during Gait in Post-Stroke Hemiplegic Patients: A Narrative Review.

The aim of this review was to present an overview of the state of the art in the use of the Microsoft Kinect camera to assess gait in post-stroke individuals through an analysis of the available literature. In recent years, several studies have explored the potentiality, accuracy, and effectiveness of this 3D optical sensor as an easy-to-use and non-invasive clinical measurement tool for the assessment of gait parameters in several pathologies. Focusing on stroke individuals, some of the available studies aimed to directly assess and characterize their gait patterns. In contrast, other studies focused on the validation of Kinect-based measurements with respect to a gold-standard reference (i.e., optoelectronic systems). However, the nonhomogeneous characteristics of the participants, of the measures, of the methodologies, and of the purposes of the studies make it difficult to adequately compare the results. This leads to uncertainties about the strengths and weaknesses of this technology in this pathological state. The final purpose of this narrative review was to describe and summarize the main features of the available works on gait in the post-stroke population, highlighting similarities and differences in the methodological approach and primary findings, thus facilitating comparisons of the studies as much as possible.

Computation of Gait Parameters in Post Stroke and Parkinson's Disease: A Comparative Study Using RGB-D Sensors and Optoelectronic Systems.

The accurate and reliable assessment of gait parameters is assuming an important role, especially in the perspective of designing new therapeutic and rehabilitation strategies for the remote follow-up of people affected by disabling neurological diseases, including Parkinson's disease and post-stroke injuries, in particular considering how gait represents a fundamental motor activity for the autonomy, domestic or otherwise, and the health of neurological patients. To this end, the study presents an easy-to-use and non-invasive solution, based on a single RGB-D sensor, to estimate specific features of gait patterns on a reduced walking path compatible with the available spaces in domestic settings. Traditional spatio-temporal parameters and features linked to dynamic instability during walking are estimated on a cohort of ten parkinsonian and eleven post-stroke subjects using a custom-written software that works on the result of a body-tracking algorithm. Then, they are compared with the "gold standard" 3D instrumented gait analysis system. The statistical analysis confirms no statistical difference between the two systems. Data also indicate that the RGB-D system is able to estimate features of gait patterns in pathological individuals and differences between them in line with other studies. Although they are preliminary, the results suggest that this solution could be clinically helpful in evolutionary disease monitoring, especially in domestic and unsupervised environments where traditional gait analysis is not usable.

Monitoring of Gait Parameters in Post-Stroke Individuals: A Feasibility Study Using RGB-D Sensors.

Stroke is one of the most significant causes of permanent functional impairment and severe motor disability. Hemiplegia or hemiparesis are common consequences of the acute event, which negatively impacts daily life and requires continuous rehabilitation treatments to favor partial or complete recovery and, consequently, to regain autonomy, independence, and safety in daily activities. Gait impairments are frequent in stroke survivors. The accurate assessment of gait anomalies is therefore crucial and a major focus of neurorehabilitation programs to prevent falls or injuries. This study aims to estimate, using a single RGB-D sensor, gait patterns and parameters on a short walkway. This solution may be suitable for monitoring the improvement or worsening of gait disorders, including in domestic and unsupervised scenarios. For this purpose, some of the most relevant spatiotemporal parameters, estimated by the proposed solution on a cohort of post-stroke individuals, were compared with those estimated by a gold standard system for a simultaneous instrumented 3D gait analysis. Preliminary results indicate good agreement, accuracy, and correlation between the gait parameters estimated by the two systems. This suggests that the proposed solution may be employed as an intermediate tool for gait analysis in environments where gold standard systems are impractical, such as home and ecological settings in real-life contexts.

Final results of the NINFA project: impact of new technologies in the daily life of elderly people.

BACKGROUND: The paper presents the work carried out within NINFA (iNtelligent Integrated Network For Aged people), a project for the wellbeing of the elderly people at home. AIMS: The impact of new technologies on elderly people is evaluated with respect to the three main topics faced by NINFA. METHODS: NINFA was structured into three main topics: (1) active user engagement from the very beginning of the planning stage: the use of specially designed questionnaires to evaluate the acceptability of new technology in general and robot caregiver specifically; (2) assessment of the well-being through non-invasive techniques: natural language processing for language change monitoring in elderly subjects; (3) automated assessment of motor and cognitive functions at home: systems to deliver tests and exergames through user interfaces compliant with elderly subjects. RESULTS: The analysis shows that there is no a priori closure to support the technology, but it must not be invasive and must allow social interactions. The study of speech transcripts shows that a large variations in the number of words used to describe the same situation could be a sign on the onset of cognitive impairments. The specifically designed systems highlight, after the training period, significant improvements in the performances of the participants and a satisfaction with regards to the systems usability. CONCLUSIONS: The outcomes of NINFA project highlight some important aspects of the relationship between elderly people and new technologies concerning: engagement and acceptability, assessment of the wellbeing and of the modifications of motor, cognitive and language functions.

An Integrated Multi-Sensor Approach for the Remote Monitoring of Parkinson's Disease.

The increment of the prevalence of neurological diseases due to the trend in population aging demands for new strategies in disease management. In Parkinson's disease (PD), these strategies should aim at improving diagnosis accuracy and frequency of the clinical follow-up by means of decentralized cost-effective solutions. In this context, a system suitable for the remote monitoring of PD subjects is presented. It consists of the integration of two approaches investigated in our previous works, each one appropriate for the movement analysis of specific parts of the body: low-cost optical devices for the upper limbs and wearable sensors for the lower ones. The system performs the automated assessments of six motor tasks of the unified Parkinson's disease rating scale, and it is equipped with a gesture-based human machine interface designed to facilitate the user interaction and the system management. The usability of the system has been evaluated by means of standard questionnaires, and the accuracy of the automated assessment has been verified experimentally. The results demonstrate that the proposed solution represents a substantial improvement in PD assessment respect to the former two approaches treated separately, and a new example of an accurate, feasible and cost-effective mean for the decentralized management of PD.

Feasibility of Home-Based Automated Assessment of Postural Instability and Lower Limb Impairments in Parkinson's Disease.

A self-managed, home-based system for the automated assessment of a selected set of Parkinson's disease motor symptoms is presented. The system makes use of an optical RGB-Depth device both to implement its gesture-based human computer interface and for the characterization and the evaluation of posture and motor tasks, which are specified according to the Unified Parkinson's Disease Rating Scale (UPDRS). Posture, lower limb movements and postural instability are characterized by kinematic parameters of the patient movement. During an experimental campaign, the performances of patients affected by Parkinson's disease were simultaneously scored by neurologists and analyzed by the system. The sets of parameters which best correlated with the UPDRS scores of subjects' performances were then used to train supervised classifiers for the automated assessment of new instances of the tasks. Results on the system usability and the assessment accuracy, as compared to clinical evaluations, indicate that the system is feasible for an objective and automated assessment of Parkinson's disease at home, and it could be the basis for the development of neuromonitoring and neurorehabilitation applications in a telemedicine framework.

A Self-Managed System for Automated Assessment of UPDRS Upper Limb Tasks in Parkinson's Disease.

A home-based, reliable, objective and automated assessment of motor performance of patients affected by Parkinson's Disease (PD) is important in disease management, both to monitor therapy efficacy and to reduce costs and discomforts. In this context, we have developed a self-managed system for the automated assessment of the PD upper limb motor tasks as specified by the Unified Parkinson's Disease Rating Scale (UPDRS). The system is built around a Human Computer Interface (HCI) based on an optical RGB-Depth device and a replicable software. The HCI accuracy and reliability of the hand tracking compares favorably against consumer hand tracking devices as verified by an optoelectronic system as reference. The interface allows gestural interactions with visual feedback, providing a system management suitable for motor impaired users. The system software characterizes hand movements by kinematic parameters of their trajectories. The correlation between selected parameters and clinical UPDRS scores of patient performance is used to assess new task instances by a machine learning approach based on supervised classifiers. The classifiers have been trained by an experimental campaign on cohorts of PD patients. Experimental results show that automated assessments of the system replicate clinical ones, demonstrating its effectiveness in home monitoring of PD.

A complexity-bounded motion estimation algorithm.

The full search motion estimation algorithm for video coding is a procedure of high computational cost. For this reason, in real-time low-power applications, low-cost motion estimation algorithms are viable solutions. A novel reduced complexity motion estimation algorithm is presented. It conjugates the reduction of computational load with good encoding efficiency. It exploits the past history of the motion field to predict the current motion field. A successive refinement phase gives the final motion field. This approach leads to a sensible reduction in the number of motion vector that have to be tested. The complexity is lower than any other algorithm algorithms known to the authors, in the literature, it is constant as there is no recursivity in the algorithm and independent of any search window area size. Experimental evaluations have shown the robustness of the algorithm when applied on a wide set of video sequences--a good performance compared to other reduced complexity algorithms and negligible loss of efficiency versus the full search algorithm.