Towards PPG-based anger detection for emotion regulation.

BACKGROUND: Anger dyscontrol is a common issue after traumatic brain injury (TBI). With the growth of wearable physiological sensors, there is new potential to facilitate the rehabilitation of such anger in the context of daily life. This potential, however, depends on how well physiological markers can distinguish changing emotional states and for such markers to generalize to real-world settings. Our study explores how wearable photoplethysmography (PPG), one of the most widely available physiological sensors, could be used detect anger within a heterogeneous population. METHODS: This study collected the TRIEP (Toronto Rehabilitation Institute Emotion-Physiology) dataset, which comprised of 32 individuals (10 TBI), exposed to a variety of elicitation material (film, pictures, self-statements, personal recall), over two day sessions. This complex dataset allowed for exploration into how the emotion-PPG relationship varied over changes in individuals, endogenous/exogenous drivers of emotion, and day-to-day differences. A multi-stage analysis was conducted looking at: (1) times-series visual clustering, (2) discriminative time-interval features of anger, and (3) out-of-sample anger classification. RESULTS: Characteristics of PPG are largely dominated by inter-subject (between individuals) differences first, then intra-subject (day-to-day) changes, before differentiation into emotion. Both TBI and non-TBI individuals showed evidence of linear separable features that could differentiate anger from non-anger classes within time-interval analysis. However, what is more challenging is that these separable features for anger have various degrees of stability across individuals and days. CONCLUSION: This work highlights how there are contextual, non-stationary challenges to the emotion-physiology relationship that must be accounted for before emotion regulation technology can perform in real-world scenarios. It also affirms the need for a larger breadth of emotional sampling when building classification models.

Ubiquitous Computing in Sports and Physical Activity-Recent Trends and Developments.

The use of small, interconnected and intelligent tools within the broad framework of pervasive computing for analysis and assessments in sport and physical activity is not a trend in itself but defines a way for information to be handled, processed and utilised: everywhere, at any time. The demand for objective data to support decision making prompted the adoption of wearables that evolve to fulfil the aims of assessing athletes and practitioners as closely as possible with their performance environments. In the present paper, we mention and discuss the advancements in ubiquitous computing in sports and physical activity in the past 5 years. Thus, recent developments in wearable sensors, cloud computing and artificial intelligence tools have been the pillars for a major change in the ways sport-related analyses are performed. The focus of our analysis is wearable technology, computer vision solutions for markerless tracking and their major contribution to the process of acquiring more representative data from uninhibited actions in realistic ecological conditions. We selected relevant literature on the applications of such approaches in various areas of sports and physical activity while outlining some limitations of the present-day data acquisition and data processing practices and the resulting sensors' functionalities, as well as the limitations to the data-driven informed decision making in the current technological and scientific framework. Finally, we hypothesise that a continuous merger of measurement, processing and analysis will lead to the development of more reliable models utilising the advantages of open computing and unrestricted data access and allow for the development of personalised-medicine-type approaches to sport training and performance.

Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances.

Mobile and wearable devices have enabled numerous applications, including activity tracking, wellness monitoring, and human-computer interaction, that measure and improve our daily lives. Many of these applications are made possible by leveraging the rich collection of low-power sensors found in many mobile and wearable devices to perform human activity recognition (HAR). Recently, deep learning has greatly pushed the boundaries of HAR on mobile and wearable devices. This paper systematically categorizes and summarizes existing work that introduces deep learning methods for wearables-based HAR and provides a comprehensive analysis of the current advancements, developing trends, and major challenges. We also present cutting-edge frontiers and future directions for deep learning-based HAR.

A Comprehensive Review of Internet of Things: Technology Stack, Middlewares, and Fog/Edge Computing Interface.

The Internet of Things (IoT) is an extensive network of heterogeneous devices that provides an array of innovative applications and services. IoT networks enable the integration of data and services to seamlessly interconnect the cyber and physical systems. However, the heterogeneity of devices, underlying technologies and lack of standardization pose critical challenges in this domain. On account of these challenges, this research article aims to provide a comprehensive overview of the enabling technologies and standards that build up the IoT technology stack. First, a layered architecture approach is presented where the state-of-the-art research and open challenges are discussed at every layer. Next, this research article focuses on the role of middleware platforms in IoT application development and integration. Furthermore, this article addresses the open challenges and provides comprehensive steps towards IoT stack optimization. Finally, the interfacing of Fog/Edge Networks to IoT technology stack is thoroughly investigated by discussing the current research and open challenges in this domain. The main scope of this study is to provide a comprehensive review into IoT technology (the horizontal fabric), the associated middleware and networks required to build future proof applications (the vertical markets).

Eigenbehaviour as an Indicator of Cognitive Abilities.

With growing use of machine learning algorithms and big data in health applications, digital measures, such as digital biomarkers, have become highly relevant in digital health. In this paper, we focus on one important use case, the long-term continuous monitoring of cognitive ability in older adults. Cognitive ability is a factor both for long-term monitoring of people living alone as well as a relevant outcome in clinical studies. In this work, we propose a new potential digital biomarker for cognitive abilities based on location eigenbehaviour obtained from contactless ambient sensors. Indoor location information obtained from passive infrared sensors is used to build a location matrix covering several weeks of measurement. Based on the eigenvectors of this matrix, the reconstruction error is calculated for various numbers of used eigenvectors. The reconstruction error in turn is used to predict cognitive ability scores collected at baseline, using linear regression. Additionally, classification of normal versus pathological cognition level is performed using a support-vector machine. Prediction performance is strong for high levels of cognitive ability but grows weaker for low levels of cognitive ability. Classification into normal and older adults with mild cognitive impairment, using age and the reconstruction error, shows high discriminative performance with an ROC AUC of 0.94. This is an improvement of 0.08 as compared with a classification with age only. Due to the unobtrusive method of measurement, this potential digital biomarker of cognitive ability can be obtained entirely unobtrusively-it does not impose any patient burden. In conclusion, the usage of the reconstruction error is a strong potential digital biomarker for binary classification and, to a lesser extent, for more detailed prediction of inter-individual differences in cognition.

Using Sensor Graphs for Monitoring the Effect on the Performance of the OTAGO Exercise Program in Older Adults.

The OTAGO exercise program is effective in decreasing the risk for falls of older adults. This research investigated if there is an indication that the OTAGO exercise program has a positive effect on the capacity and as well as on the performance in mobility. We used the data of the 10-months observational OTAGO pilot study with 15 (m = 1, f = 14) (pre-)frail participants aged 84.60 y (SD: 5.57 y). Motion sensors were installed in the flats of the participants and used to monitor their activity as a surrogate variable for performance. We derived a weighted directed multigraph from the physical sensor network, subtracted the weights of one day from a baseline, and used the difference in percent to quantify the change in performance. Least squares was used to compute the overall progress of the intervention (n = 9) and the control group (n = 6). In accordance with previous studies, we found indication for a positive effect of the OTAGO program on the capacity in both groups. Moreover, we found indication that the OTAGO program reduces the decline in performance of older adults in daily living. However, it is too early to conclude causalities from our findings because the data was collected during a pilot study.

An IoT-Enabled Information System for Smart Navigation in Museums.

The Internet of Things (IoT) is a new paradigm that connects objects to provide seamless communication and contextual information to anyone, anywhere, at any time (AAA). These Internet-of-Things-enabled automated objects interact with visitors to present a variety of information during museum navigation and exploration. In this article, a smart navigation and information system (SNIS) prototype for museum navigation and exploration is developed, which delivers an interactive and more exciting museum exploration experience based on the visitor's personal presence. The objects inside a museum share the information that assist and navigate the visitors about the different sections and objects of the museum. The system was deployed inside Chakdara Museum and experimented with 381 users to achieve the results. For results, different users marked the proposed system in terms of parameters such as interesting, reality, ease of use, satisfaction, usefulness, and user friendly. Of these 381 users, 201 marked the system as most interesting, 138 marked most realistic, 121 marked it as easy-in-use, 219 marked it useful, and 210 marked it as user friendly. These statistics prove the efficiency of SNIS and its usefulness in smart cultural heritage, including smart museums, exhibitions and cultural sites.

A DSL-Based Approach for Detecting Activities of Daily Living by Means of the AGGIR Variables.

In this paper, we propose a framework for studying the AGGIR (Autonomie Gérontologique et Groupe Iso Ressources-Autonomy Gerontology Iso-Resources Groups) grid model, with the aim of assessing the level of independence of elderly people in accordance with their capabilities of performing daily activities as well as interacting with their environments. In order to model the Activities of Daily Living (ADL), we extend a previously proposed Domain Specific Language (DSL), by defining new operators to deal with constraints related to time and location of activities and event recognition. The proposed framework aims at providing an analysis tool regarding the performance of elderly/disabled people within a home environment by means of data recovered from sensors using a smart-home simulator environment. We perform an evaluation of our framework in several scenarios, considering five of the AGGIR variables (i.e., feeding, dressing, toileting, elimination, and transfers) as well as health-care devices for tracking the occurrence of elderly activities. The results demonstrate the accuracy of the proposed framework for managing the tracked records correctly and, thus, generate the appropriate event information related to the ADL.

Recognizing Context-Aware Human Sociability Patterns Using Pervasive Monitoring for Supporting Mental Health Professionals.

Traditionally, mental health specialists monitor their patients' social behavior by applying subjective self-report questionnaires in face-to-face meetings. Usually, the application of the self-report questionnaire is limited by cognitive biases (e.g., memory bias and social desirability). As an alternative, we present a solution to detect context-aware sociability patterns and behavioral changes based on social situations inferred from ubiquitous device data. This solution does not focus on the diagnosis of mental states, but works on identifying situations of interest to specialized professionals. The proposed solution consists of an algorithm based on frequent pattern mining and complex event processing to detect periods of the day in which the individual usually socializes. Social routine recognition is performed under different context conditions to differentiate abnormal social behaviors from the variation of usual social habits. The proposed solution also can detect abnormal behavior and routine changes. This solution uses fuzzy logic to model the knowledge of the mental health specialist necessary to identify the occurrence of behavioral change. Evaluation results show that the prediction performance of the identified context-aware sociability patterns has strong positive relation (Pearson's correlation coefficient >70%) with individuals' social routine. Finally, the evaluation conducted recognized that the proposed solution leading to the identification of abnormal social behaviors and social routine changes consistently.

Using Smart City Technology to Make Healthcare Smarter.

Smart cities use information and communication technologies (ICT) to scale services include utilities and transportation to a growing population. In this article we discuss how smart city ICT can also improve healthcare effectiveness and lower healthcare cost for smart city residents. We survey current literature and introduce original research to offer an overview of how smart city infrastructure supports strategic healthcare using both mobile and ambient sensors combined with machine learning. Finally, we consider challenges that will be faced as healthcare providers make use of these opportunities.

Recognition of Sedentary Behavior by Machine Learning Analysis of Wearable Sensors during Activities of Daily Living for Telemedical Assessment of Cardiovascular Risk.

With the recent advancement in wearable computing, sensor technologies, and data processing approaches, it is possible to develop smart clothing that integrates sensors into garments. The main objective of this study was to develop the method of automatic recognition of sedentary behavior related to cardiovascular risk based on quantitative measurement of physical activity. The solution is based on the designed prototype of the smart shirt equipped with a processor, wearable sensors, power supply and telemedical interface. The data derived from wearable sensors were used to create feature vector that consisted of the estimation of the user-specific relative intensity and the variance of filtered accelerometer data. The method was validated using an experimental protocol which was designed to be safe for the elderly and was based on clinically validated short physical performance battery (SPPB) test tasks. To obtain the recognition model six classifiers were examined and compared including Linear Discriminant Analysis, Support Vector Machines, K-Nearest Neighbors, Naive Bayes, Binary Decision Trees and Artificial Neural Networks. The classification models were able to identify the sedentary behavior with an accuracy of 95.00% ± 2.11%. Experimental results suggested that high accuracy can be obtained by estimating sedentary behavior pattern using the smart shirt and machine learning approach. The main advantage of the developed method to continuously monitor patient activities in a free-living environment and could potentially be used for early detection of increased cardiovascular risk.

A High Precision, Wireless Temperature Measurement System for Pervasive Computing Applications.

This paper describes the design and calibration of a highly accurate temperature measurement system for pervasive computing applications. A negative temperature coefficient (NTC) thermistor with high resistance tolerance is interfaced through a conditioning circuit to a 12-bit digital converter of a wireless microcontroller. The system is calibrated to minimize the effect of component uncertainties and achieves an accuracy of ±0.03 °C on average (±0.05 °C in worst cases) in a 5 °C to 45 °C range. The calibration process is based on a continuous temperature sweep, while calibration data are simultaneously logged to reduce the delays and cost of conventional calibration approaches. An uncertainty analysis is performed to support the validity of the reported performance results. The described approach for interfacing the thermistor to the hardware platform can be straightforwardly adjusted for different thermistors, temperature ranges/accuracy levels/resolutions, and voltage ranges. The low power communication combined with the energy consumption optimization adopted enable an operation to be autonomic for several months to years depending on the application's measurement frequency requirements. The system cost is approximately $45 USD in components, while its design and compact size allow its integration with extended monitoring systems in various pervasive computing environments. The system has been thoroughly tested and validated in a field trial concerning a precision agriculture application and is currently used in a health monitoring application.

Ambient Intelligence Environment for Home Cognitive Telerehabilitation.

Higher life expectancy is increasing the number of age-related cognitive impairment cases. It is also relevant, as some authors claim, that physical exercise may be considered as an adjunctive therapy to improve cognition and memory after strokes. Thus, the integration of physical and cognitive therapies could offer potential benefits. In addition, in general these therapies are usually considered boring, so it is important to include some features that improve the motivation of patients. As a result, computer-assisted cognitive rehabilitation systems and serious games for health are more and more present. In order to achieve a continuous, efficient and sustainable rehabilitation of patients, they will have to be carried out as part of the rehabilitation in their own home. However, current home systems lack the therapist's presence, and this leads to two major challenges for such systems. First, they need sensors and actuators that compensate for the absence of the therapist's eyes and hands. Second, the system needs to capture and apply the therapist's expertise. With this aim, and based on our previous proposals, we propose an ambient intelligence environment for cognitive rehabilitation at home, combining physical and cognitive activities, by implementing a Fuzzy Inference System (FIS) that gathers, as far as possible, the knowledge of a rehabilitation expert. Moreover, smart sensors and actuators will attempt to make up for the absence of the therapist. Furthermore, the proposed system will feature a remote monitoring tool, so that the therapist can supervise the patients' exercises. Finally, an evaluation will be presented where experts in the rehabilitation field showed their satisfaction with the proposed system.

vhMentor: An Ontology Supported Mobile Agent System for Pervasive Health Care Monitoring.

Healthcare provision is a set of activities that demands the collaboration of several stakeholders (e.g. physicians, nurses, managers, patients etc.) who hold distinct expertise and responsibilities. In addition, medical knowledge is diversely located and often shared under no central coordination and supervision authority, while medical data flows remain mostly passive regarding the way data is delivered to both clinicians and patients. In this paper, we propose the implementation of a virtual health Mentor (vhMentor) which stands as a dedicated ontology schema and FIPA compliant agent system. Agent technology proves to be ideal for developing healthcare applications due to its distributed operation over systems and data sources of high heterogeneity. Agents are able to perform their tasks by acting pro-actively in order to assist individuals to overcome limitations posed during accessing medical data and executing non-automatic error-prone processes. vhMentor further comprises the Jess rules engine in order to implement reasoning logic. Thus, on the one hand vhMentor is a prototype that fills the gap between healthcare systems and the care provision community, while on the other hand allows the blending of next generation distributed services in healthcare domain.

A Framework for Learning Analytics Using Commodity Wearable Devices.

We advocate for and introduce LEARNSense, a framework for learning analytics using commodity wearable devices to capture learner's physical actions and accordingly infer learner context (e.g., student activities and engagement status in class). Our work is motivated by the observations that: (a) the fine-grained individual-specific learner actions are crucial to understand learners and their context information; (b) sensor data available on the latest wearable devices (e.g., wrist-worn and eye wear devices) can effectively recognize learner actions and help to infer learner context information; (c) the commodity wearable devices that are widely available on the market can provide a hassle-free and non-intrusive solution. Following the above observations and under the proposed framework, we design and implement a sensor-based learner context collector running on the wearable devices. The latest data mining and sensor data processing techniques are employed to detect different types of learner actions and context information. Furthermore, we detail all of the above efforts by offering a novel and exemplary use case: it successfully provides the accurate detection of student actions and infers the student engagement states in class. The specifically designed learner context collector has been implemented on the commodity wrist-worn device. Based on the collected and inferred learner information, the novel intervention and incentivizing feedback are introduced into the system service. Finally, a comprehensive evaluation with the real-world experiments, surveys and interviews demonstrates the effectiveness and impact of the proposed framework and this use case. The F1 score for the student action classification tasks achieve 0.9, and the system can effectively differentiate the defined three learner states. Finally, the survey results show that the learners are satisfied with the use of our system (mean score of 3.7 with a standard deviation of 0.55).

Analyzing Sensor-Based Time Series Data to Track Changes in Physical Activity during Inpatient Rehabilitation.

Time series data collected from sensors can be analyzed to monitor changes in physical activity as an individual makes a substantial lifestyle change, such as recovering from an injury or illness. In an inpatient rehabilitation setting, approaches to detect and explain changes in longitudinal physical activity data collected from wearable sensors can provide value as a monitoring, research, and motivating tool. We adapt and expand our Physical Activity Change Detection (PACD) approach to analyze changes in patient activity in such a setting. We use Fitbit Charge Heart Rate devices with two separate populations to continuously record data to evaluate PACD, nine participants in a hospitalized inpatient rehabilitation group and eight in a healthy control group. We apply PACD to minute-by-minute Fitbit data to quantify changes within and between the groups. The inpatient rehabilitation group exhibited greater variability in change throughout inpatient rehabilitation for both step count and heart rate, with the greatest change occurring at the end of the inpatient hospital stay, which exceeded day-to-day changes of the control group. Our additions to PACD support effective change analysis of wearable sensor data collected in an inpatient rehabilitation setting and provide insight to patients, clinicians, and researchers.

Collegial Activity Learning between Heterogeneous Sensors.

Activity recognition algorithms have matured and become more ubiquitous in recent years. However, these algorithms are typically customized for a particular sensor platform. In this paper we introduce PECO, a Personalized activity ECOsystem, that transfers learned activity information seamlessly between sensor platforms in real time so that any available sensor can continue to track activities without requiring its own extensive labeled training data. We introduce a multi-view transfer learning algorithm that facilitates this information handoff between sensor platforms and provide theoretical performance bounds for the algorithm. In addition, we empirically evaluate PECO using datasets that utilize heterogeneous sensor platforms to perform activity recognition. These results indicate that not only can activity recognition algorithms transfer important information to new sensor platforms, but any number of platforms can work together as colleagues to boost performance.

Detection of Gestures Associated With Medication Adherence Using Smartwatch-Based Inertial Sensors.

Poor adherence to prescription medication can compromise treatment effectiveness and cost the billions of dollars in unnecessary health care expenses. Though various interventions have been proposed for estimating adherence rates, few have been shown to be effective. Digital systems are capable of estimating adherence without extensive user involvement and can potentially provide higher accuracy with lower user burden than manual methods. In this paper, we propose a smartwatch-based system for detecting several motions that may be predictors of medication adherence, using built-in triaxial accelerometers and gyroscopes. The efficacy of the proposed technique is confirmed through a survey of medication ingestion habits and experimental results on movement classification.

One-Time URL: A Proximity Security Mechanism between Internet of Things and Mobile Devices.

The aim of this paper is to determine the physical proximity of connected things when they are accessed from a smartphone. Links between connected things and mobile communication devices are temporarily created by means of dynamic URLs (uniform resource locators) which may be easily discovered with pervasive short-range radio frequency technologies available on smartphones. In addition, a multi cross domain silent logging mechanism to allow people to interact with their surrounding connected things from their mobile communication devices is presented. The proposed mechanisms are based in web standards technologies, evolving our social network of Internet of Things towards the so-called Web of Things.

Sensing Home: A Cost-Effective Design for Smart Home via Heterogeneous Wireless Networks.

The aging population has inspired the marketing of advanced real time devices for home health care, more and more wearable devices and mobile applications, which have emerged in this field. However, to properly collect behavior information, accurately recognize human activities, and deploy the whole system in a real living environment is a challenging task. In this paper, we propose a feasible wireless-based solution to deploy a data collection scheme, activity recognition model, feedback control and mobile integration via heterogeneous networks. We compared and found a suitable algorithm that can be run on cost-efficient embedded devices. Specifically, we use the Super Set Transformation method to map the raw data into a sparse binary matrix. Furthermore, designed front-end devices of low power consumption gather the living data of the habitant via ZigBee to reduce the burden of wiring work. Finally, we evaluated our approach and show it can achieve a theoretical time-slice accuracy of 98%. The mapping solution we propose is compatible with more wearable devices and mobile apps.