CUSCO: An Unobtrusive Custom Secure Audio-Visual Recording System for Ambient Assisted Living.

The ubiquity of digital technology has facilitated detailed recording of human behaviour. Ambient technology has been used to capture behaviours in a broad range of applications ranging from healthcare and monitoring to assessment of cooperative work. However, existing systems often face challenges in terms of autonomy, usability, and privacy. This paper presents a portable, easy-to-use and privacy-preserving system for capturing behavioural signals unobtrusively in home or in office settings. The system focuses on the capture of audio, video, and depth imaging. It is based on a device built on a small-factor platform that incorporates ambient sensors which can be integrated with the audio and depth video hardware for multimodal behaviour tracking. The system can be accessed remotely and integrated into a network of sensors. Data are encrypted in real time to ensure safety and privacy. We illustrate uses of the device in two different settings, namely, a healthy-ageing IoT application, where the device is used in conjunction with a range of IoT sensors to monitor an older person's mental well-being at home, and a healthcare communication quality assessment application, where the device is used to capture a patient-clinician interaction for consultation quality appraisal. CUSCO can automatically detect active speakers, extract acoustic features, record video and depth streams, and recognise emotions and cognitive impairment with promising accuracy.

Detection of Anomalies in Daily Activities Using Data from Smart Meters.

The massive deployment of smart meters in most Western countries in recent decades has allowed the creation and development of a significant variety of applications, mainly related to efficient energy management. The information provided about energy consumption has also been dedicated to the areas of social work and health. In this context, smart meters are considered single-point non-intrusive sensors that might be used to monitor the behaviour and activity patterns of people living in a household. This work describes the design of a short-term behavioural alarm generator based on the processing of energy consumption data coming from a commercial smart meter. The device captured data from a household for a period of six months, thus providing the consumption disaggregated per appliance at an interval of one hour. These data were used to train different intelligent systems, capable of estimating the predicted consumption for the next one-hour interval. Four different approaches have been considered and compared when designing the prediction system: a recurrent neural network, a convolutional neural network, a random forest, and a decision tree. By statistically analysing these predictions and the actual final energy consumption measurements, anomalies can be detected in the undertaking of three different daily activities: sleeping, breakfast, and lunch. The recurrent neural network achieves an F1-score of 0.8 in the detection of these anomalies for the household under analysis, outperforming other approaches. The proposal might be applied to the generation of a short-term alarm, which can be involved in future deployments and developments in the field of ambient assisted living.

Healthy and Happy? An Ethical Investigation of Emotion Recognition and Regulation Technologies (ERR) within Ambient Assisted Living (AAL).

Ambient Assisted Living (AAL) refers to technologies that track daily activities of persons in need of care to enhance their autonomy and minimise their need for assistance. New technological developments show an increasing effort to integrate automated emotion recognition and regulation (ERR) into AAL systems. These technologies aim to recognise emotions via different sensors and, eventually, to regulate emotions defined as "negative" via different forms of intervention. Although these technologies are already implemented in other areas, AAL stands out by its tendency to enable an inconspicuous 24-hour surveillance in the private living space of users who rely on the technology to maintain a certain degree of independence in their daily activities. The combination of both technologies represents a new dimension of emotion recognition in a potentially vulnerable group of users. Our paper aims to provide an ethical contextualisation of the novel combination of both technologies. We discuss different concepts of emotions, namely Basic Emotion Theory (BET) and the Circumplex Model of Affect (CMA), that form the basis of ERR and provide an overview over the current technological developments in AAL. We highlight four ethical issues that specifically arise in the context of ERR in AAL systems, namely concerns regarding (1) the reductionist view of emotions, (2) solutionism as an underlying assumption of these technologies, (3) the privacy and autonomy of users and their emotions, (4) the tendency of machine learning techniques to normalise and generalise human behaviour and emotional reactions.

Ambient assisted living systems for falls monitoring at home.

INTRODUCTION: Monitoring systems at home are critical in the event of a fall, and can range from standalone fall detection devices to activity recognition devices that aim to identify behaviors in which the user may be at risk of falling, or to detect falls in real-time and alert emergency personnel. AREAS COVERED: This review analyzes the current literature concerning the different devices available for home fall detection. EXPERT OPINION: Included studies highlight how fall detection at home is an important challenge both from a clinical-assistance point of view and from a technical-bioengineering point of view. There are wearable, non-wearable and hybrid systems that aim to detect falls that occur in the patient's home. In the near future, a greater probability of predicting falls is expected thanks to an improvement in technologies together with the prediction ability of machine learning algorithms. Fall prevention must involve the clinician with a person-centered approach, low cost and minimally invasive technologies able to evaluate the movement of patients and machine learning algorithms able to make an accurate prediction of the fall event.

Eyes on privacy: acceptance of video-based AAL impacted by activities being filmed.

Introduction: The use of video-based ambient assisted living (AAL) technologies represents an innovative approach to supporting older adults living as independently and autonomously as possible in their homes. These visual devices have the potential to increase security, perceived safety, and relief for families and caregivers by detecting, among others, emergencies or serious health situations. Despite these potentials and advantages, using video-based technologies for monitoring different activities in everyday life evokes concerns about privacy intrusion and data security. For a sustainable design and adoption of such technical innovations, a detailed analysis of future users' acceptance, including perceived benefits and barriers is required and possible effects and privacy needs of different activities being filmed should be taken into account. Methods: Therefore, the present study investigated the acceptance and benefit-barrier-perception of using video-based AAL technologies for different activities of daily living based on a scenario-based online survey (N = 146). Results: In the first step, the results identified distinct evaluation patterns for 25 activities of daily living with very high (e.g., changing clothes, showering) and very low privacy needs (e.g., gardening, eating, and drinking). In a second step, three exemplary activity types were compared regarding acceptance, perceived benefits, and barriers. The acceptance and the perceived benefits of using video-based AAL technologies revealed to be higher in household and social activities compared to intimate activities. The strongest barrier perception was found for intimate activities and mainly regarded privacy concerns. Discussion: The results can be used to derive design and information recommendations for the conception, development, and communication of video-based AAL technologies in order to meet the requirements and needs of future users.

Light as a Possible Guidance in the Toilet Room from the View of Dementia Experts.

Digital assistants and guidance systems may support persons with dementia (PwD) during the independent use of the toilet room. The paper investigates the possible use of different light sources to provide visual stimuli for guidance. Demonstrators were presented to dementia experts to gather their views. While there is no evidence yet, it can be concluded that light stimuli in the toilet environment could be a (maybe only additional) option for guidance to be further investigated. The different methods must be always adapted to the local situation and the individual user characteristics.

A Decision-Aware Ambient Assisted Living System with IoT Embedded Device for In-Home Monitoring of Older Adults.

Older adults' independent life is compromised due to various problems, such as memory impairments and decision-making difficulties. This work initially proposes an integrated conceptual model for assisted living systems capable of providing helping means for older adults with mild memory impairments and their caregivers. The proposed model has four main components: (1) an indoor location and heading measurement unit in the local fog layer, (2) an augmented reality (AR) application to make interactions with the user, (3) an IoT-based fuzzy decision-making system to handle the direct and environmental interactions with the user, and (4) a user interface for caregivers to monitor the situation in real time and send reminders once required. Then, a preliminary proof-of-concept implementation is performed to evaluate the suggested mode's feasibility. Functional experiments are carried out based on various factual scenarios, which validate the effectiveness of the proposed approach. The accuracy and response time of the proposed proof-of-concept system are further examined. The results suggest that implementing such a system is feasible and has the potential to promote assisted living. The suggested system has the potential to promote scalable and customizable assisted living systems to reduce the challenges of independent living for older adults.

Barriers and Facilitators of Ambient Assisted Living Systems: A Systematic Literature Review.

Ambient Assisted Living Systems (AALSs) use information and communication technologies to support care for the growing population of older adults. AALSs focus on providing multidimensional support to families, primary care facilities, and patients to improve the quality of life of the elderly. The literature has studied the qualities of AALSs from different perspectives; however, there has been little discussion regarding the operational experience of developing and deploying such systems. This paper presents a literature review based on the PRISMA methodology regarding operational facilitators and barriers of AALSs. This study identified 750 papers, of which 61 were selected. The results indicated that the selected studies mentioned more barriers than facilitators. Both barriers and facilitators concentrate on aspects of developing and configuring the technological infrastructure of AALSs. This study organizes and describes the current literature on the challenges and opportunities regarding the operation of AALSs in practice, which translates into support for practitioners when developing and deploying AALSs.

A Graph-Attention-Based Method for Single-Resident Daily Activity Recognition in Smart Homes.

In ambient-assisted living facilitated by smart home systems, the recognition of daily human activities is of great importance. It aims to infer the household's daily activities from the triggered sensor observation sequences with varying time intervals among successive readouts. This paper introduces a novel deep learning framework based on embedding technology and graph attention networks, namely the time-oriented and location-oriented graph attention (TLGAT) networks. The embedding technology converts sensor observations into corresponding feature vectors. Afterward, TLGAT provides a sensor observation sequence as a fully connected graph to the model's temporal correlation as well as the sensor's location correlation among sensor observations and facilitates the feature representation of each sensor observation through receiving other sensor observations and weighting operations. The experiments were conducted on two public datasets, based on the diverse setups of sensor event sequence length. The experimental results revealed that the proposed method achieved favorable performance under diverse setups.

Ambient intelligence-based multimodal human action recognition for autonomous systems.

Human activity recognition can deduce the behaviour of one or more people from a set of sensor measurements. Despite its widespread applications in monitoring activities, robotics, and visual surveillance, accurate, meticulous, precise and efficient human action recognition remains a challenging research area. As human beings are moving towards the establishment of a smarter planet, human action recognition using ambient intelligence has become an area of huge potential. This work presents a method based on Bi-Convolutional Recurrent Neural Network (Bi-CRNN) -based Feature Extraction and then Random Forest classification for achieving outcomes utilizing Ambient Intelligence that are at the cutting edge of human action recognition for Autonomous Robots. The auto fusion technique used has improved fusion for utilizing and processing data from various sensors. This paper has drawn comparisons with already existing algorithms for Human Action Recognition (HAR) and tried to propose a heuristic and constructive hybrid deep learning-based algorithm with an accuracy of 94.7%.

Ambient intelligence-based monitoring of staff and patient activity in the intensive care unit.

BACKGROUND: Caregiver workload in the ICU setting is difficult to numerically quantify. Ambient Intelligence utilises computer vision-guided neural networks to continuously monitor multiple datapoints in video feeds, has become increasingly efficient at automatically tracking various aspects of human movement. OBJECTIVES: To assess the feasibility of using Ambient Intelligence to track and quantify allpatient and caregiver activity within a bedspace over the course of an ICU admission and also to establish patient specific factors, and environmental factors such as time ofday, that might contribute to an increased workload in ICU workers. METHODS: 5000 images were manually annotated and then used to train You Only LookOnce (YOLOv4), an open-source computer vision algorithm. Comparison of patientmotion and caregiver activity was then performed between these patients. RESULTS: The algorithm was deployed on 14 patients comprising 1762800 framesof new, untrained data. There was a strong correlation between the number ofcaregivers in the room and the standardized movement of the patient (p < 0.0001) withmore caregivers associated with more movement. There was a significant difference incaregiver activity throughout the day (p < 0.05), HDU vs. ICU status (p < 0.05), delirious vs. non delirious patients (p < 0.05), and intubated vs. not intubated patients(p < 0.05). Caregiver activity was lowest between 0400 and 0800 (average .71 ± .026caregivers per hour) with statistically significant differences in activity compared to 0800-2400 (p < 0.05). Caregiver activity was highest between 1200 and 1600 (1.02 ± .031 caregivers per hour) with a statistically significant difference in activity comparedto activity from 1600 to 0800 (p < 0.05). The three most dominant predictors of workeractivity were patient motion (Standardized Dominance 78.6%), Mechanical Ventilation(Standardized Dominance 7.9%) and Delirium (Standardized Dominance 6.2%). CONCLUSION: Ambient Intelligence could potentially be used to derive a single standardized metricthat could be applied to patients to illustrate their overall workload. This could be usedto predict workflow demands for better staff deployment, monitoring of caregiver workload, and potentially as a tool to predict burnout.

Integrating Abnormal Gait Detection with Activities of Daily Living Monitoring in Ambient Assisted Living: A 3D Vision Approach.

Gait analysis plays a crucial role in detecting and monitoring various neurological and musculoskeletal disorders early. This paper presents a comprehensive study of the automatic detection of abnormal gait using 3D vision, with a focus on non-invasive and practical data acquisition methods suitable for everyday environments. We explore various configurations, including multi-camera setups placed at different distances and angles, as well as performing daily activities in different directions. An integral component of our study involves combining gait analysis with the monitoring of activities of daily living (ADLs), given the paramount relevance of this integration in the context of Ambient Assisted Living. To achieve this, we investigate cutting-edge Deep Neural Network approaches, such as the Temporal Convolutional Network, Gated Recurrent Unit, and Long Short-Term Memory Autoencoder. Additionally, we scrutinize different data representation formats, including Euclidean-based representations, angular adjacency matrices, and rotation matrices. Our system's performance evaluation leverages both publicly available datasets and data we collected ourselves while accounting for individual variations and environmental factors. The results underscore the effectiveness of our proposed configurations in accurately classifying abnormal gait, thus shedding light on the optimal setup for non-invasive and efficient data collection.

Delivering Digital Healthcare for Elderly: A Holistic Framework for the Adoption of Ambient Assisted Living.

Adoption of Ambient Assisted Living (AAL) technologies for geriatric healthcare is suboptimal. This study aims to present the AAL Adoption Diamond Framework, encompassing a set of key enablers/barriers as factors, and describe our approach to developing this framework. A systematic literature review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. SCOPUS, IEEE Xplore, PubMed, ProQuest, Science Direct, ACM Digital Library, SpringerLink, Wiley Online Library and grey literature were searched. Thematic analysis was performed to identify factors reported or perceived to be important for adopting AAL technologies. Of 3717 studies initially retrieved, 109 were thoroughly screened and 52 met our inclusion criteria. Nineteen unique technology adoption factors were identified. The most common factor was privacy (50%) whereas data accuracy and affordability were the least common factors (4%). The highest number of factors found per a given study was eleven whereas the average number of factors across all studies included in our sample was four (mean = 3.9). We formed an AAL technology adoption framework based on the retrieved information and named it the AAL Adoption Diamond Framework. This holistic framework was formed by organising the identified technology adoption factors into four key dimensions: Human, Technology, Business, and Organisation. To conclude, the AAL Adoption Diamond Framework is holistic in term of recognizing key factors for the adoption of AAL technologies, and novel and unmatched in term of structuring them into four overarching themes or dimensions, bringing together the individual and the systemic factors evolving around the adoption of AAL technology. This framework is useful for stakeholders (e.g., decision-makers, healthcare providers, and caregivers) to adopt and implement AAL technologies.

Ambient Assisted Living: Scoping Review of Artificial Intelligence Models, Domains, Technology, and Concerns.

BACKGROUND: Ambient assisted living (AAL) is a common name for various artificial intelligence (AI)-infused applications and platforms that support their users in need in multiple activities, from health to daily living. These systems use different approaches to learn about their users and make automated decisions, known as AI models, for personalizing their services and increasing outcomes. Given the numerous systems developed and deployed for people with different needs, health conditions, and dispositions toward the technology, it is critical to obtain clear and comprehensive insights concerning AI models used, along with their domains, technology, and concerns, to identify promising directions for future work. OBJECTIVE: This study aimed to provide a scoping review of the literature on AI models in AAL. In particular, we analyzed specific AI models used in AАL systems, the target domains of the models, the technology using the models, and the major concerns from the end-user perspective. Our goal was to consolidate research on this topic and inform end users, health care professionals and providers, researchers, and practitioners in developing, deploying, and evaluating future intelligent AAL systems. METHODS: This study was conducted as a scoping review to identify, analyze, and extract the relevant literature. It used a natural language processing toolkit to retrieve the article corpus for an efficient and comprehensive automated literature search. Relevant articles were then extracted from the corpus and analyzed manually. This review included 5 digital libraries: IEEE, PubMed, Springer, Elsevier, and MDPI. RESULTS: We included a total of 108 articles. The annual distribution of relevant articles showed a growing trend for all categories from January 2010 to July 2022. The AI models mainly used unsupervised and semisupervised approaches. The leading models are deep learning, natural language processing, instance-based learning, and clustering. Activity assistance and recognition were the most common target domains of the models. Ambient sensing, mobile technology, and robotic devices mainly implemented the models. Older adults were the primary beneficiaries, followed by patients and frail persons of various ages. Availability was a top beneficiary concern. CONCLUSIONS: This study presents the analytical evidence of AI models in AAL and their domains, technologies, beneficiaries, and concerns. Future research on intelligent AAL should involve health care professionals and caregivers as designers and users, comply with health-related regulations, improve transparency and privacy, integrate with health care technological infrastructure, explain their decisions to the users, and establish evaluation metrics and design guidelines. TRIAL REGISTRATION: PROSPERO (International Prospective Register of Systematic Reviews) CRD42022347590; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022347590.

Analyzing technology acceptance and perception of privacy in ambient assisted living for using sensor-based technologies.

People increasingly use various technologies that enable them to ease their everyday lives in different areas. Not only wearable devices are gaining ground, but also sensor-based ambient devices and systems are increasingly perceived as beneficial in supporting users. Especially older and/or frail persons can benefit from the so-called lifelogging technologies assisting the users in different activities and supporting their mobility and autonomy. This paper empirically investigates users' technology acceptance and privacy perceptions related to sensor-based applications implemented in private environments (i.e., passive infrared sensors for presence detection, humidity and temperature sensors for ambient monitoring, magnetic sensors for user-furniture interaction). For this purpose, we designed an online survey entitled "Acceptance and privacy perceptions of sensor-based lifelogging technologies" and collected data from N = 312 German adults. In terms of user acceptance, statistical analyses revealed that participants strongly agree on the benefits of such sensor-based ambient technologies, also perceiving these as useful and easy to use. Nevertheless, their intention to use the sensor-based applications was still rather limited. The evaluation of privacy perceptions showed that participants highly value their privacy and hence require a high degree of protection for their personal data. The potential users assessed the collection of data especially in the most intimate spaces of domestic environments, such as bathrooms and bedrooms, as critical. On the other hand, participants were also willing to provide complete data transparency in case of an acute risk to their health. Our results suggest that users' perceptions of personal privacy largely affect the acceptance and successful adoption of sensor-based lifelogging in home environments.

Stepwise Design and Evaluation of a Values-Oriented Ambient Intelligence Healthcare Monitoring Platform.

OBJECTIVES: The majority of all developed digital health technologies do not reach successful implementation. A discrepancy among technology design, the context of use, and user needs and values is identified as the main reason for this failure. Value-sensitive design (VSD) is a design method enabling to align design with user values by embedding values in technology, yet the method is lacking clear heuristics for practical application. To improve the successful design and implementation of digital health, we propose and evaluate a stepwise approach to VSD. METHODS: The approach consists of the phases: experiment, demonstrate, and validate. Experiment takes place in an office to create makeshift solutions. Demonstrate takes place in a mock-up environment and aims to optimize design requirements through user feedback. The validate phase takes place in an authentic care situation and studies how the novel technology affects current workflows. RESULTS: We applied the stepwise VSD approach to the design of a hospital-based ambient intelligence solution for remotely and continuously monitoring quality and safety of patient care. We particularly focused on embodiment of the values of safety, privacy, and inclusiveness in the design. Design activities of the experiment and demonstrate phase are discussed. CONCLUSIONS: A stepwise approach to VSD enables a design to optimally meet the values of all users involved, while aligning the design process with the practical limitations of healthcare institutions. We discuss some benefits and challenges related to VSD and the potential for transfer of this approach to other digital health solutions.

Framework for Simultaneous Indoor Localization, Mapping, and Human Activity Recognition in Ambient Assisted Living Scenarios.

Indoor localization and human activity recognition are two important sources of information to provide context-based assistance. This information is relevant in ambient assisted living (AAL) scenarios, where older adults usually need supervision and assistance in their daily activities. However, indoor localization and human activity recognition have been mostly considered isolated problems. This work presents and evaluates a framework that takes advantage of the relationship between location and activity to simultaneously perform indoor localization, mapping, and human activity recognition. The proposed framework provides a non-intrusive configuration, which fuses data from an inertial measurement unit (IMU) placed in the person's shoe, with proximity and human activity-related data from Bluetooth low energy beacons (BLE) deployed in the indoor environment. A variant of the simultaneous location and mapping (SLAM) framework was used to fuse the location and human activity recognition (HAR) data. HAR was performed using data streaming algorithms. The framework was evaluated in a pilot study, using data from 22 people, 11 young people, and 11 older adults (people aged 65 years or older). As a result, seven activities of daily living were recognized with an F1 score of 88%, and the in-door location error was 0.98 ± 0.36 m for the young and 1.02 ± 0.24 m for the older adults. Furthermore, there were no significant differences between the groups, indicating that our proposed method works adequately in broad age ranges.

Human Activity Recognition Data Analysis: History, Evolutions, and New Trends.

The Assisted Living Environments Research Area-AAL (Ambient Assisted Living), focuses on generating innovative technology, products, and services to assist, medical care and rehabilitation to older adults, to increase the time in which these people can live. independently, whether they suffer from neurodegenerative diseases or some disability. This important area is responsible for the development of activity recognition systems-ARS (Activity Recognition Systems), which is a valuable tool when it comes to identifying the type of activity carried out by older adults, to provide them with assistance. that allows you to carry out your daily activities with complete normality. This article aims to show the review of the literature and the evolution of the different techniques for processing this type of data from supervised, unsupervised, ensembled learning, deep learning, reinforcement learning, transfer learning, and metaheuristics approach applied to this sector of science. health, showing the metrics of recent experiments for researchers in this area of knowledge. As a result of this article, it can be identified that models based on reinforcement or transfer learning constitute a good line of work for the processing and analysis of human recognition activities.

A Deep Convolutional Neural Network-XGB for Direction and Severity Aware Fall Detection and Activity Recognition.

Activity and Fall detection have been a topic of keen interest in the field of ambient assisted living system research. Such systems make use of different sensing mechanisms to monitor human motion and aim to ascertain the activity being performed for health monitoring and other purposes. Towards this end, in addition to activity recognition, fall detection is an especially important task as falls can lead to injuries and sometimes even death. This work presents a fall detection and activity recognition system that not only considers various activities of daily living but also considers detection of falls while taking into consideration the direction and severity. Inertial Measurement Unit (accelerometer and gyroscope) data from the SisFall dataset is first windowed into non-overlapping segments of duration 3 s. After suitable data augmentation, it is then passed on to a Convolutional Neural Network (CNN) for feature extraction with an eXtreme Gradient Boosting (XGB) last stage for classification into the various output classes. The experiments show that the gradient boosted CNN performs better than other comparable techniques, achieving an unweighted average recall of 88%.

Neural Networks for Automatic Posture Recognition in Ambient-Assisted Living.

Human Action Recognition (HAR) is a rapidly evolving field impacting numerous domains, among which is Ambient Assisted Living (AAL). In such a context, the aim of HAR is meeting the needs of frail individuals, whether elderly and/or disabled and promoting autonomous, safe and secure living. To this goal, we propose a monitoring system detecting dangerous situations by classifying human postures through Artificial Intelligence (AI) solutions. The developed algorithm works on a set of features computed from the skeleton data provided by four Kinect One systems simultaneously recording the scene from different angles and identifying the posture of the subject in an ecological context within each recorded frame. Here, we compare the recognition abilities of Multi-Layer Perceptron (MLP) and Long-Short Term Memory (LSTM) Sequence networks. Starting from the set of previously selected features we performed a further feature selection based on an SVM algorithm for the optimization of the MLP network and used a genetic algorithm for selecting the features for the LSTM sequence model. We then optimized the architecture and hyperparameters of both models before comparing their performances. The best MLP model (3 hidden layers and a Softmax output layer) achieved 78.4%, while the best LSTM (2 bidirectional LSTM layers, 2 dropout and a fully connected layer) reached 85.7%. The analysis of the performances on individual classes highlights the better suitability of the LSTM approach.