Ambient Assisted Living: Scoping Review of Artificial Intelligence Models, Domains, Technology, and Concerns.

BACKGROUND: Ambient assisted living (AAL) is a common name for various artificial intelligence (AI)-infused applications and platforms that support their users in need in multiple activities, from health to daily living. These systems use different approaches to learn about their users and make automated decisions, known as AI models, for personalizing their services and increasing outcomes. Given the numerous systems developed and deployed for people with different needs, health conditions, and dispositions toward the technology, it is critical to obtain clear and comprehensive insights concerning AI models used, along with their domains, technology, and concerns, to identify promising directions for future work. OBJECTIVE: This study aimed to provide a scoping review of the literature on AI models in AAL. In particular, we analyzed specific AI models used in AАL systems, the target domains of the models, the technology using the models, and the major concerns from the end-user perspective. Our goal was to consolidate research on this topic and inform end users, health care professionals and providers, researchers, and practitioners in developing, deploying, and evaluating future intelligent AAL systems. METHODS: This study was conducted as a scoping review to identify, analyze, and extract the relevant literature. It used a natural language processing toolkit to retrieve the article corpus for an efficient and comprehensive automated literature search. Relevant articles were then extracted from the corpus and analyzed manually. This review included 5 digital libraries: IEEE, PubMed, Springer, Elsevier, and MDPI. RESULTS: We included a total of 108 articles. The annual distribution of relevant articles showed a growing trend for all categories from January 2010 to July 2022. The AI models mainly used unsupervised and semisupervised approaches. The leading models are deep learning, natural language processing, instance-based learning, and clustering. Activity assistance and recognition were the most common target domains of the models. Ambient sensing, mobile technology, and robotic devices mainly implemented the models. Older adults were the primary beneficiaries, followed by patients and frail persons of various ages. Availability was a top beneficiary concern. CONCLUSIONS: This study presents the analytical evidence of AI models in AAL and their domains, technologies, beneficiaries, and concerns. Future research on intelligent AAL should involve health care professionals and caregivers as designers and users, comply with health-related regulations, improve transparency and privacy, integrate with health care technological infrastructure, explain their decisions to the users, and establish evaluation metrics and design guidelines. TRIAL REGISTRATION: PROSPERO (International Prospective Register of Systematic Reviews) CRD42022347590; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022347590.

Correction: Ambient Assisted Living: Scoping Review of Artificial Intelligence Models, Domains, Technology, and Concerns.

[This corrects the article DOI: 10.2196/36553.].

GAN-Based Image Colorization for Self-Supervised Visual Feature Learning.

Large-scale labeled datasets are generally necessary for successfully training a deep neural network in the computer vision domain. In order to avoid the costly and tedious work of manually annotating image datasets, self-supervised learning methods have been proposed to learn general visual features automatically. In this paper, we first focus on image colorization with generative adversarial networks (GANs) because of their ability to generate the most realistic colorization results. Then, via transfer learning, we use this as a proxy task for visual understanding. Particularly, we propose to use conditional GANs (cGANs) for image colorization and transfer the gained knowledge to two other downstream tasks, namely, multilabel image classification and semantic segmentation. This is the first time that GANs have been used for self-supervised feature learning through image colorization. Through extensive experiments with the COCO and Pascal datasets, we show an increase of 5% for the classification task and 2.5% for the segmentation task. This demonstrates that image colorization with conditional GANs can boost other downstream tasks' performance without the need for manual annotation.

Development Technologies for the Monitoring of Six-Minute Walk Test: A Systematic Review.

In the pandemic time, the monitoring of the progression of some diseases is affected and rehabilitation is more complicated. Remote monitoring may help solve this problem using mobile devices that embed low-cost sensors, which can help measure different physical parameters. Many tests can be applied remotely, one of which is the six-minute walk test (6MWT). The 6MWT is a sub-maximal exercise test that assesses aerobic capacity and endurance, allowing early detection of emerging medical conditions with changes. This paper presents a systematic review of the use of sensors to measure the different physical parameters during the performance of 6MWT, focusing on various diseases, sensors, and implemented methodologies. It was performed with the PRISMA methodology, where the search was conducted in different databases, including IEEE Xplore, ACM Digital Library, ScienceDirect, and PubMed Central. After filtering the papers related to 6MWT and sensors, we selected 31 papers that were analyzed in more detail. Our analysis discovered that the measurements of 6MWT are primarily performed with inertial and magnetic sensors. Likewise, most research studies related to this test focus on multiple sclerosis and pulmonary diseases.

Can the Eight Hop Test Be Measured with Sensors? A Systematic Review.

Rehabilitation aims to increase the independence and physical function after injury, surgery, or other trauma, so that patients can recover to their previous ability as much as possible. To be able to measure the degree of recovery and impact of the treatment, various functional performance tests are used. The Eight Hop Test is a hop exercise that is directly linked to the rehabilitation of people suffering from tendon and ligament injuries on the lower limb. This paper presents a systematic review on the use of sensors for measuring functional movements during the execution of the Eight Hop Test, focusing primarily on the use of sensors, related diseases, and different methods implemented. Firstly, an automated search was performed on the publication databases: PubMed, Springer, ACM, IEEE Xplore, MDPI, and Elsevier. Secondly, the publications related to the Eight-Hop Test and sensors were filtered according to several search criteria and 15 papers were finally selected to be analyzed in detail. Our analysis found that the Eight Hop Test measurements can be performed with motion, force, and imaging sensors.

Thought on Food: A Systematic Review of Current Approaches and Challenges for Food Intake Detection.

Nowadays, individuals have very stressful lifestyles, affecting their nutritional habits. In the early stages of life, teenagers begin to exhibit bad habits and inadequate nutrition. Likewise, other people with dementia, Alzheimer's disease, or other conditions may not take food or medicine regularly. Therefore, the ability to monitor could be beneficial for them and for the doctors that can analyze the patterns of eating habits and their correlation with overall health. Many sensors help accurately detect food intake episodes, including electrogastrography, cameras, microphones, and inertial sensors. Accurate detection may provide better control to enable healthy nutrition habits. This paper presents a systematic review of the use of technology for food intake detection, focusing on the different sensors and methodologies used. The search was performed with a Natural Language Processing (NLP) framework that helps screen irrelevant studies while following the PRISMA methodology. It automatically searched and filtered the research studies in different databases, including PubMed, Springer, ACM, IEEE Xplore, MDPI, and Elsevier. Then, the manual analysis selected 30 papers based on the results of the framework for further analysis, which support the interest in using sensors for food intake detection and nutrition assessment. The mainly used sensors are cameras, inertial, and acoustic sensors that handle the recognition of food intake episodes with artificial intelligence techniques. This research identifies the most used sensors and data processing methodologies to detect food intake.

Multi-Horizon Air Pollution Forecasting with Deep Neural Networks.

Air pollution is a global problem, especially in urban areas where the population density is very high due to the diverse pollutant sources such as vehicles, industrial plants, buildings, and waste. North Macedonia, as a developing country, has a serious problem with air pollution. The problem is highly present in its capital city, Skopje, where air pollution places it consistently within the top 10 cities in the world during the winter months. In this work, we propose using Recurrent Neural Network (RNN) models with long short-term memory units to predict the level of PM10 particles at 6, 12, and 24 h in the future. We employ historical air quality measurement data from sensors placed at multiple locations in Skopje and meteorological conditions such as temperature and humidity. We compare different deep learning models' performance to an Auto-regressive Integrated Moving Average (ARIMA) model. The obtained results show that the proposed models consistently outperform the baseline model and can be successfully employed for air pollution prediction. Ultimately, we demonstrate that these models can help decision-makers and local authorities better manage the air pollution consequences by taking proactive measures.

A Framework for Malicious Traffic Detection in IoT Healthcare Environment.

The Internet of things (IoT) has emerged as a topic of intense interest among the research and industrial community as it has had a revolutionary impact on human life. The rapid growth of IoT technology has revolutionized human life by inaugurating the concept of smart devices, smart healthcare, smart industry, smart city, smart grid, among others. IoT devices' security has become a serious concern nowadays, especially for the healthcare domain, where recent attacks exposed damaging IoT security vulnerabilities. Traditional network security solutions are well established. However, due to the resource constraint property of IoT devices and the distinct behavior of IoT protocols, the existing security mechanisms cannot be deployed directly for securing the IoT devices and network from the cyber-attacks. To enhance the level of security for IoT, researchers need IoT-specific tools, methods, and datasets. To address the mentioned problem, we provide a framework for developing IoT context-aware security solutions to detect malicious traffic in IoT use cases. The proposed framework consists of a newly created, open-source IoT data generator tool named IoT-Flock. The IoT-Flock tool allows researchers to develop an IoT use-case comprised of both normal and malicious IoT devices and generate traffic. Additionally, the proposed framework provides an open-source utility for converting the captured traffic generated by IoT-Flock into an IoT dataset. Using the proposed framework in this research, we first generated an IoT healthcare dataset which comprises both normal and IoT attack traffic. Afterwards, we applied different machine learning techniques to the generated dataset to detect the cyber-attacks and protect the healthcare system from cyber-attacks. The proposed framework will help in developing the context-aware IoT security solutions, especially for a sensitive use case like IoT healthcare environment.

Towards Detecting Pneumonia Progression in COVID-19 Patients by Monitoring Sleep Disturbance Using Data Streams of Non-Invasive Sensor Networks.

Pneumonia caused by COVID-19 is a severe health risk that sometimes leads to fatal outcomes. Due to constraints in medical care systems, technological solutions should be applied to diagnose, monitor, and alert about the disease's progress for patients receiving care at home. Some sleep disturbances, such as obstructive sleep apnea syndrome, can increase the risk for COVID-19 patients. This paper proposes an approach to evaluating patients' sleep quality with the aim of detecting sleep disturbances caused by pneumonia and other COVID-19-related pathologies. We describe a non-invasive sensor network that is used for sleep monitoring and evaluate the feasibility of an approach for training a machine learning model to detect possible COVID-19-related sleep disturbances. We also discuss a cloud-based approach for the implementation of the proposed system for processing the data streams. Based on the preliminary results, we conclude that sleep disturbances are detectable with affordable and non-invasive sensors.

Experimental Study on Wound Area Measurement with Mobile Devices.

Healthcare treatments might benefit from advances in artificial intelligence and technological equipment such as smartphones and smartwatches. The presence of cameras in these devices with increasingly robust and precise pattern recognition techniques can facilitate the estimation of the wound area and other telemedicine measurements. Currently, telemedicine is vital to the maintenance of the quality of the treatments remotely. This study proposes a method for measuring the wound area with mobile devices. The proposed approach relies on a multi-step process consisting of image capture, conversion to grayscale, blurring, application of a threshold with segmentation, identification of the wound part, dilation and erosion of the detected wound section, identification of accurate data related to the image, and measurement of the wound area. The proposed method was implemented with the OpenCV framework. Thus, it is a solution for healthcare systems by which to investigate and treat people with skin-related diseases. The proof-of-concept was performed with a static dataset of camera images on a desktop computer. After we validated the approach's feasibility, we implemented the method in a mobile application that allows for communication between patients, caregivers, and healthcare professionals.

Mobile 5P-Medicine Approach for Cardiovascular Patients.

Medicine is heading towards personalized care based on individual situations and conditions. With smartphones and increasingly miniaturized wearable devices, the sensors available on these devices can perform long-term continuous monitoring of several user health-related parameters, making them a powerful tool for a new medicine approach for these patients. Our proposed system, described in this article, aims to develop innovative solutions based on artificial intelligence techniques to empower patients with cardiovascular disease. These solutions will realize a novel 5P (Predictive, Preventive, Participatory, Personalized, and Precision) medicine approach by providing patients with personalized plans for treatment and increasing their ability for self-monitoring. Such capabilities will be derived by learning algorithms from physiological data and behavioral information, collected using wearables and smart devices worn by patients with health conditions. Further, developing an innovative system of smart algorithms will also focus on providing monitoring techniques, predicting extreme events, generating alarms with varying health parameters, and offering opportunities to maintain active engagement of patients in the healthcare process by promoting the adoption of healthy behaviors and well-being outcomes. The multiple features of this future system will increase the quality of life for cardiovascular diseases patients and provide seamless contact with a healthcare professional.

An Experimental Study on the Validity and Reliability of a Smartphone Application to Acquire Temporal Variables during the Single Sit-to-Stand Test with Older Adults.

Smartphone sensors have often been proposed as pervasive measurement systems to assess mobility in older adults due to their ease of use and low-cost. This study analyzes a smartphone-based application's validity and reliability to quantify temporal variables during the single sit-to-stand test with institutionalized older adults. Forty older adults (20 women and 20 men; 78.9 ± 8.6 years) volunteered to participate in this study. All participants performed the single sit-to-stand test. Each sit-to-stand repetition was performed after an acoustic signal was emitted by the smartphone app. All data were acquired simultaneously with a smartphone and a digital video camera. The measured temporal variables were stand-up time and total time. The relative reliability and systematic bias inter-device were assessed using the intraclass correlation coefficient (ICC) and Bland-Altman plots. In contrast, absolute reliability was assessed using the standard error of measurement and coefficient of variation (CV). Inter-device concurrent validity was assessed through correlation analysis. The absolute percent error (APE) and the accuracy were also calculated. The results showed excellent reliability (ICC = 0.92-0.97; CV = 1.85-3.03) and very strong relationships inter-devices for the stand-up time (r = 0.94) and the total time (r = 0.98). The APE was lower than 6%, and the accuracy was higher than 94%. Based on our data, the findings suggest that the smartphone application is valid and reliable to collect the stand-up time and total time during the single sit-to-stand test with older adults.

Deep Learning for Feature Extraction in Remote Sensing: A Case-Study of Aerial Scene Classification.

Scene classification relying on images is essential in many systems and applications related to remote sensing. The scientific interest in scene classification from remotely collected images is increasing, and many datasets and algorithms are being developed. The introduction of convolutional neural networks (CNN) and other deep learning techniques contributed to vast improvements in the accuracy of image scene classification in such systems. To classify the scene from areal images, we used a two-stream deep architecture. We performed the first part of the classification, the feature extraction, using pre-trained CNN that extracts deep features of aerial images from different network layers: the average pooling layer or some of the previous convolutional layers. Next, we applied feature concatenation on extracted features from various neural networks, after dimensionality reduction was performed on enormous feature vectors. We experimented extensively with different CNN architectures, to get optimal results. Finally, we used the Support Vector Machine (SVM) for the classification of the concatenated features. The competitiveness of the examined technique was evaluated on two real-world datasets: UC Merced and WHU-RS. The obtained classification accuracies demonstrate that the considered method has competitive results compared to other cutting-edge techniques.

Mobile Computing Technologies for Health and Mobility Assessment: Research Design and Results of the Timed Up and Go Test in Older Adults.

Due to the increasing age of the European population, there is a growing interest in performing research that will aid in the timely and unobtrusive detection of emerging diseases. For such tasks, mobile devices have several sensors, facilitating the acquisition of diverse data. This study focuses on the analysis of the data collected from the mobile devices sensors and a pressure sensor connected to a Bitalino device for the measurement of the Timed-Up and Go test. The data acquisition was performed within different environments from multiple individuals with distinct types of diseases. Then this data was analyzed to estimate the various parameters of the Timed-Up and Go test. Firstly, the pressure sensor is used to extract the reaction and total test time. Secondly, the magnetometer sensors are used to identify the total test time and different parameters related to turning around. Finally, the accelerometer sensor is used to extract the reaction time, total test time, duration of turning around, going time, return time, and many other derived metrics. Our experiments showed that these parameters could be automatically and reliably detected with a mobile device. Moreover, we identified that the time to perform the Timed-Up and Go test increases with age and the presence of diseases related to locomotion.

Literature on Wearable Technology for Connected Health: Scoping Review of Research Trends, Advances, and Barriers.

BACKGROUND: Wearable sensing and information and communication technologies are key enablers driving the transformation of health care delivery toward a new model of connected health (CH) care. The advances in wearable technologies in the last decade are evidenced in a plethora of original articles, patent documentation, and focused systematic reviews. Although technological innovations continuously respond to emerging challenges and technology availability further supports the evolution of CH solutions, the widespread adoption of wearables remains hindered. OBJECTIVE: This study aimed to scope the scientific literature in the field of pervasive wearable health monitoring in the time interval from January 2010 to February 2019 with respect to four important pillars: technology, safety and security, prescriptive insight, and user-related concerns. The purpose of this study was multifold: identification of (1) trends and milestones that have driven research in wearable technology in the last decade, (2) concerns and barriers from technology and user perspective, and (3) trends in the research literature addressing these issues. METHODS: This study followed the scoping review methodology to identify and process the available literature. As the scope surpasses the possibilities of manual search, we relied on the natural language processing tool kit to ensure an efficient and exhaustive search of the literature corpus in three large digital libraries: Institute of Electrical and Electronics Engineers, PubMed, and Springer. The search was based on the keywords and properties to be found in articles using the search engines of the digital libraries. RESULTS: The annual number of publications in all segments of research on wearable technology shows an increasing trend from 2010 to February 2019. The technology-related topics dominated in the number of contributions, followed by research on information delivery, safety, and security, whereas user-related concerns were the topic least addressed. The literature corpus evidences milestones in sensor technology (miniaturization and placement), communication architectures and fifth generation (5G) cellular network technology, data analytics, and evolution of cloud and edge computing architectures. The research lag in battery technology makes energy efficiency a relevant consideration in the design of both sensors and network architectures with computational offloading. The most addressed user-related concerns were (technology) acceptance and privacy, whereas research gaps indicate that more efforts should be invested into formalizing clear use cases with timely and valuable feedback and prescriptive recommendations. CONCLUSIONS: This study confirms that applications of wearable technology in the CH domain are becoming mature and established as a scientific domain. The current research should bring progress to sustainable delivery of valuable recommendations, enforcement of privacy by design, energy-efficient pervasive sensing, seamless monitoring, and low-latency 5G communications. To complement technology achievements, future work involving all stakeholders providing research evidence on improved care pathways and cost-effectiveness of the CH model is needed.

Recognition of Activities of Daily Living Based on Environmental Analyses Using Audio Fingerprinting Techniques: A Systematic Review.

An increase in the accuracy of identification of Activities of Daily Living (ADL) is very important for different goals of Enhanced Living Environments and for Ambient Assisted Living (AAL) tasks. This increase may be achieved through identification of the surrounding environment. Although this is usually used to identify the location, ADL recognition can be improved with the identification of the sound in that particular environment. This paper reviews audio fingerprinting techniques that can be used with the acoustic data acquired from mobile devices. A comprehensive literature search was conducted in order to identify relevant English language works aimed at the identification of the environment of ADLs using data acquired with mobile devices, published between 2002 and 2017. In total, 40 studies were analyzed and selected from 115 citations. The results highlight several audio fingerprinting techniques, including Modified discrete cosine transform (MDCT), Mel-frequency cepstrum coefficients (MFCC), Principal Component Analysis (PCA), Fast Fourier Transform (FFT), Gaussian mixture models (GMM), likelihood estimation, logarithmic moduled complex lapped transform (LMCLT), support vector machine (SVM), constant Q transform (CQT), symmetric pairwise boosting (SPB), Philips robust hash (PRH), linear discriminant analysis (LDA) and discrete cosine transform (DCT).

Sensor-based systems for the measurement of Functional Reach Test results: a systematic review.

The measurement of Functional Reach Test (FRT) is a widely used assessment tool in various fields, including physical therapy, rehabilitation, and geriatrics. This test evaluates a person's balance, mobility, and functional ability to reach forward while maintaining stability. Recently, there has been a growing interest in utilizing sensor-based systems to objectively and accurately measure FRT results. This systematic review was performed in various scientific databases or publishers, including PubMed Central, IEEE Explore, Elsevier, Springer, the Multidisciplinary Digital Publishing Institute (MDPI), and the Association for Computing Machinery (ACM), and considered studies published between January 2017 and October 2022, related to methods for the automation of the measurement of the Functional Reach Test variables and results with sensors. Camera-based devices and motion-based sensors are used for Functional Reach Tests, with statistical models extracting meaningful information. Sensor-based systems offer several advantages over traditional manual measurement techniques, as they can provide objective and precise measurements of the reach distance, quantify postural sway, and capture additional parameters related to the movement.

Ten meter walk test with mobile devices: A dataset with accelerometer, magnetometer, and gyroscope.

This paper presents a dataset related to the performance of the Ten Meter Walking Test, a test to allow locomotor capacity in different research and clinical settings. One of the most important parameters to measure is the gait speed during a path of ten meters. The data available in this dataset consists of accelerometer, magnetometer, and gyroscope data acquired with a mobile device in a waistband. The experiments were performed two times by 109 individuals (30 males and 79 females) in different senior residences in the Fundão municipality (Portugal). The dataset includes 208 samples because the sensors reported some failures. The acquisition of the sensors data allows the creation of a technological method for the automatic measurement of features related to the Ten Meter Walk Test, promoting patient independence in measuring their physical health status.

Advancing methods in big data capture, integration, classification and liberation.

This special issue focuses on the importance of advancing research techniques for managing and analyzing data in today's data-rich landscape. In this editorial, we set the context and invite contributions for a BMC Collection of articles titled 'Advancing methods in data capture, integration, classification and liberation'. The collection emphasizes the need for efficient ways to standardize, cleanse, integrate, enrich, and liberate data, highlighting recent advancements in research methods and industrial technologies that facilitate this. We invite researchers to submit their best work to the collection and to showcase the latest advancements and additions to research techniques.

Mobile and wearable technologies for the analysis of Ten Meter Walk Test: A concise systematic review.

Physical issues started to receive more attention due to the sedentary lifestyle prevalent in modern culture. The Ten Meter Walk Test allows measuring the person's capacity to walk along 10 m and analyzing the advancement of various medical procedures for ailments, including stroke. This systematic review is related to the use of mobile or wearable devices to measure physical parameters while administering the Ten Meter Walk Test for the analysis of the performance of the test. We applied the PRISMA methodology for searching the papers related to the Ten Meter Walk Test. Natural Language Processing (NLP) algorithms were used to automate the screening process. Various papers published in two decades from multiple scientific databases, including IEEE Xplore, Elsevier, Springer, EMBASE, SCOPUS, Multidisciplinary Digital Publishing Institute (MDPI), and PubMed Central were analyzed, focusing on various diseases, devices, features, and methods. The study reveals that chronometer and accelerometer sensors measuring spatiotemporal features are the most pertinent in the Gait characterization of most diseases. Likewise, all studies emphasized the close relation between the quality of the sensor's data obtained and the system's ultimate accuracy. In other words, calibration procedures are needed because of the body part where the sensor is worn and the type of sensor. In addition, using ambient sensors providing kinematic and kinetic features in conjunction with wearable sensors and consistently acquiring walking signals can enhance the system's performance. The most common weaknesses in the analyzed studies are the sample size and the unavailability of continuous monitoring devices for measuring the Ten Meter Walk Test.