Feasibility of a Smartwatch Platform to Assess Ecological Mobility: Real-Time Online Assessment and Mobility Monitor.

BACKGROUND: Early detection of mobility decline is critical to prevent subsequent reductions in quality of life, disability, and mortality. However, traditional approaches to mobility assessment are limited in their ability to capture daily fluctuations that align with sporadic health events. We aim to describe findings from a pilot study of our Real-time Online Assessment and Mobility Monitor (ROAMM) smartwatch application, which uniquely captures multiple streams of data in real time in ecological settings. METHODS: Data come from a sample of 31 participants (Mage = 74.7, 51.6% female) who used ROAMM for approximately 2 weeks. We describe the usability and feasibility of ROAMM, summarize prompt data using descriptive metrics, and compare prompt data with traditional survey-based questionnaires or other established measures. RESULTS: Participants were satisfied with ROAMM's function (87.1%) and ranked the usability as "above average." Most were highly engaged (average adjusted compliance = 70.7%) and the majority reported being "likely" to enroll in a 2-year study (77.4%). Some smartwatch features were correlated with their respective traditional measurements (eg, certain GPS-derived life-space mobility features (r = 0.50-0.51, p < .05) and ecologically measured pain (r = 0.72, p = .01), but others were not (eg, ecologically measured fatigue). CONCLUSIONS: ROAMM was usable, acceptable, and effective at measuring mobility and risk factors for mobility decline in our pilot sample. Additional work with a larger and more diverse sample is necessary to confirm associations between smartwatch-measured features and traditional measures. By monitoring multiple data streams simultaneously in ecological settings, this technology could uniquely contribute to the evolution of mobility measurement and risk factors for mobility loss.

Satisfaction, Usability, and Compliance With the Use of Smartwatches for Ecological Momentary Assessment of Knee Osteoarthritis Symptoms in Older Adults: Usability Study.

BACKGROUND: Smartwatches enable physicians to monitor symptoms in patients with knee osteoarthritis, their behavior, and their environment. Older adults experience fluctuations in their pain and related symptoms (mood, fatigue, and sleep quality) that smartwatches are ideally suited to capture remotely in a convenient manner. OBJECTIVE: The aim of this study was to evaluate satisfaction, usability, and compliance using the real-time, online assessment and mobility monitoring (ROAMM) mobile app designed for smartwatches for individuals with knee osteoarthritis. METHODS: Participants (N=28; mean age 73.2, SD 5.5 years; 70% female) with reported knee osteoarthritis were asked to wear a smartwatch with the ROAMM app installed. They were prompted to report their prior night's sleep quality in the morning, followed by ecological momentary assessments (EMAs) of their pain, fatigue, mood, and activity in the morning, afternoon, and evening. Satisfaction, comfort, and usability were evaluated using a standardized questionnaire. Compliance with regard to answering EMAs was calculated after excluding time when the watch was not being worn for technical reasons (eg, while charging). RESULTS: A majority of participants reported that the text displayed was large enough to read (22/26, 85%), and all participants found it easy to enter ratings using the smartwatch. Approximately half of the participants found the smartwatch to be comfortable (14/26, 54%) and would consider wearing it as their personal watch (11/24, 46%). Most participants were satisfied with its battery charging system (20/26, 77%). A majority of participants (19/26, 73%) expressed their willingness to use the ROAMM app for a 1-year research study. The overall EMA compliance rate was 83% (2505/3036 responses). The compliance rate was lower among those not regularly wearing a wristwatch (10/26, 88% vs 16/26, 71%) and among those who found the text too small to read (4/26, 86% vs 22/26, 60%). CONCLUSIONS: Older adults with knee osteoarthritis positively rated the ROAMM smartwatch app and were generally satisfied with the device. The high compliance rates coupled with the willingness to participate in a long-term study suggest that the ROAMM app is a viable approach to remotely collecting health symptoms and behaviors for both research and clinical endeavors.

The Effect of Sensor Placement and Number on Physical Activity Recognition and Energy Expenditure Estimation in Older Adults: Validation Study.

BACKGROUND: Research has shown the feasibility of human activity recognition using wearable accelerometer devices. Different studies have used varying numbers and placements for data collection using sensors. OBJECTIVE: This study aims to compare accuracy performance between multiple and variable placements of accelerometer devices in categorizing the type of physical activity and corresponding energy expenditure in older adults. METHODS: In total, 93 participants (mean age 72.2 years, SD 7.1) completed a total of 32 activities of daily life in a laboratory setting. Activities were classified as sedentary versus nonsedentary, locomotion versus nonlocomotion, and lifestyle versus nonlifestyle activities (eg, leisure walk vs computer work). A portable metabolic unit was worn during each activity to measure metabolic equivalents (METs). Accelerometers were placed on 5 different body positions: wrist, hip, ankle, upper arm, and thigh. Accelerometer data from each body position and combinations of positions were used to develop random forest models to assess activity category recognition accuracy and MET estimation. RESULTS: Model performance for both MET estimation and activity category recognition were strengthened with the use of additional accelerometer devices. However, a single accelerometer on the ankle, upper arm, hip, thigh, or wrist had only a 0.03-0.09 MET increase in prediction error compared with wearing all 5 devices. Balanced accuracy showed similar trends with slight decreases in balanced accuracy for the detection of locomotion (balanced accuracy decrease range 0-0.01), sedentary (balanced accuracy decrease range 0.05-0.13), and lifestyle activities (balanced accuracy decrease range 0.04-0.08) compared with all 5 placements. The accuracy of recognizing activity categories increased with additional placements (accuracy decrease range 0.15-0.29). Notably, the hip was the best single body position for MET estimation and activity category recognition. CONCLUSIONS: Additional accelerometer devices slightly enhance activity recognition accuracy and MET estimation in older adults. However, given the extra burden of wearing additional devices, single accelerometers with appropriate placement appear to be sufficient for estimating energy expenditure and activity category recognition in older adults.

Expenditure variations analysis using residuals for identifying high health care utilizers in a state Medicaid program.

BACKGROUND: High utilizers receive great attention in health care research because they have a largely disproportionate spending. Existing analyses usually identify high utilizers with an empirical threshold on the number of health care visits or associated expenditures. However, such count-and-cost based criteria might not be best for identifying impactable high utilizers. METHODS: We propose an approach to identify impactable high utilizers using residuals from regression-based health care utilization risk adjustment models to analyze the variations in health care expenditures. We develop linear and tree-based models to best adjust per-member per-month health care cost by clinical and socioeconomic risk factors using a large administrative claims dataset from a state public insurance program. RESULTS: The risk adjustment models identify a group of patients with high residuals whose demographics and categorization of comorbidities are similar to other patients but who have a significant amount of unexplained health care utilization. Deeper analysis of the essential hypertension cohort and chronic kidney disease cohort shows these variations in expenditures could be within individual ICD-9-CM codes and from different mixtures of ICD-9-CM codes. Additionally, correlation analysis with 3M™ Potentially Preventable Events (PPE) software shows that a portion of this utilization may be preventable. In addition, the high utilizers persist from year to year. CONCLUSIONS: After risk adjustment, patients with higher than expected expenditures (high residuals) are associated with more potentially preventable events. These residuals are temporally consistent and hence may be useful in identifying and intervening impactable high utilizers.

A smartwatch-based framework for real-time and online assessment and mobility monitoring.

Smartphone and smartwatch technology is changing the transmission and monitoring landscape for patients and research participants to communicate their healthcare information in real time. Flexible, bidirectional and real-time control of communication allows development of a rich set of healthcare applications that can provide interactivity with the participant and adapt dynamically to their changing environment. Additionally, smartwatches have a variety of sensors suitable for collecting physical activity and location data. The combination of all these features makes it possible to transmit the collected data to a remote server, and thus, to monitor physical activity and potentially social activity in real time. As smartwatches exhibit high user acceptability and increasing popularity, they are ideal devices for monitoring activities for extended periods of time to investigate the physical activity patterns in free-living condition and their relationship with the seemingly random occurring illnesses, which have remained a challenge in the current literature. Therefore, the purpose of this study was to develop a smartwatch-based framework for real-time and online assessment and mobility monitoring (ROAMM). The proposed ROAMM framework will include a smartwatch application and server. The smartwatch application will be used to collect and preprocess data. The server will be used to store and retrieve data, remote monitor, and for other administrative purposes. With the integration of sensor-based and user-reported data collection, the ROAMM framework allows for data visualization and summary statistics in real-time.

Machine learning approaches for predicting high cost high need patient expenditures in health care.

BACKGROUND: This paper studies the temporal consistency of health care expenditures in a large state Medicaid program. Predictive machine learning models were used to forecast the expenditures, especially for the high-cost, high-need (HCHN) patients. RESULTS: We systematically tests temporal correlation of patient-level health care expenditures in both the short and long terms. The results suggest that medical expenditures are significantly correlated over multiple periods. Our work demonstrates a prevalent and strong temporal correlation and shows promise for predicting future health care expenditures using machine learning. Temporal correlation is stronger in HCHN patients and their expenditures can be better predicted. Including more past periods is beneficial for better predictive performance. CONCLUSIONS: This study shows that there is significant temporal correlation in health care expenditures. Machine learning models can help to accurately forecast the expenditures. These results could advance the field toward precise preventive care to lower overall health care costs and deliver care more efficiently.

Identifying High Health Care Utilizers Using Post-Regression Residual Analysis of Health Expenditures from a State Medicaid Program.

We propose an approach to identify high health care utilizers using residuals from a regression-based health care utilization adjustment model to analyze the variations in health care expenditures. Using a large administrative claims dataset from a state public insurance program, we show that the residuals can identify a group of patients with high residuals whose demographics and categorization of comorbidities are similar to other patients but who have a significant amount of unexplained health care utilization. Additionally, these high utilizers persist from year to year. Correlation analysis with 3M™Potentially Preventable Events (PPE) software shows that a portion of this utilization may be preventable. In addition, these residuals can be useful in predicting future PPEs and hence may be useful in identifying impactable high utilizers.

CMRF: analyzing differential gene regulation in two group perturbation experiments.

BACKGROUND: Microarray experiments often measure expressions of genes taken from sample tissues in the presence of external perturbations such as medication, radiation, or disease. The external perturbation can change the expressions of some genes directly or indirectly through gene interaction network. In this paper, we focus on an important class of such microarray experiments that inherently have two groups of tissue samples. When such different groups exist, the changes in expressions for some of the genes after the perturbation can be different between the two groups. It is not only important to identify the genes that respond differently across the two groups, but also to mine the reason behind this differential response. In this paper, we aim to identify the cause of this differential behavior of genes, whether because of the perturbation or due to interactions with other genes. RESULTS: We propose a new probabilistic Bayesian method CMRF based on Markov Random Field to identify such genes. CMRF leverages the information about gene interactions as the prior of the model. We compare the accuracy of CMRF with SSEM and Student's t test and our old method SMRF on semi-synthetic dataset generated from microarray data. CMRF obtains high accuracy and outperforms all the other three methods. We also conduct a statistical significance test using a parametric noise based experiment to evaluate the accuracy of our method. In this experiment, CMRF generates significant regions of confidence for various parameter settings. CONCLUSIONS: In this paper, we solved the problem of finding primarily differentially regulated genes in the presence of external perturbations when the data is sampled from two groups. The probabilistic Bayesian method CMRF based on Markov Random Field incorporates dependency structure of the gene networks as the prior to the model. Experimental results on synthetic and real datasets demonstrated the superiority of CMRF compared to other simple techniques.