Current Status and Future Directions: The Application of Artificial Intelligence/Machine Learning for Precision Medicine.

Technological innovations, such as artificial intelligence (AI) and machine learning (ML), have the potential to expedite the goal of precision medicine, especially when combined with increased capacity for voluminous data from multiple sources and expanded therapeutic modalities; however, they also present several challenges. In this communication, we first discuss the goals of precision medicine, and contextualize the use of AI in precision medicine by showcasing innovative applications (e.g., prediction of tumor growth and overall survival, biomarker identification using biomedical images, and identification of patient population for clinical practice) which were presented during the February 2023 virtual public workshop entitled "Application of Artificial Intelligence and Machine Learning for Precision Medicine," hosted by the US Food and Drug Administration (FDA) and University of Maryland Center of Excellence in Regulatory Science and Innovation (M-CERSI). Next, we put forward challenges brought about by the multidisciplinary nature of AI, particularly highlighting the need for AI to be trustworthy. To address such challenges, we subsequently note practical approaches, viz., differential privacy, synthetic data generation, and federated learning. The proposed strategies - some of which are highlighted presentations from the workshop - are for the protection of personal information and intellectual property. In addition, methods such as the risk-based management approach and the need for an agile regulatory ecosystem are discussed. Finally, we lay out a call for action that includes sharing of data and algorithms, development of regulatory guidance documents, and pooling of expertise from a broad-spectrum of stakeholders to enhance the application of AI in precision medicine.

Dissecting the heterogeneity of "in the wild" stress from multimodal sensor data.

Stress is associated with numerous chronic health conditions, both mental and physical. However, the heterogeneity of these associations at the individual level is poorly understood. While data generated from individuals in their day-to-day lives "in the wild" may best represent the heterogeneity of stress, gathering these data and separating signals from noise is challenging. In this work, we report findings from a major data collection effort using Digital Health Technologies (DHTs) and frontline healthcare workers. We provide insights into stress "in the wild", by using robust methods for its identification from multimodal data and quantifying its heterogeneity. Here we analyze data from the Stress and Recovery in Frontline COVID-19 Workers study following 365 frontline healthcare workers for 4-6 months using wearable devices and smartphone app-based measures. Causal discovery is used to learn how the causal structure governing an individual's self-reported symptoms and physiological features from DHTs differs between non-stress and potential stress states. Our methods uncover robust representations of potential stress states across a population of frontline healthcare workers. These representations reveal high levels of inter- and intra-individual heterogeneity in stress. We leverage multiple stress definitions that span different modalities (from subjective to physiological) to obtain a comprehensive view of stress, as these differing definitions rarely align in time. We show that these different stress definitions can be robustly represented as changes in the underlying causal structure on and off stress for individuals. This study is an important step toward better understanding potential underlying processes generating stress in individuals.

Polygon Simplification for the Efficient Approximate Analytics of Georeferenced Big Data.

The unprecedented availability of sensor networks and GPS-enabled devices has caused the accumulation of voluminous georeferenced data streams. These data streams offer an opportunity to derive valuable insights and facilitate decision making for urban planning. However, processing and managing such data is challenging, given the size and multidimensionality of these data. Therefore, there is a growing interest in spatial approximate query processing depending on stratified-like sampling methods. However, in these solutions, as the number of strata increases, response time grows, thus counteracting the benefits of sampling. In this paper, we originally show the design and realization of a novel online geospatial approximate processing solution called GeoRAP. GeoRAP employs a front-stage filter based on the Ramer-Douglas-Peucker line simplification algorithm to reduce the size of study area coverage; thereafter, it employs a spatial stratified-like sampling method that minimizes the number of strata, thus increasing throughput and minimizing response time, while keeping the accuracy loss in check. Our method is applicable for various online and batch geospatial processing workloads, including complex geo-statistics, aggregation queries, and the generation of region-based aggregate geo-maps such as choropleth maps and heatmaps. We have extensively tested the performance of our prototyped solution with real-world big spatial data, and this paper shows that GeoRAP can outperform state-of-the-art baselines by an order of magnitude in terms of throughput while statistically obtaining results with good accuracy.

Reverse Engineering of Digital Measures: Inviting Patients to the Conversation.

Background: Digital measures offer an unparalleled opportunity to create a more holistic picture of how people who are patients behave in their real-world environments, thereby establishing a better connection between patients, caregivers, and the clinical evidence used to drive drug development and disease management. Reaching this vision will require achieving a new level of co-creation between the stakeholders who design, develop, use, and make decisions using evidence from digital measures. Summary: In September 2022, the second in a series of meetings hosted by the Swiss Federal Institute of Technology in Zürich, the Foundation for the National Institutes of Health Biomarkers Consortium, and sponsored by Wellcome Trust, entitled "Reverse Engineering of Digital Measures," was held in Zurich, Switzerland, with a broad range of stakeholders sharing their experience across four case studies to examine how patient centricity is essential in shaping development and validation of digital evidence generation tools. Key Messages: In this paper, we discuss progress and the remaining barriers to widespread use of digital measures for evidence generation in clinical development and care delivery. We also present key discussion points and takeaways in order to continue discourse and provide a basis for dissemination and outreach to the wider community and other stakeholders. The work presented here shows us a blueprint for how and why the patient voice can be thoughtfully integrated into digital measure development and that continued multistakeholder engagement is critical for further progress.

Precision recruitment for high-risk participants in a COVID-19 cohort study.

Background: Studies for developing diagnostics and treatments for infectious diseases usually require observing the onset of infection during the study period. However, when the infection base rate incidence is low, the cohort size required to measure an effect becomes large, and recruitment becomes costly and prolonged. We developed a model for reducing recruiting time and resources in a COVID-19 detection study by targeting recruitment to high-risk individuals. Methods: We conducted an observational longitudinal cohort study at individual sites throughout the U.S., enrolling adults who were members of an online health and research platform. Through direct and longitudinal connection with research participants, we applied machine learning techniques to compute individual risk scores from individually permissioned data about socioeconomic and behavioral data, in combination with predicted local prevalence data. The modeled risk scores were then used to target candidates for enrollment in a hypothetical COVID-19 detection study. The main outcome measure was the incidence rate of COVID-19 according to the risk model compared with incidence rates in actual vaccine trials. Results: When we used risk scores from 66,040 participants to recruit a balanced cohort of participants for a COVID-19 detection study, we obtained a 4- to 7-fold greater COVID-19 infection incidence rate compared with similar real-world study cohorts. Conclusion: This risk model offers the possibility of reducing costs, increasing the power of analyses, and shortening study periods by targeting for recruitment participants at higher risk.

Developing better digital health measures of Parkinson's disease using free living data and a crowdsourced data analysis challenge.

One of the promising opportunities of digital health is its potential to lead to more holistic understandings of diseases by interacting with the daily life of patients and through the collection of large amounts of real-world data. Validating and benchmarking indicators of disease severity in the home setting is difficult, however, given the large number of confounders present in the real world and the challenges in collecting ground truth data in the home. Here we leverage two datasets collected from patients with Parkinson's disease, which couples continuous wrist-worn accelerometer data with frequent symptom reports in the home setting, to develop digital biomarkers of symptom severity. Using these data, we performed a public benchmarking challenge in which participants were asked to build measures of severity across 3 symptoms (on/off medication, dyskinesia, and tremor). 42 teams participated and performance was improved over baseline models for each subchallenge. Additional ensemble modeling across submissions further improved performance, and the top models validated in a subset of patients whose symptoms were observed and rated by trained clinicians.

Characterization of Influenza-Like Illness Burden Using Commercial Wearable Sensor Data and Patient-Reported Outcomes: Mixed Methods Cohort Study.

BACKGROUND: The burden of influenza-like illness (ILI) is typically estimated via hospitalizations and deaths. However, ILI-associated morbidity that does not require hospitalization remains poorly characterized. OBJECTIVE: The main objective of this study was to characterize ILI burden using commercial wearable sensor data and investigate the extent to which these data correlate with self-reported illness severity and duration. Furthermore, we aimed to determine whether ILI-associated changes in wearable sensor data differed between care-seeking and non-care-seeking populations as well as between those with confirmed influenza infection and those with ILI symptoms only. METHODS: This study comprised participants enrolled in either the FluStudy2020 or the Home Testing of Respiratory Illness (HTRI) study; both studies were similar in design and conducted between December 2019 and October 2020 in the United States. The participants self-reported ILI-related symptoms and health care-seeking behaviors via daily, biweekly, and monthly surveys. Wearable sensor data were recorded for 120 and 150 days for FluStudy2020 and HTRI, respectively. The following features were assessed: total daily steps, active time (time spent with >50 steps per minute), sleep duration, sleep efficiency, and resting heart rate. ILI-related changes in wearable sensor data were compared between the participants who sought health care and those who did not and between the participants who tested positive for influenza and those with symptoms only. Correlative analyses were performed between wearable sensor data and patient-reported outcomes. RESULTS: After combining the FluStudy2020 and HTRI data sets, the final ILI population comprised 2435 participants. Compared with healthy days (baseline), the participants with ILI exhibited significantly reduced total daily steps, active time, and sleep efficiency as well as increased sleep duration and resting heart rate. Deviations from baseline typically began before symptom onset and were greater in the participants who sought health care than in those who did not and greater in the participants who tested positive for influenza than in those with symptoms only. During an ILI event, changes in wearable sensor data consistently varied with those in patient-reported outcomes. CONCLUSIONS: Our results underscore the potential of wearable sensors to discriminate not only between individuals with and without influenza infections but also between care-seeking and non-care-seeking populations, which may have future application in health care resource planning. TRIAL REGISTRATION: Clinicaltrials.gov NCT04245800; https://clinicaltrials.gov/ct2/show/NCT04245800.

Predictors of Seeking Care for Influenza-Like Illness in a Novel Digital Study.

Background: Previous research has estimated that >50% of individuals experiencing influenza-like illness (ILI) do not seek health care. Understanding factors influencing care-seeking behavior for viral respiratory infections may help inform policies to improve access to care and protect public health. We used person-generated health data (PGHD) to identify factors associated with seeking care for ILI. Methods: Two observational studies (FluStudy2020, ISP) were conducted during the United States 2019-2020 influenza season. Participants self-reported ILI symptoms using the online Evidation platform. A log-binomial regression model was used to identify factors associated with seeking care. Results: Of 1667 participants in FluStudy2020 and 47 480 participants in ISP eligible for analysis, 518 (31.1%) and 11 426 (24.1%), respectively, sought health care. Participants were mostly female (92.2% FluStudy2020, 80.6% ISP) and aged 18-49 years (89.6% FluStudy2020, 89.8% ISP). In FluStudy2020, factors associated with seeking care included having health insurance (risk ratio [RR], 2.14; 95% CI, 1.30-3.54), more severe respiratory symptoms (RR, 1.53; 95% CI, 1.37-1.71), and comorbidities (RR, 1.37; 95% CI, 1.20-1.58). In ISP, the strongest predictor of seeking care was high symptom number (RR for 6/7 symptoms, 2.14; 95% CI, 1.93-2.38). Conclusions: Using PGHD, we confirmed low rates of health care-seeking behavior for ILI and show that having health insurance, comorbidities, and a high symptom burden were associated with seeking health care. Reducing barriers in access to care for viral respiratory infections may lead to better disease management and contribute to protecting public health.

Estimating the Burden of Influenza-like Illness on Daily Activity at the Population Scale Using Commercial Wearable Sensors.

Importance: The severity of viral infections can vary widely, from asymptomatic cases to complications leading to hospitalizations and death. Milder cases, despite being more prevalent, often go undocumented, and their public health burden is not accurately estimated. Objective: To estimate the true burden of influenza-like illness (ILI) in the US population using a surrogate measure of daily steps lost as measured by commercial wearable sensors. Design, Setting, and Participants: This cohort study modeled data from 15 122 US adults who reported ILI symptoms during the 2018-2019 influenza season (before the COVID-19 pandemic) and who had a sufficient density of wearable sensor data at symptom onset. Participants' minute-level step data as measured by commercial wearable sensors were collected from October 1, 2018, through June 30, 2019. Minute-level activity time series were transformed into day-level time series per user, indicating the total number of steps daily. Main Outcomes and Measures: The primary end point was the number of steps lost during the period of 4 days before symptom onset (the latent phase) through 11 days after symptom onset (the symptomatic phase). The association between covariates and steps lost during this interval was also examined. Results: Of the 15 122 participants in this study, 13 108 (86.7%) were women, and the median age was 32 years (IQR, 27-38 years). For their ILI event, 2836 of 15 080 participants (18.8%) sought medical attention, and only 61 (0.4%) were hospitalized. Over the course of an ILI lasting 10 days, the mean cumulative loss was 4437 steps (95% CI, 4143-4731 steps). After weighting, there was an estimated overall nationwide reduction in mobility equivalent to 255.2 billion steps (95% CI, 232.9-277.6 billion steps) lost because of ILI symptoms during the study period. This finding reflects significant changes in routines, mobility, and employment and is equivalent to 15% of the active US population becoming completely immobilized for 1 day. Moreover, 60.6% of this reduction in steps (154.6 billion steps [95% CI, 138.1-171.2 billion steps]) occurred among persons who sought no medical care. Age and educational level were positively associated with steps lost. Conclusions and Relevance: These findings suggest that most of the burden of ILI in this study would have been invisible to health care and public health reporting systems. This approach has applications for public health, health care, and clinical research, from estimating costs of lost productivity at population scale, to measuring effectiveness of anti-ILI treatments, to monitoring recovery after acute viral syndromes such as during long COVID-19.

Measuring Health-Related Quality of Life With Multimodal Data: Viewpoint.

The ability to objectively measure aspects of performance and behavior is a fundamental pillar of digital health, enabling digital wellness products, decentralized trial concepts, evidence generation, digital therapeutics, and more. Emerging multimodal technologies capable of measuring several modalities simultaneously and efforts to integrate inputs across several sources are further expanding the limits of what digital measures can assess. Experts from the field of digital health were convened as part of a multi-stakeholder workshop to examine the progress of multimodal digital measures in two key areas: detection of disease and the measurement of meaningful aspects of health relevant to the quality of life. Here we present a meeting report, summarizing key discussion points, relevant literature, and finally a vision for the immediate future, including how multimodal measures can provide value to stakeholders across drug development and care delivery, as well as three key areas where headway will need to be made if we are to continue to build on the encouraging progress so far: collaboration and data sharing, removal of barriers to data integration, and alignment around robust modular evaluation of new measurement capabilities.

Correction: An Alternative to the Light Touch Digital Health Remote Study: The Stress and Recovery in Frontline COVID-19 Health Care Workers Study.

[This corrects the article DOI: 10.2196/32165.].

A Digital Twin Decision Support System for the Urban Facility Management Process.

The ever increasing pace of IoT deployment is opening the door to concrete implementations of smart city applications, enabling the large-scale sensing and modeling of (near-)real-time digital replicas of physical processes and environments. This digital replica could serve as the basis of a decision support system, providing insights into possible optimizations of resources in a smart city scenario. In this article, we discuss an extension of a prior work, presenting a detailed proof-of-concept implementation of a Digital Twin solution for the Urban Facility Management (UFM) process. The Interactive Planning Platform for City District Adaptive Maintenance Operations (IPPODAMO) is a distributed geographical system, fed with and ingesting heterogeneous data sources originating from different urban data providers. The data are subject to continuous refinements and algorithmic processes, used to quantify and build synthetic indexes measuring the activity level inside an area of interest. IPPODAMO takes into account potential interference from other stakeholders in the urban environment, enabling the informed scheduling of operations, aimed at minimizing interference and the costs of operations.

An Alternative to the Light Touch Digital Health Remote Study: The Stress and Recovery in Frontline COVID-19 Health Care Workers Study.

BACKGROUND: Several app-based studies share similar characteristics of a light touch approach that recruit, enroll, and onboard via a smartphone app and attempt to minimize burden through low-friction active study tasks while emphasizing the collection of passive data with minimal human contact. However, engagement is a common challenge across these studies, reporting low retention and adherence. OBJECTIVE: This study aims to describe an alternative to a light touch digital health study that involved a participant-centric design including high friction app-based assessments, semicontinuous passive data from wearable sensors, and a digital engagement strategy centered on providing knowledge and support to participants. METHODS: The Stress and Recovery in Frontline COVID-19 Health Care Workers Study included US frontline health care workers followed between May and November 2020. The study comprised 3 main components: (1) active and passive assessments of stress and symptoms from a smartphone app, (2) objective measured assessments of acute stress from wearable sensors, and (3) a participant codriven engagement strategy that centered on providing knowledge and support to participants. The daily participant time commitment was an average of 10 to 15 minutes. Retention and adherence are described both quantitatively and qualitatively. RESULTS: A total of 365 participants enrolled and started the study, and 81.0% (n=297) of them completed the study for a total study duration of 4 months. Average wearable sensor use was 90.6% days of total study duration. App-based daily, weekly, and every other week surveys were completed on average 69.18%, 68.37%, and 72.86% of the time, respectively. CONCLUSIONS: This study found evidence for the feasibility and acceptability of a participant-centric digital health study approach that involved building trust with participants and providing support through regular phone check-ins. In addition to high retention and adherence, the collection of large volumes of objective measured data alongside contextual self-reported subjective data was able to be collected, which is often missing from light touch digital health studies. TRIAL REGISTRATION: ClinicalTrials.gov NCT04713111; https://clinicaltrials.gov/ct2/show/NCT04713111.

How Mobility and Sociality Reshape the Context: A Decade of Experience in Mobile CrowdSensing.

The possibility of understanding the dynamics of human mobility and sociality creates the opportunity to re-design the way data are collected by exploiting the crowd. We survey the last decade of experimentation and research in the field of mobile CrowdSensing, a paradigm centred on users' devices as the primary source for collecting data from urban areas. To this purpose, we report the methodologies aimed at building information about users' mobility and sociality in the form of ties among users and communities of users. We present two methodologies to identify communities: spatial and co-location-based. We also discuss some perspectives about the future of mobile CrowdSensing and its impact on four investigation areas: contact tracing, edge-based MCS architectures, digitalization in Industry 5.0 and community detection algorithms.

Interoperable Blockchains for Highly-Integrated Supply Chains in Collaborative Manufacturing.

Blockchain technology plays a pivotal role in the undergoing fourth industrial revolution or Industry 4.0. It is considered a tremendous boost to company digitalization; thus, considerable investments in blockchain are being made. However, there is no single blockchain technology, but various solutions exist, and they cannot interoperate with one each other. The ecosystem envisioned by the Industry 4.0 does not have centralized management or leading organization, so a single blockchain solution cannot be imposed. The various organizations hold their own blockchains, which must interoperate seamlessly. Despite some solutions for blockchain interoperability being proposed, the problem is still open. This paper aims to devise a secure solution for blockchain interoperability. The proposed approach consists of a relay scheme based on Trusted Execution Environment to provide higher security guarantees than the current literature. In particular, the proposed solution adopts an off-chain secure computation element invoked by a smart contract on a blockchain to securely communicate with its peered counterpart. A prototype has been implemented and used for the performance assessment, e.g., to measure the latency increase due to cross-blockchain interactions. The achieved and reported experimental results show that the proposed security solution introduces an additional latency that is entirely tolerable for transactions. At the same time, the usage of the Trusted Execution Environment imposes a negligible overhead.

QoS-Aware Approximate Query Processing for Smart Cities Spatial Data Streams.

Large amounts of georeferenced data streams arrive daily to stream processing systems. This is attributable to the overabundance of affordable IoT devices. In addition, interested practitioners desire to exploit Internet of Things (IoT) data streams for strategic decision-making purposes. However, mobility data are highly skewed and their arrival rates fluctuate. This nature poses an extra challenge on data stream processing systems, which are required in order to achieve pre-specified latency and accuracy goals. In this paper, we propose ApproxSSPS, which is a system for approximate processing of geo-referenced mobility data, at scale with quality of service guarantees. We focus on stateful aggregations (e.g., means, counts) and top-N queries. ApproxSSPS features a controller that interactively learns the latency statistics and calculates proper sampling rates to meet latency or/and accuracy targets. An overarching trait of ApproxSSPS is its ability to strike a plausible balance between latency and accuracy targets. We evaluate ApproxSSPS on Apache Spark Structured Streaming with real mobility data. We also compared ApproxSSPS against a state-of-the-art online adaptive processing system. Our extensive experiments prove that ApproxSSPS can fulfill latency and accuracy targets with varying sets of parameter configurations and load intensities (i.e., transient peaks in data loads versus slow arriving streams). Moreover, our results show that ApproxSSPS outperforms the baseline counterpart by significant magnitudes. In short, ApproxSSPS is a novel spatial data stream processing system that can deliver real accurate results in a timely manner, by dynamically specifying the limits on data samples.

Edge-enabled Mobile Crowdsensing to Support Effective Rewarding for Data Collection in Pandemic Events.

Smart cities use Information and Communication Technologies (ICT) to enrich existing public services and to improve citizens' quality of life. In this scenario, Mobile CrowdSensing (MCS) has become, in the last few years, one of the most prominent paradigms for urban sensing. MCS allow people roaming around with their smart devices to collectively sense, gather, and share data, thus leveraging the possibility to capture the pulse of the city. That can be very helpful in emergency scenarios, such as the COVID-19 pandemic, that require to track the movement of a high number of people to avoid risky situations, such as the formation of crowds. In fact, using mobility traces gathered via MCS, it is possible to detect crowded places and suggest people safer routes/places. In this work, we propose an edge-anabled mobile crowdsensing platform, called ParticipAct, that exploits edge nodes to compute possible dangerous crowd situations and a federated blockchain network to store reward states. Edge nodes are aware of all critical situation in their range and can warn the smartphone client with a smart push notification service that avoids firing too many messages by adapting the warning frequency according to the transport and the specific subarea in which clients are located.

Reproducibility in machine learning for health research: Still a ways to go.

Machine learning for health must be reproducible to ensure reliable clinical use. We evaluated 511 scientific papers across several machine learning subfields and found that machine learning for health compared poorly to other areas regarding reproducibility metrics, such as dataset and code accessibility. We propose recommendations to address this problem.

Characterizing COVID-19 and Influenza Illnesses in the Real World via Person-Generated Health Data.

The fight against COVID-19 is hindered by similarly presenting viral infections that may confound detection and monitoring. We examined person-generated health data (PGHD), consisting of survey and commercial wearable data from individuals' everyday lives, for 230 people who reported a COVID-19 diagnosis between March 30, 2020, and April 27, 2020 (n = 41 with wearable data). Compared with self-reported diagnosed flu cases from the same time frame (n = 426, 85 with wearable data) or pre-pandemic (n = 6,270, 1,265 with wearable data), COVID-19 patients reported a distinct symptom constellation that lasted longer (median of 12 versus 9 and 7 days, respectively) and peaked later after illness onset. Wearable data showed significant changes in daily steps and prevalence of anomalous resting heart rate measurements, of similar magnitudes for both the flu and COVID-19 cohorts. Our findings highlight the need to include flu comparator arms when evaluating PGHD applications aimed to be highly specific for COVID-19.