Documenting the de-identification process of clinical and imaging data for AI for health imaging projects.

Artificial intelligence (AI) is revolutionizing the field of medical imaging, holding the potential to shift medicine from a reactive "sick-care" approach to a proactive focus on healthcare and prevention. The successful development of AI in this domain relies on access to large, comprehensive, and standardized real-world datasets that accurately represent diverse populations and diseases. However, images and data are sensitive, and as such, before using them in any way the data needs to be modified to protect the privacy of the patients. This paper explores the approaches in the domain of five EU projects working on the creation of ethically compliant and GDPR-regulated European medical imaging platforms, focused on cancer-related data. It presents the individual approaches to the de-identification of imaging data, and describes the problems and the solutions adopted in each case. Further, lessons learned are provided, enabling future projects to optimally handle the problem of data de-identification. CRITICAL RELEVANCE STATEMENT: This paper presents key approaches from five flagship EU projects for the de-identification of imaging and clinical data offering valuable insights and guidelines in the domain. KEY POINTS: ΑΙ models for health imaging require access to large amounts of data. Access to large imaging datasets requires an appropriate de-identification process. This paper provides de-identification guidelines from the AI for health imaging (AI4HI) projects.

Real-world data analysis for the association of glucose control and mortality in critically ill patients.

Existing results regarding the usage of glycemic control in critically ill patients for reduced morbidity and mortality have been based on clinical studies but could not be reproduced in large prospective studies. Current guidelines for glycemic control suggest a target blood glucose of 140-180 mg/dL, with lower targets being appropriate for some patients. The current study aims to provide additional evidence to this area, through the usage of real-world retrospective data of everyday clinical practice. We have used the large, credentialed access database MIMIC-IV to assess the effect of glycemic control to patient mortality. Glycemic control has been characterized by the percentage of time that the glucose measurements fall within pre-specified glucose bands. Results from logistic regression and survival analysis are reported, along with visualizations based on methods from the machine learning literature, which all suggest that increased time in low and high glucose values is related to increased ICU mortality and decreased survival.

GATEKEEPER's Strategy for the Multinational Large-Scale Piloting of an eHealth Platform: Tutorial on How to Identify Relevant Settings and Use Cases.

BACKGROUND: The World Health Organization's strategy toward healthy aging fosters person-centered integrated care sustained by eHealth systems. However, there is a need for standardized frameworks or platforms accommodating and interconnecting multiple of these systems while ensuring secure, relevant, fair, trust-based data sharing and use. The H2020 project GATEKEEPER aims to implement and test an open-source, European, standard-based, interoperable, and secure framework serving broad populations of aging citizens with heterogeneous health needs. OBJECTIVE: We aim to describe the rationale for the selection of an optimal group of settings for the multinational large-scale piloting of the GATEKEEPER platform. METHODS: The selection of implementation sites and reference use cases (RUCs) was based on the adoption of a double stratification pyramid reflecting the overall health of target populations and the intensity of proposed interventions; the identification of a principles guiding implementation site selection; and the elaboration of guidelines for RUC selection, ensuring clinical relevance and scientific excellence while covering the whole spectrum of citizen complexities and intervention intensities. RESULTS: Seven European countries were selected, covering Europe's geographical and socioeconomic heterogeneity: Cyprus, Germany, Greece, Italy, Poland, Spain, and the United Kingdom. These were complemented by the following 3 Asian pilots: Hong Kong, Singapore, and Taiwan. Implementation sites consisted of local ecosystems, including health care organizations and partners from industry, civil society, academia, and government, prioritizing the highly rated European Innovation Partnership on Active and Healthy Aging reference sites. RUCs covered the whole spectrum of chronic diseases, citizen complexities, and intervention intensities while privileging clinical relevance and scientific rigor. These included lifestyle-related early detection and interventions, using artificial intelligence-based digital coaches to promote healthy lifestyle and delay the onset or worsening of chronic diseases in healthy citizens; chronic obstructive pulmonary disease and heart failure decompensations management, proposing integrated care management based on advanced wearable monitoring and machine learning (ML) to predict decompensations; management of glycemic status in diabetes mellitus, based on beat to beat monitoring and short-term ML-based prediction of glycemic dynamics; treatment decision support systems for Parkinson disease, continuously monitoring motor and nonmotor complications to trigger enhanced treatment strategies; primary and secondary stroke prevention, using a coaching app and educational simulations with virtual and augmented reality; management of multimorbid older patients or patients with cancer, exploring novel chronic care models based on digital coaching, and advanced monitoring and ML; high blood pressure management, with ML-based predictions based on different intensities of monitoring through self-managed apps; and COVID-19 management, with integrated management tools limiting physical contact among actors. CONCLUSIONS: This paper provides a methodology for selecting adequate settings for the large-scale piloting of eHealth frameworks and exemplifies with the decisions taken in GATEKEEPER the current views of the WHO and European Commission while moving forward toward a European Data Space.

Data infrastructures for AI in medical imaging: a report on the experiences of five EU projects.

Artificial intelligence (AI) is transforming the field of medical imaging and has the potential to bring medicine from the era of 'sick-care' to the era of healthcare and prevention. The development of AI requires access to large, complete, and harmonized real-world datasets, representative of the population, and disease diversity. However, to date, efforts are fragmented, based on single-institution, size-limited, and annotation-limited datasets. Available public datasets (e.g., The Cancer Imaging Archive, TCIA, USA) are limited in scope, making model generalizability really difficult. In this direction, five European Union projects are currently working on the development of big data infrastructures that will enable European, ethically and General Data Protection Regulation-compliant, quality-controlled, cancer-related, medical imaging platforms, in which both large-scale data and AI algorithms will coexist. The vision is to create sustainable AI cloud-based platforms for the development, implementation, verification, and validation of trustable, usable, and reliable AI models for addressing specific unmet needs regarding cancer care provision. In this paper, we present an overview of the development efforts highlighting challenges and approaches selected providing valuable feedback to future attempts in the area.Key points• Artificial intelligence models for health imaging require access to large amounts of harmonized imaging data and metadata.• Main infrastructures adopted either collect centrally anonymized data or enable access to pseudonymized distributed data.• Developing a common data model for storing all relevant information is a challenge.• Trust of data providers in data sharing initiatives is essential.• An online European Union meta-tool-repository is a necessity minimizing effort duplication for the various projects in the area.

Mobile App Interventions for Parkinson's Disease, Multiple Sclerosis and Stroke: A Systematic Literature Review.

Central nervous system diseases (CNSDs) lead to significant disability worldwide. Mobile app interventions have recently shown the potential to facilitate monitoring and medical management of patients with CNSDs. In this direction, the characteristics of the mobile apps used in research studies and their level of clinical effectiveness need to be explored in order to advance the multidisciplinary research required in the field of mobile app interventions for CNSDs. A systematic review of mobile app interventions for three major CNSDs, i.e., Parkinson's disease (PD), multiple sclerosis (MS), and stroke, which impose significant burden on people and health care systems around the globe, is presented. A literature search in the bibliographic databases of PubMed and Scopus was performed. Identified studies were assessed in terms of quality, and synthesized according to target disease, mobile app characteristics, study design and outcomes. Overall, 21 studies were included in the review. A total of 3 studies targeted PD (14%), 4 studies targeted MS (19%), and 14 studies targeted stroke (67%). Most studies presented a weak-to-moderate methodological quality. Study samples were small, with 15 studies (71%) including less than 50 participants, and only 4 studies (19%) reporting a study duration of 6 months or more. The majority of the mobile apps focused on exercise and physical rehabilitation. In total, 16 studies (76%) reported positive outcomes related to physical activity and motor function, cognition, quality of life, and education, whereas 5 studies (24%) clearly reported no difference compared to usual care. Mobile app interventions are promising to improve outcomes concerning patient's physical activity, motor ability, cognition, quality of life and education for patients with PD, MS, and Stroke. However, rigorous studies are required to demonstrate robust evidence of their clinical effectiveness.

Promoting Obesity Prevention and Healthy Habits in Childhood: The OCARIoT Experience.

OBJECTIVE: Long term behavioural disturbances and interventions in healthy habits (mainly eating and physical activity) are the primary cause of childhood obesity. Current approaches for obesity prevention based on health information extraction lack the integration of multi-modal datasets and the provision of a dedicated Decision Support System (DSS) for health behaviour assessment and coaching of children. METHODS: Continuous co-creation process has been applied in the frame of the Design Thinking Methodology, involving children, educators and healthcare professional in the whole process. Such considerations were used to derive the user needs and the technical requirements needed for the conception of the Internet of Things (IoT) platform based on microservices. RESULTS: To promote the adoption of healthy habits and the prevention of the obesity onset for children (9-12 years old), the proposed solution empowers children -including families and educators- in taking control of their health by collecting and following-up real-time information about nutrition, physical activity data coming from IoT devices, and interconnecting healthcare professionals to provide a personalised coaching solution. The validation has two phases involving +400 children (control/intervention group), on four schools in three countries: Spain, Greece and Brazil. The prevalence of obesity decreased in 75.5% from baseline levels in the intervention group. The proposed solution created a positive impression and satisfaction from the technology acceptance perspective. CONCLUSIONS: Main findings confirm that this ecosystem can assess behaviours of children, motivating and guiding them towards achieving personal goals. Clinical and Translational Impact Statement-This study presents Early Research on the adoption of a smart childhood obesity caring solution adopting a multidisciplinary approach; it involves researchers from biomedical engineering, medicine, computer science, ethics and education. The solution has the potential to decrease the obesity rates in children aiming to impact to get a better global health.

Smart Workplaces for older adults: coping 'ethically' with technology pervasiveness.

Pervasive technologies such as Artificial Intelligence, Virtual Reality and the Internet of Things, despite their great potential for improved workability and well-being of older workers, entail wide ethical concerns. Aligned with these considerations we emphasize the need to present from the viewpoint of ethics the risks of personalized ICT solutions that aim to remedy health and support the well-being of the ageing population at workplaces. The ethical boundaries of digital technologies are opaque. The main motivation is to cope with the uncertainties of workplaces' digitization and develop an ethics framework, termed SmartFrameWorK, for personalized health support through ICT tools at workplace environments. SmartFrameWorK is built upon a five-dimensional approach of ethics norms: autonomy, privacy, transparency, trustworthiness and accountability to incite trust in digital workplace technologies. A typology underpins these principles and guides the ethical decision-making process with regard to older worker particular needs, context, data type-related risks and digital tools' use throughout their lifecycle. Risk analysis of pervasive technology use and multimodal data collection, highlighted the imperative for ethically aware practices for older workers' activity and behaviour monitoring. The SmartFrameWorK methodology has been applied in a case study to provide evidence that personalized digital services could elicit trust in users through a well-defined framework. Ethics compliance is a dynamic process from participants' engagement to data management. Defining ethical determinants is pivotal towards building trust and reinforcing better workability and well-being in older workers.

A social robot-based platform for health behavior change toward prevention of childhood obesity.

Childhood obesity is a major public health challenge which is linked with the occurrence of diseases such as diabetes and cancer. The COVID-19 pandemic has forced changes to the lifestyle behaviors of children, thereby making the risk of developing obesity even greater. Novel preventive tools and approaches are required to fight childhood obesity. We present a social robot-based platform which utilizes an interactive motivational strategy in communication with children, collects self-reports through the touch of tangible objects, and processes behavioral data, aiming to: (a) screen and assess the behaviors of children in the dimensions of physical activity, diet, and education, and (b) recommend individualized goals for health behavior change. The platform was integrated through a microservice architecture within a multi-component system targeting childhood obesity prevention. The platform was evaluated in an experimental study with 30 children aged 9-12 years in a real-life school setting, showing children's acceptance to use it, and an 80% success rate in achieving weekly personal health goals recommended by the social robot-based platform. The results provide preliminary evidence on the implementation feasibility and potential of the social robot-based platform toward the betterment of children's health behaviors in the context of childhood obesity prevention. Further rigorous longer-term studies are required.

Privacy-Preserving Partner Notification Service to Control Sexually Transmitted Infections.

Partner Notification (PN) processes are typically part of wider combination prevention efforts and focus on the notification of sexual partners to prevent Sexually Transmitted Infections (STIs), including Human Immunodeficiency Viruses and viral hepatitis. We present a free, voluntary, anonymous and GDPR-compliant Partner Notification service that offers enhanced security and privacy through a web and mobile application via a unique random codes.

Usability of the Virtual Supermarket Test for Older Adults with and without Cognitive Impairment.

This study conducted a preliminary usability assessment of the Virtual Supermarket Test (VST), a serious game-based self-administered cognitive screening test for mild cognitive impairment (MCI). Twenty-four healthy older adults with subjective cognitive decline and 33 patients with MCI self-administered the VST and then completed the System Usability Scale (SUS). The average SUS score was 83.11 (SD = 14.6). The SUS score was unaffected by age, education, touch device familiarity, and diagnosis of MCI. SUS score correlated with VST performance (r = -0.496, p = 0.000). Results of this study indicate good usability of the VST.

Ethical Decision Making in Iot Data Driven Research: A Case Study of a Large-Scale Pilot.

IoT technologies generate intelligence and connectivity and develop knowledge to be used in the decision-making process. However, research that uses big data through global interconnected infrastructures, such as the 'Internet of Things' (IoT) for Active and Healthy Ageing (AHA), is fraught with several ethical concerns. A large-scale application of IoT operating in diverse piloting contexts and case studies needs to be orchestrated by a robust framework to guide ethical and sustainable decision making in respect to data management of AHA and IoT based solutions. The main objective of the current article is to present the successful completion of a collaborative multiscale research work, which addressed the complicated exercise of ethical decision making in IoT smart ecosystems for older adults. Our results reveal that among the strong enablers of the proposed ethical decision support model were the participatory and deliberative procedures complemented by a set of regulatory and non-regulatory tools to operationalize core ethical values such as transparency, trust, and fairness in real care settings for older adults and their caregivers.

Deep Learning in mHealth for Cardiovascular Disease, Diabetes, and Cancer: Systematic Review.

BACKGROUND: Major chronic diseases such as cardiovascular disease (CVD), diabetes, and cancer impose a significant burden on people and health care systems around the globe. Recently, deep learning (DL) has shown great potential for the development of intelligent mobile health (mHealth) interventions for chronic diseases that could revolutionize the delivery of health care anytime, anywhere. OBJECTIVE: The aim of this study is to present a systematic review of studies that have used DL based on mHealth data for the diagnosis, prognosis, management, and treatment of major chronic diseases and advance our understanding of the progress made in this rapidly developing field. METHODS: A search was conducted on the bibliographic databases Scopus and PubMed to identify papers with a focus on the deployment of DL algorithms that used data captured from mobile devices (eg, smartphones, smartwatches, and other wearable devices) targeting CVD, diabetes, or cancer. The identified studies were synthesized according to the target disease, the number of enrolled participants and their age, and the study period as well as the DL algorithm used, the main DL outcome, the data set used, the features selected, and the achieved performance. RESULTS: In total, 20 studies were included in the review. A total of 35% (7/20) of DL studies targeted CVD, 45% (9/20) of studies targeted diabetes, and 20% (4/20) of studies targeted cancer. The most common DL outcome was the diagnosis of the patient's condition for the CVD studies, prediction of blood glucose levels for the studies in diabetes, and early detection of cancer. Most of the DL algorithms used were convolutional neural networks in studies on CVD and cancer and recurrent neural networks in studies on diabetes. The performance of DL was found overall to be satisfactory, reaching >84% accuracy in most studies. In comparison with classic machine learning approaches, DL was found to achieve better performance in almost all studies that reported such comparison outcomes. Most of the studies did not provide details on the explainability of DL outcomes. CONCLUSIONS: The use of DL can facilitate the diagnosis, management, and treatment of major chronic diseases by harnessing mHealth data. Prospective studies are now required to demonstrate the value of applied DL in real-life mHealth tools and interventions.

A GDPR-Compliant Partner Notification Service.

Partner Notification processes focus on the notification of sexual partners to prevent the transmission of Sexually Transmitted Infections (STIs). The INTEGRATE Joint Action provides an integrated platform called RiskRadar, for combination prevention activities targeting STIs, including an anonymous, free and voluntary Partner Notification service. The presented service information flow ensures privacy, security and GDPR compliance which were identified as vital with similar tools. The service is available via web and mobile interfaces using a unique random code provided from authorised healthcare professionals to support privacy.

Addressing the clinical unmet needs in primary Sjögren's Syndrome through the sharing, harmonization and federated analysis of 21 European cohorts.

For many decades, the clinical unmet needs of primary Sjögren's Syndrome (pSS) have been left unresolved due to the rareness of the disease and the complexity of the underlying pathogenic mechanisms, including the pSS-associated lymphomagenesis process. Here, we present the HarmonicSS cloud-computing exemplar which offers beyond the state-of-the-art data analytics services to address the pSS clinical unmet needs, including the development of lymphoma classification models and the identification of biomarkers for lymphomagenesis. The users of the platform have been able to successfully interlink, curate, and harmonize 21 regional, national, and international European cohorts of 7,551 pSS patients with respect to the ethical and legal issues for data sharing. Federated AI algorithms were trained across the harmonized databases, with reduced execution time complexity, yielding robust lymphoma classification models with 85% accuracy, 81.25% sensitivity, 85.4% specificity along with 5 biomarkers for lymphoma development. To our knowledge, this is the first GDPR compliant platform that provides federated AI services to address the pSS clinical unmet needs.

A Machine Learning Approach for Prediction of Sedentary Behavior Based on Daily Step Counts.

Sedentary behavior is considered as a major public health challenge, linked with many chronic diseases and premature mortality. In this paper, we propose a steps counting -based machine learning approach for the prediction of sedentary behavior. Our work focuses on analyzing historical data from multiple users of wearable physical activity trackers and exploring the performance of four machine learning algorithms, i.e., Logistic Regression, Random Forest, XGBoost, Convolutional Neural Networks, as well as a Majority Vote Ensemble of the algorithms. To train and test our models we employed a crowd sourced dataset containing a month's data of 33 users. For further evaluation, we employed a dataset containing 6 months of data of an additional user. The results revealed that while all models succeed in predicting next-day sedentary behavior, the ensemble model outperforms all baselines, as it manages to predict sedentary behavior and reduce false positives more effectively. On the multi-subjects test dataset, our ensemble model achieved an accuracy of 82.12% with a sensitivity of 74.53% and a specificity of 85.71%. On the additional unseen dataset, we achieved 76.88% in accuracy, 63.27% in sensitivity and 81.75% in specificity. These outcomes provide the ground towards the development of real-life artificially intelligent systems for sedentary behavior prediction.

RiskRadar: development and pilot results of a technical intervention targeting combination prevention regarding HIV, viral hepatitis, sexually transmitted infections and tuberculosis.

BACKGROUND: The HIV pandemic impacts the lives of millions and despite the global coordinated response, innovative actions are still needed to end it. A major challenge is the added burden of coinfections such as viral hepatitis, tuberculosis and various sexually transmitted infections in terms of prevention, treatment and increased morbidity in individuals with HIV infection. A need for combination prevention strategies, tailored to high-risk key populations arises and technology-based interventions can be a valuable asset. The COVID-19 pandemic challenged the delivery of existing services and added stress to existing public health and clinical structures but also highlighted the potential of exploiting technical solutions for interventions regarding infectious diseases. In this paper we report the design process, results and evaluation findings from the pilots of 'RiskRadar'-a web and mobile application aiming to support combination prevention, testing and linkage to care for HIV, viral hepatitis, various sexually transmitted infections and tuberculosis. METHODS: RiskRadar was developed for the INTEGRATE Joint Action's aim to improve, adapt and pilot innovative digital tools for combination prevention. RiskRadar was designed iteratively using informed end-user-oriented approaches. Emphasis was placed on the Risk Calculator that enables users to assess their risk of exposure to one or more of the four disease areas, make informed decisions to seek testing or care and adjust their behaviours ultimately aiming to harm/risk reduction. RiskRadar has been piloted in three countries, namely Croatia, Italy and Lithuania. RESULTS: RiskRadar has been used 1347 times across all platforms so far. More than 90% of users have found RiskRadar useful and would use it again, especially the Risk Calculator component. Almost 49.25% are men and 29.85% are in the age group of 25-34. The application has scored 5.2/7 in the User Experience Questionnaire, where it is mainly described as "supportive" and "easy-to-use". The qualitative evaluation of RiskRadar also yielded positive feedback. CONCLUSIONS: Pilot results demonstrate above average satisfaction with RiskRadar and high user-reported usability scores, supporting the idea that technical interventions could significantly support combination prevention actions on Sexually Transmitted Infections.

From a Low-Cost Air Quality Sensor Network to Decision Support Services: Steps towards Data Calibration and Service Development.

Air pollution is a widespread problem due to its impact on both humans and the environment. Providing decision makers with artificial intelligence based solutions requires to monitor the ambient air quality accurately and in a timely manner, as AI models highly depend on the underlying data used to justify the predictions. Unfortunately, in urban contexts, the hyper-locality of air quality, varying from street to street, makes it difficult to monitor using high-end sensors, as the cost of the amount of sensors needed for such local measurements is too high. In addition, development of pollution dispersion models is challenging. The deployment of a low-cost sensor network allows a more dense cover of a region but at the cost of noisier sensing. This paper describes the development and deployment of a low-cost sensor network, discussing its challenges and applications, and is highly motivated by talks with the local municipality and the exploration of new technologies to improve air quality related services. However, before using data from these sources, calibration procedures are needed to ensure that the quality of the data is at a good level. We describe our steps towards developing calibration models and how they benefit the applications identified as important in the talks with the municipality.

A Virtual Reality-Based Screening Test for Cognitive Impairment in Small Vessel Disease.

BACKGROUND: There is a need for new practical tools to assess the cognitive impairment of small vessel disease (SVD) patients in the clinic. OBJECTIVE: This study aimed to examine cognitive functioning by administering the Virtual Supermarket (VST) in patients with SVD with cognitive impairment (SVD-CI, N = 32), cognitively normal SVD (SVD-CN, N = 37), and age-and education-matched healthy controls (HC, N = 30). METHODS: The tablet-based VST application and comprehensive traditional pencil-and-paper neuropsychological tests assessing memory, attention, executive function, visuospatial function, and language were administered to all participants. RESULTS: A moderate correlation was found between the "Duration" and "Correct Quantities" variables of VST and visuospatial function and general cognitive status composite Z scores across SVD-CI patients. "Duration" and "Correct Money" variables were moderately related to memory, executive functions, and visuospatial function composite Z scores across SVD-CN patients. A combination of all VST variables discriminated SVD-CI and HC with a correct classification rate of 81%, a sensitivity of 78%, and a specificity of 84%. CONCLUSION: This study is the first to evaluate cognitive functions employing the VST in SVD with and without cognitive impairment. It provides encouraging preliminary findings of the utility of the VST as a screening tool in the assessment of cognitive impairment and the differentiation of SVD patients from HC. In the future, validation studies of the VST with larger samples are needed.

A Comparison of Traditional and Serious Game-Based Digital Markers of Cognition in Older Adults with Mild Cognitive Impairment and Healthy Controls.

BACKGROUND: Electroencephalography (EEG) has been used to assess brain activity while users are playing an immersive serious game. OBJECTIVE: To assess differences in brain activation as measured with a non-intrusive wearable EEG device, differences in game performance and correlations between EEG power, game performance and global cognition, between cognitively impaired and non-impaired older adults, during the administration of a novel self-administered serious game-based test, the Virtual Supermarket Test (VST). METHODS: 43 older adults with subjective cognitive decline (SCD) and 33 older adults with mild cognitive impairment (MCI) were recruited from day centers for cognitive disorders. Global cognition was assessed with the Montreal Cognitive Assessment (MoCA). Brain activity was measured with a non-intrusive wearable EEG device in a resting state condition and while they were administered the VST. RESULTS: During resting state condition, the MCI group showed increased alpha, beta, delta, and theta band power compared to the SCD group. During the administration of the VST, the MCI group showed increased beta and theta band power compared to the SCD group. Regarding game performance, alpha, beta, delta, and theta rhythms were positively correlated with average duration, while delta rhythm was positively correlated with mean errors. MoCA correlated with alpha, beta, delta, and theta rhythms and with average game duration and mean game errors indicating that elevated EEG rhythms in MCI may be associated with an overall cognitive decline. CONCLUSION: VST performance can be used as a digital biomarker. Cheap commercially available wearable EEG devices can be used for obtaining brain activity biomarkers.

COVID-19 Mobile Apps: A Systematic Review of the Literature.

BACKGROUND: A vast amount of mobile apps have been developed during the past few months in an attempt to "flatten the curve" of the increasing number of COVID-19 cases. OBJECTIVE: This systematic review aims to shed light into studies found in the scientific literature that have used and evaluated mobile apps for the prevention, management, treatment, or follow-up of COVID-19. METHODS: We searched the bibliographic databases Global Literature on Coronavirus Disease, PubMed, and Scopus to identify papers focusing on mobile apps for COVID-19 that show evidence of their real-life use and have been developed involving clinical professionals in their design or validation. RESULTS: Mobile apps have been implemented for training, information sharing, risk assessment, self-management of symptoms, contact tracing, home monitoring, and decision making, rapidly offering effective and usable tools for managing the COVID-19 pandemic. CONCLUSIONS: Mobile apps are considered to be a valuable tool for citizens, health professionals, and decision makers in facing critical challenges imposed by the pandemic, such as reducing the burden on hospitals, providing access to credible information, tracking the symptoms and mental health of individuals, and discovering new predictors.