How can we reward you? A compliance and reward ontology (CaRO) for eliciting quantitative reward rules for engagement in mHealth app and healthy behaviors.

OBJECTIVE: When developing mHealth apps with point reward systems, knowledge engineers and domain experts should define app requirements capturing quantitative reward patterns that reflect patient compliance with health behaviors. This is a difficult task, and they could be aided by an ontology that defines systematically quantitative behavior goals that address more than merely the recommended behavior but also rewards for partial compliance or practicing the behavior more than recommended. No ontology and algorithm exist for defining point rewards systematically. METHODS: We developed an OWL ontology for point rewards that leverages the Basic Formal Ontology, the Behaviour Change Intervention Ontology and the Gamification Domain Ontology. This Compliance and Reward Ontology (CaRO) allows defining temporal elementary reward patterns for single and multiple sessions of practicing a behavior. These could be assembled to define more complex temporal patterns for persistence behavior over longer time intervals as well as logical combinations of simpler reward patterns. We also developed an algorithm for calculating the points that should be rewarded to users, given data regarding their actual performance. A natural language generation algorithm generates from ontology instances app requirements in the form of user stories. To assess the usefulness of the ontology and algorithms, information system students who are trained to be system analysts/knowledge engineers evaluated whether the ontology and algorithms can improve the requirement elicitation of point rewards for compliance patterns more completely and correctly. RESULTS: For single-session rewards, the ontology improved formulation of two of the six requirements as well as the total time for specifying them. For multi-session rewards, the ontology improved formulation of five of the 11 requirements. CONCLUSION: CaRO is a first attempt of its kind, and it covers all of the cases of compliance and reward pattern definitions that were needed for a full-scale system that was developed as part of a large European project. The ontology and algorithm are available at https://github.com/capable-project/rewards.

Leveraging generative AI for clinical evidence synthesis needs to ensure trustworthiness.

Evidence-based medicine promises to improve the quality of healthcare by empowering medical decisions and practices with the best available evidence. The rapid growth of medical evidence, which can be obtained from various sources, poses a challenge in collecting, appraising, and synthesizing the evidential information. Recent advancements in generative AI, exemplified by large language models, hold promise in facilitating the arduous task. However, developing accountable, fair, and inclusive models remains a complicated undertaking. In this perspective, we discuss the trustworthiness of generative AI in the context of automated summarization of medical evidence.

SATO (IDEAS expAnded wiTh BCIO): Workflow for designers of patient-centered mobile health behaviour change intervention applications.

Designing effective theory-driven digital behaviour change interventions (DBCI) is a challenging task. To ease the design process, and assist with knowledge sharing and evaluation of the DBCI, we propose the SATO (IDEAS expAnded wiTh BCIO) design workflow based on the IDEAS (Integrate, Design, Assess, and Share) framework and aligned with the Behaviour Change Intervention Ontology (BCIO). BCIO is a structural representation of the knowledge in behaviour change domain supporting evaluation of behaviour change interventions (BCIs) but it is not straightforward to utilise it during DBCI design. IDEAS (Integrate, Design, Assess, and Share) framework guides multi-disciplinary teams through the mobile health (mHealth) application development life-cycle but it is not aligned with BCIO entities. SATO couples BCIO entities with workflow steps and extends IDEAS Integrate stage with consideration of customisation and personalisation. We provide a checklist of the activities that should be performed during intervention planning with concrete examples and a tutorial accompanied with case studies from the Cancer Better Life Experience (CAPABLE) European project. In the process of creating this workflow, we found the necessity to extend the BCIO to support the scenarios of multiple clinical goals in the same application. To ensure the SATO steps are easy to follow for the incomers to the field, we performed a preliminary evaluation of the workflow with two knowledge engineers, working on novel mHealth app design tasks.

Achieving trust in health-behavior-change artificial intelligence apps (HBC-AIApp) development: A multi-perspective guide.

OBJECTIVE: Trust determines the success of Health-Behavior-Change Artificial Intelligence Apps (HBC-AIApp). Developers of such apps need theory-based practical methods that can guide them in achieving such trust. Our study aimed to develop a comprehensive conceptual model and development process that can guide developers how to build HBC-AIApp in order to support trust creation among the app's users. METHODS: We apply a multi-disciplinary approach where medical informatics, human-centered design, and holistic health methods are integrated to address the trust challenge in HBC-AIApps. The integration extends a conceptual model of trust in AI developed by Jermutus et al., whose properties guide the extension of the IDEAS (integrate, design, assess, and share) HBC-App development process. RESULTS: The HBC-AIApp framework consists of three main blocks: (1) system development methods that study the users' complex reality, hence, their perceptions, needs, goals and environment; (2) mediators and other stakeholders who are important for developing and operating the HBC-AIApp, boundary objects that examine users' activities via the HBC-AIApp; and (3) the HBC-AIApp's structural components, AI logic, and physical implementation. These blocks come together to provide the extended conceptual model of trust in HBC-AIApps and the extended IDEAS process. DISCUSSION: The developed HBC-AIApp framework drew from our own experience in developing trust in HBC-AIApp. Further research will focus on studying the application of the proposed comprehensive HBC-AIApp development framework and whether applying it supports trust creation in such apps.

A community-of-practice-based evaluation methodology for knowledge intensive computational methods and its application to multimorbidity decision support.

OBJECTIVE: The study has dual objectives. Our first objective (1) is to develop a community-of-practice-based evaluation methodology for knowledge-intensive computational methods. We target a whitebox analysis of the computational methods to gain insight on their functional features and inner workings. In more detail, we aim to answer evaluation questions on (i) support offered by computational methods for functional features within the application domain; and (ii) in-depth characterizations of the underlying computational processes, models, data and knowledge of the computational methods. Our second objective (2) involves applying the evaluation methodology to answer questions (i) and (ii) for knowledge-intensive clinical decision support (CDS) methods, which operationalize clinical knowledge as computer interpretable guidelines (CIG); we focus on multimorbidity CIG-based clinical decision support (MGCDS) methods that target multimorbidity treatment plans. MATERIALS AND METHODS: Our methodology directly involves the research community of practice in (a) identifying functional features within the application domain; (b) defining exemplar case studies covering these features; and (c) solving the case studies using their developed computational methods-research groups detail their solutions and functional feature support in solution reports. Next, the study authors (d) perform a qualitative analysis of the solution reports, identifying and characterizing common themes (or dimensions) among the computational methods. This methodology is well suited to perform whitebox analysis, as it directly involves the respective developers in studying inner workings and feature support of computational methods. Moreover, the established evaluation parameters (e.g., features, case studies, themes) constitute a re-usable benchmark framework, which can be used to evaluate new computational methods as they are developed. We applied our community-of-practice-based evaluation methodology on MGCDS methods. RESULTS: Six research groups submitted comprehensive solution reports for the exemplar case studies. Solutions for two of these case studies were reported by all groups. We identified four evaluation dimensions: detection of adverse interactions, management strategy representation, implementation paradigms, and human-in-the-loop support. Based on our whitebox analysis, we present answers to the evaluation questions (i) and (ii) for MGCDS methods. DISCUSSION: The proposed evaluation methodology includes features of illuminative and comparison-based approaches; focusing on understanding rather than judging/scoring or identifying gaps in current methods. It involves answering evaluation questions with direct involvement of the research community of practice, who participate in setting up evaluation parameters and solving exemplar case studies. Our methodology was successfully applied to evaluate six MGCDS knowledge-intensive computational methods. We established that, while the evaluated methods provide a multifaceted set of solutions with different benefits and drawbacks, no single MGCDS method currently provides a comprehensive solution for MGCDS. CONCLUSION: We posit that our evaluation methodology, applied here to gain new insights into MGCDS, can be used to assess other types of knowledge-intensive computational methods and answer other types of evaluation questions. Our case studies can be accessed at our GitHub repository (https://github.com/william-vw/MGCDS).

Towards a goal-oriented methodology for clinical-guideline-based management recommendations for patients with multimorbidity: GoCom and its preliminary evaluation.

Patients with chronic multimorbidity are becoming more common as life expectancy increases, making it necessary for physicians to develop complex management plans. We are looking at the patient management process as a goal-attainment problem. Hence, our aim is to develop a goal-oriented methodology for providing decision support for managing patients with multimorbidity continuously, as the patient's health state is progressing and new goals arise (e.g., treat ulcer, prevent osteoporosis). Our methodology allows us to detect and mitigate inconsistencies among guideline recommendations stemming from multiple clinical guidelines, while consulting medical ontologies and terminologies and relying on patient information standards. This methodology and its implementation as a decision-support system, called GoCom, starts with computer-interpretable clinical guidelines (CIGs) for single problems that are formalized using the PROforma CIG language. We previously published the architecture of the system as well as a CIG elicitation guide for enriching PROforma tasks with properties referring to vocabulary codes of goals and physiological effects of management plans. In this paper, we provide a formalization of the conceptual model of GoCom that generates, for each morbidity of the patient, a patient-specific goal tree that results from the PROforma engine's enactment of the CIG with the patient's data. We also present the "Controller" algorithm that drives the GoCom system. Given a new problem that a patient develops, the Controller detects inconsistencies among goals pertaining to different comorbid problems and consults the CIGs to generate alternative non-conflicted and goal-oriented management plans that address the multiple goals simultaneously. In this stage of our research, the inconsistencies that can be detected are of two types - starting vs. stopping medications that belong to the same medication class hierarchy, and detecting opposing physiological effect goals that are specified in concurrent CIGs (e.g., decreased blood pressure vs. increased blood pressure). However, the design of GoCom is modular and generic and allows the future introduction of additional interaction detection and mitigation strategies. Moreover, GoCom generates explanations of the alternative non-conflicted management plans, based on recommendations stemming from the clinical guidelines and reasoning patterns. GoCom's functionality was evaluated using three cases of multimorbidity interactions that were checked by our three clinicians. Usefulness was evaluated with two studies. The first evaluation was a pilot study with ten 6th year medical students and the second evaluation was done with 27 6th medical students and interns. The participants solved complex realistic cases of multimorbidity patients: with and without decision-support, two cases in the first evaluation and 6 cases in the second evaluation. Use of GoCom increased completeness of the patient management plans produced by the medical students from 0.44 to 0.71 (P-value of 0.0005) in the first evaluation, and from 0.31 to 0.78 (P-value < 0.0001) in the second evaluation. Correctness in the first evaluation was very high with (0.98) or without the system (0.91), with non-significant difference (P-value ≥ 0.17). In the second evaluation, use of GoCom increased correctness from 0.68 to 0.83 (P-value of 0.001). In addition, GoCom's explanation and visualization were perceived as useful by the vast majority of participants. While GoCom's detection of goal interactions is currently limited to detection of starting vs. stopping the same medication or medication subclasses and detecting conflicting physiological effects of concurrent medications, the evaluation demonstrated potential of the system for improving clinical decision-making for multimorbidity patients.

Ideating Mobile Health Behavioral Support for Compliance to Therapy for Patients with Chronic Disease: A Case Study of Atrial Fibrillation Management.

Poor patient compliance to therapy results in a worsening condition that often increases healthcare costs. In the MobiGuide project, we developed an evidence-based clinical decision-support system that delivered personalized reminders and recommendations to patients, helping to achieve higher therapy compliance. Yet compliance could still be improved and therefore building on the MobiGuide project experience, we designed a new component called the Motivational Patient Assistant (MPA) that is integrated within the MobiGuide architecture to further improve compliance. This component draws from psychological theories to provide behavioral support to improve patient engagement and thereby increasing patients' compliance. Behavior modification interventions are delivered via mobile technology at patients' home environments. Our approach was inspired by the IDEAS (Integrate, Design, Assess, and Share) framework for developing effective digital interventions to change health behavior; it goes beyond this approach by extending the Ideation phase' concepts into concrete backend architectural components and graphical user-interface designs that implement behavioral interventions. We describe in detail our ideation approach and how it was applied to design the user interface of MPA for anticoagulation therapy for the atrial fibrillation patients. We report results of a preliminary evaluation involving patients and care providers that shows the potential usefulness of the MPA for improving compliance to anticoagulation therapy.

A model-driven methodology for exploring complex disease comorbidities applied to autism spectrum disorder and inflammatory bowel disease.

We propose a model-driven methodology aimed to shed light on complex disorders. Our approach enables exploring shared etiologies of comorbid diseases at the molecular pathway level. The method, Comparative Comorbidities Simulation (CCS), uses stochastic Petri net simulation for examining the phenotypic effects of perturbation of a network known to be involved in comorbidities to predict new roles for mutations in comorbid conditions. To demonstrate the utility of our novel methodology, we investigated the molecular convergence of autism spectrum disorder (ASD) and inflammatory bowel disease (IBD) on the autophagy pathway. In addition to validation by domain experts, we used formal analyses to demonstrate the model's self-consistency. We then used CCS to compare the effects of loss of function (LoF) mutations previously implicated in either ASD or IBD on the autophagy pathway. CCS identified similar dynamic consequences of these mutations in the autophagy pathway. Our method suggests that two LoF mutations previously implicated in IBD may contribute to ASD, and one ASD-implicated LoF mutation may play a role in IBD. Future targeted genomic or functional studies could be designed to directly test these predictions.

An ontology for Autism Spectrum Disorder (ASD) to infer ASD phenotypes from Autism Diagnostic Interview-Revised data.

OBJECTIVE: Our goal is to create an ontology that will allow data integration and reasoning with subject data to classify subjects, and based on this classification, to infer new knowledge on Autism Spectrum Disorder (ASD) and related neurodevelopmental disorders (NDD). We take a first step toward this goal by extending an existing autism ontology to allow automatic inference of ASD phenotypes and Diagnostic & Statistical Manual of Mental Disorders (DSM) criteria based on subjects' Autism Diagnostic Interview-Revised (ADI-R) assessment data. MATERIALS AND METHODS: Knowledge regarding diagnostic instruments, ASD phenotypes and risk factors was added to augment an existing autism ontology via Ontology Web Language class definitions and semantic web rules. We developed a custom Protégé plugin for enumerating combinatorial OWL axioms to support the many-to-many relations of ADI-R items to diagnostic categories in the DSM. We utilized a reasoner to infer whether 2642 subjects, whose data was obtained from the Simons Foundation Autism Research Initiative, meet DSM-IV-TR (DSM-IV) and DSM-5 diagnostic criteria based on their ADI-R data. RESULTS: We extended the ontology by adding 443 classes and 632 rules that represent phenotypes, along with their synonyms, environmental risk factors, and frequency of comorbidities. Applying the rules on the data set showed that the method produced accurate results: the true positive and true negative rates for inferring autistic disorder diagnosis according to DSM-IV criteria were 1 and 0.065, respectively; the true positive rate for inferring ASD based on DSM-5 criteria was 0.94. DISCUSSION: The ontology allows automatic inference of subjects' disease phenotypes and diagnosis with high accuracy. CONCLUSION: The ontology may benefit future studies by serving as a knowledge base for ASD. In addition, by adding knowledge of related NDDs, commonalities and differences in manifestations and risk factors could be automatically inferred, contributing to the understanding of ASD pathophysiology.

The Ontology of Clinical Research (OCRe): an informatics foundation for the science of clinical research.

To date, the scientific process for generating, interpreting, and applying knowledge has received less informatics attention than operational processes for conducting clinical studies. The activities of these scientific processes - the science of clinical research - are centered on the study protocol, which is the abstract representation of the scientific design of a clinical study. The Ontology of Clinical Research (OCRe) is an OWL 2 model of the entities and relationships of study design protocols for the purpose of computationally supporting the design and analysis of human studies. OCRe's modeling is independent of any specific study design or clinical domain. It includes a study design typology and a specialized module called ERGO Annotation for capturing the meaning of eligibility criteria. In this paper, we describe the key informatics use cases of each phase of a study's scientific lifecycle, present OCRe and the principles behind its modeling, and describe applications of OCRe and associated technologies to a range of clinical research use cases. OCRe captures the central semantics that underlies the scientific processes of clinical research and can serve as an informatics foundation for supporting the entire range of knowledge activities that constitute the science of clinical research.

A Computer-Interpretable Version of the AACE, AME, ETA Medical Guidelines for Clinical Practice for the Diagnosis and Management of Thyroid Nodules.

OBJECTIVE: Clinical practice guidelines (CPGs) could have a more consistent and meaningful impact on clinician behavior if they were delivered as electronic algorithms that provide patient-specific advice during patient-physician encounters. We developed a computer-interpretable algorithm for U.S. and European users for the purpose of diagnosis and management of thyroid nodules that is based on the "AACE, AME, ETA Medical Guidelines for Clinical Practice for the Diagnosis and Management of Thyroid Nodules," a narrative, evidence-based CPG. METHODS: We initially employed the guideline-modeling language GuideLine Interchange Format, version 3, known as GLIF3, which emphasizes the organization of a care algorithm into a flowchart. The flowchart specified the sequence of tasks required to evaluate a patient with a thyroid nodule. PROforma, a second guideline-modeling language, was then employed to work with data that are not necessarily obtained in a rigid flowchart sequence. Tallis-a user-friendly web-based "enactment tool"- was then used as the "execution engine" (computer program). This tool records and displays tasks that are done and prompts users to perform the next indicated steps. The development process was iteratively performed by clinical experts and knowledge engineers. RESULTS: We developed an interactive web-based electronic algorithm that is based on a narrative CPG. This algorithm can be used in a variety of regions, countries, and resource-specific settings. CONCLUSION: Electronic guidelines provide patient-specific decision support that could standardize care and potentially improve the quality of care. The "demonstrator" electronic thyroid nodule guideline that we describe in this report is available at http://demos.deontics.com/trace-review-app (username: reviewer; password: tnodule1). The demonstrator must be more extensively "trialed" before it is recommended for routine use.

Machine learning on longitudinal multi-modal data enables the understanding and prognosis of Alzheimer's disease progression.

Alzheimer's disease (AD) is a complex pathophysiological disease. Allowing for heterogeneity, not only in disease manifestations but also in different progression patterns, is critical for developing effective disease models that can be used in clinical and research settings. We introduce a machine learning model for identifying underlying patterns in Alzheimer's disease (AD) trajectory using longitudinal multi-modal data from the ADNI cohort and the AIBL cohort. Ten biologically and clinically meaningful disease-related states were identified from data, which constitute three non-overlapping stages (i.e., neocortical atrophy [NCA], medial temporal atrophy [MTA], and whole brain atrophy [WBA]) and two distinct disease progression patterns (i.e., NCA → WBA and MTA → WBA). The index of disease-related states provided a remarkable performance in predicting the time to conversion to AD dementia (C-Index: 0.923 ± 0.007). Our model shows potential for promoting the understanding of heterogeneous disease progression and early predicting the conversion time to AD dementia.

Computer-interpretable clinical guidelines: a methodological review.

Clinical practice guidelines (CPGs) aim to improve the quality of care, reduce unjustified practice variations and reduce healthcare costs. In order for them to be effective, clinical guidelines need to be integrated with the care flow and provide patient-specific advice when and where needed. Hence, their formalization as computer-interpretable guidelines (CIGs) makes it possible to develop CIG-based decision-support systems (DSSs), which have a better chance of impacting clinician behavior than narrative guidelines. This paper reviews the literature on CIG-related methodologies since the inception of CIGs, while focusing and drawing themes for classifying CIG research from CIG-related publications in the Journal of Biomedical Informatics (JBI). The themes span the entire life-cycle of CIG development and include: knowledge acquisition and specification for improved CIG design, including (1) CIG modeling languages and (2) CIG acquisition and specification methodologies, (3) integration of CIGs with electronic health records (EHRs) and organizational workflow, (4) CIG validation and verification, (5) CIG execution engines and supportive tools, (6) exception handling in CIGs, (7) CIG maintenance, including analyzing clinician's compliance to CIG recommendations and CIG versioning and evolution, and finally (8) CIG sharing. I examine the temporal trends in CIG-related research and discuss additional themes that were not identified in JBI papers, including existing themes such as overcoming implementation barriers, modeling clinical goals, and temporal expressions, as well as futuristic themes, such as patient-centric CIGs and distributed CIGs.

Fluid-structure interaction model of aortic valve with porcine-specific collagen fiber alignment in the cusps.

Native aortic valve cusps are composed of collagen fibers embedded in their layers. Each valve cusp has its own distinctive fiber alignment with varying orientations and sizes of its fiber bundles. However, prior mechanical behavior models have not been able to account for the valve-specific collagen fiber networks (CFN) or for their differences between the cusps. This study investigates the influence of this asymmetry on the hemodynamics by employing two fully coupled fluid-structure interaction (FSI) models, one with asymmetric-mapped CFN from measurements of porcine valve and the other with simplified-symmetric CFN. The FSI models are based on coupled structural and fluid dynamic solvers. The partitioned solver has nonconformal meshes and the flow is modeled by employing the Eulerian approach. The collagen in the CFNs, the surrounding elastin matrix, and the aortic sinus tissues have hyperelastic mechanical behavior. The coaptation is modeled with a master-slave contact algorithm. A full cardiac cycle is simulated by imposing the same physiological blood pressure at the upstream and downstream boundaries for both models. The mapped case showed highly asymmetric valve kinematics and hemodynamics even though there were only small differences between the opening areas and cardiac outputs of the two cases. The regions with a less dense fiber network are more prone to damage since they are subjected to higher principal stress in the tissues and a higher level of flow shear stress. This asymmetric flow leeward of the valve might damage not only the valve itself but also the ascending aorta.

Identifying underlying patterns in Alzheimer's disease trajectory: a deep learning approach and Mendelian randomization analysis.

Background: Alzheimer's disease (AD) is a heterogeneously progressive neurodegeneration disorder with varied rates of deterioration, either between subjects or within different stages of a certain subject. Estimating the course of AD at early stages has treatment implications. We aimed to analyze disease progression to identify distinct patterns in AD trajectory. Methods: We proposed a deep learning model to identify underlying patterns in the trajectory from cognitively normal (CN) to a state of mild cognitive impairment (MCI) to AD dementia, by jointly predicting time-to-conversion and clustering out distinct subgroups characterized by comprehensive features as well as varied progression rates. We designed and validated our model on the ADNI dataset (1370 participants). Prediction of time-to-conversion in AD trajectory was used to validate the expression of the identified patterns. Causality between patterns and time-to-conversion was further inferred using Mendelian randomization (MR) analysis. External validation was performed on the AIBL dataset (233 participants). Findings: The proposed model clustered out patterns characterized by significantly different biomarkers and varied progression rates. The discovered patterns also showed a strong prediction ability, as indicated by hazard ratio (CN→MCI, HR = 3.51, p < 0.001; MCI→AD, HR = 8.11, p < 0.001), C-Index (CN→MCI, 0.618; MCI→AD, 0.718), and AUC (CN→MCI, 3 years 0.802, 5 years 0.876; MCI→AD, 3 years 0.914, 5 years 0.957). In the external validation cohort, our model demonstrated competitive performance on conversion time prediction (CN→MCI, C-Index = 0.693; MCI→AD, C-Index = 0.752). Moreover, suggestive associations between CN→MCI/MCI→AD patterns with four/three SNPs were mediated and MR analysis indicated a causal link between MCI→AD patterns and time-to-conversion in the first three years. Interpretation: Our proposed model identifies biologically and clinically meaningful patterns from real-world data and provides promising performance on time-to-conversion prediction in AD trajectory, which could promote the understanding of disease progression, facilitate clinical trial design, and provide potential for decision-making. Funding: The National Key Research and Development Program of China, the Key R&D Program of Zhejiang, and the National Nature Science Foundation of China.