Provision and evaluation of explanations within an automated planning-based approach to solving the multimorbidity problem.

The multimorbidity problem involves the identification and mitigation of adverse interactions that occur when multiple computer interpretable guidelines are applied concurrently to develop a treatment plan for a patient diagnosed with multiple diseases. Solving this problem requires decision support approaches which are difficult to comprehend for physicians. As such, the rationale for treatment plans generated by these approaches needs to be provided. OBJECTIVE: To develop an explainability component for an automated planning-based approach to the multimorbidity problem, and to assess the fidelity and interpretability of generated explanations using a clinical case study. METHODS: The explainability component leverages the task-network model for representing computer interpretable guidelines. It generates post-hoc explanations composed of three aspects that answer why specific clinical actions are in a treatment plan, why specific revisions were applied, and how factors like medication cost, patient's adherence, etc. influence the selection of specific actions. The explainability component is implemented as part of MitPlan, where we revised our planning-based approach to support explainability. We developed an evaluation instrument based on the system causability scale and other vetted surveys to evaluate the fidelity and interpretability of its explanations using a two dimensional comparison study design. RESULTS: The explainability component was implemented for MitPlan and tested in the context of a clinical case study. The fidelity and interpretability of the generated explanations were assessed using a physician-focused evaluation study involving 21 participants from two different specialties and two levels of experience. Results show that explanations provided by the explainability component in MitPlan are of acceptable fidelity and interpretability, and that the clinical justification of the actions in a treatment plan is important to physicians. CONCLUSION: We created an explainability component that enriches an automated planning-based approach to solving the multimorbidity problem with meaningful explanations for actions in a treatment plan. This component relies on the task-network model to represent computer interpretable guidelines and as such can be ported to other approaches that also use the task-network model representation. Our evaluation study demonstrated that explanations that support a physician's understanding of the clinical reasons for the actions in a treatment plan are useful and important.

The ChatGPT Effect: Nursing Education and Generative Artificial Intelligence.

This article examines the potential of generative artificial intelligence (AI), such as ChatGPT (Chat Generative Pre-trained Transformer), in nursing education and the associated challenges and recommendations for their use. Generative AI offers potential benefits such as aiding students with assignments, providing realistic patient scenarios for practice, and enabling personalized, interactive learning experiences. However, integrating generative AI in nursing education also presents challenges, including academic integrity issues, the potential for plagiarism and copyright infringements, ethical implications, and the risk of producing misinformation. Clear institutional guidelines, comprehensive student education on generative AI, and tools to detect AI-generated content are recommended to navigate these challenges. The article concludes by urging nurse educators to harness generative AI's potential responsibly, highlighting the rewards of enhanced learning and increased efficiency. The careful navigation of these challenges and strategic implementation of AI is key to realizing the promise of AI in nursing education. [J Nurs Educ. 2024;63(X):XXX-XXX.].

A Conversational Agent for Early Detection of Neurotoxic Effects of Medications through Automated Intensive Observation.

We present a fully automated AI-based system for intensive monitoring of cognitive symptoms of neurotoxicity that frequently appear as a result of immunotherapy of hematologic malignancies. Early manifestations of these symptoms are evident in the patient's speech in the form of mild aphasia and confusion and can be detected and effectively treated prior to onset of more serious and potentially life-threatening impairment. We have developed the Automated Neural Nursing Assistant (ANNA) system designed to conduct a brief cognitive assessment several times per day over the telephone for 5-14 days following infusion of the immunotherapy medication. ANNA uses a conversational agent based on a large language model to elicit spontaneous speech in a semi-structured dialogue, followed by a series of brief language-based neurocognitive tests. In this paper we share ANNA's design and implementation, results of a pilot functional evaluation study, and discuss technical and logistic challenges facing the introduction of this type of technology in clinical practice. A large-scale clinical evaluation of ANNA will be conducted in an observational study of patients undergoing immunotherapy at the University of Minnesota Masonic Cancer Center starting in the Fall 2023.

TRESTLE: Toolkit for Reproducible Execution of Speech, Text and Language Experiments.

The evidence is growing that machine and deep learning methods can learn the subtle differences between the language produced by people with various forms of cognitive impairment such as dementia and cognitively healthy individuals. Valuable public data repositories such as TalkBank have made it possible for researchers in the computational community to join forces and learn from each other to make significant advances in this area. However, due to variability in approaches and data selection strategies used by various researchers, results obtained by different groups have been difficult to compare directly. In this paper, we present TRESTLE (Toolkit for Reproducible Execution of Speech Text and Language Experiments), an open source platform that focuses on two datasets from the TalkBank repository with dementia detection as an illustrative domain. Successfully deployed in the hackallenge (Hackathon/Challenge) of the International Workshop on Health Intelligence at AAAI 2022, TRESTLE provides a precise digital blueprint of the data pre-processing and selection strategies that can be reused via TRESTLE by other researchers seeking comparable results with their peers and current state-of-the-art (SOTA) approaches.

Using graph rewriting to operationalize medical knowledge for the revision of concurrently applied clinical practice guidelines.

Clinical practice guidelines (CPGs) are patient management tools that synthesize medical knowledge into an actionable format. CPGs are disease specific with limited applicability to the management of complex patients suffering from multimorbidity. For the management of these patients, CPGs need to be augmented with secondary medical knowledge coming from a variety of knowledge repositories. The operationalization of this knowledge is key to increasing CPGs' uptake in clinical practice. In this work, we propose an approach to operationalizing secondary medical knowledge inspired by graph rewriting. We assume that the CPGs can be represented as task network models, and provide an approach for representing and applying codified medical knowledge to a specific patient encounter. We formally define revisions that model and mitigate adverse interactions between CPGs and we use a vocabulary of terms to instantiate these revisions. We demonstrate the application of our approach using synthetic and clinical examples. We conclude by identifying areas for future work with the vision of developing a theory of mitigation that will facilitate the development of comprehensive decision support for the management of multimorbid patients.

A community-of-practice-based evaluation methodology for knowledge intensive computational methods and its application to multimorbidity decision support.

OBJECTIVE: The study has dual objectives. Our first objective (1) is to develop a community-of-practice-based evaluation methodology for knowledge-intensive computational methods. We target a whitebox analysis of the computational methods to gain insight on their functional features and inner workings. In more detail, we aim to answer evaluation questions on (i) support offered by computational methods for functional features within the application domain; and (ii) in-depth characterizations of the underlying computational processes, models, data and knowledge of the computational methods. Our second objective (2) involves applying the evaluation methodology to answer questions (i) and (ii) for knowledge-intensive clinical decision support (CDS) methods, which operationalize clinical knowledge as computer interpretable guidelines (CIG); we focus on multimorbidity CIG-based clinical decision support (MGCDS) methods that target multimorbidity treatment plans. MATERIALS AND METHODS: Our methodology directly involves the research community of practice in (a) identifying functional features within the application domain; (b) defining exemplar case studies covering these features; and (c) solving the case studies using their developed computational methods-research groups detail their solutions and functional feature support in solution reports. Next, the study authors (d) perform a qualitative analysis of the solution reports, identifying and characterizing common themes (or dimensions) among the computational methods. This methodology is well suited to perform whitebox analysis, as it directly involves the respective developers in studying inner workings and feature support of computational methods. Moreover, the established evaluation parameters (e.g., features, case studies, themes) constitute a re-usable benchmark framework, which can be used to evaluate new computational methods as they are developed. We applied our community-of-practice-based evaluation methodology on MGCDS methods. RESULTS: Six research groups submitted comprehensive solution reports for the exemplar case studies. Solutions for two of these case studies were reported by all groups. We identified four evaluation dimensions: detection of adverse interactions, management strategy representation, implementation paradigms, and human-in-the-loop support. Based on our whitebox analysis, we present answers to the evaluation questions (i) and (ii) for MGCDS methods. DISCUSSION: The proposed evaluation methodology includes features of illuminative and comparison-based approaches; focusing on understanding rather than judging/scoring or identifying gaps in current methods. It involves answering evaluation questions with direct involvement of the research community of practice, who participate in setting up evaluation parameters and solving exemplar case studies. Our methodology was successfully applied to evaluate six MGCDS knowledge-intensive computational methods. We established that, while the evaluated methods provide a multifaceted set of solutions with different benefits and drawbacks, no single MGCDS method currently provides a comprehensive solution for MGCDS. CONCLUSION: We posit that our evaluation methodology, applied here to gain new insights into MGCDS, can be used to assess other types of knowledge-intensive computational methods and answer other types of evaluation questions. Our case studies can be accessed at our GitHub repository (https://github.com/william-vw/MGCDS).

Applied artificial intelligence in healthcare: Listening to the winds of change in a post-COVID-19 world.

This editorial article aims to highlight advances in artificial intelligence (AI) technologies in five areas: Collaborative AI, Multimodal AI, Human-Centered AI, Equitable AI, and Ethical and Value-based AI in order to cope with future complex socioeconomic and public health issues.

Predictive models for social functioning in healthy young adults: A machine learning study integrating neuroanatomical, cognitive, and behavioral data.

Poor social functioning is an emerging public health problem associated with physical and mental health consequences. Developing prognostic tools is critical to identify individuals at risk for poor social functioning and guide interventions. We aimed to inform prediction models of social functioning by evaluating models relying on bio-behavioral data using machine learning. With data from the Human Connectome Project Healthy Young Adult sample (age 22-35, N = 1,101), we built Support Vector Regression models to estimate social functioning from variable sets of brain morphology to behavior with increasing complexity: 1) brain-only model, 2) brain-cognition model, 3) cognition-behavioral model, and 4) combined brain-cognition-behavioral model. Predictive accuracy of each model was assessed and the importance of individual variables for model performance was determined. The combined and cognition-behavioral models significantly predicted social functioning, whereas the brain-only and brain-cognition models did not. Negative affect, psychological wellbeing, extraversion, withdrawal, and cortical thickness of the rostral middle-frontal and superior-temporal regions were the most important predictors in the combined model. Results demonstrate that social functioning can be accurately predicted using machine learning methods. Behavioral markers may be more significant predictors of social functioning than brain measures for healthy young adults and may represent important leverage points for preventative intervention.

Nurses' Utilization of Information Resources for Patient Care Tasks: A Survey of Critical Care Nurses in an Urban Hospital Setting.

Critical care nurses manage complex patient care interventions under dynamic, time-sensitive and constrained conditions, yet clinical decision support systems for nurses are limited compared with advanced practice healthcare providers. In this work, we study and analyze nurses' information-seeking behaviors to inform the development of a clinical decision support system that supports nurses. Nurses from an urban midwestern hospital were recruited to complete an online survey containing eight open-ended questions about resource utilization for various nursing tasks and open space for additional insights. Frequencies and percentages were calculated for resource type, bivariate analyses using Pearson's χ2 test were conducted for differences in resources utilization by years of experience, and content analysis of free text was completed. Forty-five nurses (response rate, 19.6%) identified 38 unique resources, which we organized into a resource taxonomy. Institutional applications were the most common type of resource used (35.6% of all responses) but accounted for only 15.4% of respondents' "go-to resources," suggesting potential areas for improvement. Our findings highlight that knowing where to look for information, the existence of comprehensive information, and fast and easy retrieval of information are key resource seeking attributes that must be considered when designing a clinical decision support system.

Artificial Intelligence -based technologies in nursing: A scoping literature review of the evidence.

BACKGROUND: Research on technologies based on artificial intelligence in healthcare has increased during the last decade, with applications showing great potential in assisting and improving care. However, introducing these technologies into nursing can raise concerns related to data bias in the context of training algorithms and potential implications for certain populations. Little evidence exists in the extant literature regarding the efficacious application of many artificial intelligence -based health technologies used in healthcare. OBJECTIVES: To synthesize currently available state-of the-art research in artificial intelligence -based technologies applied in nursing practice. DESIGN: Scoping review METHODS: PubMed, CINAHL, Web of Science and IEEE Xplore were searched for relevant articles with queries that combine names and terms related to nursing, artificial intelligence and machine learning methods. Included studies focused on developing or validating artificial intelligence -based technologies with a clear description of their impacts on nursing. We excluded non-experimental studies and research targeted at robotics, nursing management and technologies used in nursing research and education. RESULTS: A total of 7610 articles published between January 2010 and March 2021 were revealed, with 93 articles included in this review. Most studies explored the technology development (n = 55, 59.1%) and formation (testing) (n = 28, 30.1%) phases, followed by implementation (n = 9, 9.7%) and operational (n = 1, 1.1%) phases. The vast majority (73.1%) of studies provided evidence with a descriptive design (level VI) while only a small portion (4.3%) were randomised controlled trials (level II). The study aims, settings and methods were poorly described in the articles, and discussion of ethical considerations were lacking in 36.6% of studies. Additionally, one-third of papers (33.3%) were reported without the involvement of nurses. CONCLUSIONS: Contemporary research on applications of artificial intelligence -based technologies in nursing mainly cover the earlier stages of technology development, leaving scarce evidence of the impact of these technologies and implementation aspects into practice. The content of research reported is varied. Therefore, guidelines on research reporting and implementing artificial intelligence -based technologies in nursing are needed. Furthermore, integrating basic knowledge of artificial intelligence -related technologies and their applications in nursing education is imperative, and interventions to increase the inclusion of nurses throughout the technology research and development process is needed.

A Health eLearning Ontology and Procedural Reasoning Approach for Developing Personalized Courses to Teach Patients about Their Medical Condition and Treatment.

We propose a methodological framework to support the development of personalized courses that improve patients' understanding of their condition and prescribed treatment. Inspired by Intelligent Tutoring Systems (ITSs), the framework uses an eLearning ontology to express domain and learner models and to create a course. We combine the ontology with a procedural reasoning approach and precompiled plans to operationalize a design across disease conditions. The resulting courses generated by the framework are personalized across four patient axes-condition and treatment, comprehension level, learning style based on the VARK (Visual, Aural, Read/write, Kinesthetic) presentation model, and the level of understanding of specific course content according to Bloom's taxonomy. Customizing educational materials along these learning axes stimulates and sustains patients' attention when learning about their conditions or treatment options. Our proposed framework creates a personalized course that prepares patients for their meetings with specialists and educates them about their prescribed treatment. We posit that the improvement in patients' understanding of prescribed care will result in better outcomes and we validate that the constructs of our framework are appropriate for representing content and deriving personalized courses for two use cases: anticoagulation treatment of an atrial fibrillation patient and lower back pain management to treat a lumbar degenerative disc condition. We conduct a mostly qualitative study supported by a quantitative questionnaire to investigate the acceptability of the framework among the target patient population and medical practitioners.

Artificial intelligence in nursing: Priorities and opportunities from an international invitational think-tank of the Nursing and Artificial Intelligence Leadership Collaborative.

AIM: To develop a consensus paper on the central points of an international invitational think-tank on nursing and artificial intelligence (AI). METHODS: We established the Nursing and Artificial Intelligence Leadership (NAIL) Collaborative, comprising interdisciplinary experts in AI development, biomedical ethics, AI in primary care, AI legal aspects, philosophy of AI in health, nursing practice, implementation science, leaders in health informatics practice and international health informatics groups, a representative of patients and the public, and the Chair of the ITU/WHO Focus Group on Artificial Intelligence for Health. The NAIL Collaborative convened at a 3-day invitational think tank in autumn 2019. Activities included a pre-event survey, expert presentations and working sessions to identify priority areas for action, opportunities and recommendations to address these. In this paper, we summarize the key discussion points and notes from the aforementioned activities. IMPLICATIONS FOR NURSING: Nursing's limited current engagement with discourses on AI and health posts a risk that the profession is not part of the conversations that have potentially significant impacts on nursing practice. CONCLUSION: There are numerous gaps and a timely need for the nursing profession to be among the leaders and drivers of conversations around AI in health systems. IMPACT: We outline crucial gaps where focused effort is required for nursing to take a leadership role in shaping AI use in health systems. Three priorities were identified that need to be addressed in the near future: (a) Nurses must understand the relationship between the data they collect and AI technologies they use; (b) Nurses need to be meaningfully involved in all stages of AI: from development to implementation; and (c) There is a substantial untapped and an unexplored potential for nursing to contribute to the development of AI technologies for global health and humanitarian efforts.

MitPlan: A planning approach to mitigating concurrently applied clinical practice guidelines.

As the population ages, patients' complexity and the scope of their care is increasing. Over 60% of the population is 65 years of age or older and suffers from multi-morbidity, which is associated with two times as many patient-physician encounters. Yet clinical practice guidelines (CPGs) are developed to treat a single disease. To reconcile these two competing issues, previously we developed a framework for mitigation, i.e., identifying and addressing adverse interactions in multi-morbid patients managed according to multiple CPGs. That framework relies on first-order logic (FOL) to represent CPGs and secondary medical knowledge and FOL theorem proving to establish valid patient management plans. In the work presented here, we leverage our earlier research and simplify the mitigation process by representing it as a planning problem using the Planning Domain Definition Language (PDDL). This new framework, called MitPlan, identifies and addresses adverse interactions using durative planning actions that embody clinical actions (including medication administration and patient testing), supports a physician-defined length of planning horizons, and optimizes plans based on patient preferences and action costs. It supports a variety of criteria when developing management plans, including the total cost of prescribed treatment and the cost of the revisions to be introduced. The solution to MitPlan's planning problem is a sequence of timed actions that are easy to interpret when creating a management plan. We demonstrate MitPlan's capabilities using illustrative and clinical case studies.

Towards a framework for comparing functionalities of multimorbidity clinical decision support: A literature-based feature set and benchmark cases.

Multimorbidity, the coexistence of two or more health conditions, has become more prevalent as mortality rates in many countries have declined and their populations have aged. Multimorbidity presents significant difficulties for Clinical Decision Support Systems (CDSS), particularly in cases where recommendations from relevant clinical guidelines offer conflicting advice. A number of research groups are developing computer-interpretable guideline (CIG) modeling formalisms that integrate recommendations from multiple Clinical Practice Guidelines (CPGs) for knowledge-based multimorbidity decision support. In this paper we describe work towards the development of a framework for comparing the different approaches to multimorbidity CIG-based clinical decision support (MGCDS). We present (1) a set of features for MGCDS, which were derived using a literature review and evaluated by physicians using a survey, and (2) a set of benchmarking case studies, which illustrate the clinical application of these features. This work represents the first necessary step in a broader research program aimed at the development of a benchmark framework that allows for standardized and comparable MGCDS evaluations, which will facilitate the assessment of functionalities of MGCDS, as well as highlight important gaps in the state-of-the-art. We also outline our future work on developing the framework, specifically, (3) a standard for reporting MGCDS solutions for the benchmark case studies, and (4) criteria for evaluating these MGCDS solutions. We plan to conduct a large-scale comparison study of existing MGCDS based on the comparative framework.

How Do Spinal Surgeons Perceive The Impact of Factors Used in Post-Surgical Complication Risk Scores?

When deciding about surgical treatment options, an important aspect of the decision-making process is the potential risk of complications. A risk assessment performed by a spinal surgeon is based on their knowledge of the best available evidence and on their own clinical experience. The objective of this work is to demonstrate the differences in the way spine surgeons perceive the importance of attributes used to calculate risk of post-operative and quantify the differences by building individual formal models of risk perceptions. We employ a preference-learning method - ROR-UTADIS - to build surgeon-specific additive value functions for risk of complications. Comparing these functions enables the identification and discussion of differences among personal perceptions of risk factors. Our results show there exist differences in surgeons' perceived factors including primary diagnosis, type of surgery, patient's age, body mass index, or presence of comorbidities.

Ideating Mobile Health Behavioral Support for Compliance to Therapy for Patients with Chronic Disease: A Case Study of Atrial Fibrillation Management.

Poor patient compliance to therapy results in a worsening condition that often increases healthcare costs. In the MobiGuide project, we developed an evidence-based clinical decision-support system that delivered personalized reminders and recommendations to patients, helping to achieve higher therapy compliance. Yet compliance could still be improved and therefore building on the MobiGuide project experience, we designed a new component called the Motivational Patient Assistant (MPA) that is integrated within the MobiGuide architecture to further improve compliance. This component draws from psychological theories to provide behavioral support to improve patient engagement and thereby increasing patients' compliance. Behavior modification interventions are delivered via mobile technology at patients' home environments. Our approach was inspired by the IDEAS (Integrate, Design, Assess, and Share) framework for developing effective digital interventions to change health behavior; it goes beyond this approach by extending the Ideation phase' concepts into concrete backend architectural components and graphical user-interface designs that implement behavioral interventions. We describe in detail our ideation approach and how it was applied to design the user interface of MPA for anticoagulation therapy for the atrial fibrillation patients. We report results of a preliminary evaluation involving patients and care providers that shows the potential usefulness of the MPA for improving compliance to anticoagulation therapy.