Machine Learning for Clinical Decision Support of Acute Streptococcal Pharyngitis: A Pilot Study.

BACKGROUND: Group A Streptococcus (GAS) is the predominant bacterial pathogen of pharyngitis in children. However, distinguishing GAS from viral pharyngitis is sometimes difficult. Unnecessary antibiotic use contributes to unwanted side effects, such as allergic reactions and diarrhea. It also may increase antibiotic resistance. OBJECTIVES: To evaluate the effect of a machine learning algorithm on the clinical evaluation of bacterial pharyngitis in children. METHODS: We assessed 54 children aged 2-17 years who presented to a primary healthcare clinic with a sore throat and fever over 38°C from 1 November 2021 to 30 April 2022. All children were tested with a streptococcal rapid antigen detection test (RADT). If negative, a throat culture was performed. Children with a positive RADT or throat culture were considered GAS-positive and treated antibiotically for 10 days, as per guidelines. Children with negative RADT tests throat cultures were considered positive for viral pharyngitis. The children were allocated into two groups: Group A streptococcal pharyngitis (GAS-P) (n=36) and viral pharyngitis (n=18). All patients underwent a McIsaac score evaluation. A linear support vector machine algorithm was used for classification. RESULTS: The machine learning algorithm resulted in a positive predictive value of 80.6 % (27 of 36) for GAS-P infection. The false discovery rates for GAS-P infection were 19.4 % (7 of 36). CONCLUSIONS: Applying the machine-learning strategy resulted in a high positive predictive value for the detection of streptococcal pharyngitis and can contribute as a medical decision aid in the diagnosis and treatment of GAS-P.

Integrating artificial intelligence techniques for advancements in colorectal cancer management: navigating past and predicting future direction.

Artificial Intelligence (AI) in the last few years has emerged as a valuable tool in managing colorectal cancer, revolutionizing its management at different stages. In early detection and diagnosis, AI leverages its prowess in imaging analysis, scrutinizing CT scans, MRI, and colonoscopy views to identify polyps and tumors. This ability enables timely and accurate diagnoses, initiating treatment at earlier stages. AI has helped in personalized treatment planning because of its ability to integrate diverse patient data, including tumor characteristics, medical history, and genetic information. Integrating AI into clinical decision support systems guarantees evidence-based treatment strategy suggestions in multidisciplinary clinical settings, thus improving patient outcomes. This narrative review explores the multifaceted role of AI, spanning early detection of colorectal cancer, personalized treatment planning, polyp detection, lymph node evaluation, cancer staging, robotic colorectal surgery, and training of colorectal surgeons.

Resident-Driven Clinical Decision Support Governance to Improve the Utility of Clinical Decision Support.

OBJECTIVES: This resident-driven quality improvement project aimed to better understand the known problem of a misaligned clinical decision support (CDS) strategy and improve CDS utilization. METHODS: An internal survey was sent to all internal medicine (IM) residents to identify the most bothersome CDS alerts. Survey results were supported by electronic health record (EHR) data of CDS firing rates and response rates which were collected for each of the three most bothersome CDS tools. Changes to firing criteria were created to increase utilization and to better align with the five rights of CDS. Findings and proposed changes were presented to our institution's CDS Governance Committee. Changes were approved and implemented. Postintervention firing rates were then collected for 1 week. RESULTS: Twenty nine residents participated in the CDS survey and identified sepsis alerts, lipid profile reminders, and telemetry renewals to be the most bothersome alerts. EHR data showed action rates for these CDS as low as 1%. We implemented changes to focus emergency department (ED)-based sepsis alerts to the right provider, better address the right information for lipid profile reminders, and select the right time in workflow for telemetry renewals to be most effective. With these changes we successfully eliminated ED-based sepsis CDS reminders for IM providers, saw a 97% reduction in firing rates for the lipid profile CDS, and noted a 55% reduction in firing rates for telemetry CDS. CONCLUSION: This project highlighted that alert improvements spearheaded by resident teams can be completed successfully using robust CDS governance strategies and can effectively optimize interruptive alerts.

Improving routine use of clinical pathway decision support through integration of an EHR with a clinical library resource designed to provide evidence-based guidance within oncology workflows.

BACKGROUND: The rapid evolution, complexity, and specialization of oncology treatment makes it challenging for physicians to provide care based on the latest and best evidence. We hypothesized that physicians would use evidence-based trusted care pathways if they were easy to use and integrated into clinical workflow at the point of care. METHODS: Within a large integrated care delivery system, we assembled clinical experts to define and update drug treatment pathways, encoded them as flowcharts in an online library integrated with the electronic medical record, communicated expectations that clinicians would use these pathways for every eligible patient, and combined data from multiple sources to understand usage over time. RESULTS: We were able to achieve > 75% utilization of eligible protocols ordered through these pathways within two years, with > 90% of individual oncologists having consulted the pathway at least once, despite no requirements or external incentives associated with pathway usage. Feedback from users contributed to improvements and updates to the guidance. CONCLUSIONS: By making our clinical decision support easily accessible and actionable, we find that we have made considerable progress toward our goal of having physicians consult the latest evidence in their treatment decisions.

User-Centered Framework for Implementation of Technology (UFIT): Development of an Integrated Framework for Designing Clinical Decision Support Tools Packaged With Tailored Implementation Strategies.

BACKGROUND: Electronic health record-based clinical decision support (CDS) tools can facilitate the adoption of evidence into practice. Yet, the impact of CDS beyond single-site implementation is often limited by dissemination and implementation barriers related to site- and user-specific variation in workflows and behaviors. The translation of evidence-based CDS from initial development to implementation in heterogeneous environments requires a framework that assures careful balancing of fidelity to core functional elements with adaptations to ensure compatibility with new contexts. OBJECTIVE: This study aims to develop and apply a framework to guide tailoring and implementing CDS across diverse clinical settings. METHODS: In preparation for a multisite trial implementing CDS for pediatric overweight or obesity in primary care, we developed the User-Centered Framework for Implementation of Technology (UFIT), a framework that integrates principles from user-centered design (UCD), human factors/ergonomics theories, and implementation science to guide both CDS adaptation and tailoring of related implementation strategies. Our transdisciplinary study team conducted semistructured interviews with pediatric primary care clinicians and a diverse group of stakeholders from 3 health systems in the northeastern, midwestern, and southeastern United States to inform and apply the framework for our formative evaluation. RESULTS: We conducted 41 qualitative interviews with primary care clinicians (n=21) and other stakeholders (n=20). Our workflow analysis found 3 primary ways in which clinicians interact with the electronic health record during primary care well-child visits identifying opportunities for decision support. Additionally, we identified differences in practice patterns across contexts necessitating a multiprong design approach to support a variety of workflows, user needs, preferences, and implementation strategies. CONCLUSIONS: UFIT integrates theories and guidance from UCD, human factors/ergonomics, and implementation science to promote fit with local contexts for optimal outcomes. The components of UFIT were used to guide the development of Improving Pediatric Obesity Practice Using Prompts, an integrated package comprising CDS for obesity or overweight treatment with tailored implementation strategies. TRIAL REGISTRATION: ClinicalTrials.gov NCT05627011; https://clinicaltrials.gov/study/NCT05627011.

Appropriateness of intended antibiotic prescribing using clinical case vignettes in primary care, and related factors.

BACKGROUND: Factors associated with the appropriateness of antibiotic prescribing in primary care have been poorly explored. In particular, the impact of computerised decision-support systems (CDSS) remains unknown. OBJECTIVES: We aim at investigating the uptake of CDSS and its association with physician characteristics and professional activity. METHODS: Since May 2022, users of a CDSS for antibiotic prescribing in primary care in France have been invited, when registering, to complete three case vignettes assessing clinical situations frequently encountered in general practice and identified as at risk of antibiotic misuse. Appropriateness of antibiotic prescribing was defined as the rate of answers in line with the current guidelines, computed by individuals and by specific questions. Physician's characteristics associated with individual appropriate antibiotic prescribing (< 50%, 50-75% and > 75% appropriateness) were identified by multivariate ordinal logistic regression. RESULTS: In June 2023, 60,067 physicians had registered on the CDSS. Among the 13,851 physicians who answered all case vignettes, the median individual appropriateness level of antibiotic prescribing was 77.8% [Interquartile range, 66.7%-88.9%], and was < 50% for 1,353 physicians (10%). In the multivariate analysis, physicians' characteristics associated with appropriateness were prior use of the CDSS (OR = 1.71, 95% CI 1.56-1.87), being a general practitioner vs. other specialist (OR = 1.34, 95% CI 1.20-1.49), working in primary care (OR = 1.14, 95% CI 1.02-1.27), mentoring students (OR = 1.12, 95% CI 1.04-1.21) age (OR = 0.69 per 10 years increase, 95% CI 0.67-0.71). CONCLUSION: Individual appropriateness for antibiotic prescribing was high among CDSS users, with a higher rate in young general practitioners, previously using the system. CDSS could improve antibiotic prescribing in primary care.

Individual appropriateness for antibiotic prescribing is high among CDSS users.CDSS use could passively improve antibiotic prescribing in primary care.Factors associated with appropriateness for antibiotic prescribing for primary care diseases are: prior use of CDSS, general practice speciality vs. other specialities, younger age and mentoring of students.

Revolutionizing decision support: a systematic literature review of contextual implementation models for electronic health records systems.

PURPOSE: This study aims to assess previously developed Electronic Health Records System (EHRS) implementation models and identify successful models for decision support. DESIGN/METHODOLOGY/APPROACH: A systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The data sources used were Scopus, PubMed and Google Scholar. The review identified peer-reviewed papers published in the English Language from January 2010 to April 2023, targeting well-defined implementation of EHRS with decision-support capabilities in healthcare. To comprehensively address the research question, we ensured that all potential sources of evidence were considered, and quantitative and qualitative studies reporting primary data and systematic review studies that directly addressed the research question were included in the review. By including these studies in our analysis, we aimed to provide a more thorough and reliable evaluation of the available evidence. FINDINGS: The findings suggest that the success of EHRS implementation is determined by organizational and human factors rather than technical factors alone. Successful implementation is dependent on a suitable implementation framework and management of EHRS. The review identified the capabilities of Clinical Decision Support (CDS) tools as essential in the effectiveness of EHRS in supporting decision-making. ORIGINALITY/VALUE: This study contributes to the existing literature on EHRS implementation models and identifies successful models for decision support. The findings can inform future implementations and guide decision-making in healthcare facilities.

Comparing the Effectiveness of a Clinical Decision Support Tool in Reducing Pediatric Opioid Dose Calculation Errors: PediPain App vs. Traditional Calculators - A Simulation-Based Randomised Controlled Study.

Wrong dose calculation medication errors are widespread in pediatric patients mainly due to weight-based dosing. PediPain app is a clinical decision support tool that provides weight- and age- based dosages for various analgesics. We hypothesized that the use of a clinical decision support tool, the PediPain app versus pocket calculators for calculating pain medication dosages in children reduces the incidence of wrong dosage calculations and shortens the time taken for calculations. The study was a randomised controlled trial comparing the PediPain app vs. pocket calculator for performing eight weight-based calculations for opioids and other analgesics. Participants were healthcare providers routinely administering opioids and other analgesics in their practice. The primary outcome was the incidence of wrong dose calculations. Secondary outcomes were the incidence of wrong dose calculations in simple versus complex calculations; time taken to complete calculations; the occurrence of tenfold; hundredfold errors; and wrong-key presses. A total of 140 residents, fellows and nurses were recruited between June 2018 and November 2019; 70 participants were randomized to control group (pocket calculator) and 70 to the intervention group (PediPain App). After randomization two participants assigned to PediPain group completed the simulation in the control group by mistake. Analysis was by intention-to-treat (PediPain app = 68 participants, pocket calculator = 72 participants). The overall incidence of wrong dose calculation was 178/576 (30.9%) for the control and 23/544 (4.23%) for PediPain App, P < 0·001. The risk difference was - 32.8% [-38.7%, -26.9%] for complex and - 20.5% [-26.3%, -14.8%] for simple calculations. Calculations took longer within control group (median of 69 Sects. [50, 96]) compared to PediPain app group, (median 48 Sects. [38, 63]), P < 0.001. There were no differences in other secondary outcomes. A weight-based clinical decision support tool, the PediPain app reduced the incidence of wrong doses calculation. Clinical decision support tools calculating medications may be valuable instruments for reducing medication errors, especially in the pediatric population.

An innovative artificial intelligence-based method to compress complex models into explainable, model-agnostic and reduced decision support systems with application to healthcare (NEAR).

BACKGROUND AND OBJECTIVE: In everyday clinical practice, medical decision is currently based on clinical guidelines which are often static and rigid, and do not account for population variability, while individualized, patient-oriented decision and/or treatment are the paradigm change necessary to enter into the era of precision medicine. Most of the limitations of a guideline-based system could be overcome through the adoption of Clinical Decision Support Systems (CDSSs) based on Artificial Intelligence (AI) algorithms. However, the black-box nature of AI algorithms has hampered a large adoption of AI-based CDSSs in clinical practice. In this study, an innovative AI-based method to compress AI-based prediction models into explainable, model-agnostic, and reduced decision support systems (NEAR) with application to healthcare is presented and validated. METHODS: NEAR is based on the Shapley Additive Explanations framework and can be applied to complex input models to obtain the contributions of each input feature to the output. Technically, the simplified NEAR models approximate contributions from input features using a custom library and merge them to determine the final output. Finally, NEAR estimates the confidence error associated with the single input feature contributing to the final score, making the result more interpretable. Here, NEAR is evaluated on a clinical real-world use case, the mortality prediction in patients who experienced Acute Coronary Syndrome (ACS), applying three different Machine Learning/Deep Learning models as implementation examples. RESULTS: NEAR, when applied to the ACS use case, exhibits performances like the ones of the AI-based model from which it is derived, as in the case of the Adaptive Boosting classifier, whose Area Under the Curve is not statistically different from the NEAR one, even the model's simplification. Moreover, NEAR comes with intrinsic explainability and modularity, as it can be tested on the developed web application platform (https://neardashboard.pythonanywhere.com/). CONCLUSIONS: An explainable and reliable CDSS tailored to single-patient analysis has been developed. The proposed AI-based system has the potential to be used alongside the clinical guidelines currently employed in the medical setting making them more personalized and dynamic and assisting doctors in taking their everyday clinical decisions.

Predictive analytics support for complex chronic medical conditions: An experience-based co-design study of physician managers' needs and preferences.

PURPOSE: The literature suggests predictive technology applications in health care would benefit from physician and manager input during design and development. The aim was to explore the needs and preferences of physician managers regarding the role of predictive analytics in decision support for patients with the highly complex yet common combination of multiple chronic conditions of cardiovascular (Heart) and kidney (Nephrology) diseases and diabetes (HND). METHODS: This qualitative study employed an experience-based co-design model comprised of three data gathering phases: 1. Patient mapping through non-participant observations informed by process mining of electronic health records data, 2. Semi-structured experience-based interviews, and 3. A co-design workshop. Data collection was conducted with physician managers working at or collaborating with the HND center, Danderyd University Hospital (DSAB), in Stockholm, Sweden. HND center is an integrated practice unit offering comprehensive person-centered multidisciplinary care to stabilize disease progression, reduce visits, and develop treatment strategies that enables a transition to primary care. RESULTS: Interview and workshop data described a complex challenge due to the interaction of underlying pathophysiologies and the subsequent need for multiple care givers that hindered care continuity. The HND center partly met this challenge by coordinating care through multiple interprofessional and interdisciplinary shared decision-making interfaces. The large patient datasets were difficult to operationalize in daily practice due to data entry and retrieval issues. Predictive analytics was seen as a potentially effective approach to support decision-making, calculate risks, and improve resource utilization, especially in the context of complex chronic care, and the HND center a good place for pilot testing and development. Simplicity of visual interfaces, a better understanding of the algorithms by the health care professionals, and the need to address professional concerns, were identified as key factors to increase adoption and facilitate implementation. CONCLUSIONS: The HND center serves as a comprehensive integrated practice unit that integrates different medical disciplinary perspectives in a person-centered care process to address the needs of patients with multiple complex comorbidities. Therefore, piloting predictive technologies at the same time with a high potential for improving care represents an extreme, demanding, and complex case. The study findings show that health care professionals' involvement in the design of predictive technologies right from the outset can facilitate the implementation and adoption of such technologies, as well as enhance their predictive effectiveness and performance. Simplicity in the design of predictive technologies and better understanding of the concept and interpretation of the algorithms may result in implementation of predictive technologies in health care. Institutional efforts are needed to enhance collaboration among the health care professionals and IT professionals for effective development, implementation, and adoption of predictive analytics in health care.

PresRecST: a novel herbal prescription recommendation algorithm for real-world patients with integration of syndrome differentiation and treatment planning.

OBJECTIVES: Herbal prescription recommendation (HPR) is a hot topic and challenging issue in field of clinical decision support of traditional Chinese medicine (TCM). However, almost all previous HPR methods have not adhered to the clinical principles of syndrome differentiation and treatment planning of TCM, which has resulted in suboptimal performance and difficulties in application to real-world clinical scenarios. MATERIALS AND METHODS: We emphasize the synergy among diagnosis and treatment procedure in real-world TCM clinical settings to propose the PresRecST model, which effectively combines the key components of symptom collection, syndrome differentiation, treatment method determination, and herb recommendation. This model integrates a self-curated TCM knowledge graph to learn the high-quality representations of TCM biomedical entities and performs 3 stages of clinical predictions to meet the principle of systematic sequential procedure of TCM decision making. RESULTS: To address the limitations of previous datasets, we constructed the TCM-Lung dataset, which is suitable for the simultaneous training of the syndrome differentiation, treatment method determination, and herb recommendation. Overall experimental results on 2 datasets demonstrate that the proposed PresRecST outperforms the state-of-the-art algorithm by significant improvements (eg, improvements of P@5 by 4.70%, P@10 by 5.37%, P@20 by 3.08% compared with the best baseline). DISCUSSION: The workflow of PresRecST effectively integrates the embedding vectors of the knowledge graph for progressive recommendation tasks, and it closely aligns with the actual diagnostic and treatment procedures followed by TCM doctors. A series of ablation experiments and case study show the availability and interpretability of PresRecST, indicating the proposed PresRecST can be beneficial for assisting the diagnosis and treatment in real-world TCM clinical settings. CONCLUSION: Our technology can be applied in a progressive recommendation scenario, providing recommendations for related items in a progressive manner, which can assist in providing more reliable diagnoses and herbal therapies for TCM clinical task.

Decision support systems for antibiotic prescription in hospitals: a survey with hospital managers on factors for implementation.

BACKGROUND: Inappropriate antimicrobial use, such as antibiotic intake in viral infections, incorrect dosing and incorrect dosing cycles, has been shown to be an important determinant of the emergence of antimicrobial resistance. Artificial intelligence-based decision support systems represent a potential solution for improving antimicrobial prescribing and containing antimicrobial resistance by supporting clinical decision-making thus optimizing antibiotic use and improving patient outcomes. OBJECTIVE: The aim of this research was to examine implementation factors of artificial intelligence-based decision support systems for antibiotic prescription in hospitals from the perspective of the hospital managers, who have decision-making authority for the organization. METHODS: An online survey was conducted between December 2022 and May 2023 with managers of German hospitals on factors for decision support system implementation. Survey responses were analyzed from 118 respondents through descriptive statistics. RESULTS: Survey participants reported openness towards the use of artificial intelligence-based decision support systems for antibiotic prescription in hospitals but little self-perceived knowledge in this field. Artificial intelligence-based decision support systems appear to be a promising opportunity to improve quality of care and increase treatment safety. Along with the Human-Organization-Technology-fit model attitudes were presented. In particular, user-friendliness of the system and compatibility with existing technical structures are considered to be important for implementation. The uptake of decision support systems also depends on the ability of an organization to create a facilitating environment that helps to address the lack of user knowledge as well as trust in and skepticism towards these systems. This includes the training of user groups and support of the management level. Besides, it has been assessed to be important that potential users are open towards change and perceive an added value of the use of artificial intelligence-based decision support systems. CONCLUSION: The survey has revealed the perspective of hospital managers on different factors that may help to address implementation challenges for artificial intelligence-based decision support systems in antibiotic prescribing. By combining factors of user perceptions about the systems´ perceived benefits with external factors of system design requirements and contextual conditions, the findings highlight the need for a holistic implementation framework of artificial intelligence-based decision support systems.

Genetically guided precision medicine clinical decision support tools: a systematic review.

OBJECTIVES: Patient care using genetics presents complex challenges. Clinical decision support (CDS) tools are a potential solution because they provide patient-specific risk assessments and/or recommendations at the point of care. This systematic review evaluated the literature on CDS systems which have been implemented to support genetically guided precision medicine (GPM). MATERIALS AND METHODS: A comprehensive search was conducted in MEDLINE and Embase, encompassing January 1, 2011-March 14, 2023. The review included primary English peer-reviewed research articles studying humans, focused on the use of computers to guide clinical decision-making and delivering genetically guided, patient-specific assessments, and/or recommendations to healthcare providers and/or patients. RESULTS: The search yielded 3832 unique articles. After screening, 41 articles were identified that met the inclusion criteria. Alerts and reminders were the most common form of CDS used. About 27 systems were integrated with the electronic health record; 2 of those used standards-based approaches for genomic data transfer. Three studies used a framework to analyze the implementation strategy. DISCUSSION: Findings include limited use of standards-based approaches for genomic data transfer, system evaluations that do not employ formal frameworks, and inconsistencies in the methodologies used to assess genetic CDS systems and their impact on patient outcomes. CONCLUSION: We recommend that future research on CDS system implementation for genetically GPM should focus on implementing more CDS systems, utilization of standards-based approaches, user-centered design, exploration of alternative forms of CDS interventions, and use of formal frameworks to systematically evaluate genetic CDS systems and their effects on patient care.

The skåne emergency medicine (SEM) cohort.

BACKGROUND: In the European Union alone, more than 100 million people present to the emergency department (ED) each year, and this has increased steadily year-on-year by 2-3%. Better patient management decisions have the potential to reduce ED crowding, the number of diagnostic tests, the use of inpatient beds, and healthcare costs. METHODS: We have established the Skåne Emergency Medicine (SEM) cohort for developing clinical decision support systems (CDSS) based on artificial intelligence or machine learning as well as traditional statistical methods. The SEM cohort consists of 325 539 unselected unique patients with 630 275 visits from January 1st, 2017 to December 31st, 2018 at eight EDs in the region Skåne in southern Sweden. Data on sociodemographics, previous diseases and current medication are available for each ED patient visit, as well as their chief complaint, test results, disposition and the outcome in the form of subsequent diagnoses, treatments, healthcare costs and mortality within a follow-up period of at least 30 days, and up to 3 years. DISCUSSION: The SEM cohort provides a platform for CDSS research, and we welcome collaboration. In addition, SEM's large amount of real-world patient data with almost complete short-term follow-up will allow research in epidemiology, patient management, diagnostics, prognostics, ED crowding, resource allocation, and social medicine.

Automated Clinical Trial Cohort Definition and Evaluation with CQL and CDS-Hooks.

BACKGROUND: Patient recruitment for clinical trials faces major challenges with current methods being costly and often requiring time-consuming acquisition of medical histories and manual matching of potential subjects. OBJECTIVES: Designing and implementing an Electronic Health Record (EHR) and domain-independent automation architecture using Clinical Decision Support (CDS) standards that allows researchers to effortlessly enter standardized trial criteria to retrieve eligibility statistics and integration into a clinician workflow to automatically trigger evaluation without added clinician workload. METHODS: Cohort criteria are translated into the Clinical Quality Language (CQL) and integrated into Measures and CDS-Hooks for patient- and population-level evaluation. RESULTS: Successful application of simplified real-world trial criteria to Fast Healthcare Interoperability Resources (FHIR®) test data shows the feasibility of obtaining individual patient eligibility and trial details as well as population eligibility statistics and a list of qualifying patients. CONCLUSION: Employing CDS standards for automating cohort definition and evaluation shows promise in streamlining patient selection, aligning with increasing legislative demands for standardized healthcare data.

Infection Control Through Clinical Pipelines Built with Arden Syntax MLM Building Blocks.

Healthcare-associated infections (HAIs) may have grave consequences for patients. In the case of sepsis, the 30-day mortality rate is about 25%. HAIs cost EU member states an estimated 7 billion Euros annually. Clinical decision support tools may be useful for infection monitoring, early warning, and alerts. MONI, a tool for monitoring nosocomial infections, is used at University Hospital Vienna, but needs to be clinically and technically revised and updated. A new, completely configurable pipeline-based system for defining and processing HAI definitions was developed and validated. A network of data access points, clinical rules, and explanatory output is arranged as an inference network, a clinical pipeline as it is called, and processed in a stepwise manner. Arden-Syntax-based medical logic modules were used to implement the respective rules. The system was validated by creating a pipeline for the ECDC PN5 pneumonia rule. It was tested on a set of patient data from intensive care medicine. The results were compared with previously obtained MONI output as a suitable reference, yielding a sensitivity of 93.8% and a specificity of 99.8%. Clinical pipelines show promise as an open and configurable approach to graphically-based, human-readable, machine-executable HAI definitions.

Decision discovery using clinical decision support system decision log data for supporting the nurse decision-making process.

BACKGROUND: Decision-making in healthcare is increasingly complex; notably in hospital environments where the information density is high, e.g., emergency departments, oncology departments, and psychiatry departments. This study aims to discover decisions from logged data to improve the decision-making process. METHODS: The Design Science Research Methodology (DSRM) was chosen to design an artifact (algorithm) for the discovery and visualization of decisions. The DSRM's different activities are explained, from the definition of the problem to the evaluation of the artifact. During the design and development activities, the algorithm itself is created. During the demonstration and evaluation activities, the algorithm was tested with an authentic synthetic dataset. RESULTS: The results show the design and simulation of an algorithm for the discovery and visualization of decisions. A fuzzy classifier algorithm was adapted for (1) discovering decisions from a decision log and (2) visualizing the decisions using the Decision Model and Notation standard. CONCLUSIONS: In this paper, we show that decisions can be discovered from a decision log and visualized for the improvement of the decision-making process of healthcare professionals or to support the periodic evaluation of protocols and guidelines.

The Tools for Integrated Management of Childhood Illness (TIMCI) study protocol: a multi-country mixed-method evaluation of pulse oximetry and clinical decision support algorithms.

Effective and sustainable strategies are needed to address the burden of preventable deaths among children under-five in resource-constrained settings. The Tools for Integrated Management of Childhood Illness (TIMCI) project aims to support healthcare providers to identify and manage severe illness, whilst promoting resource stewardship, by introducing pulse oximetry and clinical decision support algorithms (CDSAs) to primary care facilities in India, Kenya, Senegal and Tanzania. Health impact is assessed through: a pragmatic parallel group, superiority cluster randomised controlled trial (RCT), with primary care facilities randomly allocated (1:1) in India to pulse oximetry or control, and (1:1:1) in Tanzania to pulse oximetry plus CDSA, pulse oximetry, or control; and through a quasi-experimental pre-post study in Kenya and Senegal. Devices are implemented with guidance and training, mentorship, and community engagement. Sociodemographic and clinical data are collected from caregivers and records of enrolled sick children aged 0-59 months at study facilities, with phone follow-up on Day 7 (and Day 28 in the RCT). The primary outcomes assessed for the RCT are severe complications (mortality and secondary hospitalisations) by Day 7 and primary hospitalisations (within 24 hours and with referral); and, for the pre-post study, referrals and antibiotic. Secondary outcomes on other aspects of health status, hypoxaemia, referral, follow-up and antimicrobial prescription are also evaluated. In all countries, embedded mixed-method studies further evaluate the effects of the intervention on care and care processes, implementation, cost and cost-effectiveness. Pilot and baseline studies started mid-2021, RCT and post-intervention mid-2022, with anticipated completion mid-2023 and first results late-2023. Study approval has been granted by all relevant institutional review boards, national and WHO ethical review committees. Findings will be shared with communities, healthcare providers, Ministries of Health and other local, national and international stakeholders to facilitate evidence-based decision-making on scale-up.Study registration: NCT04910750 and NCT05065320.

Pulse oximetry and clinical decision support algorithms show potential for supporting healthcare providers to identify and manage severe illness among children under-five attending primary care in resource-constrained settings, whilst promoting resource stewardship but scale-up has been hampered by evidence gaps.This study design article describes the largest scale evaluation of these interventions to date, the results of which will inform country- and global-level policy and planning .

Academic Detailing as a Health Information Technology Implementation Method: Supporting the Design and Implementation of an Emergency Department-Based Clinical Decision Support Tool to Prevent Future Falls.

BACKGROUND: Clinical decision support (CDS) tools that incorporate machine learning-derived content have the potential to transform clinical care by augmenting clinicians' expertise. To realize this potential, such tools must be designed to fit the dynamic work systems of the clinicians who use them. We propose the use of academic detailing-personal visits to clinicians by an expert in a specific health IT tool-as a method for both ensuring the correct understanding of that tool and its evidence base and identifying factors influencing the tool's implementation. OBJECTIVE: This study aimed to assess academic detailing as a method for simultaneously ensuring the correct understanding of an emergency department-based CDS tool to prevent future falls and identifying factors impacting clinicians' use of the tool through an analysis of the resultant qualitative data. METHODS: Previously, our team designed a CDS tool to identify patients aged 65 years and older who are at the highest risk of future falls and prompt an interruptive alert to clinicians, suggesting the patient be referred to a mobility and falls clinic for an evidence-based preventative intervention. We conducted 10-minute academic detailing interviews (n=16) with resident emergency medicine physicians and advanced practice providers who had encountered our CDS tool in practice. We conducted an inductive, team-based content analysis to identify factors that influenced clinicians' use of the CDS tool. RESULTS: The following categories of factors that impacted clinicians' use of the CDS were identified: (1) aspects of the CDS tool's design (2) clinicians' understanding (or misunderstanding) of the CDS or referral process, (3) the busy nature of the emergency department environment, (4) clinicians' perceptions of the patient and their associated fall risk, and (5) the opacity of the referral process. Additionally, clinician education was done to address any misconceptions about the CDS tool or referral process, for example, demonstrating how simple it is to place a referral via the CDS and clarifying which clinic the referral goes to. CONCLUSIONS: Our study demonstrates the use of academic detailing for supporting the implementation of health information technologies, allowing us to identify factors that impacted clinicians' use of the CDS while concurrently educating clinicians to ensure the correct understanding of the CDS tool and intervention. Thus, academic detailing can inform both real-time adjustments of a tool's implementation, for example, refinement of the language used to introduce the tool, and larger scale redesign of the CDS tool to better fit the dynamic work environment of clinicians.