Deep learning for risk stratification of thymoma pathological subtypes based on preoperative CT images.

OBJECTIVES: This study aims to develop an innovative, deep model for thymoma risk stratification using preoperative CT images. Current algorithms predominantly focus on radiomic features or 2D deep features and require manual tumor segmentation by radiologists, limiting their practical applicability. METHODS: The deep model was trained and tested on a dataset comprising CT images from 147 patients (82 female; mean age, 54 years ± 10) who underwent surgical resection and received subsequent pathological confirmation. The eligible participants were divided into a training cohort (117 patients) and a testing cohort (30 patients) based on the CT scan time. The model consists of two stages: 3D tumor segmentation and risk stratification. The radiomic model and deep model (2D) were constructed for comparative analysis. Model performance was evaluated through dice coefficient, area under the curve (AUC), and accuracy. RESULTS: In both the training and testing cohorts, the deep model demonstrated better performance in differentiating thymoma risk, boasting AUCs of 0.998 and 0.893 respectively. This was compared to the radiomic model (AUCs of 0.773 and 0.769) and deep model (2D) (AUCs of 0.981 and 0.760). Notably, the deep model was capable of simultaneously identifying lesions, segmenting the region of interest (ROI), and differentiating the risk of thymoma on arterial phase CT images. Its diagnostic prowess outperformed that of the baseline model. CONCLUSIONS: The deep model has the potential to serve as an innovative decision-making tool, assisting on clinical prognosis evaluation and the discernment of suitable treatments for different thymoma pathological subtypes. KEY POINTS: • This study incorporated both tumor segmentation and risk stratification. • The deep model, using clinical and 3D deep features, effectively predicted thymoma risk. • The deep model improved AUCs by 16.1pt and 17.5pt compared to radiomic model and deep model (2D) respectively.

Development and validation of a clinical decision support system based on PSA, microRNAs, and MRI for the detection of prostate cancer.

OBJECTIVES: The aims of this study are to develop and validate a clinical decision support system based on demographics, prostate-specific antigen (PSA), microRNA (miRNA), and MRI for the detection of prostate cancer (PCa) and clinical significant (cs) PCa, and to assess if this system performs better compared to MRI alone. METHODS: This retrospective, multicenter, observational study included 222 patients (mean age 66, range 46-75 years) who underwent prostate MRI, miRNA (let-7a-5p and miR-103a-3p) assessment, and biopsy. Monoparametric and multiparametric models including age, PSA, miRNA, and MRI outcome were trained on 65% of the data and then validated on the remaining 35% to predict both PCa (any Gleason grade [GG]) and csPCa (GG ≥ 2 vs GG = 1/negative). Accuracy, sensitivity, specificity, positive and negative predictive value (NPV), and area under the receiver operating characteristic curve were calculated. RESULTS: MRI outcome was the best predictor in the monoparametric model for both detection of PCa, with sensitivity of 90% (95%CI 73-98%) and NPV of 93% (95%CI 82-98%), and for csPCa identification, with sensitivity of 91% (95%CI 72-99%) and NPV of 95% (95%CI 84-99%). Sensitivity and NPV of PSA + miRNA for the detection of csPCa were not statistically different from the other models including MRI alone. CONCLUSION: MRI stand-alone yielded the best prediction models for both PCa and csPCa detection in biopsy-naïve patients. The use of miRNAs let-7a-5p and miR-103a-3p did not improve classification performances compared to MRI stand-alone results. CLINICAL RELEVANCE STATEMENT: The use of miRNA (let-7a-5p and miR-103a-3p), PSA, and MRI in a clinical decision support system (CDSS) does not improve MRI stand-alone performance in the detection of PCa and csPCa. KEY POINTS: • Clinical decision support systems including MRI improve the detection of both prostate cancer and clinically significant prostate cancer with respect to PSA test and/or microRNA. • The use of miRNAs let-7a-5p and miR-103a-3p did not significantly improve MRI stand-alone performance. • Results of this study were in line with previous works on MRI and microRNA.

Scoping review of clinical decision support systems for multiple sclerosis management: Leveraging information technology and massive health data.

BACKGROUND AND PURPOSE: Multiple sclerosis (MS) is a complex autoimmune disease of the central nervous system, with numerous therapeutic options, but a lack of biomarkers to support a mechanistic approach to precision medicine. A computational approach to precision medicine could proceed from clinical decision support systems (CDSSs). They are digital tools aiming to empower physicians through the clinical applications of information technology and massive data. However, the process of their clinical development is still maturing; we aimed to review it in the field of MS. METHODS: For this scoping review, we screened systematically the PubMed database. We identified 24 articles reporting 14 CDSS projects and compared their technical and software development aspects. RESULTS: The projects position themselves in various contexts of usage with various algorithmic approaches: expert systems, CDSSs based on similar patients' data visualization, and model-based CDSSs implementing mathematical predictive models. So far, no project has completed its clinical development up to certification for clinical use with global release. Some CDSSs have been replaced at subsequent project iterations. The most advanced projects did not necessarily report every step of clinical development in a dedicated article (proof of concept, offline validation, refined prototype, live clinical evaluation, comparative prospective evaluation). They seek different software distribution options to integrate into health care: internal usage, "peer-to-peer," and marketing distribution. CONCLUSIONS: This review illustrates the potential of clinical applications of information technology and massive data to support MS management and helps clarify the roadmap for future projects as a multidisciplinary and multistep process.

Implementation of a clinical decision support system for the optimization of antidiabetic drug orders by pharmacists.

AIMS: The objective of the study was to describe the impact of a clinical decision support system (CDSS) on antidiabetic drug management by clinical pharmacists for hospitalized patients with T2DM. METHODS: We performed a retrospective, single-centre study in a teaching hospital, where clinical pharmacists analysed prescriptions and issued pharmacist interventions (PIs) through a computerized physician order entry (CPOE) system. A CDSS was integrated into the pharmacists' workflow in July 2019. We analysed PIs during 2 periods of interest: one before the introduction of the CDSS (from November 2018 to April 2019, PIs issued through the CPOE alone) and one afterwards (from November 2020 to April 2021, PIs issued through the CPOE and/or the CDSS). The study covered nondiabetology wards as endocrinology, diabetes and metabolism departments were not computerized at the time of the study. RESULTS: There were 203 PIs related to antidiabetic drugs in period 1 and 319 in period 2 (a 57.5% increase). Sixty-four of the 319 PIs were generated by the CDSS. Noncompliance/contraindication was the main problem identified by the CDSS (41 PIs, 68.4%), and 57.8% led to discontinuation of the drug. Most of the PIs issued through the CDSS corresponded to orders that had not been flagged up by clinical pharmacists using the CPOE. Conversely, most alerts about indications that were not being treated were detected by the clinical pharmacists using the CPOE and not by the CDSS. CONCLUSION: Use of CDSS by clinical pharmacists improved antidiabetic drug management for hospitalized patients with T2DM. The CDSS might add value to diabetes care in nondiabetology wards by decreasing the frequency of potentially inappropriate prescriptions and adverse drug reactions.

Evaluation of clinical practice guideline-derived clinical decision support systems using a novel quality model.

Over the last decade, clinical practice guidelines (CPGs) have become an important asset for daily life in healthcare organizations. Efficient management and digitization of CPGs help achieve organizational objectives and improve patient care and healthcare quality by reducing variability. However, digitizing CPGs is a difficult, complex task because they are usually expressed as text, and this often leads to the development of partial software solutions. At present, different research proposals and CPG-derived CDSS (clinical decision support system) do exist for managing CPG digitalization lifecycles (from modeling to deployment and execution), but they do not all provide full lifecycle support, making it more difficult to choose solutions or proposals that fully meet the needs of a healthcare organization. This paper proposes a method based on quality models to uniformly compare and evaluate technological tools, providing a rigorous method that uses qualitative and quantitative analysis of technological aspects. In addition, this paper also presents how this method has been instantiated to evaluate and compare CPG-derived CDSS by highlighting each phase of the CPG digitization lifecycle. Finally, discussion and analysis of currently available tools are presented, identifying gaps and limitations.

Implementation and evaluation of a system for assessment of the quality of long-term management of patients at a geriatric hospital.

BACKGROUND: The increasing aging population presents a significant challenge, accompanied by a shortage of professional caregivers, adding to the therapeutic burden. Clinical decision support systems, utilizing computerized clinical guidelines, can improve healthcare quality, reduce expenses, save time, and boost caregiver efficiency. OBJECTIVES: 1) Develop and evaluate an automated quality assessment (QA) system for retrospective longitudinal care quality analysis, focusing on clinical staff adherence to evidence-based guidelines (GLs). 2) Assess the system's technical feasibility and functional capability for senior nurse use in geriatric pressure-ulcer management. METHODS: A computational QA system using our Quality Assessment Temporal Patterns (QATP) methodology was designed and implemented. Our methodology transforms the GL's procedural-knowledge into declarative-knowledge temporal-abstraction patterns representing the expected execution trace in the patient's data for correct therapy application. Fuzzy temporal logic allows for partial compliance, reflecting individual and grouped action performance considering their values and temporal aspects. The system was tested using a pressure ulcer treatment GL and data from 100 geriatric patients' Electronic Medical Records (EMR). After technical evaluation for accuracy and feasibility, an extensive functional evaluation was conducted by an experienced nurse, comparing QA scores with and without system support, and versus automated system scores. Time efficiency was also measured. RESULTS: QA scores from the geriatric nurse, with and without system's support, did not significantly differ from those provided by the automated system (p < 0.05), demonstrating the effectiveness and reliability of both manual and automated methods. The system-supported manual QA process reduced scoring time by approximately two-thirds, from an average of 17.3 min per patient manually to about 5.9 min with the system's assistance, highlighting the system's efficiency potential in clinical practice. CONCLUSION: The QA system based on QATP, produces scores consistent with an experienced nurse's assessment for complex care over extended periods. It enables quick and accurate quality care evaluation for multiple patients after brief training. Such automated QA systems may empower nursing staff, enabling them to manage more patients, accurately and consistently, while reducing costs due to saved time and effort, and enhanced compliance with evidence-based guidelines.

Clinical practice, decision-making, and use of clinical decision support systems in invasive mechanical ventilation: a narrative review.

Invasive mechanical ventilation is a key supportive therapy for patients on intensive care. There is increasing emphasis on personalised ventilation strategies. Clinical decision support systems (CDSS) have been developed to support this. We conducted a narrative review to assess evidence that could inform device implementation. A search was conducted in MEDLINE (Ovid) and EMBASE. Twenty-nine studies met the inclusion criteria. Role allocation is well described, with interprofessional collaboration dependent on culture, nurse:patient ratio, the use of protocols, and perception of responsibility. There were no descriptions of process measures, quality metrics, or clinical workflow. Nurse-led weaning is well-described, with factors grouped by patient, nurse, and system. Physician-led weaning is heterogenous, guided by subjective and objective information, and 'gestalt'. No studies explored decision-making with CDSS. Several explored facilitators and barriers to implementation, grouped by clinician (facilitators: confidence using CDSS, retaining decision-making ownership; barriers: undermining clinician's role, ambiguity moving off protocol), intervention (facilitators: user-friendly interface, ease of workflow integration, minimal training requirement; barriers: increased documentation time), and organisation (facilitators: system-level mandate; barriers: poor communication, inconsistent training, lack of technical support). One study described factors that support CDSS implementation. There are gaps in our understanding of ventilation practice. A coordinated approach grounded in implementation science is required to support CDSS implementation. Future research should describe factors that guide clinical decision-making throughout mechanical ventilation, with and without CDSS, map clinical workflow, and devise implementation toolkits. Novel research design analogous to a learning organisation, that considers the commercial aspects of device design, is required.

Developing a clinical decision support system software prototype that assists in the management of patients with self-harm in the emergency department: protocol of the PERMANENS project.

BACKGROUND: Self-harm presents a significant public health challenge. Emergency departments (EDs) are crucial healthcare settings in managing self-harm, but clinician uncertainty in risk assessment may contribute to ineffective care. Clinical Decision Support Systems (CDSSs) show promise in enhancing care processes, but their effective implementation in self-harm management remains unexplored. METHODS: PERMANENS comprises a combination of methodologies and study designs aimed at developing a CDSS prototype that assists clinicians in the personalized assessment and management of ED patients presenting with self-harm. Ensemble prediction models will be constructed by applying machine learning techniques on electronic registry data from four sites, i.e., Catalonia (Spain), Ireland, Norway, and Sweden. These models will predict key adverse outcomes including self-harm repetition, suicide, premature death, and lack of post-discharge care. Available registry data include routinely collected electronic health record data, mortality data, and administrative data, and will be harmonized using the OMOP Common Data Model, ensuring consistency in terminologies, vocabularies and coding schemes. A clinical knowledge base of effective suicide prevention interventions will be developed rooted in a systematic review of clinical practice guidelines, including quality assessment of guidelines using the AGREE II tool. The CDSS software prototype will include a backend that integrates the prediction models and the clinical knowledge base to enable accurate patient risk stratification and subsequent intervention allocation. The CDSS frontend will enable personalized risk assessment and will provide tailored treatment plans, following a tiered evidence-based approach. Implementation research will ensure the CDSS' practical functionality and feasibility, and will include periodic meetings with user-advisory groups, mixed-methods research to identify currently unmet needs in self-harm risk assessment, and small-scale usability testing of the CDSS prototype software. DISCUSSION: Through the development of the proposed CDSS software prototype, PERMANENS aims to standardize care, enhance clinician confidence, improve patient satisfaction, and increase treatment compliance. The routine integration of CDSS for self-harm risk assessment within healthcare systems holds significant potential in effectively reducing suicide mortality rates by facilitating personalized and timely delivery of effective interventions on a large scale for individuals at risk of suicide.

Analysing the behaviour change of brain regions of methamphetamine abusers using electroencephalogram signals: Hope to design a decision support system.

Long-term use of methamphetamine (meth) causes cognitive and neuropsychological impairments. Analysing the impact of this substance on the human brain can aid prevention and treatment efforts. In this study, the electroencephalogram (EEG) signals of meth abusers in the abstinence period and healthy subjects were recorded during eyes-closed and eyes-opened states to distinguish the brain regions that meth can significantly influence. In addition, a decision support system (DSS) was introduced as a complementary method to recognize substance users accompanied by biochemical tests. According to these goals, the recorded EEG signals were pre-processed and decomposed into frequency bands using the discrete wavelet transform (DWT) method. For each frequency band, energy, KS entropy, Higuchi and Katz fractal dimensions of signals were calculated. Then, statistical analysis was applied to select features whose channels contain a p-value less than 0.05. These features between two groups were compared, and the location of channels containing more features was specified as discriminative brain areas. Due to evaluating the performance of features and distinguishing the two groups in each frequency band, features were fed into a k-nearest neighbour (KNN), support vector machine (SVM), multilayer perceptron neural networks (MLP) and linear discriminant analysis (LDA) classifiers. The results indicated that prolonged consumption of meth has a considerable impact on the brain areas responsible for working memory, motor function, attention, visual interpretation, and speech processing. Furthermore, the best classification accuracy, almost 95.8%, was attained in the gamma band during the eyes-closed state.

Nutritional management recommendation systems in polycystic ovary syndrome: a systematic review.

BACKGROUND: People with polycystic ovary syndrome suffer from many symptoms and are at risk of developing diseases such as hypertension and diabetes in the future. Therefore, the importance of self-care doubles. It is mainly to modify the lifestyle, especially following the principles of healthy eating. The purpose of this study is to review artificial intelligence-based systems for providing management recommendations, especially food recommendations. MATERIALS AND METHODS: This study started by searching three databases: PubMed, Scopus, and Web of Science, from inception until 6 June 2023. The result was the retrieval of 15,064 articles. First, we removed duplicate studies. After the title and abstract screening, 119 articles remained. Finally, after reviewing the full text of the articles and considering the inclusion and exclusion criteria, 20 studies were selected for the study. To assess the quality of articles, we used criteria proposed by Malhotra, Wen, and Kitchenham. Out of the total number of included studies, seventeen studies were high quality, while three studies were moderate quality. RESULTS: Most studies were conducted in India in 2021. Out of all the studies, diagnostic recommendation systems were the most frequently researched, accounting for 86% of the total. Precision, sensitivity, specificity, and accuracy were more common than other performance metrics. The most significant challenge or limitation encountered in these studies was the small sample size. CONCLUSION: Recommender systems based on artificial intelligence can help in fields such as prediction, diagnosis, and management of polycystic ovary syndrome. Therefore, since there are no nutritional recommendation systems for these patients in Iran, this study can serve as a starting point for such research.

Clinical decision support system supported interventions in hospitalized older patients: a matter of natural course and adequate timing.

BACKGROUND: Drug-related problems (DRPs) and potentially inappropriate prescribing (PIP) are associated with adverse patient and health care outcomes. In the setting of hospitalized older patients, Clinical Decision Support Systems (CDSSs) could reduce PIP and therefore improve clinical outcomes. However, prior research showed a low proportion of adherence to CDSS recommendations by clinicians with possible explanatory factors such as little clinical relevance and alert fatigue. OBJECTIVE: To investigate the use of a CDSS in a real-life setting of hospitalized older patients. We aim to (I) report the natural course and interventions based on the top 20 rule alerts (the 20 most frequently generated alerts per clinical rule) of generated red CDSS alerts (those requiring action) over time from day 1 to 7 of hospitalization; and (II) to explore whether an optimal timing can be defined (in terms of day per rule). METHODS: All hospitalized patients aged ≥ 60 years, admitted to Zuyderland Medical Centre (the Netherlands) were included. The evaluation of the CDSS was investigated using a database used for standard care. Our CDSS was run daily and was evaluated on day 1 to 7 of hospitalization. We collected demographic and clinical data, and moreover the total number of CDSS alerts; the total number of top 20 rule alerts; those that resulted in an action by the pharmacist and the course of outcome of the alerts on days 1 to 7 of hospitalization. RESULTS: In total 3574 unique hospitalized patients, mean age 76.7 (SD 8.3) years and 53% female, were included. From these patients, in total 8073 alerts were generated; with the top 20 of rule alerts we covered roughly 90% of the total. For most rules in the top 20 the highest percentage of resolved alerts lies somewhere between day 4 and 5 of hospitalization, after which there is equalization or a decrease. Although for some rules, there is a gradual increase in resolved alerts until day 7. The level of resolved rule alerts varied between the different clinical rules; varying from > 50-70% (potassium levels, anticoagulation, renal function) to less than 25%. CONCLUSION: This study reports the course of the 20 most frequently generated alerts of a CDSS in a setting of hospitalized older patients. We have shown that for most rules, irrespective of an intervention by the pharmacist, the highest percentage of resolved rules is between day 4 and 5 of hospitalization. The difference in level of resolved alerts between the different rules, could point to more or less clinical relevance and advocates further research to explore ways of optimizing CDSSs by adjustment in timing and number of alerts to prevent alert fatigue.

Vignette-based comparative analysis of ChatGPT and specialist treatment decisions for rheumatic patients: results of the Rheum2Guide study.

BACKGROUND: The complex nature of rheumatic diseases poses considerable challenges for clinicians when developing individualized treatment plans. Large language models (LLMs) such as ChatGPT could enable treatment decision support. OBJECTIVE: To compare treatment plans generated by ChatGPT-3.5 and GPT-4 to those of a clinical rheumatology board (RB). DESIGN/METHODS: Fictional patient vignettes were created and GPT-3.5, GPT-4, and the RB were queried to provide respective first- and second-line treatment plans with underlying justifications. Four rheumatologists from different centers, blinded to the origin of treatment plans, selected the overall preferred treatment concept and assessed treatment plans' safety, EULAR guideline adherence, medical adequacy, overall quality, justification of the treatment plans and their completeness as well as patient vignette difficulty using a 5-point Likert scale. RESULTS: 20 fictional vignettes covering various rheumatic diseases and varying difficulty levels were assembled and a total of 160 ratings were assessed. In 68.8% (110/160) of cases, raters preferred the RB's treatment plans over those generated by GPT-4 (16.3%; 26/160) and GPT-3.5 (15.0%; 24/160). GPT-4's plans were chosen more frequently for first-line treatments compared to GPT-3.5. No significant safety differences were observed between RB and GPT-4's first-line treatment plans. Rheumatologists' plans received significantly higher ratings in guideline adherence, medical appropriateness, completeness and overall quality. Ratings did not correlate with the vignette difficulty. LLM-generated plans were notably longer and more detailed. CONCLUSION: GPT-4 and GPT-3.5 generated safe, high-quality treatment plans for rheumatic diseases, demonstrating promise in clinical decision support. Future research should investigate detailed standardized prompts and the impact of LLM usage on clinical decisions.

A mixed methods analysis of the medication review intervention centered around the use of the 'Systematic Tool to Reduce Inappropriate Prescribing' Assistant (STRIPA) in Swiss primary care practices.

BACKGROUND: Electronic clinical decision support systems (eCDSS), such as the 'Systematic Tool to Reduce Inappropriate Prescribing' Assistant (STRIPA), have become promising tools for assisting general practitioners (GPs) with conducting medication reviews in older adults. Little is known about how GPs perceive eCDSS-assisted recommendations for pharmacotherapy optimization. The aim of this study was to explore the implementation of a medication review intervention centered around STRIPA in the 'Optimising PharmacoTherapy In the multimorbid elderly in primary CAre' (OPTICA) trial. METHODS: We used an explanatory mixed methods design combining quantitative and qualitative data. First, quantitative data about the acceptance and implementation of eCDSS-generated recommendations from GPs (n = 21) and their patients (n = 160) in the OPTICA intervention group were collected. Then, semi-structured qualitative interviews were conducted with GPs from the OPTICA intervention group (n = 8), and interview data were analyzed through thematic analysis. RESULTS: In quantitative findings, GPs reported averages of 13 min spent per patient preparing the eCDSS, 10 min performing medication reviews, and 5 min discussing prescribing recommendations with patients. On average, out of the mean generated 3.7 recommendations (SD=1.8). One recommendation to stop or start a medication was reported to be implemented per patient in the intervention group (SD=1.2). Overall, GPs found the STRIPA useful and acceptable. They particularly appreciated its ability to generate recommendations based on large amounts of patient information. During qualitative interviews, GPs reported the main reasons for limited implementation of STRIPA were related to problems with data sourcing (e.g., incomplete data imports), preparation of the eCDSS (e.g., time expenditure for updating and adapting information), its functionality (e.g., technical problems downloading PDF recommendation reports), and appropriateness of recommendations. CONCLUSIONS: Qualitative findings help explain the relatively low implementation of recommendations demonstrated by quantitative findings, but also show GPs' overall acceptance of STRIPA. Our results provide crucial insights for adapting STRIPA to make it more suitable for regular use in future primary care settings (e.g., necessity to improve data imports). TRIAL REGISTRATION: Clinicaltrials.gov NCT03724539, date of first registration: 29/10/2018.

A Monte Carlo simulation-based decision support system for radiation oncologists in the treatment of glioblastoma multiforme.

In the present research, we have developed a model-based crisp logic function statistical classifier decision support system supplemented with treatment planning systems for radiation oncologists in the treatment of glioblastoma multiforme (GBM). This system is based on Monte Carlo radiation transport simulation and it recreates visualization of treatment environments on mathematical anthropomorphic brain (MAB) phantoms. Energy deposition within tumour tissue and normal tissues are graded by quality audit factors which ensure planned dose delivery to tumour site thereby minimising damages to healthy tissues. The proposed novel methodology predicts tumour growth response to radiation therapy from a patient-specific medicine quality audit perspective. Validation of the study was achieved by recreating thirty-eight patient-specific mathematical anthropomorphic brain phantoms of treatment environments by taking into consideration density variation and composition of brain tissues. Dose computations accomplished through water phantom, tissue-equivalent head phantoms are neither cost-effective, nor patient-specific customized and is often less accurate. The above-highlighted drawbacks can be overcome by using open-source Electron Gamma Shower (EGSnrc) software and clinical case reports for MAB phantom synthesis which would result in accurate dosimetry with due consideration to the time factors. Considerable dose deviations occur at the tumour site for environments with intraventricular glioblastoma, haematoma, abscess, trapped air and cranial flaps leading to quality factors with a lower logic value of 0. Logic value of 1 depicts higher dose deposition within healthy tissues and also leptomeninges for majority of the environments which results in radiation-induced laceration.

Exploring the feasibility of an artificial intelligence based clinical decision support system for cutaneous melanoma detection in primary care - a mixed method study.

Objective: Skin examination to detect cutaneous melanomas is commonly performed in primary care. In recent years, clinical decision support systems (CDSS) based on artificial intelligence (AI) have been introduced within several diagnostic fields.Setting: This study employs a variety of qualitative and quantitative methodologies to investigate the feasibility of an AI-based CDSS to detect cutaneous melanoma in primary care.Subjects and Design: Fifteen primary care physicians (PCPs) underwent near-live simulations using the CDSS on a simulated patient, and subsequent individual semi-structured interviews were explored with a hybrid thematic analysis approach. Additionally, twenty-five PCPs performed a reader study (diagnostic assessment on the basis of image interpretation) of 18 dermoscopic images, both with and without help from AI, investigating the value of adding AI support to a PCPs decision. Perceived instrument usability was rated on the System Usability Scale (SUS).Results: From the interviews, the importance of trust in the CDSS emerged as a central concern. Scientific evidence supporting sufficient diagnostic accuracy of the CDSS was expressed as an important factor that could increase trust. Access to AI decision support when evaluating dermoscopic images proved valuable as it formally increased the physician's diagnostic accuracy. A mean SUS score of 84.8, corresponding to 'good' usability, was measured.Conclusion: AI-based CDSS might play an important future role in cutaneous melanoma diagnostics, provided sufficient evidence of diagnostic accuracy and usability supporting its trustworthiness among the users.

Effective primary care is important for discovering cutaneous melanoma, the deadliest and an increasingly prevalent form of skin cancer. 'Trust', 'usability and user experience', and 'the clinical context' are the qualitative themes that emerged from the qualitative analysis. These areas need to be considered for the successful adoption of AI assisted decision support tools by PCPs.The AI CDSS tool was rated by the PCPs at grade B (average 84.8) on the System Usability Scale (SUS), which is equivalent to 'good' usability.A reader study, (diagnostic assessment on the basis of image interpretation) with 25 PCPs rating dermoscopic images, showed increased value of adding an AI decision support to their clinical assessment.

The DairyPrint Model: A Decision-Support Model to Help Dairy Farmers and Other Stakeholders Towards Improved Sustainability.

Dairy farmers face increasing pressure to reduce greenhouse gas (GHG) emissions [i.e., carbon dioxide (CO2), methane (CH4), and nitrous oxide (N2O)], but measuring on-farm GHG emissions directly is costly or impractical. Therefore, the dairy industry has relied upon mathematical models to estimate those emissions. However, current models tend to be not user-friendly, difficult to access or sometimes very research-focused, limiting their practical use. To address this, we introduce the DairyPrint model, a user-friendly tool designed to estimate GHG emissions from dairy farming. The model integrates herd dynamics, manure management, crop, and feed costs considerations, simplifying the estimation process while providing comprehensive insights. The herd module simulates monthly herd dynamics based on inputs as total cows, calving interval, and culling rate, outputting average annual demographics and estimating various animal related variables (i.e., dry matter intake, milk yield, manure excretion, and enteric CH4 emissions). These outputs feed into other modules, such as the manure module, which calculates emissions based on manure, weather data, and facility type. The manure module processes manure according to farm practices, and the crop module accounts for GHG emissions from manure, fertilizers, and limestone application, also estimating nutrient balances. The DairyPrint model was developed using the Shiny framework and the Golem package for robust production-grade shiny applications in the R programming language. We evaluated the model across 32 simulation scenarios by combining various factors and considering a standard free-stall system with 1000 dairy cows averaging 40 kg/day of milk production. These factors included 2 levels of NDF-ADF in the diet (28-22.8% and 24-19.5%), the presence or absence of 3-NOP dietary addition (yes or no) at an average dose of 70 mg/kg DM per cow daily, the type of bedding used (sawdust or sand), the frequency of manure pond emptying [once (only Fall) or twice a year (Fall and Spring)], and the utilization or non-utilization of a biodigester plus solid-liquid separator (Biod + SL). In our results across the 32 scenarios simulated, the average GHG emission was 0.811 kgCO2eq/kg of milk corrected for fat and protein contents (4% and 3.3%, respectively), ranging from 0.644 to 1.082. Notably, the scenario yielding the lowest GHG emission (i.e., 0.644 kgCO2eq/kg) involved a combination of factors, including a lower level of NDF-ADF in the diet in addition to incorporation of 3-NOP, utilization of sand as bedding, application of Biod + SL, and strategic manure pond emptying in both Fall and Spring. Conversely, the scenario that resulted in the highest GHG emission (i.e., 1.082 kgCO2eq/kg) involved a combination of higher level of NDF-ADF in the diet and excluded the incorporation of 3-NOP, utilization of sawdust as bedding, no application of Biod + SL, and manure pond emptying only in Fall. All these scenarios can be easily simulated in the DairyPrint model and results obtained immediately for user evaluation. Therefore, the DairyPrint model can help farmers move toward improved sustainability, providing a user-friendly and intuitive graphical user interface allowing the user to ask what-if questions.

The Effect of Artificial Intelligence on Patient-Physician Trust: Cross-Sectional Vignette Study.

BACKGROUND: Clinical decision support systems (CDSSs) based on routine care data, using artificial intelligence (AI), are increasingly being developed. Previous studies focused largely on the technical aspects of using AI, but the acceptability of these technologies by patients remains unclear. OBJECTIVE: We aimed to investigate whether patient-physician trust is affected when medical decision-making is supported by a CDSS. METHODS: We conducted a vignette study among the patient panel (N=860) of the University Medical Center Utrecht, the Netherlands. Patients were randomly assigned into 4 groups-either the intervention or control groups of the high-risk or low-risk cases. In both the high-risk and low-risk case groups, a physician made a treatment decision with (intervention groups) or without (control groups) the support of a CDSS. Using a questionnaire with a 7-point Likert scale, with 1 indicating "strongly disagree" and 7 indicating "strongly agree," we collected data on patient-physician trust in 3 dimensions: competence, integrity, and benevolence. We assessed differences in patient-physician trust between the control and intervention groups per case using Mann-Whitney U tests and potential effect modification by the participant's sex, age, education level, general trust in health care, and general trust in technology using multivariate analyses of (co)variance. RESULTS: In total, 398 patients participated. In the high-risk case, median perceived competence and integrity were lower in the intervention group compared to the control group but not statistically significant (5.8 vs 5.6; P=.16 and 6.3 vs 6.0; P=.06, respectively). However, the effect of a CDSS application on the perceived competence of the physician depended on the participant's sex (P=.03). Although no between-group differences were found in men, in women, the perception of the physician's competence and integrity was significantly lower in the intervention compared to the control group (P=.009 and P=.01, respectively). In the low-risk case, no differences in trust between the groups were found. However, increased trust in technology positively influenced the perceived benevolence and integrity in the low-risk case (P=.009 and P=.04, respectively). CONCLUSIONS: We found that, in general, patient-physician trust was high. However, our findings indicate a potentially negative effect of AI applications on the patient-physician relationship, especially among women and in high-risk situations. Trust in technology, in general, might increase the likelihood of embracing the use of CDSSs by treating professionals.

Comparison of Two Symptom Checkers (Ada and Symptoma) in the Emergency Department: Randomized, Crossover, Head-to-Head, Double-Blinded Study.

BACKGROUND: Emergency departments (EDs) are frequently overcrowded and increasingly used by nonurgent patients. Symptom checkers (SCs) offer on-demand access to disease suggestions and recommended actions, potentially improving overall patient flow. Contrary to the increasing use of SCs, there is a lack of supporting evidence based on direct patient use. OBJECTIVE: This study aimed to compare the diagnostic accuracy, safety, usability, and acceptance of 2 SCs, Ada and Symptoma. METHODS: A randomized, crossover, head-to-head, double-blinded study including consecutive adult patients presenting to the ED at University Hospital Erlangen. Patients completed both SCs, Ada and Symptoma. The primary outcome was the diagnostic accuracy of SCs. In total, 6 blinded independent expert raters classified diagnostic concordance of SC suggestions with the final discharge diagnosis as (1) identical, (2) plausible, or (3) diagnostically different. SC suggestions per patient were additionally classified as safe or potentially life-threatening, and the concordance of Ada's and physician-based triage category was assessed. Secondary outcomes were SC usability (5-point Likert-scale: 1=very easy to use to 5=very difficult to use) and SC acceptance net promoter score (NPS). RESULTS: A total of 450 patients completed the study between April and November 2021. The most common chief complaint was chest pain (160/437, 37%). The identical diagnosis was ranked first (or within the top 5 diagnoses) by Ada and Symptoma in 14% (59/437; 27%, 117/437) and 4% (16/437; 13%, 55/437) of patients, respectively. An identical or plausible diagnosis was ranked first (or within the top 5 diagnoses) by Ada and Symptoma in 58% (253/437; 75%, 329/437) and 38% (164/437; 64%, 281/437) of patients, respectively. Ada and Symptoma did not suggest potentially life-threatening diagnoses in 13% (56/437) and 14% (61/437) of patients, respectively. Ada correctly triaged, undertriaged, and overtriaged 34% (149/437), 13% (58/437), and 53% (230/437) of patients, respectively. A total of 88% (385/437) and 78% (342/437) of participants rated Ada and Symptoma as very easy or easy to use, respectively. Ada's NPS was -34 (55% [239/437] detractors; 21% [93/437] promoters) and Symptoma's NPS was -47 (63% [275/437] detractors and 16% [70/437]) promoters. CONCLUSIONS: Ada demonstrated a higher diagnostic accuracy than Symptoma, and substantially more patients would recommend Ada and assessed Ada as easy to use. The high number of unrecognized potentially life-threatening diagnoses by both SCs and inappropriate triage advice by Ada was alarming. Overall, the trustworthiness of SC recommendations appears questionable. SC authorization should necessitate rigorous clinical evaluation studies to prevent misdiagnoses, fatal triage advice, and misuse of scarce medical resources. TRIAL REGISTRATION: German Register of Clinical Trials DRKS00024830; https://drks.de/search/en/trial/DRKS00024830.

Diagnostic Accuracy of a Mobile AI-Based Symptom Checker and a Web-Based Self-Referral Tool in Rheumatology: Multicenter Randomized Controlled Trial.

BACKGROUND: The diagnosis of inflammatory rheumatic diseases (IRDs) is often delayed due to unspecific symptoms and a shortage of rheumatologists. Digital diagnostic decision support systems (DDSSs) have the potential to expedite diagnosis and help patients navigate the health care system more efficiently. OBJECTIVE: The aim of this study was to assess the diagnostic accuracy of a mobile artificial intelligence (AI)-based symptom checker (Ada) and a web-based self-referral tool (Rheport) regarding IRDs. METHODS: A prospective, multicenter, open-label, crossover randomized controlled trial was conducted with patients newly presenting to 3 rheumatology centers. Participants were randomly assigned to complete a symptom assessment using either Ada or Rheport. The primary outcome was the correct identification of IRDs by the DDSSs, defined as the presence of any IRD in the list of suggested diagnoses by Ada or achieving a prespecified threshold score with Rheport. The gold standard was the diagnosis made by rheumatologists. RESULTS: A total of 600 patients were included, among whom 214 (35.7%) were diagnosed with an IRD. Most frequent IRD was rheumatoid arthritis with 69 (11.5%) patients. Rheport's disease suggestion and Ada's top 1 (D1) and top 5 (D5) disease suggestions demonstrated overall diagnostic accuracies of 52%, 63%, and 58%, respectively, for IRDs. Rheport showed a sensitivity of 62% and a specificity of 47% for IRDs. Ada's D1 and D5 disease suggestions showed a sensitivity of 52% and 66%, respectively, and a specificity of 68% and 54%, respectively, concerning IRDs. Ada's diagnostic accuracy regarding individual diagnoses was heterogenous, and Ada performed considerably better in identifying rheumatoid arthritis in comparison to other diagnoses (D1: 42%; D5: 64%). The Cohen κ statistic of Rheport for agreement on any rheumatic disease diagnosis with Ada D1 was 0.15 (95% CI 0.08-0.18) and with Ada D5 was 0.08 (95% CI 0.00-0.16), indicating poor agreement for the presence of any rheumatic disease between the 2 DDSSs. CONCLUSIONS: To our knowledge, this is the largest comparative DDSS trial with actual use of DDSSs by patients. The diagnostic accuracies of both DDSSs for IRDs were not promising in this high-prevalence patient population. DDSSs may lead to a misuse of scarce health care resources. Our results underscore the need for stringent regulation and drastic improvements to ensure the safety and efficacy of DDSSs. TRIAL REGISTRATION: German Register of Clinical Trials DRKS00017642; https://drks.de/search/en/trial/DRKS00017642.

Impacts of Clinical Decision Support Systems on the Relationship, Communication, and Shared Decision-Making Between Health Care Professionals and Patients: Multistakeholder Interview Study.

BACKGROUND: Clinical decision support systems (CDSSs) are increasingly being introduced into various domains of health care. Little is known so far about the impact of such systems on the health care professional-patient relationship, and there is a lack of agreement about whether and how patients should be informed about the use of CDSSs. OBJECTIVE: This study aims to explore, in an empirically informed manner, the potential implications for the health care professional-patient relationship and to underline the importance of this relationship when using CDSSs for both patients and future professionals. METHODS: Using a methodological triangulation, 15 medical students and 12 trainee nurses were interviewed in semistructured interviews and 18 patients were involved in focus groups between April 2021 and April 2022. All participants came from Germany. Three examples of CDSSs covering different areas of health care (ie, surgery, nephrology, and intensive home care) were used as stimuli in the study to identify similarities and differences regarding the use of CDSSs in different fields of application. The interview and focus group transcripts were analyzed using a structured qualitative content analysis. RESULTS: From the interviews and focus groups analyzed, three topics were identified that interdependently address the interactions between patients and health care professionals: (1) CDSSs and their impact on the roles of and requirements for health care professionals, (2) CDSSs and their impact on the relationship between health care professionals and patients (including communication requirements for shared decision-making), and (3) stakeholders' expectations for patient education and information about CDSSs and their use. CONCLUSIONS: The results indicate that using CDSSs could restructure established power and decision-making relationships between (future) health care professionals and patients. In addition, respondents expected that the use of CDSSs would involve more communication, so they anticipated an increased time commitment. The results shed new light on the existing discourse by demonstrating that the anticipated impact of CDSSs on the health care professional-patient relationship appears to stem less from the function of a CDSS and more from its integration in the relationship. Therefore, the anticipated effects on the relationship between health care professionals and patients could be specifically addressed in patient information about the use of CDSSs.