Introduction and Comparison of Novel Decentral Learning Schemes with Multiple Data Pools for Privacy-Preserving ECG Classification.

Artificial intelligence and machine learning have led to prominent and spectacular innovations in various scenarios. Application in medicine, however, can be challenging due to privacy concerns and strict legal regulations. Methods that centralize knowledge instead of data could address this issue. In this work, 6 different decentralized machine learning algorithms are applied to 12-lead ECG classification and compared to conventional, centralized machine learning. The results show that state-of-the-art federated learning leads to reasonable losses of classification performance compared to a standard, central model (-0.054 AUROC) while providing a significantly higher level of privacy. A proposed weighted variant of federated learning (-0.049 AUROC) and an ensemble (-0.035 AUROC) outperformed the standard federated learning algorithm. Overall, considering multiple metrics, the novel batch-wise sequential learning scheme performed best (-0.036 AUROC to baseline). Although, the technical aspects of implementing them in a real-world application are to be carefully considered, the described algorithms constitute a way forward towards preserving-preserving AI in medicine.

Frail People in LABLand: Development of an Easy-to-Use Machine Learning Model to Identify Frail People in Hospitals Based on Laboratory Data.

BACKGROUND: Frail individuals are very vulnerable to stressors, which often lead to adverse outcomes. To ensure an adequate therapy, a holistic diagnostic approach is needed which is provided in geriatric wards. It is important to identify frail individuals outside the geriatric ward as well to ensure that they also benefit from the holistic approach. OBJECTIVES: The goal of this study was to develop a machine learning model to identify frail individuals in hospitals. The model should be applicable without additional effort, quickly and in many different places in the healthcare system. METHODS: We used Gradient Boosting Decision Trees (GBDT) to predict a frailty target derived from a gold standard assessment. The used features were laboratory values, age and sex. We also identified the most important features. RESULTS: The best GBDT achieved an AUROC of 0.696. The most important laboratory values are urea, creatinine, granulocytes, chloride and calcium. CONCLUSION: The model performance is acceptable, but insufficient for clinical use. Additional laboratory values or the laboratory history could improve the performance.

Evaluation of a Machine Learning-Based Dysphagia Prediction Tool in Clinical Routine: A Prospective Observational Cohort Study.

Based on a large number of pre-existing documented electronic health records (EHR), we developed a machine learning (ML) algorithm for detection of dysphagia and aspiration pneumonia. The aim of our study was to prospectively apply this algorithm in two large patient cohorts. The tool was integrated in the hospital information system of a secondary care hospital in Austria. Based on existing data such as diagnoses, laboratory, and medication, dysphagia risk was predicted automatically, and patients were stratified into three risk groups. Patients' risk groups and risk factors were visualized in a web application. Prospective predictions of 1270 admissions to geriatric or internal medicine departments were compared with the occurrence of dysphagia or aspiration pneumonia of routinely documented events. The discriminative performance for internal medicine patients (n = 885) was excellent with an AUROC of 0.841, a sensitivity of 74.2%, and a specificity of 84.1%. For the smaller geriatric cohort (n = 221), the AUROC was 0.758, sensitivity 44.4%, and specificity 93.0%. For both cohorts, calibration plots showed a slight overestimation of the risk. This is the first study to evaluate the performance of a ML-based prediction tool for dysphagia in a prospective clinical setting. Future studies should validate the predictions on data of systematic dysphagia screening by specialists and evaluate user satisfaction and acceptance. The ML-based dysphagia prediction tool achieved an excellent performance in the internal medicine cohort. More data are needed to determine the performance in geriatric patients.

Towards Automated Screening of Literature on Artificial Intelligence in Nursing.

We evaluate the performance of multiple text classification methods used to automate the screening of article abstracts in terms of their relevance to a topic of interest. The aim is to develop a system that can be first trained on a set of manually screened article abstracts before using it to identify additional articles on the same topic. Here the focus is on articles related to the topic "artificial intelligence in nursing". Eight text classification methods are tested, as well as two simple ensemble systems. The results indicate that it is feasible to use text classification technology to support the manual screening process of article abstracts when conducting a literature review. The best results are achieved by an ensemble system, which achieves a F1-score of 0.41, with a sensitivity of 0.54 and a specificity of 0.96. Future work directions are discussed.

External Validation of a Machine Learning Based Delirium Prediction Software in Clinical Routine.

BACKGROUND: Various machine learning (ML) models have been developed for the prediction of clinical outcomes, but there is missing evidence on their performance in clinical routine and external validation. OBJECTIVES: Our aim was to deploy and prospectively evaluate an already developed delirium prediction software in clinical routine of an external hospital. METHODS: We compared updated ML models of the software and models re-trained with the external hospital's data. The best models were deployed in clinical routine for one month, and risk predictions for all admitted patients were compared to the risk ratings of a senior physician. After using the software, clinicians completed a questionnaire assessing technology acceptance. RESULTS: Re-trained models achieved a high discriminative performance (AUROC > 0.92). Compared to clinical risk ratings, the software achieved a sensitivity of 100.0% and a specificity of 90.6%. Usefulness, ease of use and output quality were rated positively by the users. CONCLUSION: A ML based delirium prediction software achieved a high discriminative performance and high technology acceptance at an external hospital using re-trained ML models.

How to Improve Information Technology to Support Healthcare to Address the COVID-19 Pandemic: an International Survey with Health Informatics Experts.

OBJECTIVES: To identify the ways in which healthcare information and communication technologies can be improved to address the challenges raised by the COVID-19 pandemic. METHODS: The study population included health informatics experts who had been involved with the planning, development and deployment of healthcare information and communication technologies in healthcare settings in response to the challenges presented by the COVID-19 pandemic. Data were collected via an online survey. A non-probability convenience sampling strategy was employed. Data were analyzed with content analysis. RESULTS: A total of 65 participants from 16 countries responded to the conducted survey. The four major themes regarding recommended improvements identified from the content analysis included: improved technology availability, improved interoperability, intuitive user interfaces and adoption of standards of care. Respondents also identified several key healthcare information and communication technologies that can help to provide better healthcare to patients during the COVID-19 pandemic, including telehealth, advanced software, electronic health records, remote work technologies (e.g., remote desktop computer access), and clinical decision support tools. CONCLUSIONS: Our results help to identify several important healthcare information and communication technologies, recommended by health informatics experts, which can help to provide better care to patients during the COVID-19 pandemic. The results also highlight the need for improved interoperability, intuitive user interfaces and advocating the adoption of standards of care.

An Improvised Classification Model for Predicting Delirium.

With the vast increase of digital healthcare data, there is an opportunity to mine the data for understanding inherent health patterns. Although machine-learning techniques demonstrated their applications in healthcare to answer several questions, there is still room for improvement in every aspect. In this paper, we are demonstrating a method that improves the performance of a delirium prediction model using random forest in combination with logistic regression.

Information Adapted Machine Learning Models for Prediction in Clinical Workflow.

BACKGROUND: In a database of electronic health records, the amount of available information varies widely between patients. In a real-time prediction scenario, a machine learning model may receive limited information for some patients. OBJECTIVES: Our aim was to evaluate the influence of missing data on real-time prediction of delirium, and detect changes in prediction performance when training separate models for patients with missing data. METHODS: We compared a model trained specifically on data with missing values to the currently implemented model predicting delirium. Also, we simulated five test data sets with different amount of missing data and compared the prediction results to the prediction on complete data set when using the same model. RESULTS: For patients with missing laboratory and nursing assessment data, a model trained especially for this scenario performed significantly better than the implemented model. The combination of procedure data and demographic data achieved the closest results to a prediction with a complete data set. CONCLUSION: An ongoing evaluation of real-time prediction is indispensable. Additional models adapted to the information available might improve prediction performance.

Is Regular Re-Training of a Predictive Delirium Model Necessary After Deployment in Routine Care?

Adoption of electronic medical records in hospitals generates a large amount of data. Health care professionals can easily lose their sight on the important insights of the patients' clinical and medical history. Although machine learning algorithms have already proved their significance in healthcare research, remains a challenge translation and dissemination of fully automated prediction algorithms from research to decision support at the point of care. In this paper, we address the effect of changes in the characteristics of data over time on the performance of deployed models for the use case of predicting delirium in hospitalised patients. We have analysed the stability of models trained with subsets of data from one single year (2012, 2013...2016, respectively), and tested the models with data from 2017. Our results show that in the case of delirium prediction, the models were stable over time, indicating that re-training the models is not necessary e.g. once per year might be more than sufficient.