The Impact of Multi-Institution Datasets on the Generalizability of Machine Learning Prediction Models in the ICU.

OBJECTIVES: To evaluate the transferability of deep learning (DL) models for the early detection of adverse events to previously unseen hospitals. DESIGN: Retrospective observational cohort study utilizing harmonized intensive care data from four public datasets. SETTING: ICUs across Europe and the United States. PATIENTS: Adult patients admitted to the ICU for at least 6 hours who had good data quality. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Using carefully harmonized data from a total of 334,812 ICU stays, we systematically assessed the transferability of DL models for three common adverse events: death, acute kidney injury (AKI), and sepsis. We tested whether using more than one data source and/or algorithmically optimizing for generalizability during training improves model performance at new hospitals. We found that models achieved high area under the receiver operating characteristic (AUROC) for mortality (0.838-0.869), AKI (0.823-0.866), and sepsis (0.749-0.824) at the training hospital. As expected, AUROC dropped when models were applied at other hospitals, sometimes by as much as -0.200. Using more than one dataset for training mitigated the performance drop, with multicenter models performing roughly on par with the best single-center model. Dedicated methods promoting generalizability did not noticeably improve performance in our experiments. CONCLUSIONS: Our results emphasize the importance of diverse training data for DL-based risk prediction. They suggest that as data from more hospitals become available for training, models may become increasingly generalizable. Even so, good performance at a new hospital still depended on the inclusion of compatible hospitals during training.

Does Reinforcement Learning Improve Outcomes for Critically Ill Patients? A Systematic Review and Level-of-Readiness Assessment.

OBJECTIVE: Reinforcement learning (RL) is a machine learning technique uniquely effective at sequential decision-making, which makes it potentially relevant to ICU treatment challenges. We set out to systematically review, assess level-of-readiness and meta-analyze the effect of RL on outcomes for critically ill patients. DATA SOURCES: A systematic search was performed in PubMed, Embase.com, Clarivate Analytics/Web of Science Core Collection, Elsevier/SCOPUS and the Institute of Electrical and Electronics Engineers Xplore Digital Library from inception to March 25, 2022, with subsequent citation tracking. DATA EXTRACTION: Journal articles that used an RL technique in an ICU population and reported on patient health-related outcomes were included for full analysis. Conference papers were included for level-of-readiness assessment only. Descriptive statistics, characteristics of the models, outcome compared with clinician's policy and level-of-readiness were collected. RL-health risk of bias and applicability assessment was performed. DATA SYNTHESIS: A total of 1,033 articles were screened, of which 18 journal articles and 18 conference papers, were included. Thirty of those were prototyping or modeling articles and six were validation articles. All articles reported RL algorithms to outperform clinical decision-making by ICU professionals, but only in retrospective data. The modeling techniques for the state-space, action-space, reward function, RL model training, and evaluation varied widely. The risk of bias was high in all articles, mainly due to the evaluation procedure. CONCLUSION: In this first systematic review on the application of RL in intensive care medicine we found no studies that demonstrated improved patient outcomes from RL-based technologies. All studies reported that RL-agent policies outperformed clinician policies, but such assessments were all based on retrospective off-policy evaluation.

The Incidence of Pulmonary Embolism in Hospitalized Non-ICU Patients with COVID-19 during the First Wave: A Multicenter Retrospective Cohort Study in the Netherlands.

INTRODUCTION: During the first COVID-19 outbreak in 2020 in the Netherlands, the incidence of pulmonary embolism (PE) appeared to be high in COVID-19 patients admitted to the intensive care unit (ICU). This study was performed to evaluate the incidence of PE during hospital stay in COVID-19 patients not admitted to the ICU. METHODS: Data were retrospectively collected from 8 hospitals in the Netherlands. Patients admitted between February 27, 2020, and July 31, 2020, were included. Data extracted comprised clinical characteristics, medication use, first onset of COVID-19-related symptoms, admission date due to COVID-19, and date of PE diagnosis. Only polymerase chain reaction (PCR)-positive patients were included. All PEs were diagnosed with computed tomography pulmonary angiography (CTPA). RESULTS: Data from 1,852 patients who were admitted to the hospital ward were collected. Forty patients (2.2%) were diagnosed with PE within 28 days following hospital admission. The median time to PE since admission was 4.5 days (IQR 0.0-9.0). In all 40 patients, PE was diagnosed within the first 2 weeks after hospital admission and for 22 (55%) patients within 2 weeks after onset of symptoms. Patient characteristics, pre-existing comorbidities, anticoagulant use, and laboratory parameters at admission were not related to the development of PE. CONCLUSION: In this retrospective multicenter cohort study of 1,852 COVID-19 patients only admitted to the non-ICU wards, the incidence of CTPA-confirmed PE was 2.2% during the first 4 weeks after onset of symptoms and occurred exclusively within 2 weeks after hospital admission.

Artificial intelligence to advance acute and intensive care medicine.

PURPOSE OF REVIEW: This review explores recent key advancements in artificial intelligence for acute and intensive care medicine. As artificial intelligence rapidly evolves, this review aims to elucidate its current applications, future possibilities, and the vital challenges that are associated with its integration into emergency medical dispatch, triage, medical consultation and ICUs. RECENT FINDINGS: The integration of artificial intelligence in emergency medical dispatch (EMD) facilitates swift and accurate assessment. In the emergency department (ED), artificial intelligence driven triage models leverage diverse patient data for improved outcome predictions, surpassing human performance in retrospective studies. Artificial intelligence can streamline medical documentation in the ED and enhances medical imaging interpretation. The introduction of large multimodal generative models showcases the future potential to process varied biomedical data for comprehensive decision support. In the ICU, artificial intelligence applications range from early warning systems to treatment suggestions. SUMMARY: Despite promising academic strides, widespread artificial intelligence adoption in acute and critical care is hindered by ethical, legal, technical, organizational, and validation challenges. Despite these obstacles, artificial intelligence's potential to streamline clinical workflows is evident. When these barriers are overcome, future advancements in artificial intelligence have the potential to transform the landscape of patient care for acute and intensive care medicine.

Use of artificial intelligence in critical care: opportunities and obstacles.

BACKGROUND: Perhaps nowhere else in the healthcare system than in the intensive care unit environment are the challenges to create useful models with direct time-critical clinical applications more relevant and the obstacles to achieving those goals more massive. Machine learning-based artificial intelligence (AI) techniques to define states and predict future events are commonplace activities of modern life. However, their penetration into acute care medicine has been slow, stuttering and uneven. Major obstacles to widespread effective application of AI approaches to the real-time care of the critically ill patient exist and need to be addressed. MAIN BODY: Clinical decision support systems (CDSSs) in acute and critical care environments support clinicians, not replace them at the bedside. As will be discussed in this review, the reasons are many and include the immaturity of AI-based systems to have situational awareness, the fundamental bias in many large databases that do not reflect the target population of patient being treated making fairness an important issue to address and technical barriers to the timely access to valid data and its display in a fashion useful for clinical workflow. The inherent "black-box" nature of many predictive algorithms and CDSS makes trustworthiness and acceptance by the medical community difficult. Logistically, collating and curating in real-time multidimensional data streams of various sources needed to inform the algorithms and ultimately display relevant clinical decisions support format that adapt to individual patient responses and signatures represent the efferent limb of these systems and is often ignored during initial validation efforts. Similarly, legal and commercial barriers to the access to many existing clinical databases limit studies to address fairness and generalizability of predictive models and management tools. CONCLUSIONS: AI-based CDSS are evolving and are here to stay. It is our obligation to be good shepherds of their use and further development.

Do Thresholds for Invasive Ventilation in Hypoxemic Respiratory Failure Exist? A Cohort Study.

Rationale: Invasive ventilation is a significant event for patients with respiratory failure. Physiologic thresholds standardize the use of invasive ventilation in clinical trials, but it is unknown whether thresholds prompt invasive ventilation in clinical practice. Objectives: To measure, in patients with hypoxemic respiratory failure, the probability of invasive ventilation within 3 hours after meeting physiologic thresholds. Methods: We studied patients admitted to intensive care receiving FiO2 of 0.4 or more via nonrebreather mask, noninvasive positive pressure ventilation, or high-flow nasal cannula, using data from the Medical Information Mart for Intensive Care (MIMIC)-IV database (2008-2019) and the Amsterdam University Medical Centers Database (AmsterdamUMCdb) (2003-2016). We evaluated 17 thresholds, including the ratio of arterial to inspired oxygen, the ratio of saturation to inspired oxygen ratio, composite scores, and criteria from randomized trials. We report the probability of invasive ventilation within 3 hours of meeting each threshold and its association with covariates using odds ratios (ORs) and 95% credible intervals (CrIs). Measurements and Main Results: We studied 4,726 patients (3,365 from MIMIC, 1,361 from AmsterdamUMCdb). Invasive ventilation occurred in 28% (1,320). In MIMIC, the highest probability of invasive ventilation within 3 hours of meeting a threshold was 20%, after meeting prespecified neurologic or respiratory criteria while on vasopressors, and 19%, after a ratio of arterial to inspired oxygen of <80 mm Hg. In AmsterdamUMCdb, the highest probability was 34%, after vasopressor initiation, and 25%, after a ratio of saturation to inspired oxygen of <90. The probability after meeting the threshold from randomized trials was 9% (MIMIC) and 13% (AmsterdamUMCdb). In MIMIC, a race/ethnicity of Black (OR, 0.75; 95% CrI, 0.57-0.96) or Asian (OR, 0.6; 95% CrI, 0.35-0.95) compared with White was associated with decreased probability of invasive ventilation after meeting a threshold. Conclusions: The probability of invasive ventilation within 3 hours of meeting physiologic thresholds was low and associated with patient race/ethnicity.

Age-related changes in plasma biomarkers and their association with mortality in COVID-19.

BACKGROUND: Coronavirus disease 2019 (COVID-19)-induced mortality occurs predominantly in older patients. Several immunomodulating therapies seem less beneficial in these patients. The biological substrate behind these observations is unknown. The aim of this study was to obtain insight into the association between ageing, the host response and mortality in patients with COVID-19. METHODS: We determined 43 biomarkers reflective of alterations in four pathophysiological domains: endothelial cell and coagulation activation, inflammation and organ damage, and cytokine and chemokine release. We used mediation analysis to associate ageing-driven alterations in the host response with 30-day mortality. Biomarkers associated with both ageing and mortality were validated in an intensive care unit and external cohort. RESULTS: 464 general ward patients with COVID-19 were stratified according to age decades. Increasing age was an independent risk factor for 30-day mortality. Ageing was associated with alterations in each of the host response domains, characterised by greater activation of the endothelium and coagulation system and stronger elevation of inflammation and organ damage markers, which was independent of an increase in age-related comorbidities. Soluble tumour necrosis factor receptor 1, soluble triggering receptor expressed on myeloid cells 1 and soluble thrombomodulin showed the strongest correlation with ageing and explained part of the ageing-driven increase in 30-day mortality (proportion mediated: 13.0%, 12.9% and 12.6%, respectively). CONCLUSIONS: Ageing is associated with a strong and broad modification of the host response to COVID-19, and specific immune changes likely contribute to increased mortality in older patients. These results may provide insight into potential age-specific immunomodulatory targets in COVID-19.

Predicting Readmission or Death After Discharge From the ICU: External Validation and Retraining of a Machine Learning Model.

OBJECTIVES: Many machine learning (ML) models have been developed for application in the ICU, but few models have been subjected to external validation. The performance of these models in new settings therefore remains unknown. The objective of this study was to assess the performance of an existing decision support tool based on a ML model predicting readmission or death within 7 days after ICU discharge before, during, and after retraining and recalibration. DESIGN: A gradient boosted ML model was developed and validated on electronic health record data from 2004 to 2021. We performed an independent validation of this model on electronic health record data from 2011 to 2019 from a different tertiary care center. SETTING: Two ICUs in tertiary care centers in The Netherlands. PATIENTS: Adult patients who were admitted to the ICU and stayed for longer than 12 hours. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: We assessed discrimination by area under the receiver operating characteristic curve (AUC) and calibration (slope and intercept). We retrained and recalibrated the original model and assessed performance via a temporal validation design. The final retrained model was cross-validated on all data from the new site. Readmission or death within 7 days after ICU discharge occurred in 577 of 10,052 ICU admissions (5.7%) at the new site. External validation revealed moderate discrimination with an AUC of 0.72 (95% CI 0.67-0.76). Retrained models showed improved discrimination with AUC 0.79 (95% CI 0.75-0.82) for the final validation model. Calibration was poor initially and good after recalibration via isotonic regression. CONCLUSIONS: In this era of expanding availability of ML models, external validation and retraining are key steps to consider before applying ML models to new settings. Clinicians and decision-makers should take this into account when considering applying new ML models to their local settings.

Oxygenation thresholds for invasive ventilation in hypoxemic respiratory failure: a target trial emulation in two cohorts.

BACKGROUND: The optimal thresholds for the initiation of invasive ventilation in patients with hypoxemic respiratory failure are unknown. Using the saturation-to-inspired oxygen ratio (SF), we compared lower versus higher hypoxemia severity thresholds for initiating invasive ventilation. METHODS: This target trial emulation included patients from the Medical Information Mart for Intensive Care (MIMIC-IV, 2008-2019) and the Amsterdam University Medical Centers (AmsterdamUMCdb, 2003-2016) databases admitted to intensive care and receiving inspired oxygen fraction ≥ 0.4 via non-rebreather mask, noninvasive ventilation, or high-flow nasal cannula. We compared the effect of using invasive ventilation initiation thresholds of SF < 110, < 98, and < 88 on 28-day mortality. MIMIC-IV was used for the primary analysis and AmsterdamUMCdb for the secondary analysis. We obtained posterior means and 95% credible intervals (CrI) with nonparametric Bayesian G-computation. RESULTS: We studied 3,357 patients in the primary analysis. For invasive ventilation initiation thresholds SF < 110, SF < 98, and SF < 88, the predicted 28-day probabilities of invasive ventilation were 72%, 47%, and 19%. Predicted 28-day mortality was lowest with threshold SF < 110 (22.2%, CrI 19.2 to 25.0), compared to SF < 98 (absolute risk increase 1.6%, CrI 0.6 to 2.6) or SF < 88 (absolute risk increase 3.5%, CrI 1.4 to 5.4). In the secondary analysis (1,279 patients), the predicted 28-day probability of invasive ventilation was 50% for initiation threshold SF < 110, 28% for SF < 98, and 19% for SF < 88. In contrast with the primary analysis, predicted mortality was highest with threshold SF < 110 (14.6%, CrI 7.7 to 22.3), compared to SF < 98 (absolute risk decrease 0.5%, CrI 0.0 to 0.9) or SF < 88 (absolute risk decrease 1.9%, CrI 0.9 to 2.8). CONCLUSION: Initiating invasive ventilation at lower hypoxemia severity will increase the rate of invasive ventilation, but this can either increase or decrease the expected mortality, with the direction of effect likely depending on baseline mortality risk and clinical context.

Evolution of Clinical Phenotypes of COVID-19 Patients During Intensive Care Treatment: An Unsupervised Machine Learning Analysis.

BACKGROUND: Identification of clinical phenotypes in critically ill COVID-19 patients could improve understanding of the disease heterogeneity and enable prognostic and predictive enrichment. However, previous attempts did not take into account temporal dynamics with high granularity. By including the dimension of time, we aim to gain further insights into the heterogeneity of COVID-19. METHODS: We used granular data from 3202 adult COVID patients in the Dutch Data Warehouse that were admitted to one of 25 Dutch ICUs between February 2020 and March 2021. Parameters including demographics, clinical observations, medications, laboratory values, vital signs, and data from life support devices were selected. Twenty-one datasets were created that each covered 24 h of ICU data for each day of ICU treatment. Clinical phenotypes in each dataset were identified by performing cluster analyses. Both evolution of the clinical phenotypes over time and patient allocation to these clusters over time were tracked. RESULTS: The final patient cohort consisted of 2438 COVID-19 patients with a ICU mortality outcome. Forty-one parameters were chosen for cluster analysis. On admission, both a mild and a severe clinical phenotype were found. After day 4, the severe phenotype split into an intermediate and a severe phenotype for 11 consecutive days. Heterogeneity between phenotypes appears to be driven by inflammation and dead space ventilation. During the 21-day period, only 8.2% and 4.6% of patients in the initial mild and severe clusters remained assigned to the same phenotype respectively. The clinical phenotype half-life was between 5 and 6 days for the mild and severe phenotypes, and about 3 days for the medium severe phenotype. CONCLUSIONS: Patients typically do not remain in the same cluster throughout intensive care treatment. This may have important implications for prognostic or predictive enrichment. Prominent dissimilarities between clinical phenotypes are predominantly driven by inflammation and dead space ventilation.

Coronary Angiography after Cardiac Arrest without ST-Segment Elevation.

BACKGROUND: Ischemic heart disease is a major cause of out-of-hospital cardiac arrest. The role of immediate coronary angiography and percutaneous coronary intervention (PCI) in the treatment of patients who have been successfully resuscitated after cardiac arrest in the absence of ST-segment elevation myocardial infarction (STEMI) remains uncertain. METHODS: In this multicenter trial, we randomly assigned 552 patients who had cardiac arrest without signs of STEMI to undergo immediate coronary angiography or coronary angiography that was delayed until after neurologic recovery. All patients underwent PCI if indicated. The primary end point was survival at 90 days. Secondary end points included survival at 90 days with good cerebral performance or mild or moderate disability, myocardial injury, duration of catecholamine support, markers of shock, recurrence of ventricular tachycardia, duration of mechanical ventilation, major bleeding, occurrence of acute kidney injury, need for renal-replacement therapy, time to target temperature, and neurologic status at discharge from the intensive care unit. RESULTS: At 90 days, 176 of 273 patients (64.5%) in the immediate angiography group and 178 of 265 patients (67.2%) in the delayed angiography group were alive (odds ratio, 0.89; 95% confidence interval [CI], 0.62 to 1.27; P = 0.51). The median time to target temperature was 5.4 hours in the immediate angiography group and 4.7 hours in the delayed angiography group (ratio of geometric means, 1.19; 95% CI, 1.04 to 1.36). No significant differences between the groups were found in the remaining secondary end points. CONCLUSIONS: Among patients who had been successfully resuscitated after out-of-hospital cardiac arrest and had no signs of STEMI, a strategy of immediate angiography was not found to be better than a strategy of delayed angiography with respect to overall survival at 90 days. (Funded by the Netherlands Heart Institute and others; COACT Netherlands Trial Register number, NTR4973.).

Systematic Review and Comparison of Publicly Available ICU Data Sets-A Decision Guide for Clinicians and Data Scientists.

OBJECTIVE: As data science and artificial intelligence continue to rapidly gain traction, the publication of freely available ICU datasets has become invaluable to propel data-driven clinical research. In this guide for clinicians and researchers, we aim to: 1) systematically search and identify all publicly available adult clinical ICU datasets, 2) compare their characteristics, data quality, and richness and critically appraise their strengths and weaknesses, and 3) provide researchers with suggestions, which datasets are appropriate for answering their clinical question. DATA SOURCES: A systematic search was performed in Pubmed, ArXiv, MedRxiv, and BioRxiv. STUDY SELECTION: We selected all studies that reported on publicly available adult patient-level intensive care datasets. DATA EXTRACTION: A total of four publicly available, adult, critical care, patient-level databases were included (Amsterdam University Medical Center data base [AmsterdamUMCdb], eICU Collaborative Research Database eICU CRD], High time-resolution intensive care unit dataset [HiRID], and Medical Information Mart for Intensive Care-IV). Databases were compared using a priori defined categories, including demographics, patient characteristics, and data richness. The study protocol and search strategy were prospectively registered. DATA SYNTHESIS: Four ICU databases fulfilled all criteria for inclusion and were queried using SQL (PostgreSQL version 12; PostgreSQL Global Development Group) and analyzed using R (R Foundation for Statistical Computing, Vienna, Austria). The number of unique patient admissions varied between 23,106 (AmsterdamUMCdb) and 200,859 (eICU-CRD). Frequency of laboratory values and vital signs was highest in HiRID, for example, 5.2 (±3.4) lactate values per day and 29.7 (±10.2) systolic blood pressure values per hour. Treatment intensity varied with vasopressor and ventilatory support in 69.0% and 83.0% of patients in AmsterdamUMCdb versus 12.0% and 21.0% in eICU-CRD, respectively. ICU mortality ranged from 5.5% in eICU-CRD to 9.9% in AmsterdamUMCdb. CONCLUSIONS: We identified four publicly available adult clinical ICU datasets. Sample size, severity of illness, treatment intensity, and frequency of reported parameters differ markedly between the databases. This should guide clinicians and researchers which databases to best answer their clinical questions.

Targeted Temperature Management in Out-of-Hospital Cardiac Arrest With Shockable Rhythm: A Post Hoc Analysis of the Coronary Angiography After Cardiac Arrest Trial.

OBJECTIVES: The optimal targeted temperature in patients with shockable rhythm is unclear, and current guidelines recommend targeted temperature management with a correspondingly wide range between 32°C and 36°C. Our aim was to study survival and neurologic outcome associated with targeted temperature management strategy in postarrest patients with initial shockable rhythm. DESIGN: Observational substudy of the Coronary Angiography after Cardiac Arrest without ST-segment Elevation trial. SETTING: Nineteen hospitals in The Netherlands. PATIENTS: The Coronary Angiography after Cardiac Arrest trial randomized successfully resuscitated patients with shockable rhythm and absence of ST-segment elevation to a strategy of immediate or delayed coronary angiography. In this substudy, 459 patients treated with mild therapeutic hypothermia (32.0-34.0°C) or targeted normothermia (36.0-37.0°C) were included. Allocation to targeted temperature management strategy was at the discretion of the physician. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: After 90 days, 171 patients (63.6%) in the mild therapeutic hypothermia group and 129 (67.9%) in the targeted normothermia group were alive (hazard ratio, 0.86 [95% CI, 0.62-1.18]; log-rank p = 0.35; adjusted odds ratio, 0.89; 95% CI, 0.45-1.72). Patients in the mild therapeutic hypothermia group had longer ICU stay (4 d [3-7 d] vs 3 d [2-5 d]; ratio of geometric means, 1.32; 95% CI, 1.15-1.51), lower blood pressures, higher lactate levels, and increased need for inotropic support. Cerebral Performance Category scores at ICU discharge and 90-day follow-up and patient-reported Mental and Physical Health Scores at 1 year were similar in the two groups. CONCLUSIONS: In the context of out-of-hospital cardiac arrest with shockable rhythm and no ST-elevation, treatment with mild therapeutic hypothermia was not associated with improved 90-day survival compared with targeted normothermia. Neurologic outcomes at 90 days as well as patient-reported Mental and Physical Health Scores at 1 year did not differ between the groups.

The Potential Cost-Effectiveness of a Machine Learning Tool That Can Prevent Untimely Intensive Care Unit Discharge.

OBJECTIVES: The machine learning prediction model Pacmed Critical (PC), currently under development, may guide intensivists in their decision-making process on the most appropriate time to discharge a patient from the intensive care unit (ICU). Given the financial pressure on healthcare budgets, this study assessed whether PC has the potential to be cost-effective compared with standard care, without the use of PC, for Dutch patients in the ICU from a societal perspective. METHODS: A 1-year, 7-state Markov model reflecting the ICU care pathway and incorporating the PC decision tool was developed. A hypothetical cohort of 1000 adult Dutch patients admitted in the ICU was entered in the model. We used the literature, expert opinion, and data from Amsterdam University Medical Center for model parameters. The uncertainty surrounding the incremental cost-effectiveness ratio was assessed using deterministic and probabilistic sensitivity analyses and scenario analyses. RESULTS: PC was a cost-effective strategy with an incremental cost-effectiveness ratio of €18 507 per quality-adjusted life-year. PC remained cost-effective over standard care in multiple scenarios and sensitivity analyses. The likelihood that PC will be cost-effective was 71% at a willingness-to-pay threshold of €30 000 per quality-adjusted life-year. The key driver of the results was the parameter "reduction in ICU length of stay." CONCLUSIONS: We showed that PC has the potential to be cost-effective for Dutch ICUs in a time horizon of 1 year. This study is one of the first cost-effectiveness analyses of a machine learning device. Further research is needed to validate the effectiveness of PC, thereby focusing on the key parameter "reduction in ICU length of stay" and potential spill-over effects.

A novel Vascular Leak Index identifies sepsis patients with a higher risk for in-hospital death and fluid accumulation.

PURPOSE: Sepsis is a leading cause of morbidity and mortality worldwide and is characterized by vascular leak. Treatment for sepsis, specifically intravenous fluids, may worsen deterioration in the context of vascular leak. We therefore sought to quantify vascular leak in sepsis patients to guide fluid resuscitation. METHODS: We performed a retrospective cohort study of sepsis patients in four ICU databases in North America, Europe, and Asia. We developed an intuitive vascular leak index (VLI) and explored the relationship between VLI and in-hospital death and fluid balance using generalized additive models (GAM). RESULTS: Using a GAM, we found that increased VLI is associated with an increased risk of in-hospital death. Patients with a VLI in the highest quartile (Q4), across the four datasets, had a 1.61-2.31 times increased odds of dying in the hospital compared to patients with a VLI in the lowest quartile (Q1). VLI Q2 and Q3 were also associated with increased odds of dying. The relationship between VLI, treated as a continuous variable, and in-hospital death and fluid balance was statistically significant in the three datasets with large sample sizes. Specifically, we observed that as VLI increased, there was increase in the risk for in-hospital death and 36-84 h fluid balance. CONCLUSIONS: Our VLI identifies groups of patients who may be at higher risk for in-hospital death or for fluid accumulation. This relationship persisted in models developed to control for severity of illness and chronic comorbidities.

Co-infection and ICU-acquired infection in COIVD-19 ICU patients: a secondary analysis of the UNITE-COVID data set.

BACKGROUND: The COVID-19 pandemic presented major challenges for critical care facilities worldwide. Infections which develop alongside or subsequent to viral pneumonitis are a challenge under sporadic and pandemic conditions; however, data have suggested that patterns of these differ between COVID-19 and other viral pneumonitides. This secondary analysis aimed to explore patterns of co-infection and intensive care unit-acquired infections (ICU-AI) and the relationship to use of corticosteroids in a large, international cohort of critically ill COVID-19 patients. METHODS: This is a multicenter, international, observational study, including adult patients with PCR-confirmed COVID-19 diagnosis admitted to ICUs at the peak of wave one of COVID-19 (February 15th to May 15th, 2020). Data collected included investigator-assessed co-infection at ICU admission, infection acquired in ICU, infection with multi-drug resistant organisms (MDRO) and antibiotic use. Frequencies were compared by Pearson's Chi-squared and continuous variables by Mann-Whitney U test. Propensity score matching for variables associated with ICU-acquired infection was undertaken using R library MatchIT using the "full" matching method. RESULTS: Data were available from 4994 patients. Bacterial co-infection at admission was detected in 716 patients (14%), whilst 85% of patients received antibiotics at that stage. ICU-AI developed in 2715 (54%). The most common ICU-AI was bacterial pneumonia (44% of infections), whilst 9% of patients developed fungal pneumonia; 25% of infections involved MDRO. Patients developing infections in ICU had greater antimicrobial exposure than those without such infections. Incident density (ICU-AI per 1000 ICU days) was in considerable excess of reports from pre-pandemic surveillance. Corticosteroid use was heterogenous between ICUs. In univariate analysis, 58% of patients receiving corticosteroids and 43% of those not receiving steroids developed ICU-AI. Adjusting for potential confounders in the propensity-matched cohort, 71% of patients receiving corticosteroids developed ICU-AI vs 52% of those not receiving corticosteroids. Duration of corticosteroid therapy was also associated with development of ICU-AI and infection with an MDRO. CONCLUSIONS: In patients with severe COVID-19 in the first wave, co-infection at admission to ICU was relatively rare but antibiotic use was in substantial excess to that indication. ICU-AI were common and were significantly associated with use of corticosteroids. Trial registration ClinicalTrials.gov: NCT04836065 (retrospectively registered April 8th 2021).

Right dose, right now: bedside, real-time, data-driven, and personalised antibiotic dosing in critically ill patients with sepsis or septic shock-a two-centre randomised clinical trial.

BACKGROUND: Adequate antibiotic dosing may improve outcomes in critically ill patients but is challenging due to altered and variable pharmacokinetics. To address this challenge, AutoKinetics was developed, a decision support system for bedside, real-time, data-driven and personalised antibiotic dosing. This study evaluates the feasibility, safety and efficacy of its clinical implementation. METHODS: In this two-centre randomised clinical trial, critically ill patients with sepsis or septic shock were randomised to AutoKinetics dosing or standard dosing for four antibiotics: vancomycin, ciprofloxacin, meropenem, and ceftriaxone. Adult patients with a confirmed or suspected infection and either lactate > 2 mmol/L or vasopressor requirement were eligible for inclusion. The primary outcome was pharmacokinetic target attainment in the first 24 h after randomisation. Clinical endpoints included mortality, ICU length of stay and incidence of acute kidney injury. RESULTS: After inclusion of 252 patients, the study was stopped early due to the COVID-19 pandemic. In the ciprofloxacin intervention group, the primary outcome was obtained in 69% compared to 3% in the control group (OR 62.5, CI 11.4-1173.78, p < 0.001). Furthermore, target attainment was faster (26 h, CI 18-42 h, p < 0.001) and better (65% increase, CI 49-84%, p < 0.001). For the other antibiotics, AutoKinetics dosing did not improve target attainment. Clinical endpoints were not significantly different. Importantly, higher dosing did not lead to increased mortality or renal failure. CONCLUSIONS: In critically ill patients, personalised dosing was feasible, safe and significantly improved target attainment for ciprofloxacin. TRIAL REGISTRATION: The trial was prospectively registered at Netherlands Trial Register (NTR), NL6501/NTR6689 on 25 August 2017 and at the European Clinical Trials Database (EudraCT), 2017-002478-37 on 6 November 2017.

Rapid Evaluation of Coronavirus Illness Severity (RECOILS) in intensive care: Development and validation of a prognostic tool for in-hospital mortality.

BACKGROUND: The prediction of in-hospital mortality for ICU patients with COVID-19 is fundamental to treatment and resource allocation. The main purpose was to develop an easily implemented score for such prediction. METHODS: This was an observational, multicenter, development, and validation study on a national critical care dataset of COVID-19 patients. A systematic literature review was performed to determine variables possibly important for COVID-19 mortality prediction. Using a logistic multivariable model with a LASSO penalty, we developed the Rapid Evaluation of Coronavirus Illness Severity (RECOILS) score and compared its performance against published scores. RESULTS: Our development (validation) cohort consisted of 1480 (937) adult patients from 14 (11) Dutch ICUs admitted between March 2020 and April 2021. Median age was 65 (65) years, 31% (26%) died in hospital, 74% (72%) were males, average length of ICU stay was 7.83 (10.25) days and average length of hospital stay was 15.90 (19.92) days. Age, platelets, PaO2/FiO2 ratio, pH, blood urea nitrogen, temperature, PaCO2, Glasgow Coma Scale (GCS) score measured within +/-24 h of ICU admission were used to develop the score. The AUROC of RECOILS score was 0.75 (CI 0.71-0.78) which was higher than that of any previously reported predictive scores (0.68 [CI 0.64-0.71], 0.61 [CI 0.58-0.66], 0.67 [CI 0.63-0.70], 0.70 [CI 0.67-0.74] for ISARIC 4C Mortality Score, SOFA, SAPS-III, and age, respectively). CONCLUSIONS: Using a large dataset from multiple Dutch ICUs, we developed a predictive score for mortality of COVID-19 patients admitted to ICU, which outperformed other predictive scores reported so far.

Sharing ICU Patient Data Responsibly Under the Society of Critical Care Medicine/European Society of Intensive Care Medicine Joint Data Science Collaboration: The Amsterdam University Medical Centers Database (AmsterdamUMCdb) Example.

OBJECTIVES: Critical care medicine is a natural environment for machine learning approaches to improve outcomes for critically ill patients as admissions to ICUs generate vast amounts of data. However, technical, legal, ethical, and privacy concerns have so far limited the critical care medicine community from making these data readily available. The Society of Critical Care Medicine and the European Society of Intensive Care Medicine have identified ICU patient data sharing as one of the priorities under their Joint Data Science Collaboration. To encourage ICUs worldwide to share their patient data responsibly, we now describe the development and release of Amsterdam University Medical Centers Database (AmsterdamUMCdb), the first freely available critical care database in full compliance with privacy laws from both the United States and Europe, as an example of the feasibility of sharing complex critical care data. SETTING: University hospital ICU. SUBJECTS: Data from ICU patients admitted between 2003 and 2016. INTERVENTIONS: We used a risk-based deidentification strategy to maintain data utility while preserving privacy. In addition, we implemented contractual and governance processes, and a communication strategy. Patient organizations, supporting hospitals, and experts on ethics and privacy audited these processes and the database. MEASUREMENTS AND MAIN RESULTS: AmsterdamUMCdb contains approximately 1 billion clinical data points from 23,106 admissions of 20,109 patients. The privacy audit concluded that reidentification is not reasonably likely, and AmsterdamUMCdb can therefore be considered as anonymous information, both in the context of the U.S. Health Insurance Portability and Accountability Act and the European General Data Protection Regulation. The ethics audit concluded that responsible data sharing imposes minimal burden, whereas the potential benefit is tremendous. CONCLUSIONS: Technical, legal, ethical, and privacy challenges related to responsible data sharing can be addressed using a multidisciplinary approach. A risk-based deidentification strategy, that complies with both U.S. and European privacy regulations, should be the preferred approach to releasing ICU patient data. This supports the shared Society of Critical Care Medicine and European Society of Intensive Care Medicine vision to improve critical care outcomes through scientific inquiry of vast and combined ICU datasets.

Why we should sample sparsely and aim for a higher target: Lessons from model-based therapeutic drug monitoring of vancomycin in intensive care patients.

AIMS: To explore the optimal data sampling scheme and the pharmacokinetic (PK) target exposure on which dose computation is based in the model-based therapeutic drug monitoring (TDM) practice of vancomycin in intensive care (ICU) patients. METHODS: We simulated concentration data for 1 day following four sampling schemes, Cmin , Cmax + Cmin , Cmax + Cmid-interval + Cmin , and rich sampling where a sample was drawn every hour within a dose interval. The datasets were used for Bayesian estimation to obtain PK parameters, which were used to compute the doses for the next day based on five PK target exposures: AUC24 = 400, 500, and 600 mg·h/L and Cmin = 15 and 20 mg/L. We then simulated data for the next day, adopting the computed doses, and repeated the above procedure for 7 days. Thereafter, we calculated the percentage error and the normalized root mean square error (NRMSE) of estimated against "true" PK parameters, and the percentage of optimal treatment (POT), defined as the percentage of patients who met 400 ≤ AUC24 ≤ 600 mg·h/L and Cmin ≤ 20 mg/L. RESULTS: PK parameters were unbiasedly estimated in all investigated scenarios and the 6-day average NRMSE were 32.5%/38.5% (CL/V, where CL is clearance and V is volume of distribution) in the trough sampling scheme and 27.3%/26.5% (CL/V) in the rich sampling scheme. Regarding POT, the sampling scheme had marginal influence, while target exposure showed clear impacts that the maximum POT of 71.5% was reached when doses were computed based on AUC24 = 500 mg·h/L. CONCLUSIONS: For model-based TDM of vancomycin in ICU patients, sampling more frequently than taking only trough samples adds no value and dosing based on AUC24 = 500 mg·h/L lead to the best POT.