Improving ICU Risk Predictive Models Through Automation Designed for Resiliency Against Documentation Bias.

OBJECTIVES: Electronic health records enable automated data capture for risk models but may introduce bias. We present the Philips Critical Care Outcome Prediction Model (CCOPM) focused on addressing model features sensitive to data drift to improve benchmarking ICUs on mortality performance. DESIGN: Retrospective, multicenter study of ICU patients randomized in 3:2 fashion into development and validation cohorts. Generalized additive models (GAM) with features designed to mitigate biases introduced from documentation of admission diagnosis, Glasgow Coma Scale (GCS), and extreme vital signs were developed using clinical features representing the first 24 hours of ICU admission. SETTING: eICU Research Institute database derived from ICUs participating in the Philips eICU telecritical care program. PATIENTS: A total of 572,985 adult ICU stays discharged from the hospital between January 1, 2017, and December 31, 2018, were included, yielding 509,586 stays in the final cohort; 305,590 and 203,996 in development and validation cohorts, respectively. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Model discrimination was compared against Acute Physiology and Chronic Health Evaluation (APACHE) IVa/IVb models on the validation cohort using the area under the receiver operating characteristic (AUROC) curve. Calibration assessed by actual/predicted ratios, calibration-in-the-large statistics, and visual analysis. Performance metrics were further stratified by subgroups of admission diagnosis and ICU characteristics. Historic data from two health systems with abrupt changes in Glasgow Coma Scale (GCS) documentation were assessed in the year prior to and after data shift. CCOPM outperformed APACHE IVa/IVb for ICU mortality (AUROC, 0.925 vs 0.88) and hospital mortality (AUROC, 0.90 vs 0.86). Better calibration performance was also attained among subgroups of different admission diagnoses, ICU types, and over unique ICU-years. The CCOPM provided more stable predictions compared with APACHE IVa within an external cohort of greater than 120,000 patients from two health systems with known changes in GCS documentation. CONCLUSIONS: These mortality risk models demonstrated excellent performance compared with APACHE while appearing to mitigate bias introduced through major shifts in GCS documentation at two large health systems. This provides evidence to support using automated capture rather than trained personnel for capture of GCS data used in benchmarking ICUs on mortality performance.

Physician and Trainee Perceptions of Telecritical Care Practice and Education: Results of a Programmatic Survey.

Background: Telecritical care (TCC) as a telehealth modality seeks to remedy contemporary shortfalls in staffing and experience at the bedside. Physician and physician trainee perceptions of TCC practice and education can help inform programmatic and curricular decisions. The perceptions of TCC and a formalized structured TCC rotation from faculty and trainees are unknown. Objective: To evaluate perceptions of TCC practice and education among participating physicians and trainees. Methods: Survey of physicians and trainees participating in the Emory Critical Care Center's TCC unit from 2017 to 2021 was conducted, after implementation of a structured TCC educational curriculum. Items were developed with a 5-point Likert scale. Results: The overall response rate was 71% (43 of 61). Most respondents felt their knowledge was used appropriately and that their recommendations were well received at the bedside. The majority perceived that the TCC program improved continuity, quality, and safety of patient care. More than half of respondents would practice TCC in the future, and most would advocate for it. Most fellows were comfortable providing patient care remotely after their rotation. The majority of respondents felt TCC did not add to their level of burnout. Conclusions: This programmatic evaluation identified perceived improvements in patient care. Implementation of a TCC rotation does not seem to negatively impact the educational experience of trainees.

Describing advanced practice provider roles within critical care teams with Tele-ICUs: Exemplars from seven US health systems.

Telehealth is an acknowledged strategy to meet patient healthcare needs. In critical care settings, Tele-ICU's are expanding to deliver clinical services across a diverse spectrum of critically ill patients. The expansion of telehealth provides increased opportunities for advanced practice providers including advanced practice nurses and physician assistants; however, limited information on roles and models of care for advanced practice providers in telehealth exist. This article reviews current and evolving roles for advanced practice providers in telehealth in acute and critical care settings across 7 healthcare systems in the United States. The health system exemplars described in this article identify the important role of advanced practice providers in providing patient care oversight and in improving outcomes for acute and critically ill patients. As telehealth continues to expand, additional opportunities will lead to novel roles for advanced practice providers in the field of telehealth to assist with patient care management for subacute, acute, and critically ill patients.

Intensive Care Unit Telemedicine: Innovations and Limitations.

Intensive care unit (ICU) telemedicine is an established entity that has the ability to not only improve the effectiveness, efficiency, and safety of critical care, but to also serve as a tool to combat staffing shortages and resource-limited environments. Several areas for future innovation exist within the field, including the use of advanced practice providers, robust inclusion in medical education, and concurrent application of advanced machine learning. The globalization of critical care services will also likely be predominantly delivered by ICU telemedicine. Limitations faced by the field include technical issues, financial concerns, and organizational elements.