Dynamic Prediction of Mortality Using Longitudinally Measured Pediatric Sequential Organ Failure Assessment Scores: A Joint Modeling Approach.

OBJECTIVES: The pediatric Sequential Organ Failure Assessment (pSOFA) score was designed to track illness severity and predict mortality in critically ill children. Most commonly, pSOFA at a point in time is used to assess a static patient condition. However, this approach has a significant drawback because it fails to consider any changes in a patients' condition during their PICU stay and, especially, their response to initial critical care treatment. We aimed to evaluate the performance of longitudinal pSOFA scores for predicting mortality. DESIGN: Single-center, retrospective cohort study. SETTING: Quaternary 40-bed PICU. PATIENTS: All patients admitted to the PICU between 2015 and 2021 with at least 24 hours of ICU stay. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: We calculated daily pSOFA scores up to 30 days, or until death or discharge from the PICU, if earlier. We used the joint longitudinal and time-to-event data model for the dynamic prediction of 30-day in-hospital mortality. The dataset, which included 9146 patients with a 30-day in-hospital mortality of 2.6%, was divided randomly into training (75%) and validation (25%) subsets, and subjected to 40 repeated stratified cross-validations. We used dynamic area under the curve (AUC) to evaluate the discriminative performance of the model. Compared with the admission-day pSOFA score, AUC for predicting mortality between days 5 and 30 was improved on average by 6.4% (95% CI, 6.3-6.6%) using longitudinal pSOFA scores from the first 3 days and 9.2% (95% CI, 9.0-9.5%) using scores from the first 5 days. CONCLUSIONS: Compared with admission-day pSOFA score, longitudinal pSOFA scores improved the accuracy of mortality prediction in PICU patients at a single center. The pSOFA score has the potential to be used dynamically for the evaluation of patient conditions.

Comparing the Quality of Domain-Specific Versus General Language Models for Artificial Intelligence-Generated Differential Diagnoses in PICU Patients.

OBJECTIVES: Generative language models (LMs) are being evaluated in a variety of tasks in healthcare, but pediatric critical care studies are scant. Our objective was to evaluate the utility of generative LMs in the pediatric critical care setting and to determine whether domain-adapted LMs can outperform much larger general-domain LMs in generating a differential diagnosis from the admission notes of PICU patients. DESIGN: Single-center retrospective cohort study. SETTING: Quaternary 40-bed PICU. PATIENTS: Notes from all patients admitted to the PICU between January 2012 and April 2023 were used for model development. One hundred thirty randomly selected admission notes were used for evaluation. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Five experts in critical care used a 5-point Likert scale to independently evaluate the overall quality of differential diagnoses: 1) written by the clinician in the original notes, 2) generated by two general LMs (BioGPT-Large and LLaMa-65B), and 3) generated by two fine-tuned models (fine-tuned BioGPT-Large and fine-tuned LLaMa-7B). Differences among differential diagnoses were compared using mixed methods regression models. We used 1,916,538 notes from 32,454 unique patients for model development and validation. The mean quality scores of the differential diagnoses generated by the clinicians and fine-tuned LLaMa-7B, the best-performing LM, were 3.43 and 2.88, respectively (absolute difference 0.54 units [95% CI, 0.37-0.72], p < 0.001). Fine-tuned LLaMa-7B performed better than LLaMa-65B (absolute difference 0.23 unit [95% CI, 0.06-0.41], p = 0.009) and BioGPT-Large (absolute difference 0.86 unit [95% CI, 0.69-1.0], p < 0.001). The differential diagnosis generated by clinicians and fine-tuned LLaMa-7B were ranked as the highest quality in 144 (55%) and 74 cases (29%), respectively. CONCLUSIONS: A smaller LM fine-tuned using notes of PICU patients outperformed much larger models trained on general-domain data. Currently, LMs remain inferior but may serve as an adjunct to human clinicians in real-world tasks using real-world data.

Trends in Disease Severity Among Critically Ill Children With Severe Acute Respiratory Syndrome Coronavirus 2: A Retrospective Multicenter Cohort Study in the United States.

OBJECTIVES: To describe trends in critical illness from severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection in children over the course of the COVID-19 pandemic. We hypothesized that PICU admission rates were higher in the Omicron period compared with the original outbreak but that fewer patients needed endotracheal intubation. DESIGN: Retrospective cohort study. SETTING: This study took place in nine U.S. PICUs over 3 weeks in January 2022 (Omicron period) compared with 3 weeks in March 2020 (original period). PATIENTS: Patients less than or equal to 21 years old who screened positive for SARS-CoV-2 infection by polymerase chain reaction or hospital-based rapid antigen test and were admitted to a PICU or intermediate care unit were included. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: A total of 267 patients (239 Omicron and 28 original) were reviewed. Forty-five patients in the Omicron cohort had incidental SARS-CoV-2 and were excluded from analysis. The Omicron cohort patients were younger compared with the original cohort patients (median [interquartile range], 6 yr [1.3-13.3 yr] vs 14 yr [8.3-17.3 yr]; p = 0.001). The Omicron period, compared with the original period, was associated with an average increase in COVID-19-related PICU admissions of 13 patients per institution (95% CI, 6-36; p = 0.008), which represents a seven-fold increase in the absolute number admissions. We failed to identify an association between cohort period (Omicron vs original) and odds of intubation (odds ratio, 0.7; 95% CI, 0.3-1.7). However, we cannot exclude the possibility of up to 70% reduction in intubation. CONCLUSIONS: COVID-19-related PICU admissions were seven times higher in the Omicron wave compared with the original outbreak. We could not exclude the possibility of up to 70% reduction in use of intubation in the Omicron versus original epoch, which may represent differences in PICU/hospital admission policy in the later period, or pattern of disease, or possibly the impact of vaccination.

Factors Associated With Mechanical Ventilation Duration in Pediatric Burn Patients in a Regional Burn Center in the United States.

OBJECTIVES: Among burned children who arrive at a burn center and require invasive mechanical ventilation (IMV), some may have prolonged IMV needs. This has implications for patient-centered outcomes as well as triage and resource allocation decisions. Our objective was to identify factors associated with the duration of mechanical ventilation in pediatric patients with acute burn injury in this setting. DESIGN: Single-center, retrospective cohort study. SETTING: Registry data from a regional, pediatric burn center in the United States. PATIENTS: Children less than or equal to 18 years old admitted with acute burn injury who received IMV between January 2005 and December 2020. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Ventilator days were defined as any full or partial day having received IMV via an endotracheal tube or tracheostomy, not inclusive of time spent ventilated for procedures. Of 5,766 admissions for acute burn care, 4.3% ( n = 249) required IMV with a median duration of 10 days. A multivariable model for freedom from mechanical ventilation showed that the presence of inhalational injury (subhazard ratio [sHR], 0.62; 95% CI, 0.46-0.85) and burns to the head and neck region (sHR, 0.94; 95% CI, 0.90-0.98) were associated with increased risk of remaining mechanically ventilated at any time point. Older (sHR, 1.03; 95% CI, 1.01-1.04) and male children (sHR, 1.39; 95% CI, 1.05-1.84) were more likely to discontinue mechanical ventilation. A majority of children (94.8%) survived to hospital discharge. CONCLUSIONS: The presence of inhalational injury and burns to the head and neck region were associated with a longer duration of mechanical ventilation. Older age and male gender were associated with a shorter duration of mechanical ventilation. These factors should help clinicians better estimate a burned child's expected trajectory and resource-intensive needs upon arrival to a burn center.

Pediatric Resident Engagement With an Online Critical Care Curriculum During the Intensive Care Rotation.

OBJECTIVES: Residents are often assigned online learning materials as part of blended learning models, superimposed on other patient care and learning demands. Data that describe the time patterns of when residents interact with online learning materials during the ICU rotation are lacking. We describe resident engagement with assigned online curricula related to time of day and ICU clinical schedules, using website activity data. DESIGN: Prospective cohort study examining curriculum completion data and cross-referencing timestamps for pre- and posttest attempts with resident schedules to determine the hours that they accessed the curriculum and whether or not they were scheduled for clinical duty. Residents at each site were cohorted based on two differing clinical schedules-extended duration (>24 hr) versus shorter (maximum 16 hr) shifts. SETTING: Two large academic children's hospitals. SUBJECTS: Pediatric residents rotating in the PICU from July 2013 to June 2017. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: One-hundred and fifty-seven pediatric residents participated in the study. The majority of residents (106/157; 68%) completed the curriculum, with no statistically significant association between overall curriculum completion and schedule cohort at either site. Residents made more test attempts at nighttime between 6 PM and 6 AM (1,824/2,828; 64%) regardless of whether they were scheduled for clinical duty. Approximately two thirds of test attempts (1,785/2,828; 63%) occurred when residents were not scheduled to work, regardless of time of day. Forty-two percent of all test attempts (1,199/2,828) occurred between 6 PM and 6 AM while off-duty, with 12% (342/2,828) occurring between midnight and 6 AM. CONCLUSIONS: Residents rotating in the ICU completed online learning materials mainly during nighttime and off-duty hours, including usage between midnight and 6 AM while off-duty. Increasing nighttime and off-duty workload may have implications for educational design and trainee wellness, particularly during busy, acute clinical rotations, and warrants further examination.

Characteristics and Outcomes of Children With Coronavirus Disease 2019 (COVID-19) Infection Admitted to US and Canadian Pediatric Intensive Care Units.

IMPORTANCE: The recent and ongoing coronavirus disease 2019 (COVID-19) pandemic has taken an unprecedented toll on adults critically ill with COVID-19 infection. While there is evidence that the burden of COVID-19 infection in hospitalized children is lesser than in their adult counterparts, to date, there are only limited reports describing COVID-19 in pediatric intensive care units (PICUs). OBJECTIVE: To provide an early description and characterization of COVID-19 infection in North American PICUs, focusing on mode of presentation, presence of comorbidities, severity of disease, therapeutic interventions, clinical trajectory, and early outcomes. DESIGN, SETTING, AND PARTICIPANTS: This cross-sectional study included children positive for COVID-19 admitted to 46 North American PICUs between March 14 and April 3, 2020. with follow-up to April 10, 2020. MAIN OUTCOMES AND MEASURES: Prehospital characteristics, clinical trajectory, and hospital outcomes of children admitted to PICUs with confirmed COVID-19 infection. RESULTS: Of the 48 children with COVID-19 admitted to participating PICUs, 25 (52%) were male, and the median (range) age was 13 (4.2-16.6) years. Forty patients (83%) had significant preexisting comorbidities; 35 (73%) presented with respiratory symptoms and 18 (38%) required invasive ventilation. Eleven patients (23%) had failure of 2 or more organ systems. Extracorporeal membrane oxygenation was required for 1 patient (2%). Targeted therapies were used in 28 patients (61%), with hydroxychloroquine being the most commonly used agent either alone (11 patients) or in combination (10 patients). At the completion of the follow-up period, 2 patients (4%) had died and 15 (31%) were still hospitalized, with 3 still requiring ventilatory support and 1 receiving extracorporeal membrane oxygenation. The median (range) PICU and hospital lengths of stay for those who had been discharged were 5 (3-9) days and 7 (4-13) days, respectively. CONCLUSIONS AND RELEVANCE: This early report describes the burden of COVID-19 infection in North American PICUs and confirms that severe illness in children is significant but far less frequent than in adults. Prehospital comorbidities appear to be an important factor in children. These preliminary observations provide an important platform for larger and more extensive studies of children with COVID-19 infection.

Clinical Documentation for Intensivists: The Impact of Diagnosis Documentation.

OBJECTIVES: The aim of this review is to describe the interaction of clinical documentation with patient care, measures of patient acuity, quality metrics, research database accuracy, and healthcare reimbursement in order to highlight potential areas of improvement for intensivists. DATA SOURCES: An online search of PubMed was undertaken as well as review of resources published by the American Academy of Pediatrics, the Society of Critical Care Medicine, the American Medical Association, and the Association of Clinical Documentation Improvement Specialists. STUDY SELECTION: Selected publications included those that described coding, medical record documentation, healthcare reimbursement, quality metrics, administrative databases, Clinical Documentation Improvement programs, medical scribe programs, and various payment models. DATA EXTRACTION: Relevant information was extracted to highlight the impact of diagnosis documentation on patient care, perceived patient severity of illness, quality metrics, and healthcare reimbursement. Query data from our hospital's Clinical Documentation Improvement program were reviewed to highlight areas of improvement within our own Division of Critical Care Medicine. Additionally, interventions to improve clinical documentation were incorporated into this review. DATA SYNTHESIS: Available data in the literature indicate that documentation of precise diagnoses in the medical record has a positive impact on quality metrics, accuracy of administrative databases, hospital reimbursement, and perceived patient complexity. However, there is insufficient data to make conclusions regarding documentation of specific diagnoses and effects on patient care. Administrative responsibilities associated with documentation have been increasing, especially with the introduction of electronic medical records. CONCLUSIONS: Documentation of specific diagnoses in the medical record is important in the broad context of our existing medical system but there is an associated burden in doing so. Widespread implementation of electronic medical record systems has inadvertently led to clinician dissatisfaction and burnout. Research is needed to further evaluate the impact of documentation on patient care as well as steps to decrease the associated burden.

Online Learning and Residents' Acquisition of Mechanical Ventilation Knowledge: Sequencing Matters.

OBJECTIVE: Rapid advancements in medicine and changing standards in medical education require new, efficient educational strategies. We investigated whether an online intervention could increase residents' knowledge and improve knowledge retention in mechanical ventilation when compared with a clinical rotation and whether the timing of intervention had an impact on overall knowledge gains. DESIGN: A prospective, interventional crossover study conducted from October 2015 to December 2017. SETTING: Multicenter study conducted in 33 PICUs across eight countries. SUBJECTS: Pediatric categorical residents rotating through the PICU for the first time. We allocated 483 residents into two arms based on rotation date to use an online intervention either before or after the clinical rotation. INTERVENTIONS: Residents completed an online virtual mechanical ventilation simulator either before or after a 1-month clinical rotation with a 2-month period between interventions. MEASUREMENTS AND MAIN RESULTS: Performance on case-based, multiple-choice question tests before and after each intervention was used to quantify knowledge gains and knowledge retention. Initial knowledge gains in residents who completed the online intervention (average knowledge gain, 6.9%; SD, 18.2) were noninferior compared with those who completed 1 month of a clinical rotation (average knowledge gain, 6.1%; SD, 18.9; difference, 0.8%; 95% CI, -5.05 to 6.47; p = 0.81). Knowledge retention was greater following completion of the online intervention when compared with the clinical rotation when controlling for time (difference, 7.6%; 95% CI, 0.7-14.5; p = 0.03). When the online intervention was sequenced before (average knowledge gain, 14.6%; SD, 15.4) rather than after (average knowledge gain, 7.0%; SD, 19.1) the clinical rotation, residents had superior overall knowledge acquisition (difference, 7.6%; 95% CI, 2.01-12.97;p = 0.008). CONCLUSIONS: Incorporating an interactive online educational intervention prior to a clinical rotation may offer a strategy to prime learners for the upcoming rotation, augmenting clinical learning in graduate medical education.

Epidemiology of childhood death in Australian and New Zealand intensive care units.

PURPOSE: Data on childhood intensive care unit (ICU) deaths are needed to identify changing patterns of intensive care resource utilization. We sought to determine the epidemiology and mode of pediatric ICU deaths in Australia and New Zealand (ANZ). METHODS: This was a retrospective, descriptive study of multicenter data from pediatric and mixed ICUs reported to the ANZ Pediatric Intensive Care Registry and binational Government census. All patients < 16 years admitted to an ICU between 1 January 2006 and 31 December 2016 were included. Primary outcome was ICU mortality. Subject characteristics and trends over time were evaluated. RESULTS: Of 103,367 ICU admissions, there were 2672 (2.6%) deaths, with 87.6% of deaths occurring in specialized pediatric ICUs. The proportion of ANZ childhood deaths occurring in ICU was 12%, increasing by 43% over the study period. Unadjusted (0.1% per year, 95% CI 0.096-0.104; p < 0.001) and risk-adjusted (0.1%/year, 95% CI 0.07-0.13; p < 0.001) ICU mortality rates fell. Across all admission sources and diagnostic groups, mortality declined except following pre-ICU cardiopulmonary arrest where increased mortality was observed. Half of the deaths followed withdrawal of life-sustaining therapy (51%), remaining constant throughout the study. Deaths despite maximal resuscitation declined (0.92%/year, 95% CI 0.89-0.95%; p < 0.001) and brain death diagnoses increased (0.72%/year, 95% CI 0.69-0.75%; p = 0.001). CONCLUSIONS: Unadjusted and risk-adjusted mortality for children admitted to ANZ ICUs is declining. Half of pediatric ICU deaths follow withdrawal of life-sustaining therapy. Epidemiology and mode of pediatric ICU death are changing. Further investigation at an international level will inform benchmarking, resource allocation and training requirements for pediatric critical care.

Growth and Changing Characteristics of Pediatric Intensive Care 2001-2016.

OBJECTIVES: We assessed the growth, distribution, and characteristics of pediatric intensive care in 2016. DESIGN: Hospitals with PICUs were identified from prior surveys, databases, online searching, and clinician networking. A structured web-based survey was distributed in 2016 and compared with responses in a 2001 survey. SETTING: PICUs were defined as a separate unit, specifically for the treatment of children with life-threatening conditions. PICU hospitals contained greater than or equal to 1 PICU. SUBJECTS: Physician medical directors and nurse managers. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: PICU beds per pediatric population (< 18 yr), PICU bed distribution by state and region, and PICU characteristics and their relationship with PICU beds were measured. Between 2001 and 2016, the U.S. pediatric population grew 1.9% to greater than 73.6 million children, and PICU hospitals decreased 0.9% from 347 to 344 (58 closed, 55 opened). In contrast, PICU bed numbers increased 43% (4,135 to 5,908 beds); the median PICU beds per PICU hospital rose from 9 to 12 (interquartile range 8, 20 beds). PICU hospitals with greater than or equal to 15 beds in 2001 had significant bed growth by 2016, whereas PICU hospitals with less than 15 beds experienced little average growth. In 2016, there were eight PICU beds per 100,000 U.S. children (5.7 in 2001), with U.S. census region differences in bed availability (6.8 to 8.8 beds/100,000 children). Sixty-three PICU hospitals (18%) accounted for 47% of PICU beds. Specialized PICUs were available in 59 hospitals (17.2%), 48 were cardiac (129% growth). Academic affiliation, extracorporeal membrane oxygenation availability, and 24-hour in-hospital intensivist staffing increased with PICU beds per hospital. CONCLUSIONS: U.S. PICU bed growth exceeded pediatric population growth over 15 years with a relatively small percentage of PICU hospitals containing almost half of all PICU beds. PICU bed availability is variable across U.S. states and regions, potentially influencing access to care and emergency preparedness.

The Top Ten Websites in Critical Care Medicine Education Today.

INTRODUCTION:: The number of websites for the critical care provider is rapidly growing, including websites that are part of the Free Open Access Med(ical ed)ucation (FOAM) movement. With this rapidly expanding number of websites, critical appraisal is needed to identify quality websites. The last major review of critical care websites was published in 2011, and thus a new review of the websites relevant to the critical care clinician is necessary. METHODS:: A new assessment tool for evaluating critical care medicine education websites, the Critical Care Medical Education Website Quality Evaluation Tool (CCMEWQET), was modified from existing tools. A PubMed and Startpage search from 2007 to 2017 was conducted to identify websites relevant to critical care medicine education. These websites were scored based on the CCMEWQET. RESULTS:: Ninety-seven websites relevant for critical care medicine education were identified and scored, and the top ten websites were described in detail. Common types of resources available on these websites included blog posts, podcasts, videos, online journal clubs, and interactive components such as quizzes. Almost one quarter of websites (n = 22) classified themselves as FOAM websites. The top ten websites most often included an editorial process, high-quality and appropriately attributed graphics and multimedia, scored much higher for comprehensiveness and ease of access, and included opportunities for interactive learning. CONCLUSION:: Many excellent online resources for critical care medicine education currently exist, and the number is likely to continue to increase. Opportunities for improvement in many websites include more active engagement of learners, upgrading navigation abilities, incorporating an editorial process, and providing appropriate attribution for graphics and media.

Quality improvement in pediatric intensive care: A systematic review of the literature.

IMPORTANCE: Measuring and improving performance is an essential component of any high-risk industry, including intensive care medicine. We undertook this systematic review to describe the current state of quality improvement efforts in pediatric intensive care medicine. OBJECTIVE: To evaluate the quality and rigor of all published literature on quality improvement efforts in the pediatric intensive care unit in the current era. METHODS: We conducted a literature search on MEDLINE, Embase, and Cochrane for studies that met two broad inclusion criteria: 1) the terms "pediatric critical care" and "quality improvement" and 2) they were completed in the past ten years. In the initial search, we also included academic and professional societies or organizations devoted to providing resources on quality improvement in intensive care medicine. We excluded studies that examined quality improvement processes exclusively for neonatal or adult patients receiving intensive care. RESULTS: Forty-nine of 332 identified articles were selected for final review by two reviewers who independently rated the quality of the methodology and rigor of the evidence reported for each study. Of these, 23 studies targeted structural issues, 14 studies targeted process issues, and 12 targeted an outcome as the focus of the intensive care quality improvement effort. INTERPRETATION: Our review of the published literature on quality improvement efforts in the pediatric intensive care unit in the current era found that 85% of studies were limited in methodology or analysis. Fifteen high-quality studies are reported here and serve as helpful examples of rigorous research methodology in this domain going forward.

Frameworks for quality improvement in pediatric intensive care: A concise review.

Quality improvement programs focused on improving care in intensive care units have become standard at pediatric hospitals around the world over the past several decades. However, the methodology or framework by which these programs assess quality is not standard. This review describes the varying quality improvement frameworks that have been promoted by prominent pediatric and critical care societies and the strengths and limitations of these frameworks, as well as several notable international collaboratives in this domain.