Development and External Validation of the International Early Warning Score for Improved Age- and Sex-Adjusted In-Hospital Mortality Prediction in the Emergency Department.

OBJECTIVES: Early Warning Scores (EWSs) have a great potential to assist clinical decision-making in the emergency department (ED). However, many EWS contain methodological weaknesses in development and validation and have poor predictive performance in older patients. The aim of this study was to develop and externally validate an International Early Warning Score (IEWS) based on a recalibrated National Early warning Score (NEWS) model including age and sex and evaluate its performance independently at arrival to the ED in three age categories (18-65, 66-80, > 80 yr). DESIGN: International multicenter cohort study. SETTING: Data was used from three Dutch EDs. External validation was performed in two EDs in Denmark. PATIENTS: All consecutive ED patients greater than or equal to 18 years in the Netherlands Emergency department Evaluation Database (NEED) with at least two registered vital signs were included, resulting in 95,553 patients. For external validation, 14,809 patients were included from a Danish Multicenter Cohort (DMC). MEASUREMENTS AND MAIN RESULTS: Model performance to predict in-hospital mortality was evaluated by discrimination, calibration curves and summary statistics, reclassification, and clinical usefulness by decision curve analysis. In-hospital mortality rate was 2.4% ( n = 2,314) in the NEED and 2.5% ( n = 365) in the DMC. Overall, the IEWS performed significantly better than NEWS with an area under the receiving operating characteristic of 0.89 (95% CIs, 0.89-0.90) versus 0.82 (0.82-0.83) in the NEED and 0.87 (0.85-0.88) versus 0.82 (0.80-0.84) at external validation. Calibration for NEWS predictions underestimated risk in older patients and overestimated risk in the youngest, while calibration improved for IEWS with a substantial reclassification of patients from low to high risk and a standardized net benefit of 5-15% in the relevant risk range for all age categories. CONCLUSIONS: The IEWS substantially improves in-hospital mortality prediction for all ED patients greater than or equal to18 years.

The prediction of 24-h mortality by the respiratory rate and oxygenation index compared with National Early Warning Score in emergency department patients: an observational study.

BACKGROUND: The ROX index combines respiratory rate and oxygenation to predict the response to oxygen therapy in pneumonia. It is calculated by dividing the patient's oxygen saturation, by the inspired oxygen concentration, and then by the respiratory rate (e.g. 95%/0.21/16 = 28). Since this index includes the most essential physiological variables to detect deterioration, it may be a helpful risk tool in the emergency department (ED). Although small studies suggest it can predict early mortality, no large study has compared it with the National Early Warning Score (NEWS), the most widely validated risk score for death within 24 h. AIM: The aim of this study was to compare the ability of the ROX index with the NEWS to predict mortality within 24 h of arrival at the hospital. METHODS: This was a retrospective observational multicentre analysis of data in the Netherlands Emergency Department Evaluation Database (NEED) on 270 665 patients attending four participating Dutch EDs. The ROX index and NEWS were determined on ED arrival and prior to ED treatment. RESULTS: The risk of death within 24 h increased with falling ROX and rising NEWS values. The area under the receiving operating characteristic curves for 24-h mortality of NEWS was significantly higher than for the ROX index [0.92; 95% confidence interval (CI), 0.91-0.92 versus 0.87; 95% CI, 0.86-0.88; P < 0.01]. However, the observed and predicted mortality by the ROX index was identical to mortality of 5%, after which mortality was underestimated. In contrast, up to a predicted 24-h mortality of 3% NEWS slightly underestimates mortality, and above this level over-estimates it. The standardized net benefit of ROX is slightly higher than NEWS up to a predicted 24-h mortality of 3%. CONCLUSION: The prediction of 24-h mortality by the ROX index is more accurate than NEWS for most patients likely to be encountered in the ED. ROX may be used as a first screening tool in the ED.

Procedural sedation and analgesia versus nerve blocks for reduction of fractures and dislocations in the emergency department: A systematic review and meta-analysis.

Background: Procedural sedation and analgesia (PSA) and peripheral nerve blocks (NBs) are techniques to manage pain and facilitate reduction of dislocated joints or fractures. However, it is unclear if either approach provides any distinct advantage in the emergency department (ED). The aim of this systematic review is to compare these 2 techniques on pain scores, adverse events, patient satisfaction, and length of stay (LOS) in the ED. Methods: We performed an electronic search of MEDLINE, EMBASE, and the Cochrane Library, and references were hand-searched. Randomized controlled trials (RCTs) comparing PSA with NBs for orthopedic reductions in the ED were included. Outcomes of interest included pain scores, adverse events, patient satisfaction, and LOS in the ED. A total of 2 reviewers independently screened abstracts and extracted data into a standardized form. The Cochrane risk-of-bias tool was used to evaluate study quality. The Grading of Recommendation Assessment Development and Evaluation approach was used to assess the certainty and strength of the evidence. Data on pain scores were pooled using a random-effects model and are reported as standardized mean differences (SMDs) with 95% confidence intervals (CIs). Results: A total of 6 RCTs (n = 256) were included in a qualitative review, and 4 RCTs (n = 101) were included in the meta-analysis. There was no significant difference in pain scores between the PSA and NB groups (P = 0.47; SMD, 0.45; 95% CI, -0.78 to 1.69; I2 = 0.94). There were less adverse events in the NB group (0%-3.3%) compared with the PSA group (0%-20%; n = 256). LOS times were consistently shorter in the NB group (n = 215). Patient satisfaction was comparable in both groups (n = 196). Conclusion: Based on the available evidence, NBs performed by emergency physicians are as effective as PSA in managing pain during orthopedic reductions in the ED. NBs are associated with fewer adverse events and shorter LOS in the ED. The quality of evidence is low.

Development and validation of an early warning score to identify COVID-19 in the emergency department based on routine laboratory tests: a multicentre case-control study.

OBJECTIVES: Identifying patients with a possible SARS-CoV-2 infection in the emergency department (ED) is challenging. Symptoms differ, incidence rates vary and test capacity may be limited. As PCR-testing all ED patients is neither feasible nor effective in most centres, a rapid, objective, low-cost early warning score to triage ED patients for a possible infection is developed. DESIGN: Case-control study. SETTING: Secondary and tertiary hospitals in the Netherlands. PARTICIPANTS: The study included patients presenting to the ED with venous blood sampling from July 2019 to July 2020 (n=10 417, 279 SARS-CoV-2-positive). The temporal validation cohort covered the period from July 2020 to October 2021 (n=14 080, 1093 SARS-CoV-2-positive). The external validation cohort consisted of patients presenting to the ED of three hospitals in the Netherlands (n=12 061, 652 SARS-CoV-2-positive). PRIMARY OUTCOME MEASURES: The primary outcome was one or more positive SARS-CoV-2 PCR test results within 1 day prior to or 1 week after ED presentation. RESULTS: The resulting 'CoLab-score' consists of 10 routine laboratory measurements and age. The score showed good discriminative ability (AUC: 0.930, 95% CI 0.909 to 0.945). The lowest CoLab-score had high sensitivity for COVID-19 (0.984, 95% CI 0.970 to 0.991; specificity: 0.411, 95% CI 0.285 to 0.520). Conversely, the highest score had high specificity (0.978, 95% CI 0.973 to 0.983; sensitivity: 0.608, 95% CI 0.522 to 0.685). The results were confirmed in temporal and external validation. CONCLUSIONS: The CoLab-score is based on routine laboratory measurements and is available within 1 hour after presentation. Depending on the prevalence, COVID-19 may be safely ruled out in over one-third of ED presentations. Highly suspect cases can be identified regardless of presenting symptoms. The CoLab-score is continuous, in contrast to the binary outcome of lateral flow testing, and can guide PCR testing and triage ED patients.

The effect of treatment and clinical course during Emergency Department stay on severity scoring and predicted mortality risk in Intensive Care patients.

BACKGROUND: Treatment and the clinical course during Emergency Department (ED) stay before Intensive Care Unit (ICU) admission may affect predicted mortality risk calculated by the Acute Physiology and Chronic Health Evaluation (APACHE)-IV, causing lead-time bias. As a result, comparing standardized mortality ratios (SMRs) among hospitals may be difficult if they differ in the location where initial stabilization takes place. The aim of this study was to assess to what extent predicted mortality risk would be affected if the APACHE-IV score was recalculated with the initial physiological variables from the ED. Secondly, to evaluate whether ED Length of Stay (LOS) was associated with a change (delta) in these APACHE-IV scores. METHODS: An observational multicenter cohort study including ICU patients admitted from the ED. Data from two Dutch quality registries were linked: the Netherlands Emergency department Evaluation Database (NEED) and the National Intensive Care Evaluation (NICE) registry. The ICU APACHE-IV, predicted mortality, and SMR based on data of the first 24 h of ICU admission were compared with an ED APACHE-IV model, using the most deviating physiological variables from the ED or ICU. RESULTS: A total of 1398 patients were included. The predicted mortality from the ICU APACHE-IV (median 0.10; IQR 0.03-0.30) was significantly lower compared to the ED APACHE-IV model (median 0.13; 0.04-0.36; p < 0.01). The SMR changed from 0.63 (95%CI 0.54-0.72) to 0.55 (95%CI 0.47-0.63) based on ED APACHE-IV. Predicted mortality risk changed more than 5% in 321 (23.2%) patients by using the ED APACHE-IV. ED LOS > 3.9 h was associated with a slight increase in delta APACHE-IV of 1.6 (95% CI 0.4-2.8) compared to ED LOS < 1.7 h. CONCLUSION: Predicted mortality risks and SMRs calculated by the APACHE IV scores are not directly comparable in patients admitted from the ED if hospitals differ in their policy to stabilize patients in the ED before ICU admission. Future research should focus on developing models to adjust for these differences.

Paediatric procedural sedation and analgesia by emergency physicians in a country with a recent establishment of emergency medicine.

OBJECTIVES: Paediatric patients receive less procedural sedation and analgesia (PSA) in the emergency department compared with adults, especially in countries where emergency medicine is at an early stage of development. The objectives of this study were to evaluate the adverse events and efficacy of paediatric PSA in a country with a recent establishment of emergency medicine and to describe which factors aided implementation. METHODS: This is a prospective, multicentre, observational study of paediatric patients undergoing PSA by the first trained emergency physicians (EPs) in The Netherlands. A standardized data collection form was used at all participating hospitals to collect data on adverse events, amnesia, pain scores, and procedure completion. A survey was used to interpret which factors had aided PSA implementation. RESULTS: We recorded 351 paediatric PSA. The mean age was 9.5 years (95% confidence interval: 9.1-10.0). Esketamine was most frequently used (42.4%), followed by propofol (34.7%). The adverse event rate was low (3.0%). Amnesia was present in 86.8%. The median pain score was 2 (out of 10) for patients without amnesia. Procedures were successfully completed in 93.9% of the cases. CONCLUSION: Paediatric PSA provided by the first EPs in The Netherlands showed appropriate levels of sedation and analgesia with a high rate of procedure completion and a low rate of adverse events. Our paper suggests that EPs provided with a proper infrastructure of mentorship, training and guidelines can implement effective paediatric PSA.

Procedural sedation and analgesia practices by emergency physicians in the Netherlands: a nationwide survey.

BACKGROUND: Several efforts have been made to assure and to improve the quality of procedural sedation and analgesia (PSA) performed by emergency physicians (EPs) in The Netherlands. This study investigated the current PSA practice and competences of EPs in both adult and paediatric patients. In particular, if residency and current training, awareness of guidelines is sufficient for registered EPs to adequately perform PSA and if the availability of both adult and paediatric PSA in the ED is adequate. METHODS: A cross-sectional nationwide survey was performed amongst Dutch EPs (n = 463) in June 2016. We collected data on background, training, practice, and competencies of both adult and paediatric PSA. We investigated guideline adherence, reasons for not performing PSA, and desired improvements. RESULTS: The respondents (n = 191) represented 84.6% hospitals with EPs and 41.3% of all EPs in The Netherlands. Nearly all EPs (97.8%) performed PSA in adult patients compared to only 59.1% who performed PSA in paediatric patients (p < 0.001). The major reason for not performing paediatric PSA was caused by a lack of exposure during the training-program (74.1%). PSA-guideline knowledge (98.3%) and PSA related adverse event registration (98.3%) were excellent. Lack of 24/7-availability of both adult and paediatric emergency department PSA was mainly caused by a shortage of EPs. Self-reflection indicated that EPs feel less competent in performing paediatric PSA when compared to adult PSA. CONCLUSION: This nationwide survey demonstrates that there is still a significant gap between the performance of adult and paediatric PSA even though guideline adherence and registration of PSA-related adverse events appear to be adequate. Enhancement of paediatric PSA training in combination with an increase of EP-staffing can help improve the availability of adult and paediatric PSA in the emergency department.

Procedural sedation in the emergency department by Dutch emergency physicians: a prospective multicentre observational study of 1711 adults.

OBJECTIVE: To describe our experience performing ED procedural sedation in a country where emergency medicine (EM) is a relatively new specialty. METHODS: This is a prospective observational study of adult patients undergoing procedural sedation by emergency physicians (EPs) or EM residents in eight hospitals in the Netherlands. Data were collected on a standardised form, including patient characteristics, sedative and analgesic used, procedural success, adverse events (classified according to World SIVA) and rescue interventions. RESULTS: 1711 adult cases were included from 2006 to 2013. Propofol, midazolam and esketamine (S+ enantiomer of ketamine) were the most used sedatives (63%, 29% and 8%). We had adverse event data on all patients. The overall adverse event rate was 11%, mostly hypoxia or apnoea. There was no difference in adverse event rate between EPs and EM residents. However, there was a significantly higher success rate of the procedure when EPs did the procedural sedation (92% vs 84%). No moderate (unplanned hospital admission or escalation of care) or sentinel SIVA outcomes occurred (pulmonary aspiration syndrome, death or permanent neurological deficit). CONCLUSION: Adverse events during procedural sedation occurred in 11% of patients. There were no moderate or sentinel outcomes. All events could be managed by the sedating physician. In a country where EM is a relatively new specialty, procedural sedation appears to be safe when performed by EPs or trained EM residents and has comparable adverse event rates to international studies.

Impact of a well-developed primary care system on the length of stay in emergency departments in the Netherlands: a multicenter study.

BACKGROUND: The Netherlands has a well-developed primary care system, which increasingly collaborates with hospital emergency departments (EDs). In this setting, insight into crowding in EDs is limited. This study explored links between patients' ED Length of Stay (LOS) and their care pathways. METHODS: Observational multicenter study of 7000 ED patient records from 1 February 2013. Seven EDs spread over the Netherlands, representing overall Dutch EDs, were included. This included three EDs with and four EDs without an integrated primary-care-physician (PCP) cooperative, forming one Emergency Care Access Point (ECAP). The main outcome was LOS of patients comparing different care pathways (origin and destination of ED attenders). RESULTS: The median LOS of ED attenders was 130.0 min (IQR 79.0-140.0), which increased with patients' age. Random coefficient regression analysis showed that LOS for patients referred by medical professionals was 32.9 min longer compared to self-referred patients (95% CI 27.7-38.2 min). LOS for patients admitted to hospital was 41.2 min longer compared to patients followed-up at the outpatient clinic (95% CI 35.3-46.6 min), 49.9 min longer compared to patients followed-up at the PCP (95% CI 41.5-58.3 min) and 44.6 min longer compared to patients who did not receive follow-up (95% CI 38.3-51.0 min). There was no difference in LOS between hospitals with or without an ECAP. CONCLUSIONS: With 130 min, the median LOS in Dutch EDs is relatively short, comparing to other Western countries, which ranges from 176 to 480 min. Although integration of EDs with out-of-hours primary care was not related to LOS, the strong primary care system probably contributed to the overall short LOS of ED patients in the Netherlands.

Complaints and Diagnoses of Emergency Department Patients in the Netherlands: A Comparative Study of Integrated Primary and Emergency Care.

OBJECTIVE: In the Netherlands, an increasing number of emergency departments (EDs) and general practitioner cooperatives collaborate by creating one Emergency-Care-Access-Point (ECAP). This has resulted in fewer patients at ECAP EDs. The objective of this study was to explore differences in patient characteristics, presented complaints and ED discharge diagnoses between EDs with an ECAP and EDs without an ECAP. METHODS: A retrospective observational study was performed with 1800 consecutive patient records sampled from six EDs spread over the Netherlands in 2013. We extracted data on time and date of presentation, sex, age, presenting complaint, discharge diagnosis, origin and follow up. RESULTS: At ECAP EDs, the mean age was 47.8 years (95%CI 46.1-49.4) compared to 41.3 (95%CI 39.7-42.9). Compared to non-ECAP EDs, more patients were referred by medical professionals (74.7% versus 46.8%), more patients received hospital admission (45.2% versus 29.0%) and fewer patients received GP follow-up (4.1% versus 16.9%). There was no significant difference in presenting complaints between ECAP and non-ECAP EDs. Most prevalent complaints were trauma (25.7% versus 29.7%), abdominal pain (12.1% versus 10.9%) and general symptoms (7.8% versus 4.8%). The most prevalent ED diagnoses significantly differed with fractures and dislocations (10.8%), sprains and strains (10.4%) and respiratory infections (6.8%) at ECAP EDs versus fractures and dislocations (10.7%), wounds (9.3%) and sprains and strains (8.9%) at non-ECAP EDs. CONCLUSION: Compared to non-ECAP EDs, patients at ECAP EDs were older, medical professionals referred more patients and more patients received a hospital admission. We found some small differences in discharge diagnoses between ECAP EDs compared to non-ECAP EDs, but no difference in presented complaints.

Emergency departments in The Netherlands: is there a difference in emergency departments with and without emergency physicians? a cross-sectional web-based survey.

BACKGROUND: There is a growing interest in emergency departments (EDs) and the development of emergency medicine in The Netherlands. In the last decade several policy reports have stated that the quality of emergency care should be improved and that emergency physicians (EPs) play a large role in the quality improvement. The Netherlands Society of Emergency Physicians (NVSHA) has developed an emergency medicine training program, which has been nationally recognized since 2009. Nevertheless, not all EDs are staffed with EPs yet. This study aimed to explore differences between Dutch EDs with EPs and those without EPs. METHODS: A cross-sectional web-based survey was performed on data over the year 2008 or 2009 in all 105 Dutch hospitals with an emergency department. We documented which ED-specific courses were attended by physicians working in the ED (list of 3 courses) and which clinical audit activities were implemented (list of 6 activities). The choice of courses and clinical audits was based on those mentioned in published quality reports and in national debates on emergency care. We compared EDs with and without EPs. The final analysis was based on a linear regression analysis, controlling for ED size and having an EP training program. We considered P < 0.05 significant. RESULTS: Our survey's response rate was 67%. EPs worked significantly more often in larger EDs. The linear regression analysis shows that the total number of courses attended by physicians was on average 0.51 higher (P = 0.000) in EDs with EPs than in EDs without EPs, and the total number of implemented clinical audits was on average 0.49 higher (P = 0.008). After controlling for potential confounders, the effect of both the composite number of courses attended (P = 0.001) and the composite number of implemented clinical activities (P = 0.032) remained significant. CONCLUSION: This study shows that EPs are significantly more present in larger EDs and in EDs where there is more continuing professional education and where there are more clinical audit activities. Our findings suggest that the presence of emergency physicians is positively associated with the quality of emergency care, but prospective research is required to examine causality.

GP cooperative and emergency department: an exploration of patient flows.

RATIONALE, AIMS AND OBJECTIVES: In most countries, different health care providers are involved in emergency care. In the Netherlands, out-of-hours care is provided by general practitioner cooperatives (GPCs) and emergency departments (EDs). Our aim was to describe the flow of patients attending emergency care in these settings. METHOD: A retrospective record review was performed, concerning patients who had visited a GPC or ED. Recorded information included urgency, diagnostic tests, and follow-up contacts. Descriptive figures were determined for patient flows in GPC and ED for urgent contacts and non-urgent contacts. RESULTS: We included 319 GPC contacts and 356 ED contacts, of which 78% were non-urgent. The majority of GPC contacts were completed at the GPC without follow-up; 37% of non-urgent patients had a follow-up contact, usually with primary care. Only 5% of non-urgent GPC patients received diagnostic tests compared to 63% of non-urgent ED patients (mostly X-rays). The majority of non-urgent ED patients (88%) had a follow-up contact, usually at an outpatient clinic (67%). Most non-urgent ED patients (83%) who received a diagnostic test also had an outpatient clinic follow-up contact. Of urgent ED patients, the majority had a follow-up contact (85%), mostly with an outpatient clinic (74%). CONCLUSION: Although most out-of-hours care patients present non-urgent health problems, at the ED they are more likely to receive diagnostic tests and follow-up contacts. This may reflect differences in patient populations between the ED and GPC or suggest opportunities for improving efficiency of planning follow-up contacts.

Emergency departments in The Netherlands.

Emergency medicine in The Netherlands is faced with an increasing interest by politicians and stakeholders in health care. This is due to crowding, increasing costs, criticism of the quality of emergency care, restructuring of out-of-hours services in primary care and the introduction of a training programme for emergency physicians in 2000. A comprehensive search was conducted of published research, policy reports and updated Dutch websites on acute care. Publications were included in this review if these referred to emergency care, including emergency departments (ED), general practitioner (GP) cooperatives and emergency medical services in The Netherlands and were written in English or Dutch. The literature search identified 14 eligible papers. The manual search identified 11 additional papers. Seven reports and two PhD theses were also included. Given the lack of relevant empirical research the review was liberal in its inclusion, but the analysis focused on research when available. ED in The Netherlands are in different stages of development. However, it is obvious that the presence of emergency physicians is increasing and more ED will be staffed by emergency physicians. Although this seems an important step, it does not necessarily imply a good position of the emergency physician in the ED. What the characteristics of the future patient of the Dutch ED will be is dependent on the development of different ED levels of care and GP cooperatives. The lack of empirical research also points out the need for research on quality of care in Dutch ED.