Developing outcome, process and balancing measures for an emergency department longitudinal patient monitoring system using a modified Delphi.

BACKGROUND: Early warning score systems have been widely recommended for use to detect clinical deterioration in patients. The Irish National Emergency Medicine Programme has developed and piloted an emergency department specific early warning score system. The objective of this study was to develop a consensus among frontline healthcare staff, quality and safety staff and health systems researchers regarding evaluation measures for an early warning score system in the Emergency Department. METHODS: Participatory action research including a modified Delphi consensus building technique with frontline hospital staff, quality and safety staff, health systems researchers, local and national emergency medicine stakeholders was the method employed in this study. In Stage One, a workshop was held with the participatory action research team including frontline hospital staff, quality and safety staff and health systems researchers to gather suggestions regarding the evaluation measures. In Stage Two, an electronic modified-Delphi study was undertaken with a panel consisting of the workshop participants, key local and national emergency medicine stakeholders. Descriptive statistics were used to summarise the characteristics of the panellists who completed the questionnaires in each round. The mean Likert rating, standard deviation and 95% bias-corrected bootstrapped confidence interval for each variable was calculated. Bonferroni corrections were applied to take account of multiple testing. Data were analysed using Stata 14.0 SE. RESULTS: Using the Institute for Healthcare Improvement framework, 12 process, outcome and balancing metrics for measuring the effectiveness of an ED-specific early warning score system were developed. CONCLUSION: There are currently no published measures for evaluating the effectiveness of an ED early warning score system. It was possible in this study to develop a suite of evaluation measures using a modified Delphi consensus approach. Using the collective expertise of frontline hospital staff, quality and safety staff and health systems researchers to develop and categorise the initial set of potential measures was an innovative and unique element of this study.

Study protocol for evaluating the implementation and effectiveness of an emergency department longitudinal patient monitoring system using a mixed-methods approach.

BACKGROUND: Early detection of patient deterioration is a key element of patient safety as it allows timely clinical intervention and potential rescue, thus reducing the risks of serious patient safety incidents. Longitudinal patient monitoring systems have been widely recommended for use to detect clinical deterioration. However, there is conflicting evidence on whether they improve patient outcomes. This may in part be related to variation in the rigour with which they are implemented and evaluated. This study aims to evaluate the implementation and effectiveness of a longitudinal patient monitoring system designed for adult patients in the unique environment of the Emergency Department (ED). METHODS: A novel participatory action research (PAR) approach is taken where socio-technical systems (STS) theory and analysis informs the implementation through the improvement methodology of 'Plan Do Study Act' (PDSA) cycles. We hypothesise that conducting an STS analysis of the ED before beginning the PDSA cycles will provide for a much richer understanding of the current situation and possible challenges to implementing the ED-specific longitudinal patient monitoring system. This methodology will enable both a process and an outcome evaluation of implementing the ED-specific longitudinal patient monitoring system. Process evaluations can help distinguish between interventions that have inherent faults and those that are badly executed. DISCUSSION: Over 1.2 million patients attend EDs annually in Ireland; the successful implementation of an ED-specific longitudinal patient monitoring system has the potential to affect the care of a significant number of such patients. To the best of our knowledge, this is the first study combining PAR, STS and multiple PDSA cycles to evaluate the implementation of an ED-specific longitudinal patient monitoring system and to determine (through process and outcome evaluation) whether this system can significantly improve patient outcomes by early detection and appropriate intervention for patients at risk of clinical deterioration.

An introduction to the Emergency Department Adult Clinical Escalation protocol: ED-ACE.

PURPOSE OF THE STUDY: This study demonstrates how a participatory action research approach was used to address the challenge of the early and effective detection of the deteriorating patient in the ED setting. The approach enabled a systematic approach to patient monitoring and escalation of care to be developed to address the wide-ranging spectrum of undifferentiated presentations and the phases of ED care from triage to patient admission. This paper presents a longitudinal patient monitoring system, which aims to provide monitoring and escalation of care, where necessary, of adult patients from triage to admission to hospital in a manner that is feasible in the unique ED environment. METHODS: An action research approach was taken to designing a longitudinal patient monitoring system appropriate for the ED. While the first draft protocol for post-triage monitoring and escalation was designed by a core research group, six clinical sites were included in iterative cycles of planning, action, reviewing and further planning. Reasons for refining the system at each site were collated and the protocol was adjusted accordingly before commencing the process at the next site. RESULTS: The ED Adult Clinical Escalation longitudinal patient monitoring system (ED-ACE) evolved through iterative cycles of design and testing to include: (1) a monitoring chart for adult patients; (2) a standardised approach to the monitoring and reassessment of patients after triage until they are assessed by a clinician; (3) the ISBAR (I=Identify, S=Situation, B=Background, A=Assessment, R=Recommendation) tool for interprofessional communication relating to clinical escalation; (4) a template for prescribing a patient-specific monitoring plan to be used by treating clinicians to guide patient monitoring from the time the patient is assessed until when they leave the ED and (5) a protocol for clinical escalation prompted by single physiological triggers and clinical concern. CONCLUSIONS: This tool offers a link in the 'Chain of Prevention' between the Manchester Triage System and ward-based early warning scores taking account of the importance of standardisation, while being sufficiently adaptable for the unique working environment and patient population in the ED.

The effectiveness of physiologically based early warning or track and trigger systems after triage in adult patients presenting to emergency departments: a systematic review.

BACKGROUND: Changes to physiological parameters precede deterioration of ill patients. Early warning and track and trigger systems (TTS) use routine physiological measurements with pre-specified thresholds to identify deteriorating patients and trigger appropriate and timely escalation of care. Patients presenting to the emergency department (ED) are undiagnosed, undifferentiated and of varying acuity, yet the effectiveness and cost-effectiveness of using early warning systems and TTS in this setting is unclear. We aimed to systematically review the evidence on the use, development/validation, clinical effectiveness and cost-effectiveness of physiologically based early warning systems and TTS for the detection of deterioration in adult patients presenting to EDs. METHODS: We searched for any study design in scientific databases and grey literature resources up to March 2016. Two reviewers independently screened results and conducted quality assessment. One reviewer extracted data with independent verification of 50% by a second reviewer. Only information available in English was included. Due to the heterogeneity of reporting across studies, results were synthesised narratively and in evidence tables. RESULTS: We identified 6397 citations of which 47 studies and 1 clinical trial registration were included. Although early warning systems are increasingly used in EDs, compliance varies. One non-randomised controlled trial found that using an early warning system in the ED may lead to a change in patient management but may not reduce adverse events; however, this is uncertain, considering the very low quality of evidence. Twenty-eight different early warning systems were developed/validated in 36 studies. There is relatively good evidence on the predictive ability of certain early warning systems on mortality and ICU/hospital admission. No health economic data were identified. CONCLUSIONS: Early warning systems seem to predict adverse outcomes in adult patients of varying acuity presenting to the ED but there is a lack of high quality comparative studies to examine the effect of using early warning systems on patient outcomes. Such studies should include health economics assessments.

A new era for emergency care services in Ireland.

The National Emergency Medicine Programme Strategy is a comprehensive plan to improve and develop emergency care in Ireland. It recommends significant changes in how emergency care is organised and delivered so that patients can be confident that they will receive high quality, safe and timely care. Emergency nurses were involved in developing aspects of the strategy document and will play a crucial role in its implementation to ensure that patient outcomes and satisfaction with emergency care services in Ireland are improved.