Tools and methods for evaluating the change to health service delivery due to pandemics or other similar emergencies: A rapid evidence review.

The novel coronavirus, SARS-CoV-2 and its associated disease COVID-19, were declared a pandemic in March 2020. Countries developed rapid response activities within their health services to prevent spread of the virus and protect their populations. Evaluating health service delivery change is vital to assess how adapted practices worked, particularly during times of crisis. This review examined tools and methods that are used to evaluate health service delivery change during pandemics and similar emergencies. Five databases were searched, including PubMed, CENTRAL, Embase, CINAHL, and PsycINFO. The SPIDER tool informed the inclusion criteria for the articles. Articles in English and published from 2002 to 2020 were included. Risk of bias was assessed using the Mixed-Methods Appraisal Tool (MMAT). A narrative synthesis approach was used to analyse the studies. Eleven articles met the inclusion criteria. Many evaluation tools, methods, and frameworks were identified in the literature. Only one established tool was specific to a particular disease outbreak. Others, including rapid-cycle improvement and PDSA cycles were implemented across various disease outbreaks. Novel evaluation strategies were common across the literature and included checklists, QI frameworks, questionnaires, and surveys. Adherence practices, experience with telehealth, patient/healthcare staff safety, and clinical competencies were some areas evaluated by the tools and methods. Several domains, including patient/practitioner safety and patient/practitioner experience with telemedicine were also identified in the studies.

Community first response and out-of-hospital cardiac arrest: Identifying priorities for data collection, analysis, and use via the nominal group technique.

AIM: Community First Response (CFR) is an important component of Out-of-hospital Cardiac Arrest management in many countries, including Ireland. Reliable, strategic data collection and analysis are required to support the development of CFR. However, data on CFR are currently limited in Ireland and internationally. This research aimed to identify the most important CFR data to record, the most important uses of CFR data, and barriers and facilitators to CFR data collection and use. METHODS: The Nominal Group Technique structured consensus process was used. An expert panel comprising key stakeholders, including volunteers, clinicians, researchers, policy-makers, and a patient, completed a survey to generate lists of the most important CFR data to record and the most important uses of CFR data. Subsequently, they participated in a consensus meeting to agree the top ten priorities from each list. They also identified barriers and facilitators to CFR data collection and use. RESULTS: The top ten CFR data items to record included volunteer response time, interventions/activities completed by volunteers, and the mental/physical impact on volunteers. The top ten most important uses of CFR data included providing feedback to volunteers, improving volunteer training, and measuring CFR effectiveness. Barriers included time constraints and limited training. Facilitators included having appropriate software/equipment and collecting minimal data. CONCLUSION: The results can guide CFR research and inform the development of CFR data collection and analysis policy and practice in Ireland and internationally. Ultimately, improving CFR data collection and use will help to optimise this important intervention and enhance its evidence base.

Quality improvement in a crisis: a qualitative study of experiences and lessons learned from the Irish National Ambulance Service response to the COVID-19 pandemic.

OBJECTIVES: The COVID-19 pandemic has produced radical changes in international health services. In Ireland, the National Ambulance Service established a novel home and community testing service that was central to the national COVID-19 screening programme. This service was overseen by a multidisciplinary response room. This research examined the response room service, particularly areas that performed well and areas requiring improvement, using a quality improvement (QI) framework. DESIGN: This was a qualitative study comprising semi-structured, individual interviews. Maximum variation sampling was used. The data were analysed using an established thematic analysis procedure. The analysis was guided by the framework, which comprised six QI drivers. SETTING: Response room employees, including clinicians, dispatchers and administrators, were interviewed via telephone. RESULTS: Leadership for quality: participants valued person-oriented leadership, including regular, open communication and consultation with staff. Person/family engagement: participants endeavoured to provide patient-centred care. Formal patient feedback mechanisms and shared decision-making could be beneficial in the future. Staff engagement: working in a response room could affect well-being, though it also provided networking and learning opportunities. Staff require support and teambuilding. Use of improvement methods: improvements were made in a relatively informal, ad hoc manner. The use of robust methods based on improvement science was not reported. Measurement for quality: data were collected to improve efficiency and accuracy. More rigorous measurement would be beneficial, especially formally collecting stakeholder feedback. Governance for quality: close alignment with collaborators and clear communication with staff are essential. Information and communications technology for quality: this seventh driver was added because the importance of information technology specially designed for pandemics was frequently highlighted. CONCLUSIONS: The study provides insights on what worked well and what required improvement in a pandemic response room. It can inform health services, particularly emergency services, in their preparation for additional COVID-19 waves, as well as future crises.

Identifying priorities for the collection and use of data related to community first response and out-of-hospital cardiac arrest: protocol for a nominal group technique study.

Introduction: Out-of-hospital cardiac arrest (OHCA) is a devastating health event that affects over 2000 people each year in Ireland. Survival rate is low, but immediate intervention and initiation of cardiopulmonary resuscitation (CPR) and administration of an automated external defibrillator (AED) can increase chances of survival. It is not always possible for the emergency medical services (EMS) to reach OHCA cases quickly. As such, volunteers, including lay and professional responders (e.g. off-duty paramedics and fire-fighters), trained in CPR and AED use, are mobilised by the EMS to respond locally to prehospital medical emergencies (e.g. OHCA and stroke). This is known as community first response (CFR). Data on the impact of CFR interventions are limited. This research aims to identify the most important CFR data to collect and analyse, the most important uses of CFR data, as well as barriers and facilitators to data collection and use. This can inform policies to optimise the practice of CFR in Ireland. Methods: The nominal group technique (NGT) is a structured consensus process where key stakeholders (e.g. CFR volunteers, clinicians, EMS personnel, and patients/relatives) develop a set of prioritised recommendations. This study will employ the NGT, incorporating an online survey and online consensus meeting, to develop a priority list for the collection and use of CFR data in Ireland. Stakeholder responses will also identify barriers and facilitators to data collection and use, as well as indicators that improvements to these processes have been achieved. The maximum sample size for the NGT will be 20 participants to ensure sufficient representation from stakeholder groups. Discussion: This study, employing the NGT, will consult key stakeholders to establish CFR data collection, analysis, and use priorities. Results from this study will inform CFR research, practice, and policy, to improve the national CFR service model and inform international response programs.

Improved Quality of Life, Fitness, Mental Health and Cardiovascular Risk Factors with a Publicly Funded Bariatric Lifestyle Intervention for Adults with Severe Obesity: A Prospective Cohort Study.

BACKGROUND: Lifestyle modification is the cornerstone of management for patients with severe and complicated obesity, but the effects of structured lifestyle programmes on quality of life, anxiety and depression scores and cardiovascular risk factors are not well-described. We sought to describe changes in self-reported quality of life and mental health-related outcomes as well as cardiovascular risk factors in patients completing a 10-week multidisciplinary lifestyle-modification programme. METHODS: We conducted a prospective cohort study of all patients referred from our bariatric service who completed the programme between 2013 and 2019. In addition to weight, body mass index (BMI), blood pressure, HbA1c, lipid profile and functional capacity, we quantified health-related quality of life using the Dartmouth COOP Questionnaire and the European Quality of Life Questionnaire Visual Analogue Scale (EQVAS) and mental health using the Hospital Anxiety and Depression Scale (HADS). RESULTS: Of 1122 patients who started the programme, 877 (78.2%) completed it and were included in per protocol analyses. Mean age was 47.3 ± 11.9 years, 66.9% were female, 34.8% were in full- or part-time employment and 69.4% were entitled to state-provided medical care. BMI decreased from 47.0 ± 7.8 to 46.2 ± 7.8 kg m-2 and weight decreased from 131.6 ± 25.5 to 129.5 ± 25.4 kg (both p < 0.001). There were significant reductions in anxiety and depression scores and improvements in all Dartmouth COOP domains. The EQVAS score increased from 52 ± 22 to 63 ± 19 (p < 0.001). Small but statistically significant reductions in LDL cholesterol, systolic blood pressure and HBA1c were also observed. CONCLUSIONS: Adults with severe and complicated obesity completing a specialised bariatric lifestyle-modification programme showed significant improvements in self-reported mental health and quality of life, in addition to reductions in cardiovascular risk factors.

Rapid response and learning for later: establishing high quality information networks and evaluation frameworks for the National Ambulance Service response to COVID-19 - the ENCORE COVID Project Protocol.

Background: The National Ambulance Service (NAS) is at the forefront of Ireland's response to the COVID-19 pandemic. As directed in Ireland's National Action Plan, NAS significantly expanded prehospital services, including provision of a novel COVID-19 testing service. Additionally, other health services rely on NAS's capacity to assess, transport and/or treat COVID-19 patients. In a climate of innovation and adaptation, NAS needs to learn from international ambulance services and share experience. Evaluation of the NAS response to COVID-19 is required to facilitate evidence-based planning for subsequent waves or future pandemics, and to identify innovative practice for mainstreaming into routine service provision. Aims: This project aims to test the utility of novel information networks and develop a tool that is tailored to evaluating pandemic-imposed change in an emergency medical service. Methods: The first aim will be to introduce and measure the impact of ambulance-specific research and information updates for NAS. Secondly, the usefulness to members of an international network of senior ambulance and research personnel ('AMBULANCE+COVID19' network), and the clarity and feasibility of a short-survey instrument, the Emergency Medical Services Five Question Survey (EMS-5QS), will be assessed. Finally, an evaluation framework for assessing pandemic-imposed change will be developed to enable NAS determine innovations: (1) for reactivation in another wave or new pandemic; (2) to be sustained as part of routine service. The framework will be developed in collaboration with NAS and the National Quality Improvement Team. The Research Team includes expertise from academia, ambulance services and the National Public Health Emergency Team. Conclusions: This project will facilitate the prompt introduction of information sharing processes to an emergency medical service and assess the impact of those processes. By developing a process for evaluating pandemic-imposed change in NAS, this project will add to the toolbox for future pandemic planning in emergency medical services internationally.