The experiences of 33 national COVID-19 dashboard teams during the first year of the pandemic in the World Health Organization European Region: A qualitative study.

Background: Governments across the World Health Organization (WHO) European Region have prioritised dashboards for reporting COVID-19 data. The ubiquitous use of dashboards for public reporting is a novel phenomenon. Objective: This study explores the development of COVID-19 dashboards during the first year of the pandemic and identifies common barriers, enablers and lessons from the experiences of teams responsible for their development. Methods: We applied multiple methods to identify and recruit COVID-19 dashboard teams, using a purposive, quota sampling approach. Semi-structured group interviews were conducted from April to June 2021. Using elaborative coding and thematic analysis, we derived descriptive and explanatory themes from the interview data. A validation workshop was held with study participants in June 2021. Results: Eighty informants participated, representing 33 national COVID-19 dashboard teams across the WHO European Region. Most dashboards were launched swiftly during the first months of the pandemic, February to May 2020. The urgency, intense workload, limited human resources, data and privacy constraints and public scrutiny were common challenges in the initial development stage. Themes related to barriers or enablers were identified, pertaining to the pre-pandemic context, pandemic itself, people and processes and software, data and users. Lessons emerged around the themes of simplicity, trust, partnership, software and data and change. Conclusions: COVID-19 dashboards were developed in a learning-by-doing approach. The experiences of teams reveal that initial underpreparedness was offset by high-level political endorsement, the professionalism of teams, accelerated data improvements and immediate support with commercial software solutions. To leverage the full potential of dashboards for health data reporting, investments are needed at the team, national and pan-European levels.

Development and Actionability of the Dutch COVID-19 Dashboard: Descriptive Assessment and Expert Appraisal Study.

BACKGROUND: Web-based public reporting by means of dashboards has become an essential tool for governments worldwide to monitor COVID-19 information and communicate it to the public. The actionability of such dashboards is determined by their fitness for purpose-meeting a specific information need-and fitness for use-placing the right information into the right hands at the right time and in a manner that can be understood. OBJECTIVE: The aim of this study was to identify specific areas where the actionability of the Dutch government's COVID-19 dashboard could be improved, with the ultimate goal of enhancing public understanding of the pandemic. METHODS: The study was conducted from February 2020 to April 2021. A mixed methods approach was carried out, using (1) a descriptive checklist over time to monitor changes made to the dashboard, (2) an actionability scoring of the dashboard to pinpoint areas for improvement, and (3) a reflection meeting with the dashboard development team to contextualize findings and discuss areas for improvement. RESULTS: The dashboard predominantly showed epidemiological information on COVID-19. It had been developed and adapted by adding more in-depth indicators, more geographic disaggregation options, and new indicator themes. It also changed in target audience from policy makers to the general public; thus, a homepage was added with the most important information, using news-like items to explain the provided indicators and conducting research to enhance public understanding of the dashboard. However, disaggregation options such as sex, socioeconomic status, and ethnicity and indicators on dual-track health system management and social and economic impact that have proven to give important insights in other countries are missing from the Dutch COVID-19 dashboard, limiting its actionability. CONCLUSIONS: The Dutch COVID-19 dashboard developed over time its fitness for purpose and use in terms of providing epidemiological information to the general public as a target audience. However, to strengthen the Dutch health system's ability to cope with upcoming phases of the COVID-19 pandemic or future public health emergencies, we advise (1) establishing timely indicators relating to health system capacity, (2) including relevant data disaggregation options (eg, sex, socioeconomic status), and (3) enabling interoperability between social, health, and economic data sources.

Improving performance intelligence for governing an integrated health and social care delivery network: a case study on the Amsterdam Noord district.

BACKGROUND: A guiding principle of a successful integrated health and social care delivery network is to establish a governance approach based on learning, grounded in a data and knowledge infrastructure. The 'Krijtmolen Alliantie' is a network of health and social care providers with the ambition to realize such a performance intelligence driven governance model in line with the Triple Aim. This study seeks to identify what performance intelligence is available and how it can be improved. METHODS: This case study was conducted in the district of Amsterdam Noord, the Netherlands, and employed 23 semi-structured interviews with stakeholders in health and social care, a feasibility analysis of available administrative data, and a reflection meeting with board members of the 'Krijtmolen Alliantie'. Information needs for performance intelligence by the stakeholders were mapped and a data landscape of the district covered by the network was drafted. Finally, in the reflection meeting with board members of the 'Krijtmolen Alliantie' the information needs and data landscape were aligned with governing needs, resulting in priority domains around which to strengthen the data infrastructure for governance of the integrated health and social care delivery network. RESULTS: The 'Krijtmolen Alliantie' encompasses a network of providers with a diverse range of catchment areas. There are indicators on population health and welfare, however they have limited actionability for providers due to a misalignment with their respective catchment areas. There is a barrier in data exchange between health and social care providers. It is difficult to construct one indicator for per capita cost in the Dutch health data infrastructure as health and social care are subdivided in financing siloes. Priority domains for improvement of performance intelligence for the 'Krijtmolen Alliantie' are: 1) Per capita and per patient cost data integration that would allow combined accountability through aligning financial incentives to facilitate integrated care, and 2) combined patient experience and outcome measures to reflect network quality of care and patient experience performance. CONCLUSION: Available performance intelligence lacks actionability for the governance of integrated care networks. Our recommendation is to align performance intelligence with the regional governance responsibilities of stakeholders for health and social care delivery.