Changing genomic epidemiology of COVID-19 in long-term care facilities during the 2020-2022 pandemic, Washington State.

BACKGROUND: Long-term care facilities (LTCFs) are vulnerable to disease outbreaks. Here, we jointly analyze SARS-CoV-2 genomic and paired epidemiologic data from LTCFs and surrounding communities in Washington state (WA) to assess transmission patterns during 2020-2022, in a setting of changing policy. We describe sequencing efforts and genomic epidemiologic findings across LTCFs and perform in-depth analysis in a single county. METHODS: We assessed genomic data representativeness, built phylogenetic trees, and conducted discrete trait analysis to estimate introduction sizes over time, and explored selected outbreaks to further characterize transmission events. RESULTS: We found that transmission dynamics among cases associated with LTCFs in WA changed over the course of the COVID-19 pandemic, with variable introduction rates into LTCFs, but decreasing amplification within LTCFs. SARS-CoV-2 lineages circulating in LTCFs were similar to those circulating in communities at the same time. Transmission between staff and residents was bi-directional. CONCLUSIONS: Understanding transmission dynamics within and between LTCFs using genomic epidemiology on a broad scale can assist in targeting policies and prevention efforts. Tracking facility-level outbreaks can help differentiate intra-facility outbreaks from high community transmission with repeated introduction events. Based on our study findings, methods for routine tree building and overlay of epidemiologic data for hypothesis generation by public health practitioners are recommended. Discrete trait analysis added valuable insight and can be considered when representative sequencing is performed. Cluster detection tools, especially those that rely on distance thresholds, may be of more limited use given current data capture and timeliness. Importantly, we noted a decrease in data capture from LTCFs over time. Depending on goals for use of genomic data, sentinel surveillance should be increased or targeted surveillance implemented to ensure available data for analysis.

Impact of the COVID-19 Pandemic on the State Enteric Disease Public Health Workforce in the Western United States, March-April 2022.

OBJECTIVE: To assess the impact of the COVID-19 pandemic on the state-level enteric disease workforce and routine enteric disease surveillance and outbreak investigation activities in the western United States. DESIGN AND SETTING: Key informant interviews conducted using bidirectional video from March to April 2022. PARTICIPANTS: Enteric disease epidemiologists at state public health agencies in the western states served by the Colorado and Washington Integrated Food Safety Centers of Excellence. MAIN OUTCOMES: Key themes were identified using grounded theory. RESULTS: Nine themes were identified including excessive workload, shifts in local and state responsibilities, challenges with retention and hiring, importance of student teams, laboratory supplies shortages, changes to case and outbreak investigation priorities, transitioning back to enterics, adoption of new methods and technology, and current and future needs. CONCLUSIONS: The COVID-19 pandemic response had a substantial impact on state-level enteric disease activities in western states, with many staff members diverted from routine responsibilities and a de-prioritization of enteric disease work. There is a need for sustainable solutions to address staffing shortages, prioritize employee mental health, and effectively manage routine workloads when responding to emergencies.

Sentinel Surveillance System Implementation and Evaluation for SARS-CoV-2 Genomic Data, Washington, USA, 2020-2021.

Genomic data provides useful information for public health practice, particularly when combined with epidemiologic data. However, sampling bias is a concern because inferences from nonrandom data can be misleading. In March 2021, the Washington State Department of Health, USA, partnered with submitting and sequencing laboratories to establish sentinel surveillance for SARS-CoV-2 genomic data. We analyzed available genomic and epidemiologic data during presentinel and sentinel periods to assess representativeness and timeliness of availability. Genomic data during the presentinel period was largely unrepresentative of all COVID-19 cases. Data available during the sentinel period improved representativeness for age, death from COVID-19, outbreak association, long-term care facility-affiliated status, and geographic coverage; timeliness of data availability and captured viral diversity also improved. Hospitalized cases were underrepresented, indicating a need to increase inpatient sampling. Our analysis emphasizes the need to understand and quantify sampling bias in phylogenetic studies and continue evaluation and improvement of public health surveillance systems.

Improving Foodborne Disease Surveillance and Outbreak Detection and Response Using Peer Networks-The Integrated Food Safety Centers of Excellence.

CONTEXT: Foodborne disease surveillance and outbreak investigations are foundational to the prevention and control of foodborne disease in the United States, where contaminated foods cause an estimated 48 million illnesses, 128 000 hospitalizations, and 3000 deaths each year. Surveillance activities and rapid detection and investigation of foodborne disease outbreaks require a trained and coordinated workforce across epidemiology, environmental health, and laboratory programs. PROGRAM: Under the 2011 Food Safety Modernization Act, the Centers for Disease Control and Prevention (CDC) was called on to establish Integrated Food Safety (IFS) Centers of Excellence (CoEs) at state health departments, which would collaborate with academic partners, to identify, implement, and evaluate model practices in foodborne disease surveillance and outbreak response and to serve as a resource for public health professionals. IMPLEMENTATION: CDC designated 5 IFS CoEs in August 2012 in Colorado, Florida, Minnesota, Oregon, and Tennessee; a sixth IFS CoE in New York was added in August 2014. For the August 2019-July 2024 funding period, 5 IFS CoEs were designated in Colorado, Minnesota, New York, Tennessee, and Washington. Each IFS CoE is based at the state health department that partners with at least one academic institution. EVALUATION: IFS CoEs have built capacity across public health agencies by increasing the number of workforce development opportunities (developing >70 trainings, tools, and resources), supporting outbreak response activities (responding to >50 requests for outbreak technical assistance annually), mentoring students, and responding to emerging issues, such as changing laboratory methods and the COVID-19 pandemic.

Mixed-Methods Evaluation of the Washington State Practice Transformation Support Hub.

PURPOSE: Practice transformation initiatives have the potential to promote collaborations between public health, primary care, and behavioral health, but limited empirical evidence is available on how these programs affect participating clinical practices. OBJECTIVE: To report the findings from a mixed-methods program evaluation of the Washington Practice Transformation Support Hub (Hub), a publicly funded, multicomponent practice transformation initiative in Washington State. DESIGN: We used quantitative and qualitative methods to evaluate the impact of Hub activities on participating primary care and behavioral health practices. Pre- and posttest survey data were combined with administrative program data to understand the effect of program components. Qualitative interviews contextualized findings. SETTING: Urban and rural primary care and behavioral health practices in Washington State. PARTICIPANTS: One hundred seventy-five practices that were recruited to receive Hub coaching and facilitation from 8 coaches; of these, 13 practices and all coaches participated in key informant interviews. INTERVENTION: Practice coaching and facilitation supported by an online resource portal, from January 2017 through January 2019. MAIN OUTCOME MEASURES: Self-reported progress in specific activities in 3 practice-level domains: bidirectional integration of physical and behavioral health care (care integration); alignment with community-based services for whole-person care (clinical-community linkages); and value-based payment. RESULTS: Participation in Hub activities was associated with improvements in care integration and clinical-community linkages but not with progress toward value-based payment. Qualitative results indicated that practice progress was influenced by communication with practices, the culture of the practice, resource constraints (particularly in rural areas), and perceptions about sustainability. CONCLUSIONS: This statewide practice transformation initiative was successful in strengthening primary care and behavioral health integration and clinical-community linkages among participating practices but not value-based payment. Future practice transformation efforts may benefit from addressing barriers posed by communication, limited application of value-based payment, culture change, competing priorities, and resource limitations, particularly for rural communities.

Evaluation of an Emergency Department and Hospital-Based Data Exchange to Improve HIV Care Engagement and Viral Suppression.

BACKGROUND: Emergency department (ED) visits and inpatient (IP) admissions may provide an opportunity to reengage poorly engaged people living with HIV and facilitate viral suppression. In 2015, Public Health Seattle and King County partnered with the University of Washington Medicine to implement a real-time data exchange to identify virally unsuppressed people living with HIV seen at the ED/IP hospital and reengage them in HIV care. We evaluated the impact of the data exchange on care engagement and viral suppression. METHODS: Public Health Seattle and King County received a text alert on weekdays 8 AM to 6 PM for ED/IP patients previously diagnosed with HIV with a most recent viral load ≥200 copies/mL. We compared viral load testing <3 months and viral suppression <6 months after an alert-eligible visit in the 2 years after intervention and the 7 to 30 months before intervention. To account for secular trends, we used difference-in-differences models to compare patients with alert-window visits to patients with visits outside the alert window before and after intervention. RESULTS: Patients with visits within the alert window in the postintervention period were 1.08 (95% confidence interval [CI], 0.97-1.20) times more likely to have a viral load test within 3 months after an ED visit/IP admission and 1.50 (95% CI, 1.27-1.76) times more likely to achieve viral suppression within 6 months than patients in the preintervention period. However, care engagement (difference-in-differences relative risk, 1.00; 95% CI, 0.84-1.18) and viral suppression (difference-in-differences relative risk, 1.01; 95% CI, 0.84-1.20) trends were similar among patients with visits outside the alert window. CONCLUSIONS: Real-time data exchange with ED/IP hospitals was associated with improved viral suppression, but not increased care engagement. However, our results may reflect secular trends resulting from diverse interventions, of which ours was only one. More efforts are needed to improve the effectiveness of relinkage interventions guided by real-time data exchange.

Destress 9-1-1-an online mindfulness-based intervention in reducing stress among emergency medical dispatchers: a randomised controlled trial.

OBJECTIVES: Emergency medical dispatchers (EMDs) experience significant stress in the workplace. Yet, interventions aimed at reducing work-related stress are difficult to implement due to the logistic challenges associated with the relatively unique EMD work environment. This investigation tested the efficacy of a 7-week online mindfulness-based intervention (MBI) tailored to the EMD workforce. METHODS: Active-duty EMDs from the USA and Canada (n=323) were randomly assigned to an intervention or wait list control condition. Participants completed surveys of stress and mindfulness at baseline, post intervention, and 3 months follow-up. Repeated measures mixed effects models were used to assess changes in stress and mindfulness. RESULTS: Differences between the intervention group and control group in pre-post changes in stress using the Calgary Symptoms of Stress Inventory were statistically significant, with a difference of -10.0 (95% CI: -14.9, -5.2, p<0.001) for change from baseline to post intervention, and a difference of -6.5 (95% CI: -11.9, -1.1, p=0.02) for change from baseline to 3 months follow-up. Change in mindfulness scores did not differ between groups. However, increases in mindfulness scores were correlated with greater reductions in stress for all participants, regardless of group (r=-0.53, p<0.001). CONCLUSIONS: Development of tailored online MBIs for employees working in challenging work environments offer a promising direction for prevention and intervention. This study found that a short, weekly online MBI for EMDs resulted in reductions in reports of stress. Implications of online MBIs in other emergency responding populations and directions for future research are discussed.

Epidemiology and Antimicrobial Resistance Characteristics of the Sequence Type 131-H30 Subclone Among Extraintestinal Escherichia coli Collected From US Children.

Background: Escherichia coli sequence type (ST) 131-H30 is a globally important pathogen implicated in rising rates of multidrug resistance among E. coli causing extraintestinal infections. Previous studies have focused on adults, leaving the epidemiology of H30 among children undefined. Methods: We used clinical data and isolates from a case-control study of extended-spectrum cephalosporin-resistant E. coli conducted at 4 US children's hospitals to estimate the burden and identify host correlates of infection with H30. H30 isolates were identified using 2-locus genotyping; host correlates were examined using log-binomial regression models stratified by extended-spectrum cephalosporin resistance status. Results: A total of 339 extended-spectrum cephalosporin-resistant and 1008 extended-spectrum cephalosporin-susceptible E. coli isolates were available for analyses. The estimated period prevalence of H30 was 5.3% among all extraintestinal E. coli isolates (95% confidence interval [CI], 4.6%-7.1%); H30 made up 43.3% (81/187) of extended-spectrum ß-lactamase (ESBL)-producing isolates in this study. Host correlates of infection with H30 differed by extended-spectrum cephalosporin resistance status: Among resistant isolates, age ≤5 years was positively associated with H30 infection (relative risk [RR], 1.83 [95% CI, 1.19-2.83]); among susceptible isolates, age ≤5 years was negatively associated with H30 (RR, 0.48 [95% CI, .27-.87]), while presence of an underlying medical condition was positively associated (RR, 4.49 [95% CI, 2.43-8.31]). Conclusions: ST131-H30 is less common among extraintestinal E. coli collected from children compared to reported estimates among adults, possibly reflecting infrequent fluoroquinolone use in pediatrics; however, it is similarly dominant among ESBL-producing isolates. The H30 subclone appears to disproportionately affect young children relative to other extended-spectrum cephalosporin-resistant E. coli.

Protocol: a multi-level intervention program to reduce stress in 9-1-1 telecommunicators.

BACKGROUND: Nationwide, emergency response systems depend on 9-1-1 telecommunicators to prioritize, triage, and dispatch assistance to those in distress. 9-1-1 call center telecommunicators (TCs) are challenged by acute and chronic workplace stressors: tense interactions with citizen callers in crisis; overtime; shift-work; ever-changing technologies; and negative work culture, including co-worker conflict. This workforce is also subject to routine exposures to secondary traumatization while handling calls involving emergency situations and while making time urgent, high stake decisions over the phone. Our study aims to test the effectiveness of a multi-part intervention to reduce stress in 9-1-1 TCs through an online mindfulness training and a toolkit containing workplace stressor reduction resources. METHODS/DESIGN: The study employs a randomized controlled trial design with three data collection points. The multi-part intervention includes an individual-level online mindfulness training and a call center-level organizational stress reduction toolkit. 160 TCs will be recruited from 9-1-1 call centers, complete a baseline survey at enrollment, and are randomly assigned to an intervention or a control group. Intervention group participants will start a 7-week online mindfulness training developed in-house and tailored to 9-1-1 TCs and their call center environment; control participants will be "waitlisted" and start the training after the study period ends. Following the intervention group's completion of the mindfulness training, all participants complete a second survey. Next, the online toolkit with call-center wide stress reduction resources is made available to managers of all participating call centers. After 3 months, a third survey will be completed by all participants. The primary outcome is 9-1-1 TCs' self-reported symptoms of stress at three time points as measured by the C-SOSI (Calgary Symptoms of Stress Inventory). Secondary outcomes will include: perceptions of social work environment (measured by metrics of social support and network conflict); mindfulness; and perceptions of social work environment and mindfulness as mediators of stress reduction. DISCUSSION: This study will evaluate the effectiveness of an online mindfulness training and call center-wide stress reduction toolkit in reducing self-reported stress in 9-1-1 TCs. The results of this study will add to the growing body of research on worksite stress reduction programs. TRIAL REGISTRATION: ClinicalTrials.gov Registration Number: NCT02961621 Registered on November 7, 2016 (retrospectively registered).

Impact of new technologies on stress, attrition and well-being in emergency call centers: the NextGeneration 9-1-1 study protocol.

BACKGROUND: Our public health emergency response system relies on the "first of the first responders"-the emergency call center workforce that handles the emergency needs of a public in distress. Call centers across the United States have been preparing for the "Next Generation 9-1-1" initiative, which will allow citizens to place 9-1-1 calls using a variety of digital technologies. The impacts of this initiative on a workforce that is already highly stressed is unknown. There is concern that these technology changes will increase stress, reduce job performance, contribute to maladaptive coping strategies, lower employee retention, or change morale in the workplace. Understanding these impacts to inform approaches for mitigating the health and performance risks associated with new technologies is crucial for ensuring the 911 system fulfills its mission of providing optimal emergency response to the public. METHODS: Our project is an observational, prospective cohort study framed by the first new technology that will be implemented: text-to-911 calling. Emergency center call takers will be recruited nationwide. Data will be collected by online surveys distributed at each center before text-to-911 implementation; within the first month of implementation; and 6 months after implementation. Primary outcome measures are stress as measured by the Calgary Symptoms of Stress Index, use of sick leave, job performance, and job satisfaction. Primary analyses will use mixed effects regression models and mixed effects logistic regression models to estimate the change in outcome variables associated with text-to-911 implementation. Multiple secondary analyses will examine effects of stress on absenteeism; associations between technology attitudes and stress; effects of implementation on attitudes towards technology; and mitigating effects of job demands, job satisfaction, attitudes towards workplace technology and workplace support on change in stress. DISCUSSION: Our public health dependence on this workforce for our security and safety makes it imperative that the impact of technological changes such as text-to-911 are researched so appropriate intervention efforts to can be developed. Failing to protect our 9-1-1 call takers from predictable health risks would be similar to knowingly exposing field emergency responders to a toxic situation without following OSHA required training and practice standards assuring their protection.

Exploring bi-directional and SMS messaging for communications between Public Health Agencies and their stakeholders: a qualitative study.

BACKGROUND: Communication technologies that enable bi-directional/two-way communications and cell phone texting (SMS) between public health agencies and their stakeholders may improve public health surveillance, ensure targeted distribution of alerts to hard-to-reach populations, reduce mortality and morbidity in an emergency, and enable a crucial feedback loop between public health agencies and the communities they serve. Building on prior work regarding health care provider preferences for receiving one-way public health communications by email, fax or SMS, we conducted a formative, exploratory study to understand how a bi-directional system and the incorporation of SMS in that system might be used as a strategy to send and receive messages between public health agencies and community-based organizations which serve vulnerable populations, health care providers, and public health workers. Our research question: Under what conditions and/or situations might public health agencies utilize bi-directional and/or SMS messaging for disseminating time-sensitive public health information (alerts, advisories, updates, etc.) to their stakeholders? METHODS: A mixed methods (qualitative and quantitative) study was conducted between April and July 2014. Data collection included a survey distributed to health care providers and semi-structured interviews with providers, community- and government-based organization leaders and directors, and public health agency internal workforce staff. Survey respondents and interviewees were asked about their exposure to public health messages, how these messages are received and how the information in these messages are handled, and in what situations (for example, a local vs. a national event, a pandemic or emergency vs. a health update) a bi-directional and/or SMS messaging system might improve communications between public health agencies and their stakeholder group. Interview and survey data were qualitatively analyzed. Thematic codes were quantitized into dichotomous variables of 0 or 1 on a per respondent basis to enumerate the presence or absence of each thematic code, enable quantitative analysis, and inform interpretation of findings. RESULTS: Five major themes emerged from synthesizing survey and interview results: 1) Regardless of situational context (emergency vs. non-urgent) and message recipient (stakeholder group), e-mail is a favored modality for receiving public health messages; 2) The decision to use bi-directional, SMS or multiple communication strategies is complex and public health agencies' need to manage messaging concerns/barriers and benefits for all parties; 3) Both public health agencies and their stakeholders share similar values/uses and concerns regarding two-way public health messaging and SMS; 4) Public health is highly trusted, thus thoughtful, effective messaging will ensure continuation of this goodwill; and 5) Information reciprocity between public health agencies and stakeholders who share their information is essential. CONCLUSIONS: Multiple communication strategies might be utilized but the choice of a specific strategy needs to balance message content (emergency vs. routine communications), delivery (one- vs. two-way), channel (SMS, email, etc.), and public health agency burden with stakeholder preferences and technical capabilities, all while mitigating the risk of message overload and disregard of important communications by recipients.

Patient attrition from the HIV antiretroviral therapy program at two hospitals in Haiti.

OBJECTIVE: To identify factors associated with antiretroviral therapy (ART) attrition among patients initiating therapy in 2005-2011 at two large, public-sector department-level hospitals, and to inform interventions to improve ART retention. METHODS: This retrospective cohort study used data from the iSanté electronic medical record (EMR) system. The study characterized ART attrition levels and explored the patient demographic, clinical, temporal, and service utilization factors associated with ART attrition, using time-to-event analysis methods. RESULTS: Among the 2 023 patients in the study, ART attrition on average was 17.0 per 100 person-years (95% confidence interval (CI): 15.8-18.3). In adjusted analyses, risk of ART attrition was up to 89% higher for patients living in distant communes compared to patients living in the same commune as the hospital (hazard ratio: 1.89, 95%CI: 1.54-2.33; P < 0.001). Hospital site, earlier year of ART start, spending less time enrolled in HIV care prior to ART initiation, receiving a non-standard ART regimen, lacking counseling prior to ART initiation, and having a higher body mass index were also associated with attrition risk. CONCLUSIONS: The findings suggest quality improvement interventions at the two hospitals, including: enhanced retention support and transportation subsidies for patients accessing care from remote areas; counseling for all patients prior to ART initiation; timely outreach to patients who miss ART pick-ups; "bridging services" for patients transferring care to alternative facilities; routine screening for anticipated interruptions in future ART pick-ups; and medical case review for patients placed on non-standard ART regimens. The findings are also relevant for policymaking on decentralization of ART services in Haiti.

Integration of Jail Booking and HIV Surveillance Data to Facilitate Care Coordination.

Many people with HIV (PWH) in jail have not been well engaged in HIV treatment in the community. This study aimed to assess the impact of a data exchange paired with care coordination for PWH on HIV outcomes after jail release. We developed an automated process to match jail booking records with HIV surveillance data. Health department HIV relinkage specialists and jail release planners used the data in weekly case conferences to facilitate care coordination for PWH who were out of care (no CD4 or viral load [VL] reported in the past 12 months) or viremic (VL ≥ 200 copies/mL) before booking. We compared VL testing within 3 months after release and viral suppression (VL < 200 copies/mL) within 6 months after release in preintervention (October 1, 2016-October 1, 2017) versus postintervention (April 1, 2018-February 1, 2019) periods using Cox proportional hazard models. Comparing 153 bookings among PWH in the preintervention period to 80 in the postintervention period, VL testing after release did not differ (47% vs. 55%; adjusted hazard ratio [aHR]: 1.05, 95% confidence interval [CI]: 0.68-1.64) nor did viral suppression (35% vs. 44%; aHR: 1.28 [95% CI: 0.80-2.05]). Data exchange and care coordination are insufficient to improve postrelease outcomes among PWH without additional interventions in the jail and community.

Use of Digital COVID-19 Exposure Notifications at a Large Gathering: Survey Analysis of Public Health Conference Attendees.

BACKGROUND: WA Notify was Washington State's smartphone-based COVID-19 digital exposure notification (EN) tool, which was used to help limit the spread of COVID-19 between November 30, 2020, and May 11, 2023. Following the 2022 Washington State Public Health Association Annual Conference, attendees who had WA Notify activated began receiving ENs alerting them to a possible COVID-19 exposure during the conference. A survey was emailed to all conference attendees to measure WA Notify adoption, mechanisms through which attendees received ENs, and self-reported engagement in protective behaviors postexposure. OBJECTIVE: This study aimed to learn more about the experiences of WA Notify adopters and nonadopters who may have been exposed to COVID-19 at a large group gathering. METHODS: A web-based survey administered through REDCap (Research Electronic Data Capture; Vanderbilt University) was sent to all attendees of the Washington State Public Health Association conference. Self-reported demographic information and characteristics of respondents were summarized. Regression models were used to estimate relative risks to compare WA Notify adoption and testing behaviors between groups. RESULTS: Of the 464 total registered attendees who were sent the survey, 205 (44%) responses were received; 201 eligible attendees were included in this analysis. Of those, 149 (74%) respondents reported having WA Notify activated on their phones at the time of the conference. Among respondents with WA Notify activated, 54% (n=77) reported learning of their potential exposure from a WA Notify EN. Respondents who reported that they did not have WA Notify activated and learned of their potential exposure via the event-wide email from conference organizers were 39% less likely to test for COVID-19 compared to respondents with WA Notify activated who learned of their potential exposure from the email (relative risk 0.61, 95% CI 0.40-0.93; P=.02), and this gap was even larger when compared to respondents who learned of their exposure from a WA Notify EN. The most commonly cited reason for not having WA Notify activated was privacy concerns (n=17, 35%), followed by not wanting to receive ENs (n=6, 12%) and being unaware of WA Notify (n=5, 10%). CONCLUSIONS: Digital EN systems are an important tool to directly and anonymously notify close contacts of potential exposures and provide guidance on the next steps in a timely manner. Given the privacy concerns, there is still a need for increasing transparency surrounding EN technology to increase uptake by the public if this technology were to be used in the future to slow the spread of communicable diseases.

Evaluation of the effectiveness of Washington State's digital COVID-19 exposure notification system over one pandemic year.

Introduction: Digital exposure notifications are a novel public health intervention used during the COVID-19 pandemic to alert users of possible COVID-19 exposure. We seek to quantify the effectiveness of Washington State's digital exposure notification system, WA Notify, as measured by the number of COVID-19 cases averted during a 1-year period. Methods: While maintaining individuals' privacy, WA Notify collected data that could be used to evaluate the system's effectiveness. This article uses these and other data and builds on a previous model to estimate the number of cases averted by WA Notify. Novel estimates of some model parameters are possible because of improvements in the quality and breadth of data reported by WA Notify. Results: We estimate that WA Notify averted 64,000 (sensitivity analysis: 35,000-92,000) COVID-19 cases in Washington State during the study period from 1 March 2021 to 28 February 2022. During this period, there were an estimated 1,089,000 exposure notifications generated and 155,000 cases reported to WA Notify. During the last 78 days of the study period, the median estimated number of daily active users was 1,740,000. Discussion: We believe WA Notify reduced the impact of the COVID-19 pandemic in Washington State and that similar systems could reduce the impact of future communicable disease outbreaks.

Public health communications and alert fatigue.

BACKGROUND: Health care providers play a significant role in large scale health emergency planning, detection, response, recovery and communication with the public. The effectiveness of health care providers in emergency preparedness and response roles depends, in part, on public health agencies communicating information in a way that maximizes the likelihood that the message is delivered, received, deemed credible and, when appropriate, acted on. However, during an emergency, health care providers can become inundated with alerts and advisories through numerous national, state, local and professional communication channels. We conducted an alert fatigue study as a sub-study of a larger randomized controlled trial which aimed to identify the most effective methods of communicating public health messages between public health agencies and providers. We report an analysis of the effects of public health message volume/frequency on recall of specific message content and effect of rate of message communications on health care provider alert fatigue. METHODS: Health care providers enrolled in the larger study (n=528) were randomized to receive public health messages via email, fax, short message service (SMS or cell phone text messaging) or to a control group that did not receive messages. For 12 months, study messages based on real events of public health significance were sent quarterly with follow-up telephone interviews regarding message receipt and topic recall conducted 5-10 days after the message delivery date. During a pandemic when numerous messages are sent, alert fatigue may impact ability to recall whether a specific message has been received due to the "noise" created by the higher number of messages. To determine the impact of "noise" when study messages were sent, we compared health care provider recall of the study message topic to the number of local public health messages sent to health care providers. RESULTS: We calculated the mean number of messages that each provider received from local public health during the time period around each study message and provider recall of study message content. We found that recall rates were inversely proportional to the mean number of messages received per week: Every increase of one local public health message per week resulted in a statistically significant 41.2% decrease (p < 0.01), 95% CI [0.39, .87] in the odds of recalling the content of the study message. CONCLUSIONS: To our knowledge, this is the first study to document the effects of alert fatigue on health care providers' recall of information. Our results suggest that information delivered too frequently and/or repetitively through numerous communication channels may have a negative effect on the ability of health care providers to effectively recall emergency information. Keeping health care providers and other first-line responders informed during an emergency is critical. Better coordination between organizations disseminating alerts, advisories and other messages may improve the ability of health care providers to recall public health emergency messages, potentially impacting effective response to public health emergency messages.

Engagement in Protective Behaviors by Digital Exposure Notification Users During the COVID-19 Pandemic, Washington State, January-June 2021.

OBJECTIVES: Smartphone-based digital exposure notification (EN) tools were introduced during the COVID-19 pandemic to supplement strained case investigation and contact tracing efforts. We examined the influence of an EN tool implemented in Washington State, WA Notify, on user engagement in behaviors that protect against COVID-19 transmission. METHODS: From January 25 through June 30, 2021, we administered 2 surveys to WA Notify users who received notification of a possible COVID-19 exposure. The initial survey, sent when users received a notification, focused on intent to engage in protective behaviors. The follow-up survey captured data on self-reported actual engagement in protective behaviors and contact by a public health contact tracer. RESULTS: Of 1507 WA Notify users who completed the initial survey, 40.1% (n = 604) reported intending to seek COVID-19 testing and 67.1% (n = 1011) intended to watch for COVID-19 symptoms. Of 407 respondents to the follow-up survey, 57.5% (n = 234) reported getting tested and 84.3% (n = 343) reported watching for COVID-19 symptoms. Approximately 84% (n = 1266) of respondents to the initial survey received a notification from WA Notify before being reached by public health contact tracers; on follow-up, 42.5% (n = 173) of respondents reported never being contacted by public health. CONCLUSIONS: Our findings suggest that WA Notify users may initiate protective behaviors earlier than nonusers who will not know of an exposure until notified by public health or by a known contact. Digital EN tools may be a valuable addition to existing public health outbreak investigation and response activities.

Trading-off privacy and utility: the Washington State experience assessing the performance of a public health digital exposure notification system for coronavirus disease 2019.

OBJECTIVE: Digital exposure notifications (DEN) systems were an emergency response to the coronavirus disease 2019 (COVID-19) pandemic, harnessing smartphone-based technology to enhance conventional pandemic response strategies such as contact tracing. We identify and describe performance measurement constructs relevant to the implementation of DEN tools: (1) reach (number of users enrolled in the intervention); (2) engagement (utilization of the intervention); and (3) effectiveness in preventing transmissions of COVID-19 (impact of the intervention). We also describe WA State's experience utilizing these constructs to design data-driven evaluation approaches. METHODS: We conducted an environmental scan of DEN documentation and relevant publications. Participation in multidisciplinary collaborative environments facilitated shared learning. Compilation of available data sources and their relevance to implementation and operation workflows were synthesized to develop implementation evaluation constructs. RESULTS: We identified 8 useful performance indicators within reach, engagement, and effectiveness constructs. DISCUSSION: We use implementation science to frame the evaluation of DEN tools by linking the theoretical constructs with the metrics available in the underlying disparate, deidentified, and aggregate data infrastructure. Our challenges in developing meaningful metrics include limited data science competencies in public health, validation of analytic methodologies in the complex and evolving pandemic environment, and the lack of integration with the public health infrastructure. CONCLUSION: Continued collaboration and multidisciplinary consensus activities can improve the utility of DEN tools for future public health emergencies.