Implementation of a Web-Based Chatbot to Guide Hospital Employees in Returning to Work During the COVID-19 Pandemic: Development and Before-and-After Evaluation.

BACKGROUND: Throughout the COVID-19 pandemic, multiple policies and guidelines were issued and updated for health care personnel (HCP) for COVID-19 testing and returning to work after reporting symptoms, exposures, or infection. The high frequency of changes and complexity of the policies made it difficult for HCP to understand when they needed testing and were eligible to return to work (RTW), which increased calls to Occupational Health Services (OHS), creating a need for other tools to guide HCP. Chatbots have been used as novel tools to facilitate immediate responses to patients' and employees' queries about COVID-19, assess symptoms, and guide individuals to appropriate care resources. OBJECTIVE: This study aims to describe the development of an RTW chatbot and report its impact on demand for OHS support services during the first Omicron variant surge. METHODS: This study was conducted at Mass General Brigham, an integrated health care system with over 80,000 employees. The RTW chatbot was developed using an agile design methodology. We mapped the RTW policy into a unified flow diagram that included all required questions and recommendations, then built and tested the chatbot using the Microsoft Azure Healthbot Framework. Using chatbot data and OHS call data from December 10, 2021, to February 17, 2022, we compared OHS resource use before and after the deployment of the RTW chatbot, including the number of calls to the OHS hotline, wait times, call length, and time OHS hotline staff spent on the phone. We also assessed Centers for Disease Control and Prevention data for COVID-19 case trends during the study period. RESULTS: In the 5 weeks post deployment, 5575 users used the RTW chatbot with a mean interaction time of 1 minute and 17 seconds. The highest engagement was on January 25, 2022, with 368 users, which was 2 weeks after the peak of the first Omicron surge in Massachusetts. Among users who completed all the chatbot questions, 461 (71.6%) met the RTW criteria. During the 10 weeks, the median (IQR) number of daily calls that OHS received before and after deployment of the chatbot were 633 (251-934) and 115 (62-167), respectively (U=163; P<.001). The median time from dialing the OHS phone number to hanging up decreased from 28 minutes and 22 seconds (IQR 25:14-31:05) to 6 minutes and 25 seconds (IQR 5:32-7:08) after chatbot deployment (U=169; P<.001). Over the 10 weeks, the median time OHS hotline staff spent on the phone declined from 3 hours and 11 minutes (IQR 2:32-4:15) per day to 47 (IQR 42-54) minutes (U=193; P<.001), saving approximately 16.8 hours per OHS staff member per week. CONCLUSIONS: Using the agile methodology, a chatbot can be rapidly designed and deployed for employees to efficiently receive guidance regarding RTW that complies with the complex and shifting RTW policies, which may reduce use of OHS resources.

A Mobile Health Application Integrated in the Electronic Health Record for Rheumatoid Arthritis Patient-Reported Outcomes: A Controlled Interrupted Time-Series Analysis of Impact on Visit Efficiency.

OBJECTIVE: Patient-reported outcome (PRO) collection between visits for rheumatoid arthritis (RA) could improve visit efficiency, reducing in-person visits for patients with stable symptoms while facilitating access for those with symptoms. We examined whether a mobile health PRO application integrated in the electronic health record (EHR) could reduce visit volume for those with RA. METHODS: We developed an application for RA that prompted patients every other day to complete brief PRO questionnaires. Results of the application were integrated into the EHR. We tested the application in a controlled interrupted time-series analysis between 2020 and 2023. Rheumatologists received EHR-based messages based on PRO results recommending the patient receive a visit earlier or later than scheduled. The primary outcome was monthly visit volume during the year before versus the year after initiation. RESULTS: A total of 150 patients with RA consented and used the application. The median age was 62 years, 83% were female, 7% had fewer than 2 years of disease, and 50% were seropositive; 150 controls were well matched. Among those in the application cohort, the estimated monthly median visit volume in the year before use of the application was 31.2 (95% confidence interval [95% CI] 28.0-34.3); in controls, this was 30.4 (95% CI 27.3-33.6). In the year using the application, the estimated monthly visit volume was 36.8 (95% CI 33.4-40.3) compared to 38.7 (95% CI 35.2-42.3) in controls. The difference in the differences between the cohorts was not statistically significant (-2.7 visits, 95% CI -9.3 to 4.0). No differences were noted in flare rates or visit delays. CONCLUSION: In this initial trial of a PRO application intervention to improve visit efficiency, we found no association with reduced visit volume.

Empathy and Equity: Key Considerations for Large Language Model Adoption in Health Care.

The growing presence of large language models (LLMs) in health care applications holds significant promise for innovative advancements in patient care. However, concerns about ethical implications and potential biases have been raised by various stakeholders. Here, we evaluate the ethics of LLMs in medicine along 2 key axes: empathy and equity. We outline the importance of these factors in novel models of care and develop frameworks for addressing these alongside LLM deployment.

The Electronic Inbox-Benefits, Questions, and Solutions for the Road Ahead.

This Viewpoint looks at digital communication between patients and physicians, including approaches to provide adequate support for these efforts that balance patient needs with appropriate time investments from clinicians.

Quality of Layperson CPR Instructions From Artificial Intelligence Voice Assistants.

This case series study evaluates responses from 4 artificial intelligence voice assistance on CPR questions from laypersons.

Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study.

BACKGROUND: Large language model (LLM)-based artificial intelligence chatbots direct the power of large training data sets toward successive, related tasks as opposed to single-ask tasks, for which artificial intelligence already achieves impressive performance. The capacity of LLMs to assist in the full scope of iterative clinical reasoning via successive prompting, in effect acting as artificial physicians, has not yet been evaluated. OBJECTIVE: This study aimed to evaluate ChatGPT's capacity for ongoing clinical decision support via its performance on standardized clinical vignettes. METHODS: We inputted all 36 published clinical vignettes from the Merck Sharpe & Dohme (MSD) Clinical Manual into ChatGPT and compared its accuracy on differential diagnoses, diagnostic testing, final diagnosis, and management based on patient age, gender, and case acuity. Accuracy was measured by the proportion of correct responses to the questions posed within the clinical vignettes tested, as calculated by human scorers. We further conducted linear regression to assess the contributing factors toward ChatGPT's performance on clinical tasks. RESULTS: ChatGPT achieved an overall accuracy of 71.7% (95% CI 69.3%-74.1%) across all 36 clinical vignettes. The LLM demonstrated the highest performance in making a final diagnosis with an accuracy of 76.9% (95% CI 67.8%-86.1%) and the lowest performance in generating an initial differential diagnosis with an accuracy of 60.3% (95% CI 54.2%-66.6%). Compared to answering questions about general medical knowledge, ChatGPT demonstrated inferior performance on differential diagnosis (ß=-15.8%; P<.001) and clinical management (ß=-7.4%; P=.02) question types. CONCLUSIONS: ChatGPT achieves impressive accuracy in clinical decision-making, with increasing strength as it gains more clinical information at its disposal. In particular, ChatGPT demonstrates the greatest accuracy in tasks of final diagnosis as compared to initial diagnosis. Limitations include possible model hallucinations and the unclear composition of ChatGPT's training data set.

Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow.

IMPORTANCE: Large language model (LLM) artificial intelligence (AI) chatbots direct the power of large training datasets towards successive, related tasks, as opposed to single-ask tasks, for which AI already achieves impressive performance. The capacity of LLMs to assist in the full scope of iterative clinical reasoning via successive prompting, in effect acting as virtual physicians, has not yet been evaluated. OBJECTIVE: To evaluate ChatGPT's capacity for ongoing clinical decision support via its performance on standardized clinical vignettes. DESIGN: We inputted all 36 published clinical vignettes from the Merck Sharpe & Dohme (MSD) Clinical Manual into ChatGPT and compared accuracy on differential diagnoses, diagnostic testing, final diagnosis, and management based on patient age, gender, and case acuity. SETTING: ChatGPT, a publicly available LLM. PARTICIPANTS: Clinical vignettes featured hypothetical patients with a variety of age and gender identities, and a range of Emergency Severity Indices (ESIs) based on initial clinical presentation. EXPOSURES: MSD Clinical Manual vignettes. MAIN OUTCOMES AND MEASURES: We measured the proportion of correct responses to the questions posed within the clinical vignettes tested. RESULTS: ChatGPT achieved 71.7% (95% CI, 69.3% to 74.1%) accuracy overall across all 36 clinical vignettes. The LLM demonstrated the highest performance in making a final diagnosis with an accuracy of 76.9% (95% CI, 67.8% to 86.1%), and the lowest performance in generating an initial differential diagnosis with an accuracy of 60.3% (95% CI, 54.2% to 66.6%). Compared to answering questions about general medical knowledge, ChatGPT demonstrated inferior performance on differential diagnosis (ß=-15.8%, p<0.001) and clinical management (ß=-7.4%, p=0.02) type questions. CONCLUSIONS AND RELEVANCE: ChatGPT achieves impressive accuracy in clinical decision making, with particular strengths emerging as it has more clinical information at its disposal.

A Pilot of Digital Whiteboards for Improving Patient Satisfaction in the Emergency Department: Nonrandomized Controlled Trial.

BACKGROUND: Electronic paper (E-paper) screens use electrophoretic ink to provide paper-like low-power displays with advanced networking capabilities that may potentially serve as an alternative to traditional whiteboards and television display screens in hospital settings. E-paper may be leveraged in the emergency department (ED) to facilitate communication. Providing ED patient status updates on E-paper screens could improve patient satisfaction and overall experience and provide more equitable access to their health information. OBJECTIVE: We aimed to pilot a patient-facing digital whiteboard using E-paper to display relevant orienting and clinical information in real time to ED patients. We also sought to assess patients' satisfaction after our intervention and understand our patients' overall perception of the impact of the digital whiteboards on their stay. METHODS: We deployed a 41-inch E-paper digital whiteboard in 4 rooms in an urban, tertiary care, and academic ED and enrolled 110 patients to understand and evaluate their experience. Participants completed a modified Hospital Consumer Assessment of Health Care Provider and Systems satisfaction questionnaire about their ED stay. We compared responses to a matched control group of patients triaged to ED rooms without digital whiteboards. We designed the digital whiteboard based on iterative feedback from various departmental stakeholders. After establishing IT infrastructure to support the project, we enrolled patients on a convenience basis into a control and an intervention (digital whiteboard) group. Enrollees were given a baseline survey to evaluate their comfort with technology and an exit survey to evaluate their opinions of the digital whiteboard and overall ED satisfaction. Statistical analysis was performed to compare baseline characteristics as well as satisfaction. RESULTS: After the successful prototyping and implementation of 4 digital whiteboards, we screened 471 patients for inclusion. We enrolled 110 patients, and 50 patients in each group (control and intervention) completed the study protocol. Age, gender, and racial and ethnic composition were similar between groups. We saw significant increases in satisfaction on postvisit surveys when patients were asked about communication regarding delays (P=.03) and what to do after discharge (P=.02). We found that patients in the intervention group were more likely to recommend the facility to family and friends (P=.04). Additionally, 96% (48/50) stated that they preferred a room with a digital whiteboard, and 70% (35/50) found the intervention "quite a bit" or "extremely" helpful in understanding their ED stay. CONCLUSIONS: Digital whiteboards are a feasible and acceptable method of displaying patient-facing data in the ED. Our pilot suggested that E-paper screens coupled with relevant, real-time clinical data and packaged together as a digital whiteboard may positively impact patient satisfaction and the perception of the facility during ED visits. Further study is needed to fully understand the impact on patient satisfaction and experience. TRIAL REGISTRATION: ClinicalTrials.gov NCT04497922; https://clinicaltrials.gov/ct2/show/NCT04497922.

Disparities in the Inclusion of Racial and Ethnic Minority Groups and Older Adults in Prostate Cancer Clinical Trials: A Meta-analysis.

Importance: Prostate cancer (PCa) is marked by disparities in clinical outcomes by race, ethnicity, and age. Equitable enrollment in clinical trials is fundamental to promoting health equity. Objective: To evaluate disparities in the inclusion of racial and ethnic minority groups and older adults across PCa clinical trials. Data Sources: MEDLINE, Embase, and ClinicalTrials.gov were searched to identify primary trial reports from each database's inception through February 2021. Global incidence in age subgroups and US population-based incidence in racial and ethnic subgroups were acquired from the Global Burden of Disease and Surveillance, Epidemiology, and End Results 21 incidence databases respectively. Study Selection: All phase 2/3 randomized PCa clinical trials were eligible for age disparity analyses. Trials recruiting exclusively from the US were eligible for primary racial and ethnic disparity analyses. Data Extraction and Synthesis: This study was reported in accordance with Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guidelines. Data were pooled using a random-effects model. Main Outcomes and Measures: Enrollment incidence ratios (EIRs), trial proportions (TPs) of participants 65 years or older or members of a racial and ethnic subgroup divided by global incidence in the corresponding age group, or US population-based incidence in the corresponding racial and ethnic subgroup, were calculated. Meta-regression was used to explore associations between trial characteristics and EIRs and trends in EIRs during the past 3 decades. Results: Of 9552 participants among trials reporting race, 954 (10.8%) were African American/Black, 80 (1.5%) were Asian/Pacific Islander, and 8518 (78.5) were White. Of 65 US trials, 45 (69.2%) reported race and only 9 (13.8%) reported data on all 5 US racial categories. Of 286 global trials, 75 (26.2%) reported the enrollment proportion of older adults. Outcomes by race and age were reported in 2 (3.1%) and 41 (15.0%) trials, respectively. Black (EIR, 0.70; 95% CI, 0.59-0.83) and Hispanic (EIR, 0.70; 95% CI, 0.59-0.83) patients were significantly underrepresented in US trials. There was no disparity in older adult representation (TP, 21 143 [71.1%]; EIR, 1.00; 95% CI, 0.95-1.05). The representation of Black patients was lower in larger trials (meta-regression coefficient, -0.06; 95% CI, -0.10 to -0.02; P = .002). Conclusions and Relevance: The results of this meta-analysis suggest that Black and Hispanic men are underrepresented in trials compared with their share of PCa incidence. The representation of Black patients has consistently remained low during the past 2 decades.

Results of a Remotely Delivered Hypertension and Lipid Program in More Than 10 000 Patients Across a Diverse Health Care Network.

Importance: Blood pressure (BP) and cholesterol control remain challenging. Remote care can deliver more effective care outside of traditional clinician-patient settings but scaling and ensuring access to care among diverse populations remains elusive. Objective: To implement and evaluate a remote hypertension and cholesterol management program across a diverse health care network. Design, Setting, and Participants: Between January 2018 and July 2021, 20 454 patients in a large integrated health network were screened; 18 444 were approached, and 10 803 were enrolled in a comprehensive remote hypertension and cholesterol program (3658 patients with hypertension, 8103 patients with cholesterol, and 958 patients with both). A total of 1266 patients requested education only without medication titration. Enrolled patients received education, home BP device integration, and medication titration. Nonlicensed navigators and pharmacists, supported by cardiovascular clinicians, coordinated care using standardized algorithms, task management and automation software, and omnichannel communication. BP and laboratory test results were actively monitored. Main Outcomes and Measures: Changes in BP and low-density lipoprotein cholesterol (LDL-C). Results: The mean (SD) age among 10 803 patients was 65 (11.4) years; 6009 participants (56%) were female; 1321 (12%) identified as Black, 1190 (11%) as Hispanic, 7758 (72%) as White, and 1727 (16%) as another or multiple races (including American Indian or Alaska Native, Asian, Native Hawaiian or Other Pacific Islander, unknown, other, and declined to respond; consolidated owing to small numbers); and 142 (11%) reported a preferred language other than English. A total of 424 482 BP readings and 139 263 laboratory reports were collected. In the hypertension program, the mean (SD) office BP prior to enrollment was 150/83 (18/10) mm Hg, and the mean (SD) home BP was 145/83 (20/12) mm Hg. For those engaged in remote medication management, the mean (SD) clinic BP 6 and 12 months after enrollment decreased by 8.7/3.8 (21.4/12.4) and 9.7/5.2 (22.2/12.6) mm Hg, respectively. In the education-only cohort, BP changed by a mean (SD) -1.5/-0.7 (23.0/11.1) and by +0.2/-1.9 (30.3/11.2) mm Hg, respectively (P < .001 for between cohort difference). In the lipids program, patients in remote medication management experienced a reduction in LDL-C by a mean (SD) 35.4 (43.1) and 37.5 (43.9) mg/dL at 6 and 12 months, respectively, while the education-only cohort experienced a mean (SD) reduction in LDL-C of 9.3 (34.3) and 10.2 (35.5) mg/dL at 6 and 12 months, respectively (P < .001). Similar rates of enrollment and reductions in BP and lipids were observed across different racial, ethnic, and primary language groups. Conclusions and Relevance: The results of this study indicate that a standardized remote BP and cholesterol management program may help optimize guideline-directed therapy at scale, reduce cardiovascular risk, and minimize the need for in-person visits among diverse populations.

Development and Testing of an Electronic Health Record-Integrated Patient-Reported Outcome Application and Intervention to Improve Efficiency of Rheumatoid Arthritis Care.

OBJECTIVE: Many patients with rheumatoid arthritis (RA) have difficulty finding clinicians to treat them because of workforce shortages. We developed an app to address this problem by improving care efficiency. The app collects patient-reported outcomes (PROs) and can be used to inform visit timing, potentially reducing the volume of low-value visits. We describe the development process, intervention design, and planned study for testing the app. METHODS: We employed user-centered design, interviewing patients and clinicians, to develop the app. To improve visit efficiency, symptom tracking logic alerts clinicians to PRO trends: worsening PROs generate alerts suggesting an earlier visit, and stable or improving PROs generate notifications that scheduled visits could be delayed. An interrupted time-series analysis with a nonrandomized control population will allow assessment of the impact of the app on visit frequency. RESULTS: Patient interviews identified several of the following needs for effective app and intervention design: the importance of a simple user interface facilitating rapid answering of PROs, the availability of condensed summary information with links to more in-depth answers to common questions regarding RA, and the need for clinicians to discuss the PRO data during visits with patients. Clinician interviews identified the following user needs: PRO data must be easy to view and use during the clinical workflow, and there should be reduced interval visits when PROs are trending worse. Some clinicians believed visits could be delayed for patients with stable PROs, whereas others raised concerns. CONCLUSION: PRO apps may improve care efficiency in rheumatology. Formal evaluation of an integrated PRO RA app is forthcoming.

User experience with a voice-enabled smartphone app to collect patient-reported outcomes in rheumatoid arthritis.

OBJECTIVES: Rheumatoid arthritis (RA) is a chronic disease, requiring frequent patient-provider interaction and self-monitoring. We developed a novel mobile health smartphone app with a voice-enabled feature to help patients virtually track disease activity and ask general questions about RA. METHODS: With a user-centered design (UCD) approach, we developed a voice-enabled app (VEA) which was then tested in two focus groups of patients (n=8) and one with providers (n=4). Voice enablement and a question and answer (Q & A) library function were previously requested by patients. Based on focus group feedback, the VEA was refined and tested with 26 patients for 56 days. The VEA asked patients to fill in daily patient-reported outcomes (PROs) and complete the trial with a satisfaction survey. RESULTS: Of the 26 patients in the VEA trial, 77% were female and 50% were aged 55 and older. Adherence to daily PROs during the 56-day trial was 66%, with <1% of PROs completed using the voice-enabled feature. PROMIS short forms and RADAI-5 PROs remained stable. Of the 22 satisfaction survey respondents, 86% were satisfied with their overall experience with the app and 18.5% were satisfied with voice enablement. The voice assistant had an 86% success rate at understanding and answering interactions regarding surveys and a 44% success rate regarding Q & A interactions. CONCLUSIONS: We developed a novel VEA through a UCD framework and conducted pilot testing. Adherence was moderate and RADAI-5 and PROMIS measures were stable. Based on satisfaction results, PROs may not be the best use of voice enablement technology.

Notes From the Field: A Voice-Activated Video Communication System for Nurses to Communicate With Inpatients With COVID-19.

With the relaxing of telehealth regulations through the Health Insurance Portability and Accountability Act (HIPAA) waiver notification for Telehealth Remote Communications during the COVID-19 Nationwide Public Health Emergency, our organization had the opportunity to pilot an innovative virtual care solution using a modified consumer-grade voice-activated video communication system (Amazon Echo Show 8) within one inpatient COVID-19 unit. In this brief report, we describe our experiences with implementing the system and general feedback from clinicians, and discuss areas for future development required to enable future scaling of this solution. Our pilot demonstrates the feasibility of deploying a consumer-grade voice assistant device in COVID-19 patient rooms. We found the devices engaging due to the voice technologies and Alexa functionalities for both clinician and patient entertainment. To enable future deployment at scale, enhancements to the Echo Show and data analytics will need to be further explored.

Real-World Analysis of Off-Label Use of Molecularly Targeted Therapy in a Large Academic Medical Center Cohort.

PURPOSE: The primary objective of this study is to quantify the use of off-label molecularly targeted therapy and describe the clinical situations in which off-label targeted therapy are used. A key secondary objective is to report the outcomes of patients treated with off-label use of targeted therapy. PATIENTS AND METHODS: We searched the electronic health record between 2000 and 2020 at our center to characterize the volume, clinical settings, and outcomes associated with off-label use of targeted therapies in different types of solid tumors. RESULTS: Among 46,712 patients who received targeted therapies, we identified 119 instances of off-label use of targeted therapy. Colon cancer was the most common cancer type to receive off-label targeted therapy in 18 patients (15.1%), followed by 13 with non-small-cell lung cancer (10.9%), eight with cholangiocarcinoma (6.7%), and seven with glioblastoma (5.9%). The most frequent molecular rationale for off-label therapy came from a comprehensive next-generation sequencing test (53.7%). The most frequently mutated gene that provided the rationale for targeted therapy was BRAF (20.1%), with BRAFV600E being the most common molecular alteration overall (15.1%). The median duration of off-label targeted therapy was 3.58 months, and the overall survival of treated patients was 7.59 months. There were 37 patients (31.1%) treated for longer than 6 months, 23 patients (19.3%) who survived ≥ 2 years, and 13 patients who were still on therapy as of June 2020. CONCLUSION: In this large cohort study of patients with solid tumors, off-label use of targeted therapy was uncommon. With that said, a notable proportion of patients had treatment durations ≥ 6 months and survivals of ≥ 2 years.

Assessing Patient Experience and Orientation in the Emergency Department with Virtual Windows.

Patients have benefitted from increasingly sophisticated diagnostic and therapeutic innovations over the years. However, the design of the physical hospital environment has garnered less attention. This may negatively impact a patient's experience and health. In areas of the hospital, such as the emergency department (ED), patients may spend hours, or even days, in a windowless environment. Studies have highlighted the importance of natural light and imagery, as they are essential in providing important stimuli to regulate circadian rhythm and orientation, and to mitigate the onset of certain medical conditions. In hospital locations where standard windows may be infeasible, the use of a virtual window may simulate the benefits of an actual window. In this pilot study, we assessed patient experience and orientation with virtual windows in the ED. We demonstrated that virtual windows are an acceptable technology that may improve patient experience and orientation.

Deploying digital health tools within large, complex health systems: key considerations for adoption and implementation.

In recent years, the number of digital health tools with the potential to significantly improve delivery of healthcare services has grown tremendously. However, the use of these tools in large, complex health systems remains comparatively limited. The adoption and implementation of digital health tools at an enterprise level is a challenge; few strategies exist to help tools cross the chasm from clinical validation to integration within the workflows of a large health system. Many previously proposed frameworks for digital health implementation are difficult to operationalize in these dynamic organizations. In this piece, we put forth nine dimensions along which clinically validated digital health tools should be examined by health systems prior to adoption, and propose strategies for selecting digital health tools and planning for implementation in this setting. By evaluating prospective tools along these dimensions, health systems can evaluate which existing digital health solutions are worthy of adoption, ensure they have sufficient resources for deployment and long-term use, and devise a strategic plan for implementation.

Coronavirus disease 2019 (COVID-19) screening system utilizing daily symptom attestation helps identify hospital employees who should be tested to protect patients and coworkers.

OBJECTIVE: To investigate the effectiveness of a daily attestation system used by employees of a multi-institutional academic medical center, which comprised of symptom-screening, self-referrals to the Occupational Health Services team, and/or a severe acute respiratory coronavirus virus 2 (SARS-CoV-2) test. DESIGN: We conducted a retrospective cohort study of all employee attestations and SARS-CoV-2 tests performed between March and June 2020. SETTING: A large multi-institutional academic medical center, including both inpatient and ambulatory settings. PARTICIPANTS: All employees who worked at the study site. METHODS: Data were combined from the attestation system (COVIDPass), the employee database, and the electronic health records and were analyzed using descriptive statistics including χ2, Wilcoxon, and Kruskal-Wallis tests. We investigated whether an association existed between symptomatic attestations by the employees and the employee testing positive for SARS-CoV-2. RESULTS: After data linkage and cleaning, there were 2,117,298 attestations submitted by 65,422 employees between March and June 2020. Most attestations were asymptomatic (99.9%). The most commonly reported symptoms were sore throat (n = 910), runny nose (n = 637), and cough (n = 570). Among the 2,026 employees who ever attested that they were symptomatic, 905 employees were tested within 14 days of a symptomatic attestation, and 114 (13%) of these tests were positive. The most common symptoms associated with a positive SARS-CoV-2 test were anosmia (23% vs 4%) and fever (46% vs 19%). CONCLUSIONS: Daily symptom attestations among healthcare workers identified a handful of employees with COVID-19. Although the number of positive tests was low, attestations may help keep unwell employees off campus to prevent transmissions.

Symptom monitoring after coronavirus disease 2019 (COVID-19) vaccination in a large integrated healthcare system: Separating symptoms from severe acute respiratory coronavirus virus 2 (SARS-CoV-2) infection.

OBJECTIVE: To describe the incidence of systemic overlap and typical coronavirus disease 2019 (COVID-19) symptoms in healthcare personnel (HCP) following COVID-19 vaccination and association of reported symptoms with diagnosis of severe acute respiratory coronavirus virus 2 (SARS-CoV-2) infection in the context of public health recommendations regarding work exclusion. DESIGN: This prospective cohort study was conducted between December 16, 2020, and March 14, 2021, with HCP who had received at least 1 dose of either the Pfizer-BioNTech or Moderna COVID-19 vaccine. SETTING: Large healthcare system in New England. INTERVENTIONS: HCP were prompted to complete a symptom survey for 3 days after each vaccination. Reported symptoms generated automated guidance regarding symptom management, SARS-CoV-2 testing requirements, and work restrictions. Overlap symptoms (ie, fever, fatigue, myalgias, arthralgias, or headache) were categorized as either lower or higher severity. Typical COVID-19 symptoms included sore throat, cough, nasal congestion or rhinorrhea, shortness of breath, ageusia and anosmia. RESULTS: Among 64,187 HCP, a postvaccination electronic survey had response rates of 83% after dose 1 and 77% after dose 2. Report of ≥3 lower-severity overlap symptoms, ≥1 higher-severity overlap symptoms, or at least 1 typical COVID-19 symptom after dose 1 was associated with increased likelihood of testing positive. HCP with prior COVID-19 infection were significantly more likely to report severe overlap symptoms after dose 1. CONCLUSIONS: Reported overlap symptoms were common; however, only report of ≥3 low-severity overlap symptoms, at least 1 higher-severity overlap symptom, or any typical COVID-19 symptom were associated with infection. Work-related restrictions for overlap symptoms should be reconsidered.