"Covering provider": an effort to streamline clinical communication chaos.

Objective: This report describes a root cause analysis of incorrect provider assignments and a standardized workflow developed to improve the clarity and accuracy of provider assignments. Materials and Methods: A multidisciplinary working group involving housestaff was assembled. Key drivers were identified using value stream mapping and fishbone analysis. A report was developed to allow for the analysis of correct provider assignments. A standardized workflow was created and piloted with a single service line. Pre- and post-pilot surveys were administered to nursing staff and participating housestaff on the unit. Results: Four key drivers were identified. A standardized workflow was created with an exclusive treatment team role in Epic held by a single provider at any given time, with a corresponding patient list column displaying provider information for each patient. Pre- and post-survey responses report decreased confusion, decreased provider identification errors, and increased user satisfaction among RNs and residents with sustained uptake over time. Conclusion: This work demonstrates structured root cause analysis, notably engaging housestaff, to develop a standardized workflow for an understudied and growing problem. The development of tools and strategies to address the widespread burdens resulting from clinical communication failures is needed.

Effect of an Electronic Health Record-Based Intervention on Documentation Practices.

Please see title page and main document for latest version of abstract.

Assessing avian influenza surveillance intensity in wild birds using a One Health lens.

Wildlife disease surveillance, particularly for pathogens with zoonotic potential such as Highly Pathogenic Avian Influenza Virus (HPAIV), is critical to facilitate situational awareness, inform risk, and guide communication and response efforts within a One Health framework. This study evaluates the intensity of avian influenza virus (AIV) surveillance in Ontario's wild bird population following the 2021 H5N1 incursion into Canada. Analyzing 2562 samples collected between November 1, 2021, and October 31, 2022, in Ontario, Canada, we identify spatial variations in surveillance intensity relative to human population density, poultry facility density, and wild mallard abundance. Using the spatial scan statistic, we pinpoint areas where public engagement, collaborations with Indigenous and non-Indigenous hunter/harvesters, and working with poultry producers, could augment Ontario's AIV wild bird surveillance program. Enhanced surveillance at these human-domestic animal-wildlife interfaces is a crucial element of a One Health approach to AIV surveillance. Ongoing assessment of our wild bird surveillance programs is essential for strategic planning and will allow us to refine approaches and generate results that continue to support the program's overarching objective of safeguarding the health of people, animals, and ecosystems.

AI-Generated Draft Replies Integrated Into Health Records and Physicians' Electronic Communication.

Importance: Timely tests are warranted to assess the association between generative artificial intelligence (GenAI) use and physicians' work efforts. Objective: To investigate the association between GenAI-drafted replies for patient messages and physician time spent on answering messages and the length of replies. Design, Setting, and Participants: Randomized waiting list quality improvement (QI) study from June to August 2023 in an academic health system. Primary care physicians were randomized to an immediate activation group and a delayed activation group. Data were analyzed from August to November 2023. Exposure: Access to GenAI-drafted replies for patient messages. Main Outcomes and Measures: Time spent (1) reading messages, (2) replying to messages, (3) length of replies, and (4) physician likelihood to recommend GenAI drafts. The a priori hypothesis was that GenAI drafts would be associated with less physician time spent reading and replying to messages. A mixed-effects model was used. Results: Fifty-two physicians participated in this QI study, with 25 randomized to the immediate activation group and 27 randomized to the delayed activation group. A contemporary control group included 70 physicians. There were 18 female participants (72.0%) in the immediate group and 17 female participants (63.0%) in the delayed group; the median age range was 35-44 years in the immediate group and 45-54 years in the delayed group. The median (IQR) time spent reading messages in the immediate group was 26 (11-69) seconds at baseline, 31 (15-70) seconds 3 weeks after entry to the intervention, and 31 (14-70) seconds 6 weeks after entry. The delayed group's median (IQR) read time was 25 (10-67) seconds at baseline, 29 (11-77) seconds during the 3-week waiting period, and 32 (15-72) seconds 3 weeks after entry to the intervention. The contemporary control group's median (IQR) read times were 21 (9-54), 22 (9-63), and 23 (9-60) seconds in corresponding periods. The estimated association of GenAI was a 21.8% increase in read time (95% CI, 5.2% to 41.0%; P = .008), a -5.9% change in reply time (95% CI, -16.6% to 6.2%; P = .33), and a 17.9% increase in reply length (95% CI, 10.1% to 26.2%; P < .001). Participants recognized GenAI's value and suggested areas for improvement. Conclusions and Relevance: In this QI study, GenAI-drafted replies were associated with significantly increased read time, no change in reply time, significantly increased reply length, and some perceived benefits. Rigorous empirical tests are necessary to further examine GenAI's performance. Future studies should examine patient experience and compare multiple GenAIs, including those with medical training.

Artificial Intelligence-Generated Draft Replies to Patient Inbox Messages.

Importance: The emergence and promise of generative artificial intelligence (AI) represent a turning point for health care. Rigorous evaluation of generative AI deployment in clinical practice is needed to inform strategic decision-making. Objective: To evaluate the implementation of a large language model used to draft responses to patient messages in the electronic inbox. Design, Setting, and Participants: A 5-week, prospective, single-group quality improvement study was conducted from July 10 through August 13, 2023, at a single academic medical center (Stanford Health Care). All attending physicians, advanced practice practitioners, clinic nurses, and clinical pharmacists from the Divisions of Primary Care and Gastroenterology and Hepatology were enrolled in the pilot. Intervention: Draft replies to patient portal messages generated by a Health Insurance Portability and Accountability Act-compliant electronic health record-integrated large language model. Main Outcomes and Measures: The primary outcome was AI-generated draft reply utilization as a percentage of total patient message replies. Secondary outcomes included changes in time measures and clinician experience as assessed by survey. Results: A total of 197 clinicians were enrolled in the pilot; 35 clinicians who were prepilot beta users, out of office, or not tied to a specific ambulatory clinic were excluded, leaving 162 clinicians included in the analysis. The survey analysis cohort consisted of 73 participants (45.1%) who completed both the presurvey and postsurvey. In gastroenterology and hepatology, there were 58 physicians and APPs and 10 nurses. In primary care, there were 83 physicians and APPs, 4 nurses, and 8 clinical pharmacists. The mean AI-generated draft response utilization rate across clinicians was 20%. There was no change in reply action time, write time, or read time between the prepilot and pilot periods. There were statistically significant reductions in the 4-item physician task load score derivative (mean [SD], 61.31 [17.23] presurvey vs 47.26 [17.11] postsurvey; paired difference, -13.87; 95% CI, -17.38 to -9.50; P < .001) and work exhaustion scores (mean [SD], 1.95 [0.79] presurvey vs 1.62 [0.68] postsurvey; paired difference, -0.33; 95% CI, -0.50 to -0.17; P < .001). Conclusions and Relevance: In this quality improvement study of an early implementation of generative AI, there was notable adoption, usability, and improvement in assessments of burden and burnout. There was no improvement in time. Further code-to-bedside testing is needed to guide future development and organizational strategy.

Drivers of telemedicine in primary care clinics at a large academic medical centre.

BACKGROUND: COVID-19 disrupted healthcare routines and prompted rapid telemedicine implementation. We investigated the drivers of visit modality selection (telemedicine versus in-person) in primary care clinics at an academic medical centre. METHODS: We used electronic medical record data from March 2020 to May 2022 from 13 primary care clinics (N = 21,031 new, N = 207,292 return visits), with 55% overall telemedicine use. Hierarchical logistic regression and cross-validation methods were used to estimate the variation in visit modality explained by the patient, clinician and visit factors as measured by the mean-test area under the curve (AUC). RESULTS: There was significant variation in telemedicine use across clinicians (ranging from 0-100%) for the same visit diagnosis. The strongest predictors of telemedicine were the clinician seen for new visits (mean AUC of 0.79) and the primary visit diagnosis for return visits (0.77). Models based on all patient characteristics combined accounted for relatively little variation in modality selection, 0.54 for new and 0.58 for return visits, respectively. Amongst patient characteristics, males, patients over 65 years, Asians and patient's with non-English language preferences used less telemedicine; however, those using interpreter services used significantly more telemedicine. CONCLUSION: Clinician seen and primary visit diagnoses were the best predictors of visit modality. The distinction between new and return visits and the minimal impact of patient characteristics on visit modality highlights the complexity of clinical care and warrants research approaches that go beyond linear models to uncover the emergent causal effects of specific technology features mediated by tasks, people and organisations.