Ambulatory antibiotic prescription rates for acute respiratory infection rebound two years after the start of the COVID-19 pandemic.

BACKGROUND: During the COVID-19 pandemic, acute respiratory infection (ARI) antibiotic prescribing in ambulatory care markedly decreased. It is unclear if antibiotic prescription rates will remain lowered. METHODS: We used trend analyses of antibiotics prescribed during and after the first wave of COVID-19 to determine whether ARI antibiotic prescribing rates in ambulatory care have remained suppressed compared to pre-COVID-19 levels. Retrospective data was used from patients with ARI or UTI diagnosis code(s) for their encounter from 298 primary care and 66 urgent care practices within four academic health systems in New York, Wisconsin, and Utah between January 2017 and June 2022. The primary measures included antibiotic prescriptions per 100 non-COVID ARI encounters, encounter volume, prescribing trends, and change from expected trend. RESULTS: At baseline, during and after the first wave, the overall ARI antibiotic prescribing rates were 54.7, 38.5, and 54.7 prescriptions per 100 encounters, respectively. ARI antibiotic prescription rates saw a statistically significant decline after COVID-19 onset (step change -15.2, 95% CI: -19.6 to -4.8). During the first wave, encounter volume decreased 29.4% and, after the first wave, remained decreased by 188%. After the first wave, ARI antibiotic prescription rates were no longer significantly suppressed from baseline (step change 0.01, 95% CI: -6.3 to 6.2). There was no significant difference between UTI antibiotic prescription rates at baseline versus the end of the observation period. CONCLUSIONS: The decline in ARI antibiotic prescribing observed after the onset of COVID-19 was temporary, not mirrored in UTI antibiotic prescribing, and does not represent a long-term change in clinician prescribing behaviors. During a period of heightened awareness of a viral cause of ARI, a substantial and clinically meaningful decrease in clinician antibiotic prescribing was observed. Future efforts in antibiotic stewardship may benefit from continued study of factors leading to this reduction and rebound in prescribing rates.

Leveraging Machine Learning to Develop Digital Engagement Phenotypes of Users in a Digital Diabetes Prevention Program: Evaluation Study.

BACKGROUND: Digital diabetes prevention programs (dDPPs) are effective "digital prescriptions" but have high attrition rates and program noncompletion. To address this, we developed a personalized automatic messaging system (PAMS) that leverages SMS text messaging and data integration into clinical workflows to increase dDPP engagement via enhanced patient-provider communication. Preliminary data showed positive results. However, further investigation is needed to determine how to optimize the tailoring of support technology such as PAMS based on a user's preferences to boost their dDPP engagement. OBJECTIVE: This study evaluates leveraging machine learning (ML) to develop digital engagement phenotypes of dDPP users and assess ML's accuracy in predicting engagement with dDPP activities. This research will be used in a PAMS optimization process to improve PAMS personalization by incorporating engagement prediction and digital phenotyping. This study aims (1) to prove the feasibility of using dDPP user-collected data to build an ML model that predicts engagement and contributes to identifying digital engagement phenotypes, (2) to describe methods for developing ML models with dDPP data sets and present preliminary results, and (3) to present preliminary data on user profiling based on ML model outputs. METHODS: Using the gradient-boosted forest model, we predicted engagement in 4 dDPP individual activities (physical activity, lessons, social activity, and weigh-ins) and general activity (engagement in any activity) based on previous short- and long-term activity in the app. The area under the receiver operating characteristic curve, the area under the precision-recall curve, and the Brier score metrics determined the performance of the model. Shapley values reflected the feature importance of the models and determined what variables informed user profiling through latent profile analysis. RESULTS: We developed 2 models using weekly and daily DPP data sets (328,821 and 704,242 records, respectively), which yielded predictive accuracies above 90%. Although both models were highly accurate, the daily model better fitted our research plan because it predicted daily changes in individual activities, which was crucial for creating the "digital phenotypes." To better understand the variables contributing to the model predictor, we calculated the Shapley values for both models to identify the features with the highest contribution to model fit; engagement with any activity in the dDPP in the last 7 days had the most predictive power. We profiled users with latent profile analysis after 2 weeks of engagement (Bayesian information criterion=-3222.46) with the dDPP and identified 6 profiles of users, including those with high engagement, minimal engagement, and attrition. CONCLUSIONS: Preliminary results demonstrate that applying ML methods with predicting power is an acceptable mechanism to tailor and optimize messaging interventions to support patient engagement and adherence to digital prescriptions. The results enable future optimization of our existing messaging platform and expansion of this methodology to other clinical domains. TRIAL REGISTRATION: ClinicalTrials.gov NCT04773834; https://www.clinicaltrials.gov/ct2/show/NCT04773834. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/26750.

Healthcare systems collaborating to implement a shared decision-making tool in the electronic health record and build evidence on its adoption and use.

Introduction: Shared decision-making (SDM) is a method of care by which patients and clinicians work together to co-create a plan of care. Electronic health record (EHR) integration of SDM tools may increase adoption of SDM. We conducted a "lightweight" integration of a freely available electronic SDM tool, CV Prevention Choice, within the EHRs of three healthcare systems. Here, we report how the healthcare systems collaborated to achieve integration. Methods: This work was conducted as part of a stepped wedge randomized pragmatic trial. CV Prevention Choice was developed using guidelines for HTML5-based web applications. Healthcare systems integrated the tool in their EHR using documentation the study team developed and refined with lessons learned after each system integrated the electronic SDM tool into their EHR. CV Prevention Choice integration populates the tool with individual patient data locally without sending protected health information between the EHR and the web. Data abstraction and secure transfer systems were developed to manage data collection to assess tool implementation and effectiveness outcomes. Results: Time to integrate CV Prevention Choice in the EHR was 12.1 weeks for the first system, 10.4 weeks for the second, and 9.7 weeks for the third. One system required two 1-hour meetings with study team members and two healthcare systems required a single 1-hour meeting. Healthcare system information technology teams collaborated by sharing information and offering improvements to documentation. Challenges included tracking CV Prevention Choice use for reporting and capture of combination medications. Data abstraction required refinements to address differences in how each healthcare system captured data elements. Conclusion: Targeted documentation on tool features and resource mapping supported collaboration of IT teams across healthcare systems, enabling them to integrate a web-based SDM tool with little additional research team effort or oversight. Their collaboration helped overcome difficulties integrating the web application and address challenges to data harmonization for trial outcome analyses.

Barriers to Implementing Registered Nurse-Driven Clinical Decision Support for Antibiotic Stewardship: Retrospective Case Study.

BACKGROUND: Up to 50% of antibiotic prescriptions for upper respiratory infections (URIs) are inappropriate. Clinical decision support (CDS) systems to mitigate unnecessary antibiotic prescriptions have been implemented into electronic health records, but their use by providers has been limited. OBJECTIVE: As a delegation protocol, we adapted a validated electronic health record-integrated clinical prediction rule (iCPR) CDS-based intervention for registered nurses (RNs), consisting of triage to identify patients with low-acuity URI followed by CDS-guided RN visits. It was implemented in February 2022 as a randomized controlled stepped-wedge trial in 43 primary and urgent care practices within 4 academic health systems in New York, Wisconsin, and Utah. While issues were pragmatically addressed as they arose, a systematic assessment of the barriers to implementation is needed to better understand and address these barriers. METHODS: We performed a retrospective case study, collecting quantitative and qualitative data regarding clinical workflows and triage-template use from expert interviews, study surveys, routine check-ins with practice personnel, and chart reviews over the first year of implementation of the iCPR intervention. Guided by the updated CFIR (Consolidated Framework for Implementation Research), we characterized the initial barriers to implementing a URI iCPR intervention for RNs in ambulatory care. CFIR constructs were coded as missing, neutral, weak, or strong implementation factors. RESULTS: Barriers were identified within all implementation domains. The strongest barriers were found in the outer setting, with those factors trickling down to impact the inner setting. Local conditions driven by COVID-19 served as one of the strongest barriers, impacting attitudes among practice staff and ultimately contributing to a work infrastructure characterized by staff changes, RN shortages and turnover, and competing responsibilities. Policies and laws regarding scope of practice of RNs varied by state and institutional application of those laws, with some allowing more clinical autonomy for RNs. This necessitated different study procedures at each study site to meet practice requirements, increasing innovation complexity. Similarly, institutional policies led to varying levels of compatibility with existing triage, rooming, and documentation workflows. These workflow conflicts were compounded by limited available resources, as well as an implementation climate of optional participation, few participation incentives, and thus low relative priority compared to other clinical duties. CONCLUSIONS: Both between and within health care systems, significant variability existed in workflows for patient intake and triage. Even in a relatively straightforward clinical workflow, workflow and cultural differences appreciably impacted intervention adoption. Takeaways from this study can be applied to other RN delegation protocol implementations of new and innovative CDS tools within existing workflows to support integration and improve uptake. When implementing a system-wide clinical care intervention, considerations must be made for variability in culture and workflows at the state, health system, practice, and individual levels. TRIAL REGISTRATION: ClinicalTrials.gov NCT04255303; https://clinicaltrials.gov/ct2/show/NCT04255303.

Construction of the Digital Health Equity-Focused Implementation Research Conceptual Model - Bridging the Divide Between Equity-focused Digital Health and Implementation Research.

Digital health implementations and investments continue to expand. As the reliance on digital health increases, it is imperative to implement technologies with inclusive and accessible approaches. A conceptual model can be used to guide equity-focused digital health implementations to improve suitability and uptake in diverse populations. The objective of this study is expand an implementation model with recommendations on the equitable implementation of new digital health technologies. The Digital Health Equity-Focused Implementation Research (DH-EquIR) conceptual model was developed based on a rigorous review of digital health implementation and health equity literature. The Equity-Focused Implementation Research for Health Programs (EquIR) model was used as a starting point and merged with digital equity and digital health implementation models. Existing theoretical frameworks and models were appraised as well as individual equity-sensitive implementation studies. Patient and program-related concepts related to digital equity, digital health implementation, and assessment of social/digital determinants of health were included. Sixty-two articles were analyzed to inform the adaption of the EquIR model for digital health. These articles included digital health equity models and frameworks, digital health implementation models and frameworks, research articles, guidelines, and concept analyses. Concepts were organized into EquIR conceptual groupings, including population health status, planning the program, designing the program, implementing the program, and equity-focused implementation outcomes. The adapted DH-EquIR conceptual model diagram was created as well as detailed tables displaying related equity concepts, evidence gaps in source articles, and analysis of existing equity-related models and tools. The DH-EquIR model serves to guide digital health developers and implementation specialists to promote the inclusion of health-equity planning in every phase of implementation. In addition, it can assist researchers and product developers to avoid repeating the mistakes that have led to inequities in the implementation of digital health across populations.

Mixed methods assessment of the influence of demographics on medical advice of ChatGPT.

OBJECTIVES: To evaluate demographic biases in diagnostic accuracy and health advice between generative artificial intelligence (AI) (ChatGPT GPT-4) and traditional symptom checkers like WebMD. MATERIALS AND METHODS: Combination symptom and demographic vignettes were developed for 27 most common symptom complaints. Standardized prompts, written from a patient perspective, with varying demographic permutations of age, sex, and race/ethnicity were entered into ChatGPT (GPT-4) between July and August 2023. In total, 3 runs of 540 ChatGPT prompts were compared to the corresponding WebMD Symptom Checker output using a mixed-methods approach. In addition to diagnostic correctness, the associated text generated by ChatGPT was analyzed for readability (using Flesch-Kincaid Grade Level) and qualitative aspects like disclaimers and demographic tailoring. RESULTS: ChatGPT matched WebMD in 91% of diagnoses, with a 24% top diagnosis match rate. Diagnostic accuracy was not significantly different across demographic groups, including age, race/ethnicity, and sex. ChatGPT's urgent care recommendations and demographic tailoring were presented significantly more to 75-year-olds versus 25-year-olds (P < .01) but were not statistically different among race/ethnicity and sex groups. The GPT text was suitable for college students, with no significant demographic variability. DISCUSSION: The use of non-health-tailored generative AI, like ChatGPT, for simple symptom-checking functions provides comparable diagnostic accuracy to commercially available symptom checkers and does not demonstrate significant demographic bias in this setting. The text accompanying differential diagnoses, however, suggests demographic tailoring that could potentially introduce bias. CONCLUSION: These results highlight the need for continued rigorous evaluation of AI-driven medical platforms, focusing on demographic biases to ensure equitable care.

Leveraging Generative AI Tools to Support the Development of Digital Solutions in Health Care Research: Case Study.

BACKGROUND: Generative artificial intelligence has the potential to revolutionize health technology product development by improving coding quality, efficiency, documentation, quality assessment and review, and troubleshooting. OBJECTIVE: This paper explores the application of a commercially available generative artificial intelligence tool (ChatGPT) to the development of a digital health behavior change intervention designed to support patient engagement in a commercial digital diabetes prevention program. METHODS: We examined the capacity, advantages, and limitations of ChatGPT to support digital product idea conceptualization, intervention content development, and the software engineering process, including software requirement generation, software design, and code production. In total, 11 evaluators, each with at least 10 years of experience in fields of study ranging from medicine and implementation science to computer science, participated in the output review process (ChatGPT vs human-generated output). All had familiarity or prior exposure to the original personalized automatic messaging system intervention. The evaluators rated the ChatGPT-produced outputs in terms of understandability, usability, novelty, relevance, completeness, and efficiency. RESULTS: Most metrics received positive scores. We identified that ChatGPT can (1) support developers to achieve high-quality products faster and (2) facilitate nontechnical communication and system understanding between technical and nontechnical team members around the development goal of rapid and easy-to-build computational solutions for medical technologies. CONCLUSIONS: ChatGPT can serve as a usable facilitator for researchers engaging in the software development life cycle, from product conceptualization to feature identification and user story development to code generation. TRIAL REGISTRATION: ClinicalTrials.gov NCT04049500; https://clinicaltrials.gov/ct2/show/NCT04049500.

Quantifying the impact of telemedicine and patient medical advice request messages on physicians' work-outside-work.

The COVID-19 pandemic has boosted digital health utilization, raising concerns about increased physicians' after-hours clinical work ("work-outside-work"). The surge in patients' digital messages and additional time spent on work-outside-work by telemedicine providers underscores the need to evaluate the connection between digital health utilization and physicians' after-hours commitments. We examined the impact on physicians' workload from two types of digital demands - patients' messages requesting medical advice (PMARs) sent to physicians' inbox (inbasket), and telemedicine. Our study included 1716 ambulatory-care physicians in New York City regularly practicing between November 2022 and March 2023. Regression analyses assessed primary and interaction effects of (PMARs) and telemedicine on work-outside-work. The study revealed a significant effect of PMARs on physicians' work-outside-work and that this relationship is moderated by physicians' specialties. Non-primary care physicians or specialists experienced a more pronounced effect than their primary care peers. Analysis of their telemedicine load revealed that primary care physicians received fewer PMARs and spent less time in work-outside-work with more telemedicine. Specialists faced increased PMARs and did more work-outside-work as telemedicine visits increased which could be due to the difference in patient panels. Reducing PMAR volumes and efficient inbasket management strategies needed to reduce physicians' work-outside-work. Policymakers need to be cognizant of potential disruptions in physicians carefully balanced workload caused by the digital health services.

Implementing a Clinical Decision Support Tool to Improve Physical Activity.

BACKGROUND: Currently, only about half of U.S. adults achieve current physical activity guidelines. Routine physical activity is not regularly assessed, nor are patients routinely counseled by their healthcare provider on achieving recommended levels. The three-question physical activity vital sign (PAVS) was developed to assess physical activity duration and intensity and identify adults not meeting physical activity guidelines. Clinical decision support provided via a best practice advisory in an electronic health record (EHR) system can be triggered as a prompt, reminding healthcare providers to implement the best practice intervention when appropriate. Remote patient monitoring of physical activity can provide objective data in the EHR. OBJECTIVES: This study aimed to evaluate the feasibility and clinical utility of embedding the PAVS and a triggered best practice advisor into the EHR in an ambulatory preventive cardiology practice setting to alert providers to patients reporting low physical activity and prompt healthcare providers to counsel these patients as needed. METHODS: Three components based in the EHR were integrated for the purpose of this study: Patients completed the PAVS through their electronic patient portal prior to an office visit, a best practice advisory was created to prompt providers to counsel patients who reported low levels of physical activity, and remote patient monitoring via Fitbit synced to the EHR provided objective physical activity data. The intervention was pilot-tested in the Epic EHR for 1 year (July 1, 2021 to June 30, 2022). Qualitative feedback on the intervention from both providers and patients was obtained at the completion of the study. RESULTS: Monthly assessments of the use of the PAVS and best practice advisory and remote patient monitoring were completed. Patients' completion of the PAVS varied from 35% to 48% per month. The best practice advisory was signed by providers between 2% and 65% and was acknowledged by 2%-22% per month. The majority (58%) of patients were able to sync a Fitbit device to their EHR for remote monitoring. DISCUSSION: Although uptake of each component needs improvement, this pilot demonstrated the feasibility of incorporating a physical activity promotion intervention into the EHR. Qualitative feedback provided guidance for future implementation.

Reducing prescribing of antibiotics for acute respiratory infections using a frontline nurse-led EHR-Integrated clinical decision support tool: protocol for a stepped wedge randomized control trial.

BACKGROUND: Overprescribing of antibiotics for acute respiratory infections (ARIs) remains a major issue in outpatient settings. Use of clinical prediction rules (CPRs) can reduce inappropriate antibiotic prescribing but they remain underutilized by physicians and advanced practice providers. A registered nurse (RN)-led model of an electronic health record-integrated CPR (iCPR) for low-acuity ARIs may be an effective alternative to address the barriers to a physician-driven model. METHODS: Following qualitative usability testing, we will conduct a stepped-wedge practice-level cluster randomized controlled trial (RCT) examining the effect of iCPR-guided RN care for low acuity patients with ARI. The primary hypothesis to be tested is: Implementation of RN-led iCPR tools will reduce antibiotic prescribing across diverse primary care settings. Specifically, this study aims to: (1) determine the impact of iCPRs on rapid strep test and chest x-ray ordering and antibiotic prescribing rates when used by RNs; (2) examine resource use patterns and cost-effectiveness of RN visits across diverse clinical settings; (3) determine the impact of iCPR-guided care on patient satisfaction; and (4) ascertain the effect of the intervention on RN and physician burnout. DISCUSSION: This study represents an innovative approach to using an iCPR model led by RNs and specifically designed to address inappropriate antibiotic prescribing. This study has the potential to provide guidance on the effectiveness of delegating care of low-acuity patients with ARIs to RNs to increase use of iCPRs and reduce antibiotic overprescribing for ARIs in outpatient settings. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT04255303, Registered February 5 2020, https://clinicaltrials.gov/ct2/show/NCT04255303 .

Considerations for using predictive models that include race as an input variable: The case study of lung cancer screening.

Indiscriminate use of predictive models incorporating race can reinforce biases present in source data and lead to an exacerbation of health disparities. In some countries, such as the United States, there is therefore a push to remove race from prediction models; however, there are still many prediction models that use race as an input. Biomedical informaticists who are given the responsibility of using these predictive models in healthcare environments are likely to be faced with questions like how to deal with race covariates in these models. Thus, there is a need for a pragmatic framework to help model users think through how to include race in their chosen model so as to avoid inadvertently exacerbating disparities. In this paper, we use the case study of lung cancer screening to propose a simple framework to guide how model users can approach the use (or non-use) of race inputs in the predictive models they are tasked with leveraging in electronic health records and clinical workflows.

Implementing Remote Patient Monitoring of Physical Activity in Clinical Practice.

PURPOSE: Remote patient monitoring (RPM) is a tool for patients to share data collected outside of office visits. RPM uses technology and the digital transmission of data to inform clinician decision-making in patient care. Using RPM to track routine physical activity is feasible to operationalize, given contemporary consumer-grade devices that can sync to the electronic health record. Objective monitoring through RPM can be more reliable than patient self-reporting for physical activity. DESIGN AND METHODS: This article reports on four pilot studies that highlight the utility and practicality of RPM for physical activity monitoring in outpatient clinical care. Settings include endocrinology, cardiology, neurology, and pulmonology settings. RESULTS: The four pilot use cases discussed demonstrate how RPM is utilized to monitor physical activity, a shift that has broad implications for prediction, prevention, diagnosis, and management of chronic disease and rehabilitation progress. CLINICAL RELEVANCE: If RPM for physical activity is to be expanded, it will be important to consider that certain populations may face challenges when accessing digital health services. CONCLUSION: RPM technology provides an opportunity for clinicians to obtain objective feedback for monitoring progress of patients in rehabilitation settings. Nurses working in rehabilitation settings may need to provide additional patient education and support to improve uptake.

Opening the Black Box of an mHealth Patient-Reported Outcome Tool for Diabetes Self-Management: Interview Study Among Patients With Type 2 Diabetes.

BACKGROUND: Mobile health (mHealth) tools are used to collect data on patient-reported outcomes (PROs) and facilitate the assessment of patients' self-management behaviors outside the clinic environment. Despite the high availability of mHealth diabetes tools, there is a lack of understanding regarding the underlying reasons why these mHealth PRO tools succeed or fail in terms of changing patients' self-management behaviors. OBJECTIVE: This study aims to identify the factors that drive engagement with an mHealth PRO tool and facilitate patients' adoption of self-management behaviors, as well as elicit suggestions for improvement. METHODS: This qualitative study was conducted within the context of a randomized controlled trial designed to evaluate the efficacy of an mHealth PRO tool (known as i-Matter) versus usual care regarding reduction in glycated hemoglobin (HbA1c) levels and adherence to self-management behaviors at 12 months among patients with uncontrolled type 2 diabetes. Patients randomized to i-Matter participated in semistructured interviews about their experiences at the 3-, 6-, 9-, and 12-month study visits. A qualitative analysis of the interviews was conducted by 2 experienced qualitative researchers using conventional qualitative content analysis. RESULTS: The sample comprised 71 patients, of whom 67 (94%) completed at least one interview (n=48, 72% female patients; n=25, 37% identified as African American or Black; mean age 56.65 [SD 9.79] years). We identified 4 overarching themes and 6 subthemes. Theme 1 showed that the patients' reasons for engagement with i-Matter were multifactorial. Patients were driven by internal motivating factors that bolstered their engagement and helped them feel accountable for their diabetes (subtheme 1) and external motivating factors that helped to serve as reminders to be consistent with their self-management behaviors (subtheme 2). Theme 2 revealed that the use of i-Matter changed patients' attitudes toward their disease and their health behaviors in 2 ways: patients developed more positive attitudes about their condition and their ability to effectively self-manage it (subtheme 3), and they also developed a better awareness of their current behaviors, which motivated them to adopt healthier lifestyle behaviors (subtheme 4). Theme 3 showed that patients felt more committed to their health as a result of using i-Matter. Theme 4 highlighted the limitations of i-Matter, which included its technical design (subtheme 5) and the need for more resources to support the PRO data collected and shared through the tool (subtheme 6). CONCLUSIONS: This study isolated internal and external factors that prompted patients to change their views about their diabetes, become more engaged with the intervention and their health, and adopt healthy behaviors. These behavioral mechanisms provide important insights to drive future development of mHealth interventions that could lead to sustained behavior change.

The Impact of an Electronic Best Practice Advisory on Patients' Physical Activity and Cardiovascular Risk Profile.

BACKGROUND: Regular physical activity (PA) is a component of cardiovascular health and is associated with a lower risk of cardiovascular disease (CVD). However, only about half of US adults achieved the current PA recommendations. OBJECTIVE: The study purpose was to implement PA counseling using a clinical decision support tool in a preventive cardiology clinic and to assess changes in CVD risk factors in a sample of patients enrolled over 12 weeks of PA monitoring. METHODS: This intervention, piloted for 1 year, had 3 components embedded in the electronic health record: assessment of patients' PA, an electronic prompt for providers to counsel patients reporting low PA, and patient monitoring using a Fitbit. Cardiovascular disease risk factors included PA (self-report and Fitbit), body mass index, blood pressure, lipids, and cardiorespiratory fitness assessed with the 6-minute walk test. Depression and quality of life were also assessed. Paired t tests assessed changes in CVD risk. RESULTS: The sample who enrolled in the remote patient monitoring (n = 59) were primarily female (51%), White adults (76%) with a mean age of 61.13 ± 11.6 years. Self-reported PA significantly improved over 12 weeks (P = .005), but not Fitbit steps (P = .07). There was a significant improvement in cardiorespiratory fitness (469 ± 108 vs 494 ± 132 m, P = .0034), and 23 participants (42%) improved at least 25 m, signifying a clinically meaningful improvement. Only 4 participants were lost to follow-up over 12 weeks of monitoring. CONCLUSIONS: Patients may need more frequent reminders to be active after an initial counseling session, perhaps getting automated messages based on their step counts syncing to their electronic health record.

Putting ChatGPT's Medical Advice to the (Turing) Test: Survey Study.

BACKGROUND: Chatbots are being piloted to draft responses to patient questions, but patients' ability to distinguish between provider and chatbot responses and patients' trust in chatbots' functions are not well established. OBJECTIVE: This study aimed to assess the feasibility of using ChatGPT (Chat Generative Pre-trained Transformer) or a similar artificial intelligence-based chatbot for patient-provider communication. METHODS: A survey study was conducted in January 2023. Ten representative, nonadministrative patient-provider interactions were extracted from the electronic health record. Patients' questions were entered into ChatGPT with a request for the chatbot to respond using approximately the same word count as the human provider's response. In the survey, each patient question was followed by a provider- or ChatGPT-generated response. Participants were informed that 5 responses were provider generated and 5 were chatbot generated. Participants were asked-and incentivized financially-to correctly identify the response source. Participants were also asked about their trust in chatbots' functions in patient-provider communication, using a Likert scale from 1-5. RESULTS: A US-representative sample of 430 study participants aged 18 and older were recruited on Prolific, a crowdsourcing platform for academic studies. In all, 426 participants filled out the full survey. After removing participants who spent less than 3 minutes on the survey, 392 respondents remained. Overall, 53.3% (209/392) of respondents analyzed were women, and the average age was 47.1 (range 18-91) years. The correct classification of responses ranged between 49% (192/392) to 85.7% (336/392) for different questions. On average, chatbot responses were identified correctly in 65.5% (1284/1960) of the cases, and human provider responses were identified correctly in 65.1% (1276/1960) of the cases. On average, responses toward patients' trust in chatbots' functions were weakly positive (mean Likert score 3.4 out of 5), with lower trust as the health-related complexity of the task in the questions increased. CONCLUSIONS: ChatGPT responses to patient questions were weakly distinguishable from provider responses. Laypeople appear to trust the use of chatbots to answer lower-risk health questions. It is important to continue studying patient-chatbot interaction as chatbots move from administrative to more clinical roles in health care.

Leveraging Electronic Health Record Technology and Team Care to Address Medication Adherence: Protocol for a Cluster Randomized Controlled Trial.

BACKGROUND: Low medication adherence is a common cause of high blood pressure but is often unrecognized in clinical practice. Electronic data linkages between electronic health records (EHRs) and pharmacies offer the opportunity to identify low medication adherence, which can be used for interventions at the point of care. We developed a multicomponent intervention that uses linked EHR and pharmacy data to automatically identify patients with elevated blood pressure and low medication adherence. The intervention then combines team-based care with EHR-based workflows to address medication nonadherence. OBJECTIVE: This study aims to describe the design of the Leveraging EHR Technology and Team Care to Address Medication Adherence (TEAMLET) trial, which tests the effectiveness of a multicomponent intervention that leverages EHR-based data and team-based care on medication adherence among patients with hypertension. METHODS: TEAMLET is a pragmatic, cluster randomized controlled trial in which 10 primary care practices will be randomized 1:1 to the multicomponent intervention or usual care. We will include all patients with hypertension and low medication adherence who are seen at enrolled practices. The primary outcome is medication adherence, as measured by the proportion of days covered, and the secondary outcome is clinic systolic blood pressure. We will also assess intervention implementation, including adoption, acceptability, fidelity, cost, and sustainability. RESULTS: As of May 2023, we have randomized 10 primary care practices into the study, with 5 practices assigned to each arm of the trial. The enrollment for the study commenced on October 5, 2022, and the trial is currently ongoing. We anticipate patient recruitment to go through the fall of 2023 and the primary outcomes to be assessed in the fall of 2024. CONCLUSIONS: The TEAMLET trial will evaluate the effectiveness of a multicomponent intervention that leverages EHR-based data and team-based care on medication adherence. If successful, the intervention could offer a scalable approach to address inadequate blood pressure control among millions of patients with hypertension. TRIAL REGISTRATION: ClinicalTrials.gov NCT05349422; https://clinicaltrials.gov/ct2/show/NCT05349422. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/47930.