Text vs Patient Portal Messaging to Improve Influenza Vaccination Coverage: A Health System-Wide Randomized Clinical Trial.

Importance: Increasing influenza vaccination rates is a public health priority. One method recommended by the US Centers for Disease Control and Prevention and others is for health systems to send reminders nudging patients to be vaccinated. Objective: To evaluate and compare the effect of electronic health record (EHR)-based patient portal reminders vs text message reminders on influenza vaccination rates across a health system. Design, Setting, and Participants: This 3-arm randomized clinical trial was conducted from September 7, 2022, to April 30, 2023, among primary care patients within the University of California, Los Angeles (UCLA) health system. Interventions: Arm 1 received standard of care. The health system sent monthly reminder messages to patients due for an influenza vaccine by portal (arm 2) or text (arm 3). Arm 2 had a 2 × 2 nested design, with fixed vs responsive monthly reminders and preappointment vs no preappointment reminders. Arm 3 had 1 × 2 design, with preappointment vs no preappointment reminders. Preappointment reminders for eligible patients were sent 24 and 48 hours before scheduled primary care visits. Fixed reminders (in October, November, and December) involved identical messages via portal or text. Responsive portal reminders involved a September message asking patients about their plans for vaccination, with a follow-up reminder if the response was affirmative but the patient was not yet vaccinated. Main Outcomes and Measures: The primary outcome was influenza vaccination by April 30, 2023, obtained from the UCLA EHR, including vaccination from pharmacies and other sources. Results: A total of 262 085 patients (mean [SD] age, 45.1 [20.7] years; 237 404 [90.6%] adults; 24 681 [9.4%] children; 149 349 [57.0%] women) in 79 primary care practices were included (87 257 in arm 1, 87 478 in arm 2, and 87 350 in arm 3). At the entire primary care population level, none of the interventions improved influenza vaccination rates. All groups had rates of approximately 47%. There was no statistical or clinically significant improvement following portal vs text, preappointment reminders vs no preappointment reminders (portal and text reminders combined), or responsive vs fixed monthly portal reminders. Conclusions and Relevance: At the population level, neither portal nor text reminders for influenza vaccination were effective. Given that vaccine hesitancy may be a major reason for the lack of impact of portal or text reminders, more intensive interventions by health systems are needed to raise influenza vaccination coverage levels. Trial Registration: ClinicalTrials.gov Identifier: NCT05525494.

Evaluation of behavioral economic strategies to raise influenza vaccination rates across a health system: Results from a randomized clinical trial.

Influenza vaccination rates are low. Working with a large US health system, we evaluated three health system-wide interventions using the electronic health record's patient portal to improve influenza vaccination rates. We performed a two-arm RCT with a nested factorial design within the treatment arm, randomizing patients to usual-care control (no portal interventions) or to one or more portal interventions. We included all patients within this health system during the 2020-2021 influenza vaccination season, which overlapped with the COVID-19 pandemic. Through the patient portal, we simultaneously tested: pre-commitment messages (sent September 2020, asking patients to commit to a vaccination); monthly portal reminders (October - December 2020), direct appointment scheduling (patients could self-schedule influenza vaccination at multiple sites); and pre-appointment reminder messages (sent before scheduled primary care appointments, reminding patients about influenza vaccination). The main outcome measure was receipt of influenza vaccine (10/01/2020-03/31/2021). We randomized 213,773 patients (196,070 adults ≥18 years, 17,703 children). Influenza vaccination rates overall were low (39.0%). Vaccination rates for study arms did not differ: Control (38.9%), pre-commitment vs no pre-commitment (39.2%/38.9%), direct appointment scheduling yes/no (39.1%/39.1%), pre-appointment reminders yes/no (39.1%/39.1%); p > 0.017 for all comparisons (p value cut-off adjusted for multiple comparisons). After adjusting for age, gender, insurance, race, ethnicity, and prior influenza vaccination, none of the interventions increased vaccination rates. We conclude that patient portal interventions to remind patients to receive influenza vaccine during the COVID-19 pandemic did not raise influenza immunization rates. More intensive or tailored interventions are needed beyond portal innovations to increase influenza vaccination.

Effect of Personalized Messages Sent by a Health System's Patient Portal on Influenza Vaccination Rates: a Randomized Clinical Trial.

BACKGROUND: Adult influenza vaccination rates are low. Tailored patient reminders might raise rates. OBJECTIVE: Evaluate impact of a health system's patient portal reminders: (1) tailored to patient characteristics and (2) incorporating behavioral science strategies, on influenza vaccination rates among adults. DESIGN: Pragmatic 6-arm randomized trial across a health system during the 2019-2020 influenza vaccination season. The setting was one large health system-53 adult primary care practices. PARTICIPANTS: All adult patients who used the patient portal within 12 months, stratified by the following: young adults (18-64 years, without diabetes), older adults (≥65 years, without diabetes), and those with diabetes (≥18 years). INTERVENTIONS: Patients were randomized within strata to either (1) pre-commitment reminder alone (1 message, mid-October), (2) pre-commitment + loss frame messages, (3) pre-commitment + gain frame messages, (4) loss frame messages alone, (5) gain frame messages alone, or (6) standard of care control. Patients in the pre-commitment group were sent a message in mid-October, asking if they planned on getting an influenza vaccination. Patients in loss or gain frame groups were sent up to 3 portal reminders (late October, November, and December, if no documented influenza vaccination in the EHR) about importance and safety of influenza vaccine. MAIN MEASURES: Receipt of 1 influenza vaccine from 10/01/2019 to 03/31/2020. KEY RESULTS: 196,486 patients (145,166 young adults, 29,795 older adults, 21,525 adults with diabetes) were randomized. Influenza vaccination rates were as follows: for young adults 36.8%, for older adults 55.6%, and for diabetics 60.6%. On unadjusted and adjusted (for age, gender, insurance, race, ethnicity, and prior influenza vaccine history) analyses, influenza vaccination rates were not statistically different for any study group versus control. CONCLUSIONS: Patient reminders sent by a health system's patient portal that were tailored to patient demographics (young adults, older adults, diabetes) and that incorporated two behavioral economic messaging strategies (pre-commitment and loss/gain framing) were not effective in raising influenza vaccination rates. TRIAL REGISTRATION: This trial was registered with ClinicalTrials.gov (NCT04110314).

Behavioural nudges increase COVID-19 vaccinations.

Enhancing vaccine uptake is a critical public health challenge1. Overcoming vaccine hesitancy2,3 and failure to follow through on vaccination intentions3 requires effective communication strategies3,4. Here we present two sequential randomized controlled trials to test the effect of behavioural interventions on the uptake of COVID-19 vaccines. We designed text-based reminders that make vaccination salient and easy, and delivered them to participants drawn from a healthcare system one day (first randomized controlled trial) (n = 93,354 participants; clinicaltrials number NCT04800965) and eight days (second randomized controlled trial) (n = 67,092 individuals; clinicaltrials number NCT04801524) after they received a notification of vaccine eligibility. The first reminder boosted appointment and vaccination rates within the healthcare system by 6.07 (84%) and 3.57 (26%) percentage points, respectively; the second reminder increased those outcomes by 1.65 and 1.06 percentage points, respectively. The first reminder had a greater effect when it was designed to make participants feel ownership of the vaccine dose. However, we found no evidence that combining the first reminder with a video-based information intervention designed to address vaccine hesitancy heightened its effect. We performed online studies (n = 3,181 participants) to examine vaccination intentions, which revealed patterns that diverged from those of the first randomized controlled trial; this underscores the importance of pilot-testing interventions in the field. Our findings inform the design of behavioural nudges for promoting health decisions5, and highlight the value of making vaccination easy and inducing feelings of ownership over vaccines.

Patient Portal Reminders for Pediatric Influenza Vaccinations: A Randomized Clinical Trial.

OBJECTIVES: In a large health system, we evaluated the effectiveness of electronic health record patient portal reminders in increasing pediatric influenza vaccination rates. METHODS: We conducted an intention-to-treat randomized clinical trial of 22 046 children from 6 months to <18 years of age in 53 primary care practices. Patients (or parent and/or proxies) who were active portal users were randomly assigned to receive reminder messages framed as gains or losses or no messages. They were separately randomly assigned to receive a precommitment message before the influenza season. The primary outcome was receipt of ≥1 seasonal influenza vaccinations. Additionally, children 6 months to <3 years of age due for a second influenza vaccine were randomly assigned to receive a reminder or no reminder for the second vaccination. RESULTS: First-dose influenza vaccination rates were 56.9% in the control group, 58.0% in the loss-frame reminders group (P = .07), and 58.0% in the gain-frame group (P = .47). Rates were 58.3% in the precommitment group versus 57.0% in the control group (P = .11). Adjusted risk ratios for first vaccination were 1.02 (95% confidence interval [CI]: 1.00-1.04) for loss-frame reminders, 1.01 (95% CI: 0.98-1.05) for gain-frame reminders, and 1.02 (95% CI: 1.00-1.04) for precommitment messages versus controls. Second-dose vaccination rates were 44.1% in the control group and 55.0% in the reminder group, with an adjusted risk ratio of 1.25 (95% CI: 1.07-1.45). CONCLUSIONS: Patient portal reminders for influenza vaccines in children, whether framed as gains or losses, did not increase first-dose influenza vaccination rates but were highly effective for the second dose of the vaccine.

Effect of Patient Portal Reminders Sent by a Health Care System on Influenza Vaccination Rates: A Randomized Clinical Trial.

Importance: Influenza vaccination rates across the US are low. Because few practices send patient reminders for influenza vaccination, a scalable patient reminder system is needed. Objective: To evaluate the effect of patient reminders sent via a health care system's electronic health record patient portal on influenza vaccination rates. Design, Setting, and Participants: This pragmatic, 4-arm randomized clinical trial was performed from October 1, 2018, to March 31, 2019, across the UCLA (University of California, Los Angeles) health care system. A total of 164 205 patients in 52 primary care practices who had used the patient portal within 12 months were included. Interventions: Patients due for an influenza vaccine were sent a letter via the patient portal of the health care system reminding them about the importance of influenza vaccination, safety of the vaccine, and morbidity associated with influenza. Patients were randomized within primary care practices to 1 of 4 study groups (no reminder [n = 41 070] vs 1 reminder [n = 41 055], 2 reminders [n = 41 046], or 3 reminders [n = 41 034]). Main Outcomes and Measures: The primary outcome was receipt of 1 or more influenza vaccines as documented in the electronic health record, which was supplemented with influenza vaccination data from external sources (eg, pharmacies). Secondary outcomes were influenza vaccination rates among subgroups and influenza vaccinations self-reported by patients in reply to the portal-based query as having been received elsewhere. Results: A total of 164 205 patients (mean [SD] age, 46.2 [19.6] years; 95 779 [58.3%] female) were randomly allocated to 1 of the 4 study arms. In the primary analysis across all ages and not including patient self-reported vaccinations in reply to portal reminders, influenza vaccination rates were 37.5% for those receiving no reminders, 38.0% for those receiving 1 reminder (P = .008 vs no reminder), 38.2% for those receiving 2 reminders (P = .03 vs no reminder), and 38.2% for those receiving 3 reminders (P = .02 vs no reminder). In the secondary analysis not including patient self-reported vaccinations, among adults aged 18 to 64 years (vaccination rates: 32.0% in the control group, 32.8% in the 1-reminder group, 32.8% in the 2-reminder group, and 32.8% in the 3-reminder group; P = .001), male patients (vaccination rates: 37.3% vs 38.3%, 38.6%, and 38.8%; P = .001), non-Hispanic patients (vaccination rates: 37.6% vs 38.2%, 38.3%, and 38.2%; P = .004), and those who were not vaccinated in the prior 2 years (vaccination rates: 15.3% vs 15.9%, 16.3%, and 16.1%; P < .001), vaccination rates were higher in the portal reminder groups than in the control group; the findings in these 3 subgroups mirrored the findings in the entire population. When self-reported vaccinations received elsewhere were included, influenza vaccination rates were 1.4 to 2.9 percentage points higher in the portal reminder groups, with a dose-response effect (0 reminders: 15 537 [37.8%]; 1 reminder: 16 097 [39.2%]; 2 reminders: 16 426 [40.0%]; and 3 reminders: 16 714 [40.7%]; P < .001). Conclusions and Relevance: Generic patient portal reminders were effective in minimally increasing influenza vaccination rates, but more intensive or more targeted patient motivational strategies appear to be needed. Trial Registration: ClinicalTrials.gov Identifier: NCT03666026.

Pediatric patient portal use in one health system.

OBJECTIVE: The study sought to assess, for children in one large health system, (1) characteristics of active users of the patient portal (≥1 use in prior 12 months), (2) portal use by adolescents, and (3) variations in pediatric patient portal use. MATERIALS AND METHODS: We analyzed data from the electronic health record regarding pediatric portal use during 2017-2018 across a health system (39 871 pediatric patients). RESULTS: Altogether, 63.5% of pediatric patients were active portal users. Children (proxies) who were boys, privately insured, white, and spoke English were more likely to be active users. Common uses involved messaging with physicians, medications, allergies, letters, and laboratory results. By 15 years of age, >50% of adolescents used the portal by themselves (without a proxy). Pediatric portal use varied widely across practices. DISCUSSION: Pediatric or adolescent portal use is quite high, but large variations exist. CONCLUSION: Use of the portal for pediatric care may reflect varying pediatric patient engagement.