Text vs Patient Portal Messaging to Improve Influenza Vaccination Coverage: A Health System-Wide Randomized Clinical Trial.

Importance: Increasing influenza vaccination rates is a public health priority. One method recommended by the US Centers for Disease Control and Prevention and others is for health systems to send reminders nudging patients to be vaccinated. Objective: To evaluate and compare the effect of electronic health record (EHR)-based patient portal reminders vs text message reminders on influenza vaccination rates across a health system. Design, Setting, and Participants: This 3-arm randomized clinical trial was conducted from September 7, 2022, to April 30, 2023, among primary care patients within the University of California, Los Angeles (UCLA) health system. Interventions: Arm 1 received standard of care. The health system sent monthly reminder messages to patients due for an influenza vaccine by portal (arm 2) or text (arm 3). Arm 2 had a 2 × 2 nested design, with fixed vs responsive monthly reminders and preappointment vs no preappointment reminders. Arm 3 had 1 × 2 design, with preappointment vs no preappointment reminders. Preappointment reminders for eligible patients were sent 24 and 48 hours before scheduled primary care visits. Fixed reminders (in October, November, and December) involved identical messages via portal or text. Responsive portal reminders involved a September message asking patients about their plans for vaccination, with a follow-up reminder if the response was affirmative but the patient was not yet vaccinated. Main Outcomes and Measures: The primary outcome was influenza vaccination by April 30, 2023, obtained from the UCLA EHR, including vaccination from pharmacies and other sources. Results: A total of 262 085 patients (mean [SD] age, 45.1 [20.7] years; 237 404 [90.6%] adults; 24 681 [9.4%] children; 149 349 [57.0%] women) in 79 primary care practices were included (87 257 in arm 1, 87 478 in arm 2, and 87 350 in arm 3). At the entire primary care population level, none of the interventions improved influenza vaccination rates. All groups had rates of approximately 47%. There was no statistical or clinically significant improvement following portal vs text, preappointment reminders vs no preappointment reminders (portal and text reminders combined), or responsive vs fixed monthly portal reminders. Conclusions and Relevance: At the population level, neither portal nor text reminders for influenza vaccination were effective. Given that vaccine hesitancy may be a major reason for the lack of impact of portal or text reminders, more intensive interventions by health systems are needed to raise influenza vaccination coverage levels. Trial Registration: ClinicalTrials.gov Identifier: NCT05525494.

Clinician Prompts for Human Papillomavirus Vaccination: A Cluster Randomized Trial.

OBJECTIVE: We assessed the impact of an online intervention using clinician prompts for human papillomavirus (HPV) vaccination with a cluster randomized controlled trial. METHODS: The randomized trial occurred July 2021-January 2022 in 48 primary care pediatric practices (24 intervention, 24 control) across the US. We trained clinicians via two online learning modules, plus weekly ''quick tips'' delivered via text or email. The training taught practices to implement a staff prompt to the clinician (e.g., printed reminders placed on the keyboard) plus electronic health record (EHR) prompts (if not already done) at well and acute/chronic visits for initial and subsequent HPV vaccination. We assessed missed opportunities for HPV vaccination using logistic regression models accounting for clustering by practice on an intent to treat basis. Surveys assessed facilitators and barriers to using prompts. RESULTS: During the 6-month intervention, missed opportunities for HPV vaccination increased (worsened) in both intervention and control groups. However, at well child care visits, missed opportunities for the initial HPV vaccine increased by 4.5 (95% CI: -9.0%, -0.1%) percentage points less in intervention versus control practices. Change in missed opportunities for subsequent doses at well child care and non-well child care visits did not differ between trial groups. An end-of trial survey found understaffing as a common challenge. CONCLUSIONS: Clinician prompts reduced missed opportunities for HPV vaccination at well child care visits. Understaffing related to the COVID-19 pandemic may have led to worsening missed opportunities for both groups and likely impeded practices in fully implementing changes.

Missed Opportunities for Adolescent Immunizations at Well-Care Visits During the COVID-19 Pandemic.

PURPOSE: The Coronavirus Disease 2019 pandemic disrupted healthcare, but the impact on vaccination missed opportunities (MOs, vaccine-eligible visits without vaccination) is unknown. We evaluated pandemic-related trends in MOs at adolescent well-care visits for three vaccines: human papillomavirus; quadrivalent meningococcal conjugate; and tetanus, diphtheria, and acellular pertussis (Tdap). METHODS: We analyzed electronic health record data from 24 pediatric primary care practices in 13 states from 1/1/2018 to 12/31/2021. Segmented logistic regression estimated risk differences for MOs during the pandemic relative to prepandemic trends. RESULTS: Among 106,605 well-care visits, we observed decreases in MOs prepandemic followed by an increase in MOs during the pandemic for all three vaccines. Relative to prepandemic, MOs increased for human papillomavirus (+15.9%, 95% confidence interval [CI]: 11.7%, 20.1%), meningococcal conjugate (+9.4%, 95% CI: 5.2%, 13.7%), and tetanus, diphtheria, and acellular pertussis (Tdap) (+ 8.2%, 95% CI: 4.3%, 12.1%). DISCUSSION: Increases in vaccine MOs during the pandemic equaled or exceeded pre-pandemic decreases. Reducing MOs in adolescent well-care could raise vaccine coverage.

Evaluation of behavioral economic strategies to raise influenza vaccination rates across a health system: Results from a randomized clinical trial.

Influenza vaccination rates are low. Working with a large US health system, we evaluated three health system-wide interventions using the electronic health record's patient portal to improve influenza vaccination rates. We performed a two-arm RCT with a nested factorial design within the treatment arm, randomizing patients to usual-care control (no portal interventions) or to one or more portal interventions. We included all patients within this health system during the 2020-2021 influenza vaccination season, which overlapped with the COVID-19 pandemic. Through the patient portal, we simultaneously tested: pre-commitment messages (sent September 2020, asking patients to commit to a vaccination); monthly portal reminders (October - December 2020), direct appointment scheduling (patients could self-schedule influenza vaccination at multiple sites); and pre-appointment reminder messages (sent before scheduled primary care appointments, reminding patients about influenza vaccination). The main outcome measure was receipt of influenza vaccine (10/01/2020-03/31/2021). We randomized 213,773 patients (196,070 adults ≥18 years, 17,703 children). Influenza vaccination rates overall were low (39.0%). Vaccination rates for study arms did not differ: Control (38.9%), pre-commitment vs no pre-commitment (39.2%/38.9%), direct appointment scheduling yes/no (39.1%/39.1%), pre-appointment reminders yes/no (39.1%/39.1%); p > 0.017 for all comparisons (p value cut-off adjusted for multiple comparisons). After adjusting for age, gender, insurance, race, ethnicity, and prior influenza vaccination, none of the interventions increased vaccination rates. We conclude that patient portal interventions to remind patients to receive influenza vaccine during the COVID-19 pandemic did not raise influenza immunization rates. More intensive or tailored interventions are needed beyond portal innovations to increase influenza vaccination.

Performance Feedback for Human Papillomavirus Vaccination: A Randomized Trial From the American Academy of Pediatrics Pediatric Research in Office Settings Research Network.

OBJECTIVE: To test the hypothesis that a feedback-based intervention would reduce human papillomavirus (HPV) vaccine missed opportunities. METHODS: In a longitudinal cluster randomized controlled trial of 48 pediatric primary care practices, we allocated half the practices to receive a sequential, multicomponent intervention phased over consecutive periods. In a prior trial (period 1), communication skills training reduced missed opportunities for the initial HPV vaccine dose at well visits but not at acute/chronic visits. The current trial (period 2) evaluated the added value of performance feedback to clinicians after communication training. Performance feedback consisted of an introductory training module, weekly electronic "Quick Tips," and 3 individualized performance feedback reports to clinicians. We fit logistic regression models for the primary outcome of HPV vaccination missed opportunities using generalized estimating equations with independence working correlation, accounting for clustering at the practice level. RESULTS: Performance feedback resulted in a 3.4 (95% confidence interval [CI]: -6.8, 0.0) percentage point greater reduction in missed HPV vaccine opportunities for the intervention versus control group during acute/chronic visits for subsequent HPV vaccinations (dose 2 or 3). However, during well visits for HPV vaccination dose #1, intervention practices increased missed opportunities (worsened) by 4.2 (95% CI: 1.0, 7.4) percentage points more than control practices, reducing the prior period 1 improvements and blunting the overall effect of performance feedback. We did not observe differences for the other visit/dose categories. CONCLUSIONS: Performance feedback improved HPV vaccination for one subset of visits (acute/chronic, subsequent HPV vaccinations due), but not for well visits.

Perspectives on Maternal Vaccination from Obstetrical Clinicians: A Qualitative Multi-site Study.

OBJECTIVES: Despite the seriousness of influenza and pertussis, availability of safe and effective vaccines against them, and long-standing maternal vaccination recommendations, US maternal influenza and Tdap vaccination rates have been low. To increase vaccination rates in obstetric offices, it is important to understand clinician perspectives and office processes. We conducted in-depth interviews with nurses and providers on these topics. METHODS: Interviewees worked in obstetric offices in one-of-four participating health systems in NY and CA. We audio-recorded and transcribed 20-30-min interviews. We used predetermined categories to code interviews with Dedoose, then iteratively refined codes and identified themes. RESULTS: We conducted 20 interviews between 4/2020 and 9/2020: 13 providers (physician or nurse midwife) (5 NY, 8 CA); 7 office nurses (6 NY, 1 CA). In almost all offices, patient refusal of influenza vaccine was considered the major vaccination barrier; Tdap was often deferred by patients until post-delivery. Nurse-only visits for either vaccine were rare. Vaccination outside the office was uncommon; few offices systematically documented vaccines given elsewhere in a retrievable manner. Participants emphasized patient education as key to prenatal care, but the number of topics left little time for immunizations. Few interviewees could identify an office "immunization champion," knew their office vaccination rates, or had participated in vaccination quality improvement. Several interviewees indicated that they or another provider were good at persuading hesitant patients, but their method had not been shared with other clinicians. CONCLUSIONS FOR PRACTICE: Multiple practical barriers and maternal vaccine hesitancy limit maternal vaccination. Quality improvement strategies are needed.

Obstetric Provider Attitudes and Office Practices for Maternal Influenza and Tdap Vaccination.

Background: Although maternal vaccination with influenza and tetanus toxoid, reduced diphtheria toxoid, and acellular pertussis (Tdap) vaccines improve health outcomes for pregnant individuals and infants, maternal vaccination rates are low. This study assessed obstetric providers' attitudes and practices related to influenza and Tdap vaccination in four large health systems in New York (NY) and California (CA). Methods: We conducted a cross-sectional survey of all obstetric providers within four health systems (two in NY, two in CA) to evaluate provider attitudes and office systems used for Tdap and influenza vaccination. The survey assessed perceptions of influenza and Tdap vaccination based on the Health Belief Model, and assessed office systems (reminders, prompts, standing orders, and patient education) and communication with pregnant patients related to influenza and Tdap vaccines. Results: We had 112 responses (52% response rate) for analyses. Respondents strongly supported vaccination during pregnancy but viewed influenza disease as less of a concern for newborns than for pregnant individuals (40% vs. 67% considered influenza disease to be very significant, p < 0.001). Only 84% agreed that giving influenza vaccine in the first trimester is very safe. Patient vaccine refusal was the most commonly named barrier for both influenza and Tdap vaccination. Providers frequently used office system prompts, but did not frequently use standing orders, patient educational materials, vaccine champions, and feedback on vaccination rates. Conclusions: While most providers consider influenza and Tdap vaccination important during pregnancy, there is room for improvement in focusing on the importance of maternal vaccination to the health of the infant, and increasing the use of office systems to improve vaccination during pregnancy.

Effect of Personalized Messages Sent by a Health System's Patient Portal on Influenza Vaccination Rates: a Randomized Clinical Trial.

BACKGROUND: Adult influenza vaccination rates are low. Tailored patient reminders might raise rates. OBJECTIVE: Evaluate impact of a health system's patient portal reminders: (1) tailored to patient characteristics and (2) incorporating behavioral science strategies, on influenza vaccination rates among adults. DESIGN: Pragmatic 6-arm randomized trial across a health system during the 2019-2020 influenza vaccination season. The setting was one large health system-53 adult primary care practices. PARTICIPANTS: All adult patients who used the patient portal within 12 months, stratified by the following: young adults (18-64 years, without diabetes), older adults (≥65 years, without diabetes), and those with diabetes (≥18 years). INTERVENTIONS: Patients were randomized within strata to either (1) pre-commitment reminder alone (1 message, mid-October), (2) pre-commitment + loss frame messages, (3) pre-commitment + gain frame messages, (4) loss frame messages alone, (5) gain frame messages alone, or (6) standard of care control. Patients in the pre-commitment group were sent a message in mid-October, asking if they planned on getting an influenza vaccination. Patients in loss or gain frame groups were sent up to 3 portal reminders (late October, November, and December, if no documented influenza vaccination in the EHR) about importance and safety of influenza vaccine. MAIN MEASURES: Receipt of 1 influenza vaccine from 10/01/2019 to 03/31/2020. KEY RESULTS: 196,486 patients (145,166 young adults, 29,795 older adults, 21,525 adults with diabetes) were randomized. Influenza vaccination rates were as follows: for young adults 36.8%, for older adults 55.6%, and for diabetics 60.6%. On unadjusted and adjusted (for age, gender, insurance, race, ethnicity, and prior influenza vaccine history) analyses, influenza vaccination rates were not statistically different for any study group versus control. CONCLUSIONS: Patient reminders sent by a health system's patient portal that were tailored to patient demographics (young adults, older adults, diabetes) and that incorporated two behavioral economic messaging strategies (pre-commitment and loss/gain framing) were not effective in raising influenza vaccination rates. TRIAL REGISTRATION: This trial was registered with ClinicalTrials.gov (NCT04110314).

Effect of Training Pediatric Clinicians in Human Papillomavirus Communication Strategies on Human Papillomavirus Vaccination Rates: A Cluster Randomized Clinical Trial.

Importance: Missed opportunities for human papillomavirus (HPV) vaccination during pediatric health care visits are common. Objectives: To evaluate the effect of online communication training for clinicians on missed opportunities for HPV vaccination rates overall and at well-child care (WCC) visits and visits for acute or chronic illness (hereafter referred to as acute or chronic visits) and on adolescent HPV vaccination rates. Design, Setting, and Participants: From December 26, 2018, to July 30, 2019, a longitudinal cluster randomized clinical trial allocated practices to communication training vs standard of care in staggered 6-month periods. A total of 48 primary care pediatric practices in 19 states were recruited from the American Academy of Pediatrics Pediatric Research in Office Settings network. Participants were clinicians in intervention practices. Outcomes were evaluated for all 11- to 17-year-old adolescents attending 24 intervention practices (188 clinicians) and 24 control practices (177 clinicians). Analyses were as randomized and performed on an intent-to-treat basis, accounting for clustering by practice. Interventions: Three sequential online educational modules were developed to help participating clinicians communicate with parents about the HPV vaccine. Weekly text messages were sent to participating clinicians to reinforce learning. Statisticians were blinded to group assignment. Main Outcomes and Measures: Main outcomes were missed opportunities for HPV vaccination overall and for HPV vaccine initiation and subsequent doses at WCC and acute or chronic visits (visit-level outcome). Secondary outcomes were HPV vaccination rates (person-level outcome). Outcomes were compared during the intervention vs baseline. Results: Altogether, 122 of 188 clinicians in intervention practices participated; of these, 120, 119, and 116 clinicians completed training modules 1, 2, and 3, respectively. During the intervention period, 29 206 adolescents (14 664 girls [50.2%]; mean [SD] age, 14.2 [2.0] years) made 15 888 WCC and 28 123 acute or chronic visits to intervention practices; 33 914 adolescents (17 069 girls [50.3%]; mean [SD] age, 14.2 [2.0] years) made 17 910 WCC and 35 281 acute or chronic visits to control practices. Intervention practices reduced missed opportunities overall by 2.4 percentage points (-2.4%; 95% CI, -3.5% to -1.2%) more than controls. Intervention practices reduced missed opportunities for vaccine initiation during WCC visits by 6.8 percentage points (-6.8%; 95% CI, -9.7% to -3.9%) more than controls. The intervention had no effect on missed opportunities for subsequent doses of the HPV vaccine or at acute or chronic visits. Adolescents in intervention practices had a 3.4-percentage point (95% CI, 0.6%-6.2%) greater improvement in HPV vaccine initiation compared with adolescents in control practices. Conclusions and Relevance: This scalable, online communication training increased HPV vaccination, particularly HPV vaccine initiation at WCC visits. Results support dissemination of this intervention. Trial Registration: ClinicalTrials.gov Identifier: NCT03599557.

Centralized Reminder/Recall for Human Papillomavirus Vaccination: Findings From Two States-A Randomized Clinical Trial.

PURPOSE: Centralized reminder/recall (C-R/R) using Immunization Information Systems has been effective in increasing childhood immunization rates. Previously, C-R/R using autodialer for human papillomavirus (HPV) vaccine did not raise rates. We assessed C-R/R for HPV vaccine using other modalities and focused on younger adolescents. METHODS: We conducted a three-arm pragmatic RCT in randomly sampled primary care practices in Colorado (n = 88) and New York (n = 136), proportionate to where adolescents received care. We randomized, within practices, adolescents aged 11-14 years who had not completed the HPV vaccination series to receive C-R/R using different modalities (Colorado: autodialer, mail, or control; New York: autodialer, text, or control). Up to two reminders were sent in intervention arms for each dose needed between 2/2017 and 12/2018. RESULTS: In Colorado, no significant differences were found for series initiation (31.3% control, 31.1% autodial, 31.8% mail), with slight improvement for series completion in the autodialer arm (29.7% control, 31.1% autodialer, p = .04) but not the mail arm (30.9%, p = .06). No significant differences were found in New York for series initiation (24.1% for all arms) or completion (17.1% control, 16.9% autodial, 17.9% text). Adjusted analyses showed higher completion rates for the autodialer arm in Colorado but not for other arms. In Colorado, C-R/R reduced time to series completion by around 2 months. Cost per adolescent was $1.81 for mail; under $.40 for all other modalities. CONCLUSIONS: C-R/R has less benefit for raising HPV vaccination rates than other studies have noted for childhood immunizations, although it may quicken series completion at little cost.

A randomized controlled trial of an online immunization curriculum.

INTRODUCTION: Immunization education for physicians-in-training is crucial to address vaccine concerns in clinical practice. Vaccine education is not standardized across residency programs. The Collaboration for Vaccination Education and Research (CoVER) team developed an online curriculum for pediatric (Peds) and family medicine (FM) residents. METHODS: A cluster randomized controlled trial (RCT) was performed during the 2017-2018 academic year to evaluate the CoVER curriculum. A convenience sample of residency institutions were randomly allocated to the intervention or control group, with stratification by residency type. The intervention, the CoVER curriculum, consisted of four online modules and an in-person training guide. Control sites continued with their standard vaccine education. Pre-intervention and post-intervention surveys were emailed to residents in both groups. The primary outcomes compared between groups were changes in "vaccine knowledge," "vaccine attitudes/hesitancy," and "self-confidence" in immunization communication. The team assessing outcomes was unblinded to assignments. Hierarchical general linear model was used to adjust for residency type and residency year; residency site was modeled as a random effect. RESULTS: Overall, 1444 residents from 31 residency programs were eligible to participate (734 intervention, 710 control). The pre-intervention response rate was 730 (51%) and post-intervention was 526 (36%). Average knowledge scores increased from pre-intervention (control 53%; CoVER 53%) to post-intervention (control 58%; CoVER 60%). Increases in vaccine knowledge among FM residents were greater for CoVER compared to controls (p = 0.041). Vaccine hesitancy was more common among FM (23%) than Peds (10%) residents. In all three residency years, residents in the CoVER group showed greater increases in self-confidence in ability to discuss vaccines with parents/patients (p < 0.03) compared to control group. CONCLUSION: The CoVER curriculum is an effective model to standardize immunization education of physicians-in-training. This RCT demonstrated the effectiveness of the CoVER curriculum to improve resident confidence in their ability to discuss vaccines with parents and patients.

Prevalence and characteristics of HPV vaccine hesitancy among parents of adolescents across the US.

BACKGROUND: While many clinicians encounter parents or adolescents who refuse HPV vaccine, little is known about the prevalence of hesitancy for HPV vaccine nationally or its association with vaccination. METHODS: In April 2019, we surveyed families with adolescents 11-17 years using a national online panel (Knowledge Panel®) as the sampling frame. We assessed the prevalence of HPV vaccine hesitancy with the validated 9-item Vaccine Hesitancy Scale (VHS). We used multivariate analyses to assess demographic factors associated with HPV vaccine hesitancy. We also assessed practical barriers to receipt of HPV vaccine and the relationship between barriers and hesitancy. Finally, we evaluated the association between both HPV vaccine hesitancy and practical barriers on HPV vaccine receipt or refusal. RESULTS: 2,177 parents out of 4,185 sampled (52%) completed the survey, 2,020 qualified (lived with adolescent). Using a VHS cut-off score > 3 out of 5 points, 23% of US parents were hesitant about HPV vaccine. Hesitancy was lower among those with Hispanic ethnicity. At least one out of five parents disagreed that the HPV vaccine is beneficial for their adolescent, that the vaccine is effective, protects against HPV-related cancers, or that they followed their adolescent's health-care provider's recommendation about the vaccine. Many were concerned about vaccine side effects and the novelty of the vaccine. Adolescents living with vaccine-hesitant parents were less than one-third as likely to have received the vaccine (RR = 0.29, 95% CI 0.24, 0.35) or completed the vaccine series (RR = 0.29, 95% CI 0.23, 0.36), and were 6-fold more likely to have refused the vaccine because of parental vaccine-related concerns (RR = 6.09, 95% CI = 5.26, 7.04). Most practical barriers were independently associated with vaccine receipt but not with vaccine refusal. CONCLUSIONS: HPV vaccine hesitancy is common nationally and strongly related to both under-vaccination and vaccine refusal.

Missed opportunities for human papillomavirus vaccination at office visits during which influenza vaccine was administered: An AAP pediatric research in office settings (PROS) national primary care research network study.

INTRODUCTION: Little is known about missed opportunities (MOs) for HPV vaccination during primary care visits at which influenza vaccination is delivered. METHODS: We extracted electronic health records for HPV vaccine-eligible 11-to-17-year-olds. We assessed the proportion of visits during which an influenza vaccine was given and an HPV vaccine was due, but not given (i.e., MOs). RESULTS: Of 56,135 eligible visits, 57.5% represented MOs for HPV vaccination. MOs were more common at visits where an initial versus subsequent HPV vaccine dose was due (68.6% vs. 31.3%) and for acute/chronic and nurse-only visits compared to preventive visits (74.0% and 80.2% vs. 36.7%). In a multivariable model, MOs were more likely for the initial HPV dose and for non-preventive visits, but did not vary by patient sex/age. CONCLUSIONS: HPV vaccine MOs were common during visits where influenza vaccine was administered. Increasing simultaneous administration of HPV and influenza vaccines could increase HPV vaccine coverage.

Identifying Strategies to Reduce Missed Opportunities for HPV Vaccination in Primary Care: A Qualitative Study of Positive Deviants.

The objectives of this study were to assess the contextual factors, practice strategies, and sustainability of interventions implemented during a national quality improvement (QI) project to raise human papillomavirus (HPV) vaccination rates. We conducted semistructured interviews with positive deviant practices that successfully reduced missed opportunities by ≥20% for HPV vaccination in the prior year. We assessed leadership support, motivators, interventions used, and sustainability. Key themes related to QI teams included strong leadership support, multidisciplinary teams, having a practice champion, and a collaborative environment. Themes related to the interventions included using a presumptive bundled recommendation for all appropriate vaccines at age 11, previsit planning, and reminders for preventive visits, which were sustainable for most practices 1-year postintervention. Both internal practice-level factors (multidisciplinary teams, collaboration, and previsit planning) and organizational factors (institutional support and health system-level reminders for preventive visits) were key to a successful QI intervention to improve HPV vaccination.

Effect of State Immunization Information System Based Reminder/Recall for Influenza Vaccinations: A Randomized Trial of Autodialer, Text, and Mailed Messages.

OBJECTIVE: To evaluate the effect of different modalities of centralized reminder/recall (autodialer, text, mailed reminders) on increasing childhood influenza vaccination. STUDY DESIGN: Two simultaneous randomized clinical trials conducted from October 2017 to April 1, 2018, in New York State and Colorado. There were 61 931 children in New York (136 practices) and 23 845 children in Colorado (42 practices) who were randomized to different centralized reminder/recall modalities-4 arms in New York (autodialer, text, mailed, and no reminder control) and 3 arms in Colorado (autodialer, mailed, and no reminder control). The message content was similar across modalities. Up to 3 reminders were sent for intervention arms. The main outcome measure was receipt of ≥1 influenza vaccine. RESULTS: In New York, compared with the control arm (26.6%), postintervention influenza vaccination rates in the autodialer arm (28.0%) were 1.4 percentage points higher (adjusted risk ratio, 1.06; 95% CI, 1.02-1.10), but the rates for text (27.6%) and mail (26.8%) arms were not different from controls. In Colorado, compared with the control arm (29.9%), postintervention influenza vaccination rates for the autodialer (32.9%) and mail (31.5%) arms were 3.0 percentage points (adjusted risk ratio, 1.08; 95% CI, 1.03-1.12) and 1.6 percentage points (adjusted risk ratio, 1.06; 95% CI, 1.02-1.10) higher, respectively. Compared with the control arm, the incremental cost per additional vaccine delivered was $20 (New York) and $16 (Colorado) for autodialer messages. CONCLUSIONS: Centralized reminder/recall for childhood influenza vaccine was most effective via autodialer, less effective via mail, and not effective via text messages. The impact of each modality was modest. Compared with no reminders, the incremental cost per additional vaccine delivered was also modest for autodialer messages. TRIAL REGISTRATION: ClinicalTrials.gov: NCT03294473 and NCT03246100.

Effect of Patient Portal Reminders Sent by a Health Care System on Influenza Vaccination Rates: A Randomized Clinical Trial.

Importance: Influenza vaccination rates across the US are low. Because few practices send patient reminders for influenza vaccination, a scalable patient reminder system is needed. Objective: To evaluate the effect of patient reminders sent via a health care system's electronic health record patient portal on influenza vaccination rates. Design, Setting, and Participants: This pragmatic, 4-arm randomized clinical trial was performed from October 1, 2018, to March 31, 2019, across the UCLA (University of California, Los Angeles) health care system. A total of 164 205 patients in 52 primary care practices who had used the patient portal within 12 months were included. Interventions: Patients due for an influenza vaccine were sent a letter via the patient portal of the health care system reminding them about the importance of influenza vaccination, safety of the vaccine, and morbidity associated with influenza. Patients were randomized within primary care practices to 1 of 4 study groups (no reminder [n = 41 070] vs 1 reminder [n = 41 055], 2 reminders [n = 41 046], or 3 reminders [n = 41 034]). Main Outcomes and Measures: The primary outcome was receipt of 1 or more influenza vaccines as documented in the electronic health record, which was supplemented with influenza vaccination data from external sources (eg, pharmacies). Secondary outcomes were influenza vaccination rates among subgroups and influenza vaccinations self-reported by patients in reply to the portal-based query as having been received elsewhere. Results: A total of 164 205 patients (mean [SD] age, 46.2 [19.6] years; 95 779 [58.3%] female) were randomly allocated to 1 of the 4 study arms. In the primary analysis across all ages and not including patient self-reported vaccinations in reply to portal reminders, influenza vaccination rates were 37.5% for those receiving no reminders, 38.0% for those receiving 1 reminder (P = .008 vs no reminder), 38.2% for those receiving 2 reminders (P = .03 vs no reminder), and 38.2% for those receiving 3 reminders (P = .02 vs no reminder). In the secondary analysis not including patient self-reported vaccinations, among adults aged 18 to 64 years (vaccination rates: 32.0% in the control group, 32.8% in the 1-reminder group, 32.8% in the 2-reminder group, and 32.8% in the 3-reminder group; P = .001), male patients (vaccination rates: 37.3% vs 38.3%, 38.6%, and 38.8%; P = .001), non-Hispanic patients (vaccination rates: 37.6% vs 38.2%, 38.3%, and 38.2%; P = .004), and those who were not vaccinated in the prior 2 years (vaccination rates: 15.3% vs 15.9%, 16.3%, and 16.1%; P < .001), vaccination rates were higher in the portal reminder groups than in the control group; the findings in these 3 subgroups mirrored the findings in the entire population. When self-reported vaccinations received elsewhere were included, influenza vaccination rates were 1.4 to 2.9 percentage points higher in the portal reminder groups, with a dose-response effect (0 reminders: 15 537 [37.8%]; 1 reminder: 16 097 [39.2%]; 2 reminders: 16 426 [40.0%]; and 3 reminders: 16 714 [40.7%]; P < .001). Conclusions and Relevance: Generic patient portal reminders were effective in minimally increasing influenza vaccination rates, but more intensive or more targeted patient motivational strategies appear to be needed. Trial Registration: ClinicalTrials.gov Identifier: NCT03666026.

Effect of State Immunization Information System Centralized Reminder and Recall on HPV Vaccination Rates.

BACKGROUND: Although autodialer centralized reminder and recall (C-R/R) from state immunization information systems (IISs) has been shown to raise childhood vaccination rates, its impact on human papillomavirus (HPV) vaccination rates is unclear. METHODS: In a 4-arm pragmatic randomized controlled trial across 2 states, we randomly selected practices representative of the specialty (pediatrics, family medicine, and health center) where children received care. Within each practice, patients 11 to 17.9 years old who had not completed their HPV vaccine series (NY: N = 30 616 in 123 practices; CO: N = 31 502 in 80 practices) were randomly assigned to receive 0, 1, 2, or 3 IIS C-R/R autodialer messages per vaccine dose. We assessed HPV vaccine receipt via the IIS, calculated intervention costs, and compared HPV vaccine series initiation and completion rates across study arms. RESULTS: In New York, HPV vaccine initiation rates ranged from 37.0% to 37.4%, and completion rates were between 29.1% and 30.1%, with no significant differences across study arms. In Colorado, HPV vaccine initiation rates ranged from 31.2% to 33.5% and were slightly higher for 1 reminder compared with none, but vaccine completion rates, ranging from 27.0% to 27.8%, were similar. On adjusted analyses in Colorado, vaccine initiation rates were slightly higher for 1 and 3 C-R/R messages (adjusted risk ratios 1.07 and 1.04, respectively); completion rates were slightly higher for 1 and 3 C-R/R messages (adjusted risk ratios 1.02 and 1.03, respectively). CONCLUSIONS: IIS-based C-R/R for HPV vaccination did not improve HPV vaccination rates in New York and increased vaccination rates slightly in Colorado.