Evaluation of behavioral economic strategies to raise influenza vaccination rates across a health system: Results from a randomized clinical trial.

Influenza vaccination rates are low. Working with a large US health system, we evaluated three health system-wide interventions using the electronic health record's patient portal to improve influenza vaccination rates. We performed a two-arm RCT with a nested factorial design within the treatment arm, randomizing patients to usual-care control (no portal interventions) or to one or more portal interventions. We included all patients within this health system during the 2020-2021 influenza vaccination season, which overlapped with the COVID-19 pandemic. Through the patient portal, we simultaneously tested: pre-commitment messages (sent September 2020, asking patients to commit to a vaccination); monthly portal reminders (October - December 2020), direct appointment scheduling (patients could self-schedule influenza vaccination at multiple sites); and pre-appointment reminder messages (sent before scheduled primary care appointments, reminding patients about influenza vaccination). The main outcome measure was receipt of influenza vaccine (10/01/2020-03/31/2021). We randomized 213,773 patients (196,070 adults ≥18 years, 17,703 children). Influenza vaccination rates overall were low (39.0%). Vaccination rates for study arms did not differ: Control (38.9%), pre-commitment vs no pre-commitment (39.2%/38.9%), direct appointment scheduling yes/no (39.1%/39.1%), pre-appointment reminders yes/no (39.1%/39.1%); p > 0.017 for all comparisons (p value cut-off adjusted for multiple comparisons). After adjusting for age, gender, insurance, race, ethnicity, and prior influenza vaccination, none of the interventions increased vaccination rates. We conclude that patient portal interventions to remind patients to receive influenza vaccine during the COVID-19 pandemic did not raise influenza immunization rates. More intensive or tailored interventions are needed beyond portal innovations to increase influenza vaccination.

Effect of Personalized Messages Sent by a Health System's Patient Portal on Influenza Vaccination Rates: a Randomized Clinical Trial.

BACKGROUND: Adult influenza vaccination rates are low. Tailored patient reminders might raise rates. OBJECTIVE: Evaluate impact of a health system's patient portal reminders: (1) tailored to patient characteristics and (2) incorporating behavioral science strategies, on influenza vaccination rates among adults. DESIGN: Pragmatic 6-arm randomized trial across a health system during the 2019-2020 influenza vaccination season. The setting was one large health system-53 adult primary care practices. PARTICIPANTS: All adult patients who used the patient portal within 12 months, stratified by the following: young adults (18-64 years, without diabetes), older adults (≥65 years, without diabetes), and those with diabetes (≥18 years). INTERVENTIONS: Patients were randomized within strata to either (1) pre-commitment reminder alone (1 message, mid-October), (2) pre-commitment + loss frame messages, (3) pre-commitment + gain frame messages, (4) loss frame messages alone, (5) gain frame messages alone, or (6) standard of care control. Patients in the pre-commitment group were sent a message in mid-October, asking if they planned on getting an influenza vaccination. Patients in loss or gain frame groups were sent up to 3 portal reminders (late October, November, and December, if no documented influenza vaccination in the EHR) about importance and safety of influenza vaccine. MAIN MEASURES: Receipt of 1 influenza vaccine from 10/01/2019 to 03/31/2020. KEY RESULTS: 196,486 patients (145,166 young adults, 29,795 older adults, 21,525 adults with diabetes) were randomized. Influenza vaccination rates were as follows: for young adults 36.8%, for older adults 55.6%, and for diabetics 60.6%. On unadjusted and adjusted (for age, gender, insurance, race, ethnicity, and prior influenza vaccine history) analyses, influenza vaccination rates were not statistically different for any study group versus control. CONCLUSIONS: Patient reminders sent by a health system's patient portal that were tailored to patient demographics (young adults, older adults, diabetes) and that incorporated two behavioral economic messaging strategies (pre-commitment and loss/gain framing) were not effective in raising influenza vaccination rates. TRIAL REGISTRATION: This trial was registered with ClinicalTrials.gov (NCT04110314).

Perspectives on Maternal Vaccination from Obstetrical Clinicians: A Qualitative Multi-site Study.

OBJECTIVES: Despite the seriousness of influenza and pertussis, availability of safe and effective vaccines against them, and long-standing maternal vaccination recommendations, US maternal influenza and Tdap vaccination rates have been low. To increase vaccination rates in obstetric offices, it is important to understand clinician perspectives and office processes. We conducted in-depth interviews with nurses and providers on these topics. METHODS: Interviewees worked in obstetric offices in one-of-four participating health systems in NY and CA. We audio-recorded and transcribed 20-30-min interviews. We used predetermined categories to code interviews with Dedoose, then iteratively refined codes and identified themes. RESULTS: We conducted 20 interviews between 4/2020 and 9/2020: 13 providers (physician or nurse midwife) (5 NY, 8 CA); 7 office nurses (6 NY, 1 CA). In almost all offices, patient refusal of influenza vaccine was considered the major vaccination barrier; Tdap was often deferred by patients until post-delivery. Nurse-only visits for either vaccine were rare. Vaccination outside the office was uncommon; few offices systematically documented vaccines given elsewhere in a retrievable manner. Participants emphasized patient education as key to prenatal care, but the number of topics left little time for immunizations. Few interviewees could identify an office "immunization champion," knew their office vaccination rates, or had participated in vaccination quality improvement. Several interviewees indicated that they or another provider were good at persuading hesitant patients, but their method had not been shared with other clinicians. CONCLUSIONS FOR PRACTICE: Multiple practical barriers and maternal vaccine hesitancy limit maternal vaccination. Quality improvement strategies are needed.

Effect of State Immunization Information System Based Reminder/Recall for Influenza Vaccinations: A Randomized Trial of Autodialer, Text, and Mailed Messages.

OBJECTIVE: To evaluate the effect of different modalities of centralized reminder/recall (autodialer, text, mailed reminders) on increasing childhood influenza vaccination. STUDY DESIGN: Two simultaneous randomized clinical trials conducted from October 2017 to April 1, 2018, in New York State and Colorado. There were 61 931 children in New York (136 practices) and 23 845 children in Colorado (42 practices) who were randomized to different centralized reminder/recall modalities-4 arms in New York (autodialer, text, mailed, and no reminder control) and 3 arms in Colorado (autodialer, mailed, and no reminder control). The message content was similar across modalities. Up to 3 reminders were sent for intervention arms. The main outcome measure was receipt of ≥1 influenza vaccine. RESULTS: In New York, compared with the control arm (26.6%), postintervention influenza vaccination rates in the autodialer arm (28.0%) were 1.4 percentage points higher (adjusted risk ratio, 1.06; 95% CI, 1.02-1.10), but the rates for text (27.6%) and mail (26.8%) arms were not different from controls. In Colorado, compared with the control arm (29.9%), postintervention influenza vaccination rates for the autodialer (32.9%) and mail (31.5%) arms were 3.0 percentage points (adjusted risk ratio, 1.08; 95% CI, 1.03-1.12) and 1.6 percentage points (adjusted risk ratio, 1.06; 95% CI, 1.02-1.10) higher, respectively. Compared with the control arm, the incremental cost per additional vaccine delivered was $20 (New York) and $16 (Colorado) for autodialer messages. CONCLUSIONS: Centralized reminder/recall for childhood influenza vaccine was most effective via autodialer, less effective via mail, and not effective via text messages. The impact of each modality was modest. Compared with no reminders, the incremental cost per additional vaccine delivered was also modest for autodialer messages. TRIAL REGISTRATION: ClinicalTrials.gov: NCT03294473 and NCT03246100.

Cost effectiveness of school-located influenza vaccination programs for elementary and secondary school children.

BACKGROUND: Studies have noted variations in the cost-effectiveness of school-located influenza vaccination (SLIV), but little is known about how SLIV's cost-effectiveness may vary by targeted age group (e.g., elementary or secondary school students), or vaccine consent process (paper-based or web-based). Further, SLIV's cost-effectiveness may be impacted by its spillover effect on practice-based vaccination; prior studies have not addressed this issue. METHODS: We performed a cost-effectiveness analysis on two SLIV programs in upstate New York in 2015-2016: (a) elementary school SLIV using a stepped wedge design with schools as clusters (24 suburban and 18 urban schools) and (b) secondary school SLIV using a cluster randomized trial (16 suburban and 4 urban schools). The cost-per-additionally-vaccinated child (i.e., incremental cost-effectiveness ratio (ICER)) was estimated by dividing the incremental SLIV intervention cost by the incremental effectiveness (i.e., the additional number of vaccinated students in intervention schools compared to control schools). We performed deterministic analyses, one-way sensitivity analyses, and probabilistic analyses. RESULTS: The overall effectiveness measure (proportion of children vaccinated) was 5.7 and 5.5 percentage points higher, respectively, in intervention elementary (52.8%) and secondary schools (48.2%) than grade-matched control schools. SLIV programs vaccinated a small proportion of children in intervention elementary (5.2%) and secondary schools (2.5%). In elementary and secondary schools, the ICER excluding vaccine purchase was $85.71 and $86.51 per-additionally-vaccinated-child, respectively. When additionally accounting for observed spillover impact on practice-based vaccination, the ICER decreased to $80.53 in elementary schools -- decreasing substantially in secondary schools. (to $53.40). These estimates were higher than the published practice-based vaccination cost (median = $25.50, mean = $45.48). Also, these estimates were higher than our 2009-2011 urban SLIV program mean costs ($65) due to additional costs for use of a new web-based consent system ($12.97 per-additionally-vaccinated-child) and higher project coordination costs in 2015-2016. One-way sensitivity analyses showed that ICER estimates were most sensitive to the SLIV effectiveness. CONCLUSIONS: SLIV raises vaccination rates and may increase practice-based vaccination in primary care practices. While these SLIV programs are effective, to be as cost-effective as practice-based vaccination our SLIV programs would need to vaccinate more students and/or lower the costs for consent systems and project coordination. TRIAL REGISTRATION: ClinicalTrials.gov NCT02227186 (August 25, 2014), updated NCT03137667 (May 2, 2017).

Effect of an Asthma Guideline in 2 Pediatric Emergency Departments and an Urgent Care Center.

OBJECTIVES: The objective of this study was to evaluate ordering of albuterol via metered-dose inhaler with spacer (MDI-spacer), length of stay (LOS), and 72-hour return rates before and after publication of an internally developed pediatric asthma clinical practice guideline (CPG). METHODS: The internally developed CPG reflected national recommendations. It was explained at faculty meetings by a respected clinician and published on the intranet on February 6, 2012. We performed a retrospective study of visits from January 1, 2009, to October 31, 2014, by children aged 2 to 17 years with a primary diagnosis of asthma and discharged from a target site (2 pediatric emergency departments and 1 urgent care center). We excluded critical/emergent visits and those by patients who transferred to the emergency department/urgent care center from another facility or were admitted. We extracted data for 37 months before and 33 months after CPG implementation (post-CPG) using a single electronic health record system. RESULTS: Albuterol delivery via MDI-spacer increased by 33.95% (P < 0.0001) during 1-month post-CPG implementation with no significant subsequent decrease. An unexpected decline was noted for median LOS before CPG implementation (-1.24 minutes; P < 0.0001). For MDI-spacer-treated patients post-CPG, decreased median LOS was maintained and there was decreased variability of the median LOS (P < 0.001). For nebulizer-treated patients post-CPG, median LOS increased (.95 minutes; P = 0.033). No change was observed for 72-hour return rates. CONCLUSIONS: Implementation of an asthma CPG increased ordering of albuterol via MDI-spacer. The increase was sustained over time in all study sites. Decreased variability in median LOS for MDI-spacer patients was observed post-CPG. Median LOS for those treated with MDI-spacer exclusively remained unchanged in the post-CPG period, whereas post-CPG LOS increased in those who received nebulized albuterol.

Adapting an HIV Risk Reduction Curriculum: Processes and Outcomes.

Becoming a Responsible Teen (BART) is a community-based, HIV risk reduction curriculum shown to increase safer sex behaviors among African American adolescents. However, BART does not address common barriers to sexual health care access, which may limit program efficacy. We used a community-engaged adaptation process to maximize program relevance and health outcomes by incorporating a broad ecological perspective. Adolescent and staff advisory boards at a community-based organization recommended modifications (e.g., delete references to Kwanzaa, update language, localize incentives) and supported inclusion of critical on-site health services, such as sexually transmitted infection testing and condom provision. We conducted a trial of adapted BART (one session/week for 8 weeks) with 36 adolescents at two community organizations (mean age = 15.5 years, 52% female; 61% reported previous sexual intercourse). Most received on-site sexually transmitted infection testing (61%) and condoms (70%). Adolescents demonstrated significant improvements in self-efficacy for safer sexual practices (p < .02), AIDS risk knowledge (p < .001), condom knowledge (p < .001), and condom attitudes (p < .04). Adolescents and staff were satisfied with the revised curriculum and found on-site services acceptable. Based on improvements in constructs influencing behavior and the successful delivery of services essential for optimal health, future studies to assess efficacy and sustainability of the adapted curriculum appear warranted.

Influenza-Like Illness Diagnosis and Management in the Acute Care Setting.

During influenza season, acute respiratory illness due to influenza is difficult to distinguish from other influenza-like illnesses, but testing should be reserved for situations when timely results will influence management or infection control measures. Immunization status and timing of disease onset notwithstanding, a neuraminidase inhibitor should be offered immediately for certain high-risk children; neuraminidase inhibitor treatment should be considered if shorter illness is warranted or an at-risk sibling may be protected. Antipyretics and cough control may be useful. Immunization with an age-appropriate dose of an inactivated influenza vaccine is the cornerstone of prevention for health care personnel and our patients.

Brief Behavioral Intervention to Improve Adolescent Sexual Health: A Feasibility Study in the Emergency Department.

OBJECTIVE: Although emergency department (ED) visits offer an opportunity to deliver brief behavioral interventions to improve health, provision of ED-based interventions targeting adolescent sexual health is uncommon. The objectives for this study were to evaluate the feasibility and preliminary effects of a novel sexual health service intervention for adolescents. METHODS: In this cross-sectional feasibility study, sexually active patients aged 14 to 19 years presenting to a Midwestern pediatric ED were recruited to receive an intervention to improve sexual health. The intervention, based on motivational interviewing (MI), included agenda setting, exploration of behaviors, a decisional balance exercise, tailored feedback, and provision of personalized health services (including condoms, prescription for emergency contraception, urine testing for Chlamydia trachomatis and Neisseria gonorrheae, and referral to the hospital-affiliated adolescent clinic). Data were collected before and after intervention administration and at a 3-month follow-up telephone interview. Surveys assessed sexual risk behaviors, satisfaction with the intervention, health care use, and demographics. Feasibility criteria were (1) subject-rated interventionist fidelity to MI principles (Likert scale 1 [strongly agree] to 4 [strongly disagree]), (2) subject satisfaction (Likert scale 1 [not at all] to 5 [very]), and (3) session duration (minutes, recorded by the interventionist). A secondary outcome was the proportion of subjects who completed at least 1 health service. Services provided at the adolescent clinic were determined by an electronic medical record review. Comparisons of responses between sex subgroups were analyzed using Χ test. RESULTS: From August to November 2012, 69 adolescents were approached, 66 (96%) completed the screening survey, and 24 (37%) reported previous sexual activity. Of those, 20 (83%) agreed to participate. The mean (SD) age was 16.2 (1.4) years; 60% were female. Most (78%) reported that the interventionist maintained high fidelity to MI principles and most (80%) were very satisfied with the intervention. Mean (SD) intervention length was 15.7 (2.2) minutes. Most subjects (65%) accepted 1 or more health services, including 42% who completed clinic follow-up. In the ED or the referral clinic, the following services were provided to the subjects: condoms (n = 11), emergency contraception prescription (n = 5), C. trachomatis/N. gonorrheae testing (n = 4), hormonal birth control provision (n = 2), and human immunodeficiency virus testing (n = 3). Fifteen subjects (75%) were reached for the 3-month follow-up, and condom use was maintained by 67% of those reporting sexual activity. CONCLUSIONS: This study demonstrated the feasibility and potential utility of an MI-based service navigation intervention to connect youth with point-of-care services as well as resources for ongoing sexual health needs.

Cost effectiveness analysis of Year 2 of an elementary school-located influenza vaccination program-Results from a randomized controlled trial.

BACKGROUND: School-located vaccination against influenza (SLV-I) has the potential to improve current suboptimal influenza immunization coverage for U.S. school-aged children. However, little is known about SLV-I's cost-effectiveness. The objective of this study is to establish the cost-effectiveness of SLV-I based on a two-year community-based randomized controlled trial (Year 1: 2009-2010 vaccination season, an unusual H1N1 pandemic influenza season, and Year 2: 2010-2011, a more typical influenza season). METHODS: We performed a cost-effectiveness analysis on a two-year randomized controlled trial of a Western New York SLV-I program. SLV-I clinics were offered in 21 intervention elementary schools (Year 1 n = 9,027; Year 2 n = 9,145 children) with standard-of-care (no SLV-I) in control schools (Year 1 n = 4,534 (10 schools); Year 2 n = 4,796 children (11 schools)). We estimated the cost-per-vaccinated child, by dividing the incremental cost of the intervention by the incremental effectiveness (i.e., the number of additionally vaccinated students in intervention schools compared to control schools). RESULTS: In Years 1 and 2, respectively, the effectiveness measure (proportion of children vaccinated) was 11.2 and 12.0 percentage points higher in intervention (40.7 % and 40.4 %) than control schools. In year 2, the cost-per-vaccinated child excluding vaccine purchase ($59.88 in 2010 US $) consisted of three component costs: (A) the school costs ($8.25); (B) the project coordination costs ($32.33); and (C) the vendor costs excluding vaccine purchase ($16.68), summed through Monte Carlo simulation. Compared to Year 1, the two component costs (A) and (C) decreased, while the component cost (B) increased in Year 2. The cost-per-vaccinated child, excluding vaccine purchase, was $59.73 (Year 1) and $59.88 (Year 2, statistically indistinguishable from Year 1), higher than the published cost of providing influenza vaccination in medical practices ($39.54). However, taking indirect costs (e.g., averted parental costs to visit medical practices) into account, vaccination was less costly in SLV-I ($23.96 in Year 1, $24.07 in Year 2) than in medical practices. CONCLUSIONS: Our two-year trial's findings reinforced the evidence to support SLV-I as a potentially favorable system to increase childhood influenza vaccination rates in a cost-efficient way. Increased efficiencies in SLV-I are needed for a sustainable and scalable SLV-I program.

Prevalence of 3 sexually transmitted infections in a pediatric emergency department.

OBJECTIVE: This study aimed to determine the prevalence of Chlamydia trachomatis, Neisseria gonorrheae, and Trichomonas vaginalis and to describe factors associated with sexually transmitted infection (STI) in a pediatric emergency department (ED). METHODS: Adolescents aged 14 to 19 years presenting to a Midwestern pediatric ED were asked to provide urine for STI testing and complete a survey about previous sexual activity (PSA), high-risk behaviors, demographics, and visit reason (reproductive: genitourinary complaints, abdominal pain, or a female with vomiting). Comparisons between subgroups were analyzed using Χ test. RESULTS: Among 200 subjects (64% of approached), mean age was 15.6 years; 63% were female. Eleven subjects (6%; 95% confidence interval, 2.3-8.7) tested positive for 1 or more STIs: 10 for C. trachomatis (one denied PSA), 3 for T. vaginalis (all coinfected with C. trachomatis), and 1 for N. gonorrheae. Half reported PSA; of these, 71% reported 1 or more high-risk behaviors, most commonly first sex before the age of 15 years (51%) and no condom at last sex (42%). Among those with PSA and nonreproductive visit (n = 73), 11.0% had 1 or more STIs (95% confidence interval, 3.4-18.1). Two factors were associated with greater likelihood of positive STI test result, namely, reporting PSA versus no PSA (10% vs 1%, P = 0.005) and last sex within 1 month or less versus more than 1 month (20% vs 0%, P = 0.001). In this sample, none of the following characteristics were associated with STI: insurance, race, high-risk behaviors, age, or ED visit reason. CONCLUSIONS: Approximately 1 in 10 sexually active adolescent ED patients without reproductive complaints had 1 or more STIs. This suggests the need for strategies to increase STI testing for this population.

Get screened: a randomized trial of the incremental benefits of reminders, recall, and outreach on cancer screening.

BACKGROUND: Rates of breast cancer (BC) and colorectal cancer (CRC) screening are particularly low among poor and minority patients. Multifaceted interventions have been shown to improve cancer-screening rates, yet the relative impact of the specific components of these interventions has not been assessed. Identifying the specific components necessary to improve cancer-screening rates is critical to tailor interventions in resource limited environments. OBJECTIVE: To assess the relative impact of various components of the reminder, recall, and outreach (RRO) model on BC and CRC screening rates within a safety net practice. DESIGN: Pragmatic randomized trial. PARTICIPANTS: Men and women aged 50-74 years past due for CRC screen and women aged 40-74 years past due for BC screening. INTERVENTIONS: We randomized 1,008 patients to one of four groups: (1) reminder letter; (2) letter and automated telephone message (Letter + Autodial); (3) letter, automated telephone message, and point of service prompt (Letter + Autodial + Prompt); or (4) letter and personal telephone call (Letter + Personal Call). MAIN MEASURES: Documentation of mammography or colorectal cancer screening at 52 weeks following randomization. KEY RESULTS: Compared to a reminder letter alone, Letter + Personal Call was more effective at improving screening rates for BC (17.8 % vs. 27.5 %; AOR 2.2, 95 % CI 1.2-4.0) and CRC screening (12.2 % vs. 21.5 %; AOR 2.0, 95 % CI 1.1-3.9). Compared to letter alone, a Letter + Autodial + Prompt was also more effective at improving rates of BC screening (17.8 % vs. 28.2 %; AOR 2.1, 95 % CI 1.1-3.7) and CRC screening (12.2 % vs. 19.6 %; AOR 1.9, 95 % CI 1.0-3.7). Letter + Autodial was not more effective than a letter alone at improving screening rates. CONCLUSIONS: The addition of a personal telephone call or a patient-specific provider prompt were both more effective at improving mammogram and CRC screening rates compared to a reminder letter alone. The use of automated telephone calls, however, did not provide any incremental benefit to a reminder letter alone.

Patient navigation moderates emotion and information demands of cancer treatment: a qualitative analysis.

PURPOSE: Patient navigation is increasingly employed to guide patients through cancer treatment. We assessed the elements of navigation that promoted patients' involvement in treatment among patients with breast and colorectal cancer that participated in a navigation study. METHODS: We conducted qualitative analysis of 28 audiotaped and transcribed semi-structured interviews of navigated and unnavigated cancer patients. RESULTS: Themes included feeling emotionally and cognitively overwhelmed and desire for a strong patient-navigator partnership. Both participants who were navigated and those who were not felt that navigation did or could help address their emotional, informational, and communicational needs. The benefits of logistical support were cited less often. CONCLUSIONS: Findings underscore the salience of personal relationships between patients and navigators in meeting patients' emotional and informational needs.

Views on human papillomavirus vaccination: a mixed-methods study of urban youth.

While the human papillomavirus (HPV) vaccine has potential to protect against the majority of HPV-associated cancers, vaccination rates in the United States remain low. Racial/ethnic and economic disparities exist for HPV vaccination completion rates. We conducted a mixed-methods study using the theory of planned behavior framework to explore attitudes and beliefs about HPV vaccination among urban, economically disadvantaged adolescents. Fifty adolescents aged 14-18 years were recruited from community-based organizations to complete a written survey and participate in a focus group. The mean age was 15.5 ± 1.3 years; 98 % were African American or mixed race; 64 % were female; 52 % reported previous sexual intercourse; 40 % reported receipt of ≥1 HPV vaccine dose. The knowledge deficit about the HPV vaccine was profound and seemed slightly greater among males. Mothers, fathers and grandmothers were mentioned as important referents for HPV vaccination, but peers and romantic partners were not. Common barriers to vaccination were lack of awareness, anticipated side effects (i.e., pain), and concerns about vaccine safety. Characteristics associated with ≥1 vaccine dose were: having heard of the HPV vaccine versus not (65 vs. 20 %, p = 0.002) and agreeing with the statement "Most people I know would think HPV vaccine is good for your health" versus not (67 vs. 27 %, p = 0.007). Our work indicates a profound lack of awareness about HPV vaccination as well as the important influence of parents among urban, economically-disadvantaged youth. Awareness of these attitudes and beliefs can assist providers and health officials by informing specific interventions to increase vaccine uptake.

Text vs Patient Portal Messaging to Improve Influenza Vaccination Coverage: A Health System-Wide Randomized Clinical Trial.

Importance: Increasing influenza vaccination rates is a public health priority. One method recommended by the US Centers for Disease Control and Prevention and others is for health systems to send reminders nudging patients to be vaccinated. Objective: To evaluate and compare the effect of electronic health record (EHR)-based patient portal reminders vs text message reminders on influenza vaccination rates across a health system. Design, Setting, and Participants: This 3-arm randomized clinical trial was conducted from September 7, 2022, to April 30, 2023, among primary care patients within the University of California, Los Angeles (UCLA) health system. Interventions: Arm 1 received standard of care. The health system sent monthly reminder messages to patients due for an influenza vaccine by portal (arm 2) or text (arm 3). Arm 2 had a 2 × 2 nested design, with fixed vs responsive monthly reminders and preappointment vs no preappointment reminders. Arm 3 had 1 × 2 design, with preappointment vs no preappointment reminders. Preappointment reminders for eligible patients were sent 24 and 48 hours before scheduled primary care visits. Fixed reminders (in October, November, and December) involved identical messages via portal or text. Responsive portal reminders involved a September message asking patients about their plans for vaccination, with a follow-up reminder if the response was affirmative but the patient was not yet vaccinated. Main Outcomes and Measures: The primary outcome was influenza vaccination by April 30, 2023, obtained from the UCLA EHR, including vaccination from pharmacies and other sources. Results: A total of 262 085 patients (mean [SD] age, 45.1 [20.7] years; 237 404 [90.6%] adults; 24 681 [9.4%] children; 149 349 [57.0%] women) in 79 primary care practices were included (87 257 in arm 1, 87 478 in arm 2, and 87 350 in arm 3). At the entire primary care population level, none of the interventions improved influenza vaccination rates. All groups had rates of approximately 47%. There was no statistical or clinically significant improvement following portal vs text, preappointment reminders vs no preappointment reminders (portal and text reminders combined), or responsive vs fixed monthly portal reminders. Conclusions and Relevance: At the population level, neither portal nor text reminders for influenza vaccination were effective. Given that vaccine hesitancy may be a major reason for the lack of impact of portal or text reminders, more intensive interventions by health systems are needed to raise influenza vaccination coverage levels. Trial Registration: ClinicalTrials.gov Identifier: NCT05525494.

Sexual health behaviors, preferences for care, and use of health services among adolescents in pediatric emergency departments.

OBJECTIVES: The objective of this study was to describe sexual health behaviors, as well as prior use of and preferences for sexual health services among adolescents in the pediatric emergency department (ED). METHODS: In this cross-sectional study, subjects aged 14 to 19 years who presented to an urban or suburban ED from a single Midwestern hospital system completed a written survey. The survey included questions on previous sexual activity, high-risk behaviors (first sex before age 15 years, no condom at last sex, substance use at last sex, >3 partners in past 3 months, and >4 lifetime partners), and sexual health service use and preferences. Comparisons of responses between subgroups were analyzed using χ2 test. Multiple logistic regression was used to identify factors associated with high-risk behaviors. Care preferences were scored using a 4-point Likert scale; mean scores were ranked. RESULTS: Subjects included 306 adolescents (85% of approached). The mean age was 15.5 years. Almost half (45%) reported previous sexual activity, and of those, 63% reported 1 or more high-risk behaviors (most commonly first sex before age 15 years [43%] and no condom at last sex [29%]). Almost all wanted to prevent pregnancy, but only one third received birth control counseling before sexual debut, and 14% reported no contraception at last sex. Younger age was associated with 1 or more high-risk behaviors (odds ratio, 3.7; confidence interval, 1.39-9.84). Preferences for care included caring, knowledgeable providers, and low/no cost. CONCLUSIONS: Because of high prevalence of high-risk behaviors among adolescents presenting in the ED, strategies should be developed to link these patients to comprehensive sexual health care.

Performance Feedback for Human Papillomavirus Vaccination: A Randomized Trial From the American Academy of Pediatrics Pediatric Research in Office Settings Research Network.

OBJECTIVE: To test the hypothesis that a feedback-based intervention would reduce human papillomavirus (HPV) vaccine missed opportunities. METHODS: In a longitudinal cluster randomized controlled trial of 48 pediatric primary care practices, we allocated half the practices to receive a sequential, multicomponent intervention phased over consecutive periods. In a prior trial (period 1), communication skills training reduced missed opportunities for the initial HPV vaccine dose at well visits but not at acute/chronic visits. The current trial (period 2) evaluated the added value of performance feedback to clinicians after communication training. Performance feedback consisted of an introductory training module, weekly electronic "Quick Tips," and 3 individualized performance feedback reports to clinicians. We fit logistic regression models for the primary outcome of HPV vaccination missed opportunities using generalized estimating equations with independence working correlation, accounting for clustering at the practice level. RESULTS: Performance feedback resulted in a 3.4 (95% confidence interval [CI]: -6.8, 0.0) percentage point greater reduction in missed HPV vaccine opportunities for the intervention versus control group during acute/chronic visits for subsequent HPV vaccinations (dose 2 or 3). However, during well visits for HPV vaccination dose #1, intervention practices increased missed opportunities (worsened) by 4.2 (95% CI: 1.0, 7.4) percentage points more than control practices, reducing the prior period 1 improvements and blunting the overall effect of performance feedback. We did not observe differences for the other visit/dose categories. CONCLUSIONS: Performance feedback improved HPV vaccination for one subset of visits (acute/chronic, subsequent HPV vaccinations due), but not for well visits.

Missed Opportunities for Adolescent Immunizations at Well-Care Visits During the COVID-19 Pandemic.

PURPOSE: The Coronavirus Disease 2019 pandemic disrupted healthcare, but the impact on vaccination missed opportunities (MOs, vaccine-eligible visits without vaccination) is unknown. We evaluated pandemic-related trends in MOs at adolescent well-care visits for three vaccines: human papillomavirus; quadrivalent meningococcal conjugate; and tetanus, diphtheria, and acellular pertussis (Tdap). METHODS: We analyzed electronic health record data from 24 pediatric primary care practices in 13 states from 1/1/2018 to 12/31/2021. Segmented logistic regression estimated risk differences for MOs during the pandemic relative to prepandemic trends. RESULTS: Among 106,605 well-care visits, we observed decreases in MOs prepandemic followed by an increase in MOs during the pandemic for all three vaccines. Relative to prepandemic, MOs increased for human papillomavirus (+15.9%, 95% confidence interval [CI]: 11.7%, 20.1%), meningococcal conjugate (+9.4%, 95% CI: 5.2%, 13.7%), and tetanus, diphtheria, and acellular pertussis (Tdap) (+ 8.2%, 95% CI: 4.3%, 12.1%). DISCUSSION: Increases in vaccine MOs during the pandemic equaled or exceeded pre-pandemic decreases. Reducing MOs in adolescent well-care could raise vaccine coverage.

Clinician Prompts for Human Papillomavirus Vaccination: A Cluster Randomized Trial.

OBJECTIVE: We assessed the impact of an online intervention using clinician prompts for human papillomavirus (HPV) vaccination with a cluster randomized controlled trial. METHODS: The randomized trial occurred July 2021-January 2022 in 48 primary care pediatric practices (24 intervention, 24 control) across the US. We trained clinicians via two online learning modules, plus weekly ''quick tips'' delivered via text or email. The training taught practices to implement a staff prompt to the clinician (e.g., printed reminders placed on the keyboard) plus electronic health record (EHR) prompts (if not already done) at well and acute/chronic visits for initial and subsequent HPV vaccination. We assessed missed opportunities for HPV vaccination using logistic regression models accounting for clustering by practice on an intent to treat basis. Surveys assessed facilitators and barriers to using prompts. RESULTS: During the 6-month intervention, missed opportunities for HPV vaccination increased (worsened) in both intervention and control groups. However, at well child care visits, missed opportunities for the initial HPV vaccine increased by 4.5 (95% CI: -9.0%, -0.1%) percentage points less in intervention versus control practices. Change in missed opportunities for subsequent doses at well child care and non-well child care visits did not differ between trial groups. An end-of trial survey found understaffing as a common challenge. CONCLUSIONS: Clinician prompts reduced missed opportunities for HPV vaccination at well child care visits. Understaffing related to the COVID-19 pandemic may have led to worsening missed opportunities for both groups and likely impeded practices in fully implementing changes.

Assessing the acceptability and feasibility of a school-located influenza vaccination program with third-party billing in elementary schools.

This study qualitatively assesses the acceptability and feasibility of a school-located vaccination for influenza (SLIV) project that was conducted in New York State in 2009-2011, from the perspectives of project participants with different roles. Fourteen in-depth semistructured interviews with participating schools' personnel and the mass vaccinator were tape-recorded and transcribed. Interviewees were randomly selected from stratified lists and included five principals, five school nurses, two school administrators, and two lead personnel from the mass vaccinator. A content analysis of transcripts from the interviews was completed and several themes emerged. All participants generally found the SLIV project acceptable. School personnel and the vaccinator viewed the SLIV project process as feasible and beneficial. However, the vaccinator identified difficulties with third-party billing as a potential threat to sustainability.