A randomized trial of behavioral interventions yielding sustained reductions in distracted driving.

Distracted driving is responsible for nearly 1 million crashes each year in the United States alone, and a major source of driver distraction is handheld phone use. We conducted a randomized, controlled trial to compare the effectiveness of interventions designed to create sustained reductions in handheld use while driving (NCT04587609). Participants were 1,653 consenting Progressive® Snapshot® usage-based auto insurance customers ages 18 to 77 who averaged at least 2 min/h of handheld use while driving in the month prior to study invitation. They were randomly assigned to one of five arms for a 10-wk intervention period. Arm 1 (control) got education about the risks of handheld phone use, as did the other arms. Arm 2 got a free phone mount to facilitate hands-free use. Arm 3 got the mount plus a commitment exercise and tips for hands-free use. Arm 4 got the mount, commitment, and tips plus weekly goal gamification and social competition. Arm 5 was the same as Arm 4, plus offered behaviorally designed financial incentives. Postintervention, participants were monitored until the end of their insurance rating period, 25 to 65 d more. Outcome differences were measured using fractional logistic regression. Arm 4 participants, who received gamification and competition, reduced their handheld use by 20.5% relative to control (P < 0.001); Arm 5 participants, who additionally received financial incentives, reduced their use by 27.6% (P < 0.001). Both groups sustained these reductions through the end of their insurance rating period.

Development of a patient-centered text message-based platform for the self-management of interstitial cystitis/bladder pain syndrome symptoms.

OBJECTIVE: To develop a patient-centered text message-based platform that promotes self-management of symptoms of interstitial cystitis/bladder pain syndrome (IC/BPS). METHODS: Adult women with IC/BPS interested in initiating a first- or second-line treatments per American Urological Association guidelines (recategorized as "behavioral/non-pharmacologic treatments" and "oral medicines" in the 2022 version) participated in rapid cycle innovation consisting of iterative cycles of contextual inquiry, prototype design and development. We delivered treatment modules and supportive messages using an algorithm-driven interactive messaging prototype through a HIPAA-compliant texting platform. Patients provided feedback through narrative text messages and an exit interview. Feedback was analyzed qualitatively and used to iteratively revise the platform until engagement ≥ 85% and accuracy ≥ 80% were achieved. The final version consisted of four treatment module categories (patient education and behavioral modification, cognitive behavioral therapy, pelvic floor physical therapy, and guided mindfulness practices) and supportive messages delivered through an automated algorithm over 6 weeks. RESULTS: Thirty IC/BPS patients with moderate symptom bother (median IC Problem Index score 9, range 6-12) participated in five cycles of contextual inquiry. Qualitative analysis identified three overarching concepts that informed the development of the platform: preference for patient centered terms, desire to gain self-efficacy in managing symptoms, and need for provider support. Patients preferred the term "interstitial cystitis" to "bladder pain syndrome" which carried the stigma of chronic pain. Patients reported greater self-efficacy in managing symptoms through improved access to mind-body and behavioral treatment modules that helped them to gain insight into their motivations and behaviors. The concept of provider support was informed by shared decision making (patients could choose preferred treatment modules) and reduced sense of isolation (weekly check in messages to check on symptom bother). CONCLUSION: A patient centered text message-based platform may be clinically useful in the self-management of IC/BPS symptoms.

Sustained Implementation of a Multicomponent Strategy to Increase Emergency Department-Initiated Interventions for Opioid Use Disorder.

STUDY OBJECTIVE: There is strong evidence supporting emergency department (ED)-initiated buprenorphine for opioid use disorder, but less is known about how to implement this practice. Our aim was to describe implementation, maintenance, and provider adoption of a multicomponent strategy for opioid use disorder treatment in 3 urban, academic EDs. METHODS: We conducted a retrospective analysis of electronic health record data for adult patients with opioid use disorder-related visits before (March 2017 to November 2018) and after (December 2018 to July 2020) implementation. We describe patient characteristics, clinical treatment, and process measures over time and conducted an interrupted time series analysis using a patient-level multivariable logistic regression model to assess the association of the interventions with buprenorphine use and other outcomes. Finally, we report provider-level variation in prescribing after implementation. RESULTS: There were 2,665 opioid use disorder-related visits during the study period: 28% for overdose, 8% for withdrawal, and 64% for other conditions. Thirteen percent of patients received medications for opioid use disorder during or after their ED visit overall. Following intervention implementation, there were sustained increases in treatment and process measures, with a net increase in total buprenorphine of 20% in the postperiod (95% confidence interval 16% to 23%). In the adjusted patient-level model, there was an immediate increase in the probability of buprenorphine treatment of 24.5% (95% confidence interval 12.1% to 37.0%) with intervention implementation. Seventy percent of providers wrote at least 1 buprenorphine prescription, but provider-level buprenorphine prescribing ranged from 0% to 61% of opioid use disorder-related encounters. CONCLUSION: A combination of strategies to increase ED-initiated opioid use disorder treatment was associated with sustained increases in treatment and process measures. However, adoption varied widely among providers, suggesting that additional strategies are needed for broader uptake.

Telemedicine in Liver Disease and Beyond: Can the COVID-19 Crisis Lead to Action?

Evidence strongly supports that access to specialty gastroenterology or hepatology care in cirrhosis is associated with higher adherence to guideline-recommended care and improves clinical outcomes. Presently, only about one half of acute care hospitalizations for cirrhosis-related complications result in inpatient specialty care, and the current hepatology workforce cannot meet the demand of patients with liver disease nationwide, particularly in less densely populated areas and in community-based practices not affiliated with academic centers. Telemedicine, defined as the delivery of health care services at a distance using electronic means for diagnosis and treatment, holds tremendous promise to increase access to broadly specialty care. The technology is cheap and easy to use, although it is presently limited in scale by interstate licensing restrictions and reimbursement barriers. The outbreak of severe acute respiratory syndrome coronavirus 2 and coronavirus disease 2019 has, in the short term, accelerated the growth of telemedicine delivery as a public health and social distancing measure. Herein, we examine whether this public health crisis can accelerate the national conversation about broader adoption of telemedicine for routine medical care in non-crisis situations, using a case series from our telehepatology program as a pragmatic example.

Capturing Real-Time Emergency Department Sentiment: A Feasibility Study Using Touch-Button Terminals.

STUDY OBJECTIVE: Providing care in emergency departments (EDs) affects patients and providers. Providers experience high rates of work-related stress. Little is known about the feasibility of measuring real-time sentiment within busy clinical environments. We test the feasibility of measuring sentiment with touch-button terminals in an academic, urban ED. METHODS: Terminals offered a choice of 4 sentiment buttons (very positive, positive, negative, and very negative). They were placed central to physician workstations, nursing workstations, and the patient exit. Pearson correlation coefficients (r) were calculated to estimate correlation between sentiment and volume metrics (arrivals, length of stay, waiting patients, and number of boarding patients) over time. RESULTS: A total of 13,849 sentiments were recorded (June 2018 to October 2018); 9,472 came from providers (52.6% nursing) and 4,377 from patients. The majority of provider sentiments were negative (58.7%). Negative provider sentiment was associated with increasing number of patients waiting to be seen (r=0.45) and boarding (r=0.68). Positive provider sentiment was associated with increasing numbers of patients who left without being seen (r=0.48). Increased boarding was associated with more recorded sentiments (r=0.73). Negative patient sentiment was associated with increasing number waiting (r=0.55), boarding (r=0.67), and leaving without being seen (r=0.46). CONCLUSION: This study demonstrates the feasibility of a novel approach to measuring "on-shift" sentiment in real time and provides a sample comparison to traditional volume metrics.

Rideshare-Based Medical Transportation for Medicaid Patients and Primary Care Show Rates: A Difference-in-Difference Analysis of a Pilot Program.

BACKGROUND: Transportation to primary care is a well-documented barrier for patients with Medicaid, despite access to non-emergency medical transportation (NEMT) benefits. Rideshare services, which offer greater convenience and lower cost, have been proposed as an NEMT alternative. OBJECTIVE: To evaluate the impact of rideshare-based medical transportation on the proportion of Medicaid patients attending scheduled primary care appointments. DESIGN: In one of two similar practices, all eligible Medicaid patients were offered rideshare-based transportation ("rideshare practice"). A difference-in-difference analytical approach using logistic regression with robust standard errors was employed to compare show rate changes between the rideshare practice and the practice where rideshare was not offered ("control practice"). PARTICIPANTS: Our study population included residents of West Philadelphia who were insured by Medicaid and were established patients at two academic general internal medicine practices located in the same building. INTERVENTION: We designed a rideshare-based transportation pilot intervention. Patients were offered the service during their reminder call 2 days before the appointment, and rides were prescheduled by research staff. Patients then called research staff to schedule their return trip home. MAIN MEASURES: We assessed the effect of offering rideshare-based transportation on appointment show rates by comparing the change in the average show rate for the rideshare practice, from the baseline period to the intervention period, with the change at the control practice. KEY RESULTS: At the control practice, the show rate declined from 60% (146/245) to 51% (34/67). At the rideshare practice, the show rate improved from 54% (72/134) to 68% (41/60). In the adjusted model, controlling for patient demographics and provider type, the odds of showing up for an appointment before and after the intervention increased 2.57 (1.10-6.00) times more in the rideshare practice than in the control practice. CONCLUSIONS: Results of this pilot program suggest that offering a rideshare-based transportation service can increase show rates to primary care for Medicaid patients.

Effect of Outreach Messages on Medicaid Enrollment.

OBJECTIVES: To measure the impact of different outreach messages on health insurance enrollment among Medicaid-eligible adults. METHODS: Between March 2015 and April 2016, we conducted a series of experiments using mail-based outreach that encouraged individuals to enroll in Pennsylvania's expanded Medicaid program. Recipients were randomized to receive 1 of 4 different messages describing the benefits of health insurance. The primary outcome was the response rate to each letter. RESULTS: We mailed outreach letters to 32 993 adults in Philadelphia. Messages that emphasized the dental benefits of insurance were significantly more likely to result in a response than messages emphasizing the health benefits (odds ratio = 1.33; 95% confidence interval = 1.10, 1.61). CONCLUSIONS: Medicaid enrollment outreach messages that emphasized the dental benefits of insurance were more effective than those that emphasized the health-related benefits. Public Health Implications. Although the structure and eligibility of the Medicaid program are likely to change, testing and identifying successful outreach and enrollment strategies remains important. Outreach messages that emphasize dental benefits may be more effective at motivating enrollment among individuals of low socioeconomic status.

Framing Financial Incentives to Increase Physical Activity Among Overweight and Obese Adults: A Randomized, Controlled Trial.

BACKGROUND: Financial incentive designs to increase physical activity have not been well-examined. OBJECTIVE: To test the effectiveness of 3 methods to frame financial incentives to increase physical activity among overweight and obese adults. DESIGN: Randomized, controlled trial. (ClinicalTrials.gov: NCT 02030119). SETTING: University of Pennsylvania. PARTICIPANTS: 281 adult employees (body mass index ≥27 kg/m2). INTERVENTION: 13-week intervention. Participants had a goal of 7000 steps per day and were randomly assigned to a control group with daily feedback or 1 of 3 financial incentive programs with daily feedback: a gain incentive ($1.40 given each day the goal was achieved), lottery incentive (daily eligibility [expected value approximately $1.40] if goal was achieved), or loss incentive ($42 allocated monthly upfront and $1.40 removed each day the goal was not achieved). Participants were followed for another 13 weeks with daily performance feedback but no incentives. MEASUREMENTS: Primary outcome was the mean proportion of participant-days that the 7000-step goal was achieved during the intervention. Secondary outcomes included the mean proportion of participant-days achieving the goal during follow-up and the mean daily steps during intervention and follow-up. RESULTS: The mean proportion of participant-days achieving the goal was 0.30 (95% CI, 0.22 to 0.37) in the control group, 0.35 (CI, 0.28 to 0.42) in the gain-incentive group, 0.36 (CI, 0.29 to 0.43) in the lottery-incentive group, and 0.45 (CI, 0.38 to 0.52) in the loss-incentive group. In adjusted analyses, only the loss-incentive group had a significantly greater mean proportion of participant-days achieving the goal than control (adjusted difference, 0.16 [CI, 0.06 to 0.26]; P = 0.001), but the adjusted difference in mean daily steps was not significant (861 [CI, 24 to 1746]; P = 0.056). During follow-up, daily steps decreased for all incentive groups and were not different from control. LIMITATION: Single employer. CONCLUSION: Financial incentives framed as a loss were most effective for achieving physical activity goals. PRIMARY FUNDING SOURCE: National Institute on Aging.

Change In Length of Stay and Readmissions among Hospitalized Medical Patients after Inpatient Medicine Service Adoption of Mobile Secure Text Messaging.

BACKGROUND: Changes in the medium of communication from paging to mobile secure text messaging may change clinical care, but the effects of these changes on patient outcomes have not been well examined. OBJECTIVE: To evaluate the association between inpatient medicine service adoption of mobile secure text messaging and patient length of stay and readmissions. DESIGN: Observational study. PARTICIPANTS: Patients admitted to medicine services at the Hospital of the University of Pennsylvania (intervention site; n = 8995 admissions of 6484 patients) and Penn Presbyterian Medical Center (control site; n = 6799 admissions of 4977 patients) between May 1, 2012, and April 30, 2014. INTERVENTION: Mobile secure text messaging. MAIN MEASURES: Change in length of stay and 30-day readmissions, comparing patients at the intervention site to the control site before (May 1, 2012 to April 30, 2013) and after (May 1, 2013 to April 30, 2014) the intervention, adjusting for time trends and patient demographics, comorbidities, insurance, and disposition. KEY RESULTS: During the pre-intervention period, the mean length of stay ranged from 4.0 to 5.0 days at the control site and from 5.2 to 6.7 days at the intervention site, but trends were similar. In the first month after the intervention, the mean length of stay was unchanged at the control site (4.7 to 4.7 days) but declined at the intervention site (6.0 to 5.4 days). Trends were mostly similar during the rest of the post-intervention period, ranging from 4.4 to 5.6 days at the control site and from 5.4 to 6.5 days at the intervention site. Readmission rates varied significantly within sites before and after the intervention, but overall trends were similar. In adjusted analyses, there was a significant decrease in length of stay for the intervention site relative to the control site during the post-intervention period compared to the pre-intervention period (-0.77 days ; 95 % CI, -1.14, -0.40; P < 0.001). There was no significant difference in the odds of readmission (OR, 0.97; 95 % CI: 0.81, 1.17; P = 0.77). These findings were supported by multiple sensitivity analyses. CONCLUSIONS: Compared to a control group over time, hospitalized medical patients on inpatient services whose care providers and staff were offered mobile secure text messaging showed a relative decrease in length of stay and no change in readmissions.

Individual Versus Team-Based Financial Incentives to Increase Physical Activity: A Randomized, Controlled Trial.

BACKGROUND: More than half of adults in the United States do not attain the minimum recommended level of physical activity to achieve health benefits. The optimal design of financial incentives to promote physical activity is unknown. OBJECTIVE: To compare the effectiveness of individual versus team-based financial incentives to increase physical activity. DESIGN: Randomized, controlled trial comparing three interventions to control. PARTICIPANTS: Three hundred and four adult employees from an organization in Philadelphia formed 76 four-member teams. INTERVENTIONS: All participants received daily feedback on performance towards achieving a daily 7000 step goal during the intervention (weeks 1- 13) and follow-up (weeks 14- 26) periods. The control arm received no other intervention. In the three financial incentive arms, drawings were held in which one team was selected as the winner every other day during the 13-week intervention. A participant on a winning team was eligible as follows: $50 if he or she met the goal (individual incentive), $50 only if all four team members met the goal (team incentive), or $20 if he or she met the goal individually and $10 more for each of three teammates that also met the goal (combined incentive). MAIN MEASURES: Mean proportion of participant-days achieving the 7000 step goal during the intervention. KEY RESULTS: Compared to the control group during the intervention period, the mean proportion achieving the 7000 step goal was significantly greater for the combined incentive (0.35 vs. 0.18, difference: 0.17, 95 % confidence interval [CI]: 0.07-0.28, p <0.001) but not for the individual incentive (0.25 vs 0.18, difference: 0.08, 95 % CI: -0.02-0.18, p = 0.13) or the team incentive (0.17 vs 0.18, difference: -0.003, 95 % CI: -0.11-0.10, p = 0.96). The combined incentive arm participants also achieved the goal at significantly greater rates than the team incentive (0.35 vs. 0.17, difference: 0.18, 95 % CI: 0.08-0.28, p < 0.001), but not the individual incentive (0.35 vs. 0.25, difference: 0.10, 95 % CI: -0.001-0.19, p = 0.05). Only the combined incentive had greater mean daily steps than control (difference: 1446, 95 % CI: 448-2444, p ≤ 0.005). There were no significant differences between arms during the follow-up period (weeks 14- 26). CONCLUSIONS: Financial incentives rewarded for a combination of individual and team performance were most effective for increasing physical activity. TRIAL REGISTRATION: Clinicaltrials.gov identifier: NCT02001194.

Pilot Study of a Mobile Phone Chatbot for Medication Adherence and Toxicity Management Among Patients With GI Cancers on Capecitabine.

PURPOSE: Capecitabine is an oral chemotherapy used to treat many gastrointestinal cancers. Its complex dosing and narrow therapeutic index make medication adherence and toxicity management crucial for quality care. METHODS: We conducted a pilot study of PENNY-GI, a mobile phone text messaging-based chatbot that leverages algorithmic surveys and natural language processing to promote medication adherence and toxicity management among patients with gastrointestinal cancers on capecitabine. Eligibility initially included all capecitabine-containing regimens but was subsequently restricted to capecitabine monotherapy because of challenges in integrating PENNY-GI with radiation and intravenous chemotherapy schedules. We used design thinking principles and real-time data on safety, accuracy, and usefulness to make iterative refinements to PENNY-GI with the goal of minimizing the proportion of text messaging exchanges with incorrect medication or symptom management recommendations. All patients were invited to participate in structured exit interviews to provide feedback on PENNY-GI. RESULTS: We enrolled 40 patients (median age 64.5 years, 52.5% male, 62.5% White, 55.0% with colorectal cancer, 50.0% on capecitabine monotherapy). We identified 284 of 3,895 (7.3%) medication-related and 13 of 527 (2.5%) symptom-related text messaging exchanges with incorrect recommendations. In exit interviews with 24 patients, participants reported finding the medication reminders reliable and user-friendly, but the symptom management tool was too simplistic to be helpful. CONCLUSION: Although PENNY-GI provided accurate recommendations in >90% of text messaging exchanges, we identified multiple limitations with respect to the intervention's generalizability, usefulness, and scalability. Lessons from this pilot study should inform future efforts to develop and implement digital health interventions in oncology.

Feedback and Financial Incentives for Reducing Cell Phone Use While Driving: A Randomized Clinical Trial.

Importance: Handheld phone use while driving is a major factor in vehicle crashes. Scalable interventions are needed to encourage drivers not to use their phones. Objective: To test whether interventions involving social comparison feedback and/or financial incentives can reduce drivers' handheld phone use. Design, Setting, and Participants: In a randomized clinical trial, interventions were administered nationwide in the US via a mobile application in the context of a usage-based insurance program (Snapshot Mobile application). Customers were eligible to be invited to participate in the study if enrolled in the usage-based insurance program for 30 to 70 days. The study was conducted from May 13 to June 30, 2019. Analysis was completed December 22, 2023. Interventions: Participants were randomly assigned to 1 of 6 trial arms for a 7-week intervention period: (1) control; (2) feedback, with weekly push notification about their handheld phone use compared with that of similar others; (3) standard incentive, with a maximum $50 award at the end of the intervention based on how their handheld phone use compared with similar others; (4) standard incentive plus feedback, combining interventions of arms 2 and 3; (5) reframed incentive plus feedback, with a maximum $7.15 award each week, framed as participant's to lose; and (6) doubled reframed incentive plus feedback, a maximum $14.29 weekly loss-framed award. Main Outcome and Measure: Proportion of drive time engaged in handheld phone use in seconds per hour (s/h) of driving. Analyses were conducted with the intention-to-treat approach. Results: Of 17 663 customers invited by email to participate, 2109 opted in and were randomized. A total of 2020 drivers finished the intervention period (68.0% female; median age, 30 [IQR, 25-39] years). Median baseline handheld phone use was 216 (IQR, 72-480) s/h. Relative to control, feedback and standard incentive participants did not reduce their handheld phone use. Standard incentive plus feedback participants reduced their use by -38 (95% CI, -69 to -8) s/h (P = .045); reframed incentive plus feedback participants reduced their use by -56 (95% CI, -87 to -26) s/h (P < .001); and doubled reframed incentive plus feedback participants reduced their use by -42 s/h (95% CI, -72 to -13 s/h; P = .007). The 5 active treatment arms did not differ significantly from each other. Conclusions and Relevance: In this randomized clinical trial, providing social comparison feedback plus incentives reduced handheld phone use while individuals were driving. Trial Registration: ClinicalTrials.gov Identifier: NCT03833219.

Validation of an Automated Symptom-Based Triage Tool in Ophthalmology.

OBJECTIVES: Acute care ophthalmic clinics often suffer from inefficient triage, leading to suboptimal patient access and resource utilization. This study reports the preliminary results of a novel, symptom-based, patient-directed, online triage tool developed to address the most common acute ophthalmic diagnoses and associated presenting symptoms. METHODS: A retrospective chart review of patients who presented to a tertiary academic medical center's urgent eye clinic after being referred for an urgent, semi-urgent, or nonurgent visit by the ophthalmic triage tool between January 1, 2021 and January 1, 2022 was performed. Concordance between triage category and severity of diagnosis on the subsequent clinic visit was assessed. RESULTS: The online triage tool was utilized 1,370 and 95 times, by the call center administrators (phone triage group) and patients directly (web triage group), respectively. Of all patients triaged with the tool, 8.50% were deemed urgent, 59.2% semi-urgent, and 32.3% nonurgent. At the subsequent clinic visit, the history of present illness had significant agreement with symptoms reported to the triage tool (99.3% agreement, weighted kappa = 0.980, p < 0.001). The triage algorithm also had significant agreement with the severity of the physician diagnosis (97.0% agreement, weighted kappa = 0.912, p < 0.001). Zero patients were found to have a diagnosis on exam that should have corresponded to a higher urgency level on the triage tool. CONCLUSION: The automated ophthalmic triage algorithm was able to safely and effectively triage patients based on symptoms. Future work should focus on the utility of this tool to reduce nonurgent patient load in urgent clinical settings and to improve access for patients who require urgent medical care.

Crowdsourced Community Support Resources Among Patients Discharged From the Emergency Department During the COVID-19 Pandemic: Pilot Feasibility Study.

BACKGROUND: The COVID-19 pandemic has placed strains on communities. During this public health crisis, health systems have created remote methods of monitoring symptom progression and delivering care virtually. OBJECTIVE: Using an SMS text message-based system, we sought to build and test a remote model to explore community needs, connect individuals to curated resources, and facilitate community health worker intervention when needed during the pandemic. The primary aims of this pilot study were to establish the feasibility (ie, engagement with the text line) and acceptability (ie, participant ratings of resources and service) of delivering automated well-being resources via smartphone technology. METHODS: Eligible patients (aged 18 years or older, having a cell phone with SMS text messaging capability, and recently visited the emergency department) were identified using the electronic health record. The patients were consented to enroll and begin receiving COVID-19-related information and links to community resources. We collected open-ended and close-ended resource and mood ratings. We calculated the frequencies and conducted a thematic review of the open-ended responses. RESULTS: In 7 weeks, 356 participants were enrolled; 13,917 messages were exchanged including 333 resource ratings (mean 4) and 673 well-being scores (mean 6.8). We received and coded 386 open-ended responses, most of which elaborated upon their self-reported mood score (29%). Overall, 77% (n=274) of our participants rated the platform as a service they would highly recommend to a family member or friend. CONCLUSIONS: This approach is designed to broaden the reach of health systems, tailor to community needs in real time, and connect at-risk individuals with robust community health support.

Effect of Text Messaging and Behavioral Interventions on COVID-19 Vaccination Uptake: A Randomized Clinical Trial.

Importance: COVID-19 vaccine uptake among urban populations remains low. Objective: To evaluate whether text messaging with outbound or inbound scheduling and behaviorally informed content might increase COVID-19 vaccine uptake. Design, Setting, and Participants: This randomized clinical trial with a factorial design was conducted from April 29 to July 6, 2021, in an urban academic health system. The trial comprised 16 045 patients at least 18 years of age in Philadelphia, Pennsylvania, with at least 1 primary care visit in the past 5 years, or a future scheduled primary care visit within the next 3 months, who were unresponsive to prior outreach. The study was prespecified in the trial protocol, and data were obtained from the intent-to-treat population. Interventions: Eligible patients were randomly assigned in a 1:20:20 ratio to (1) outbound telephone call only by call center, (2) text message and outbound telephone call by call center to those who respond, or (3) text message, with patients instructed to make an inbound telephone call to a hotline. Patients in groups 2 and 3 were concurrently randomly assigned in a 1:1:1:1 ratio to receive different content: standard messaging, clinician endorsement (eg, "Dr. XXX recommends"), scarcity ("limited supply available"), or endowment framing ("We have reserved a COVID-19 vaccine appointment for you"). Main Outcomes and Measures: The primary outcome was the proportion of patients who completed the first dose of the COVID-19 vaccine within 1 month, according to the electronic health record. Secondary outcomes were the completion of the first dose within 2 months and completion of the vaccination series within 2 months of initial outreach. Additional outcomes included the percentage of patients with invalid cell phone numbers (wrong number or nontextable), no response to text messaging, the percentage of patients scheduled for the vaccine, text message responses, and the number of telephone calls made by the access center. Analysis was on an intention-to-treat basis. Results: Among the 16 045 patients included, the mean (SD) age was 36.9 (11.1) years; 9418 (58.7%) were women; 12 869 (80.2%) had commercial insurance, and 2283 (14.2%) were insured by Medicaid; 8345 (52.0%) were White, 4706 (29.3%) were Black, and 967 (6.0%) were Hispanic or Latino. At 1 month, 14 of 390 patients (3.6% [95% CI, 1.7%-5.4%]) in the outbound telephone call-only group completed 1 vaccine dose, as did 243 of 7890 patients (3.1% [95% CI, 2.7%-3.5%]) in the text plus outbound call group (absolute difference, -0.5% [95% CI, -2.4% to 1.4%]; P = .57) and 253 of 7765 patients (3.3% [95% CI, 2.9%-3.7%]) in the text plus inbound call group (absolute difference, -0.3% [95% CI, -2.2% to 1.6%]; P = .72). Among the 15 655 patients receiving text messaging, 118 of 3889 patients (3.0% [95% CI, 2.5%-3.6%]) in the standard messaging group completed 1 vaccine dose, as did 135 of 3920 patients (3.4% [95% CI, 2.9%-4.0%]) in the clinician endorsement group (absolute difference, 0.4% [95% CI, -0.4% to 1.2%]; P = .31), 100 of 3911 patients (2.6% [95% CI, 2.1%-3.1%]) in the scarcity group (absolute difference, -0.5% [95% CI, -1.2% to 0.3%]; P = .20), and 143 of 3935 patients (3.6% [95% CI, 3.0%-4.2%]) in the endowment group (absolute difference, 0.6% [95% CI, -0.2% to 1.4%]; P = .14). Conclusions and Relevance: There was no detectable increase in vaccination uptake among patients receiving text messaging compared with telephone calls only or behaviorally informed message content. Trial Registration: ClinicalTrials.gov Identifier: NCT04834726.

Comparing the Effects of Design Thinking and A3 Problem-Solving on Resident Attitudes Toward Systems Change.

BACKGROUND: Quality improvement (QI) is a required component of graduate medical education. Many medical educators struggle to foster an improvement mindset within residents. OBJECTIVE: We conducted a mixed-methods study to compare a Design Thinking (DT) approach to QI education with a Lean, A3 problem-solving approach. We hypothesized that a DT approach would better promote a mentality of continuous improvement, measured by residents' resistance to change. METHODS: Thirty-eight postgraduate year 2 internal medicine residents were divided into 4 cohorts during the 2017-2018 academic year. One cohort participated in an experimental QI curriculum utilizing DT while 3 control cohorts participated in the existing curriculum based on Lean principles. Participants voluntarily completed a quantitative Resistance to Change (RTC) scale pre- and post-curriculum. To inform our understanding of these results, we also conducted semistructured interviews for qualitative thematic analysis. RESULTS: The effect size on the overall RTC score (response rate 92%) was trivial in both groups. Three major themes emerged from the qualitative data: factors influencing the QI learning experience, factors influencing creativity, and general attitudes toward QI. Each contained several subthemes with minimal qualitative differences between groups. CONCLUSIONS: This study found similar results in terms of their effect on attitudes toward systems change, ability to promote creative change agency, and educational experience. Despite positive educational experiences, many residents still did not view systems-based problem-solving as part of their professional identity.