Peer Comparison or Guideline-Based Feedback and Postsurgery Opioid Prescriptions: A Randomized Clinical Trial.

Importance: Excess opioid prescribing after surgery can result in prolonged use and diversion. Email feedback based on social norms may reduce the number of pills prescribed. Objective: To assess the effectiveness of 2 social norm-based interventions on reducing guideline-discordant opioid prescribing after surgery. Design, Setting, and Participants: This cluster randomized clinical trial conducted at a large health care delivery system in northern California between October 2021 and October 2022 included general, obstetric/gynecologic, and orthopedic surgeons with patients aged 18 years or older discharged to home with an oral opioid prescription. Interventions: In 19 hospitals, 3 surgical specialties (general, orthopedic, and obstetric/gynecologic) were randomly assigned to a control group or 1 of 2 interventions. The guidelines intervention provided email feedback to surgeons on opioid prescribing relative to institutionally endorsed guidelines; the peer comparison intervention provided email feedback on opioid prescribing relative to that of peer surgeons. Emails were sent to surgeons with at least 2 guideline-discordant prescriptions in the previous month. The control group had no intervention. Main Outcome and Measures: The probability that a discharged patient was prescribed a quantity of opioids above the guideline for the respective procedure during the 12 intervention months. Results: There were 38 235 patients discharged from 640 surgeons during the 12-month intervention period. Control-group surgeons prescribed above guidelines 36.8% of the time during the intervention period compared with 27.5% and 25.4% among surgeons in the peer comparison and guidelines arms, respectively. In adjusted models, the peer comparison intervention reduced guideline-discordant prescribing by 5.8 percentage points (95% CI, -10.5 to -1.1; P = .03) and the guidelines intervention reduced it by 4.7 percentage points (95% CI, -9.4 to -0.1; P = .05). Effects were driven by surgeons who performed more surgeries and had more guideline-discordant prescribing at baseline. There was no significant difference between interventions. Conclusions and Relevance: In this cluster randomized clinical trial, email feedback based on either guidelines or peer comparison reduced opioid prescribing after surgery. Guideline-based feedback was as effective as peer comparison-based feedback. These interventions are simple, low-cost, and scalable, and may reduce downstream opioid misuse. Trial Registration: ClinicalTrials.gov NCT05070338.

Reducing Care Overuse in Older Patients Using Professional Norms and Accountability : A Cluster Randomized Controlled Trial.

BACKGROUND: Effective strategies are needed to curtail overuse that may lead to harm. OBJECTIVE: To evaluate the effects of clinician decision support redirecting attention to harms and engaging social and reputational concerns on overuse in older primary care patients. DESIGN: 18-month, single-blind, pragmatic, cluster randomized trial, constrained randomization. (ClinicalTrials.gov: NCT04289753). SETTING: 60 primary care internal medicine, family medicine and geriatrics practices within a health system from 1 September 2020 to 28 February 2022. PARTICIPANTS: 371 primary care clinicians and their older adult patients from participating practices. INTERVENTION: Behavioral science-informed, point-of-care, clinical decision support tools plus brief case-based education addressing the 3 primary clinical outcomes (187 clinicians from 30 clinics) were compared with brief case-based education alone (187 clinicians from 30 clinics). Decision support was designed to increase salience of potential harms, convey social norms, and promote accountability. MEASUREMENTS: Prostate-specific antigen (PSA) testing in men aged 76 years and older without previous prostate cancer, urine testing for nonspecific reasons in women aged 65 years and older, and overtreatment of diabetes with hypoglycemic agents in patients aged 75 years and older and hemoglobin A1c (HbA1c) less than 7%. RESULTS: At randomization, mean clinic annual PSA testing, unspecified urine testing, and diabetes overtreatment rates were 24.9, 23.9, and 16.8 per 100 patients, respectively. After 18 months of intervention, the intervention group had lower adjusted difference-in-differences in annual rates of PSA testing (-8.7 [95% CI, -10.2 to -7.1]), unspecified urine testing (-5.5 [CI, -7.0 to -3.6]), and diabetes overtreatment (-1.4 [CI, -2.9 to -0.03]) compared with education only. Safety measures did not show increased emergency care related to urinary tract infections or hyperglycemia. An HbA1c greater than 9.0% was more common with the intervention among previously overtreated diabetes patients (adjusted difference-in-differences, 0.47 per 100 patients [95% CI, 0.04 to 1.20]). LIMITATION: A single health system limits generalizability; electronic health data limit ability to differentiate between overtesting and underdocumentation. CONCLUSION: Decision support designed to increase clinicians' attention to possible harms, social norms, and reputational concerns reduced unspecified testing compared with offering traditional case-based education alone. Small decreases in diabetes overtreatment may also result in higher rates of uncontrolled diabetes. PRIMARY FUNDING SOURCE: National Institute on Aging.

Development and pilot testing of EHR-nudges to reduce overuse in older primary care patients.

BACKGROUND: Unnecessary testing and treatment of common conditions in older adults can lead to significant morbidity and mortality. The primary objective of this study was to develop and pilot test a set of clinical decision support (CDS) alerts informed by social psychology to address overuse in three areas related to ambulatory care of older adults. METHODS: We developed three electronic health record (EHR) CDS alerts to address overuse and pilot tested them from January 17, 2019 to July 17, 2019. We enrolled 14 primary care physicians from three practices within a large health system who cared for adults aged 65 years and older. Three measures of overuse applied to patients meeting the following criteria: ordering of prostate-specific antigen (PSA) for prostate cancer screening in adult men aged 76 years and older, ordering of urinalysis or urine cultures (UA or UC) for non-specific reasons to identify bacteriuria in women aged 65 years and older, and overtreatment of diabetes with insulin or oral hypoglycemic medications in adults aged at 75 years and older (DM). Clinicians received CDS alerts when criteria for any of the three overuse measures were met. We then surveyed clinicians to evaluate their experience with the CDS alerts. RESULTS: The number of clinical encounters that triggered CDS alerts was 19 for PSA, 48 for UA/UC and 128 for DM. For PSA encounters, 4 (21%) orders were not performed after the alert. In the UA/UC encounters 29 (60%) orders were not performed after the alert. For the DM encounters, 21 (34%) had diabetes therapy reduced following the alert. Survey respondents indicated that the alerts were clinically accurate and sometimes led them to change their clinical action. CONCLUSIONS: These CDS alerts were feasible to implement and may minimize unnecessary testing and treatment of common conditions in older adults.

Development of High-Risk Geriatric Polypharmacy Electronic Clinical Quality Measures and a Pilot Test of EHR Nudges Based on These Measures.

BACKGROUND: Inappropriate polypharmacy, prevalent among older patients, is associated with substantial harms. OBJECTIVE: To develop measures of high-risk polypharmacy and pilot test novel electronic health record (EHR)-based nudges grounded in behavioral science to promote deprescribing. DESIGN: We developed and validated seven measures, then conducted a three-arm pilot from February to May 2019. PARTICIPANTS: Validation used data from 78,880 patients from a single large health system. Six physicians were pre-pilot test environment users. Sixty-nine physicians participated in the pilot. MAIN MEASURES: Rate of high-risk polypharmacy among patients aged 65 years or older. High-risk polypharmacy was defined as being prescribed ≥5 medications and satisfying ≥1 of the following high-risk criteria: drugs that increase fall risk among patients with fall history; drug-drug interactions that increase fall risk; thiazolidinedione, NSAID, or non-dihydropyridine calcium channel blocker in heart failure; and glyburide, glimepiride, or NSAID in chronic kidney disease. INTERVENTIONS: Physicians received EHR alerts when renewing or prescribing certain high-risk medications when criteria were met. One practice received a "commitment nudge" that offered a chance to commit to addressing high-risk polypharmacy at the next visit. One practice received a "justification nudge" that asked for a reason when high-risk polypharmacy was present. One practice received both. KEY RESULTS: Among 55,107 patients 65 and older prescribed 5 or more medications, 6256 (7.9%) had one or more high-risk criteria. During the pilot, the mean (SD) number of nudges per physician per week was 1.7 (0.4) for commitment, 0.8 (0.5) for justification, and 1.9 (0.5) for both interventions. Physicians requested to be reminded to address high-risk polypharmacy for 236/833 (28.3%) of the commitment nudges and acknowledged 441 of 460 (95.9%) of justification nudges, providing a text response for 187 (40.7%). CONCLUSIONS: EHR-based measures and nudges addressing high-risk polypharmacy were feasible to develop and implement, and warrant further testing.

Design of Behavioral Economic Applications to Geriatrics Leveraging Electronic Health Records (BEAGLE): A pragmatic cluster randomized controlled trial.

BACKGROUND: Overtesting and treatment of older patients is common and may lead to harms. The Choosing Wisely campaign has provided recommendations to reduce overtesting and overtreatment of older adults. Behavioral economics-informed interventions embedded within the electronic health record (EHR) have been shown to reduce overuse in several areas. Our objective is to conduct a parallel arm, pragmatic cluster-randomized trial to evaluate the effectiveness of behavioral-economics-informed clinical decision support (CDS) interventions previously piloted in primary care clinics and designed to reduce overtesting and overtreatment in older adults. METHODS/DESIGN: This trial has two parallel arms: clinician education alone vs. clinician education plus behavioral-economics-informed CDS. There are three co-primary outcomes for this trial: (1) prostate-specific antigen (PSA) screening in older men, (2) urine testing for non-specific reasons in older women, and (3) overtreatment of diabetes in older adults. All eligible primary care clinics from a large regional health system were randomized using a modified constrained randomization process and their attributed clinicians were included. Clinicians were recruited to complete a survey and educational module. We randomized 60 primary care clinics with 374 primary care clinicians and achieved adequate balance between the study arms for prespecified constrained variables. Baseline annual overuse rates for the three co-primary outcomes were 25%, 23%, and 17% for the PSA, urine, and diabetes measures, respectively. DISCUSSION: This trial is evaluating behavioral-economics-informed EHR-embedded interventions to reduce overuse of specific tests and treatments for older adults. The study will evaluate the effectiveness and safety of these interventions.

Impact of a Risk Calculator on Risk Perception and Surgical Decision Making: A Randomized Trial.

OBJECTIVE: The aim of this study was to determine whether exposure to data from a risk calculator influences surgeons' assessments of risk and in turn, their decisions to operate. BACKGROUND: Little is known about how risk calculators inform clinical judgment and decision-making. METHODS: We asked a national sample of surgeons to assess the risks (probability of serious complications or death) and benefits (recovery) of operative and nonoperative management and to rate their likelihood of recommending an operation (5-point scale) for 4 detailed clinical vignettes wherein the best treatment strategy was uncertain. Surgeons were randomized to the clinical vignettes alone (control group; n = 384) or supplemented by data from a risk calculator (risk calculator group; n = 395). We compared surgeons' judgments and decisions between the groups. RESULTS: Surgeons exposed to the risk calculator judged levels of operative risk that more closely approximated the risk calculator value (RCV) compared with surgeons in the control group [mesenteric ischemia: 43.7% vs 64.6%, P < 0.001 (RCV = 25%); gastrointestinal bleed: 47.7% vs 53.4%, P < 0.001 (RCV = 38%); small bowel obstruction: 13.6% vs 17.5%, P < 0.001 (RCV = 14%); appendicitis: 13.4% vs 24.4%, P < 0.001 (RCV = 5%)]. Surgeons exposed to the risk calculator also varied less in their assessment of operative risk (standard deviations: mesenteric ischemia 20.2% vs 23.2%, P = 0.01; gastrointestinal bleed 17.4% vs 24.1%, P < 0.001; small bowel obstruction 10.6% vs 14.9%, P < 0.001; appendicitis 15.2% vs 21.8%, P < 0.001). However, averaged across the 4 vignettes, the 2 groups did not differ in their reported likelihood of recommending an operation (mean 3.7 vs 3.7, P = 0.76). CONCLUSIONS: Exposure to risk calculator data leads to less varied and more accurate judgments of operative risk among surgeons, and thus may help inform discussions of treatment options between surgeons and patients. Interestingly, it did not alter their reported likelihood of recommending an operation.

Surgeon Perception of Risk and Benefit in the Decision to Operate.

OBJECTIVE: To determine how surgeons' perceptions of treatment risks and benefits influence their decisions to operate. BACKGROUND: Little is known about what makes one surgeon choose to operate on a patient and another chooses not to operate. METHODS: Using an online study, we presented a national sample of surgeons (N = 767) with four detailed clinical vignettes (mesenteric ischemia, gastrointestinal bleed, bowel obstruction, appendicitis) where the best treatment option was uncertain and asked them to: (1) judge the risks (probability of serious complications) and benefits (probability of recovery) for operative and nonoperative management and (2) decide whether or not they would recommend an operation. RESULTS: Across all clinical vignettes, surgeons varied markedly in both their assessments of the risks and benefits of operative and nonoperative management (narrowest range 4%-100% for all four predictions across vignettes) and in their decisions to operate (49%-85%). Surgeons were less likely to operate as their perceptions of operative risk increased [absolute difference (AD) = -29.6% from 1.0 standard deviation below to 1.0 standard deviation above mean (95% confidence interval, CI: -31.6, -23.8)] and their perceptions of nonoperative benefit increased [AD = -32.6% (95% CI: -32.8,--28.9)]. Surgeons were more likely to operate as their perceptions of operative benefit increased [AD = 18.7% (95% CI: 12.6, 21.5)] and their perceptions of nonoperative risk increased [AD = 32.7% (95% CI: 28.7, 34.0)]. Differences in risk/benefit perceptions explained 39% of the observed variation in decisions to operate across the four vignettes. CONCLUSIONS: Given the same clinical scenarios, surgeons' perceptions of treatment risks and benefits vary and are highly predictive of their decisions to operate.