Effect of Social Comparison Feedback on Laboratory Test Ordering for Hospitalized Patients: A Randomized Controlled Trial.

BACKGROUND: Social comparison feedback is an increasingly popular strategy that uses performance report cards to modify physician behavior. Our objective was to test the effect of such feedback on the ordering of routine laboratory tests for hospitalized patients, a practice considered overused. METHODS: This was a single-blinded randomized controlled trial. Between January and June 2016, physicians on six general medicine teams at the Hospital of the University of Pennsylvania were cluster randomized with equal allocation to two arms: (1) those e-mailed a summary of their routine laboratory test ordering vs. the service average for the prior week, linked to a continuously updated personalized dashboard containing patient-level details, and snapshot of the dashboard and (2) those who did not receive the intervention. The primary outcome was the count of routine laboratory test orders placed by a physician per patient-day. We modeled the count of orders by each physician per patient-day after the intervention as a function of trial arm and the physician's order count before the intervention. The count outcome was modeled using negative binomial models with adjustment for clustering within teams. RESULTS: One hundred and fourteen interns and residents participated. We did not observe a statistically significant difference in adjusted reduction in routine laboratory ordering between the intervention and control physicians (physicians in the intervention group ordered 0.14 fewer tests per patient-day than physicians in the control group, 95% CI - 0.56 to 0.27, p = 0.50). Physicians whose absolute ordering rate deviated from the peer rate by more than 1.0 laboratory test per patient-day reduced their laboratory ordering by 0.80 orders per patient-day (95% CI - 1.58 to - 0.02, p = 0.04). CONCLUSIONS: Personalized social comparison feedback on routine laboratory ordering did not change targeted behavior among physicians, although there was a significant decrease in orders among participants who deviated more from the peer rate. TRIAL REGISTRATION: Clinicaltrials.gov registration: #NCT02330289.

A behavioral economics intervention to encourage epinephrine-carrying among food-allergic adults: a randomized controlled trial.

BACKGROUND: Adolescents and young adults with food allergies are at increased risk of adverse events, including death from anaphylaxis. Epinephrine is the cornerstone of emergency response, yet few individuals with serious food allergies consistently carry their emergency medication. Behavioral economics offers promising, previously untapped opportunities for behavior change in this arena. OBJECTIVE: To test the effectiveness of modest financial incentives in promoting the carrying of epinephrine and to evaluate the acceptability of text messaging for delivering reminders and key health messages to young adults with food allergies. METHODS: A mixed-methods randomized controlled trial in young adults with food allergies investigated the carrying of epinephrine auto-injectors using financial incentives plus text message reminders vs text message reminders alone. Epinephrine carriage was assessed 10 times during the 49-day intervention using rapid-reply cell phone photographs plus daily code words. RESULTS: The intervention (financial incentive) group had their epinephrine auto-injectors at 54% of check-ins vs 27% of check-ins in the control (text-only) group (P = .023). Participants in the 2 groups consistently reported favorable impressions of text messaging as a desirable, unobtrusive way to receive information and support for food allergy management. CONCLUSION: Although the intervention and control groups reported favorable impressions of text message-based reminder systems, the intervention group performed significantly better than the control group on a photograph-based measurement of epinephrine carriage. There remained ample room for improvement in the 2 groups given the goal of consistent, uninterrupted epinephrine carriage by people with potentially life-threatening food allergies. TRIAL REGISTRATION: https://clinicaltrials.gov; NCT02354729.

Validation of an Automated Symptom-Based Triage Tool in Ophthalmology.

OBJECTIVES: Acute care ophthalmic clinics often suffer from inefficient triage, leading to suboptimal patient access and resource utilization. This study reports the preliminary results of a novel, symptom-based, patient-directed, online triage tool developed to address the most common acute ophthalmic diagnoses and associated presenting symptoms. METHODS: A retrospective chart review of patients who presented to a tertiary academic medical center's urgent eye clinic after being referred for an urgent, semi-urgent, or nonurgent visit by the ophthalmic triage tool between January 1, 2021 and January 1, 2022 was performed. Concordance between triage category and severity of diagnosis on the subsequent clinic visit was assessed. RESULTS: The online triage tool was utilized 1,370 and 95 times, by the call center administrators (phone triage group) and patients directly (web triage group), respectively. Of all patients triaged with the tool, 8.50% were deemed urgent, 59.2% semi-urgent, and 32.3% nonurgent. At the subsequent clinic visit, the history of present illness had significant agreement with symptoms reported to the triage tool (99.3% agreement, weighted kappa = 0.980, p < 0.001). The triage algorithm also had significant agreement with the severity of the physician diagnosis (97.0% agreement, weighted kappa = 0.912, p < 0.001). Zero patients were found to have a diagnosis on exam that should have corresponded to a higher urgency level on the triage tool. CONCLUSION: The automated ophthalmic triage algorithm was able to safely and effectively triage patients based on symptoms. Future work should focus on the utility of this tool to reduce nonurgent patient load in urgent clinical settings and to improve access for patients who require urgent medical care.

Effect of Nudges to Clinicians, Patients, or Both to Increase Statin Prescribing: A Cluster Randomized Clinical Trial.

Importance: Statins reduce the risk of major adverse cardiovascular events, but less than one-half of individuals in America who meet guideline criteria for a statin are actively prescribed this medication. Objective: To evaluate whether nudges to clinicians, patients, or both increase initiation of statin prescribing during primary care visits. Design, Setting, and Participants: This cluster randomized clinical trial evaluated statin prescribing of 158 clinicians from 28 primary care practices including 4131 patients. The design included a 12-month preintervention period and a 6-month intervention period between October 19, 2019, and April 18, 2021. Interventions: The usual care group received no interventions. The clinician nudge combined an active choice prompt in the electronic health record during the patient visit and monthly feedback on prescribing patterns compared with peers. The patient nudge was an interactive text message delivered 4 days before the visit. The combined nudge included the clinician and patient nudges. Main Outcomes and Measures: The primary outcome was initiation of a statin prescription during the visit. Results: The sample comprised 4131 patients with a mean (SD) age of 65.5 (10.5) years; 2120 (51.3%) were male; 1210 (29.3%) were Black, 106 (2.6%) were Hispanic, 2732 (66.1%) were White, and 83 (2.0%) were of other race or ethnicity, and 933 (22.6%) had atherosclerotic cardiovascular disease. In unadjusted analyses during the preintervention period, statins were prescribed to 5.6% of patients (105 of 1876) in the usual care group, 4.8% (97 of 2022) in the patient nudge group, 6.0% (104 of 1723) in the clinician nudge group, and 4.7% (82 of 1752) in the combined group. During the intervention, statins were prescribed to 7.3% of patients (75 of 1032) in the usual care group, 8.5% (100 of 1181) in the patient nudge group, 13.0% (128 of 981) in the clinician nudge arm, and 15.5% (145 of 937) in the combined group. In the main adjusted analyses relative to usual care, the clinician nudge significantly increased statin prescribing alone (5.5 percentage points; 95% CI, 3.4 to 7.8 percentage points; P = .01) and when combined with the patient nudge (7.2 percentage points; 95% CI, 5.1 to 9.1 percentage points; P = .001). The patient nudge alone did not change statin prescribing relative to usual care (0.9 percentage points; 95% CI, -0.8 to 2.5 percentage points; P = .32). Conclusions and Relevance: Nudges to clinicians with and without a patient nudge significantly increased initiation of a statin prescription during primary care visits. The patient nudge alone was not effective. Trial Registration: ClinicalTrials.gov Identifier: NCT04307472.

Development of Training in Problem Solving for Caregivers of Childhood Brain Tumor Survivors.

BACKGROUND: Family management (FM) challenges of maternal caregivers of young adult survivors of childhood brain tumors are well documented, but there are no evidence-based caregiver interventions to improve FM. OBJECTIVES: The aims of this study were to (1) generate the knowledge necessary for developing a caregiver intervention (stage 0) and (2) modify an existing, efficacious intervention by engaging stakeholders (stage 1). METHODS: Stages 0 and 1 of the National Institutes of Health Stage Model for Behavioral Intervention Development and the FM Styles Framework were used in this study. RESULTS: In stage 0, families with condition-focused FM patterns were identified as at risk for poor problem solving. The 12-item Condition Management Ability scale of the FM Measures was selected as the screener to identify condition-focused maternal caregivers. Problem solving was identified as a potential mechanism for promoting behavior change. In stage 1, Bright IDEAS for Everyday Living was modified by integrating the FM Styles Framework creating Training in Problem Solving for Caregivers of Young Adult Survivors of Childhood Brain Tumors. Qualitative and quantitative assessments of feasibility and acceptability by maternal caregivers were excellent and used to improve selected areas of concern. CONCLUSION: Feedback from stakeholders indicates that Training in Problem Solving is a promising approach to shifting FM patterns and improving the functioning of caregivers, young adult survivors, and families. IMPLICATIONS FOR NURSING PRACTICE: When developing interventions, the use of systemic methods can provide both clinically based and scientifically acceptable solutions. Those interventions based on both problem solving and FM are potentially promising but need further testing.

A Mobile Application Patient Decision Aid for Treatment of Overactive Bladder.

OBJECTIVE: The aim of this study was to develop and validate a mobile application patient decision aid (mPDA) for providing treatment options to women with overactive bladder (OAB). METHODS: We performed a mixed methods study. We conducted cognitive interviews to gain insight about treatment decisions for OAB. We then developed an evidence-based mPDA and conducted a prospective cohort study to validate it. Women completed the validated Decisional Conflict Scale. Construct validity was determined by comparing Decisional Conflict Scale scores before and after use of the decision aid. Concurrent validity was assessed by determining the relationship between change in Decision Conflict Scale score and a validated Patient Satisfaction Questionnaire. Discriminant validity was assessed by comparing the change in Decision Conflict Scale score in women who had failed 2 or less versus 3 or more prior treatments. RESULTS: Fifteen women participated in cognitive interviews. Thematic analysis revealed that women want information about adverse events, personalization of treatment options, and supplemental interactive sources. Sixty-five women participated in the validation study. Decision Conflict Scale scores improved significantly after use of the decision aid (60.2 ± 22.3 vs 18.7 ± 19.5, P < 0.001). Change in Decision Conflict Scale score correlated moderately with Patient Satisfaction Questionnaire score (r = 0.437, P = 0.003). Women with 3 or more prior treatment failures had greater improvement in Decision Conflict Scale score than women with 2 or less prior treatment failures (P < 0.001). CONCLUSIONS: The mPDA is a valuable adjunct to physician counseling for treatment options in women with OAB.

Communicating Guideline Recommendations Using Graphic Narrative Versus Text-Based Broadcast Screensavers: Design and Implementation Study.

BACKGROUND: The use of graphic narratives, defined as stories that use images for narration, is growing in health communication. OBJECTIVE: The aim of this study was to describe the design and implementation of a graphic narrative screensaver (GNS) to communicate a guideline recommendation (ie, avoiding low-value acid suppressive therapy [AST] use in hospital inpatients) and examine the comparative effectiveness of the GNS versus a text-based screensaver (TBS) on clinical practice (ie, low-value AST prescriptions) and clinician recall. METHODS: During a 2-year period, the GNS and the TBS were displayed on inpatient clinical workstations. The numbers of new AST prescriptions were examined in the four quarters before, the three quarters during, and the one quarter after screensavers were implemented. Additionally, an electronic survey was sent to resident physicians 1 year after the intervention to assess screensaver recall. RESULTS: Designing an aesthetically engaging graphic that could be rapidly understood was critical in the development of the GNS. The odds of receiving an AST prescription on medicine and medicine subspecialty services after the screensavers were implemented were lower for all four quarters (ie, GNS and TBS broadcast together, only TBS broadcast, only GNS broadcast, and no AST screensavers broadcast) compared to the quarter prior to implementation (odds ratio [OR] 0.85, 95% CI 0.78-0.92; OR 0.89, 95% CI 0.82-0.97; OR 0.87, 95% CI 0.80-0.95; and OR 0.81, 95% CI 0.75-0.89, respectively; P<.001 for all comparisons). There were no statistically significant decreases for other high-volume services, such as the surgical services. These declines appear to have begun prior to screensaver implementation. When surveyed about the screensaver content 1 year later, resident physicians recalled both the GNS and TBS (43/70, 61%, vs 54/70, 77%; P=.07) and those who recalled the screensaver were more likely to recall the main message of the GNS compared to the TBS (30/43, 70%, vs 1/54, 2%; P<.001). CONCLUSIONS: It is feasible to use a graphic narrative embedded in a broadcast screensaver to communicate a guideline recommendation, but further study is needed to determine the impact of graphic narratives on clinical practice.

Insourcing and scaling a telemedicine solution in under 2 weeks: Lessons for the digital transformation of health care.

The Covid-19 pandemic required rapid scale of telemedicine as well as other digital workflows to maintain access to care while reducing infection risk. Both patients and clinicians who hadn't used telemedicine before were suddenly faced with a multi-step setup process to log into a virtual meeting. Unlike in-person examination rooms, locking a virtual meeting room was more error-prone and posed a risk of multiple patients joining the same online session. There was administrative burden on the practice staff who were generating and manually sending links to patients, and educating patients on device set up was time-consuming and unsustainable. A solution had to be deployed rapidly system-wide, without the usual roll out across months. Our answer was to design and implement a novel EHR-integrated web application called the Switchboard, in just two weeks. The Switchboard leverages a commercial, cloud-based video meeting platform and facilitates an end-to-end virtual care encounter workflow, from pre-visit reminders to post-visit SMS text message-based measurement of patient experience, with tools to extend contact-less workflows to in-person appointments. Over the first 11 months of the pandemic, the in-house platform has been adopted across 6 hospitals and >200 practices, scaled to 8,800 clinicians who at their peak conducted an average of 30,000 telemedicine appointments/week, and enabled over 10,000-20,000 text messages/day to be exchanged through the platform. Furthermore, it enabled our organization to convert from an average of 75% of telehealth visits being conducted via telephone to 75% conducted via video within weeks.

A Mobile, Electronic Health Record-Connected Application for Managing Team Workflows in Inpatient Care.

BACKGROUND: Clinical workflows require the ability to synthesize and act on existing and emerging patient information. While offering multiple benefits, in many circumstances electronic health records (EHRs) do not adequately support these needs. OBJECTIVES: We sought to design, build, and implement an EHR-connected rounding and handoff tool with real-time data that supports care plan organization and team-based care. This article first describes our process, from ideation and development through implementation; and second, the research findings of objective use, efficacy, and efficiency, along with qualitative assessments of user experience. METHODS: Guided by user-centered design and Agile development methodologies, our interdisciplinary team designed and built Carelign as a responsive web application, accessible from any mobile or desktop device, that gathers and integrates data from a health care institution's information systems. Implementation and iterative improvements spanned January to July 2016. We assessed acceptance via usage metrics, user observations, time-motion studies, and user surveys. RESULTS: By July 2016, Carelign was implemented on 152 of 169 total inpatient services across three hospitals staffing 1,616 hospital beds. Acceptance was near-immediate: in July 2016, 3,275 average unique weekly users generated 26,981 average weekly access sessions; these metrics remained steady over the following 4 years. In 2016 and 2018 surveys, users positively rated Carelign's workflow integration, support of clinical activities, and overall impact on work life. CONCLUSION: User-focused design, multidisciplinary development teams, and rapid iteration enabled creation, adoption, and sustained use of a patient-centered digital workflow tool that supports diverse users' and teams' evolving care plan organization needs.

Vaccipack, A Mobile App to Promote Human Papillomavirus Vaccine Uptake Among Adolescents Aged 11 to 14 Years: Development and Usability Study.

BACKGROUND: More than 90% of human papillomavirus (HPV)-related cancers could be prevented by widespread uptake of the HPV vaccine, yet vaccine use in the United States falls short of public health goals. OBJECTIVE: The purpose of this study was to describe the development, acceptability, and intention to use the mobile app Vaccipack, which was designed to promote uptake and completion of the adolescent HPV vaccine series. METHODS: Development of the mobile health (mHealth) content was based on the integrated behavioral model (IBM). The technology acceptance model (TAM) was used to guide the app usability evaluation. App design utilized an iterative process involving providers and potential users who were parents and adolescents. App features include a vaccine-tracking function, a discussion forum, and stories with embedded messages to promote intention to vaccinate. Parents and adolescents completed surveys before and after introducing the app in a pediatric primary care setting with low HPV vaccination rates. RESULTS: Surveys were completed by 54 participants (20 adolescents aged 11 to 14 years and 34 parents). Notably, 75% (15/20) of adolescents and 88% (30/34) of parents intended to use the app in the next 2 weeks. Acceptability of the app was high among both groups: 88% (30/34) of parents and 75% (15/20) of adolescents indicated that Vaccipack was easy to use, and 82% (28/34) of parents and 85% (17/20) of adolescents perceived the app to be beneficial. Higher levels of app acceptability were found among parents with strong intentions to use the app (P=.09; 95% CI -2.15 to 0.15). CONCLUSIONS: mHealth technology, such as Vaccipack, may be an acceptable and nimble platform for providing information to parents and adolescents and advancing the uptake of important vaccines.

IRIS: A Modular Platform for Continuous Monitoring and Caretaker Notification in the Intensive Care Unit.

OBJECTIVE: New approaches are needed to interpret large amounts of physiologic data continuously recorded in the ICU. We developed and prospectively validated a versatile platform (IRIS) for real-time ICU physiologic monitoring, clinical decision making, and caretaker notification. METHODS: IRIS was implemented in the neurointensive care unit to stream multimodal time series data, including EEG, intracranial pressure (ICP), and brain tissue oxygenation (PbtO2), from ICU monitors to an analysis server. IRIS was applied for 364 patients undergoing continuous EEG, 26 patients undergoing burst suppression monitoring, and four patients undergoing intracranial pressure and brain tissue oxygen monitoring. Custom algorithms were used to identify periods of elevated ICP, compute burst suppression ratios (BSRs), and detect faulty or disconnected EEG electrodes. Hospital staff were notified of clinically relevant events using our secure API to route alerts through a password-protected smartphone application. RESULTS: Sustained increases in ICP and concordant decreases in PbtO2 were reliably detected using user-defined thresholds and alert throttling. BSR trends computed by the platform correlated highly with manual neurologist markings (r2 0.633-0.781; p < 0.0001). The platform identified EEG electrodes with poor signal quality with 95% positive predictive value, and reduced latency of technician response by 93%. CONCLUSION: This study validates a flexible real-time platform for monitoring and interpreting ICU data and notifying caretakers of actionable results, with potential to reduce the manual burden of continuous monitoring services on care providers. SIGNIFICANCE: This work represents an important step toward facilitating translational medical data analytics to improve patient care and reduce health care costs.

Patient Characteristics Associated With Telemedicine Access for Primary and Specialty Ambulatory Care During the COVID-19 Pandemic.

Importance: The coronavirus disease 2019 (COVID-19) pandemic has required a shift in health care delivery platforms, necessitating a new reliance on telemedicine. Objective: To evaluate whether inequities are present in telemedicine use and video visit use for telemedicine visits during the COVID-19 pandemic. Design, Setting, and Participants: In this cohort study, a retrospective medical record review was conducted from March 16 to May 11, 2020, of all patients scheduled for telemedicine visits in primary care and specialty ambulatory clinics at a large academic health system. Age, race/ethnicity, sex, language, median household income, and insurance type were all identified from the electronic medical record. Main Outcomes and Measures: A successfully completed telemedicine visit and video (vs telephone) visit for a telemedicine encounter. Multivariable models were used to assess the association between sociodemographic factors, including sex, race/ethnicity, socioeconomic status, and language, and the use of telemedicine visits, as well as video use specifically. Results: A total of 148 402 unique patients (86 055 women [58.0%]; mean [SD] age, 56.5 [17.7] years) had scheduled telemedicine visits during the study period; 80 780 patients (54.4%) completed visits. Of 78 539 patients with completed visits in which visit modality was specified, 35 824 (45.6%) were conducted via video, whereas 24 025 (56.9%) had a telephone visit. In multivariable models, older age (adjusted odds ratio [aOR], 0.85 [95% CI, 0.83-0.88] for those aged 55-64 years; aOR, 0.75 [95% CI, 0.72-0.78] for those aged 65-74 years; aOR, 0.67 [95% CI, 0.64-0.70] for those aged ≥75 years), Asian race (aOR, 0.69 [95% CI, 0.66-0.73]), non-English language as the patient's preferred language (aOR, 0.84 [95% CI, 0.78-0.90]), and Medicaid insurance (aOR, 0.93 [95% CI, 0.89-0.97]) were independently associated with fewer completed telemedicine visits. Older age (aOR, 0.79 [95% CI, 0.76-0.82] for those aged 55-64 years; aOR, 0.78 [95% CI, 0.74-0.83] for those aged 65-74 years; aOR, 0.49 [95% CI, 0.46-0.53] for those aged ≥75 years), female sex (aOR, 0.92 [95% CI, 0.90-0.95]), Black race (aOR, 0.65 [95% CI, 0.62-0.68]), Latinx ethnicity (aOR, 0.90 [95% CI, 0.83-0.97]), and lower household income (aOR, 0.57 [95% CI, 0.54-0.60] for income <$50 000; aOR, 0.89 [95% CI, 0.85-0.92], for $50 000-$100 000) were associated with less video use for telemedicine visits. These results were similar across medical specialties. Conclusions and Relevance: In this cohort study of patients scheduled for primary care and medical specialty ambulatory telemedicine visits at a large academic health system during the early phase of the COVID-19 pandemic, older patients, Asian patients, and non-English-speaking patients had lower rates of telemedicine use, while older patients, female patients, Black, Latinx, and poorer patients had less video use. Inequities in accessing telemedicine care are present, which warrant further attention.

Effect of an Automated Patient Dashboard Using Active Choice and Peer Comparison Performance Feedback to Physicians on Statin Prescribing: The PRESCRIBE Cluster Randomized Clinical Trial.

Importance: Statins are not prescribed to approximately 50% of patients who could benefit from them. Objective: To evaluate the effectiveness of an automated patient dashboard using active choice framing with and without peer comparison feedback on performance to nudge primary care physicians (PCPs) to increase guideline-concordant statin prescribing. Design, Setting, and Participants: This 3-arm cluster randomized clinical trial was conducted from February 21, 2017, to April 21, 2017, at 32 practice sites in Pennsylvania and New Jersey. Participants included 96 PCPs and 4774 patients not previously receiving statin therapy. Data were analyzed from April 25, 2017, to June 16, 2017. Interventions: Primary care physicians in the 2 intervention arms were emailed a link to an automated online dashboard listing their patients who met national guidelines for statin therapy but had not been prescribed this medication. The dashboard included relevant patient information, and for each patient, PCPs were asked to make an active choice to prescribe atorvastatin, 20 mg, once daily, atorvastatin at another dose, or another statin or not prescribe a statin and select a reason. The dashboard was available for 2 months. In 1 intervention arm, the email to PCPs also included feedback on their statin prescribing rate compared with their peers. Primary care physicians in the usual care group received no interventions. Main Outcomes and Measures: Statin prescription rates. Results: Patients had a mean (SD) age of 62.4 (8.3) years and a mean (SD) 10-year atherosclerotic cardiovascular disease risk score of 13.6 (8.2); 2625 (55.0%) were male, 3040 (63.7%) were white, and 1318 (27.6%) were black. In the active choice arm, 16 of 32 PCPs (50.0%) accessed the patient dashboard, but only 2 of 32 (6.3%) signed statin prescription orders. In the active choice with peer comparison arm, 12 of 32 PCPs (37.5%) accessed the patient dashboard and 8 of 32 (25.0%) signed statin prescription orders. Statins were prescribed in 40 of 1566 patients (2.6%) in the usual care arm, 116 of 1743 (6.7%) in the active choice arm, and 117 of 1465 (8.0%) in the active choice with peer comparison arm. In the main adjusted model, compared with usual care, there was a significant increase in statin prescribing in the active choice with peer comparison arm (adjusted difference in percentage points, 5.8; 95% CI, 0.9-13.5; P = .008), but not in the active choice arm (adjusted difference in percentage points, 4.1; 95% CI, -0.8 to 13.1; P = .11). Conclusions and Relevance: An automated patient dashboard using both active choice framing and peer comparison feedback led to a modest but significant increase in guideline-concordant statin prescribing rates. Trial Registration: ClinicalTrials.gov Identifier: NCT03021759.

Internal Medicine Resident Engagement with a Laboratory Utilization Dashboard: Mixed Methods Study.

The objective of this study was to measure internal medicine resident engagement with an electronic medical record-based dashboard providing feedback on their use of routine laboratory tests relative to service averages. From January 2016 to June 2016, residents were e-mailed a snapshot of their personalized dashboard, a link to the online dashboard, and text summarizing the resident and service utilization averages. We measured resident engagement using e-mail read-receipts and web-based tracking. We also conducted 3 hour-long focus groups with residents. Using grounded theory approach, the transcripts were analyzed for common themes focusing on barriers and facilitators of dashboard use. Among 80 residents, 74% opened the e-mail containing a link to the dashboard and 21% accessed the dashboard itself. We did not observe a statistically significant difference in routine laboratory ordering by dashboard use, although residents who opened the link to the dashboard ordered 0.26 fewer labs per doctor-patient-day than those who did not (95% confidence interval, -0.77 to 0.25; 𝑃 = 0 .31). While they raised several concerns, focus group participants had positive attitudes toward receiving individualized feedback delivered in real time.