Enhancing self-regulation and learner engagement in L2 speaking: exploring the potential of intelligent personal assistants within a learning-oriented feedback framework.

INTRODUCTION: Developing L2 speaking proficiency can be challenging for learners, particularly when it comes to fostering self-regulation and maintaining engagement. Intelligent Personal Assistants (IPAs) offer a potential solution by providing accessible, interactive language learning opportunities. METHODS: This mixed-methods study investigated the effectiveness of using Google Assistant within a learning-oriented feedback (LOA) framework to enhance L2 speaking proficiency, self-regulation, and learner engagement among 54 university-level EFL learners in China. Convenience sampling assigned participants to either an experimental group (n = 27) using Google Assistant with tailored activities or a control group (n = 27) using traditional methods. The Oral Proficiency Interview (OPI) assessed speaking performance. Self-reported questionnaires measured L2 motivation and the Scale of Strategic Self-Regulation for Speaking English as a Foreign Language (S2RS-EFL) evaluated speaking self-regulation. Additionally, semi-structured interviews with a subsample of the experimental group provided qualitative insights. RESULTS: The Google Assistant group demonstrated a statistically significant improvement in speaking performance compared to the control group. While no significant difference in motivation was found, thematic analysis of interviews revealed perceived benefits of Google Assistant, including increased accessibility, interactivity, and immediate pronunciation feedback. These features likely contributed to a more engaging learning experience, potentially fostering self-regulation development in line with the core principles of LOA. CONCLUSION: This study suggests Google Assistant as a promising supplementary tool for enhancing L2 speaking proficiency, learner autonomy, and potentially self-regulation within an LOA framework. Further research is needed to explore its impact on motivation and optimize engagement strategies.

Enhancing Laryngoscopy Mastery: The Impact of Autonomous Practice with Feedback-Providing Simulators.

Mastery learning with fixed end points and variable training time leads to more consistent expertise but is difficult to implement. Here we piloted mastery learning of laryngoscopy with independent practice. 35 learners participated in independent mastery learning on a manikin that provides automated performance feedback. A pre- and postpractice assessment of intubation skills was completed. After an average of 21 minutes of open practice, the percentage of subjects that met mastery criteria improved from 24% to 89% (P < .05). Independent intubation practice with manikin feedback facilitated mastery learning, enhanced procedural education, and may impact clinical care.

How is your feedback perceived? An experimental study of anticipated and delayed conversational feedback.

This article presents a different experiment examining the impact of feedback timing on its perception. Dialog sequences, featuring a main speaker's utterance followed by a listener's feedback, were extracted from spontaneous conversations. The original feedback instances were manipulated to be produced earlier, up to 1.5 s in advance, or to be delayed, up to 2 s later. Participants evaluated the feedback acceptability and engagement level of the listener. The findings reveal that 76% of the time feedback remains acceptable regardless of the delay. However, engagement decreases after a 1-s delay while no consistent effect is observed for feedback anticipation.

How to Design Effective Audit and Feedback Interventions With Nurses: A Set of Hypotheses Based on Qualitative and Quantitative Evidence.

OBJECTIVE: To propose practical hypotheses on audit and feedback that support the effectiveness with nurses. BACKGROUND: Audit and feedback interventions have been mainly studied with physicians; however, the processes have been practiced by nurses for years. Nurses' response may differ from that of physicians and other healthcare disciplines because of their roles, power, and the configuration of nursing activities. METHODS: A comparative analysis of the Clinical Performance Feedback Intervention Theory was conducted using nursing-specific empirical data from: 1) a mixed-methods systematic review and 2) a pilot study of audit and feedback with a team of primary care nurses. RESULTS: Researchers hypothesize that audit and feedback interventions are more effective when: 1) feedback emphasizes how it relates to the relational aspect of nursing; 2) indicators are measured and reported at team level; and 3) feedback is provided in a way that highlights benefits to nurses' practice, such as the potential to reduce workload. CONCLUSION: These proposed hypotheses provide concrete guidance to researchers and managers for an effective use of audit and feedback as a quality improvement strategy with nurses.

Feedback and Financial Incentives for Reducing Cell Phone Use While Driving: A Randomized Clinical Trial.

Importance: Handheld phone use while driving is a major factor in vehicle crashes. Scalable interventions are needed to encourage drivers not to use their phones. Objective: To test whether interventions involving social comparison feedback and/or financial incentives can reduce drivers' handheld phone use. Design, Setting, and Participants: In a randomized clinical trial, interventions were administered nationwide in the US via a mobile application in the context of a usage-based insurance program (Snapshot Mobile application). Customers were eligible to be invited to participate in the study if enrolled in the usage-based insurance program for 30 to 70 days. The study was conducted from May 13 to June 30, 2019. Analysis was completed December 22, 2023. Interventions: Participants were randomly assigned to 1 of 6 trial arms for a 7-week intervention period: (1) control; (2) feedback, with weekly push notification about their handheld phone use compared with that of similar others; (3) standard incentive, with a maximum $50 award at the end of the intervention based on how their handheld phone use compared with similar others; (4) standard incentive plus feedback, combining interventions of arms 2 and 3; (5) reframed incentive plus feedback, with a maximum $7.15 award each week, framed as participant's to lose; and (6) doubled reframed incentive plus feedback, a maximum $14.29 weekly loss-framed award. Main Outcome and Measure: Proportion of drive time engaged in handheld phone use in seconds per hour (s/h) of driving. Analyses were conducted with the intention-to-treat approach. Results: Of 17 663 customers invited by email to participate, 2109 opted in and were randomized. A total of 2020 drivers finished the intervention period (68.0% female; median age, 30 [IQR, 25-39] years). Median baseline handheld phone use was 216 (IQR, 72-480) s/h. Relative to control, feedback and standard incentive participants did not reduce their handheld phone use. Standard incentive plus feedback participants reduced their use by -38 (95% CI, -69 to -8) s/h (P = .045); reframed incentive plus feedback participants reduced their use by -56 (95% CI, -87 to -26) s/h (P < .001); and doubled reframed incentive plus feedback participants reduced their use by -42 s/h (95% CI, -72 to -13 s/h; P = .007). The 5 active treatment arms did not differ significantly from each other. Conclusions and Relevance: In this randomized clinical trial, providing social comparison feedback plus incentives reduced handheld phone use while individuals were driving. Trial Registration: ClinicalTrials.gov Identifier: NCT03833219.

Comparative study on the impact of 'Infographic versus video feedback' on enhancing students' clinical skills in basic life support.

BACKGROUND: Effective cardiopulmonary resuscitation (CPR) training for nursing students is crucial for improving patient outcomes in cardiac arrest scenarios. This study assesses the impact of infographic versus video feedback on enhancing nursing students' clinical skills in Basic Life Support (BLS). METHODS: In a randomized controlled setting, 76 nursing students at Torbat Heydariyeh University of Medical Sciences were divided into two groups: one received infographic-based education and the other video feedback training. Pre- and post-intervention assessments measured knowledge and skill retention using validated questionnaires. RESULTS: Post-training, the infographic group showed significantly higher knowledge scores, while the video feedback group exhibited greater improvement in CPR skill performance. No significant differences were noted in pre-training assessment scores between the groups. CONCLUSION: Infographic-based education enhances BLS knowledge retention, and video feedback improves practical CPR skills. This suggests potential benefits of a combined infographic and video feedback approach for optimizing CPR training outcomes, addressing a critical need in medical education.

Feedback in an Entrustment-Based Objective Structured Clinical Examination: Analysis of Content and Scoring Methods.

Background The integration of entrustable professional activities (EPAs) within objective structured clinical examinations (OSCEs) has yielded a valuable avenue for delivering timely feedback to residents. However, concerns about feedback quality persist. Objective This study aimed to assess the quality and content alignment of verbal feedback provided by examiners during an entrustment-based OSCE. Methods We conducted a progress test OSCE for internal medicine residents in 2022, assessing 7 EPAs. The immediate 2-minute feedback provided by examiners was recorded and analyzed using the Quality of Assessment of Learning (QuAL) score. We also analyzed the degree of alignment with EPA learning objectives: competency milestones and task-specific abilities. In a randomized crossover experiment, we compared the impact of 2 scoring methods used to assess residents' clinical performance (3-point entrustability scales vs task-specific checklists) on feedback quality and alignment. Results Twenty-one examiners provided feedback to 67 residents. The feedback demonstrated high quality (mean QuAL score 4.3 of 5) and significant alignment with the learning objectives of the EPAs. On average, examiners addressed in their feedback 2.5 milestones (61%) and 1.2 task-specific abilities (46%). The scoring methods used had no significant impact on QuAL scores (95% CI -0.3, 0.1, P=.28), alignment with competency milestones (95% CI -0.4, 0.1, P=.13), or alignment with task-specific abilities (95% CI -0.3, 0.1, P=.29). Conclusions In our entrustment-based OSCE, examiners consistently offered valuable feedback aligned with intended learning outcomes. Notably, we explored high-quality feedback and alignment as separate dimensions, finding no significant impact from our 2 scoring methods on either aspect.

Longitudinal evaluation of an electronic audit and feedback system for patient safety in a large tertiary hospital setting.

Objective: This study sought to assess the impact of a novel electronic audit and feedback (e-A&F) system on patient outcomes. Methods: The e-A&F intervention was implemented in a tertiary hospital and involved near real-time feedback via web-based dashboards. We used a segmented regression analysis of interrupted time series. We modelled the pre-post change in outcomes for the (1) announcement of this priority list, and (2) implementation of the e-A&F intervention to have affected patient outcomes. Results: Across the study period there were 222,792 episodes of inpatient care, of which 13,904 episodes were found to contain one or more HACs, a risk of 6.24%. From the point of the first intervention until the end of the study the overall risk of a HAC reduced from 8.57% to 4.12% - a 51.93% reduction. Of this reduction the proportion attributed to each of these interventions was found to be 29.99% for the announcement of the priority list and 21.93% for the implementation of the e-A&F intervention. Discussion: Our findings lend evidence to a mechanism that the announcement of a measurement framework, at a national level, can lead to local strategies, such as e-A&F, that lead to significant continued improvements over time.

Characterizing the aggregated encoding method utilizing bursts activated by a VCSEL-neuron with a feedback structure.

The rapid advancement of photonic technologies has facilitated the development of photonic neurons that emulate neuronal functionalities akin to those observed in the human brain. Neuronal bursts frequently occur in behaviors where information is encoded and transmitted. Here, we present the demonstration of the bursting response activated by an artificial photonic neuron. This neuron utilizes a single vertical-cavity surface-emitting laser (VCSEL) and encodes multiple stimuli effectively by varying the spike count during a burst based on the polarization competition in the VCSEL. By virtue of the modulated optical injection in the VCSEL employed to trigger the spiking response, we activate bursts output in the VCSEL with a feedback structure in this scheme. The bursting response activated by the VCSEL-neuron exhibits neural signal characteristics, promising an excitation threshold and the refractory period. Significantly, this marks the inaugural implementation of a controllable integrated encoding scheme predicated on bursts within photonic neurons. There are two remarkable merits; on the one hand, the interspike interval of bursts is distinctly diminished, amounting to merely one twenty-fourth compared to that observed in optoelectronic oscillators. Moreover, the interspike period of bursts is about 70.8% shorter than the period of spikes activated by a VCSEL neuron without optical feedback. Our results may shed light on the analogy between optical and biological neurons and open the door to fast burst encoding-based optical systems with a speed several orders of magnitude faster than their biological counterparts.

Audit and feedback to change diagnostic image ordering practices: A systematic review and meta-analysis.

BACKGROUND: Up to 30% of diagnostic imaging (DI) tests may be unnecessary, leading to increased healthcare costs and the possibility of patient harm. The primary objective of this systematic review was to assess the effect of audit and feedback (AF) interventions directed at healthcare providers on reducing image ordering. The secondary objective was to examine the effect of AF on the appropriateness of DI ordering. METHODS: Studies were identified using MEDLINE, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials and ClinicalTrials.gov registry on December 22nd, 2022. Studies were included if they were randomized control trials (RCTs), targeted healthcare professionals, and studied AF as the sole intervention or as the core component of a multi-faceted intervention. Risk of bias for each study was evaluated using the Cochrane risk of bias tool. Meta-analyses were completed using RevMan software and results were displayed in forest plots. RESULTS: Eleven RCTs enrolling 4311 clinicians or practices were included. AF interventions resulted in 1.5 fewer image test orders per 1000 patients seen than control interventions (95% confidence interval (CI) for the difference -2.6 to -0.4, p-value = 0.009). The effect of AF on appropriateness was not statistically significant, with a 3.2% (95% CI -1.5 to 7.7%, p-value = 0.18) greater likelihood of test orders being considered appropriate with AF vs control interventions. The strength of evidence was rated as moderate for the primary objective but was very low for the appropriateness outcome because of risk of bias, inconsistency in findings, indirectness, and imprecision. CONCLUSION: AF interventions are associated with a modest reduction in total DI ordering with moderate certainty, suggesting some benefit of AF. Individual studies document effects of AF on image order appropriateness ranging from a non-significant trend toward worsening to a highly significant improvement, but the weighted average effect size from the meta-analysis is not statistically significant with very low certainty.

The UK VIRTUS helmet: User feedback from Operation TORAL in Afghanistan.

In 2015, the VIRTUS helmet was introduced to UK Armed Forces and will ultimately replace the Mark 7 combat helmet. The VIRTUS helmet has a reduced trimline compared to the Mark 7 helmet and can incorporate attachments such as a visor, mandible guard and nape protection. An anonymous questionnaire was provided to 200 UK Armed Forces personnel deployed to four locations on Operation TORAL in Afghanistan between September and October 2019. This is the first User feedback survey assessing the VIRTUS helmet in an operational environment. Users were measured to ascertain the fit of their helmet and asked to rate perceived helmet mass and comfort using a 5-point Likert scale. Users were also asked whether the VIRTUS helmet was better than previous helmets and about their use of the nape protection. The VIRTUS helmet was perceived to be an improvement over previously issued UK combat helmets in terms of both comfort and mass.

Making assessment a team sport: a qualitative study of facilitated group feedback in internal medicine residency.

Purpose: Competency-based medical education relies on feedback from workplace-based assessment (WBA) to direct learning. Unfortunately, WBAs often lack rich narrative feedback and show bias towards Medical Expert aspects of care. Building on research examining interactive assessment approaches, the Queen's University Internal Medicine residency program introduced a facilitated, team-based assessment initiative ("Feedback Fridays") in July 2017, aimed at improving holistic assessment of resident performance on the inpatient medicine teaching units. In this study, we aim to explore how Feedback Fridays contributed to formative assessment of Internal Medicine residents within our current model of competency-based training. Method: A total of 53 residents participated in facilitated, biweekly group assessment sessions during the 2017 and 2018 academic year. Each session was a 30-minute facilitated assessment discussion done with one inpatient team, which included medical students, residents, and their supervising attending. Feedback from the discussion was collected, summarized, and documented in narrative form in electronic WBA forms by the program's assessment officer for the residents. For research purposes, verbatim transcripts of feedback sessions were analyzed thematically. Results: The researchers identified four major themes for feedback: communication, intra- and inter-personal awareness, leadership and teamwork, and learning opportunities. Although feedback related to a broad range of activities, it showed strong emphasis on competencies within the intrinsic CanMEDS roles. Additionally, a clear formative focus in the feedback was another important finding. Conclusions: The introduction of facilitated team-based assessment in the Queen's Internal Medicine program filled an important gap in WBA by providing learners with detailed feedback across all CanMEDS roles and by providing constructive recommendations for identified areas for improvement.

Objectif: La formation médicale fondée sur les compétences s'appuie sur la rétroaction faite lors de l'évaluation des apprentissages par observation directe dans le milieu de travail. Malheureusement, les évaluations dans le milieu de travail omettent souvent de fournir une rétroaction narrative exhaustive et privilégient les aspects des soins relevant de l'expertise médicale. En se basant sur la recherche ayant étudié les approches d'évaluation interactive, le programme de résidence en médecine interne de l'Université Queen's a introduit en juillet 2017 une initiative d'évaluation facilitée et en équipe (« Les vendredis rétroaction ¼), visant à améliorer l'évaluation holistique du rendement des résidents dans les unités d'enseignement clinique en médecine interne. Dans cette étude, nous visons à explorer comment ces « vendredis rétroaction ¼ ont contribué à l'évaluation formative des résidents en médecine interne dans le cadre de notre modèle actuel de formation axée sur les compétences. Méthode: Au total, 53 résidents ont participé à des séances d'évaluation de groupe facilitées et bi-hebdomadaires au cours de l'année universitaire 2017-2018. Chaque séance consistait en une discussion d'évaluation facilitée de 30 minutes menée avec une équipe de l'unité de soins, qui comprenait des étudiants en médecine, des résidents et le médecin superviseur. Les commentaires issus de la discussion ont été recueillis, résumés et documentés sous forme narrative dans des formulaires électroniques d'observation directe dans le milieu de travail par le responsable de l'évaluation du programme de résidence. À des fins de recherche, les transcriptions verbatim des séances de rétroaction ont été analysées de façon thématique. Résultats: Les chercheurs ont identifié quatre thèmes principaux pour les commentaires : la communication, la conscience intra- et interpersonnelle, le leadership et le travail d'équipe, et les occasions d'apprentissage. Bien que la rétroaction concerne un large éventail d'activités, elle met fortement l'accent sur les compétences liées aux rôles intrinsèques de CanMEDS. De plus, le fait que la rétroaction avait un rôle clairement formatif est une autre constatation importante. Conclusions: L'introduction de l'évaluation en équipe facilitée dans le programme de médecine interne à Queen's a comblé une lacune importante dans l'apprentissage par observation directe dans le milieu de travail en fournissant aux apprenants une rétroaction détaillée sur tous les rôles CanMEDS et en formulant des recommandations constructives sur les domaines à améliorer.

The efficacy of automated feedback after internet-based depression screening (DISCOVER): an observer-masked, three-armed, randomised controlled trial in Germany.

BACKGROUND: Despite the availability of effective treatments, most depressive disorders remain undetected and untreated. Internet-based depression screening combined with automated feedback of screening results could reach people with depression and lead to evidence-based care. We aimed to test the efficacy of two versions of automated feedback after internet-based screening on depression severity compared with no feedback. METHODS: DISCOVER was an observer-masked, three-armed, randomised controlled trial in Germany. We recruited individuals (aged ≥18 years) who were undiagnosed with depression and screened positive for depression on an internet-based self-report depression rating scale (Patient Health Questionnaire-9 [PHQ-9] ≥10 points). Participants were randomly assigned 1:1:1 to automatically receive no feedback, non-tailored feedback, or tailored feedback on the depression screening result. Randomisation was stratified by depression severity (moderate: PHQ-9 score 10-14 points; severe: PHQ-9 score ≥15 points). Participants could not be masked but were kept unaware of trial hypotheses to minimise expectancy bias. The non-tailored feedback included the depression screening result, a recommendation to seek professional diagnostic advice, and brief general information about depression and its treatment. The tailored feedback included the same basic information but individually framed according to the participants' symptom profiles, treatment preferences, causal symptom attributions, health insurance, and local residence. Research staff were masked to group allocation and outcome assessment as these were done using online questionnaires. The primary outcome was change in depression severity, defined as change in PHQ-9 score 6 months after random assignment. Analyses were conducted following the intention-to-treat principle for participants with at least one follow-up visit. This trial was registered at ClinicalTrials.gov, NCT04633096. FINDINGS: Between Jan 12, 2021, and Jan 31, 2022, 4878 individuals completed the internet-based screening. Of these, 1178 (24%) screened positive for depression (mean age 37·1 [SD 14·2] years; 824 [70%] woman, 344 [29%] men, and 10 [1%] other gender identity). 6 months after random assignment, depression severity decreased by 3·4 PHQ-9 points in the no feedback group (95% CI 2·9-4·0; within-group d 0·67; 325 participants), by 3·5 points in the non-tailored feedback group (3·0-4·0; within-group d 0·74; 319 participants), and by 3·7 points in the tailored feedback group (3·2-4·3; within-group d 0·71; 321 participants), with no significant differences among the three groups (p=0·72). The number of participants seeking help for depression or initiating psychotherapy or antidepressant treatment did not differ among study groups. The results remained consistent when adjusted for fulfilling the DSM-5-based criteria for major depressive disorder or subjective belief of having a depressive disorder. Negative effects were reported by less than 1% of the total sample 6 months after random assignment. INTERPRETATION: Automated feedback following internet-based depression screening did not reduce depression severity or prompt sufficient depression care in individuals previously undiagnosed with but affected by depression. FUNDING: German Research Foundation.

Near real-time patient experience feedback with data relay to providers: a systematic review of its effectiveness.

Near Real-Time Feedback (NRTF) on the patient's experience with care, coupled with data relay to providers, can inform quality-of-care improvements, including at the point of care. The objective is to systematically review contemporary literature on the impact of the use of NRTF and data relay to providers on standardized patient experience measures. Six scientific databases and five specialty journals were searched supplemented by snowballing search strategies, according to the registered study protocol. Eligibility included studies in English (2015-2023) assessing the impact of NRTF and data relay on standardized patient-reported experience measures as a primary outcome. Eligibility and quality appraisals were performed by two independent reviewers. An expert former patient (Patient and Family Advisory Council and communication sciences background) helped interpret the results. Eight papers met review eligibility criteria, including three randomized controlled trials (RCTs) and one non-randomized study. Three of these studies involved in-person NRTF prior to data relay (patient-level data for immediate corrective action or aggregated and peer-compared) and led to significantly better results in all or some of the experience measures. In turn, a kiosk-based NRTF achieved no better experience results. The remaining studies were pre-post designs with mixed or neutral results and greater risks of bias. In-person NRTF on the patient experience followed by rapid data relay to their providers, either patient-level or provider-level as peer-compared, can improve the patient experience of care. Reviewed kiosk-based or self-reported approaches combined with data relay were not effective. Further research should determine which approach (e.g. who conducts the in-person NRTF) will provide better, more efficient improvements and under which circumstances.

Evolutionary Game Dynamics with Environmental Feedback in a Network with Two Communities.

Recent developments of eco-evolutionary models have shown that evolving feedbacks between behavioral strategies and the environment of game interactions, leading to changes in the underlying payoff matrix, can impact the underlying population dynamics in various manners. We propose and analyze an eco-evolutionary game dynamics model on a network with two communities such that players interact with other players in the same community and those in the opposite community at different rates. In our model, we consider two-person matrix games with pairwise interactions occurring on individual edges and assume that the environmental state depends on edges rather than on nodes or being globally shared in the population. We analytically determine the equilibria and their stability under a symmetric population structure assumption, and we also numerically study the replicator dynamics of the general model. The model shows rich dynamical behavior, such as multiple transcritical bifurcations, multistability, and anti-synchronous oscillations. Our work offers insights into understanding how the presence of community structure impacts the eco-evolutionary dynamics within and between niches.

Tunable linear feedback control of urban drainage systems using models defined purely from data.

Real-time and model-predictive control promises to make urban drainage systems (UDS) adaptive, coordinated, and dynamically optimal. Though early implementations are promising, existing control algorithms have drawbacks in computational expense, trust, system-level coordination, and labor cost. Linear feedback control has distinct advantages in computational expense, interpretation, and coordination. However, current methods for building linear feedback controllers require calibrated software models. Here we present an automated method for generating tunable linear feedback controllers that require only system response data. The controller design consists of three main steps: (1) estimating the network connectivity using tools for causal inference, (2) identifying a linear, time-invariant (LTI) dynamical system which approximates the network, and (3) designing and tuning a feedback controller based on the LTI urban drainage system approximation. The flooding safety, erosion prevention, and water treatment performance of the method are evaluated across 190 design storms on a separated sewer model. Strong results suggest that the system knowledge required for generating effective, safe, and tunable controllers for UDS is surprisingly basic. This method allows near-turnkey synthesis of controllers solely from sensor data or reduction of process-based models.

Practice Facilitation and Clinical Performance Feedback Using the Electronic Health Record Improved Blood Pressure and Cholesterol Management in Small Primary Care Practices in New York City.

Cardiovascular disease (CVD) disproportionately affects people of color and those with lower household income. Improving blood pressure (BP) and cholesterol management for those with or at risk for CVD can improve health outcomes. The New York City Department of Health implemented clinical performance feedback with practice facilitation (PF) in 134 small primary care practices serving on average over 84% persons of color. Facilitators reviewed BP and cholesterol management data on performance dashboards and guided practices to identify and outreach to patients with suboptimal BP and cholesterol management. Despite disruptions from the COVID-19 pandemic, practices demonstrated significant improvements in BP (68%-75%, P < .001) and cholesterol management (72%-78%, P = .01). Prioritizing high-need neighborhoods for impactful resource investment, such as PF and data sharing, may be a promising approach to reducing CVD and hypertension inequities in areas heavily impacted by structural racism.

Mailed feedback to primary care physicians on antibiotic prescribing for patients aged 65 years and older: pragmatic, factorial randomised controlled trial.

OBJECTIVES: To evaluate whether providing family physicians with feedback on their antibiotic prescribing compared with that of their peers reduces antibiotic prescriptions. To also identify effects on antibiotic prescribing from case-mix adjusted feedback reports and messages emphasising antibiotic associated harms. DESIGN: Pragmatic, factorial randomised controlled trial. SETTING: Primary care physicians in Ontario, Canada PARTICIPANTS: All primary care physicians were randomly assigned a group if they were eligible and actively prescribing antibiotics to patients 65 years or older. Physicians were excluded if had already volunteered to receive antibiotic prescribing feedback from another agency, or had opted out of the trial. INTERVENTION: A letter was mailed in January 2022 to physicians with peer comparison antibiotic prescribing feedback compared with the control group who did not receive a letter (4:1 allocation). The intervention group was further randomised in a 2x2 factorial trial to evaluate case-mix adjusted versus unadjusted comparators, and emphasis, or not, on harms of antibiotics. MAIN OUTCOME MEASURES: Antibiotic prescribing rate per 1000 patient visits for patients 65 years or older six months after intervention. Analysis was in the modified intention-to-treat population using Poisson regression. RESULTS: 5046 physicians were included and analysed: 1005 in control group and 4041 in intervention group (1016 case-mix adjusted data and harms messaging, 1006 with case-mix adjusted data and no harms messaging, 1006 unadjusted data and harms messaging, and 1013 unadjusted data and no harms messaging). At six months, mean antibiotic prescribing rate was 59.4 (standard deviation 42.0) in the control group and 56.0 (39.2) in the intervention group (relative rate 0.95 (95% confidence interval 0.94 to 0.96). Unnecessary antibiotic prescribing (0.89 (0.86 to 0.92)), prolonged duration prescriptions defined as more than seven days (0.85 (0.83 to 0.87)), and broad spectrum prescribing (0.94 (0.92 to 0.95)) were also significantly lower in the intervention group compared with the control group. Results were consistent at 12 months post intervention. No significant effect was seen for including emphasis on harms messaging. A small increase in antibiotic prescribing with case-mix adjusted reports was noted (1.01 (1.00 to 1.03)). CONCLUSIONS: Peer comparison audit and feedback letters significantly reduced overall antibiotic prescribing with no benefit of case-mix adjustment or harms messaging. Antibiotic prescribing audit and feedback is a scalable and effective intervention and should be a routine quality improvement initiative in primary care. TRIAL REGISTRATION: ClinicalTrials.gov NCT04594200.