Harnessing the potential of data-driven strategies to optimise transfusion practice.

No one doubts the significant variation in the practice of transfusion medicine. Common examples are the variability in transfusion thresholds and the use of tranexamic acid for surgery with likely high blood loss despite evidence-based standards. There is a long history of applying different strategies to address this variation, including education, clinical guidelines, audit and feedback, but the effectiveness and cost-effectiveness of these initiatives remains unclear. Advances in computerised decision support systems and the application of novel electronic capabilities offer alternative approaches to improving transfusion practice. In England, the National Institute for Health and Care Research funded a Blood and Transplant Research Unit (BTRU) programme focussing on 'A data-enabled programme of research to improve transfusion practices'. The overarching aim of the BTRU is to accelerate the development of data-driven methods to optimise the use of blood and transfusion alternatives, and to integrate them within routine practice to improve patient outcomes. One particular area of focus is implementation science to address variation in practice.

Nationally Automated Colonoscopy Performance Feedback Increases Polyp Detection: The NED APRIQOT Randomized Controlled Trial.

BACKGROUND & AIMS: Postcolonoscopy colorectal cancer incidence and mortality rates are higher for endoscopists with low polyp detection rates. Using the UK's National Endoscopy Database (NED), which automatically captures real-time data, we assessed if providing feedback of case-mix-adjusted mean number of polyps (aMNP), as a key performance indicator, improved endoscopists' performance. Feedback was delivered via a theory-informed, evidence-based audit and feedback intervention. METHODS: This multicenter, prospective, NED Automated Performance Reports to Improve Quality Outcomes Trial randomized National Health Service endoscopy centers to intervention or control. Intervention-arm endoscopists were e-mailed tailored monthly reports automatically generated within NED, informed by qualitative interviews and behavior change theory. The primary outcome was endoscopists' aMNP during the 9-month intervention. RESULTS: From November 2020 to July 2021, 541 endoscopists across 36 centers (19 intervention; 17 control) performed 54,770 procedures during the intervention, and 15,960 procedures during the 3-month postintervention period. Comparing the intervention arm with the control arm, endoscopists during the intervention period: aMNP was nonsignificantly higher (7%; 95% CI, -1% to 14%; P = .08). The unadjusted MNP (10%; 95% CI, 1%-20%) and polyp detection rate (10%; 95% CI, 4%-16%) were significantly higher. Differences were not maintained in the postintervention period. In the intervention arm, endoscopists accessing NED Automated Performance Reports to Improve Quality Outcomes Trial webpages had a higher aMNP than those who did not (aMNP, 118 vs 102; P = .03). CONCLUSIONS: Although our automated feedback intervention did not increase aMNP significantly in the intervention period, MNP and polyp detection rate did improve significantly. Engaged endoscopists benefited most and improvements were not maintained postintervention; future work should address engagement in feedback and consider the effectiveness of continuous feedback. CLINICAL TRIALS REGISTRY:  www.isrctn.org ISRCTN11126923 .

Implementing Enhanced Recovery After Surgery for hysterectomy in a hospital network with audit and feedback: A stepped-wedge cluster randomised trial.

OBJECTIVE: To evaluate the effectiveness of implementing the Enhanced Recovery After Surgery (ERAS) protocol in patients undergoing elective hysterectomy in a network of regional hospitals, supported by an intensive audit-and-feedback (A&F) approach. DESIGN: A multi-centre, stepped-wedge cluster randomised trial (ClinicalTrials.gov NCT04063072). SETTING: Gynaecological units in the Piemonte region, Italy. POPULATION: Patients undergoing elective hysterectomy, either for cancer or for benign conditions. METHODS: Twenty-three units (clusters), stratified by surgical volume, were randomised into four sequences. At baseline (first 3 months), standard care was continued in all units. Subsequently, the four sequences implemented the ERAS protocol successively every 3 months, after specific training. By the end of the study, each unit had a period in which standard care was maintained (control) and a period in which the protocol, supported by feedback, was applied (experimental). MAIN OUTCOME MEASURES: Length of hospital stay (LOS), without outliers (>98th percentile). RESULTS: Between September 2019 and May 2021, 2086 patients were included in the main analysis with an intention-to-treat approach: 1104 (53%) in the control period and 982 (47%) in the ERAS period. Compliance with the ERAS protocol increased from 60% in the control period to 76% in the experimental period, with an adjusted absolute difference of +13.3% (95% CI 11.6% to 15.0%). LOS, moving from 3.5 to 3.2 days, did not show a significant reduction (-0.12 days; 95% CI -0.30 to 0.07 days). No difference was observed in the occurrence of complications. CONCLUSIONS: Implementation of the ERAS protocol for hysterectomy at the regional level, supported by an A&F approach, resulted in a substantial improvement in compliance, but without meaningful effects on LOS and complications. This study confirms the effectiveness of A&F in promoting important innovations in an entire hospital network and suggests the need of a higher compliance with the ERAS protocol to obtain valuable improvements in clinical outcomes.

Incorporating clinician insight and care plans into an audit and feedback initiative for antipsychotic prescribing to Medicaid-enrolled youth in Philadelphia.

BACKGROUND: Audit and feedback (A/F), which include initiatives like report cards, have an inconsistent impact on clinicians' prescribing behavior. This may be attributable to their focus on aggregate prescribing measures, a one-size-fits-all approach, and the fact that A/F initiatives rarely engage with the clinicians they target. METHODS: In this study, we describe the development and delivery of a report card that summarized antipsychotic prescribing to publicly-insured youth in Philadelphia, which was introduced by a Medicaid managed care organization in 2020. In addition to measuring aggregate prescribing behavior, the report card included different elements of care plans, including whether youth were receiving polypharmacy, proper medication management, and the concurrent use of behavioral health outpatient services. The A/F initiative elicited feedback from clinicians, which we refer to as an "audit and feedback loop." We also evaluate the impact of the report card by comparing pre-post differences in prescribing measures for clinicians who received the report card with a group of clinicians who did not receive the report card. RESULTS: Report cards indicated that many youth who were prescribed antipsychotics were not receiving proper medication management or using behavioral health outpatient services alongside the antipsychotic prescription, but that polypharmacy was rare. In their feedback, clinicians who received report cards cited several challenges related to antipsychotic prescribing, such as the logistical difficulties of entering lab orders and family members' hesitancy to change care plans. The impact of the report card was mixed: there was a modest reduction in the share of youth receiving polypharmacy following the receipt of the report card, while other measures did not change. However, we documented a large reduction in the number of youth with one or more antipsychotic prescription fill among clinicians who received a report card. CONCLUSIONS: A/F initiatives are a common approach to improving the quality of care, and often target specific practices such as antipsychotic prescribing. Report cards are a low-cost and feasible intervention but there is room for quality improvement, such as adding measures that track medication management or eliciting feedback from clinicians who receive report cards. To ensure that the benefits of antipsychotic prescribing outweigh its risks, it is important to promote quality and safety of antipsychotic prescribing within a broader care plan.

Implementation of an audit and feedback module targeting low-value clinical practices in a provincial trauma quality assurance program: a cost-effectiveness study.

BACKGROUND: Audit and Feedback (A&F) interventions based on quality indicators have been shown to lead to significant improvements in compliance with evidence-based care including de-adoption of low-value practices (LVPs). Our primary aim was to evaluate the cost-effectiveness of adding a hypothetical A&F module targeting LVPs for trauma admissions to an existing quality assurance intervention targeting high-value care and risk-adjusted outcomes. A secondary aim was to assess how certain A&F characteristics might influence its cost-effectiveness. METHODS: We conducted a cost-effectiveness analysis using a probabilistic static decision analytic model in the Québec trauma care continuum. We considered the Québec Ministry of Health perspective. Our economic evaluation compared a hypothetical scenario in which the A&F module targeting LVPs is implemented in a Canadian provincial trauma quality assurance program to a status quo scenario in which the A&F module is not implemented. In scenarios analyses we assessed the impact of A&F characteristics on its cost-effectiveness. Results are presented in terms of incremental costs per LVP avoided. RESULTS: Results suggest that the implementation of A&F module (Cost = $1,480,850; Number of LVPs = 6,005) is associated with higher costs and higher effectiveness compared to status quo (Cost = $1,124,661; Number of LVPs = 8,228). The A&F module would cost $160 per LVP avoided compared to status quo. The A&F module becomes more cost-effective with the addition of facilitation visits; more frequent evaluation; and when only high-volume trauma centers are considered. CONCLUSION: A&F module targeting LVPs is associated with higher costs and higher effectiveness than status quo and has the potential to be cost-effective if the decision-makers' willingness-to-pay is at least $160 per LVP avoided. This likely represents an underestimate of true ICER due to underestimated costs or missed opportunity costs. Results suggest that virtual facilitation visits, frequent evaluation, and implementing the module in high-volume centers can improve cost-effectiveness.

Developing a questionnaire to evaluate an automated audit & feedback intervention: a Rand-modified Delphi method.

BACKGROUND: Audit and feedback (A&F) is a widely used implementation strategy to evaluate and improve medical practice. The optimal design of an A&F system is uncertain and structured process evaluations are currently lacking. This study aimed to develop and validate a questionnaire to evaluate the use of automated A&F systems. METHODS: Based on the Clinical Performance Feedback Intervention Theory (CP-FIT) and the REFLECT-52 (REassessing audit & Feedback interventions: a tooL for Evaluating Compliance with suggested besT practices) evaluation tool a questionnaire was designed for the purpose of evaluating automated A&F systems. A Rand-modified Delphi method was used to develop the process evaluation and obtain validation. Fourteen experts from different domains in primary care consented to participate and individually scored the questions on a 9-point Likert scale. Afterwards, the questions were discussed in a consensus meeting. After approval, the final questionnaire was compiled. RESULTS: A 34-question questionnaire composed of 57 items was developed and presented to the expert panel. The consensus meeting resulted in a selection of 31 questions, subdivided into 43 items. A final list of 30 questions consisting of 42 items was obtained. CONCLUSION: A questionnaire consisting of 30 questions was drawn up for the assessment and improvement of automated A&F systems, based on CP-FIT and REFLECT-52 theory and approved by experts. Next steps will be piloting and implementation of the questionnaire.

Access to automated comparative feedback reports in primary care - a study of intensity of use and relationship with clinical performance among Swedish primary care practices.

BACKGROUND: Digital applications that automatically extract information from electronic medical records and provide comparative visualizations of the data in the form of quality indicators to primary care practices may facilitate local quality improvement (QI). A necessary condition for such QI to work is that practices actively access the data. The purpose of this study was to explore the use of an application that visualizes quality indicators in Swedish primary care, developed by a profession-led QI initiative ("Primärvårdskvalitet"). We also describe the characteristics of practices that used the application more or less extensively, and the relationships between the intensity of use and changes in selected performance indicators. METHODS: We studied longitudinal data on 122 primary care practices' visits to pages (page views) in the application over a period up to 5 years. We compared high and low users, classified by the average number of monthly page views, with respect to practice and patient characteristics as well as baseline measurements of a subset of the performance indicators. We estimated linear associations between visits to pages with diabetes-related indicators and the change in measurements of selected diabetes indicators over 1.5 years. RESULTS: Less than half of all practices accessed the data in a given month, although most practices accessed the data during at least one third of the observed months. High and low users were similar in terms of most studied characteristics. We found statistically significant positive associations between use of the diabetes indicators and changes in measurements of three diabetes indicators. CONCLUSIONS: Although most practices in this study indicated an interest in the automated feedback reports, the intensity of use can be described as varying and on average limited. The positive associations between the use and changes in performance suggest that policymakers should increase their support of practices' QI efforts. Such support may include providing a formalized structure for peer group discussions of data, facilitating both understanding of the data and possible action points to improve performance, while maintaining a profession-led use of applications.

Outpatient management of urinary tract infections by medical officers in Nairobi, Kenya: lack of benefit from audit and feedback on adherence to treatment guidelines.

INTRODUCTION: Acute uncomplicated urinary tract infections are common in outpatient settings but are not treated optimally. Few studies of the outpatient use of antibiotics for specific diagnoses have been done in sub-Saharan Africa, so little is known about the prescribing patterns of medical officers in the region. METHODS: Aga Khan University has 16 outpatient clinics throughout the Nairobi metro area with a medical officer specifically assigned to that clinic. A baseline assessment of evaluation and treatment of suspected UTI was performed from medical records in these clinics. Then the medical officer from each of the 16 clinics was recruited from each clinic was recruited with eight each randomized to control vs. feedback groups. Both groups were given a multimodal educational session including locally adapted UTI guidelines and emphasis on problems identified in the baseline assessment Each record was scored using a scoring system that was developed for the study according to adequacy of history, physical examination, clinical diagnosis matching recorded data, diagnostic workup and treatment. Three audits were done for both groups; baseline (audit 1), post-CME (audit 2), and a final audit, which was after feedback for the feedback group (audit 3). The primary analysis assessed overall guideline adherence in the feedback group versus the CME only group. RESULTS: The overall scores in both groups showed significant improvement after the CME in comparison to baseline and for each group, the scores in most domains also improved. However, audit 3 showed persistence of the gains attained after the CME but no additional benefit from the feedback. Some deficiencies that persisted throughout the study included lack of workup of possible STI and excess use of non-UTI laboratory tests such as CBC, stool culture and H. pylori Ag. After the CME, the use of nitrofurantoin rose from only 4% to 8% and cephalosporin use increased from 49 to 67%, accompanied by a drop in quinolone use. CONCLUSION: The CME led to modest improvements in patient care in the categories of history taking, treatment and investigations, but feedback had no additional effect. Future studies should consider an enforcement element or a more intensive feedback approach.

Adapting a quality improvement collaborative to a new national context: a co-design and feasibility study to improve dementia care in Ireland.

BACKGROUND: Adaptation seeks to increase intervention fit with context, an important influence upon implementation. People with dementia in acute hospitals in Ireland do not routinely receive best care. To improve care in Ireland, we sought to adapt an existing quality improvement collaborative, to support the improvement capabilities of recipients of feedback from the Irish National Audit of Dementia. METHODS: The study followed a staged process to co-design adaptations to reflect contextual differences between the English and the Irish healthcare systems, and to explore feasibility of the adapted Quality Improvement Collaborative in Ireland. We used co-design group meetings involving dementia clinicians from three hospitals, delivered the intervention virtually and interviewed healthcare workers from seven hospitals to adapt and explore the fidelity, affective response and reported appropriateness of the intervention. RESULTS: The intervention required adaptation to reflect differences in strategic intention, ways of working and hospital social structures. There was evidence that the adapted intervention generated a positive affective response, was perceived as appropriate and led to fidelity of receipt and response. CONCLUSION: We describe implications for the adaptation of interventions to increase participants' quality improvement capabilities and highlight the importance of socio-adaptive work. We propose further work to explore antecedents of senior positional leader engagement, to describe the delivery of intra-participant behaviour change techniques and to adapt the intervention to other clinical domains.

Better with GPs as managers? - Variation in perceptions of feedback messages, goal-clarity and performance across manager´s in Swedish primary care.

BACKGROUND: Primary care in several countries is developing towards team-based and multi-professional care, requiring leadership and management capabilities at the primary care practice level. This article reports findings from a study of primary care managers in Sweden, focusing variation in performance and perceptions of feedback messages and goal-clarity, depending on managers' professional background. METHODS: The study was designed as a cross-sectional analysis of primary care practice managers' perceptions combined with registered data on patient-reported performance. Managers perceptions was collected through a survey to all 1 327 primary care practice managers in Sweden. Data about patient-reported performance was collected from the 2021 National Patient Survey in primary care. We used bivariate (Pearson correlation) and multivariate (ordinary least square regression analysis) statistical methods to describe and analyse the possible association between managers' background, responses to survey statements and patient-reported performance. RESULTS: Both GP and non-GP managers had positive perceptions of the quality and support of feedback messages from professional committees focusing medical quality indicators, although managers perceived that the feedback facilitated improvement work to a lower degree. Feedback from the regions as payers scored consistently lower in all dimensions, especially among GP-managers. Results from regression analysis indicate that GP-managers correlate with better patient-reported performance when controlling for selected primary care practice and managerial characteristics. A significant positive relationship with patient-reported performance was also found for female managers, a smaller size of the primary care practice and a good staffing situation of GPs. CONCLUSIONS: Both GP and non-GP managers rated the quality and support of feedback messages from professional committees higher than feedback from regions as payers. Differences in perceptions were especially striking among GP-managers. Patient-reported performance was significantly better in primary care practices managed by GPs and female managers. Variables reflecting structural and organizational, rather than managerial, characteristics contributed with additional explanations behind the variation in patient-reported performance across primary care practices. As we cannot exclude reversed causality, the findings may reflect that GPs are more likely to accept being a manager of a primary care practice with favourable characteristics.

Development and pilot evaluation of an educational session to support sparing opioid prescriptions to opioid naïve patients in a Canadian primary care setting.

BACKGROUND: Prescribing rates of some analgesics decreased during the public health crisis. Yet, up to a quarter of opioid-naïve persons prescribed opioids for noncancer pain develop prescription opioid use disorder. We, therefore, sought to evaluate a pilot educational session to support primary care-based sparing of opioid analgesics for noncancer pain among opioid-naïve patients in British Columbia (BC). METHODS: Therapeutics Initiative in BC has launched an audit and feedback intervention. Individual prescribing portraits were mailed to opioid prescribers, followed by academic detailing webinars. The webinars' learning outcomes included defining the terms opioid naïve and opioid sparing, and educating attendees on the (lack of) evidence for opioid analgesics to treat noncancer pain. The primary outcome was change in knowledge measured by four multiple-choice questions at the outset and conclusion of the webinar. RESULTS: Two hundred participants attended four webinars; 124 (62%) responded to the knowledge questions. Community-based primary care professionals (80/65%) from mostly urban settings (77/62%) self-identified as family physicians (46/37%), residents (22/18%), nurse practitioners (24/19%), and others (32/26%). Twelve participants (10%) recalled receiving the individualized portraits. While the correct identification of opioid naïve definitions increased by 23%, the correct identification of opioid sparing declined by 7%. Knowledge of the gaps in high-quality evidence supporting opioid analgesics and risk tools increased by 26% and 35%, respectively. CONCLUSION: The educational session outlined in this pilot yielded mixed results but appeared acceptable to learners and may need further refinement to become a feasible way to train professionals to help tackle the current toxic drugs crisis.

The effectiveness of canteen manager audit and feedback reports and online menu-labels in encouraging healthier food choices within students' online lunch orders: A pilot cluster randomised controlled trial in primary school canteens in New South Wales, Australia.

Online school canteen lunch ordering systems may offer a unique opportunity to support the implementation of school canteen nutrition polices, while delivering behavioural interventions directly to consumers to influence healthy student purchasing. This cluster randomised controlled trial aimed to test the effectiveness of a menu audit and feedback strategy alone, and in combination with online menu labels in encouraging healthier purchasing from an online school canteen ordering system. Five intervention schools received a menu audit and feedback strategy, plus online menu labels; and five control schools received a delayed menu audit and feedback strategy. Data from 19,799 student lunch orders, containing over 40,000 items were included in the evaluation. Outcomes were assessed at baseline (pre-intervention), follow-up 1 (menu audit and feedback vs control), and follow-up 2 (menu audit and feedback plus online menu labels vs menu audit and feedback alone). From baseline to follow-up 1, the menu audit and feedback strategy alone had no significant effect on the proportion of healthy ('Everyday') and less healthy ('Occasional' or 'Should not be sold') items purchased. From baseline to follow-up 2, schools that received menu audit and feedback plus online menu labels had significantly higher odds of students purchasing 'Everyday' items (OR: 1.19; p = 0.019), and significantly lower odds of students purchasing 'Occasional' (OR: 0.86; p = 0.048) and 'Should not be sold' (OR: 0.52; p < 0.001) items. Menu audit and feedback with the addition of online menu labels was effective in increasing the proportion of healthy items purchased relative to menu audit and feedback in isolation. There may be a greater role for online menu labelling as part of a suite of strategies to improve public health nutrition in schools.

Making the most of audit and feedback to improve diabetes care: a qualitative study of the perspectives of Australian Diabetes Centres.

BACKGROUND: Diabetes has high burden on the health system and the individual, and many people living with diabetes struggle to optimally manage their condition. In Australia, people living with diabetes attend a mixture of primary, secondary and tertiary care centres. Many of these Diabetes Centres participate in the Australian National Diabetes Audit (ANDA), a quality improvement (QI) activity that collects clinical information (audit) and feeds back collated information to participating sites (feedback). Despite receiving this feedback, many process and care outcomes for Diabetes Centres continue to show room for improvement. The purpose of this qualitative study was to inform improvement of the ANDA feedback, identify the needs of those receiving feedback and elicit the barriers to and enablers of optimal feedback use. METHODS: Semi-structured interviews were conducted with representatives of Australian Diabetes Centres, underpinned by the Consolidated Framework for Implementation Research (CFIR). De-identified transcripts were analysed thematically, underpinned by the domains and constructs of the CFIR. RESULTS: Representatives from 14 Diabetes centres participated in this study, including a diverse range of staff typical of the Diabetes Centres who take part in ANDA. In general, participants wanted a shorter report with a more engaging, simplified data visualisation style. Identified barriers to use of feedback were time or resource constraints, as well as access to knowledge about how to use the data provided to inform the development of QI activities. Enablers included leadership engagement, peer mentoring and support, and external policy and incentives. Potential cointerventions to support use include exemplars from clinical change champions and peer leaders, and educational resources to help facilitate change. CONCLUSIONS: This qualitative study supported our contention that the format of ANDA feedback presentation can be improved. Healthcare professionals suggested actionable changes to current feedback to optimise engagement and potential implementation of QI activities. These results will inform redesign of the ANDA feedback to consider the needs and preferences of end users and to provide feedback and other supportive cointerventions to improve care, and so health outcomes for people with diabetes. A subsequent cluster randomised trial will enable us to evaluate the impact of these changes.

Use of the knowledge to action model improved physical therapist adherence to a common clinical practice guideline across multiple settings: a multisite case series.

BACKGROUND: When a new guideline is published there is a need to understand how its recommendations can best be implemented in real-world practice. Yet, guidelines are often published with little to no roadmap for organizations to follow to promote adherence to their recommendations. The purpose of this study was to evaluate the impact of using a common process model to implement a single clinical practice guideline across multiple physical therapy clinical settings. METHODS: Five organizationally distinct sites with physical therapy services for patients with peripheral vestibular hypofunction participated. The Knowledge to Action model served as the foundation for implementation of a newly published guideline. Site leaders conducted preliminary gap surveys and face-to-face meetings to guide physical therapist stakeholders' identification of target-behaviors for improved guideline adherence. A 6-month multimodal implementation intervention included local opinion leaders, audit and feedback, fatigue-resistant reminders, and communities of practice. Therapist adherence to target-behaviors for the 6 months before and after the intervention was the primary outcome for behavior change. RESULTS: Therapist participants at all sites indicated readiness for change and commitment to the project. Four sites with more experienced therapists selected similar target behaviors while the fifth, with more inexperienced therapists, identified different goals. Adherence to target behaviors was mixed. Among four sites with similar target behaviors, three had multiple areas of statistically significantly improved adherence and one site had limited improvement. Success was most common with behaviors related to documentation and offering patients low technology resources to support home exercise. A fifth site showed a trend toward improved therapist self-efficacy and therapist behavior change in one provider location. CONCLUSIONS: The Knowledge to Action model provided a common process model for sites with diverse structures and needs to implement a guideline in practice. Multimodal, active interventions, with a focus on auditing adherence to therapist-selected target behaviors, feedback in collaborative monthly meetings, fatigue-resistant reminders, and developing communities of practice was associated with long-term improvement in adherence. Local rather than external opinion leaders, therapist availability for community building meetings, and rate of provider turnover likely impacted success in this model. TRIAL REGISTRATION: This study does not report the results of a health care intervention on human participants.

Implementation and Evaluation of a Digitally Enabled Precision Public Health Intervention to Reduce Inappropriate Gabapentinoid Prescription: Cluster Randomized Controlled Trial.

BACKGROUND: Digital technologies can enable rapid targeted delivery of audit and feedback interventions at scale. Few studies have evaluated how mode of delivery affects clinical professional behavior change and none have assessed the feasibility of such an initiative at a national scale. OBJECTIVE: The aim of this study was to develop and evaluate the effect of audit and feedback by digital versus postal (letter) mode of delivery on primary care physician behavior. METHODS: This study was developed as part of the Veterans' Medicines Advice and Therapeutics Education Services (MATES) program, an intervention funded by the Australian Government Department of Veterans' Affairs that provides targeted education and patient-specific audit with feedback to Australian general practitioners, as well as educational material to veterans and other health professionals. We performed a cluster randomized controlled trial of a multifaceted intervention to reduce inappropriate gabapentinoid prescription, comparing digital and postal mode of delivery. All veteran patients targeted also received an educational intervention (postal delivery). Efficacy was measured using a linear mixed-effects model as the average number of gabapentinoid prescriptions standardized by defined daily dose (individual level), and number of veterans visiting a psychologist in the 6 and 12 months following the intervention. RESULTS: The trial involved 2552 general practitioners in Australia and took place in March 2020. Both intervention groups had a significant reduction in total gabapentinoid prescription by the end of the study period (digital: mean reduction of 11.2%, P=.004; postal: mean reduction of 11.2%, P=.001). We found no difference between digital and postal mode of delivery in reduction of gabapentinoid prescriptions at 12 months (digital: -0.058, postal: -0.058, P=.98). Digital delivery increased initiations to psychologists at 12 months (digital: 3.8%, postal: 2.0%, P=.02). CONCLUSIONS: Our digitally delivered professional behavior change intervention was feasible, had comparable effectiveness to the postal intervention with regard to changes in medicine use, and had increased effectiveness with regard to referrals to a psychologist. Given the logistical benefits of digital delivery in nationwide programs, the results encourage exploration of this mode in future interventions.

Improving the Development and Implementation of Audit and Feedback Systems to Support Health Care Workers in Limiting Antimicrobial Resistance in the Hospital: Scoping Review.

BACKGROUND: For eHealth technologies in general and audit and feedback (AF) systems specifically, integrating interdisciplinary theoretical underpinnings is essential, as it increases the likelihood of achieving desired outcomes by ensuring a fit among eHealth technology, stakeholders, and their context. In addition, reporting on the development and implementation process of AF systems, including substantiations of choices, enables the identification of best practices and accumulation of knowledge across studies but is often not elaborated on in publications. OBJECTIVE: This scoping review aims to provide insights into the development and implementation strategies for AF systems for a real-world problem that threatens modern health care-antimicrobial resistance-and provide an interdisciplinary conceptual framework that can serve as a checklist and guidance for making informed choices in the development and implementation of future AF systems. METHODS: A scoping review was conducted by querying PubMed, Scopus, Web of Science, IEEE Xplore Digital Library, and Embase (≥2010) for studies describing either the development or implementation process, or both, of an AF system for antimicrobial resistance or infections in hospitals. Studies reporting only on effectiveness or impact were excluded. A total of 3 independent reviewers performed the study selection, and 2 reviewers constructed the conceptual framework through the axial and selective coding of often-used theories, models, and frameworks (TMFs) from the literature on AF and eHealth development and implementation. Subsequently, the conceptual framework was used for the systematic extraction and interpretation of the studies' descriptions of AF systems and their development and implementation. RESULTS: The search resulted in 2125 studies that were screened for eligibility, of which 12 (0.56%); 2012-2020) were included. These studies described the development and implementation processes heterogeneously in terms of study aims, study targets, target groups, methods, and theoretical underpinnings. Few studies have explicitly explained how choices for the development and implementation of AF systems were substantiated by the TMFs. The conceptual framework provided insights into what is reported on the development and implementation process and revealed underreported AF system constructs (eg, AF system design; engagement with the AF system; and comparison, goal setting, and action planning) and development and implementation (eg, champions) constructs. CONCLUSIONS: This scoping review showed the current heterogeneous reporting of AF systems and their development and implementation processes and exemplified how interdisciplinary TMFs can (and should) be balanced in a conceptual framework to capture relevant AF systems and development and implementation constructs. Thereby, it provides a concrete checklist and overall guidance that supports the professionalization and harmonization of AF system development and implementation. For the development and implementation of future AF systems and other eHealth technologies, researchers and health care workers should be supported in selecting and integrating TMFs into their development and implementation process and encouraged to explicitly report on theoretical underpinnings and the substantiation of choices.

Prevalence of Effective Audit-and-Feedback Practices in Primary Care Settings: A Qualitative Examination Within Veterans Health Administration.

OBJECTIVE: The purpose of this study is to uncover and catalog the various practices for delivering and disseminating clinical performance in various Veterans Affairs (VA) locations and to evaluate their quality against evidence-based models of effective feedback as reported in the literature. BACKGROUND: Feedback can enhance clinical performance in subsequent performance episodes. However, evidence is clear that the way in which feedback is delivered determines whether performance is harmed or improved. METHOD: We purposively sampled 16 geographically dispersed VA hospitals based on high, low, consistently moderate, and moderately average highly variable performance on a set of 17 outpatient clinical performance measures. We excluded four sites due to insufficient interview data. We interviewed four key personnel from each location (n = 48) to uncover effective and ineffective audit and feedback strategies. Interviews were transcribed and analyzed qualitatively using a framework-based content analysis approach to identify emergent themes. RESULTS: We identified 102 unique strategies used to deliver feedback. Of these strategies, 64 (62.74%) have been found to be ineffective according to the audit-and-feedback research literature. Comparing features common to effective (e.g., individually tailored, computerized feedback reports) versus ineffective (e.g., large staff meetings) strategies, most ineffective strategies delivered feedback in meetings, whereas strategies receiving the highest effectiveness scores delivered feedback via visually understood reports that did not occur in a group setting. CONCLUSIONS: Findings show that current practices are leveraging largely ineffective feedback strategies. Future research should seek to identify the longitudinal impact of current feedback and audit practices on clinical performance. APPLICATION: Feedback in primary care has little standardization and does not follow available evidence for effective feedback design. Future research in this area is warranted.

[Effects of statutory quality assurance in acute inpatient care]. / Effekte der gesetzlichen Qualitätssicherung in der akutstationären Versorgung.

BACKGROUND: Statutory quality assurance (QA) serves to ensure and further develop the quality of service provision. Particularly prominent in Germany's acute inpatient care are mandatory quality reports (QRs) and participation in external quality assessments (eQAs). Their effects have not yet been comprehensively evaluated. OBJECTIVES: What are the effects of eQAs and QRs on the quality of care? MATERIALS AND METHODS: Based on a selective literature review, international evidence on the effects of QA was compiled. This was supplemented by analyses of the quality reports of the Federal Office for Quality Assurance (BQS), the Institute for Applied Quality Improvement and Research in Health Care (AQUA), and the Institute for Quality Assurance and Transparency in Healthcare (IQTIG), which have been responsible for eQAs since 2001. RESULTS: According to international literature, at most weak effects of these measures can be expected, especially on process quality. Studies from Germany mostly observe only uncontrolled temporal trends and partly show improved quality indicators. Only one controlled study each was able to show weak positive effects on outcome and process quality for eQAs and QRs, respectively. CONCLUSIONS: There are no convincing evaluation results for either the QRs or the eQAs. Deficiencies in the addressee-oriented design of the QRs and the reported indicator results in terms of their validity, risk adjustment, and temporal availability can be cited as potential causes. Statutory QA should be revised by paying more attention to the prerequisites for successful performance feedback and by again creating room for an intrinsically motivated assessment of one's own quality of care.

Performance of a Supervisor Observational Coding System and an Audit and Feedback Intervention.

Workplace-based clinical supervision is common in community based mental health care for youth and families and could be a leveraged to scale and improve the implementation of evidence-based treatment (EBTs). Accurate methods are needed to measure, monitor, and support supervisor performance with limited disruption to workflow. Audit and Feedback (A&F) interventions may offer some promise in this regard. The study-a randomized controlled trial with 60 clinical supervisors measured longitudinally for 7 months-had two parts: (1) psychometric evaluation of an observational coding system for measuring adherence and competence of EBT supervision and (2) evaluation of an experimental Supervisor Audit and Feedback (SAF) intervention on outcomes of supervisor adherence and competence. All supervisors recorded and uploaded weekly supervision sessions for 7 months, and those in the experimental condition were provided a single, monthly web-based feedback report. Psychometric performance was evaluated using measurement models based in Item Response Theory, and the effect of the SAF intervention was evaluated using mixed-effects regression models. The observational instrument performed well across psychometric indicators of dimensionality, rating scale functionality, and item fit; however, coder reliability was lower for competence than for adherence. Statistically significant A&F effects were largely in the expected directions and consistent with hypotheses. The observational coding system performed well, and a monthly electronic feedback report showed promise in maintaining or improving community-based clinical supervisors' adherence and, to a lesser extent, competence. Limitations discussed include unknown generalizability to the supervision of other EBTs.

Thinking Beyond the "Core" Antibiotic Stewardship Interventions: Shifting the Onus for Appropriate Antibiotic Use from Stewardship Teams to Prescribing Clinicians.

United States guidance for hospital antibiotic stewardship has emphasized prospective audit and feedback and prior authorization of select antibiotics as core interventions. These remain the most common interventions implemented by stewardship programs. Although these approaches have been shown to reduce unnecessary antibiotic use, they incorrectly put the onus for appropriate antibiotic use on the stewardship team rather than the prescribing clinician. We propose that a primary focus of stewardship programs should be implementation of broader interventions that engage frontline clinicians and equip them with tools to integrate antibiotic stewardship into their own daily practice, thus reducing the need for day-to-day stewardship team oversite. We discuss a framework of broader interventions and policies that will facilitate this paradigm shift.