RESUMEN
BACKGROUND & AIMS: Postcolonoscopy colorectal cancer incidence and mortality rates are higher for endoscopists with low polyp detection rates. Using the UK's National Endoscopy Database (NED), which automatically captures real-time data, we assessed if providing feedback of case-mix-adjusted mean number of polyps (aMNP), as a key performance indicator, improved endoscopists' performance. Feedback was delivered via a theory-informed, evidence-based audit and feedback intervention. METHODS: This multicenter, prospective, NED Automated Performance Reports to Improve Quality Outcomes Trial randomized National Health Service endoscopy centers to intervention or control. Intervention-arm endoscopists were e-mailed tailored monthly reports automatically generated within NED, informed by qualitative interviews and behavior change theory. The primary outcome was endoscopists' aMNP during the 9-month intervention. RESULTS: From November 2020 to July 2021, 541 endoscopists across 36 centers (19 intervention; 17 control) performed 54,770 procedures during the intervention, and 15,960 procedures during the 3-month postintervention period. Comparing the intervention arm with the control arm, endoscopists during the intervention period: aMNP was nonsignificantly higher (7%; 95% CI, -1% to 14%; P = .08). The unadjusted MNP (10%; 95% CI, 1%-20%) and polyp detection rate (10%; 95% CI, 4%-16%) were significantly higher. Differences were not maintained in the postintervention period. In the intervention arm, endoscopists accessing NED Automated Performance Reports to Improve Quality Outcomes Trial webpages had a higher aMNP than those who did not (aMNP, 118 vs 102; P = .03). CONCLUSIONS: Although our automated feedback intervention did not increase aMNP significantly in the intervention period, MNP and polyp detection rate did improve significantly. Engaged endoscopists benefited most and improvements were not maintained postintervention; future work should address engagement in feedback and consider the effectiveness of continuous feedback. CLINICAL TRIALS REGISTRY: www.isrctn.org ISRCTN11126923 .
RESUMEN
OBJECTIVE: To estimate and quantify the cost implications and health impacts of improving the performance of English endoscopy services to the optimum quality as defined by postcolonoscopy colorectal cancer (PCCRC) rates. DESIGN: A semi-Markov state-transition model was constructed, following the logical treatment pathway of individuals who could potentially undergo a diagnostic colonoscopy. The model consisted of three identical arms, each representing a high, middle or low-performing trust's endoscopy service, defined by PCCRC rates. A cohort of 40-year-old individuals was simulated in each arm of the model. The model's time horizon was when the cohort reached 90 years of age and the total costs and quality-adjusted life-years (QALYs) were calculated for all trusts. Scenario and sensitivity analyses were also conducted. RESULTS: A 40-year-old individual gains 0.0006 QALYs and savings of £6.75 over the model lifetime by attending a high-performing trust compared with attending a middle-performing trust and gains 0.0012 QALYs and savings of £14.64 compared with attending a low-performing trust. For the population of England aged between 40 and 86, if all low and middle-performing trusts were improved to the level of a high-performing trust, QALY gains of 14 044 and cost savings of £249 311 295 are possible. Higher quality trusts dominated lower quality trusts; any improvement in the PCCRC rate was cost-effective. CONCLUSION: Improving the quality of endoscopy services would lead to QALY gains among the population, in addition to cost savings to the healthcare provider. If all middle and low-performing trusts were improved to the level of a high-performing trust, our results estimate that the English National Health Service would save approximately £5 million per year.
RESUMEN
BACKGROUND: Audit and feedback (A&F) interventions improve patient care but may result in unintended consequences. To evaluate plausible harms and maximise benefits, theorisation using logic models can be useful. We aimed to explore the adverse effects of colonoscopy A&F using a feedback intervention theory (FIT) dark logic model before the National Endoscopy Database Automated Performance Reports to Improve Quality Outcomes Trial study. METHODS: We undertook a qualitative study exploring A&F practices in colonoscopy. Interviews were undertaken with endoscopists from six English National Health Service endoscopy centres, purposively sampled for professional background and experience. A thematic framework analysis was performed, mapping paradoxical effects and harms using FIT and the theory of planned behaviour. RESULTS: Data saturation was achieved on the 19th participant, with participants from nursing, surgical and medical backgrounds and a median of 7 years' experience.When performance was below aspirational targets participants were falsely reassured by social comparisons. Participants described confidence as a requirement for colonoscopy. Negative feedback without a plan to improve risked reducing confidence and impeding performance (cognitive interference). Unmet targets increased anxiety and prompted participants to question messages' motives and consider gaming.Participants described inaccurate documentation of subjective measures, including patient comfort, to achieve targets perceived as important. Participants described causing harm from persevering to complete procedures despite patient discomfort and removing insignificant polyps to improve detection rates without benefiting the patient. CONCLUSION: Our dark logic model highlighted that A&F interventions may create both desired and adverse effects. Without a priori theorisation evaluations may disregard potential harms. In colonoscopy, improved patient experience measures may reduce harm. To address cognitive interference the motivation of feedback to support improvement should always be clear, with plans targeting specific behaviours and offering face-to-face support for confidence. TRIAL REGISTRATION NUMBER: ISRCTN11126923.