Evaluating the Quality of Narrative Feedback for Entrustable Professional Activities in a Surgery Residency Program.

OBJECTIVE: We assessed the quality of narrative feedback given to surgical residents during the first five years of Competency-Based Medical Education (CBME) implementation. SUMMARY BACKGROUND DATA: CBME requires ongoing formative assessments and feedback on learners' performance. METHODS: We conducted a retrospective cross-sectional study using assessments of Entrustable Professional Activities (EPAs) in the Surgical Foundations curriculum at Queen's University from 2017-2022. Two raters independently evaluated quality of narrative feedback using the Quality of Assessment of Learning (QuAL) Score (0-5). RESULTS: A total of 3,900 EPA assessments were completed over 5 years. Fifty-seven percent (2229/3900) of assessments had narrative feedback documented with a mean QuAL score of 2.16±1.49. Of these, 1614 (72.4%) provided evidence about the resident's performance, 951 (42.7%) provided suggestions for improvement, and 499/2229 (22.4%) connected suggestions to the evidence. There was no meaningful change in narrative feedback quality over time (r=0.067, P=0.002). Variables associated with lower quality of narrative feedback include: Attending role (2.04±1.48) compared to medical student (3.13±1.12, P<0.001) and clinical fellow (2.47±1.54, P<0.001), concordant specialties between the assessor and learner (2.06±1.50 vs. 2.21±1.49, P=0.025), completion of the assessment one month or more after the encounter versus one week (1.85±1.48 vs. 2.23±1.49, P<0.001), and resident entrustment versus not entrusted to perform the assessed EPA (2.13±1.45 vs. 2.35±1.66; P=0.008). The quality of narrative feedback was similar for assessments completed under direct and indirect observation (2.18±1.47 vs. 2.06±1.54; P=0.153). CONCLUSIONS: Just over half of the EPA assessments of surgery residents contained narrative feedback with overall fair quality. There was no meaningful change in the quality of feedback over 5 years. These findings prompt future research and faculty development.

Educational Effectiveness of Telementoring as a Continuing Professional Development Intervention for Surgeons in Practice: A Systematic Review.

Objective: We performed a systematic review to determine the educational effectiveness of telementoring as a continuing professional development (CPD) intervention for surgeons in practice. Background: Surgeons can mentor their peers in remote locations using videoconferencing communication, referred to as telementoring. Methods: We searched MEDLINE and EMBASE and included studies assessing the educational effectiveness of telementoring interventions used by surgeons in practice. We excluded studies involving only trainees and those not evaluating educational effectiveness. Two reviewers independently screened, extracted data, and assessed study quality using the Medical Education Research Study Quality Instrument (MERSQI; maximum score 18). Educational outcomes were categorized using Moore's Outcomes Framework. Results: We retrieved a total of 1351 records, and 252 studies were selected for full-text review. Twenty-eight studies were included with 1 randomized controlled trial, 19 cohort studies, 5 qualitative studies, and 3 case studies, totaling 178 surgeons and 499 cases. The average MERSQI score was 10.21 ± 2.2 out of 18. Educational outcomes included surgeons' satisfaction with telementoring interventions (Moore's Level 2) in 12 studies, improvement in surgeons' procedural knowledge (Level 3b) in 3 studies, improvements in surgeons' procedural competence in an educational setting (Level 4) in 4 studies, performance in a workplace-based setting (Level 5) in 23 studies, and patient outcomes (Level 6) in 3 studies. No studies reported community health outcomes (Level 7). Conclusions: Moderate-level evidence demonstrates the use of telementoring as effective in changing surgeons' knowledge and competence in both educational and workplace-based settings. Its use is also associated with changes in patient outcomes.

Learning Outcomes and Educational Effectiveness of E-Learning as a Continuing Professional Development Intervention for Practicing Surgeons and Proceduralists: A Systematic Review.

BACKGROUND: Electronic learning (e-Learning) has become a prevalent mode of delivering medical education. We aimed to determine the learning outcomes and educational effectiveness of e-Learning as a continuing professional development (CPD) intervention for practicing surgeons and proceduralists. METHODS: We searched MEDLINE databases and included studies reporting learning outcomes of e-learning CPD interventions for practicing surgeons and physicians performing technical procedures. We excluded articles only studying surgical trainees and those not reporting learning outcomes. Two reviewers independently screened, extracted data, and assessed study quality using the Critical Appraisal Skills Programme (CASP) tools. Learning outcomes and educational effectiveness were categorized using Moore's Outcomes Framework (PROSPERO: CRD42022333523). RESULTS: Of 1307 identified articles, 12 were included- 9 cohort studies, one randomized controlled trial and 2 qualitative studies, with a total of 2158 participants. Eight studies were rated as moderate, five as strong, and 2 as weak in study quality. E-Learning CPD interventions included web-based modules, image recognition, videos, a repository of videos and schematics, and an online journal club. Seven studies reported participants' satisfaction with the e-Learning interventions (Moore's Level 2), 4 reported improvements in participants' declarative knowledge (Level 3a), 1 reported improvements in procedural knowledge (Level 3b) and five reported improvements in participants' procedural competence in an educational setting (Level 4). No studies demonstrated improvements in participants' workplace-based performance, the health of patients, or community health (Levels 5-7). CONCLUSIONS: E-Learning as a CPD educational intervention is associated with high satisfaction and improvements in knowledge and procedural competencies of practicing surgeons and proceduralists in an educational setting. Future research is required to investigate whether e-Learning is associated with higher-level learning outcomes.

Surgical management of acute life-threatening events affecting esophageal atresia and/or tracheoesophageal fistula patients.

BACKGROUND: Following surgical correction, many patients with esophageal atresia with or without tracheoesophageal fistula (EA/TEF) present to the emergency department (ED) with acute airway complications. We sought to determine the incidence and risk factors for severe acute life-threatening events (ALTEs) in pediatric patients with repaired congenital EA/TEF and the outcomes of operative interventions. METHODS: A retrospective cohort chart review was performed on patients with EA/TEF with surgical repair and follow-up at a single centre from 2000 to 2018. Primary outcomes included 5-year ED visits and/or hospitalizations for ALTEs. Demographic, operative, and outcome data were collected. Chi-square tests and univariate analyses were performed. RESULTS: In total, 266 EA/TEF patients met inclusion criteria. Of these, 59 (22.2%) had experienced ALTEs. Patients with low birth weight, low gestational age, documented tracheomalacia, and clinically significant esophageal strictures were more likely to experience ALTEs (p < 0.05). ALTEs occurred prior to 1 year of age in 76.3% (45/59) of patients with a median age at presentation of 8 months (range 0-51 months). Recurrence of ALTEs after esophageal dilatation was 45.5% (10/22), mostly due to stricture recurrence. Patients experiencing ALTEs received anti-reflux procedures (8/59, 13.6%), airway pexy procedures (7/59, 11.9%), or both (5/59, 8.5%) within a median age of 6 months of life. The resolution and recurrence of ALTEs after operative interventions are described. CONCLUSION: Significant respiratory morbidity is common among patients with EA/TEF. Understanding the multifactorial etiology and operative management of ALTEs have an important role in their resolution. TYPE OF STUDY: Original Research, Clinical Research. LEVEL OF EVIDENCE: Level III Retrospective Comparative Study.

Cardiac changes during the peri-menopausal period in a VCD-induced murine model of ovarian failure.

AIM: Cardiovascular disease (CVD) risk is lower in pre-menopausal females vs age matched males. After menopause risk equals or exceeds that of males. CVD protection of pre-menopausal females is ascribed to high circulating oestrogen levels. Despite experimental evidence that oestrogen are cardioprotective, oestrogen replacement therapy trials have not shown clear benefits. One hypothesis to explain the discrepancy proposed hearts remodel during peri-menopause. Peri-menopasual myocardial changes have never been investigated, nor has the ability of oestrogen to regulate heart function during peri-menopause. METHODS: We injected female mice with 4-vinylcyclohexene diepoxide (VCD, 160 mg/kg/d IP) to cause gradual ovarian failure over 120d and act as a peri-menopausal model RESULTS: Left ventricular function assessed by Langendorff perfusion found no changes in VCD-injected mice at 60 or 120 days compared to intact mice. Cardiac myofilament activity was altered at 60 and 120 days indicating a molecular remodelling in peri-menopause. Myocardial TGF-ß1 increased at 60 days post-VCD treatment along with reduced Akt phosphorylation. Acute activation of oestrogen receptor-α (ERα) or -ß (ERß) depressed left ventricular contractility in hearts from intact mice. ER-regulation of myocardial and myofilament function, and myofilament phosphorylation, were disrupted in the peri-menopausal model. Disruption occurred without alterations in total ERα or ERß expression. CONCLUSIONS: This is the first study to demonstrate remodelling of the heart in a model of peri-menopause, along with a disruption in ER-dependent regulation of the heart. These data indicate that oestrogen replacement therapy initiated after menopause affects a heart that is profoundly different from that found in reproductively intact animals.