What is the Role of Video-Based Assessment of Laparoscopic Surgical Skill in Residency Training? A Qualitative Study of Trainee and Faculty Perspectives.

OBJECTIVES: Surgical training programs are starting to experiment with video-based assessment (VBA) of residents' technical skills. VBA may limit the effect of interpersonal bias on assessment scores. However, before VBA is implemented widely, stakeholders' perceptions ought to be explored, including potential benefits and challenges. METHODS: Using the qualitative methods of hermeneutical phenomenology, the authors explored both trainee and faculty educators' perspectives on VBA using semi-structured interviews. Participants were recruited from the Department of Obstetrics and Gynecology at the University of Toronto. Data underwent thematic analysis and was validated by the investigator and theoretical triangulation. RESULTS: The authors interviewed 9 physicians (5 faculty and 4 residents). Four dominant themes were identified, including advantages compared to traditional methods, the role of feedback and coaching, challenges integrating VBA, and considerations for implementation. CONCLUSIONS: Surgical trainees and faculty feel that VBA is a worthy tool to advance equity and fairness in assessment, but felt it was better as a vehicle for feedback and coaching. VBA cannot be used as a standalone assessment metric without additional evidence for its validity. If implemented, residency programs can use VBA as an adjunct to other evaluation measures to facilitate coaching, provide asynchronous feedback, and limit assessment bias.

"Check Your Vulva"-A Patient Education and Virtual Vulva Care Pilot Project.

OBJECTIVE: The aim of the study is to identify whether vulvar self-examination learned from a web site could lead to a self-identification of vulvar lesions and the feasibility of virtual vulvar care with patient submitted photos. MATERIALS AND METHODS: The study used a prospective cohort design in a tertiary academic hospital over a 1-year period. Eligible participants who self-identified a vulvar lesion/skin changes were invited to send vulvar photos through a secure patient portal and schedule a phone consult to discuss diagnosis/management. Clinical data, photo interpretability, and patient satisfaction measures were collected. Self-referral patients versus vulva clinic waitlist patients were analyzed separately. RESULTS: Few people were interested in submitting vulvar photos online. Twenty-eight participants directly contacted the study, 8 consented, and 6 sent in vulvar photos. Forty four of 476 on the waitlist consented but only 24 of 44 sent in photos (5% of waitlist patients). The median time for a virtual assessment was 7 days for study participants while it was 18 months for the in-person usual care pathway. Most patient submitted photos were assessable. However, 60% participants needed help from another person to take the photos. More than 90% of patients required an in-person visit for their vulvar condition/concerns. While most patients were happy with the virtual process, 58% rated their satisfaction with the ease of taking photos of the genital region as "fair" or "poor." CONCLUSIONS: Virtual care with photos/phone calls might be feasible, although most patients are unlikely to participate. Because of patient discomfort, unease with taking photos, and patient privacy concerns, vulvar care should continue to be in-person for most new consults.

Labour Management in Trial of Labour After Cesarean Delivery (TOLAC): A Gap Analysis and Quality Improvement Initiative.

OBJECTIVE: This quality improvement (QI) initiative was designed to identify gaps between evidence-based or hospital recommendations for trial of labour after cesarean delivery (TOLAC) labour management and clinical practice. METHODS: Viable, singleton pregnancies from January 1, 2016, to December 31, 2018, undergoing TOLAC were extracted from the electronic medical record. Sixty randomly selected charts were reviewed for (1) consent, (2) induction methods, (3) oxytocin use, (4) continuous fetal monitoring, (5) admission indication, (6) examination regularity, (7) duration of dystocia before decision to perform cesarean delivery (CD), and (8) maternal complications. RESULTS: The institutional vaginal birth after cesarean rate was 71%. Documented consent to TOLAC on admission was present in 50% of cases. Oxytocin augmentation was used in 38% of cases, and the median maximum dose was 4 mU/min (interquartile range [IQR] 3-7.5 mU/min). Delays in initiating oxytocin were identified in 47% of those patients. Decisions to deliver by cesarean were made after a median time of 5 hours and 40 minutes (IQR 3 hours and 30 minutes to 6 hours and 35 minutes) of failure to progress despite adequate contractions. After this decision, median time to delivery was 1 hour and 11 minutes (IQR 57 minutes to 2 hours and 16 minutes). Complications included postpartum hemorrhage (5%) and chorioamnionitis (6.7%). Surgical injury occurred in 10% of intrapartum CD. Peripartum complications were associated with delay in oxytocin implementation (χ2 (1) = 9.80; P < 0.001) in secondary analysis. CONCLUSION: Areas for QI were identified in (1) consent, (2) duration of dystocia before decision to proceed with CD and delay to CD, and (3) peripartum complications. We recognize the potential use of this as a tool to identify areas for QI and prospective study.

Exploring Faculty Perceptions of Competency-Based Medical Education and Assessing Needs for Implementation in Obstetrics and Gynaecology Residency.

OBJECTIVE: The shift to competency-based medical education (CBME) is associated with changes in the way residents are taught and assessed. Although there are many purported benefits of CBME, an understanding of the preparedness of faculty to meet the needs of this new paradigm is lacking. The aim of this study was to characterize faculty needs to support the transition to CBME. METHODS: An online survey was designed with the aim of characterizing faculty understanding of the principles of CBME and common trainee assessment methods, as well as exploring barriers to the implementation of CBME in obstetrics and gynaecology residency programs across Canada. The survey was sent to faculty across Canada in English and French. RESULTS: A total of 284 responses were collected between September 2015 and December 2016. Although most faculty viewed CBME as a positive change, there were gaps in their knowledge about CBME and workplace-based assessment methods. Barriers to the implementation of CBME included lack of training in assessment of residents and feedback, financial implications, and time constraints. CONCLUSION: To facilitate the transition to CBME, institutions may need to consider establishing faculty training programs and implementing systemic change aimed at addressing faculty needs and barriers during this fundamental shift in the structure of residency training.

Graduating Obstetrics and Gynaecology Residents' Readiness for Practice: A Cross-Sectional Survey Study.

OBJECTIVE: This study sought to evaluate the self-reported and program director-reported comfort of graduating Canadian obstetrics and gynaecology residents in independently performing various surgical skills. METHODS: A Web-based survey was distributed to four cohorts of graduating obstetrics and gynaecology residents across Canada (2014-2017). Residents were asked to indicate their comfort level with independently performing 34 core surgical procedures by using a five-point Likert-type scale. A similar survey was sent to program directors. Comfort scores for residents and program directors were compared using quantitative and qualitative methods as appropriate (Canadian Task Force Classification II-3). RESULTS: Resident and program director survey response rates were 168 of 320 (52.5%) and 20 of 48 (41.7%), respectively. Residents were "comfortable" or "very comfortable" performing 7 of 13 (54%) gynaecology and 4 of 6 (67%) obstetrics List A procedures independently. Program directors reported that residents were "comfortable" or "very comfortable" performing 10 of 13 (77%) gynaecology and 4 of 6 (67%) obstetrics List A procedures. Compared with program directors, residents reported lower comfort with certain minimally invasive and obstetrics List A procedures (P < 0.05). Differences in comfort when performing several List A procedures were related to training program size and plans to pursue fellowship. Qualitative analysis revealed several major and minor themes supporting the dichotomy between residents' lack of comfort and program directors' expectation of comfort. CONCLUSION: Graduating residents were not comfortable performing many core surgical procedures independently. Additionally, program directors believed that trainees were more comfortable than they reported, and comfort varied according to program size and future fellowship plans. The new competency-based curriculum is an opportunity to address this gap.

Identification and treatment of iron-deficiency anemia in pregnancy and postpartum: A systematic review and quality appraisal of guidelines using AGREE II.

BACKGROUND: Several international guidelines provide recommendations for the optimal management of iron-deficiency anemia (IDA) in the pregnant and postpartum populations. OBJECTIVES: To review the quality of guidelines containing recommendations for the identification and treatment of IDA in pregnancy and postpartum using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) instrument and to summarize their recommendations. SEARCH STRATEGY: PubMed, Medline, and Embase databases were searched from inception to August 2, 2021. A web engine search was also performed. SELECTION CRITERIA: Clinical practice guidelines that focused on the management of IDA in pregnancy and/or postpartum populations were included. DATA COLLECTION AND ANALYSIS: Included guidelines were appraised using AGREE II independently by two reviewers. Domain scores greater than 70% were considered high-quality. Overall scores of six or seven (out of a possible seven) were considered high-quality guidelines. Recommendations on IDA management were extracted and summarized. MAIN RESULTS: Of 2887 citations, 16 guidelines were included. Only six (37.5%) guidelines were deemed high-quality and were recommended by the reviewers. All 16 (100%) guidelines discussed the management of IDA in pregnancy, and 10 (62.5%) also included information on the management of IDA in the postpartum period. CONCLUSIONS: The complex interplay of racial, ethnic, and socioeconomic disparities was rarely addressed, which limits the generalizability of the recommendations. In addition, many guidelines failed to identify barriers to implementation, strategies to improve uptake or iron treatment, and resource and cost implications of clinical recommendations. These findings highlight important areas to target future work.

Effects of a Resident's Reputation on Laparoscopic Skills Assessment.

OBJECTIVE: To quantify the effect of a resident's reputation on the assessment of their laparoscopic skills. METHODS: Faculty gynecologists were randomized to receive one of three hypothetical resident scenarios: a resident with high, average, or low surgical skills. All participants were then asked to view the same video of a resident performing a laparoscopic salpingo-oophorectomy that differed only by the resident description and provide an assessment using a modified OSATS (Objective Structured Assessment of Technical Skills) and a global assessment scale. RESULTS: From September 6, 2020, to October 20, 2020, a total of 43 faculty gynecologic surgeons were recruited to complete the study. Assessment scores on the modified OSATS (out of 20) and global assessment (out of 5) differed significantly according to resident description, where the high-performing resident scored highest (median scores of 15 and 4, respectively), followed by the average-performing resident (13 and 3), and finally, the low-performing resident (11 and 3) (P=.008 and .043, respectively). CONCLUSION: Faculty assessment of residents in gynecologic surgery is influenced by the assessor's knowledge of the resident's past performance. This knowledge introduces bias that artificially increases scores given to those residents with favorable reputations and decreases scores given to those with reputed surgical skill deficits. These data quantify the effect of such bias in the assessment of residents in the workplace and serve as an impetus to explore systems-level interventions to mitigate bias.