Video-based coaching for surgical residents: a systematic review and meta-analysis.

BACKGROUND: Video-based coaching (VBC) is used to supplement current teaching methods in surgical education and may be useful in competency-based frameworks. Whether VBC can effectively improve surgical skill in surgical residents has yet to be fully elucidated. The objective of this study is to compare surgical residents receiving and not receiving VBC in terms of technical surgical skill. METHODS: The following databases were searched from database inception to October 2021: Medline, EMBASE, Cochrane Central Register of Controlled Trials (CENTRAL), and PubMed. Articles were included if they were randomized controlled trials (RCTs) comparing surgical residents receiving and not receiving VBC. The primary outcome, as defined prior to data collection, was change in objective measures of technical surgical skill following implementation of either VBC or control. A pairwise meta-analyses using inverse variance random effects was performed. Standardized mean differences (SMD) were used as the primary outcome measure to account for differences in objective surgical skill evaluation tools. RESULTS: From 2734 citations, 11 RCTs with 157 residents receiving VBC and 141 residents receiving standard surgical teaching without VBC were included. There was no significant difference in post-coaching scores on objective surgical skill evaluation tools between groups (SMD 0.53, 95% CI 0.00 to 1.01, p = 0.05, I2 = 74%). The improvement in scores pre- and post-intervention was significantly greater in residents receiving VBC compared to those not receiving VBC (SMD 1.62, 95% CI 0.62 to 2.63, p = 0.002, I2 = 85%). These results were unchanged with leave-one-out sensitivity analysis and subgroup analysis according to operative setting. CONCLUSION: VBC can improve objective surgical skills in surgical residents of various levels. The benefit may be most substantial for trainees with lower baseline levels of objective skill. Further studies are required to determine the impact of VBC on competency-based frameworks.

Video-based coaching in surgical education: a systematic review and meta-analysis.

BACKGROUND: In the era of competency-based surgical education, VBC has gained increased attention and may enhance the efficacy of surgical education. The objective of this systematic review was to summarize the existing evidence of video-based coaching (VBC) and compare VBC to traditional master-apprentice-based surgical education. METHODS: We performed a systematic review and meta-analysis of randomized controlled trials (RCT) assessing VBC according to the PRISMA and Cochrane guidelines. The MEDLINE, EMBASE, and COCHRANE and Researchgate databases were searched for eligible manuscripts. Standard mean difference (SMD) of performance scoring scales was used to assess the effect of VBC versus traditional training without VBC (control). RESULTS: Of 627 studies identified, 24 RCTs were eligible and evaluated. The studies included 778 surgical trainees (n = 386 VBC vs. n = 392 control). 13 performance scoring scales were used to assess technical competence; OSATS-GRS was the most common (n = 15). VBC was provided preoperative (n = 11), intraoperative (n = 1), postoperative (n = 10), and perioperative (n = 2). The majority of studies were unstructured, where identified coaching frameworks were PRACTICE (n = 1), GROW (n = 2) and Wisconsin Coaching Framework (n = 1). There was an effect on performance scoring scales in favor of VBC coaching (SMD 0.87, p < 0.001). In subgroup analyses, the residents had a larger relative effect (SMD 1.13; 0.61-1.65, p < 0.001) of VBC compared to medical students (SMD 0.43, 0.06-0.81, p < 0.001). The greatest source of potential bias was absence of blinding of the participants and personnel (n = 20). CONCLUSION: Video-based coaching increases technical performance of medical students and surgical residents. There exist significant study and intervention heterogeneity that warrants further exploration, showing the need to structure and standardize video-based coaching tools.

Supplementing Intraoperative Mastoidectomy Teaching With Video-Based Coaching.

OBJECTIVES: Video-based coaching might complement general surgery education, but little is known of its applicability for otologic microsurgical teaching. Our purpose was thus to evaluate the content and resident-perceived benefit of video-based coaching for mastoidectomy education. METHODS: In this mixed-methods pilot design, mastoidectomies were recorded from operative microscopes and reviewed during 30-minute video-based coaching sessions at 2 tertiary care centers. Eight residents and 3 attendings participated. Ten-point Likert-type questionnaires on the extent to which attendings taught 12 topics through 8 techniques were completed by residents after surgical and coaching sessions. Coaching sessions and structured interviews with residents were audio-recorded, transcribed and iteratively coded. RESULTS: Seven audio-recordings were available for coaching sessions, during which a mean of 2.22 ± 0.5 topics per minute were discussed. Of the 12 teaching topics, technique was discussed most frequently (32%, 0.71 ± 0.2 topics/min), followed by anatomy (16%, 0.31 ± 0.16 topics/min). Of all 8 ratings between coaching and operative sessions, residents indicated a greater extent of discussion of anatomy (median difference, [95% confidence interval (CI)] of 3 [1-4]), progress (2.25 [95% CI, 0.5-4]), technique (3.5 [95% CI, 1.5-5.5]), pitfalls (2.5 [95% CI, 1-3.5]), and summarizing (3 [95% CI, 1-5]). In structured interviews, residents reported improved self-confidence and global perspective. CONCLUSIONS: Video-based coaching is educationally dense and characterized by perceived richer teaching and promotion of a deeper surgical understanding. It requires no additional resources, can be completed in a short period of time and can be implemented programmatically for any otolaryngologic subspecialty utilizing video-recording capable equipment.

Video-based Coaching: Current Status and Role in Surgical Practice, Part II- Practical Implementation and Risk Mitigation from the Society for Surgery of the Alimentary Tract, Health Care Quality and Outcomes Committee.

INTRODUCTION: Video-based surgical coaching is gaining traction within the surgical community. It has an increasing adoption rate and growing recognition of its utility, especially an advanced continuous professional growth tool, for continued educational purposes. This method offers instructional flexibility in real-time remote settings and asynchronous feedback scenarios. In our first paper, we delineated fundamental principles for video-based coaching, emphasizing the customization of feedback to suit individual surgeon's needs. METHOD: In this second part of the series, we review into practical applications of video-based coaching, focusing on quality improvements in a team-based setting, such as the trauma bay. Additionally, we address the potential risks associated with surgical video recording, storage, and distribution, particularly regarding medicolegal aspects. We propose a comprehensive framework to facilitate the implementation of video coaching within individual healthcare institutions. RESULTS: Our paper examines the legal and ethical framework and explores the potential benefits and challenges, offering insights into the real-world implications of this educational approach. CONCLUSION: This paper contributes to the discourse on integrating video-based coaching into continuous professional development. It aims to facilitate informed decision-making in healthcare institutions, considering the adoption of this innovative educational quality tool.

Video Coaching in Surgical Education: Utility, Opportunities, and Barriers to Implementation.

OBJECTIVE: This review discusses the literature on Video-Based Coaching (VBC) and explores the barriers to widespread implementation. DESIGN: A search was performed on Scopus and PubMed for the terms "operation," "operating room," "surgery," "resident," "house staff," "graduate medical education," "teaching," "coaching," "assessment," "reflection," "camera," and "video" on July 27, 2021, in English. This yielded 828 results. A single author reviewed the titles and abstracts and eliminated any results that did not pertain to operative VBC or assessment. All bibliographies were reviewed, and appropriate manuscripts were included in this study. This resulted in a total of 52 manuscripts included in this review. SETTING/PARTICIPANTS: Original, peer-reviewed studies focused on VBC or assessment. RESULTS: VBC has been both subjectively and objectively found to be a valuable educational tool. Nearly every study of video recording in the operating room found that subjects, including surgical residents and seasoned surgeons alike, overwhelmingly considered it a useful, non-redundant adjunct to their training. Most studies that evaluated skill acquisition via standardized assessment tools found that surgical residents who underwent a VBC program had significant improvements compared to their counterparts who did not undergo video review. Despite this evidence of effectiveness, fewer than 5% of residency programs employ video recording in the operating room. Barriers to implementation include significant time commitments for proposed coaching curricula and difficulty with integration of video cameras into the operating room. CONCLUSIONS: VBC has significant educational benefits, but a scalable curriculum has not been developed. An optimal solution would ensure technical ease and expediency, simple, high-quality cameras, immediate review, and overcoming entrenched surgical norms and culture.

How I Do It: Pilot Study of Video-Based Feedback as an Educational Tool for Medical Students' Presentations on Morning Rounds.

OBJECTIVE: Morning rounds are a bedrock learning opportunity during clinical rotations in medical school. Specific feedback is critical for students to improve presentation skills and build confidence, however, current feedback mechanisms are fragmented and nonstandard. We aimed to assess whether video-based coaching of morning rounds could improve student feedback and self-awareness without increasing anxiety during patient presentations. DESIGN: Medical students during core clinical clerkships were filmed presenting on morning rounds during their surgery clerkship. A designated faculty coach reviewed the video prior to an in-person coaching session. Students reviewed the video with faculty and were coached on content, presentation style, and presence. A short survey assessed students' pre- and postcoaching confidence, skill, and the utility of the coaching session. SETTING: University of Michigan Health System, Department of Surgery, Division of General Surgery, Ann Arbor, Michigan PARTICIPANTS: Eight medical student volunteers during their core clinical clerkships at University of Michigan Medical School during the surgery clerkship. RESULTS: Comparison of pre- and post self-assessments showed that students underestimated their knowledge of basic and clinical science and overestimated their clinical assessment skills and ability to appropriately address the core components of a presentation. Most students (75%) did not think that the filming process altered their performance and only 25% of students felt increased anxiety due to filming. All students agreed that the feedback session was useful and helped them understand how to improve their oral presentations. CONCLUSION: This pilot demonstrates the feasibility and value of video-based coaching as an educational tool for medical students on clerkships. A larger sample size is needed to further evaluate the effectiveness of video-based coaching in establishing baseline clinical abilities and identifying potential areas for improvement.

Video-Based Coaching: An Efficient Learning and Teaching Modality for Pediatric Surgery and Pediatric Urology Training Program.

Objective: The development of integrated multimedia operating rooms has made possible to record surgical procedures mainly in minimally invasive surgery (MIS) and robotic surgery. This modality of video storage allows the trainees to study surgical procedures based on video analysis. The aim of this study is to compare two learning methods of surgical procedures, operative textbooks and video-based coaching, in a group of 10 pediatric surgery trainees. Patients and Methods: We selected five surgical procedures to study: three MIS procedures, Nissen fundoplication, partial nephrectomy, and cholecystectomy; and two robotic procedures, Lich-Gregoir reimplantation for vesicoureteral reflux and Henderson-Hynes pyleoplasty for ureteropelvic junction obstruction. Ten trainees were divided into two groups of 5 each, Group 1 (G1) and Group 2 (G2). G1 studied the procedures analyzing videos, G2 studied the same procedure classically reading textbooks. Tutors prepared a questionnaire of 100 multianswered questions that was submitted to both groups, divided into 20 questions for each surgical technique. The questionnaire focused on the different steps of surgical techniques. Results: Analyzing the 10 questionnaires, G1 (video group) obtained a median result of 82 exact answers (74-97), whereas G2 (textbook group) obtained a median result of 64.2 correct answers (53-79). Analyzing statistically the results of two groups, using unpaired t-Student's test with a level of statistical significance >95%, the results of G1 were statistically significantly better that G2 with a P = .0265 for the average scores. Conclusion: Video-based coaching to learn surgical techniques is a novel, feasible, and excellent modality for supplementing surgical techniques learning for pediatric surgery trainees. Objective evaluation using a multianswered questionnaire demonstrates that video-based coaching in pediatric surgery is statistically better than textbook classic education. We suggest to adopt this teaching modality in every surgical training program above all to teach MIS and robotic surgery.

Video-Based Coaching: Current Status and Role in Surgical Practice (Part 1) From the Society for Surgery of the Alimentary Tract, Health Care Quality and Outcomes Committee.

Patient safety and outcomes are directly related to surgical performance. Surgical training emphasizes the importance of the surgeon in determining these outcomes. After training is complete, there is a lack of structured programs for surgeons to audit their skills and continue their individual development. There is a significant linear relationship between surgeon technical skill and surgical outcomes; however, measuring technical performance is difficult. Video-based coaching matches an individual surgeon in practice with a surgical colleague who has been trained in the core principles of coaching for individualizing instruction. It can provide objective assessment for teaching higher-level concepts, such as technical skills, cognitive skills, and decision-making. There are many benefits to video-based coaching. While the concept is gaining acceptance as a method of surgical education, it is still novel in clinical practice. As more surgeons look towards video-based coaching for quality improvement, a consistent definition of the program, goals, and metrics for assessment will be critical. This paper is a review on the status of the video-based coaching as it applies to practicing surgeons.

Translating motion tracking data into resident feedback: An opportunity for streamlined video coaching.

BACKGROUND: We hypothesized that differences in motion data during a simulated laparoscopic ventral hernia repair (LVH) can be used to stratify top and lower tier performers and streamline video review. MATERIALS AND METHODS: Surgical residents (N = 94) performed a simulated partial LVH repair while wearing motion tracking sensors. We identified the top ten and lower ten performers based on a final product quality score (FPQS) of the repair. Two blinded raters independently reviewed motion plots to identify patterns and stratify top and lower tier performers. RESULTS: Top performers had significantly higher FPQS (23.3 ± 1.2 vs 5.7 ± 1.6 p < 0.01). Raters identified patterns and stratified top performers from lower tier performers (Rater 1 χ2 = 3.2 p = 0.07 and Rater 2 χ2 = 2.0 p = 0.16). During video review, we correlated motion plots with the relevant portion of the procedure. CONCLUSION: Differences in motion data can identify learning needs and enable rapid review of surgical videos for coaching.