Effect of video-based self-reflection on intraoperative skills: A pilot randomized controlled trial.

BACKGROUND: The value of video-based self-assessment in enhancing surgical skills is uncertain. This study investigates the feasibility and estimates sample size for a full-scale randomized controlled trial to evaluate the effectiveness of video-based self-assessment to improve surgical performance of laparoscopic cholecystectomy in trainees. METHODS: This parallel pilot randomized controlled trial included general surgery trainees performing supervised laparoscopic cholecystectomy randomized 1:1 to control (traditional intraoperative teaching) or intervention group (traditional teaching plus video-based self-assessment). Operative performance was measured by the attending surgeon blinded to group assignment at the time of surgery using standardized assessment tools (Global Operative Assessment of Laparoscopic Skills and Operative Performance Rating System). The intervention group had access to their video recordings on a web-based platform for review and self-assessment using the same instruments. The primary outcome for the estimation of sample size was the difference in faculty-assessed final operative performance (third submitted case). Feasibility criteria included >85% participation, >85% adherence to case submission and >85% completion of self-assessment. RESULTS: Of 37 eligible trainees approached, 32 consented and were randomized (86%). There were 16 in the intervention group, 15 in the control group (55% male, 55% junior trainees), and 1 was excluded for protocol violation. Twenty-four (75%) of participants submitted 3 cases. Thirteen trainees (81%) accessed the platform and completed 26 (63.2%) case self-assessments. Fifty-five trainees per arm will be needed to power a full-scale laparoscopic cholecystectomy with Global Operative Assessment of Laparoscopic Skills and 130 trainees per arm with Operative Performance Rating System as the assessment tool. CONCLUSION: This pilot study contributes important data to inform the design of an adequately powered randomized controlled trial of video-based self-assessment to improve trainee performance of laparoscopic cholecystectomy. Although a priori trial feasibility criteria were not achieved, automated video capture and storage could significantly improve adherence in future trials.

Validity of video-based general and procedure-specific self-assessment tools for surgical trainees in laparoscopic cholecystectomy.

INTRODUCTION: Self-review of recorded surgical procedures offers new opportunities for trainees to extend technical learning outside the operating-room. Valid tools for self-assessment are required prior to evaluating the effectiveness of video-review in enhancing technical learning. Therefore, we aimed to contribute evidence regarding the validity of intraoperative performance assessment tools for video-based self-assessment by general surgery trainees when performing laparoscopic cholecystectomies. METHODS AND PROCEDURES: Using a web-based platform, general surgery trainees in a university-based residency program submitted recorded laparoscopic cholecystectomy procedures where they acted as the supervised primary surgeon. Attending surgeons measured operative performance at the time of surgery using general and procedure-specific assessment tools [Global Operative Assessment of Laparoscopic Skills (GOALS) and Operative Performance Rating System (OPRS), respectively] and entrustability level (O-SCORE). Trainees self-evaluated their performance from video-review using the same instruments. The validity of GOALS and OPRS for trainee self-assessment was investigated by testing the hypotheses that self-assessment scores correlate with (H1) expert assessment scores, (H2) O-SCORE, and (H3) procedure time and that (H4) self-assessment based on these instruments differentiates junior [postgraduate year (PGY) 1-3] and senior trainees (PGY 4-5), as well as (H5)simple [Visual Analogue Scale (VAS) ≤ 4] versus complex cases (VAS > 4). All hypotheses were based on previous literature, defined a priori, and were tested according to the COSMIN consensus on measurement properties. RESULTS: A total of 35 videos were submitted (45% female and 45% senior trainees) and self-assessed. Our data supported 2 out of 5 hypotheses (H1 and H4) for GOALS and 3 out of 5 hypotheses (H1, H4 and H5) for OPRS, for trainee self-assessment. CONCLUSIONS: OPRS, a procedure-specific assessment tool, was better able to differentiate between groups expected to have different levels of intraoperative performance, compared to GOALS, a general assessment tool. Given the interest in video-based learning, there is a need to further develop valid procedure-specific tools to support video-based self-assessment by trainees in a range of procedures.

Optimizing discharge decision-making in colorectal surgery: a prospective cohort study of discharge practices in a recently implemented enhanced recovery pathway.

AIM: The objectives of this project were (1) to compare time to readiness for discharge by set criteria and actual length of stay (LOS) in a newly implemented colorectal enhanced recovery pathway and (2) to identify reasons for delayed hospital discharge. METHOD: We conducted a prospective cohort study of 73 adult patients (age 67 ± 14 years, 56% men, 51% laparoscopic, 13% stoma creation) undergoing elective colorectal surgery in a university hospital with a recently implemented recovery pathway (<2 years). Time to readiness for discharge (oral intake, flatus, pain control, ability to walk, and no complications) was compared to actual LOS using a correlation-adjusted log-rank test. The treating team was interviewed, and thematic analysis was used to identify reasons for patients remaining in hospital after discharge criteria (DC) were achieved. RESULTS: Median LOS was 6 (4-8) days and median time to readiness for discharge was 5 (3-8) days (P < 0.001). Twenty-eight patients (37%) remained in hospital after DC were achieved. Although some delayed discharges were medically justified (e.g., workup [13%] or treatment of complications not captured by DC [2.6%]), unnecessary hospital stays were common (e.g., perceived need for observation [16%], or patients not willing to be discharged [11%]). CONCLUSIONS: Unnecessary hospital stays were common within a recently implemented enhanced recovery pathway and represent a target for quality improvement. Efforts should be directed at optimizing patient education regarding discharge expectations, early consultation of the discharge planning team and improving discharge decision-making using standardized DC.

Assessment of surgical performance of laparoscopic benign hiatal surgery: a systematic review.

BACKGROUND: Operative skills correlate with patient outcomes, yet at the completion of training or after learning a new procedure, these skills are rarely formally evaluated. There is interest in the use of summative video assessment of laparoscopic benign foregut and hiatal surgery (LFS). If this is to be used to determine competency, it must meet the robust criteria established for high-stakes assessments. The purpose of this review is to identify tools that have been used to assess performance of LFS and evaluate the available validity evidence for each instrument. METHODS: A systematic search was conducted up to July 2017. Eligible studies reported data on tools used to assess performance in the operating room during LFS. Two independent reviewers considered 1084 citations for eligibility. The characteristics and testing conditions of each assessment tool were recorded. Validity evidence was evaluated using five sources of validity (content, response process, internal structure, relationship to other variables, and consequences). RESULTS: There were six separate tools identified. Two tools were generic to laparoscopy, and four were specific to LFS [two specific to Nissen fundoplication (NF), one heller myotomy (HM), and one paraesophageal hernia repair (PEH)]. Overall, only one assessment was supported by moderate evidence while the others had limited or unknown evidence. Validity evidence was based mainly on internal structure (all tools reporting reliability and item analysis) and content (two studies referencing previous papers for tool development in the context of clinical assessment, and four listing items without specifying the development procedures). There was little or no evidence supporting test response process (one study reporting rater training), relationship to other variables (two comparing scores in subjects with different clinical experience), and consequences (no studies). Two tools were identified to have evidence for video assessment, specific to NF. CONCLUSION: There is limited evidence supporting the validity of assessment tools for laparoscopic foregut surgery. This precludes their use for summative video-based assessment to verify competency. Further research is needed to develop an assessment tool designed for this purpose.

Incidence and predictors of prolonged postoperative ileus after colorectal surgery in the context of an enhanced recovery pathway.

BACKGROUND: Prolonged postoperative ileus (PPOI) is common after colorectal surgery but has not been widely studied in the context of enhanced recovery pathways (ERPs) that include interventions aimed to accelerate gastrointestinal recovery. The aim of this study is to estimate the incidence and predictors of PPOI in the context of an ERP for colorectal surgery. METHODS: We analyzed data from an institutional colorectal surgery ERP registry. Incidence of PPOI was estimated according to a definition adapted from Vather (intolerance of solid food and absence of flatus or bowel movement for ≥ 4 days) and compared to other definitions in the literature. Potential risk factors for PPOI were identified from previous studies, and their predictive ability was evaluated using Bayesian model averaging (BMA). Results are presented as posterior effect probability (PEP). Evidence of association was categorized as: no evidence (PEP < 50%), weak evidence (50-75%), positive evidence (75-95%), strong evidence (95-99%), and very strong evidence (> 99%). RESULTS: There were 323 patients analyzed (mean age 63.5 years, 51% males, 74% laparoscopic, 33% rectal resection). The incidence of PPOI was 19% according to the primary definition, but varied between 11 and 59% when using other definitions. On BMA analysis, intraoperative blood loss (PEP 99%; very strong evidence), administration of any intravenous opioids in the first 48 h (PEP 94%; strong evidence), postoperative epidural analgesia (PEP 56%; weak evidence), and non-compliance with intra-operative fluid management protocols (3 ml/kg/h for laparoscopic and 5 ml/kg/h for open; PEP 55%, weak evidence) were predictors of PPOI. CONCLUSIONS: The incidence of PPOI after colorectal surgery is high even within an established ERP and varied considerably by diagnostic criteria, highlighting the need for a consensus definition. The use of intravenous opioids is a modifiable strong predictor of PPOI within an ERP, while the role of epidural analgesia and intraoperative fluid management should be further evaluated.