Procedure-based assessment for laparoscopic cholecystectomy can replace global rating scales.

INTRODUCTION: Global rating scales (GRSs) such as the Objective Structured Assessment of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Surgery (GOALS) are assessment methods for surgical procedures. The aim of this study was to establish construct validity of Procedure-Based Assessment (PBA) and to compare PBA with GRSs for laparoscopic cholecystectomy. MATERIAL AND METHODS: OSATS and GOALS GRSs were compared with PBA in their ability to discriminate between levels of performance between trainees who can perform the procedure independently and those who cannot. Three groups were formed based on the number of procedures performed by the trainee: novice (1-10), intermediate (11-20) and experienced (>20). Differences between groups were assessed using the Kruskal-Wallis and Mann-Whitney U tests. RESULTS: Increasing experience correlated significantly with higher GRSs and PBA scores (all p < .001). Scores of novice and intermediate groups overlapped substantially on the OSATS (p = .1) and GOALS (p = .1), while the PBA discriminated between these groups (p = .03). The median score in the experienced group was higher with less dispersion for PBA (97.2[85.3-100]) compared to OSATS (82.1[60.7-100]) and GOALS (80[60-100]). CONCLUSION: For assessing skill level or the capability of performing a laparoscopic cholecystectomy independently, PBA has a higher discriminative ability compared to the GRSs.

The Pareto Analysis for Establishing Content Criteria in Surgical Training.

INTRODUCTION: Current surgical training is still highly dependent on expensive operating room (OR) experience. Although there have been many attempts to transfer more training to the skills laboratory, little research is focused on which technical behaviors can lead to the highest profit when they are trained outside the OR. The Pareto principle states that in any population that contributes to a common effect, a few account for the bulk of the effect. This principle has been widely used in business management to increase company profits. This study uses the Pareto principle for establishing content criteria for more efficient surgical training. METHOD: A retrospective study was conducted to assess verbal guidance provided by 9 supervising surgeons to 12 trainees performing 64 laparoscopic cholecystectomies in the OR. The verbal corrections were documented, tallied, and clustered according to the aimed change in novice behavior. The corrections were rank ordered, and a cumulative distribution curve was used to calculate which corrections accounted for 80% of the total number of verbal corrections. RESULTS: In total, 253 different verbal corrections were uttered 1587 times and were categorized into 40 different clusters of aimed changes in novice behaviors. The 35 highest-ranking verbal corrections (14%) and the 11 highest-ranking clusters (28%) accounted for 80% of the total number of given verbal corrections. CONCLUSIONS: Following the Pareto principle, we were able to identify the aspects of trainee behavior that account for most corrections given by supervisors during a laparoscopic cholecystectomy on humans. This strategy can be used for the development of new training programs to prepare the trainee in advance for the challenges encountered in the clinical setting in an OR.

The predictive value of aptitude assessment in laparoscopic surgery: a meta-analysis.

CONTEXT: Current methods of assessing candidates for medical specialties that involve laparoscopic skills suffer from a lack of instruments to assess the ability to work in a minimally invasive surgery environment. OBJECTIVES: A meta-analysis was conducted to investigate whether aptitude assessment can be used to predict variability in the acquisition and performance of laparoscopic skills. METHODS: PubMed, PsycINFO and Google Scholar were searched to November 2014 for published and unpublished studies reporting the measurement of a form of aptitude for laparoscopic skills. The quality of studies was assessed with QUADAS-2. Summary correlations were calculated using a random-effects model. RESULTS: Thirty-four studies were found to be eligible for inclusion; six of these studies used an operating room performance measurement. Laparoscopic skills correlated significantly with visual-spatial ability (r = 0.32, 95% confidence interval [CI] 0.25-0.39; p < 0.001), perceptual ability (r = 0.31, 95% CI 0.22-0.39; p < 0.001), psychomotor ability (r = 0.26, 95% CI 0.10-0.40; p = 0.003) and simulator-based assessment of aptitude (r = 0.64, 95% CI 0.52-0.73; p < 0.001). Three-dimensional dynamic visual-spatial ability showed a significantly higher correlation than intrinsic static visual-spatial ability (p = 0.024). CONCLUSIONS: In general, aptitude assessments are associated with laparoscopic skill level. Simulator-based assessment of aptitude appears to have the potential to represent a job sample and to enable the assessment of all forms of aptitude for laparoscopic surgery at once. A laparoscopy aptitude test can be a valuable additional tool in the assessment of candidates for medical specialties that require laparoscopic skills.

Validity, reliability and support for implementation of independence-scaled procedural assessment in laparoscopic surgery.

BACKGROUND: There is no widely used method to evaluate procedure-specific laparoscopic skills. The first aim of this study was to develop a procedure-based assessment method. The second aim was to compare its validity, reliability and feasibility with currently available global rating scales (GRSs). METHODS: An independence-scaled procedural assessment was created by linking the procedural key steps of the laparoscopic cholecystectomy to an independence scale. Subtitled and blinded videos of a novice, an intermediate and an almost competent trainee, were evaluated with GRSs (OSATS and GOALS) and the independence-scaled procedural assessment by seven surgeons, three senior trainees and six scrub nurses. Participants received a short introduction to the GRSs and independence-scaled procedural assessment before assessment. The validity was estimated with the Friedman and Wilcoxon test and the reliability with the intra-class correlation coefficient (ICC). A questionnaire was used to evaluate user opinion. RESULTS: Independence-scaled procedural assessment and GRS scores improved significantly with surgical experience (OSATS p = 0.001, GOALS p < 0.001, independence-scaled procedural assessment p < 0.001). The ICCs of the OSATS, GOALS and independence-scaled procedural assessment were 0.78, 0.74 and 0.84, respectively, among surgeons. The ICCs increased when the ratings of scrub nurses were added to those of the surgeons. The independence-scaled procedural assessment was not considered more of an administrative burden than the GRSs (p = 0.692). DISCUSSION/CONCLUSION: A procedural assessment created by combining procedural key steps to an independence scale is a valid, reliable and acceptable assessment instrument in surgery. In contrast to the GRSs, the reliability of the independence-scaled procedural assessment exceeded the threshold of 0.8, indicating that it can also be used for summative assessment. It furthermore seems that scrub nurses can assess the operative competence of surgical trainees.

Validity and reliability of global operative assessment of laparoscopic skills (GOALS) in novice trainees performing a laparoscopic cholecystectomy.

PURPOSE: Global Operative Assessment of Laparoscopic Skills (GOALS) assessment has been designed to evaluate skills in laparoscopic surgery. A longitudinal blinded study of randomized video fragments was conducted to estimate the validity and reliability of GOALS in novice trainees. METHODS: In total, 10 trainees each performed 6 consecutive laparoscopic cholecystectomies. Sixty procedures were recorded on video. Video fragments of (1) opening of the peritoneum; (2) dissection of Calot's triangle and achievement of critical view of safety; and (3) dissection of the gallbladder from the liver bed were blinded, randomized, and rated by 2 consultant surgeons using GOALS. Also, a grade was given for overall competence. The correlation of GOALS with live observation Objective Structured Assessment of Technical Skills (OSATS) scores was calculated. Construct validity was estimated using the Friedman 2-way analysis of variance by ranks and the Wilcoxon signed-rank test. The interrater reliability was calculated using the absolute and consistency agreement 2-way random-effects model intraclass correlation coefficient. RESULTS: A high correlation was found between mean GOALS score (r = 0.879, p = 0.021) and mean OSATS score. The GOALS score increased significantly across the 6 procedures (p = 0.002). The trainees performed significantly better on their sixth when compared with their first cholecystectomy (p = 0.004). The consistency agreement interrater reliability was 0.37 for the mean GOALS score (p = 0.002) and 0.55 for overall competence (p < 0.001) of the 3 video fragments. CONCLUSION: The validity observed in this randomized blinded longitudinal study supports the existing evidence that GOALS is a valid tool for assessment of novice trainees. A relatively low reliability was found in this study.

Fewer cancer reoperations for medullary thyroid cancer after initial surgery according to ATA guidelines.

BACKGROUND: Surgery is still the only curative treatment for medullary thyroid cancer (MTC). We evaluated clinical outcome in patients with locoregional MTC with regard to adequacy of treatment following ATA guidelines and number of sessions to first intended curative surgery in different hospitals. METHODS: We reviewed all records of MTC patients (n = 184) treated between 1980 and 2010 in two tertiary referral centers in the Netherlands. Symptomatic MTC (palpable tumor or suspicious lymphadenopathy) patients without distant metastasis were included (n = 86). Patients were compared with regard to adequacy of surgery according to ATA recommendations, tumor characteristics, number of local cancer reoperations, biochemical cure, clinical disease-free survival (DFS), overall survival (OS), and complications. RESULTS: Adherence to ATA guidelines resulted in fewer cancer-related reoperations (0.24 vs. 0.60; P = 0.027) and more biochemical cure (40.9 vs. 20 %; P = 0.038). Surgery according to ATA-guidelines on patients treated in referral centers was significantly more often adequate (59.2 vs. 26.7 %; P = 0.026). Tumor size and LN+ were the most important predictors for clinical recurrence [relative risk (RR) 4.1 (size > 40 mm) 4.1 (LN+) and death (RR 4.2 (size > 40 mm) 8.1 (LN+)]. CONCLUSIONS: ATA-compliant surgery resulted in fewer local reoperations and more biochemical cure. Patients in referral centers more often underwent adequate surgery according to ATA-guidelines. Size and LN+ were the most important predictors for DFS and OS.

Development of a standardized training course for laparoscopic procedures using Delphi methodology.

BACKGROUND: Content, evaluation, and certification of laparoscopic skills and procedure training lack uniformity among different hospitals in The Netherlands. Within the process of developing a new regional laparoscopic training curriculum, a uniform and transferrable curriculum was constructed for a series of laparoscopic procedures. The aim of this study was to determine regional expert consensus regarding the key steps for laparoscopic appendectomy and cholecystectomy using Delphi methodology. METHODS: Lists of suggested key steps for laparoscopic appendectomy and cholecystectomy were created using surgical textbooks, available guidelines, and local practice. A total of 22 experts, working for teaching hospitals throughout the region, were asked to rate the suggested key steps for both procedures on a Likert scale from 1-5. Consensus was reached with Crohnbach's α ≥ 0.90. RESULTS: Of the 22 experts, 21 completed and returned the survey (95%). Data analysis already showed consensus after the first round of Delphi on the key steps for laparoscopic appendectomy (Crohnbach's α = 0.92) and laparoscopic cholecystectomy (Crohnbach's α = 0.90). After the second round, 15 proposed key steps for laparoscopic appendectomy and 30 proposed key steps for laparoscopic cholecystectomy were rated as important (≥4 by at least 80% of the expert panel). These key steps were used for the further development of the training curriculum. CONCLUSION: By using the Delphi methodology, regional consensus was reached on the key steps for laparoscopic appendectomy and cholecystectomy. These key steps are going to be used for standardized training and evaluation purposes in a new regional laparoscopic curriculum.

Ergonomic assessment of the French and American position for laparoscopic cholecystectomy in the MIS Suite.

BACKGROUND: Cholecystectomy was one of the first surgical procedures to be performed with laparoscopy in the 1980s. Currently, two operation setups generally are used to perform a laparoscopic cholecystectomy: the French and the American position. In the French position, the patient lies in the lithotomy position, whereas in the American position, the patient lies supine with the left arm in abduction. To find an ergonomic difference between the two operation setups the movements of the surgeon's vertebral column were analyzed in a crossover study. METHODS: The posture of the surgeon's vertebral column was recorded intraoperatively using an electromagnetic motion-tracking system with three sensors attached to the head and to the trunk at the levels of Th1 and S1. A three-dimensional posture analysis of the cervical and thoracolumbar spine was performed to evaluate four surgeons removing a gallbladder in the French and American position. The body angles assessed were flexion/extension of the cervical and thoracolumbar spine, axial rotation of the cervical and thoracolumbar spine, lateroflexion of the cervical and thoracolumbar spine, and the orientation of the head in the sagittal plane. For each body angle, the mean, the percentage of operation time within an ergonomic acceptable range, and the relative frequencies were calculated and compared. RESULTS: No statistical difference was observed in the mean body angles or in the percentages of operation time within an acceptable range between the French and the American position. The relative frequencies of the body angles might indicate a trend toward slight thoracolumbar flexion in the French position. CONCLUSION: In a modern dedicated minimally invasive surgery suite, the body posture of the neck and trunk and the orientation of the head did not differ significantly between the French and American position.