An American Board of Surgery Pilot of Video Assessment of Surgeon Technical Performance in Surgery.

OBJECTIVE: The American Board of Surgery (ABS) sought to investigate the suitability of video-based assessment (VBA) as an adjunct to certification for assessing technical skills. BACKGROUND: Board certification is based on the successful completion of a residency program coupled with knowledge and reasoning assessments. VBA is a new modality for evaluating operative skills that have been shown to correlate with patient outcomes after surgery. METHODS: Diplomates of the ABS were initially assessed for background knowledge and interest in VBA. Surgeons were then solicited to participate in the pilot. Three commercially available VBA platforms were identified and used for the pilot assessment. All participants served as reviewers and reviewees for videos. After the interaction, participants were surveyed regarding their experiences and recommendations to the ABS. RESULTS: To the initial survey, 4853/25,715 diplomates responded. The majority were neither familiar with VBA, nor the tools used for operative assessments. Two hundred seventy-four surgeons actively engaged in the subsequent pilot. One hundred sixty-nine surgeons completed the postpilot survey. Most participants found the process straightforward. Of the participants, 74% felt that the feedback would help their surgical practice. The majority (81%) remain interested in VBA for continuing medical education credits. Using VBA in continuous certification could improve surgeon skills felt by 70%. Two-thirds of participants felt VBA could help identify and remediate underperforming surgeons. Identified barriers to VBA included limitations for open surgery, privacy issues, and technical concerns. CONCLUSIONS: VBA is promising as an adjunct to the current board certification process and should be further considered by the ABS.

Understanding why caregivers call after ambulatory pediatric urologic surgery.

INTRODUCTION: To uncover factors associated with an increased likelihood of a postoperative triage phone call from caregivers after pediatric ambulatory urologic surgery with a focus on social determinants of health. MATERIALS AND METHODS: This was a retrospective cohort study from July 2014-January 2020. Patients undergoing ambulatory urologic surgery by three different pediatric urologists were included. The primary outcome was the number of patient families that called within 30 days after surgery. Univariable tests and multivariable logistic regression analysis were used to identify factors associated with the increased likelihood of a postoperative phone call. RESULTS: The families of 460 patients out of 1618 patients called at least once within 30 days of surgery (28%). There were 665 total calls, an average number of 1.5 (SD+/-0.8) phone calls per family. Families who live further away (OR 0.66, 95%CI 0.46-0.93), who do not speak English as a primary language (OR 0.61, 95%CI 0.38-1.00), and who were Native American/Alaskan Native (OR 0.33, 95%CI 0.11-0.99) were less likely to call after surgery. Those with commercial insurance (OR 1.42, 95%CI 1.09-1.85), recovering from non-hypospadias penile surgery (OR 3.20, 95%CI 2.46-4.32), or from hypospadias repair (OR 5.14, 95%CI 3.28-8.18) were more likely to call after surgery. CONCLUSIONS: Nearly 1 in 3 families call the hospital triage line after ambulatory urologic surgery with postoperative concerns. Families with children who undergo penile surgery are 3-5 times more likely to call after surgery. Social determinants of health may have a role in postoperative phone call rates as medically underserved patients are less likely to call.

Virtual Reality Warm-up Before Robot-assisted Surgery: A Randomized Controlled Trial.

TRIAL DESIGN: This was a randomized controlled trial. BACKGROUND: Intraoperative errors correlate with surgeon skill and skill declines with intervals of inactivity. The goals of this research were to identify the optimal virtual reality (VR) warm-up curriculum to prime a surgeon's technical skill and validate benefit in the operating room. MATERIALS AND METHODS: Surgeons were randomized to receive six trial sessions of a designated set of VR modules on the da Vinci Skills Simulator to identify optimal VR warm-up curricula to prime technical skill. After performing their curricula, warm-up effect was assessed based on performance on a criterion task. The optimal warm-up curriculum was chosen from the group with the best task time and video review-based technical skill. Robot-assisted surgery-experienced surgeons were then recruited to either receive or not receive warm-up before surgery. Skill in the first 15 min of surgery was assessed by blinded surgeon and crowdworker review as well as tool motion metrics. The intervention was performing VR warm-up before human robot-assisted surgery. Warm-up effect was measured using objective performance metrics and video review using the Global Evaluative Assessment of Robotic Skills tool. Linear mixed effects models with a random intercept for each surgeon and nonparametric modified Friedman tests were used for analysis. RESULTS: The group performing only a Running Suture task on the simulator was on average 31.3 s faster than groups performing other simulation tasks and had the highest Global Evaluative Assessment of Robotic Skills scores from 41 surgeons who participated. This was chosen as the optimal curriculum. Thereafter, 34 surgeons completed 347 surgeries with corresponding video and tool motion data. No statistically significant differences in skill were observed with the warm-up intervention. CONCLUSIONS: We conclude that a robotic VR warm-up before performing the early stages of surgery does not impact the technical skill of the surgeon.

How I Do It: The pudendal nerve block for pediatric ambulatory urologic surgery.

Regional analgesia is an important adjunct for perioperative pain management in the setting of pediatric penile surgeries. Caudal epidural analgesia (CEA) is the most common analgesic technique performed, but it has limitations and associated morbidity. The pudendal nerve block (PNB) is an effective alternative to CEA with a lower risk profile; in prior examination of the approach, PNB has been demonstrated to have similar postoperative pain control outcomes. We describe our technique and highlight observations made as we have transitioned from CEA to PNB for many patients.

Perspectives on Priapism Education in Emergency Medicine.

INTRODUCTION: Priapism is a urologic emergency managed by both emergency medicine (EM) providers and urologists. Attitudes regarding its management and understanding of education of non-urology trainees in this area are poorly defined. AIM: The aim of this study was to describe attitudes toward priapism management among multiple stakeholders and define the current state of priapism education among EM residency programs. METHODS: Surveys were developed and distributed online to EM residency leadership, EM residents, and urology providers. Each solicited attitudes and preferences regarding independent priapism management by EM providers. EM residents were further queried about their educational and clinical experiences in priapism management, and EM residency leadership were surveyed about their educational curricula. Responses among all 3 groups were compared using Fisher's exact tests. MAIN OUTCOME MEASURE: Quantitative and descriptive responses were solicited regarding EM providers' management of acute ischemic priapism and current priapism curricula for EM residents. RESULTS: 91 EM residency program directors and assistant program directors (31.6% of programs), 227 EM residents (14.7% of programs), and 94 urologists (6.3% of survey recipients) responded. All geographic regions and all years of EM training were represented. Over 90% of all surveyed groups felt that EM providers should independently manage priapism in practice. 17% of senior EM residents felt "not at all" confident in managing priapism; and 25.5% had never primarily managed this entity in training. 81% of programs had a formalized priapism curriculum, of which 19% included treatment simulation. However, 36% of residents felt that current curricula were insufficient. CLINICAL IMPLICATIONS: Widespread approval from both EM providers and urologists support EM-based management for uncomplicated cases of acute ischemic priapism. Current educational curricula for EM trainees may not be sufficient to prepare them to manage this entity in practice. STRENGTHS & LIMITATIONS: This is the first study to examine provider attitudes toward EM-based management of priapism and assess the current state of education in this area with input from all key stakeholders. This survey was limited in its scope and the response rate was lower than desired. CONCLUSION: Urologists support independent priapism management by EM providers, but an educational gap remains for EM trainees who do not feel adequately trained to manage this independently in practice. Dai JC, Franzen DS, Lendvay TS, et al. Perspectives on Priapism Education in Emergency Medicine. J Sex Med 2020;17:159-162.

Postoperative Imaging Patterns of Pediatric Nephrolithiasis: Opportunities for Improvement.

PURPOSE: Imaging following surgical intervention for nephrolithiasis is important to define operative success and ensure the absence of silent obstruction. We assessed nationwide postoperative imaging patterns in children undergoing ureteroscopy and shock wave lithotripsy. MATERIALS AND METHODS: We reviewed the MarketScan® Commercial Claims and Encounters database from 2007 to 2013 for patients 1 to 18 years old undergoing ureteroscopy or shock wave lithotripsy. We assessed imaging exposure following index procedure within 90 days as a primary analysis and 180 days as a secondary analysis of the index procedure. Univariate and multivariate statistical analyses were performed to assess factors associated with undergoing postoperative imaging. RESULTS: A total of 4,251 children met inclusion criteria, of whom 1,647 had undergone shock wave lithotripsy and 2,604 had undergone ureteroscopy. Postoperative imaging was performed in 57.5% of the cohort, with a higher proportion of children undergong imaging following shock wave lithotripsy compared to ureteroscopy (73% vs 47.8%, p <0.001). Noncomputerized tomographic imaging modalities were most common following ureteroscopy (70.8%) and shock wave lithotripsy (84.6%). Younger children and those with complex medical conditions or complicated postoperative courses were more likely to undergo followup imaging. Computerized tomography was more commonly used in older children and females. At 180-day followup 63% of the cohort had undergone any imaging, again more frequently following shock wave lithotripsy (77.0%) vs ureteroscopy (45.0%). CONCLUSIONS: A large percentage of children with nephrolithiasis do not undergo followup imaging after shock wave lithotripsy, and even fewer undergo imaging after ureteroscopy. Most followup imaging is done within 90 days of surgery. Further work is needed to define appropriate postoperative imaging practices in this population.

Robot-assisted extravesical ureteral reimplantation (revur) for unilateral vesico-ureteral reflux in children: results of a multicentric international survey.

PURPOSE: This multicentric international retrospective study aimed to report the outcome of robot-assisted extravesical ureteral reimplantation (REVUR) in patients with unilateral vesico-ureteral reflux (VUR). METHODS: The medical records of 55 patients (35 girls, 20 boys) underwent REVUR in four international centers of pediatric robotic surgery for primary unilateral VUR were retrospectively reviewed. Patients' average age was 4.9 years. The preoperative grade of reflux was III in 12.7%, IV in 47.3% and V in 40%. Twenty-six patients (47.3%) presented a loss of renal function preoperatively and 10 (18.1%) had a duplex system. RESULTS: Average robot docking time was 16.2 min (range 5-30). Average total operative time was 92.2 min (range 50-170). No conversions or intra-operative complications were recorded. All patients had a bladder Foley catheter for 24 h post-operatively. Average hospital stay was 2 days (range 1-3). Average follow-up length was 28 months (range 9-60). We recorded three (5.4%) postoperative complications: 1 small urinoma resolved spontaneously (II Clavien) and 2 persistent reflux, only one requiring redo-surgery using endoscopic injection (IIIb Clavien). CONCLUSION: REVUR is a safe and effective technique for treatment of primary unilateral VUR. The procedure is easy and fast to perform thanks to the 6° of freedom of robotic arms. The learning curve is short and it is useful to begin the robotics experience with a surgeon expert in robotic surgery as proctor on the 2nd robot console. The high cost and the diameter of instruments remain the main challenges of robotics applications in pediatric urology.

National Trends in Secondary Procedures Following Pediatric Pyeloplasty.

PURPOSE: Although reported success rates after pediatric pyeloplasty to correct ureteropelvic junction are high, failure may require intervention. We sought to characterize the incidence and timing of secondary procedures after pediatric pyeloplasty using a national employer based insurance database. MATERIALS AND METHODS: Using the MarketScan® database we identified patients 0 to 18 years old who underwent pyeloplasty from 2007 to 2013 with greater than 3 months of postoperative enrollment. Secondary procedures following the index pyeloplasty were identified by CPT codes and classified as stent/drain, endoscopic, pyeloplasty, nephrectomy or transplant. The risk of undergoing a secondary procedure was ascertained using Cox proportional hazards models adjusting for demographic and clinical characteristics. RESULTS: We identified 1,976 patients with a mean ± SD followup of 23.9 ± 19.8 months. Overall 226 children (11.4%) had undergone at least 1 post-pyeloplasty procedure. The first procedure was done within 1 year in 87.2% of patients with a mean postoperative interval of 5.9 ± 11.1 months. Stents/drains, endoscopic procedures and pyeloplasties were noted in 116 (5.9%), 34 (1.7%) and 71 patients (3.1%), respectively. Length of stay was associated with undergoing a secondary procedure. Compared with 2 days or less the HR of 3 to 5 and 6 days or greater was 1.65 and 3.94 (p = 0.001 and <0.001, respectively). CONCLUSIONS: Following pediatric pyeloplasty 1 of 9 patients undergoes at least 1 secondary procedure with the majority performed within the first year. One of 11 patients undergoes intervention more extensive than placement of a single stent or drain, requiring management strategies that generally signify recurrent or persistent obstruction. Estimates of pyeloplasty success in this national data set are lower than in other published series.

Validation of the AUA BLUS Tasks.

PURPOSE: Standardized assessment of laparoscopic skill in urology is lacking. We investigated whether the AUA (American Urological Association) BLUS (Basic Laparoscopic Urologic Skills) skill tasks are valid to address this need. MATERIALS AND METHODS: This institutional review board approved study included 27 medical students, 42 urology residents, 18 fellows and 37 faculty urologists across 8 sites. Using the EDGE (Electronic Data Generation and Evaluation) device (Simulab, Seattle, Washington) 454 recordings were collected on peg transfer, pattern cutting, suturing and clip applying tasks, which together comprise the expert determined BLUS tasks. We collected synchronized video and tool motion data for each trial. For each task errors, time, path length, economy of motion, peak grasp force and EDGE score were collected. An expert panel of 5 faculty members performed GOALS (Global Objective Assessment of Laparoscopic Skills) evaluations on a representative subset of peg transfer and suturing skill tasks performed by 24 participants (IRR = 0.95). RESULTS: Demographically derived skill levels proved unsuitable to evaluate construct validity. Separation of mean scores by grouped skill levels was strongest for the suturing task. Objective motion metrics and errors supported construct validity vis-à-vis correlation with blinded expert video ratings (motion metrics R(2) = 0.95, p <0.01). Expert scores appeared to reward errors in suturing but not in block transfer. CONCLUSIONS: BLUS skill task performance scoring can discriminate among basic laparoscopic technical skill levels. Self-reported demographics are an unreliable source of determining laparoscopic technical skill.

Crowd-Sourced Assessment of Technical Skills for Validation of Basic Laparoscopic Urologic Skills Tasks.

PURPOSE: The BLUS (Basic Laparoscopic Urologic Skills) consortium sought to address the construct validity of BLUS tasks and the wider problem of accurate, scalable and affordable skill evaluation by investigating the concordance of 2 novel candidate methods with faculty panel scores, those of automated motion metrics and crowdsourcing. MATERIALS AND METHODS: A faculty panel of surgeons (5) and anonymous crowdworkers blindly reviewed a randomized sequence of a representative sample of 24 videos (12 pegboard and 12 suturing) extracted from the BLUS validation study (454) using the GOALS (Global Objective Assessment of Laparoscopic Skills) survey tool with appended pass-fail anchors via the same web based user interface. Pre-recorded motion metrics (tool path length, jerk cost etc) were available for each video. Cronbach's alpha, Pearson's R and ROC with AUC statistics were used to evaluate concordance between continuous scores, and as pass-fail criteria among the 3 groups of faculty, crowds and motion metrics. RESULTS: Crowdworkers provided 1,840 ratings in approximately 48 hours, 60 times faster than the faculty panel. The inter-rater reliability of mean expert and crowd ratings was good (α=0.826). Crowd score derived pass-fail resulted in 96.9% AUC (95% CI 90.3-100; positive predictive value 100%, negative predictive value 89%). Motion metrics and crowd scores provided similar or nearly identical concordance with faculty panel ratings and pass-fail decisions. CONCLUSIONS: The concordance of crowdsourcing with faculty panels and speed of reviews is sufficiently high to merit its further investigation alongside automated motion metrics. The overall agreement among faculty, motion metrics and crowdworkers provides evidence in support of the construct validity for 2 of the 4 BLUS tasks.

Crowdsourcing: a valid alternative to expert evaluation of robotic surgery skills.

BACKGROUND: Robotic-assisted gynecologic surgery is common, but requires unique training. A validated assessment tool for evaluating trainees' robotic surgery skills is Robotic-Objective Structured Assessments of Technical Skills. OBJECTIVE: We sought to assess whether crowdsourcing can be used as an alternative to expert surgical evaluators in scoring Robotic-Objective Structured Assessments of Technical Skills. STUDY DESIGN: The Robotic Training Network produced the Robotic-Objective Structured Assessments of Technical Skills, which evaluate trainees across 5 dry lab robotic surgical drills. Robotic-Objective Structured Assessments of Technical Skills were previously validated in a study of 105 participants, where dry lab surgical drills were recorded, de-identified, and scored by 3 expert surgeons using the Robotic-Objective Structured Assessments of Technical Skills checklist. Our methods-comparison study uses these previously obtained recordings and expert surgeon scores. Mean scores per participant from each drill were separated into quartiles. Crowdworkers were trained and calibrated on Robotic-Objective Structured Assessments of Technical Skills scoring using a representative recording of a skilled and novice surgeon. Following this, 3 recordings from each scoring quartile for each drill were randomly selected. Crowdworkers evaluated the randomly selected recordings using Robotic-Objective Structured Assessments of Technical Skills. Linear mixed effects models were used to derive mean crowdsourced ratings for each drill. Pearson correlation coefficients were calculated to assess the correlation between crowdsourced and expert surgeons' ratings. RESULTS: In all, 448 crowdworkers reviewed videos from 60 dry lab drills, and completed a total of 2517 Robotic-Objective Structured Assessments of Technical Skills assessments within 16 hours. Crowdsourced Robotic-Objective Structured Assessments of Technical Skills ratings were highly correlated with expert surgeon ratings across each of the 5 dry lab drills (r ranging from 0.75-0.91). CONCLUSION: Crowdsourced assessments of recorded dry lab surgical drills using a validated assessment tool are a rapid and suitable alternative to expert surgeon evaluation.

National Trends in Followup Imaging after Pyeloplasty in Children in the United States.

PURPOSE: Radiographic followup after pyeloplasty for the correction of ureteropelvic junction obstruction is not well defined in children. We characterize trends in frequency and modality of postoperative imaging after open and minimally invasive pediatric pyeloplasty. MATERIALS AND METHODS: Using the MarketScan® database, we identified patients 0 to 18 years old undergoing pyeloplasty between 2007 and 2013. Followup imaging was classified as functional (diuretic renography, excretory urography) or nonfunctional (ultrasound, computerized tomography, magnetic resonance imaging). We excluded patients with less than 24 months of postoperative enrollment in MarketScan. Multivariate logistic regression was performed to determine associations between demographic variables and imaging use patterns. RESULTS: We identified 926 patients with a mean ± SD followup of 3.6 ± 1.3 years, of whom 30% underwent minimally invasive pyeloplasty. Overall 5.9% of patients had no postoperative imaging available. Within the first 6 months postoperatively 853 patients (91%) underwent at least 1 imaging study and 192 (24%) underwent renography. Within the first 12 months postoperatively 91% of patients underwent at least 1 imaging study, most commonly ultrasound. After 12 months almost a third of the patients were not followed with imaging. Of the 71% undergoing imaging most underwent ultrasound. Younger age and female gender were independently associated with frequent imaging (at least yearly) on multivariate logistic regression. CONCLUSIONS: Following pediatric pyeloplasty there is variation in modality and frequency of imaging followup. The majority of patients are followed with renal ultrasound, with less frequent use of functional imaging. Almost a third of patients do not undergo followup imaging after 1 year.

Crowd-sourced assessment of surgical skills in cricothyrotomy procedure.

BACKGROUND: Objective assessment of surgical skills is resource intensive and requires valuable time of expert surgeons. The goal of this study was to assess the ability of a large group of laypersons using a crowd-sourcing tool to grade a surgical procedure (cricothyrotomy) performed on a simulator. The grading included an assessment of the entire procedure by completing an objective assessment of technical skills survey. MATERIALS AND METHODS: Two groups of graders were recruited as follows: (1) Amazon Mechanical Turk users and (2) three expert surgeons from University of Washington Department of Otolaryngology. Graders were presented with a video of participants performing the procedure on the simulator and were asked to grade the video using the objective assessment of technical skills questions. Mechanical Turk users were paid $0.50 for each completed survey. It took 10 h to obtain all responses from 30 Mechanical Turk users for 26 training participants (26 videos/tasks), whereas it took 60 d for three expert surgeons to complete the same 26 tasks. RESULTS: The assessment of surgical performance by a group (n = 30) of laypersons matched the assessment by a group (n = 3) of expert surgeons with a good level of agreement determined by Cronbach alpha coefficient = 0.83. CONCLUSIONS: We found crowd sourcing was an efficient, accurate, and inexpensive method for skills assessment with a good level of agreement to experts' grading.

Comparison of two simulation systems to support robotic-assisted surgical training: a pilot study (Swine model).

OBJECTIVE: To compare the efficacy of simulation-based training between the Mimic dV- Trainer and traditional dry lab da Vinci robot training. DESIGN: A prospective randomized study analyzing the performance of 20 robotics-naive participants. Participants were enrolled in an online da Vinci Intuitive Surgical didactic training module, followed by training in use of the da Vinci standard surgical robot. Spatial ability tests were performed as well. Participants were randomly assigned to 1 of 2 training conditions: performance of 3 Fundamentals of Laparoscopic Surgery dry lab tasks using the da Vinci or performance of 4 dV-Trainer tasks. Participants in both groups performed all tasks to empirically establish proficiency criterion. Participants then performed the transfer task, a cystotomy closure using the daVinci robot on a live animal (swine) model. The performance of robotic tasks was blindly assessed by a panel of experienced surgeons using objective tracking data and using the validated Global Evaluative Assessment of Robotic Surgery (GEARS), a structured assessment tool. RESULTS: No statistically significant difference in surgeon performance was found between the 2 training conditions, dV-Trainer and da Vinci robot. Analysis of a 95% confidence interval for the difference in means (-0.803 to 0.543) indicated that the 2 methods are unlikely to differ to an extent that would be clinically meaningful. CONCLUSION: Based on the results of this study, a curriculum on the dV- Trainer was shown to be comparable to traditional da Vinci robot training. Therefore, we have identified that training on a virtual reality system may be an alternative to live animal training for future robotic surgeons.

Painless pediatric priapism and cough.

Pediatric priapism can be a medical emergency but is not a common complaint seen in pediatric emergency department. Priapism in a previously healthy child is also rare. We report a case of painless stuttering priapism associated with an acute Mycoplasma pneumoniae infection in a previously healthy boy.

Recent trends in the surgical management of primary vesicoureteral reflux in the era of dextranomer/hyaluronic acid.

PURPOSE: Since its inception as a technology in the United States, endoscopic correction of vesicoureteral reflux has become a popular treatment option in children with vesicoureteral reflux with reported wide use. We determined whether the increasing trend in use in the United States after the introduction of dextranomer/hyaluronic acid has been sustained. MATERIALS AND METHODS: We abstracted data on pediatric patients treated with ureteral reimplantation or dextranomer/hyaluronic acid intervention for vesicoureteral reflux from 2004 to 2011 from the PHIS (Pediatric Health Information System) database. Patients with coding data indicating diagnoses other than primary vesicoureteral reflux and hospitals reporting less than 80% of ambulatory surgery cases by CPT code were excluded from study. RESULTS: We identified 14,430 patients (17,826 procedures), of whom 49% underwent reimplantation and 51% underwent dextranomer/hyaluronic acid injection. Of the patients 83% were female with a median age at surgery of 4.7 years (IQR 2.5-7.2). Linear regression showed a significant downward trend in the average total number of antireflux operations per institution during the study period. This was attributable to a decrease in the average rate of dextranomer/hyaluronic acid interventions because the average reimplantation rate remained stable during this time. CONCLUSIONS: At freestanding pediatric hospitals enrolled in the PHIS database there is a trend toward decreasing intervention for primary vesicoureteral reflux, which appears to be due to decreased use of injection therapy. This may reflect a philosophical change in reflux management by injection therapy.

Crowd-Sourced Assessment of Technical Skills: a novel method to evaluate surgical performance.

BACKGROUND: Validated methods of objective assessments of surgical skills are resource intensive. We sought to test a web-based grading tool using crowdsourcing called Crowd-Sourced Assessment of Technical Skill. MATERIALS AND METHODS: Institutional Review Board approval was granted to test the accuracy of Amazon.com's Mechanical Turk and Facebook crowdworkers compared with experienced surgical faculty grading a recorded dry-laboratory robotic surgical suturing performance using three performance domains from a validated assessment tool. Assessor free-text comments describing their rating rationale were used to explore a relationship between the language used by the crowd and grading accuracy. RESULTS: Of a total possible global performance score of 3-15, 10 experienced surgeons graded the suturing video at a mean score of 12.11 (95% confidence interval [CI], 11.11-13.11). Mechanical Turk and Facebook graders rated the video at mean scores of 12.21 (95% CI, 11.98-12.43) and 12.06 (95% CI, 11.57-12.55), respectively. It took 24 h to obtain responses from 501 Mechanical Turk subjects, whereas it took 24 d for 10 faculty surgeons to complete the 3-min survey. Facebook subjects (110) responded within 25 d. Language analysis indicated that crowdworkers who used negation words (i.e., "but," "although," and so forth) scored the performance more equivalently to experienced surgeons than crowdworkers who did not (P < 0.00001). CONCLUSIONS: For a robotic suturing performance, we have shown that surgery-naive crowdworkers can rapidly assess skill equivalent to experienced faculty surgeons using Crowd-Sourced Assessment of Technical Skill. It remains to be seen whether crowds can discriminate different levels of skill and can accurately assess human surgery performances.

Beyond task time: automated measurement augments fundamentals of laparoscopic skills methodology.

BACKGROUND: Laparoscopic psychomotor skills are challenging to learn and objectively evaluate. The Fundamentals of Laparoscopic Skills (FLS) program provides a popular, inexpensive, widely-studied, and reported method for evaluating basic laparoscopic skills. With an emphasis on training safety before efficiency, we present data that explore the metrics in the FLS curriculum. MATERIALS AND METHODS: A multi-institutional (n = 3) cross-sectional study enrolled subjects (n = 98) of all laparoscopic skill levels to perform FLS tasks in an instrumented box trainer. Recorded task videos were postevaluated by faculty reviewers (n = 2) blinded to subject identity using a modified Objective Structured Assessment of Technical Skills (OSATS) protocol. FLS scores were computed for each completed task and compared with demographically established skill levels (training level and number of procedures), video review scoring, and objective performance metrics including path length, economy of motion, and peak grasping force. RESULTS: Three criteria used to determine expert skill, training and experience level, blinded review of performance by faculty via OSATS, and FLS scores, disagree in establishing concurrent validity for determining "true experts" in FLS tasks. FLS-scoring exhibited near-perfect correlation with task time for all three tasks (Pearson r = 0.99, 1.00, 1.00 with P <0.00000001). FLS error penalties had negligible effect on FLS scores. Peak grasping force did not correlate with task time or FLS scores. CONCLUSIONS: FLS technical skills scores presented negligible benefit beyond the measurement of task time. FLS scoring is weighted more toward speed than precision and may not significantly address poor tissue handling skills, especially regarding excessive grasping force. Categories of experience or training level may not form a suitable basis for establishing proficiency thresholds or for construct validity studies for technical skills.

Haptic Guidance and Haptic Error Amplification in a Virtual Surgical Robotic Training Environment.

Teleoperated robotic systems have introduced more intuitive control for minimally invasive surgery, but the optimal method for training remains unknown. Recent motor learning studies have demonstrated that exaggeration of errors helps trainees learn to perform tasks with greater speed and accuracy. We hypothesized that training in a force field that pushes the user away from a desired path would improve their performance on a virtual reality ring-on-wire task. Thirty-eight surgical novices trained under a no-force, guidance, or error-amplifying force field over five days. Completion time, translational and rotational path error, and combined errortime were evaluated under no force field on the final day. The groups significantly differed in combined error-time, with the guidance group performing the worst. Error-amplifying field participants did not plateau in their performance during training, suggesting that learning was still ongoing. Guidance field participants had the worst performance on the final day, confirming the guidance hypothesis. Observed trends also suggested that participants who had high initial path error benefited more from guidance. Error-amplifying and error-reducing haptic training for robot-assisted telesurgery benefits trainees of different abilities differently, with our results indicating that participants with high initial combined error-time benefited more from guidance and error-amplifying force field training.

Putting the coach in the game: Current and future state of surgical coaching in pediatric urology.

BACKGROUND: Surgical coaching has been proposed as a mechanism to fill gaps in proficiency and encourage continued growth following formal surgical training. Coaching benefits have been demonstrated in other surgical fields; however, have not been evaluated within pediatric urology. The aims of this study were to survey members of The Societies for Pediatric Urology (SPU) to assess the current understanding and utilization of surgical coaching while gauging interest, potential barriers and personal goals for participation in a coaching program. METHODS: Following IRB approval, members of the SPU were invited to electronically complete an anonymous survey which assessed 4 domains: 1) understanding of surgical coaching principles, 2) current utilization, 3) interest and potential barriers to participation, and 4) personal surgical goals. To evaluate understanding, questions with predefined correct answers on the key principles of coaching were posed either in multiple choice or True/False format to the SPU membership. RESULTS: Of the 674 pediatric urologists invited, 146 completed the survey (22%). Of those, 46% correctly responded the definition of surgical coaching. Coaching utilization was reported in 27% of respondents currently or having previously participated in a surgical coaching program. Despite current participation rates, only 6 surgeons (4%) have completed training in surgical coaching, despite 79% expressing interest to participate in a surgical coaching program. The most influential barrier to participating in a coaching program was time commitment. Respondents largely prioritized technical and cognitive skill improvement as their primary goals for coaching (see figure below). CONCLUSIONS: While interest in surgical coaching is high among pediatric urologists, the principles of surgical coaching were not universally understood. Furthermore, formal coach training is markedly deficient, representing a gap in our profession and an opportunity for significant avenues for improvement, especially for technical and cognitive skills. Development of a coaching model based on these results would best suit the needs of pediatric urologists providing that the time commitment barrier for these endeavors can be mitigated and/or reconciled.