Desarrollo y validación de un nuevo simulador para endourología / The development and validation of a new simulator for endourology

Introducción La simulación en medicina ha evolucionado sustancialmente en las últimas décadas. Actualmente hay una gran variedad de simuladores disponibles, especialmente diseñados para la práctica de procedimientos quirúrgicos. Debido a las largas curvas de aprendizaje de las técnicas endourológicas mínimamente invasivas, la rama de la endourología se puede ver muy beneficiada por el uso de estos simuladores. Material y métodos Se diseñó un simulador de baja fidelidad para la práctica de técnicas endourológicas que utilizan cistoscopia. En el proceso de validación participaron 5 expertos y 19 no expertos. Los expertos eran profesionales médicos de un Departamento de Urología con experiencia de al menos 100 procedimientos de cistoscopia flexible. Los no expertos eran residentes en medicina interna sin experiencia en ningún tipo de técnica endoscópica. Se recogió información sobre la validez aparente y de contenido mediante escalas de Likert con puntuación de 1 a 5. Para evaluar la validez de constructo, se midió el tiempo para completar dos tareas, para lo cual se evaluó el procedimiento mediante la escala de evaluación global OSATS. Resultados El nuevo simulador se fabricó satisfactoriamente de acuerdo con su diseño. En todos los aspectos evaluados de la validez de constructo hubo una diferencia significativa (p<0,05) entre el grupo de expertos y el de no expertos. La validez de contenido fue puntuada con 4,66 (desviación estándar [DE] ±0,56) por los expertos y con 4,41 (DE±0,71) por los no expertos. En el cuestionario de validez aparente, la puntuación media fue de 4,14 (DE±0,94), y la pregunta que recibió la puntuación más alta (4,6 [DE±0,84]) evaluaba la inmersión en el procedimiento. Conclusión El simulador presentado es válido tanto para el entrenamiento de nuevos endourólogos como para el perfeccionamiento de las técnicas de los médicos expertos (AU)

Introduction Simulation in medicine has developed a lot in the last few decades. There is a broad range of simulators available, above all for training in surgical procedures. Endourology can benefit much from simulation because the minimally-invasive procedures of endourology frequently have long learning curves, which can be reduced by training with simulators. Material and methods A low-fidelity simulator was designed for practicing endourology techniques that use cystoscopy. The process of validation involved 5 experts and 19 non-experts. Experts comprised medical professionals working in a department of urology who had performed at least 100 flexible cystoscopy procedures. Non-experts were residents in internal medicine without experience in any type of endoscopy. Information about face and content validity was collected by means of Likert scales from 1 to 5. To evaluate construct validity, we measured the time to complete two tasks, for which the procedure was evaluated by means of the OSATS global evaluation scale. Results New simulator was successfully built according to its design. For all evaluated aspects of construct validity, there was a significant difference (P<.05) between the group of experts and the group of non-experts. Content validity was scored 4.66 (standard deviation±0.56) by the experts and 4.41 (±0.71) by the non-experts. In the face validity questionnaire, the average score was 4.14 (±0.94), the question receiving the highest score: 4.6 (±0.84) concerned immersion in the procedure. Conclusion The simulator presented is valid both for training up new urologists in endourology technique and for experts seeking to perfect their skills (AU)

An Introduction to Cystoscopy for OB/GYN Residents.

INTRODUCTION: OB/GYN residents' preparedness to perform cystoscopy after residency may vary as the ACGME requires only 10 cystoscopic cases to be performed during training. Given residents' potentially limited exposure to cystoscopy, supplemental educational activities centered around increasing familiarity with the procedure may be useful. The objective of this workshop was to provide an opportunity for OB/GYN residents to become more comfortable with cystoscopic equipment and performing cystoscopy. METHODS: We showed a video of common pathology seen on cystoscopy and then progressed through two hands-on stations. One station focused on equipment familiarity, with learners identifying equipment and then practicing assembling and disassembling the cystoscope. The other station allowed for simulated cystoscopy utilizing a pig bladder. We used a checklist assessment and pre- and postcourse surveys to evaluate familiarity with equipment and anxiety surrounding performing cystoscopy. RESULTS: Twenty residents ranging from PGY 1s to PGY 4s who participated in this workshop over the past 2 years completed both pre- and postcourse evaluations. There was statistically significant improvement in ratings of familiarity with equipment and anxiety surrounding the procedure. All participants whom we assessed showed improvement in identifying and assembling equipment as well as in performing the steps of the procedure independently. DISCUSSION: This workshop provided OB/GYN residents with an opportunity for hands-on cystoscopic experience. Through direct assessment and evaluation forms, the workshop was shown to be a beneficial activity for improving cystoscopic knowledge.

A global snapshot of endourology residency training.

BACKGROUND: Urology has become more complex over the last decades with surgical sophisticated technologies such as endoscopy, laparoscopy and robotic surgery. As these minimally invasive methods gain popularity throughout the world, this has led in some countries to a serious training gap as compared to other countries, and between generations of surgeons within national training systems. There is a huge heterogeneity in urological training between countries, whether developed or developing. This paper attempts to shed some light onto global urological training, comparing a significant number of various national systems, and to outline global tendencies in urological training. It will enable interested readers to see where their own system stands in international comparison, and hopefully enable them to identify training needs to achieve global quality standards. MATERIALS AND METHODS: This is a questionnaire-based assessment which was sent to 240 members of U-merge from 62 countries. In addition, there is ample literature on the requirements of structured training programs and assessments, and we have tried to briefly outline the key points in this paper. RESULTS: We received responses from 32 countries Urology residency training is hugely heterogenous between countries. Only 44% of nations use a structured training program with assessments. Others use the Halstedian apprenticeship approach. Notably, some developing countries do use modern teaching and assessment methods, whereas some developed countries still use the outmoded apprenticeship model. For the interested reader, results have been tabled in detail, and training systems described country by country. CONCLUSIONS: Our results have shown a huge heterogeneity in quality urology training between countries and within continents. In systems without national structure of training, it can be assumed that such differences exist even between hospitals/ training institutions. There is no doubt in times of globalization with resident and doctor migration and exchanges that training needs structure and standardization. The still huge gap in developing countries to catch up and be able to afford latest surgical and learning technologies need to be addressed with the help of responsible outreach programs.

A Novel Simulated Training Platform and Study of Performance Among Different Levels of Learners in Flexible Cystoscopy.

INTRODUCTION: The aims of this study were to test a novel simulation platform suitable for flexible cystoscopy using a standard scope, to assess the platform's proposed use as a training tool for flexible cystoscopy, and to assess the user experience through surveyed response. METHODS: Thirty-one urologists (11 novices, 20 experts) were evaluated using a novel light-based bladder model and standard flexible cystoscope. Time to complete full inspection of the simulated bladder was measured, and the scope trajectory was recorded. Participants also completed a survey of the training platform. RESULTS: Thirty participants completed a simulated inspection of a portable bladder model with a mean ± SD time for 153.1 ± 76.1 seconds. One participant failed to complete. Novice urologists (defined as those having completed less than 50 flexible cystoscopies in clinic) had a mean ± SD time of 176.9 ± 95.8 seconds, whereas with experts, this decreased to 139.3 ± 60.7 seconds. Dynamic trajectory maps identified "blind spots" within each user's cystoscopy performance. In a poststudy follow-up, 27 participants considered the tool valuable or extremely valuable for training, whereas 19 participants considered that the tool either very well or excellently replicated the clinical setting. All participants ranked the tool as very good or excellent for overall quality of training. DISCUSSION: Advances in electronic technology make portable low-cost models a potential low-cost alternative to endourology training platforms. In providing a quantifiable measure of user performance, the tool may shorten the learning curve in flexible cystoscopy and, potentially, reduce clinical errors and provide quantifiable measures for further clinical training.

Validation of the endoscopic stone treatment step 1 (EST-s1): a novel EAU training and assessment tool for basic endoscopic stone treatment skills-a collaborative work by ESU, ESUT and EULIS.

INTRODUCTION: The endoscopic stone treatment step 1 (EST s1) protocol has been developed after 2 years of collaborative work between different European Association of Urology (EAU) sections. OBJECTIVES: In this study, we added construct validity evidence to the EST s1 curriculum. MATERIALS AND METHODS: The EST-s1 curriculum includes four standardized tasks: flexible cystoscopy, rigid cystoscopy, semi-rigid URS and flexible URS. Validation was performed during the annual 2016 EUREP meeting in Prague. 124 participants provided information on their endoscopic logbook and carried out these 4 tasks during a DVD recorded session. Recordings were anonymized and blindly assessed independently by five proctors. Inter-rater reliability was checked on a sample of five videos by the calculation of intra-class correlation coefficient. Task-specific clinical background of participants was correlated with their personal performance on the simulator. Breakpoint analysis was used to define the minimum number of performed cases, to be considered "proficient". "Proficient" and "Non-proficient" groups were compared for construct validity assessment. Likert scale-based questionnaires were used to test content and to comment on when the EST-s1 exams should be undertaken within the residency program. RESULTS: 124 participants (105 final-year residents and 19 faculty members) took part in this study. The breakpoint analysis showed a significant change in performance curve at 36, 41, 67 and 206 s, respectively, corresponding to 30, 60, 25 and 120 clinical cases for each of the 4 tasks. EST-s1 was scored as a valid training tool, correctly representing the procedures performed in each task. Experts felt that this curriculum is best used during the third year of residency training. CONCLUSION: Our validation study successfully demonstrated correlation between clinical expertise and EST-s1 tasks, adding construct validity evidence to it. Our work also demonstrates the successful collaboration established within various EAU sections.

Global Survey of a Novel Smartphone Mobile Endoscopy System.

INTRODUCTION: The most commonly performed procedure among urologists is cystoscopy. However, urologists in developing countries have limited access and funds to purchase the equipment necessary to perform this procedure. The novel Endockscope (ES) mobile endoscopic system aids in reducing this gap in both cost and accessibility. MATERIALS AND METHODS: ES kits were distributed at the 2016 World Congress of Endourology in Cape Town, South Africa. All participants were given instructions on how to use the device and each participant attended a live demonstration during the conference. Eight months later, all participants were contacted via email, regular mail, or phone to complete a questionnaire designed to assess the impact of the ES device. RESULTS: A total of 24 ES kits were distributed. After numerous emails, questionnaires sent by regular return mail, and phone calls, 12 (50%) participants completed the survey as instructed. Seventy percent of participants reported that they performed more endoscopic procedures due to the ES system. Overall, 90% of participants stated that they would purchase the ES system for personal use ($40.53). All participants reported that they would recommend the ES to others. CONCLUSION: The ES system provided an effective inexpensive system to enable urologists in resource-challenged countries to offer cystoscopy to more of their patients.

Direct Observation vs. Video-Based Assessment in Flexible Cystoscopy.

OBJECTIVE: Direct observation in assessment of clinical skills is prone to bias, demands the observer to be present at a certain location at a specific time, and is time-consuming. Video-based assessment could remove the risk of bias, increase flexibility, and reduce the time spent on assessment. This study investigated if video-based assessment was a reliable tool for cystoscopy and if direct observers were prone to bias compared with video-raters. DESIGN: This study was a blinded observational trial. Twenty medical students and 9 urologists were recorded during 2 cystoscopies and rated by a direct observer and subsequently by 2 blinded video-raters on a global rating scale (GRS) for cystoscopy. Both intrarater and interrater reliability were explored. Furthermore, direct observer bias was explored by a paired samples t-test. RESULTS: Intrarater reliability calculated by Pearson's r was 0.86. Interrater reliability was 0.74 for single measure and 0.85 for average measures. A hawk-dove effect was seen between the 2 raters. Direct observer bias was detected when comparing direct observer scores to the assessment by an independent video-rater (p < 0.001). CONCLUSION: This study found that video-based assessment was a reliable tool for cystoscopy with 2 video-raters. There was a significant bias when comparing direct observation with blinded video-based assessment.

Nonspecialist Raters Can Provide Reliable Assessments of Procedural Skills.

BACKGROUND: Competency-based learning has become a crucial component in medical education. Despite the advantages of competency-based learning, there are still challenges that need to be addressed. Currently, the common perception is that specialist assessment is needed for evaluating procedural skills which is difficult owing to the limited availability of faculty time. The aim of this study was to explore the validity of assessments of video recorded procedures performed by nonspecialist raters. METHODS: This study was a blinded observational trial. Twenty-three novices (senior medical students) and 9 experienced doctors were video recorded while each performing 2 flexible cystoscopies on patients. The recordings were anonymized and placed in random order and then rated by 2 experienced cystoscopists (specialist raters) and 2 medical students (nonspecialist raters). Flexible cystoscopy was chosen as it is a simple procedural skill that is crucial to master in a resident urology program. RESULTS: The internal consistency of assessments was high, Cronbach's α = 0.93 and 0.95 for nonspecialist and specialist raters, respectively (p < 0.001 for both correlations). The interrater reliability was significant (p < 0.001) with a Pearson's correlation of 0.77 for the nonspecialists and 0.75 for the specialists. The test-retest reliability showed the biggest difference between the 2 groups, 0.59 and 0.38 for the nonspecialist raters and the specialist raters, respectively (p < 0.001). CONCLUSION: Our study suggests that nonspecialist raters can provide reliable and valid assessments of video recorded cystoscopies. This could make mastery learning and competency-based education more feasible.

The CREST Simulation Development Process: Training the Next Generation.

BACKGROUND: The challenges of training and assessing endourologic skill have driven the development of new training systems. The Center for Research in Education and Simulation Technologies (CREST) has developed a team and a methodology to facilitate this development process. METHODS: Backwards design principles were applied. A panel of experts first defined desired clinical and educational outcomes. Outcomes were subsequently linked to learning objectives. Gross task deconstruction was performed, and the primary domain was classified as primarily involving decision-making, psychomotor skill, or communication. A more detailed cognitive task analysis was performed to elicit and prioritize relevant anatomy/tissues, metrics, and errors. Reference anatomy was created using a digital anatomist and clinician working off of a clinical data set. Three dimensional printing can facilitate this process. When possible, synthetic or virtual tissue behavior and textures were recreated using data derived from human tissue. Embedded sensors/markers and/or computer-based systems were used to facilitate the collection of objective metrics. A learning Verification and validation occurred throughout the engineering development process. RESULTS: Nine endourology-relevant training systems were created by CREST with this approach. Systems include basic laparoscopic skills (BLUS), vesicourethral anastomosis, pyeloplasty, cystoscopic procedures, stent placement, rigid and flexible ureteroscopy, GreenLight PVP (GL Sim), Percutaneous access with C-arm (CAT), Nephrolithotomy (NLM), and a vascular injury model. Mixed modalities have been used, including "smart" physical models, virtual reality, augmented reality, and video. Substantial validity evidence for training and assessment has been collected on systems. An open source manikin-based modular platform is under development by CREST with the Department of Defense that will unify these and other commercial task trainers through the common physiology engine, learning management system, standard data connectors, and standards. CONCLUSION: Using the CREST process has and will ensure that the systems we create meet the needs of training and assessing endourologic skills.

Construct and Predictive Validity of a Cystoscopic Checklist to Evaluate Surgical Competency in the Operating Room.

PURPOSE: The aim of this study was to demonstrate the construct and predictive validity of a task-specific checklist for cystoscopy in the operating room. METHODS: This study is a prospective observational study evaluating the validity of a task-specific checklist for cystoscopic proficiency on residents performing cystoscopy in the operating room over a 4-year period. Residents were scored on 2 task-specific checklists: (1) assembly and (2) performance of a diagnostic cystoscopy. Construct validity was evaluated by comparing absolute checklist scores based on resident year with a Kruskal-Wallis and χ test, respectively. Paired analysis was performed with Wilcoxon sign rank and McNemar tests to assess differences between initial and final observations. Predictive validity was evaluated by determining the percent of competently performed task-specific checklists subsequent to 1 competent task-specific checklist completion. RESULTS: One hundred fifty-three evaluations were performed on 30 residents from all 4 levels of training. The median task-specific checklist scores for both (1) assembly and (2) performance of a diagnostic cystoscopy demonstrated construct validity with statistically significant trends demonstrating improved scores as resident year increased from intern to chief, P values of <0.001 and <0.0001, respectively. Once competency was obtained for 1 cystoscope assembly checklist, 92% of future assembly checklists were competently competent. For diagnostic cystoscopy once checklist competency was obtained, 69% of future checklists were completed competently. All scores and competencies were significantly improved from the initial to the final observation. DISCUSSION: The task-specific checklists for (1) assembly and (2) performance of a diagnostic cystoscopy demonstrated construct validity. Predicative validity for assembly of a cystoscope is high but less so for performance of a diagnostic cystoscope.

Upper and Lower Urinary Tract Endoscopy Training on Thiel-embalmed Cadavers.

OBJECTIVE: To evaluate Thiel-embalmed cadavers as a new training model for urological endoscopy procedures. MATERIALS AND METHODS: Twelve urologists performed upper and lower urinary tract endoscopies on 5 different Thiel-embalmed cadavers to evaluate this potentially new training model in urological endoscopic procedural training. Using a 5-point Likert scale, the participants assessed the quality of the tissue and the overall experience of the endoscopy in comparison to a live patient procedure. RESULTS: Thiel-embalmed cadavers have shown to mimic live patient endoscopy of the upper and lower urinary tract in terms of almost identical overall anatomical conditions and manipulation characteristics of the tissue. The mucosa of the urethra and ureters showed similar colors and consistency in comparison to a live patient, whereas bladder mucosa was lacking the visibility of the vessels, thus was unsuitable for identifying any mucosal abnormalities. The flexibility of the muscles allowed for proper patient positioning, whereas the loss of muscle tonus made ureteroscopy more difficult although sufficiently comparable to the procedure done in a live patient. CONCLUSION: Thiel-embalmed cadavers have already been proven to be a suitable training model for several medical procedures. They are known for preserving tissue color, consistency, and flexibility without the irritant odors or risk of infection, which make them resemble live patients with real-life surgical challenges. The results of our study strongly suggest that despite some minor drawbacks, Thiel-embalmed cadavers are a suitable simulation model for initial training of urethrocystoscopy and ureteroscopy.

Impact of remote monitoring and supervision on resident training using new ACGME milestone criteria.

INTRODUCTION: The study objective was to determine the impact of remote monitoring and supervision (RMS) in integrated endourology suites (IES) on residents achieving endoscopic training milestones. MATERIALS AND METHODS: Twenty-one urology residents evaluated RMS in IES using a 25-question survey. IES provided audio-visual communication for faculty to supervise residents remotely. Questionnaire used a linear visual scale of 1-10 to assess acceptability (8 questions), impact on training (10 questions), supervision level (1 question), and pre- and post-training milestone self-assessments (6 questions). Improvements in Patient Care Milestone #7 (upper/lower tract endoscopic procedures) and Patient Care Milestone #9 (office-based procedures) were analyzed. RESULTS: Twenty-one urology residents (out of potential 23) evaluated RMS in IES using a 25-question survey (91.3% response rate). Overall RMS acceptability and satisfaction was high (mean score = 9.1/10) with a majority (95.2%) feeling comfortable being alone with the patient. Residents reported positively on the following parameters: autonomy without compromising safety (8.7), supervision level (8.6), achieving independence (8.4), education quality (8.3), learning rate (8.1), clinical decision-making (8.0), and reducing case numbers to achieve proficiency (7.6). Residents perceived no issues with under- or over-supervision, and a majority (76.2%) expressed that RMS should be standard of training in residency programs. Residents reported mean level increases of 2.5 and 2.8 (out of 5) in Patient Care Milestones for endoscopic procedures and office-based procedures, respectively (p < 0.0001). CONCLUSIONS: RMS in integrated endourology suites may enhance resident education and endoscopic training. The study demonstrated an increase in competency levels reported by residents trained using RMS.

Ureteroscopy and cystoscopy training: comparison between transparent and non-transparent simulators.

BACKGROUND: Simulators have been widely used to train operational skills in urology, how to improve its effectiveness deserves further investigation. In this paper, we evaluated training using a novel transparent anatomic simulator, an opaque model or no simulator training, with regard to post-training ureteroscopy and cystoscopy proficiency. METHODS: Anatomically correct transparent and non-transparent endourological simulators were fabricated. Ten experienced urologists provided a preliminary evaluation of the models as teaching tools. 36 first-year medical students underwent identical theoretical training and a 50-point examination of theoretical knowledge. The students were randomly assigned to receive training with the transparent simulator (Group 1), the non-transparent simulator (Group 2) or detailed verbal instruction only (Group 3). 12 days after the training session, the trainees' skills at ureteral stent insertion and removal were evaluated using the Uro-Scopic Trainer and rated on an Objective Structured Assessment of Technical Skills (OSATS) scale. RESULTS: The new simulators were successfully fabricated in accordance with the design parameters. Of the ten urologists invited to evaluate the devices, 100% rated the devices as anatomically accurate, 90% thought both models were easy to use and 80% thought they were good ureteroscopy and cystoscopy training tools. The scores on the theoretical knowledge test were comparable among the training groups, and all students were able to perform ureteral stent insertion and removal. The mean OSATS scores of groups 1, 2 and 3 were 21.83 ± 3.64, 18.50 ± 4.03 and 15.58 ± 2.23 points, respectively, (p = 0.001). CONCLUSIONS: Simulator training allowed students to achieve higher ureteroscopic and cystoscopic proficiency, and transparent simulators were more effective than non-transparent simulators.

Do high-fidelity training models translate into better skill acquisition for an endourologist?

PURPOSE OF REVIEW: Nowadays, accessibility to the operative room is becoming more limited for medical students and residents, principally due to decreasing operative time, increasing waiting list, ethical consideration and legal issue in case of any complications. Simulation models have gained in popularity and are now considered a major component in the training and skill development of medical students and residents before coming to the operative room. In this review, we summarized and discussed the relevant aspect of ureteroscopy training models and gave an overview of the advantage in skill acquisition while training with a high-fidelity model. RECENT FINDINGS: Currently, there is an increase in surgical programs trying to implement endourology training models into the curriculum. The training simulators that would allow the medical students and residents to rapidly reach an autonomous level are yet to be developed. Several ureteroscopy models have been described and validated; however, the transposition of skill acquisition into real-life surgery is not properly demonstrated. SUMMARY: Training reduces the learning curve for novice medical students or residents. However, further studies are still needed to better define the impact of skill acquisition in real life and its sustainability.

Perceptions of posthysterectomy cystoscopy training in obstetrics and gynecology residency programs.

OBJECTIVE: The objective of this study was to characterize the training practices of obstetrics and gynecology (OG) residency programs regarding posthysterectomy cystoscopy. METHODS: Two separate electronic surveys were sent to program directors and residents at American Council of Graduate Medical Education-accredited OG programs. Measures included the type of cystoscopy training available, estimates on indications and how often posthysterectomy cystoscopy is performed, and exposure to female pelvic medicine and reconstructive surgery (FPMRS). RESULTS: Sixty-one (26%) of 235 program directors and 394 (29.7%) of 1325 residents completed the survey. The majority of residents (95%) who received training reported having experience with cystoscopy in the operating room. Residents with FPMRS fellowships were more likely to perform routine cystoscopy after hysterectomy during their training compared with residents without fellowships (39% vs 27%, P = 0.01). Residents graduating from programs with FMPRS fellowships reported they planned to always perform routine cystoscopy more often than did those without a fellowship program (30.3% vs 17%, P = 0.01).Program directors most frequently defined competency as direct observation of the procedure (95%), followed by the number performed (53%) and a competency checklist (45%). No significant differences were noted in the reported use of routine cystoscopy by program directors after hysterectomy, with or without a fellowship program (62% vs 48%, P = 0.38). CONCLUSIONS: Residents in OG programs are receiving cystoscopy training, most commonly in the operating room, less often with simulation. Nineteen percent reported receiving no training. Graduating residents exposed to FPMRS fellowships more frequently reported planning to always perform cystoscopy after hysterectomy than did those without fellowship exposure.

[Transurethral resection of bladder tumors: management of complications]. / Transurethrale Resektion der Harnblase: Komplikationsmanagement.

As a frequent endourological procedure, transurethral resection of bladder tumors (TURB) represents a major field of activity for urological surgeons. Although TURB represents an endoscopic training procedure for urology residents, there are clear requirements for the quality of the surgical procedure as such. The knowledge of possible complications and their management are essential for urologists active in the clinical field. Bleeding complications, bladder perforation, infections and injuries to the ureteral orifice are the most frequently observed complications. This article summarizes the essential risks and complications as well as the corresponding preventive and therapeutic measures.