Development and validation of a theoretical test in non-anaesthesiologist-administered propofol sedation for gastrointestinal endoscopy.

OBJECTIVE: Safety with non-anaesthesiologist-administered propofol sedation (NAAP) during gastrointestinal (GI) endoscopy is related to theoretical knowledge. A summative testing of knowledge before attempting supervised nurse-administered propofol sedation (NAPS) in the clinic is advised. The aims of this study were to develop a theoretical test about propofol sedation, to gather validity evidence for the test and to measure the effect of a NAPS-specific training course. MATERIAL AND METHODS: A three-phased psychometric study on multiple choice questionnaire (MCQ) test development, gathering of validity evidence and evaluation of the effect of a specific NAAP course on the test result. A MCQ containing 86 questions was developed and administered 113 times to 91 participants representing novices, intermediates and experienced. RESULTS: Question difficulty analyses revealed 50 level I and II questions. The 50 MCQs showed mean (SD) intergroup differences (p = 0.001) between novices = 28.6 (4.82), intermediates = 36.8 (5.43) and experienced = 41.8 (4.65) and provided a pass score of 35.2. The course with pre-course test had significant effect on the knowledge of nurses (18% increase) and physicians (19% increase; p = 0.001 and 0.001, respectively). CONCLUSIONS: Data supported the validity of the developed MCQ test. The NAPS-specific course with pre-course testing adds theoretical knowledge to already well-prepared participants.

Three-dimensional versus two-dimensional vision in laparoscopy: a systematic review.

BACKGROUND: Laparoscopic surgery is widely used, and results in accelerated patient recovery time and hospital stay were compared with laparotomy. However, laparoscopic surgery is more challenging compared with open surgery, in part because surgeons must operate in a three-dimensional (3D) space through a two-dimensional (2D) projection on a monitor, which results in loss of depth perception. To counter this problem, 3D imaging for laparoscopy was developed. A systematic review of the literature was performed to assess the effect of 3D laparoscopy. METHODS: A systematic search of the literature was conducted to identify randomized controlled trials that compared 3D with 2D laparoscopy. The search was accomplished in accordance with the PRISMA guidelines using the PubMed, EMBASE, and The Cochrane Library electronic databases. No language or year of publication restrictions was applied. Data extracted were cohort size and characteristics, skill trained or operation performed, instrument used, outcome measures, and conclusions. Two independent authors performed the search and data extraction. RESULTS: Three hundred and forty articles were screened for eligibility, and 31 RCTs were included in the review. Three trials were carried out in a clinical setting, and 28 trials used a simulated setting. Time was used as an outcome measure in all of the trials, and number of errors was used in 19 out of 31 trials. Twenty-two out of 31 trials (71%) showed a reduction in performance time, and 12 out of 19 (63%) showed a significant reduction in error when using 3D compared to 2D. CONCLUSIONS: Overall, 3D laparoscopy appears to improve speed and reduce the number of performance errors when compared to 2D laparoscopy. Most studies to date assessed 3D laparoscopy in simulated settings, and the impact of 3D laparoscopy on clinical outcomes has yet to be examined.

Development and validation of a theoretical test of proficiency for video-assisted thoracoscopic surgery (VATS) lobectomy.

BACKGROUND: Testing stimulates learning, improves long-term retention, and promotes technical performance. No purpose-orientated test of competence in the theoretical aspects of VATS lobectomy has previously been presented. The purpose of this study was, therefore, to develop and gather validity evidence for a theoretical test on VATS lobectomy consisting of multiple-choice questions. METHODS: Four European VATS lobectomy experts were interviewed to explore their views on important theoretical VATS lobectomy knowledge (step 1). This information was used to construct the test items in compliance with existing guidelines for multiple-choice questions (step 2). The experts rated the relevance of the items to confirm content validity in a modified Delphi approach (step 3). Finally, the test was administered to physicians, who were categorised into different experience levels based on their experience in VATS procedures overall and in VATS lobectomies specifically. Their answers were used to achieve construct validity (step 4). RESULTS: Initially, 81 items were constructed and two Delphi iterations reduced the test to 50 items. Item analysis led to the exclusion of 19 items and the mean discrimination index of the 31 final items was 0.26. Cronbach's alpha for internal consistency was 0.75. The mean item difficulty was calculated to 0.63. According to performed VATS procedures, significantly different test performances were detected when comparing the group performances (p = 0.002) and the experts performed significantly better than the novices (p < 0.001) and intermediates (p = 0.01). In the category of performed VATS lobectomies, significant group performances were also found. In this category, the experts were also significantly better than the novices (p < 0.001), the trainees (p = 0.002), and the intermediates (p = 0.01). CONCLUSIONS: This study led to the development of a theoretical test on VATS lobectomy consisting of multiple-choice questions. Both content and construct validity evidence were established.

Development and validation of a multiple-choice questionnaire-based theoretical test in direct ophthalmoscopy.

PURPOSE: Direct ophthalmoscopy can reveal systemic, neurologic and ophthalmic conditions, but is poorly mastered among young physicians. A theoretical test is needed to measure effect of educational interventions. We developed and gathered validity evidence for a multiple-choice questionnaire (MCQ)-based theoretical test in direct ophthalmoscopy. METHODS: The MCQ was developed by interviewing experts. Then, validity evidence was evaluated using Messick's validity framework. Content was ensured by inviting the experts to contribute in a Delphi-like process. Response process was ensured by piloting and by streamlining all instructions. Then, the test was taken by ophthalmologists and by medical students without experience in direct ophthalmoscopy. Results were used to evaluate internal structure (item quality analysis and internal consistency), relations to other variables (correlation of test scores to experience level) and consequences (establishment of pass-fail score and the consequences of its use). RESULTS: The first phase of the study yielded 100 MCQs. In second phase, we identified that 60 items fulfilled predefined relevance and item quality requirements. These items demonstrated very high internal consistency (Cronbach's alpha = 0.95), significantly discriminated medical students from specialists (p < 0.001, independent samples t-test) and the established pass-fail score of 50 (83%) correct answers resulted in no false positives (students passing) and no false negatives (specialists failing). A Decision study identified that sampling 15 items suffice for certification. CONCLUSION: We developed and validated an MCQ-based theoretical test in direct ophthalmoscopy that enables an evidence-based approach to measuring, evaluating and certifying the theoretical knowledge necessary for direct ophthalmoscopy.

[Life-threatening intrauterine infection with Clostridium perfringens].

In this case report, a 40-year-old woman with a history of a uterine leiomyoma presented with abdominal pain and fever. Initially, her symptoms were associated with a bleeding from an ovarian cyst seen on a CT scan of the abdomen showing free intraperitoneal fluid surrounding the internal genitals. Meanwhile, her blood cultures came out positive for Clostridium perfringens, and her condition deteriorated despite intravenous antibiotics. A new CT scan revealed intrauterine gas development. A laparotomy was performed with removal of the internal genitals, and the patient improved on continuous antibiotics.

Training and Assessment of Hysteroscopic Skills: A Systematic Review.

OBJECTIVE: The aim of this systematic review was to identify studies on hysteroscopic training and assessment. DESIGN: PubMed, Excerpta Medica, the Cochrane Library, and Web of Science were searched in January 2015. Manual screening of references and citation tracking were also performed. Studies on hysteroscopic educational interventions were selected without restrictions on study design, populations, language, or publication year. A qualitative data synthesis including the setting, study participants, training model, training characteristics, hysteroscopic skills, assessment parameters, and study outcomes was performed by 2 authors working independently. Effect sizes were calculated when possible. Overall, 2 raters independently evaluated sources of validity evidence supporting the outcomes of the hysteroscopy assessment tools. RESULTS: A total of 25 studies on hysteroscopy training were identified, of which 23 were performed in simulated settings. Overall, 10 studies used virtual-reality simulators and reported effect sizes for technical skills ranging from 0.31 to 2.65; 12 used inanimate models and reported effect sizes for technical skills ranging from 0.35 to 3.19. One study involved live animal models; 2 studies were performed in clinical settings. The validity evidence supporting the assessment tools used was low. Consensus between the 2 raters on the reported validity evidence was high (94%). CONCLUSIONS: This systematic review demonstrated large variations in the effect of different tools for hysteroscopy training. The validity evidence supporting the assessment of hysteroscopic skills was limited.