Construct Validity and Experience of Using a Low-cost Arthroscopic Knee Surgery Simulator.

OBJECTIVE: To validate an affordable and easily reproducible arthroscopic knee surgery simulator made from simple, low-cost materials by demonstrating its ability to distinguish experienced from novice arthroscopists (i.e., construct validity). Additionally, acceptance and usefulness of the simulator in medical training and education were assessed. DESIGN: The simulator was used to perform a partial meniscectomy in both menisci. External and intra-articular images obtained during the procedures were used to assess objective visual parameters. The Arthroscopic Surgical Skill Evaluation Tool and a Likert scale addressing individual perceptions about the simulator and its applicability in medical education were also used. SETTING: The study was conducted at Hospital de Clínicas da Universidade Federal do Paraná, a teaching hospital in southern Brazil. PARTICIPANTS: Thirty sixth-year medical students were recruited, as well as 10 orthopedic surgeons who had knee arthroscopy expertise and were members of a sports traumatology and knee arthroscopy group. RESULTS: There were statistically significant differences between the groups in all objective parameters. The mean time to perform the procedure was 60% higher among students compared to surgeons. Students needed 72.5% more time on average to perform triangulations and obtained an error rate approximately twice higher in the assessment of the area removed from the menisci. Regarding Arthroscopic Surgical Skill Evaluation Tool scores, statistically significant differences were found between surgeons and students in all 8 domains and in the total score. The simulator was well accepted, as over 90% of participants found it useful for education and training, believed it contributed to teaching and assessing specific surgical steps and procedures, and reported that the task was enjoyable. CONCLUSIONS: The arthroscopic knee surgery simulator was largely accepted and had good applicability in objective measurement of surgical skills, distinguishing medical students from orthopedic surgeons and thus demonstrating construct validity.

Comparison of Operative Logbook Experience of Australian General Surgical Trainees With Surgeons Deployed on Humanitarian Missions: What Can Be Learnt for the Future?

OBJECTIVE: General surgical training in Australia has undergone considerable change in recent years with less exposure to other areas of surgery. General surgeons from many high-income countries have played important roles in assisting with the provision of surgical care in low- and middle-income countries during sudden-onset disasters (SODs) as part of emergency medical teams (EMTs). It is not known if contemporary Australian general surgeons are receiving the broad surgical training required for work in EMTs. DESIGN: Logbook data on the surgical procedures performed by Australian general surgical trainees were obtained from General Surgeons Australia (GSA) for the time period February 2008 to February 2017. Surgical procedures performed by Médecins sans Frontières (MSF) surgeons during 5 projects in 3 SODs (the 2010 Haiti earthquake, the 2013 Philippines typhoon and the 2015 Nepal earthquake) were obtained from previously published data for 6 months following each disaster. SETTING AND PARTICIPANTS: This was carried out at the University of Sydney with input from MSF Operational Centre Brussels and GSA. RESULTS: Australian general surgical trainees performed a mean of 2107 surgical procedures (excluding endoscopy) during their training (10 6-month rotations). Common procedures included abdominal wall hernia repairs (268, 12.7%), cholecystectomies (247, 11.8%), and specialist colorectal procedures (242, 11.5%). MSF surgeons performed a total of 3542 surgical procedures across the 5 projects analyzed. Common procedures included Caesarean sections (443, 12.5%), wound debridement (1115, 31.5%), and other trauma-related procedures (472, 13.3%). CONCLUSIONS: Australian general surgical trainees receive exposure to both essential and advanced general surgery but lack exposure to specialty procedures including the obstetric and orthopedic procedures commonly performed by MSF surgeons after SODs. Further training in these areas would likely be beneficial for general surgeons prior to deployment with an EMT.

Education Improves Musculoskeletal Radiology Interpretation by Trainees in a Low-Resource Setting.

OBJECTIVE: The aims of this study were to assess baseline musculoskeletal radiology knowledge among Haitian orthopedists and to determine the impact of an adult and pediatric musculoskeletal radiology lecture series. DESIGN: Participants were given lectures reviewing normal and abnormal elbow radiographs and received assessments before and after the intervention. Bivariate and multivariate analyses were used to identify factors associated with baseline and postintervention scores. SETTING: This study was carried out as part of the 2018 Haitian Annual Assembly of Orthopaedic Trauma. This is an annual continuing medical educational conference in the capital city of Port-au-Prince open to all Haitian orthopedic surgeons and associated care providers, with a strong focus on resident training. PARTICIPANTS: Haitian orthopedic surgery residents and surgeons attending the 2018 Haitian Annual Assembly of Orthopaedic Trauma. RESULTS: Thirty-seven residents and faculty consented to participate in this study and 32 (86.5%) were male with a median age of 33 (interquartile rage: 30-35). On multivariate analysis controlling for the title (resident versus attending), total years of orthopedics (beginning of residency and beyond), and formal radiology teaching in medical school or residency, conference attendance in the past was significantly associated with higher preintervention assessment scores (odds ratio = 1.24, 95% confidence interval = 1.06-1.44, p = 0.010]. The mean total preintervention accuracy for correctly identification of pathology, if present, was 70% compared to 83% at the postassessment (p < 0.001). CONCLUSIONS: Overall, this study demonstrates that a brief lecture series at a continuing medical conference in Port-au-Prince, Haiti improved upper extremity radiographic interpretation based on pre and postassessments, and that prior conference attendance may be associated with higher baseline scores.

Triple jump: an alternative to be consider for assessing compliance with goals in graduate programs / Salto triple: una alternativa de evaluación del cumplimiento de objetivos en programas de postgrado

SUMMARY: Ensuring quality in graduate teaching is a guarantee of the competitiveness demonstrated by institutions. The aim of this study was to determine the internal consistency and reliability of the Triple Jump (TJ) instrument applied to Master's and Doctorate students in Medical Sciences to assess compliance of goals. Reliability study conducted at Universidad de La Frontera, Temuco, Chile. TJ was applied by 3 evaluators who performed 2 evaluations, with structured assessment guidelines in three domains (cognitive, attitudinal and procedural), on a Likert scale with scores from 0 (not achieved) to 4 (achieved). The total point score was transformed into a final grade. The evaluated subjects were characterized, and internal consistency and interobserver reliability were determined. Fifty-one Health care professionals enrolled in Medical Sciences graduate programs at the Universidad de La Frontera between 2005-2016 (35 from the Master 's program and 16 from the Doctorate in Medical Sciences). In study subjects had a median age of 29 years, 6 years of professional experience and 3 years as specialists. 66.7 % were male. The internal consistency of the responses to the assessment was characterized by a Cronbach's between 0.734 and 0.938. Interobserver reliability of the instrument had values between 0.86 and 1.0. The levels of internal consistency and reliability were higher than previously reported; therefore, the test is reliable and exhibits solid internal consistency.

RESUMEN: Garantizar la calidad en la enseñanza de posgrado es una garantía de la competitividad demostrada por las instituciones. El objetivo de este estudio fue determinar la consistencia interna y confiabilidad interobservador del instrumento salto triple (ST), aplicado a estudiantes de Magíster y Doctorado en Ciencias Médicas, para evaluar cumplimiento de objetivos de aprendizaje. Estudio de confiabilidad realizado en la Universidad de La Frontera, Temuco, Chile. El ST, fue aplicado por 3 evaluadores que realizaron 2 evaluaciones, utilizando guías de evaluación estructuradas en tres dimensiones (cognitivo, actitudinal y de procedimiento); en una escala tipo Likert con puntajes de 0 (objetivo no logrado) a 4 (objetivo plenamente logrado). El puntaje total se transformó posteriormente en una calificación final. Se caracterizó a los sujetos evaluados y se determinó consistencia interna y confiabilidad interobservador. Para ello, se enrolaron 51 profesionales de la salud matriculados en los programas de postgrado en Ciencias Médicas de la Universidad de La Frontera entre 2005 y 2016 (35 del programa de Magíster y 16 del Doctorado en Ciencias Médicas). Los sujetos a estudio, tenían una mediana de edad de 29 años, 66,7 % eran hombres, tenían 6 años de experiencia profesional y 3 años como especialistas. La consistencia interna de las respuestas a la evaluación se caracterizó por un a de Cronbach entre 0,734 y 0,938. La confiabilidad interobservador del instrumento tenía valores entre 0,86 y 1,0. Los niveles de consistencia interna y confiabilidad fueron más altos que los reportados previamente; por ende, nos parece que esta forma de evaluar objetivos en este tipo de estudiantes, tiene una consistencia interna sólida y es confiable.

Does Previous Laparoscopic Experience Influence Basic Robotic Surgical Skills?

OBJECTIVE: Studies addressing the effect of laparoscopic experience on robotic skills have produced conflicting results. This study aimed to compare simulated robotic surgical tasks using the virtual reality simulator dV-Trainer between laparoscopically experienced surgeons and first-year surgical residents. DESIGN: A cross-sectional study. Participants completed 4 trials of the following tasks on the dV-Trainer: Peg Board 2, Ring and Rail 1, and Suture Sponge 1. Performance was recorded using a computerized built-in scoring algorithm. Scores and metrics were compared between groups 1 and 2 and between the first and subsequent trials. SETTING: Hospital de Clínicas, Porto Alegre, Brazil, a tertiary care teaching hospital. PARTICIPANTS: Twenty laparoscopically experienced surgeons (group 1) and 20 first-year surgical residents (group 2). All participants completed the study. RESULTS: The overall scores for Peg Board 2 (738.04 ± 267.83 vs 730.39 ± 225.31; p = 0.57), Ring and Rail 1 (919.03 ± 242.69 vs 965.84 ± 222.96; p = 0.13), and Suture Sponge 1 (563.62 ± 185.50 vs 560.99 ± 152.71; p = 0.67) did not differ significantly between groups 1 and 2. Group 1 had better results for master workspace range in Peg Board 2 and Ring and Rail 1. Group 2 had higher scores for economy of motion in Peg Board 2 and Ring and Rail 1 and for excessive instrument force in Ring and Rail 1. In both groups, the overall scores in the third and fourth trials were significantly higher than those in the first trial. CONCLUSIONS: There are no significant differences in the performance of simulated robotic surgical tasks between laparoscopically experienced surgeons and laparoscopically naïve surgical residents. Some slight differences were observed in specific metrics, but these differences were not sufficient to change the final results. We may assume that laparoscopic experience should not be an essential step in the initial learning curve of robotic surgery.

TEAM: A Low-Cost Alternative to ATLS for Providing Trauma Care Teaching in Haiti.

OBJECTIVE: Trauma resuscitation protocols have unified the care of trauma patients and significantly improved outcomes. However, the success of the Advanced Trauma Life Support course is difficult to reproduce in developing countries due to set-up costs, limitations of resources, and variations of practice. The objective of this study is to assess the Trauma Evaluation and Management (TEAM) course as a low-cost alternative for trauma resuscitation teaching in Low and Middle Income Countries (LMIC). DESIGN: As part of the Team Broken Earth initiative, TEAM course was provided to the health care professionals in Haiti. At its conclusion, participants were asked to complete a survey evaluating the course. Qualitative and quantitative data were analyzed to evaluate the perception of the course. SETTING: The course was provided in Port-au-Prince, Haiti. PARTICIPANTS: A total of 80 health care professionals participated in the course. Response was obtained from 69 participants, which comprised of 32 physicians, 10 Emergency Medical Technicians (EMT), 22 nurses, and 5 medical trainees. RESULTS: The course was well received by physicians, nurses, and EMT with an average score of 90.6%. Question analysis revealed a lower satisfaction of physicians for the course manual and teaching materials, and information related to decisions for transfer of patients. EMT consistently felt that the course was not tailored to their learning and practice needs. Written feedback demonstrated several areas of weaknesses including need for improvements in translations, hands-on practice, and educational materials. CONCLUSIONS: Overall, the TEAM course was well received. Analysis demonstrated a need for adjustments specific to LMIC including a focus on prehospital assessment, increased nursing responsibilities, and unavailability of specialist's referrals. Team Broken Earth intends to take these findings into consideration and continue to provide the TEAM course to other LMIC.

A Self-Reported Needs Assessment Survey of Pediatric Orthopaedic Education in Haiti.

OBJECTIVE: The burden of musculoskeletal disease remains high in low-income countries, with a high rate of pediatric disease. Efforts continue for orthopedic education, but there is little guidance on local needs and desires. Our aim was to determine the specific content and modalities that would be most useful for pediatric orthopedic educational programs abroad, and we demonstrate a practical method of identifying country-specific educational deficits through a self-reported needs survey in Haiti. DESIGN: A cross-sectional survey was administered using an automated response system. We obtained demographic information as well as training and practice patterns, comfort levels with pediatric diagnoses, and desired topics for education using a 5-point Likert Scale. SETTING: Haitian Annual Assembly for Orthopaedic Trauma (HAAOT), the only national, continuing medical education conference for orthopedic providers in Haiti. PARTICIPANTS: Of 60 eligible participants, 51 were included in the final analysis. RESULTS: Time spent on pediatric orthopedics varied widely, centered at 10% to 25%. Median comfort level with pediatric orthopedics was 3 of 5. Skills with lowest self-reported competence included spica casting, clubfoot casting, and management of supracondylar humerus fractures. Skills with highest self-reported competence were long-leg casting and Salter-Harris classification. Modes of education highly requested included didactics/lectures, hands-on sessions, dedicated rotations, and exchanges with foreign peers/mentors. Diagnoses most encountered were osteomyelitis, trauma, and clubfoot; lowest comfort levels were in neuromuscular, spine, lower extremity deformity, congenital hip, and clubfoot; and most requested for future teaching were congenital hip, neuromuscular, and spine. CONCLUSIONS: Haitian orthopedic providers express a strong desire and need for ongoing pediatric orthopedic education. They describe a high prevalence of trauma and infection, but convey a requirement for more comprehensive, multimodal teaching that also includes congenital deformities/dysplasias, neuromuscular, and spine. Our results demonstrate the importance of assessing country-specific needs and involving local care providers in curriculum development.

Validation of a Visual-Spatial Secondary Task to Assess Automaticity in Laparoscopic Skills.

INTRODUCTION: Our objective was to assess reliability and validity of a visual-spatial secondary task (VSST) as a method to measure automaticity on a basic simulated laparoscopic skill model. In motor skill acquisition, expertise is defined by automaticity. The highest level of performance with less cognitive and attentional resources characterizes this stage, allowing experts to perform multiple tasks. Conventional validated parameters as operative time, objective assessment skills scales (OSATS), and movement economy, are insufficient to distinguish if an individual has reached the more advanced learning phases, such as automaticity. There is literature about using a VSST as an attention indicator that correlates with the automaticity level. METHODS: Novices with completed and approved Fundamentals of Laparoscopic Surgery course, and laparoscopy experts were enrolled for an experimental study and measured under dual tasks conditions. Each participant performed the test giving priority to the primary task while at the same time they responded to a VSST. The primary task consisted of 4 interrupted laparoscopic stitches (ILS) on a bench-model. The VSST was a screen that showed different patterns that the surgeon had to recognize and press a pedal while doing the stitches (PsychoPsy software, Python, MacOS). Novices were overtrained on ILS until they reach at least 100 repetitions and then were retested. Participants were video recorded and then assessed by 2 blinded evaluators who measured operative time and OSATS. These scores were considered indicators of quality for the primary task. The VSST performance was measured by the detectability index (DI), which is a ratio between correct and wrong detections. A reliable evaluation was defined as two measures of DI with less than 10% of difference, maintaining the cutoff scores for performance on the primary task (operative time <110 seg and OSATS >17 points). RESULTS: Novices (n = 11) achieved reliable measure of the test after 2 (2-5) repetitions on the preassessment and 3.75 (2-5) on the postassessment (p = 0.04); whereas laparoscopy experts (n = 4) did it after 3.5 (3-4) repetitions. Proficiency cutoff scores for the primary task were achieved on every measure for novices (prepost overtraining) and experts. Expert performance on VSST was DI 0.78 (0.69-0.87). Novice performance was significantly better on postassessment (DI-pre 0.48 [0.06-0.71] vs DI-post 0.78 [0.48-0.95], p = 0.003). Overtraining consisted in 140 (100-210) repetitions of ILS for all novices, made in 8 hours (3-15). By categorizing DI based on expert performance, novices with DI-post >0.65 achieved better OSATS score and less operative time than novices with DI-post<0.65 (p = 0.007 y, p = 0.089, respectively). CONCLUSION: Measuring automaticity is feasible using a VSST. This instrument is reliable and has a face, content and construct validity. A DI over 0.65 may be a cutoff point correlated with high standard performance on the primary task. This instrument measures performance on laparoscopic skills, and along with conventional indicators, would better define advance levels of expertise. More studies are required applying this VSST to achieve external validity by reproducing our results.

Assessment of the Mexican Board of Pediatric Surgery Certification System.

OBJECTIVE: To evaluate the quality of the Mexican Board of Pediatric Surgery (MBPS) certifying system, using contemporary international guidelines. DESIGN: Retrospective assessment of evidence collected during the design and implementation processes of 2 consecutive applications of the MBPS certifying examination, using Cizek's checklist for evaluating credential-testing programs. It includes the relevant guidelines from the American Education Research Association, the American Psychological Association, the National Council on Measurement in Education, and the National Commission for Certifying Agencies. Four independent and previously trained raters used the checklist. They underwent a 2-week training using frame-of-reference and performance dimensions methodologies. SETTING: Certification examinations of MBPS. POPULATION: The 2013 and 2014 MBPS certification examinations, with 111 evidence items of the processes, followed for the assessment of 86 examinees. RESULTS: The checklist internal consistency was 0.89. Absolute interrater agreement was 0.34 for the 2013 and 0.66 for the 2014 editions of the examination. The 2013 examination complied with 55 (64%) of the checklist 86 items, in 2014 with 72 (84%). CONCLUSION: In 2014, the certifying system reached a quality of 84%. For optimal fulfillment of its social responsibility, the MBPS is required to maintain its level of quality and attempt to improve its performance.

Effectiveness of learning advanced laparoscopic skills in a brief intensive laparoscopy training program.

BACKGROUND: Intensive training programs arose from limitations in access to simulation centers. The aim of this study is to evaluate the effect and associated factors involved in an intensive course for learning advanced laparoscopic skills, which include validated teaching techniques. METHODS: General surgeons and final-year residents were analyzed after completing an intensive 5-session advanced laparoscopy course. Initial (IA) and final assessment (FA) consisted in performing a jejunojejunal anastomosis in a live porcine model, measured using objective structured assessment of technical skill (OSATS) (GRS and SRS, that is, global rating scale and specific rating scale, respectively) and operative time (OT). The 3-session training was structured in a bench model with an ex vivo bowel. For the demographic analysis, 3 groups were defined according to the presentation of relevant changes in OSATS and in OT between IA and FA: group A, no changes; group B, change in 1 variable; and group C, change in both variables. RESULTS: After the course, all 114 participants presented a significant improvement in OT (37 vs 24.6min, p < 0.001) and in OSATS; global rating scale (10.5 vs 16 points; p < 0.001) and Specific Rating Scale (8.5 vs 12.7 points; p < 0.001). In the IA, 70 (61%) participants completed the jejunojejunal anastomosis and 105(92%) in the FA (p < 0.01). In the FA, 56% of participants presented relevant changes in both variables (group C). This group was significantly younger (34 vs 45 vs 40y old; p < 0.001), had fewer years of surgical experience (2 vs 9 vs 5y; p < 0.001), and had a proportionally higher concentration of residents (p = 0.01). CONCLUSIONS: This intensive course is set out as a viable alternative to teach basic skills in advanced laparoscopy in a short period of time, which is ideal for surgeons with difficult access to training centers. It remains necessary to establish the participant profile for which this type of course is most beneficial.

A 19-Year Record of Training Haitian Residents in Otorhinolaryngology and Cervicofacial Surgery.

OBJECTIVES: Since 1996, 1 to 4 annual training missions have been carried out to train Haitian otorhinolaryngology (ENT) and cervicofacial surgery residents by the association Liens Otorhinolaryngology Ayti (LOA). Until 1996, ENT was practiced and taught by ophthalmologists. The aim of this article is to describe the contributions and limitations of LOA in training of Haitian resident physicians and the creation of the ENT specialty in Haiti. DESIGN: Retrospective analysis of clinical consultation and surgical interventions records and didactics carried out during missions from 1996 through 2014. PARTICIPANTS: A total of 37 missions were made during the 19-year period in which 29 senior ENT specialists participated, with an average of 3.37 missions per physician. RESULTS: A total of 10,300 consultations and 173 surgical procedures were made jointly by a senior LOA physician and a Haitian resident physician. Totally 16 Haitian ENT residents were trained, 81% of whom are still practicing in Haiti. ENT became a surgical specialty in 2001 after the nomination of a Haitian ENT specialist as Assistant Director of the ENT-Ophthalmology service. The latter benefitted from dual training by LOA in Haiti and abroad. CONCLUSION: The Haitian population experiences significant difficulties with access to medical care owing to very low number of resident medical personnel. LOA's work has contributed over 19 years to the training of ENT physicians now practicing in Haiti and to the creation of a local ENT specialty.

A novel approach for needs assessment to build global orthopedic surgical capacity in a low-income country.

OBJECTIVE: Visiting surgical teams are a vital aspect of capacity-building continuing medical education (CME) in low-income countries like Haiti. Imperfect understanding of the genuine needs of local surgeons limit CME initiatives. Previous paper-based needs assessment efforts have been unsuccessful because of low response rates. We explored using an electronic audience response system (ARS) during a Haitian CME conference to improve the response rates and better assess needs. METHODS: Data were prospectively collected using an ARS from 78 conference participants (57 Haitian and 21 foreign) about current and desired knowledge of 7 topic and 8 skill areas using a 5-point Likert scale presented in English and in French. The response rates using ARS vs a similar paper survey were compared using a 2-sample test of proportions. The current and desired knowledge levels were compared using paired t tests. Analysis of variance and post hoc unpaired t tests were used to compare between demographic groups. RESULTS: The response rates were significantly greater for ARS vs a paper survey (87.7 vs 63.2%, p = 0.002). The 4 areas of least self-confidence for Haitians were pelvic and articular injury, joint dislocation, and osteomyelitis. The 4 skills of least self-confidence for Haitians were arthroscopy, open reduction and internal fixation-plate, external fixation, and fasciotomy. Haitians desired improvements in knowledge and management of articular, diaphyseal, and pelvic injury, joint dislocation, and osteomyelitis to a greater extent than foreigners (p < 0.05). Participants who previously attended the conference on open fractures felt more knowledgeable about open fractures as a topic (p < 0.05), but not in its management. CONCLUSIONS: We are the first to show that an ARS improves response rates to allow for better characterization of surgeon needs in the developing world. We also demonstrate the importance of skill building paired with topic area teaching. Lastly, we show how a CME conference is an effective tool to build surgical capacity and increase confidence level.

Integrative learning in morphology: philosophical grounds of thefounding educators of the Santa Casa School of Medical Sciences,Sao Paulo, Brazil

This aim of this paper is to briefly report the education methodology employed at the Santa Casa School of Medical Sciences’ undergraduate program, founded in 1963, Sao Paulo, Brazil. Some relevant historical aspects are also brought out in order to provide readers with a glimpse of the social scenario that have yielded such successful model, based on integrative, practice-based strategies. Developed from simple concepts, innovative at that time, the educational system, the building structure of the hospital-university facilities and the pedagogical method remains modern and still inspires educators nowadays. The Department of Morphology is in alignment with these principles, working with the minimum possible lectures and exploring practical experience to the maximum. The disciplines of anatomy, histology and embryology comprise the curricular unit, elaborated per organ system, in a pedagogical program based on: timeline organization of the disciplines, strong theory-practice linkage, and a proactive learning system. The faculty members are trained in multiple areas to be as versatile as possible, delivering lectures and assisting in the practical training. New teaching methods may aggregate value to this model. We believe that such didactic approach can provide students with a realistic perspective of the main purpose and applicability of the basic sciences.