RESUMO
RESUMEN Introducción: Algunos autores han señalado que el armado de un examen con preguntas aleatorias puede perjudicar el rendimiento de los estudiantes. A partir de la pandemia por COVID -19 y del aislamiento social obligatorio, las actividades de educación médica de posgrado pasaron a la modalidad virtual y los exámenes se implementaron online. Objetivo: Estudiar si el ordenamiento al azar de las preguntas tiene algún efecto en los resultados de los exámenes. Material y métodos: Se redactaron 2 exámenes: uno sobre Prevención de la enfermedad cardiovascular y otro sobre Valvulopatías. Para cada uno de los temas se confeccionaron dos cuestionarios: una versión con las preguntas en el orden lógico y según dificultad estimada, y otra con las mismas preguntas distribuidas al azar. Cada examen tenía 50 preguntas de selección múltiple con 3 opciones. Puntaje máximo posible: 50 Los exámenes fueron administrados en plataforma Moodle, modalidad sincrónica, tiempo disponible 75 minutos. Los resultados se expresaron en puntajes obtenidos (rango y valores de tendencia central) y según el índice de dificultad de las preguntas. Resultados: Respondieron 284 residentes, alumnos del Curso Bianual de Cardiología. Dos grupos de 1° año (tema Prevención) y dos grupos de 2° año (Valvulopatías). No hubo diferencia entre los resultados de las dos versiones del mismo examen. Conclusiones: Este estudio careció de la potencia suficiente para fundamentar una u otra forma de ordenar las preguntas de los exámenes de ciencias clínicas. Surgieron nuevas preguntas que deberán ser respondidas en futuros estudios.
ABSTRACT Background: Some authors have pointed out that setting up an exam with random questions can impair student performance. Since the COVID-19 pandemic and compulsory social isolation, postgraduate medical education activities became virtual and exams were implemented online. Objective: The aim of the study was to analyse whether the random order of questions has any effect on test results. Method: Two exams were written: one on the Prevention of Cardiovascular Disease and another on Heart Valve Diseases. For each topic, two questionnaires were designed: a version with the questions in logical order and according to the estimated difficulty and another with the same questions randomly distributed. Each exam had 50 multiple-choice questions with 3 options, and the maximum possible score was 50 The exams were taken on the Moodle platform, with synchronous modality, and the time available was 75 minutes. The results were expressed as scores obtained (range and central tendency) and according to the index of difficulty of the questions. Results: The number of respondents was 284 residents, students of the Biannual Cardiology Course: two 1st year groups (Prevention topic) and two 2nd year groups (Valve diseases). There was no difference between the results of the two versions of the same exam. Conclusions: This study lacks sufficient power to support either way of question order in clinical sciences exams, giving rise to new queries.
RESUMO
Background In our country, training in cardiology is achieved by participating in residency programs, attending a hospital cardiology unit or taking university courses. On the basis of comments from teachers giving classes in the SAC Biennial Course about certain kind of deficit in basic areas of the specialty among cardiology residents attending the course, we decided to investigate their knowledge in cardiovascular anatomy, physiology, physical diagnosis, pharmacology and clinical cardiology after 1 or 2 years of training in Internal Medicine or Cardiology residency programs, respectively. Objective To evaluate the knowledge in basic areas in cardiology among residents attending the UBA Biennial Cardiology Course given by the Argentine Society of Cardiology. Material and Methods We conducted an observational, cross-sectional study. A questionnaire was designed with 50 multiple choice questions, divided in three subjects: Subject A, 17 questions about cardiovascular anatomy, physiology, pathophysiology and pharmacology; Subject B, 15 questions about clinical cardiology, physical diagnosis and electrocardiography; and Subject C, 17 questions regarding medical practice and cardiological clinical syndromes. The questionnaire was answered by residents either initiating the course (Group 1) or who were attending the second year (Group 2). Results In the general exam, Group 1 (n=63) had a median of 29/50 right answers (58%) and Group 2 (n=57) 30/50 (60%). There were no significant differences between both groups (p=0.21). The performance in Subject A was significantly lower compared to Subjects B and C in both groups. Conclusion The level of knowledge in basic areas of cardiology among residents is considered insufficient, with greatest deficits in cardiovascular anatomy, physiology, pathophysiology and pharmacology. It is necessary to revise the program of the Biennial Course and to analyze the opportunities of learning and reflection offered by the residency program.
RESUMO
Objetivo: Se analizó el desempeño académico de los estudiantes del primer año de la carrera de Medicina de la generación 2004, en las seis asignaturas que cursaron: anatomía, biología celular y tisular, biología del desarrollo, bioquímica y biología molecular, salud pública I y psicología médica. Resultados: Los resultados mostraron que el desempeño de los alumnos del grupo matutino era superior al del grupo vespertino (p < 0.05); este hecho era más evidente en las asignaturas de mayor índice de dificultad, como anatomía y bioquímica y biología molecular (p < 0.01). Asimismo, se observó que, según el bachillerato de procedencia, ya sea colegios de ciencias y humanidades (CCH), preparatorias o escuelas privadas, el índice de acreditación fue mayor en alumnos de estas últimas. Se calculó el índice de aprobación de cada una de las asignaturas, dividiendo el porcentaje de aprobación en los exámenes departamentales entre el porcentaje de aprobación emitido por el profesor. Conclusión: Los resultados mostraron que en algunas asignaturas el índice era cercano a 1, como psicología médica y salud pública; en cambio, en otras como anatomía y biología celular y tisular los índices fluctuaron entre 0.5 a 0.7, lo que significa que el porcentaje de acreditación es inferior cuando es medido a través de los exámenes departamentales que a través de las evaluaciones del profesor.
OBJECTIVE: The academic skills of medical students during their first year (class of 2004) were analyzed. Subjects included gross anatomy, cellular biology, developmental biology, biochemistry and molecular biology, public health I and medical psychology. RESULTS: Results showed that students attending morning classes achieved a higher score than those attending afternoon classes. This fact was even more evident in the hardest subjects such as gross anatomy, biochemistry and molecular biology. It was also noticeable that students' achievement depended on the type of high school they had attended (public or private). The percentage of passing grades for each subject was calculated dividing the percentage of continuous assessment exams' passing grades by the percentage of passing grades given by the professor. CONCLUSIONS: Results showed that the index was close to I in some subjects such as medical psychology and public health, whilst in others such as gross anatomy and cellular biology the range fluctuated from 0.5 to 0.7. We conclude that the passing percentage is lower if it is tested through continuous assessment exams compared with professor's performance appraisals.
