RESUMO
BACKGROUND: To test the value of a simulated Family Conference Objective Structured Clinical Exam (OSCE) for resident assessment purposes, we examined the generalizability and construct validity of its scores in a multi-institutional study. METHODS: Thirty-four first-year (PG1) and 27 third-year (PG3) surgery residents (n = 61) from 6 training programs were tested. The OSCE consisted of 2 cases (End-of-Life [EOL] and Disclosure of Complications [DOC]). At each program, 2 clinicians and 2 standardized family members rated residents using case-specific tools. Performance was measured as the percentage of possible score obtained. We examined the generalizability of scores for each case separately. To assess construct validity, we compared PG1 with PG3 performance using repeated measures multivariate analysis of variance (MANOVA). RESULTS: The relative G-coefficient for EOL was .890. For DOC, the relative G-coefficient was .716. There were no significant performance differences between PG1 and PG3 residents. CONCLUSIONS: This OSCE provides reliable assessments suitable for formative evaluation of residents' interpersonal communication skills and professionalism.
Assuntos
Comunicação , Avaliação Educacional/métodos , Cirurgia Geral/educação , Simulação de Paciente , Relações Profissional-Família , Competência Clínica , Humanos , Internato e Residência , Complicações Pós-Operatórias , Reprodutibilidade dos Testes , Assistência Terminal , Revelação da VerdadeRESUMO
BACKGROUND: In response to declining instruction in technical skills, the authors instituted a novel method to teach basic procedural skills to medical students beginning the surgery clerkship. METHODS: Sixty-three medical students participated in a skills training laboratory. The first part of the laboratory taught basic suturing skills, and the second involved a cadaver with pig skin grafted to different anatomic locations. Clinical scenarios were simulated, and students performed essential procedural skills. RESULTS: Students learned most of their suturing skills in the laboratory skills sessions, compared with the emergency room or the operating room (P = .01). Students reported that the laboratory allowed them greater opportunity to participate in the emergency room and operating room. Students also felt that the suture laboratory contributed greatly to their skills in wound closure. Finally, 90% of students had never received instruction on suturing, and only 12% had performed any procedural skills before beginning the surgery rotation. CONCLUSIONS: The laboratory described is an effective way of insuring that necessary technical skills are imparted during the surgery rotation.