[Systematic analysis of evaluations of Objective Structured Clinical Exam (OSCE) multiple circuits: Explanatory variables and inter-rater correlations]. / Analyse systématique des évaluations de circuits multiples d'examen clinique objectif structuré (ECOS) : variables explicatives et corrélations inter-évaluateurs.
Rev Med Interne
; 45(6): 327-334, 2024 Jun.
Article
en Fr
| MEDLINE
| ID: mdl-38643040
ABSTRACT
INTRODUCTION:
Objective Structured Clinical Examinations (OSCEs) assess professional performance in a simulated environment. Following their integration into the reform of the 2nd cycle of medical studies (R2C), this pedagogical modality was implemented in France. This study investigates the variability of students' OSCE scores, as well as their inter-rater reproducibility.METHODS:
This single-center retrospective study covered several sessions of evaluative OSCE circuits conducted between January 2022 and June 2023. Variables collected were baseline situation family, competency domain, presence of a standardized participant for stations; gender and professional status for evaluators; scores (global, clinical and communication skills), number of previously completed OSCE circuits and faculty scores for students.RESULTS:
The variability of the overall score was explained mainly (79.7%, CI95% [77.4; 82.0]) by the station factor. The student factor and the circuit factor explained 7.5% [12.9; 20.2] and<0.01% [2.10-13; 2.10-9] respectively. The inter-rater intra-class correlation coefficient was 87.2% [86.4; 87.9] for the global score. Station characteristics (starting situation, domain) and evaluator characteristics (gender, status) were significantly associated with score variations.CONCLUSION:
This first study on the variability of OSCE circuit scores in France shows good reproducibility with influence of station characteristics. In order to standardize circuits, variability linked to the domain competency should be considered as well.Palabras clave
Texto completo:
1
Colección:
01-internacional
Banco de datos:
MEDLINE
Asunto principal:
Estudiantes de Medicina
/
Variaciones Dependientes del Observador
/
Competencia Clínica
/
Evaluación Educacional
Límite:
Female
/
Humans
/
Male
País/Región como asunto:
Europa
Idioma:
Fr
Revista:
Rev Med Interne
Año:
2024
Tipo del documento:
Article
País de afiliación:
Francia