Impact of reference panel composition on scores of script concordance test assessing basic nephrology knowledge in undergraduate medical education.
Med Teach
; 46(1): 110-116, 2024 01.
Article
em En
| MEDLINE
| ID: mdl-37544894
ABSTRACT
PURPOSE:
In the assessment of basic medical knowledge, the composition of the reference panel between specialists and primary care (PC) physicians is a contentious issue. We assessed the effect of panel composition on the scores of undergraduate medical students in a script concordance test (SCT).METHODS:
The scale of an SCT on basic nephrology knowledge was set by a panel of nephrologists or a mixed panel of nephrologists and PC physicians. The results of the SCTs were compared with ANOVA for repeated measurements. Concordance was assessed with Bland and Altman plots.RESULTS:
Forty-five students completed the SCT. Their scores differed according to panel composition 65.6 ± 9.73/100 points for nephrologists, and 70.27 ± 8.82 for the mixed panel, p < 0.001. Concordance between the scores was low with a bias of -4.27 ± 2.19 and a 95% limit of agreement of -8.96 to -0.38. Panel composition led to a change in the ranking of 71% of students (mean 3.6 ± 2.6 places).CONCLUSION:
The composition of the reference panel, either specialist or mixed, for SCT assessment of basic knowledge has an impact on test results and student rankings.Palavras-chave
Texto completo:
1
Coleções:
01-internacional
Base de dados:
MEDLINE
Assunto principal:
Estudantes de Medicina
/
Educação de Graduação em Medicina
/
Nefrologia
Limite:
Humans
Idioma:
En
Ano de publicação:
2024
Tipo de documento:
Article