Participation and selection effects of a voluntary selection process.

Many different medical school selection processes are used worldwide. In this paper, we examine the effect of (1) participation, and (2) selection in a voluntary selection process on study performance. We included data from two cohorts of medical students admitted to Erasmus MC, Rotterdam and VUmc, Amsterdam, The Netherlands and compared them to previously published data from Groningen medical school, The Netherlands. All included students were admitted based on either (1) a top pre-university grade point average, or (2) a voluntary selection process, or (3) weighted lottery. We distinguished between lottery-admitted students who had participated in the voluntary selection process and had been rejected, and lottery-admitted students who had not participated. Knowledge test scores, study progress, and professionalism scores were examined using ANCOVA modelling, logistic regression, and Bonferroni post hoc multiple-comparison tests, controlling for gender and cohort. For written test grades, results showed a participation effect at Groningen medical school and Erasmus MC (p < 0.001), and a selection effect at VUmc (p < 0.05). For obtained course credits, results showed a participation effect at all universities (p < 0.01) and a selection effect at Groningen medical school (p < 0.005). At Groningen medical school, a participation effect seemed apparent in on time first-year completion (p < 0.05). Earlier reported selection and participation effects in professionalism scores at Groningen medical school were not apparent at VUmc. Top pre-university students performed well on all outcome measures. For both the participation effect and the selection effect, results differed between universities. Institutional differences in curricula and in the design of the selection process seem to mediate relations between the different admissions processes and performance. Further research is needed for a deeper understanding of the influence of institutional differences on selection outcomes.

Non-cognitive selected students do not outperform lottery-admitted students in the pre-clinical stage of medical school.

Medical schools all over the world select applicants using non-cognitive and cognitive criteria. The predictive value of these different types of selection criteria has however never been investigated within the same curriculum while using a control group. We therefore set up a study that enabled us to compare the academic performance of three different admission groups, all composed of school-leaver entry students, and all enrolled in the same Bachelor curriculum: students selected on non-cognitive criteria, students selected on cognitive criteria and students admitted by lottery. First-year GPA and number of course credits (ECTS) at 52 weeks after enrollment of non-cognitive selected students (N = 102), cognitive selected students (N = 92) and lottery-admitted students (N = 356) were analyzed. In addition, chances of dropping out, probability of passing the third-year OSCE, and completing the Bachelor program in 3 years were compared. Although there were no significant differences between the admission groups in first-year GPA, cognitive selected students had obtained significantly more ECTS at 52 weeks and dropped out less often than lottery-admitted students. Probabilities of passing the OSCE and completing the bachelor program in 3 years did not significantly differ between the groups. These findings indicate that the use of only non-cognitive selection criteria is not sufficient to select the best academically performing students, most probably because a minimal cognitive basis is needed to succeed in medical school.

The development of self-regulated learning during the pre-clinical stage of medical school: a comparison between a lecture-based and a problem-based curriculum.

Society expects physicians to always improve their competencies and to be up to date with developments in their field. Therefore, an important aim of medical schools is to educate future medical doctors to become self-regulated, lifelong learners. However, it is unclear if medical students become better self-regulated learners during the pre-clinical stage of medical school, and whether students develop self-regulated learning skills differently, dependent on the educational approach of their medical school. In a cross-sectional design, we investigated the development of 384 medical students' self-regulated learning skills with the use of the Self-Regulation of Learning Self-Report Scale. Next, we compared this development in students who enrolled in two distinct medical curricula: a problem-based curriculum and a lectured-based curriculum. Analysis showed that more skills decreased than increased during the pre-clinical stage of medical school, and that the difference between the curricula was mainly caused by a decrease in the skill evaluation in the lecture-based curriculum. These findings seem to suggest that, irrespective of the curriculum, self-regulated learning skills do not develop during medical school.

Self-regulated learning and academic performance in medical education.

CONTENT: Medical schools aim to graduate medical doctors who are able to self-regulate their learning. It is therefore important to investigate whether medical students' self-regulated learning skills change during medical school. In addition, since these skills are expected to be helpful to learn more effectively, it is of interest to investigate whether these skills are related to academic performance. METHODS: In a cross-sectional design, the Self-Regulation of Learning Self-Report Scale (SRL-SRS) was used to investigate the change in students' self-regulated learning skills. First and third-year students (N = 949, 81.7%) SRL-SRS scores were compared with ANOVA. The relation with academic performance was investigated with multinomial regression analysis. RESULTS: Only one of the six skills, reflection, significantly, but positively, changed during medical school. In addition, a small, but positive relation of monitoring, reflection, and effort with first-year GPA was found, while only effort was related to third-year GPA. CONCLUSIONS: The change in self-regulated learning skills is minor as only the level of reflection differs between the first and third year. In addition, the relation between self-regulated learning skills and academic performance is limited. Medical schools are therefore encouraged to re-examine the curriculum and methods they use to enhance their students' self-regulated learning skills. Future research is required to understand the limited impact on performance.

Ethnic and social disparities in performance on medical school selection criteria.

CONTEXT: Medical schools in Western societies seek measures to increase the diversity of their student bodies with respect to ethnicity and social background. Currently, little is known about the effects of different selection procedures on student diversity. OBJECTIVES: This prospective cohort study aimed to determine performance differences between traditional and non-traditional (i.e. ethnic minority and first-generation university candidates) medical school applicants in academic and non-academic selection criteria. METHODS: Applicants in 2013 (n = 703) were assessed on academic and non-academic selection criteria. They also completed a questionnaire on ethnicity and social background. Main outcome measures were 'not selected' (i.e. failure on any criteria), 'failure on academic criteria' and 'failure on non-academic criteria'. Odds ratios (ORs) with 95% confidence intervals (CIs) were estimated by logistic regression analysis for ethnic subgroups (Surinamese/Antillean, Turkish/Moroccan/African, Asian, Western) compared with Dutch applicants, adjusted for age, gender, additional socio-demographic variables (first-generation immigrant, first-generation university applicant, first language, medical doctor as parent) and pre-university grade point average (pu-GPA). Similar analyses were performed for first-generation university applicants. RESULTS: Compared with Dutch applicants, Surinamese/Antillean applicants underperformed in the selection procedure (failure rate: 78% versus 57%; adjusted OR 2.52, 95% CI 1.07-5.94), in particular on academic criteria (failure rate: 66% versus 34%; adjusted OR 3.00, 95% CI 1.41-6.41). The higher failure rate of first-generation university applicants on academic criteria (50% versus 37%; unadjusted OR 1.66, 95% CI 1.18-2.33) was partly explained by additional socio-demographic variables and pu-GPA. The outcome measure 'failure on non-academic criteria' showed no significant differences among the ethnic or social subgroups. CONCLUSIONS: The absence of differences on non-academic criteria was promising with reference to increasing social and ethnic diversity; however, the possibility that self-selection instigated by the selection procedure is stronger in applicants from non-traditional backgrounds cannot be ruled out. Further research should also focus on why cognitive tests might favour traditional applicants.