The change from UMAT to UCAT for undergraduate medical school applicants: impact on selection outcomes.

OBJECTIVES: To assess whether the change from the Undergraduate Medical and Health Sciences Admissions Test (UMAT; 1991-2019) to the University Clinical Aptitude Test (UCAT) for the 2020 New South Wales undergraduate medical degree intake was associated with changes in the impact of sex, socio-economic status and remoteness of residence, and professional coaching upon selection for interview. DESIGN, SETTING, PARTICIPANTS: Cross-sectional study of applicants for the three NSW undergraduate medical programs for entry in 2019 (4114 applicants) or 2020 (4270); 703 people applied for both intakes. Applicants selected for interview were surveyed about whether they had received professional coaching for the selection test. MAIN OUTCOME MEASURES: Scores on the three sections of the UMAT (2019 entry cohort) and the five subtests of the UCAT (2020 entry); total UMAT and UCAT scores. RESULTS: Mean scores for UMAT 1 and 3 and for all four UCAT cognitive subtests were higher for men than women; the differences were statistically significant after adjusting for age, socio-economic status, and remoteness. The effect size for sex was 0.24 (95% CI, 0.18-0.30) for UMAT total score, 0.38 (95% CI, 0.32-0.44) for UCAT total score. For the 2020 intake, 2303 of 4270 applicants (53.9%) and 476 of 1074 interviewees (44.3%) were women. The effect size for socio-economic status was 0.47 (95% CI, 0.39-0.54) for UMAT, 0.43 (95% CI, 0.35-0.50) for UCAT total score; the effect size for remoteness was 0.54 (95% CI, 0.45-0.63) for UMAT, 0.48 (95% CI, 0.39-0.58) for UCAT total score. The impact of professional coaching on UCAT performance was not statistically significant among those accepted for interview. CONCLUSIONS: Women and people from areas outside major cities or of lower socio-economic status perform less well on the UCAT than other applicants. Reviewing the test and applicant quotas may be needed to achieve selection equity.

Correcting the predictive validity of a selection test for the effect of indirect range restriction.

BACKGROUND: The validity of selection tests is underestimated if it is determined by simply calculating the predictor-outcome correlation found in the admitted group. This correlation is usually attenuated by two factors: (1) the combination of selection variables which can compensate for each other and (2) range restriction in predictor and outcome due to the absence of outcome measures for rejected applicants. METHODS: Here we demonstrate the logic of these artifacts in a situation typical for student selection tests and compare four different methods for their correction: two formulas for the correction of direct and indirect range restriction, expectation maximization algorithm (EM) and multiple imputation by chained equations (MICE). First we show with simulated data how a realistic estimation of predictive validity could be achieved; second we apply the same methods to empirical data from one medical school. RESULTS: The results of the four methods are very similar except for the direct range restriction formula which underestimated validity. CONCLUSION: For practical purposes Thorndike's case C formula is a relatively straightforward solution to the range restriction problem, provided distributional assumptions are met. With EM and MICE more precision is obtained when distributional requirements are not met, but access to a sophisticated statistical package such as R is needed. The use of true score correlation has its own problems and does not seem to provide a better correction than other methods.

Is perfect good? - Dimensions of perfectionism in newly admitted medical students.

BACKGROUND: Society expects physicians to perform perfectly but high levels of perfectionism are associated with symptoms of distress in medical students. This study investigated whether medical students admitted to medical school by different selection criteria differ in the occurrence of perfectionism. METHODS: Newly enrolled undergraduate medical students (n = 358) filled out the following instruments: Multidimensional Perfectionism Scale (MPS-H), Multidimensional Perfectionism Scale (MPS-F), Big Five Inventory (BFI-10), General Self-Efficacy Scale (GSE), Patient Health Questionnaire 9 (PHQ-9), and Generalized Anxiety Disorder 7 (GAD-7). Sociodemographic data such as age, gender, high school degrees, and the way of admission to medical school were also included in the questionnaire. RESULTS: The 298 participating students had significantly lower scores in Socially-Prescribed Perfectionism than the general population independently of their way of admission to medical school. Students who were selected for medical school by their high school degree showed the highest score for Adaptive Perfectionism. Maladaptive Perfectionism was the strongest predictor for the occurrence symptoms of depression and anxiety regardless of the way of admission. CONCLUSIONS: Students from all admission groups should be observed longitudinally for performance and to assess whether perfectionism questionnaires might be an additional useful instrument for medical school admission processes.

General Ability or Distinct Scholastic Aptitudes? A Multidimensional Validity Analysis of a Psychometric Higher-Education Entrance Test.

The present study explored the construct validity of the Psychometric Entrance Test (PET) for higher education in Israel, as represented by the factorial structure of the scholastic aptitudes it measures, and focused on whether the test presents a single measure of overall ability or a measure of the fields of knowledge that are being tested. In Study 1, we used Exploratory Factor Analysis to generate hypotheses regarding the factorial structure of the test. In Study 2, Confirmatory Factor Analysis was carried out to compare competing models that were constructed based on theoretical considerations and the results of Study 1. The findings indicated that a two-layered hierarchical model, encompassing both a General Ability factor and three scholastic domain-specific factors (Verbal Reasoning, Quantitative Reasoning, and English), showed the best fit. Within the framework of the CFA, several statistical procedures were applied to assess reliability (indicator and complexity) and validity (convergent and divergent.).

Widening access in selection using situational judgement tests: evidence from the UKCAT.

CONTEXT: Widening access promotes student diversity and the appropriate representation of all demographic groups. This study aims to examine diversity-related benefits of the use of situational judgement tests (SJTs) in the UK Clinical Aptitude Test (UKCAT) in terms of three demographic variables: (i) socio-economic status (SES); (ii) ethnicity, and (iii) gender. METHODS: Outcomes in medical and dental school applicant cohorts for the years 2012 (n = 15 581) and 2013 (n = 15 454) were studied. Applicants' scores on cognitive tests and an SJT were linked to SES (parents' occupational status), ethnicity (White versus Black and other minority ethnic candidates), and gender. RESULTS: Firstly, the effect size for SES was lower for the SJT (d = 0.13-0.20 in favour of the higher SES group) than it was for the cognitive tests (d = 0.38-0.35). Secondly, effect sizes for ethnicity of the SJT and cognitive tests were similar (d = ~ 0.50 in favour of White candidates). Thirdly, males outperformed females on cognitive tests, whereas the reverse was true for SJTs. When equal weight was given to the SJT and the cognitive tests in the admission decision and when the selection ratio was stringent, simulated scenarios showed that using an SJT in addition to cognitive tests might enable admissions boards to select more students from lower SES backgrounds and more female students. CONCLUSIONS: The SJT has the potential to appropriately complement cognitive tests in the selection of doctors and dentists. It may also put candidates of lower SES backgrounds at less of a disadvantage and may potentially diversify the student intake. However, use of the SJT applied in this study did not diminish the role of ethnicity. Future research should examine these findings with other SJTs and other tests internationally and scrutinise the causes underlying the role of ethnicity.

Do later wake times and increased sleep duration of 12th graders result in more studying, higher grades, and improved SAT/ACT test scores?

BACKGROUND: The aim of this study was to investigate the relationship between sleep duration, wake time, and hours studying on high school grades and performance on the Scholastic Aptitude Test (SAT)/ American College Testing (ACT) college entrance exams. METHOD: Data were collected from 13,071 recently graduated high school seniors who were entering college in the fall of 2014. A column proportions z test with a Bonferroni adjustment was used to analyze proportional differences. Analysis of covariance (ANCOVA) was used to examine mean group differences. RESULTS: Students who woke up prior to 6 a.m. and got less than 8 h of sleep (27 %) were significantly more likely to report studying 11 or more hours per week (30 %), almost double the rate compared to students who got more than 8 h of sleep and woke up the latest (16 %). Post hoc results revealed students who woke up at 7 a.m. or later reported significantly higher high school grades than all other groups (p < 0.001), with the exception of those students who woke up between 6:01 a.m. and 7:00 a.m. and got eight or more hours of sleep. The highest reported SAT/ACT scores were from the group that woke up after 7 a.m. but got less than 8 h sleep (M = 1099.5). Their scores were significantly higher than all other groups. CONCLUSION: This study provides additional evidence that increased sleep and later wake time are associated with increased high school grades. However, this study also found that students who sleep the longest also reported less studying and lower SAT/ACT scores.

Item exposure control for multidimensional computer adaptive testing under maximum likelihood and expected a posteriori estimation.

Item bank stratification has been shown to be an effective method for combating item overexposure in both uni- and multidimensional computer adaptive testing. However, item bank stratification cannot guarantee that items will not be overexposed-that is, exposed at a rate exceeding some prespecified threshold. In this article, we propose enhancing stratification for multidimensional computer adaptive tests by combining it with the item eligibility method, a technique for controlling the maximum exposure rate in computerized tests. The performance of the method was examined via a simulation study and compared to existing methods of item selection and exposure control. Also, for the first time, maximum likelihood (MLE) and expected a posteriori (EAP) estimation of examinee ability were compared side by side in a multidimensional computer adaptive test. The simulation suggested that the proposed method is effective in suppressing the maximum item exposure rate with very little loss of measurement accuracy and precision. As compared to MLE, EAP generates smaller mean squared errors of the ability estimates in all simulation conditions.

The stochastically curtailed generalized likelihood ratio: A new termination criterion for variable-length computerized classification tests.

Computerized classification tests (CCTs) are used to classify examinees into categories in the context of professional certification testing. The term "variable-length" refers to CCTs that terminate (i.e., cease administering items to the examinee) when a classification can be made with a prespecified level of certainty. The sequential probability ratio test (SPRT) is a common criterion for terminating variable-length CCTs, but recent research has proposed more efficient methods. Specifically, the stochastically curtailed SPRT (SCSPRT) and the generalized likelihood ratio criterion (GLR) have been shown to classify examinees with accuracy similar to the SPRT while using fewer items. This article shows that the GLR criterion itself may be stochastically curtailed, resulting in a new termination criterion, the stochastically curtailed GLR (SCGLR). All four criteria-the SPRT, SCSPRT, GLR, and the new SCGLR-were compared using a simulation study. In this study, we examined the criteria in testing conditions that varied several CCT design features, including item bank characteristics, pass/fail threshold, and examinee ability distribution. In each condition, the termination criteria were evaluated according to their accuracy (proportion of examinees classified correctly), efficiency (test length), and loss (a single statistic combing both accuracy and efficiency). The simulation results showed that the SCGLR can yield increased efficiency without sacrificing accuracy, relative to the SPRT, SCSPRT, and GLR in a wide variety of CCT designs.

Predictive validity of the UK clinical aptitude test in the final years of medical school: a prospective cohort study.

BACKGROUND: The UK Clinical Aptitude Test (UKCAT) was designed to address issues identified with traditional methods of selection. This study aims to examine the predictive validity of the UKCAT and compare this to traditional selection methods in the senior years of medical school. This was a follow-up study of two cohorts of students from two medical schools who had previously taken part in a study examining the predictive validity of the UKCAT in first year. METHODS: The sample consisted of 4th and 5th Year students who commenced their studies at the University of Aberdeen or University of Dundee medical schools in 2007. Data collected were: demographics (gender and age group), UKCAT scores; Universities and Colleges Admissions Service (UCAS) form scores; admission interview scores; Year 4 and 5 degree examination scores. Pearson's correlations were used to examine the relationships between admissions variables, examination scores, gender and age group, and to select variables for multiple linear regression analysis to predict examination scores. RESULTS: Ninety-nine and 89 students at Aberdeen medical school from Years 4 and 5 respectively, and 51 Year 4 students in Dundee, were included in the analysis. Neither UCAS form nor interview scores were statistically significant predictors of examination performance. Conversely, the UKCAT yielded statistically significant validity coefficients between .24 and .36 in four of five assessments investigated. Multiple regression analysis showed the UKCAT made a statistically significant unique contribution to variance in examination performance in the senior years. CONCLUSIONS: Results suggest the UKCAT appears to predict performance better in the later years of medical school compared to earlier years and provides modest supportive evidence for the UKCAT's role in student selection within these institutions. Further research is needed to assess the predictive validity of the UKCAT against professional and behavioural outcomes as the cohort commences working life.

The contribution of general cognitive abilities and approximate number system to early mathematics.

BACKGROUND: Math learning is a complex process that entails a wide range of cognitive abilities to be fulfilled. There is sufficient evidence that both general and specific cognitive skills assume a fundamental role, despite the absence of shared consensus about the relative extent of their involvement. Moreover, regarding general abilities, there is no agreement about the recruitment of the different memory components or of intelligence. In relation to specific factors, great debate subsists regarding the role of the approximate number system (ANS). AIMS: Starting from these considerations, we wanted to conduct a wide assessment of memory components and ANS, by controlling for the effects associated with intelligence and also exploring possible relationships between all precursors. SAMPLE AND METHOD: To achieve this purpose, a sample of 157 children was tested at both beginning and end of their Grade 1. Both general (memory and intelligence) and specific (ANS) precursors were evaluated by a wide battery of tests and put in relation to concurrent and subsequent math skills. Memory was explored in passive and active aspects involving both verbal and visuo-spatial components. RESULTS: Path analysis results demonstrated that memory, and especially the more active processes, and intelligence were the strongest precursors in both assessment times. ANS had a milder role which lost significance by the end of the school year. Memory and ANS seemed to influence early mathematics almost independently. CONCLUSION: Both general and specific precursors seemed to have a crucial role in early math competences, despite the lower involvement of ANS.

Automatic item generation implemented for measuring artistic judgment aptitude.

Automatic item generation (AIG) is a broad class of methods that are being developed to address psychometric issues arising from internet and computer-based testing. In general, issues emphasize efficiency, validity, and diagnostic usefulness of large scale mental testing. Rapid prominence of AIG methods and their implicit perspective on mental testing is bringing painful scrutiny to many sacred psychometric assumptions. This report reviews basic AIG ideas, then presents conceptual foundations, image model development, and operational application to artistic judgment aptitude testing.

On robustness and power of the likelihood-ratio test as a model test of the linear logistic test model.

Recently the linear logistic test model (LLTM) by Fischer (1973) is increasingly used. In applications of LLTM, a likelihood-ratio test comparing the likelihood of the LLTM to the likelihood of the Rasch model is the most often applied model test. The present simulation study evaluates the empirical Type I risk, test power, and approximation to the expected distribution in the context of the LLTM. Furthermore, as possible influence factors on the distribution of the likelihood-ratio test statistic, the misspecification of the superior model, the closeness to singularity of the design matrix, and different sorts of misspecification of the design matrix are implemented. In summary, results of the simulations indicate that the likelihood-ratio test statistic holds the fixed Type I risk under typical conditions. Nevertheless, it is especially important to ensure the fit of the superior model, the Rasch model, and to consider the closeness to singularity of the design matrix.

Selecting the right medical student.

Medical student selection is an important but difficult task. Three recent papers by McManus et al. in BMC Medicine have re-examined the role of tests of attainment of learning (A' levels, GCSEs, SQA) and of aptitude (AH5, UKCAT), but on a much larger scale than previously attempted. They conclude that A' levels are still the best predictor of future success at medical school and beyond. However, A' levels account for only 65% of the variance in performance that is found. Therefore, more work is needed to establish relevant assessment of the other 35%. Please see related research articles http://www.biomedcentral.com/1741-7015/11/242, http://www.biomedcentral.com/1741-7015/11/243 and http://www.biomedcentral.com/1741-7015/11/244.

Construct-level predictive validity of educational attainment and intellectual aptitude tests in medical student selection: meta-regression of six UK longitudinal studies.

BACKGROUND: Measures used for medical student selection should predict future performance during training. A problem for any selection study is that predictor-outcome correlations are known only in those who have been selected, whereas selectors need to know how measures would predict in the entire pool of applicants. That problem of interpretation can be solved by calculating construct-level predictive validity, an estimate of true predictor-outcome correlation across the range of applicant abilities. METHODS: Construct-level predictive validities were calculated in six cohort studies of medical student selection and training (student entry, 1972 to 2009) for a range of predictors, including A-levels, General Certificates of Secondary Education (GCSEs)/O-levels, and aptitude tests (AH5 and UK Clinical Aptitude Test (UKCAT)). Outcomes included undergraduate basic medical science and finals assessments, as well as postgraduate measures of Membership of the Royal Colleges of Physicians of the United Kingdom (MRCP(UK)) performance and entry in the Specialist Register. Construct-level predictive validity was calculated with the method of Hunter, Schmidt and Le (2006), adapted to correct for right-censorship of examination results due to grade inflation. RESULTS: Meta-regression analyzed 57 separate predictor-outcome correlations (POCs) and construct-level predictive validities (CLPVs). Mean CLPVs are substantially higher (.450) than mean POCs (.171). Mean CLPVs for first-year examinations, were high for A-levels (.809; CI: .501 to .935), and lower for GCSEs/O-levels (.332; CI: .024 to .583) and UKCAT (mean = .245; CI: .207 to .276). A-levels had higher CLPVs for all undergraduate and postgraduate assessments than did GCSEs/O-levels and intellectual aptitude tests. CLPVs of educational attainment measures decline somewhat during training, but continue to predict postgraduate performance. Intellectual aptitude tests have lower CLPVs than A-levels or GCSEs/O-levels. CONCLUSIONS: Educational attainment has strong CLPVs for undergraduate and postgraduate performance, accounting for perhaps 65% of true variance in first year performance. Such CLPVs justify the use of educational attainment measure in selection, but also raise a key theoretical question concerning the remaining 35% of variance (and measurement error, range restriction and right-censorship have been taken into account). Just as in astrophysics, 'dark matter' and 'dark energy' are posited to balance various theoretical equations, so medical student selection must also have its 'dark variance', whose nature is not yet properly characterized, but explains a third of the variation in performance during training. Some variance probably relates to factors which are unpredictable at selection, such as illness or other life events, but some is probably also associated with factors such as personality, motivation or study skills.

Assessing selective sustained attention in 3- to 5-year-old children: evidence from a new paradigm.

Selective sustained attention (SSA) is crucial for higher order cognition. Factors promoting SSA are described as exogenous or endogenous. However, there is little research specifying how these factors interact during development, due largely to the paucity of developmentally appropriate paradigms. We report findings from a novel paradigm designed to investigate SSA in preschoolers. The findings indicate that this task (a) has good psychometric and parametric properties and (b) allows investigation of exogenous and endogenous factors within the same task, making it possible to attribute changes in performance to different mechanisms of attentional control rather than to differences in engagement in different tasks.

The UK Clinical Aptitude Test and clinical course performance at Nottingham: a prospective cohort study.

BACKGROUND: The UK Clinical Aptitude Test (UKCAT) was introduced in 2006 as an additional tool for the selection of medical students. It tests mental ability in four distinct domains (Verbal Reasoning, Quantitative Reasoning, Abstract Reasoning, and Decision Analysis), and the results are available to students and admission panels in advance of the selection process. Our first study showed little evidence of any predictive validity for performance in the first two years of the Nottingham undergraduate course.The study objective was to determine whether the UKCAT scores had any predictive value for the later parts of the course, largely delivered via clinical placements. METHODS: Students entering the course in 2007 and who had taken the UKCAT were asked for permission to use their anonymised data in research. The UKCAT scores were incorporated into a database with routine pre-admission socio-demographics and subsequent course performance data. Correlation analysis was followed by hierarchical multivariate linear regression. RESULTS: The original study group comprised 204/254 (80%) of the full entry cohort. With attrition over the five years of the course this fell to 185 (73%) by Year 5. The Verbal Reasoning score and the UKCAT Total score both demonstrated some univariate correlations with clinical knowledge marks, and slightly less with clinical skills. No parts of the UKCAT proved to be an independent predictor of clinical course marks, whereas prior attainment was a highly significant predictor (p <0.001). CONCLUSIONS: This study of one cohort of Nottingham medical students showed that UKCAT scores at admission did not independently predict subsequent performance on the course. Whilst the test adds another dimension to the selection process, its fairness and validity in selecting promising students remains unproven, and requires wider investigation and debate by other schools.

Comparison of pre-medical academic achievement, entrance test and aptitude test scores in admission selection process.

OBJECTIVE: To compare the awards of various pre-medical academic achievements with aptitude test scores obtained by candidates taking the Entrance Test 2011, and to identify demographic differences in the trend, if any. METHODS: The cross-sectional study involved a 22-item aptitude test administered to all the students taking the Medical College Admission Test conducted by the University of Health Sciences, Lahore, on September 13, 2011. The Matriculation, Intermediate, EntranceTest and AptitudeTest scores of all the students along with their demographic variables were entered into SPSS 16 and statistically analysed by using parametric tests. A p value of < 0.05 was considered statistically significant. RESULTS: Out of the 32,746 students, 22,935 (70%) were females. Students who scored more than 75% marks (n = 4,723; 14%) also scored higher marks in the Aptitude Test (p < 0.05). Female candidates in general scored higher marks in the Entrance Test (p < 0.05) and in the Aptitude Test (p < 0.05). Overall, students from the economically and academically underdeveloped districts of Punjab scored less marks in the Entrance Test (p < 0.05) and the Aptitude Test (p < 0.05).The difference in Entrance Test and Aptitude Test marks of students from underdeveloped districts was greater than that of students for the developed districts (p < 0.05). However, in Matriculation and Intermediate examinations, students from the underdeveloped districts scored higher marks than the developed districts (p < 0.05). Students scoring higher marks in Matric and Intermediate, scored low marks in the Aptitude Test (p < 0.05). CONCLUSION: The Entrance Test and Aptitude Test scores correlated poorly with Intermediate and Matriculation scores. There is a need to strengthen the underdeveloped areas academically. Besides, the predictive value of the Aptitude Test scores related to future performance of candidates selected needs to be ascertained with further studies.

An analysis of the performance of UK medical graduates in the MRCOG Part 1 and Part 2 written examinations.

BACKGROUND: There is a lack of evidence on whether graduates from different medical schools perform differently in postgraduate examinations. OBJECTIVE: To evaluate the variations in performance of UK medical graduates in Member of the Royal College of Obstetricians and Gynaecologists (MRCOG) examination. METHODS: A retrospective analysis of performance of 1335 doctors graduating in UK medical schools who entered the Part 1 MRCOG and 822 doctors taking the Part 2 MRCOG written examination for the first time between 1998 and 2008. The main outcome measures were to evaluate medical school effects, gender effects and academic performance effect. RESULTS: Graduates of UK medical schools performed differently in the Part 1 and Part 2 written MRCOG examination. The graduates of Oxford (pass rate 82.6%), Cambridge (75%), Bristol (59.3%) and Edinburgh (57.5%) performed significantly better and the graduates of Liverpool (26.8%), Southampton (21.8%) and Wales (18.2%) performed significantly worse than the remaining cohort in the Part 1 examination. The candidates of Newcastle (88.9%), Oxford (82.4%), Cambridge (81%) and Edinburgh (78.2%) performed significantly better and the graduates of Glasgow (49.2%) and Leicester (36.2%) have significantly underperformed compared with the remaining cohort in Part 2 written examination. There was no difference in the success rates of male (47.5%) and female (42.0%) candidates in the Part 1; however, female candidates had a significantly better success rate in the Part 2 written examination than male candidates (65.6% vs 52.9%). CONCLUSION: These results show that there is variation in performance among the graduates from different medical schools in the Part 1 and Part 2 MRCOG written examination.

Can personal qualities of medical students predict in-course examination success and professional behaviour? An exploratory prospective cohort study.

BACKGROUND: Over two-thirds of UK medical schools are augmenting their selection procedures for medical students by using the United Kingdom Clinical Aptitude Test (UKCAT), which employs tests of cognitive and non-cognitive personal qualities, but clear evidence of the tests' predictive validity is lacking. This study explores whether academic performance and professional behaviours that are important in a health professional context can be predicted by these measures, when taken before or very early in the medical course. METHODS: This prospective cohort study follows the progress of the entire student cohort who entered Hull York Medical School in September 2007, having taken the UKCAT cognitive tests in 2006 and the non-cognitive tests a year later. This paper reports on the students' first and second academic years of study. The main outcome measures were regular, repeated tutor assessment of individual students' interpersonal skills and professional behaviour, and annual examination performance in the three domains of recall and application of knowledge, evaluation of data, and communication and practical clinical skills. The relationships between non-cognitive test scores, cognitive test scores, tutor assessments and examination results were explored using the Pearson product-moment correlations for each group of data; the data for students obtaining the top and bottom 20% of the summative examination results were compared using Analysis of Variance. RESULTS: Personal qualities measured by non-cognitive tests showed a number of statistically significant relationships with ratings of behaviour made by tutors, with performance in each year's objective structured clinical examinations (OSCEs), and with themed written summative examination marks in each year. Cognitive ability scores were also significantly related to each year's examination results, but seldom to professional behaviours. The top 20% of examination achievers could be differentiated from the bottom 20% on both non-cognitive and cognitive measures. CONCLUSIONS: This study shows numerous significant relationships between both cognitive and non-cognitive test scores, academic examination scores and indicators of professional behaviours in medical students. This suggests that measurement of non-cognitive personal qualities in applicants to medical school could make a useful contribution to selection and admission decisions. Further research is required in larger representative groups, and with more refined predictor measures and behavioural assessment methods, to establish beyond doubt the incremental validity of such measures over conventional cognitive assessments.

Psychometric analysis of five measures of spatial ability.

This study analyzed psychometric properties of five measures of spatial ability on 96 young adults, with supplementary analysis for three of the measures on another sample of 71 young adults. Two measures were taken from the widely cited Kit of Factor-Referenced Cognitive Tests and three other measures were taken from a relatively new source originally intended as laboratory demonstrations. Previous research provided limited information on the psychometric properties of the measures. All five measures yielded adequate reliability and loaded on a single factor. Three measures yielded markedly skewed distributions. Two measures showed clear sex differences with men scoring higher but this difference seemed contaminated by a speed factor; three measures did not show a sex difference. Recommendations for use of the measures in future studies are provided.