ScotGEM - an update on Scotland's only graduate-entry rural generalist-focused undergraduate programme, including student career intentions.

INTRODUCTION: In 2016, the Scottish Government commissioned ScotGEM, a generalist focused graduate entry medical programme. The first cohort of 55 students entered in 2018 and will graduate in 2022. Key unique features of ScotGEM include over 50% of clinical education being led by GPs, the creation of a team of dedicated Generalist Clinical Mentors (GCMs) who support this, a geographically dispersed approach to delivery, and a focus on healthcare improvement activities. This presentation will focus on the progress of our inaugural cohort in terms of progression, performance, and career intentions in comparison with the related internationally literature. METHODS: Progression and performance will be reported based upon assessment outcomes. Career intentions were assessed via an electronic questionnaire exploring career preferences, including speciality, location and reasoning distributed to the first three cohorts. We utilised questions derived from key UK and Australian studies to allow direct comparison with the existing literature. RESULTS: The response rate was 77% (126/163). ScotGEM students' progression rate was high and performance directly comparable with Dundee students. A positive attitude towards general practice and emergency medicine careers was reported. A high proportion of students intended to remain in Scotland, with half interested in working in rural or remote settings. DISCUSSION: Overall, results suggest ScotGEM is meeting the aims of its Mission, a finding of key workforce relevance in Scotland and other rural European contexts that supplements the existing international evidence base. The role of GCMs has been instrumental and may be applicable in other areas.

A qualitative perspective on what factors influence ScotGEM students' career intentions.

INTRODUCTION: ScotGEM is a novel graduate medicine programme in Scotland with a rural generalist focus. This survey-based study aimed to assess the career intentions of ScotGEM students and the various factors influencing them. METHODS: An online questionnaire was devised from existing literature that explored students' interest regarding generalist or specialty career, geographical location, and influencing factors. Free-text responses regarding their primary care career interest and their reasoning behind geographical preferences allowed for qualitative content analysis. Responses were coded inductively and categorised into themes by two independent researchers who then compared and finalised the themes. RESULTS: 126/163 (77%) completed the questionnaire. Content analysis of free-text responses in relation to a negative attitude towards a prospective GP career yielded themes: personal aptitude, emotional toll of GP and uncertainty. Themes in relation to desired geographical preference included: family factors, lifestyle issues and perceptions regarding professional and personal development opportunities. DISCUSSION: The qualitative analysis of factors influencing the career intentions of students on the graduate programme is key to understanding what is important to them. Students who have decided against primary care have realised an early aptitude for specialism due to their experiences, while also witnessing the potential emotional toll of primary care. Family needs may already be dictating where they will choose to work in the future. Lifestyle reasons were in favour of both urban and rural careers, with a sizeable number of responses still uncertain. These findings and their implications are discussed in context of existing international literature on rural medical workforce.

Dundee's Longitudinal Integrated Clerkship: drivers, implementation and early evaluation.

Dundee University School of Medicine established a pilot for a 40 week long comprehensive Longitudinal Integrated Clerkship (LIC) in 2016. Ten places for year 4 students are available which are shared between two regions of Scotland which are largely rural areas by UK definitions. This paper describes the drivers for the pilot, its implementation and early evaluation. For the evaluation, data were collected using focus groups and semi-structured interviews from the first cohort of seven students, four health service employed staff (two with leadership roles and two with regional student facing roles), 21 General Practitioner tutors, and from reflective audio-diaries kept by all students. Analysis was thematic, the themes being identified from the data. Summative assessment data were collated. Students reported positive learning experiences though access to secondary care learning linked to their patients was sometimes problematic. GP tutors were positive and enthusiastic about the programme and could see the potential benefits on recruitment to GP careers. Pre-existing workload pressures were a challenge. Summative assessment results were encouraging. The Dundee LIC is successful in delivering Dundee's year 4 curriculum. Ongoing development has been focused on improving awareness of the programme in secondary care services.

Predictors of fitness to practise declarations in UK medical undergraduates.

BACKGROUND: Misconduct during medical school predicts subsequent fitness to practise (FtP) events in doctors, but relatively little is known about which factors are associated with such issues during undergraduate education. This study exploits the newly created UK medical education database (UKMED), with the aim of identifying predictors of conduct or health-related issues that could potentially impair FtP. The findings would have implications for policies related to both the selection and support of medical students. METHODS: Data were available for 14,379 students obtaining provisional registration with the General Medical Council who started medical school in 2007 and 2008. FtP declarations made by students were available, as were various educational and demographic predictor variables, including self-report 'personality measures' for students who participated in UK Clinical Aptitude Test (UKCAT) pilot studies. Univariable and multivariable logistic regression models were developed to evaluate the predictors of FtP declarations. RESULTS: Significant univariable predictors (p < 0.05) for conduct-related declarations included male gender, white ethnicity and a non-professional parental background. Male gender (OR 3.07) and higher 'self-esteem' (OR 1.45) were independently associated with an increased risk of a conduct issue. Female gender, a non-professional background, and lower self-reported 'confidence' were, among others, associated with increased odds of a health-related declaration. Only 'confidence' was a significant independent predictor of a health declaration (OR 0.69). Female gender, higher UKCAT score, a non-professional background and lower 'confidence' scores were significant predictors of reported depression, and the latter two variables were independent predictors of declared depression. CONCLUSIONS: White ethnicity and UK nationality were associated with increased odds of both conduct and health-related declarations, as were certain personality traits. Students from non-professional backgrounds may be at increased risk of depression and therefore could benefit from targeted support. The small effect sizes observed for the 'personality measures' suggest they would offer little potential benefit for selection, over and above those measures already in use.

The UK medical education database (UKMED) what is it? Why and how might you use it?

BACKGROUND: Educating doctors is expensive and poor performance by future graduates can literally cost lives. Whilst the practice of medicine is highly evidence based, medical education is much less so. Research on medical school selection, undergraduate progression, Fitness to Practise (FtP) and postgraduate careers has been hampered across the globe by the challenges of uniting the data required. This paper describes the creation, structure and access arrangements for the first UK-wide attempt to do so. OVERVIEW: A collaborative approach has created a research database commencing with all entrants to UK medical schools in 2007 and 2008 (UKMED Phase 1). Here the content is outlined, governance arrangements considered, system access explained, and the potential implications of this new resource discussed. The data currently include achievements prior to medical school entry, admissions tests, graduation point information and also all subsequent data collected by the General Medical Council, including FtP, career progression, annual National Training Survey (NTS) responses, career choice and postgraduate exam performance data. UKMED has grown since the pilot phase with additional datasets; all subsequent years of students/trainees and stronger governance processes. The inclusion of future cohorts and additional information such as admissions scores or bespoke surveys or assessments is now being piloted. Thus, for instance, new scrutiny can be applied to selection techniques and the effectiveness of educational interventions. Data are available free of charge for approved studies from suitable research groups worldwide. CONCLUSION: It is anticipated that UKMED will continue on a rolling basis. This has the potential to radically change the volume and types of research that can be envisaged and, therefore, to improve standards, facilitate workforce planning and support the regulation of medical education and training. This paper aspires to encourage proposals to utilise this exciting resource.

How effective are selection methods in medical education? A systematic review.

CONTEXT: Selection methods used by medical schools should reliably identify whether candidates are likely to be successful in medical training and ultimately become competent clinicians. However, there is little consensus regarding methods that reliably evaluate non-academic attributes, and longitudinal studies examining predictors of success after qualification are insufficient. This systematic review synthesises the extant research evidence on the relative strengths of various selection methods. We offer a research agenda and identify key considerations to inform policy and practice in the next 50 years. METHODS: A formalised literature search was conducted for studies published between 1997 and 2015. A total of 194 articles met the inclusion criteria and were appraised in relation to: (i) selection method used; (ii) research question(s) addressed, and (iii) type of study design. RESULTS: Eight selection methods were identified: (i) aptitude tests; (ii) academic records; (iii) personal statements; (iv) references; (v) situational judgement tests (SJTs); (vi) personality and emotional intelligence assessments; (vii) interviews and multiple mini-interviews (MMIs), and (viii) selection centres (SCs). The evidence relating to each method was reviewed against four evaluation criteria: effectiveness (reliability and validity); procedural issues; acceptability, and cost-effectiveness. CONCLUSIONS: Evidence shows clearly that academic records, MMIs, aptitude tests, SJTs and SCs are more effective selection methods and are generally fairer than traditional interviews, references and personal statements. However, achievement in different selection methods may differentially predict performance at the various stages of medical education and clinical practice. Research into selection has been over-reliant on cross-sectional study designs and has tended to focus on reliability estimates rather than validity as an indicator of quality. A comprehensive framework of outcome criteria should be developed to allow researchers to interpret empirical evidence and compare selection methods fairly. This review highlights gaps in evidence for the combination of selection tools that is most effective and the weighting to be given to each tool.

Fair access to medicine? Retrospective analysis of UK medical schools application data 2009-2012 using three measures of socioeconomic status.

BACKGROUND: Medical students have historically largely come from more affluent parts of society, leading many countries to seek to broaden access to medical careers on the grounds of social justice and the perceived benefits of greater workforce diversity. The aim of this study was to examine variation in socioeconomic status (SES) of applicants to study medicine and applicants with an accepted offer from a medical school, comparing the four UK countries and individual medical schools. METHODS: Retrospective analysis of application data for 22 UK medical schools 2009/10-2011/12. Data were analysed for all 32,964 UK-domiciled applicants aged <20 years to 22 non-graduate medical schools requiring applicants to sit the United Kingdom Clinical Aptitude Test (UKCAT). Rates of applicants and accepted offers were compared using three measures of SES: (1) Postcode-assigned Index of Multiple Deprivation score (IMD); (2) School type; (3) Parental occupation measured by the National Statistics Socio Economic Classification (NS-SEC). RESULTS: There is a marked social gradient of applicants and applicants with accepted offers with, depending on UK country of residence, 19.7-34.5% of applicants living in the most affluent tenth of postcodes vs 1.8-5.7% in the least affluent tenth. However, the majority of applicants in all postcodes had parents in the highest SES occupational group (NS-SEC1). Applicants resident in the most deprived postcodes, with parents from lower SES occupational groups (NS-SEC4/5) and attending non-selective state schools were less likely to obtain an accepted offer of a place at medical school further steepening the observed social gradient. Medical schools varied significantly in the percentage of individuals from NS-SEC 4/5 applying (2.3%-8.4%) and gaining an accepted offer (1.2%-7.7%). CONCLUSION: Regardless of the measure, those from less affluent backgrounds are less likely to apply and less likely to gain an accepted offer to study medicine. Postcode-based measures such as IMD may be misleading, but individual measures like NS-SEC can be gamed by applicants. The previously unreported variation between UK countries and between medical schools warrants further investigation as it implies solutions are available but inconsistently applied.

Medical electives in sub-Saharan Africa: a host perspective.

CONTEXT: Electives are part of most Western medical school curricula. It is estimated that each year 3000-4000 undergraduate medical students from the UK alone undertake an elective in a developing country. The impact of these electives has given some cause for concern, but the views of elective hosts are largely missing from the debate. OBJECTIVES: The purpose of this study was to evaluate the organisation, outcomes and impacts of medical electives in sub-Saharan Africa from a host perspective. METHODS: A qualitative analysis of 14 semi-structured interviews with elective hosts at seven elective sites in Malawi, Zambia and Tanzania was carried out. A framework analysis approach was used to analyse 483 minutes of audio-recorded data. RESULTS: Hosts were committed to providing elective experiences but their reasons for doing so varied considerably, in particular between urban or teaching hospitals and rural or mission hospitals. Nurturing a group of professionals who will understand the provision of health care from a global perspective was the main reason reported for hosting an elective, along with generating potential future staff. Hosts argued that the quality of supervision should be judged according to local context. Typical concerns cited in the literature with reference to clinical activities, safety and ethics did not emerge as issues for these hosts. However, in under-resourced clinical contexts, the training of local students sometimes had to take priority. Electives could be improved with greater student preparation and some contribution from sending institutions to support teaching, supervision or patient care. CONCLUSIONS: The challenge to both students and their sending institutions is to progress towards giving something proportionate back in return for the learning experiences received. There is clearly room to improve electives from the hosts' perspective, but individually host institutions lack the opportunity or ability to achieve change.

Evaluating the validity of an integrity-based situational judgement test for medical school admissions.

BACKGROUND: While the construct of integrity has emerged as a front-runner amongst the desirable attributes to select for in medical school admissions, it is less clear how best to assess this characteristic. A potential solution lies in the use of Situational Judgement Tests (SJTs) which have gained popularity due to robust psychometric evidence and potential for large-scale administration. This study aims to explore the psychometric properties of an SJT designed to measure the construct of integrity. METHODS: Ten SJT scenarios, each with five response stems were developed from critical incident interviews with academic and clinical staff. 200 of 520 (38.5 %) Multiple Mini Interview candidates at Dundee Medical School participated in the study during the 2012-2013 admissions cycle. Participants were asked to rate the appropriateness of each SJT response on a 4-point likert scale as well as complete the HEXACO personality inventory and a face validity questionnaire. Pearson's correlations and descriptive statistics were used to examine the associations between SJT score, HEXACO personality traits, pre-admissions measures namely academic and United Kingdom Clinical Aptitude Test (UKCAT) scores, as well as acceptability. RESULTS: Cronbach's alpha reliability for the SJT was .64. Statistically significant correlations ranging from .16 to .36 (.22 to .53 disattenuated) were observed between SJT score and the honesty-humility (integrity), conscientiousness, extraversion and agreeableness dimensions of the HEXACO inventory. A significant correlation of .32 (.47 disattenuated) was observed between SJT and MMI scores and no significant relationship with the UKCAT. Participant reactions to the SJTs were generally positive. CONCLUSIONS: Initial findings are encouraging regarding the psychometric robustness of an integrity-based SJT for medical student selection, with significant associations found between the SJTs, integrity, other desirable personality traits and the MMI. The SJTs showed little or no redundancy with cognitive ability. Results suggest that carefully-designed SJTs may augment more costly MMIs.

Western medical students' experiences on clinical electives in sub-Saharan Africa.

CONTEXT: Electives commonly represent a valued, enjoyed and formative part of medical training. However, there is little empirical evidence about students' preparedness, practices and perceptions of medical electives in resource-poor settings. Exploring what students do, why and under what circumstances is therefore worthwhile. OBJECTIVES: This study aimed to evaluate students' views on the processes, outcomes and impacts of medical electives in three low-income countries. METHODS: A qualitative study using purposeful sampling and semi-structured interviews was conducted. Participants were 29 Western students on medical electives at seven host sites in sub-Saharan Africa. A framework approach was used to analyse 872 minutes of audio-recorded data. RESULTS: Students were highly positive about their experiences and seemed aware of their clinical limitations. Pre-departure training offered by some institutions was beneficial, but the content was perceived to be of little clinical relevance. Language barriers were the main challenges faced by students, even in places where English was the second language. Students who stayed longer, were nearer qualification or were based in rural units (rather than teaching centres) contributed more to patient care. Supervision was considered adequate but this appeared to be judged in a local context. Deliberate inappropriate practice was not encountered, but on occasion misunderstanding arose over the student's status. CONCLUSIONS: Students who undertake electives in resource-poor countries appear to have clearly thought out and positive intentions, but current systems cause concern with reference to student activities and staff time, and require improvement. Instead of focusing on education benefits alone, students (and their sending institutions) need to consider other approaches through which host communities can more clearly benefit. Effective pre-departure preparation should become a requirement.

Medical student electives and learning outcomes for global health: a commentary on behalf of the UK Medical Schools Elective Council.

BACKGROUND: Electives have the potential to have a very positive impact on the professional development of medical students. Education about issues in global health is widely regarded as a neglected area in the undergraduate curricula of many medical schools. Linking learning outcomes for global health to the elective offers a possible solution that avoids adding additional teaching to crowded courses. CONCLUSION: This commentary advocates caution as many potential learning outcomes are better addressed elsewhere and setting detailed outcomes erodes the essence of the elective - student choice.

The fairness, predictive validity and acceptability of multiple mini interview in an internationally diverse student population--a mixed methods study.

BACKGROUND: International medical students, those attending medical school outside of their country of citizenship, account for a growing proportion of medical undergraduates worldwide. This study aimed to establish the fairness, predictive validity and acceptability of Multiple Mini Interview (MMI) in an internationally diverse student population. METHODS: This was an explanatory sequential, mixed methods study. All students in First Year Medicine, National University of Ireland Galway 2012 were eligible to sit a previously validated 10 station MMI. Quantitative data comprised: demographics, selection tool scores and First Year Assessment scores. Qualitative data comprised separate focus groups with MMI Assessors, EU and Non-EU students. RESULTS: 109 students participated (45% of class). Of this 41.3% (n = 45) were Non-EU and 35.8% (n = 39) did not have English as first language. Age, gender and socioeconomic class did not impact on MMI scores. Non-EU students and those for whom English was not a first language achieved significantly lower scores on MMI than their EU and English speaking counterparts (difference in mean 11.9% and 12.2% respectively, P<0.001). MMI score was associated with English language proficiency (IELTS) (r = 0.5, P<0.01). Correlations emerged between First Year results and IELTS (r = 0.44; p = 0.006; n = 38) and EU school exit exam (r = 0.52; p<0.001; n = 56). MMI predicted EU student OSCE performance (r = 0.27; p = 0.03; n = 64). In the analysis of focus group data two overarching themes emerged: Authenticity and Cultural Awareness. MMI was considered a highly authentic assessment that offered a deeper understanding of the applicant than traditional tools, with an immediate relevance to clinical practice. Cultural specificity of some stations and English language proficiency were seen to disadvantage international students. Recommendations included cultural awareness training for MMI assessors, designing and piloting culturally neutral stations, lengthening station duration and providing high quality advance information to candidates. CONCLUSION: MMI is a welcome addition to assessment armamentarium for selection, particularly with regard to stakeholder acceptability. Understanding the mediating and moderating influences for differences in performance of international candidates is essential to ensure that MMI complies with the metrics of good assessment practice and principles of both distributive and procedural justice for all applicants, irrespective of nationality and cultural background.

Is embellishing UCAS personal statements accepted practice in applications to medicine and dentistry?

BACKGROUND: The assessment of non-academic achievements through the personal statement remains part of the selection process at most UK medical and dental schools. Such statement offers applicants an opportunity to highlight their non-academic achievements, but the highly competitive nature of the process may tempt them to exaggerate their accomplishments. The challenge is that selectors cannot discern applicants' exaggerated claims from genuine accounts and the system risks preferentially selecting dishonest applicants. AIM: To explore the level and perception of deception on UCAS personal statements among applicants to medical and dental schools. To investigate the association between attitudes towards deception and various other demographic variables and cognitive ability via the UKCAT. METHODS: An online survey was completed with first year students from six UK medical schools and one dental school. Questionnaire items were classified into three categories involving individual acts, how they suspect their peers behave, and overall perceptions of personal statements to influence the selection process. Descriptive statistics were used to investigate responses to questionnaire items. t-Tests were used to investigate the relationship between items, demographic variables and cognitive ability. RESULTS: Candidates recognized that putting fraudulent information or exaggerating one's experience on UCAS personal statement was dishonest; however there is a widespread belief that their peers do it. Female respondents and those with a higher UKCAT score were more likely to condemn deceptive practices. CONCLUSION: The existing selection process is open to abuse and may benefit dishonest applicants. Admission systems should consider investing in systems that can pursue traceable information that applicants provide, and nullify the application should it contain fraudulent information.

The multiple mini-interview in the U.K. context: 3 years of experience at Dundee.

BACKGROUND: The multiple mini-interview (MMI) is a new interview process that Dundee Medical School has recently adopted to assess entrants into its undergraduate medicine course. This involves an 'objective structured clinical examination' like rotational approach in which candidates are assessed on specific attributes at a number of stations. AIMS: To present methodological, questionnaire and psychometric data on the transitional process from traditional interviews to MMIs over a 3-year period and discuss the implications for those considering making this transition. METHODS: To facilitate the transition, a four-station MMI was piloted in 2007. Success encouraged consideration of desirable attributes which were used to develop a full 10-station process which was implemented in 2009 with assessors being recruited from staff, students and simulated patients. A questionnaire was administered to all assessors and candidates who participated in the 2009 MMIs. Cronbach's alpha and Pearson's r and analysis of variances were used to determine the MMI's psychometric properties. Multi-faceted Rasch modelling (MFRM) was modelled to control for assessor leniency/stringency and the impact of using 'fair scores' determined. Analysis was conducted using SPSS 17 and FACETS 3.65.0. RESULTS: The questionnaire confirmed that the process was acceptable to all parties. Cronbach's alpha reliability was satisfactory and consistent. Graduates/mature candidates outperformed U.K. school-leavers and overseas candidates. Using MFRM fair scores would change the selection outcome of 6.2% and 9.6% of candidates in 2009 and 2010, respectively. Students were less lenient, made more use of the full range of the rating scales and were just as reliable as staff. CONCLUSIONS: The strategy of generating institutional support through staged introduction proved effective. The MMI in Dundee was shown to be feasible and displayed sound psychometric properties. Student assessors appeared to perform at least as well as staff. Despite a considerable intellectual and logistical challenge MMIs were successfully introduced and deemed worthwhile.

Factors associated with declaration of disability in medical students and junior doctors, and the association of declared disability with academic performance: observational study using data from the UK Medical Education Database, 2002-2018 (UKMED54).

OBJECTIVES: To examine factors associated with declaration of disability by medical students and doctors, and the association of declared disability with academic performance. DESIGN: Observational study using record-linked data collected between 2002 and 2018. SETTING: UK Medical Education Database is a repository of data relating to training of medical students and doctors. Disability and other data are record-linked. PARTICIPANTS: All students starting at a UK medical school between 2002 and 2018 (n=135 930). MAIN OUTCOME MEASURES: Declared disability was categorised by the Higher Education Statistics Authority. Outcomes related to undergraduate academic performance included scores in the educational performance measure (EPM), prescribing safety assessment and situational judgement test. Performance in postgraduate examinations was studied, as well as prior attainment in school examinations and aptitude tests. RESULTS: Specific learning disability (SLD) was the most commonly declared disability (3.5% compared with the next most commonly declared disability at 1.0% of n=129 345 all cases in the study), and during the period covered by the data, SLD declarations increased from 1.4% (n=6440 for students starting in 2002) to 4.6% (n=8625 for students starting in 2018). In a logistic regression, the following factors predicted recording of SLD on entry to medical school ((exp(B)±95% CI), p<0.0001 unless otherwise stated): attendance at a fee-paying school (2.306±0.178), graduate status (1.806±0.205), participation of local areas quintile (1.089±0.030), age (1.034±0.012). First year medical students were less likely to declare SLD if they were from a non-white ethnic background (Asian/Asian British 0.324±0.034, black/black British 0.571±0.102, mixed 0.731±0.108, other ethnic groups 0.566±0.120), female (0.913±0.059; p=0.007) or from a low index of multiple deprivation quintile (0.963±0.029); p=0.017. In univariate analysis with Bonferroni corrections applied for multiple tests, no significant difference was observed in the recording of SLD according to socioeconomic class (χ2=5.637, p=1), whether or not a student's parents had a higher education (χ2=0.140, p=1), or whether or not a student had received a United Kingdom Clinical Aptitude Test (UKCAT) bursary (χ2=7.661, p=0.068). Students who declared SLD at some point in medical school (n=4830) had lower EPM normalised deviate values (-0.390) than those who did not (-0.119) (F=189.872, p<0.001). Those for whom SLD was recorded were as likely to complete the course successfully as those who did not declare disability (93.0% successful completion by those for whom SLD declared from year 1 (n=2480), 92.2% by those for whom SLD declared after year 1 (n=2350), 91.6% by those for whom SD not declared at any point (n=85 180)) (χ2=6.905, p=0.032). Of 3580 first year students who declared SLD, 43.1% had not sat the UKCAT Special Educational Needs aptitude test (which gives extra time for those with special educational needs), while 28% of 2400 registrants for whom SLD was recorded as medical students did not declare it at General Medical Council registration. CONCLUSIONS: Substantial increases in declaration of SLD may reflect changes in the social and legal environment during the period of the study. Those who declare SLD are just as likely to gain a primary medical qualification as those who do not. For some individuals, disability declaration appears to depend on context, based on differences in numbers declaring SLD before, during and after medical school.

Predictive validity of the personal qualities assessment for selection of medical students in Scotland.

BACKGROUND: The Personal Qualities Assessment (PQA) was developed to enhance medical student selection by measuring a range of non-cognitive attributes in the applicants to medical school. Applicants to the five Scottish medical schools were invited to pilot the test in 2001 and 2002. AIMS: To evaluate the predictive validity of PQA for selecting medical students. METHODS: A longitudinal cohort study was conducted in which PQA scores were compared with senior year medical school performance. RESULTS: Consent to access performance markers was obtained from 626 students (61.6% of 1017 entrants in 2002-2003). Linkable Foundation Year (4th) rankings were available for 411 (66%) students and objective structured clinical examination (OSCE) rankings for 335 (54%) of those consenting. Both samples were representative of the original cohort. No significant correlations were detected between separate elements of the PQA assessment and student performance. However, using the algorithm advocated by Powis et al. those defined as 'non-extreme' (<±1.5 SD from the cohort mean scores; SD, standard deviation) character types on the involved-detached and on the libertarian-communitarian moral orientation scales were ranked higher in OSCEs (average of 7.5% or 25 out of 335, p = 0.049). CONCLUSIONS: This study was limited by high attrition and basic outcome markers which are insensitive to relevant non-cognitive characteristics. However, it is the largest currently available study of predictive validity for the PQA assessment. There was one finding of significance: that those students who were identified by PQA as 'not extreme' on the two personal characteristics scales performed better in an OSCE measure of professionalism. Futures studies are required since psychometric testing for both cognitive and non-cognitive attributes are increasingly used in admission process and these should include more and better measures of professionalism against which to correlate non-cognitive traits.

Use of UKCAT scores in student selection by U.K. medical schools, 2006-2010.

BACKGROUND: The United Kingdom Clinical Aptitude Test (UKCAT) is a set of cognitive tests introduced in 2006, taken annually before application to medical school. The UKCAT is a test of aptitude and not acquired knowledge and as such the results give medical schools a standardised and objective tool that all schools could use to assist their decision making in selection, and so provide a fairer means of choosing future medical students.Selection of students for U.K. medical schools is usually in three stages: assessment of academic qualifications, assessment of further qualities from the application form submitted via UCAS (Universities and Colleges Admissions Service) leading to invitation to interview, and then selection for offer of a place. Medical schools were informed of the psychometric qualities of the UKCAT subtests and given some guidance regarding the interpretation of results. Each school then decided how to use the results within its own selection system. METHODS: Annual retrospective key informant telephone interviews were conducted with every UKCAT Consortium medical school, using a pre-circulated structured questionnaire. The key points of the interview were transcribed, 'member checked' and a content analysis was undertaken. RESULTS: Four equally popular ways of using the test results have emerged, described as Borderline, Factor, Threshold and Rescue methods. Many schools use more than one method, at different stages in their selection process. Schools have used the scores in ways that have sought to improve the fairness of selection and support widening participation. Initially great care was taken not to exclude any applicant on the basis of low UKCAT scores alone but it has been used more as confidence has grown. CONCLUSIONS: There is considerable variation in how medical schools use UKCAT, so it is important that they clearly inform applicants how the test will be used so they can make best use of their limited number of applications.

Electives: isn't it time for a change?

OBJECTIVES: Medical student electives are memorable learning experiences, of which approximately 40% are spent in developing countries. Students often have laudable motivation but are rarely helped to learn most effectively or contribute meaningfully whilst away. Each year an estimated 350 years of elective time is spent in developing countries (by students from the UK alone), which represents substantial opportunity. METHODS: We conducted a literature search prior to developing an alternative approach towards electives based upon educational and ethical principles. RESULTS: Despite their anecdotal value there has been little empirical research conducted into electives. From our review we identified four key learning domains (Clinical Knowledge and Skills, Attitudes, Global Perspectives, Personal and Professional Development) and two broader issues (Institutional Benefits and Moral/Ethical Considerations). Potentially beneficial and more structured alternatives are emerging and improvements appear possible through institutional collaborations and greater planning in order to maximise the educational experience, opportunities to contribute and minimise the risks involved in electives. CONCLUSIONS: Electives are a highlight of clinical training but probably often represent missed opportunities. There are both educational and moral reasons for seeking more considered approaches to reduce the 'medical tourism' that can result from the current largely ad hoc arrangements.

Does the UKCAT predict Year 1 performance in medical school?

CONTEXT: The need to identify the best applicants for medicine and to ensure that selection is fair and ethical has led to the development of alternative, or additional, selection tools. One such tool is the United Kingdom Clinical Aptitude Test, or UKCAT. To date there have been no studies of the predictive validity of the UKCAT. OBJECTIVES: This study set out to identify whether UKCAT total score and subtest scores predict Year 1 outcomes in medical school. METHODS: Year 1 students starting in 2007 at the University of Aberdeen or University of Dundee medical schools were included. Data collected were: UKCAT scores; Universities and Colleges Admissions Service (UCAS) form scores; admission interview scores; final Year 1 degree examination scores, and records of re-sitting examinations and of withdrawing from a course. Correlations were used to select variables for multiple regression analysis to predict examination scores. RESULTS: Data were available for 341 students. Examination scores did not correlate with UKCAT total or subtest scores. Neither UCAS form score nor admission interview score predicted outcomes. None of the UKCAT scores were reliably associated with withdrawals (P-values for all comparisons > 0.05). Only the decision analysis subtest was associated with re-sits of examinations, but the difference in means was contrary to the direction anticipated (P = 0.025, 95% confidence interval = 6.1-89.7). DISCUSSION: UKCAT scores did not predict Year 1 performance at the two medical schools. Although early prediction is arguably not the primary aim of the UKCAT, there is some cause for concern that the test failed to show even the small-to-moderate predictive power demonstrated by similar admissions tools.