Virtual reality as an engaging and enjoyable method for delivering emergency clinical simulation training: a prospective, interventional study of medical undergraduates.

BACKGROUND: It is a requirement that medical students are educated in emergencies and feel well prepared for practice as a doctor, yet national surveys show that many students feel underprepared. Virtual reality (VR), combined with 360-degree filming, provides an immersive, realistic, and interactive simulation experience. Unlike conventional in-person simulation, it is scalable with reduced workforce demands. We sought to compare students' engagement and enjoyment of VR simulation to desktop computer-based simulation. METHODS: We conducted a prospective, interventional, evaluation study. The study was carried out on final year medical students undertaking their Pre-Foundation Assistantship (n = 116) at Imperial College School of Medicine (ICSM) in London. We compared objective engagement, subjective engagement, and subjective enjoyment of VR simulation to desktop computer-based simulation using cardiac arrest and life-threatening asthma scenarios. Engagement was measured objectively using students' physiological parameters, including heart rate and eye tracking, and facilitator observations using the validated 'Behavioural Engagement Related to Instruction' (BERI) protocol. Students' subjective engagement and enjoyment levels were measured using a post-session survey. RESULTS: Students' maximum heart rates were significantly higher during VR simulation with a mean difference of 4.2 beats per minute (3.2 to 5.2, p < 0.001), and eye tracking showed they spent a significantly greater mean percentage of time of 6.4% (5.1 to 7.7, p < 0.001) focusing on the scenarios in VR compared to standard desktop. Qualitative data showed students enjoyed and felt engaged with the sessions, which provided a safe space for learning. CONCLUSIONS: Our study shows that students found VR simulations enjoyable and were more engaged compared to standard desktop simulation. This suggests that 360-degree VR simulation experiences provide students with immersive, realistic training, which is scalable, giving them the unique opportunity to manage emergencies and work within emergency teams, which would not typically occur during traditional training.

Fasting pancreatic polypeptide predicts incident microvascular and macrovascular complications of type 2 diabetes: An observational study.

AIMS: Pancreatic polypeptide (PP) is elevated in people with vascular risk factors such as type 2 diabetes or increased visceral fat. We investigated potential relationships between PP and microvascular and macrovascular complications of diabetes. MATERIALS AND METHODS: Animal study: Subcutaneous PP infusion for 4 weeks in high fat diet mouse model. Retinal mRNA submitted for Ingenuity Pathway Analysis. Human study: fasting PP measured in 1478 participants and vascular complications recorded over median 5.5 (IQR 4.9-5.8) years follow-up. RESULTS: Animal study: The retinal transcriptional response to PP was indicative of cellular stress and damage, and this footprint matched responses described in previously published studies of retinal disease. Of mechanistic importance the transcriptional landscape was consistent with upregulation of folliculin, a recently identified susceptibility gene for diabetic retinopathy. Human study: Adjusting for established risk factors, PP was associated with prevalent and incident clinically significant retinopathy (odds ratio (OR) 1.289 (1.107-1.501) p = 0.001; hazard ratio (HR) 1.259 (1.035-1.531) p = 0.0213), albuminuria (OR 1.277 (1.124-1.454), p = 0.0002; HR 1.608 (1.208-2.141) p = 0.0011), and macrovascular disease (OR 1.021 (1.006-1.037) p = 0.0068; HR 1.324 (1.089-1.61), p = 0.0049), in individuals with type 2 diabetes, and progression to diabetes in non-diabetic individuals (HR 1.402 (1.081-1.818), p = 0.0109). CONCLUSIONS: Elevated fasting PP is independently associated with vascular complications of diabetes and affects retinal pathways potentially influencing retinal neuronal survival. Our results suggest possible new roles for PP-fold peptides in the pathophysiology of diabetes complications and vascular risk stratification.

UK Prescribing Safety Assessment (PSA): The development, implementation and outcomes of a national online prescribing assessment.

AIMS: The United Kingdom (UK) Prescribing Safety Assessment (PSA) is a 2-h online assessment of basic competence to prescribe and supervise the use of medicines. It has been undertaken by students and doctors in UK medical and foundation schools for the past decade. This study describes the academic characteristics and performance of the assessment; longitudinal performance of candidates and schools; stakeholder feedback; and surrogate markers of prescribing safety in UK healthcare practice. METHODS: We reviewed the performance data generated by over 70 000 medical students and 3700 foundation doctors who have participated in the PSA since its inception in 2013. These data were supplemented by Likert scale and free text feedback from candidates and a variety of stakeholder groups. Further data on medication incidents, collected by national reporting systems and the regulatory body, are reported, with permission. RESULTS: We demonstrate the feasibility, high quality and reliability of an online prescribing assessment, uniquely providing a measure of prescribing competence against a national standard. Over 90% of candidates pass the PSA on their first attempt, while a minority are identified for further training and assessment. The pass rate shows some variation between different institutions and between undergraduate and foundation cohorts. Most responders to a national survey agreed that the PSA is a useful instrument for assessing prescribing competence, and an independent review has recommended adding the PSA to the Medical Licensing Assessment. Surrogate markers suggest there has been improvement in prescribing safety in practice, temporally associated with the introduction of the PSA but other factors could be influential too. CONCLUSIONS: The PSA is a practical and cost-effective way of delivering a reliable national assessment of prescribing competence that has educational impact and is supported by the majority of stakeholders. There is a need to develop national systems to identify and report prescribing errors and the harm they cause, enabling the impact of educational interventions to be measured.

Reliability, validity and acceptability of an online clinical reasoning simulator for medical students: An international pilot.

INTRODUCTION: Clinical reasoning skills are essential for decision-making. Current assessment methods are limited when testing clinical reasoning and management of uncertainty. This study evaluates the reliability, validity and acceptability of Practicum Script, an online simulation-based programme, for developing medical students' clinical reasoning skills using real-life cases. METHODS: In 2020, we conducted an international, multicentre pilot study using 20 clinical cases with 2457 final-year medical students from 21 schools worldwide. Psychometric analysis was performed (n = 1502 students completing at least 80% of cases). Classical estimates of reliability for three test domains (hypothesis generation, hypothesis argumentation and knowledge application) were calculated using Cronbach's alpha and McDonald's omega coefficients. Validity evidence was obtained by confirmatory factor analysis (CFA) and measurement alignment (MA). Items from the knowledge application domain were analysed using cognitive diagnostic modelling (CDM). Acceptability was evaluated by an anonymous student survey. RESULTS: Reliability estimates were high with narrow confidence intervals. CFA revealed acceptable goodness-of-fit indices for the proposed three-factor model. CDM analysis demonstrated good absolute test fit and high classification accuracy estimates. Student survey responses showed high levels of acceptability. CONCLUSION: Our findings suggest that Practicum Script is a useful resource for strengthening students' clinical reasoning skills and ability to manage uncertainty.

The influence of candidates' race on examiners' ratings in standardised assessments of clinical practice.

PURPOSE: Delivering fair and reliable summative assessments in medical education assumes examiner decision making is devoid of bias. We investigated whether candidate racial appearances influenced examiner ratings in undergraduate clinical exams. METHODS: We used an internet-based design. Examiners watched a randomised set of six videos of three different white candidates and three different non-white (Asian, black and Chinese) candidates taking a clinical history at either fail, borderline or pass grades. We compared the median and interquartile range (IQR) of the paired difference between scores for the white and non-white candidates at each performance grade and tested for statistical significance. RESULTS: 160 Examiners participated. At the fail grade, the black and Chinese candidates scored lower than the white candidate, with median paired differences of -2.5 and -1 respectively (both p < 0.001). At the borderline grade, the black and Chinese candidates scored higher than the white candidate, with median paired differences of +2 and +3, respectively (both p < 0.001). At the passing grade, the Asian candidate scored lower than the white candidate (median paired difference -1, p < 0.001). CONCLUSION: The racial appearance of candidates appeared to influence the scores awarded by examiners, but not in a uniform manner.

The impact of patient skin colour on diagnostic ability and confidence of medical students.

Previous literature has explored unconscious racial biases in clinical education and medicine, finding that people with darker skin tones can be underrepresented in learning resources and managed differently in a clinical setting. This study aimed to examine whether patient skin colour can affect the diagnostic ability and confidence of medical students, and their cognitive reasoning processes. We presented students with 12 different clinical presentations on both white skin (WS) and non-white skin (NWS). A think aloud (TA) study was conducted to explore students' cognitive reasoning processes (n = 8). An online quiz was also conducted where students submitted a diagnosis and confidence level for each clinical presentation (n = 185). In the TA interviews, students used similar levels of information gathering and analytical reasoning for each skin type but appeared to display increased uncertainty and reduced non-analytical reasoning methods for the NWS images compared to the WS images. In the online quiz, students were significantly more likely to accurately diagnose five of the 12 clinical presentations (shingles, cellulitis, Lyme disease, eczema and meningococcal disease) on WS compared to NWS (p < 0.01). With regards to students' confidence, they were significantly more confident diagnosing eight of the 12 clinical presentations (shingles, cellulitis, Lyme disease, eczema, meningococcal disease, urticaria, chickenpox and Kawasaki disease) on WS when compared to NWS (p < 0.01). These findings highlight the need to improve teaching resources to include a greater diversity of skin colours exhibiting clinical signs, to improve students' knowledge and confidence, and ultimately, to avoid patients being misdiagnosed due to the colour of their skin.

Twelve tips for introducing very short answer questions (VSAQs) into your medical curriculum.

Most undergraduate written examinations use multiple-choice questions, such as single best answer questions (SBAQs) to assess medical knowledge. In recent years, a strong evidence base has emerged for the use of very short answer questions (VSAQs). VSAQs have been shown to be an acceptable, reliable, discriminatory, and cost-effective assessment tool in both formative and summative undergraduate assessments. VSAQs address many of the concerns raised by educators using SBAQs including inauthentic clinical scenarios, cueing and test-taking behaviours by students, as well as the limited feedback SBAQs provide for both students and teachers. The widespread use of VSAQs in medical assessment has yet to be adopted, possibly due to lack of familiarity and experience with this assessment method. The following twelve tips have been constructed using our own practical experience of VSAQs alongside supporting evidence from the literature to help medical educators successfully plan, construct and implement VSAQs within medical curricula.

The validity of Engagement and Feedback Assessments (EFAs): identifying students at risk of failing.

BACKGROUND: Imperial College School of Medicine, London UK, introduced a new curriculum in 2019, with a focus on the GMC outcomes for graduates, and pedagogy best practice. The new curriculum included formative assessments, named engagement and feedback assessments (EFAs), to support learning, and attainment in the summative examinations. The aims of this study were to assess the validity of EFAs and to determine whether they have utility as a modified form of programmatic assessment to inform decision-making regarding possible interventions by measuring and analysing attendance at and performance in these formative events. METHODS: Seven hundred and sixty-one students were included in the study and assessment results were included for academic years 2019/20 to 2020/21. Forty-one data points per student, (27 in Year 1 and 14 in Year 2) were used, to compare EFA scores with the summative performance. Attendance was monitored through engagement with the EFAs. RESULTS: Cohort 1 (enrolled 2019): In year 1, EFAs were associated with summative exam scores (overall r = 0.63, p < 0.001). Year 2, EFA scores were also associated with summative scores (overall r = 0.57, p < 0.001), including the clinical practical assessment (r = 0.45, p < 0.001). Missing two or more EFAs was associated with a significant increase in the likelihood of failing one or more summative examinations in the first year (OR: 7.97, 95% CI 2.65-34.39) and second year (OR: 3.20, 95% CI 1.74-5.95). Missing more than two EFAs in their first year was also associated with a higher risk of failing a summative examination in the second year (OR: 2.47, 95% CI 1.33-4.71). Students who increased their attendance between year 1 and 2 fared better in summative assessment than those who maintained poor attendance, whereas those that reduced their attendance fared worse than those that maintained high attendance. Cohort 2 (enrolled 2020): Analysis of cohort 2 supported these findings and in this cohort missing two or more EFAs was again associated with an increased likelihood of failing a summative examination (OR = 4.00, 95% CI = 2.02-7.90). CONCLUSION: Our EFA model has validity in predicting performance in summative assessments and can inform prospective interventions to support students' learning. Enhancing attendance and engagement can improve outcomes.

BMAT's predictive validity for medical school performance: A retrospective cohort study.

BACKGROUND: Although used widely, there is limited evidence of the BioMedical Admissions Test's (BMAT) predictive validity and incremental validity over prior educational attainment (PEA). We investigated BMAT's predictive and incremental validity for performance in two undergraduate medical schools, Imperial College School of Medicine (ICSM), UK, and Lee Kong Chian School of Medicine (LKCMedicine), Singapore. Our secondary goal was to compare the evidence collected with published evidence relating to comparable tools. METHODS: This was a retrospective cohort study of four ICSM (1188 students, entering 2010-2013) and three LKCMedicine cohorts (222 students, 2013-2015). We investigated associations between BMAT Section 1 ('Thinking Skills'), Section 2 ('Scientific Knowledge and Applications') and Section 3a ('Writing Task') scores, with written and clinical assessment performance across all programme years. Incremental validity was investigated over PEA (A-levels) in a subset of ICSM students. RESULTS: When BMAT sections were investigated independently, Section 2 scores predicted performance on all written assessments in both institutions with mainly small effect sizes (standardised coefficient ranges: ICSM: 0.08-0.19; LKCMedicine: 0.22-0.36). Section 1 scores predicted Years 5 and 6 written assessment performance at ICSM (0.09-0.14) but nothing at LKCMedicine. Section 3a scores only predicted Year 5 clinical assessment performance at ICSM with a coefficient <0.1. There were no positive associations with standardised coefficients >0.1 between BMAT performance and clinical assessment performance. Multivariable regressions confirmed that Section 2 scores were the most predictive. We found no clear evidence of incremental validity for any BMAT section scores over A-level grades. DISCUSSION: Schools who wish to assess scientific knowledge independently of A-levels may find BMAT Section 2 useful. Comparison with previous studies indicates that, overall, BMAT seems less useful than comparable tools. Larger scale studies are needed. Broader questions regarding why institutions adopt certain admissions tests, including those with little evidence, need consideration.

Assessing the predictive validity of the UCAT-A systematic review and narrative synthesis.

BACKGROUND: The University Clinical Aptitude Test (UCAT) is an admissions assessment used by a consortium of universities across the UK, Australia, and New Zealand, to aid the selection of applicants to medical and dental degree programmes. The UCAT aims to measure the mental aptitude and professional behaviours required to become successful doctors and dentists. We conducted a systematic review to establish the predictive value of the UCAT across measures of performance at undergraduate and post-graduate levels. METHODS: A literature search was conducted in April 2020 using eight electronic databases: MEDLINE, APA PsycInfo, SCOPUS, Web of Science, EThOS, OpenGrey, PROSPERO, and the UCAT website. Data were extracted from selected studies and tabulated as results matrices. A narrative synthesis was performed. RESULTS: Twenty-four studies satisfied our inclusion criteria, 23 of which were deemed to be of good quality (using the Newcastle-Ottawa Scale). For over 70% of univariate data points, the UCAT exerted no statistically significant predictive validity; for the remainder, predictive power was weak. The cognitive total and verbal reasoning subtests had the largest evidence base as weakly positive predictors of academic performance. The SJT subtest was a weak predictor of professional behaviour during medical school. Studies specific to dental schools demonstrated variable findings across the five studies. Only 1 study looked at post-graduate outcome measures and demonstrated that the UCAT was not a predictor of health- or conduct-related fitness to practice declarations at GMC registration. CONCLUSIONS: These data provide some support for the use of cognitive total and verbal reasoning subtests as part of medical school selection. Further research is needed to investigate outcomes beyond professional registration and for dental students.

Is the assumption of equal distances between global assessment categories used in borderline regression valid?

BACKGROUND: Standard setting for clinical examinations typically uses the borderline regression method to set the pass mark. An assumption made in using this method is that there are equal intervals between global ratings (GR) (e.g. Fail, Borderline Pass, Clear Pass, Good and Excellent). However, this assumption has never been tested in the medical literature to the best of our knowledge. We examine if the assumption of equal intervals between GR is met, and the potential implications for student outcomes. METHODS: Clinical finals examiners were recruited across two institutions to place the typical 'Borderline Pass', 'Clear Pass' and 'Good' candidate on a continuous slider scale between a typical 'Fail' candidate at point 0 and a typical 'Excellent' candidate at point 1. Results were analysed using one-sample t-testing of each interval to an equal interval size of 0.25. Secondary data analysis was performed on summative assessment scores for 94 clinical stations and 1191 medical student examination outcomes in the final 2 years of study at a single centre. RESULTS: On a scale from 0.00 (Fail) to 1.00 (Excellent), mean examiner GRs for 'Borderline Pass', 'Clear Pass' and 'Good' were 0.33, 0.55 and 0.77 respectively. All of the four intervals between GRs (Fail-Borderline Pass, Borderline Pass-Clear Pass, Clear Pass-Good, Good-Excellent) were statistically significantly different to the expected value of 0.25 (all p-values < 0.0125). An ordinal linear regression using mean examiner GRs was performed for each of the 94 stations, to determine pass marks out of 24. This increased pass marks for all 94 stations compared with the original GR locations (mean increase 0.21), and caused one additional fail by overall exam pass mark (out of 1191 students) and 92 additional station fails (out of 11,346 stations). CONCLUSIONS: Although the current assumption of equal intervals between GRs across the performance spectrum is not met, and an adjusted regression equation causes an increase in station pass marks, the effect on overall exam pass/fail outcomes is modest.

Standard setting Very Short Answer Questions (VSAQs) relative to Single Best Answer Questions (SBAQs): does having access to the answers make a difference?

BACKGROUND: We investigated whether question format and access to the correct answers affect the pass mark set by standard-setters on written examinations. METHODS: Trained educators used the Angoff method to standard set two 50-item tests with identical vignettes, one in a single best answer question (SBAQ) format (with five answer options) and the other in a very short answer question (VSAQ) format (requiring free text responses). Half the participants had access to the correct answers and half did not. The data for each group were analysed to determine if the question format or having access to the answers affected the pass mark set. RESULTS: A lower pass mark was set for the VSAQ test than the SBAQ test by the standard setters who had access to the answers (median difference of 13.85 percentage points, Z = -2.82, p = 0.002). Comparable pass marks were set for the SBAQ test by standard setters with and without access to the correct answers (60.65% and 60.90% respectively). A lower pass mark was set for the VSAQ test when participants had access to the correct answers (difference in medians -13.75 percentage points, Z = 2.46, p = 0.014). CONCLUSIONS: When given access to the potential correct answers, standard setters appear to appreciate the increased difficulty of VSAQs compared to SBAQs.

Understanding concepts of generalism and specialism amongst medical students at a research-intensive London medical school.

BACKGROUND: Many prominent UK medical organisations have identified a need for more generalist clinicians to address the complex requirements of an aging society. We sought to clarify attitudes towards "Specialists" and "Generalists" amongst medical students and junior doctors at Imperial College School of Medicine. METHODS: A survey exploring medical students' beliefs was followed up by qualitative analysis of focus groups of medical students and Imperial-graduate foundation year doctors. RESULTS: First year medical students associated specialists with academia and higher income, and generalists with ease of training and job availability. Senior (Years 5/6) medical students associated specialists even more firmly with broader influence and academic work, whilst generalists were assigned lower prestige but the same workload as specialists. The medical student focus group discussed concepts of Generalism pertaining only to Primary Care. In contrast, the foundation year doctor focus group revealed that Generalism was now seen to include some hospital care, and the perception that generalists sat lower in a knowledge hierarchy had been challenged. CONCLUSION: Perceptions that Generalism is associated with lower prestige in the medical profession are already present at the very start of medical school and seem to be reinforced during undergraduate training. In early postgraduate clinical practice, the perceived knowledge and prestige hierarchy lessens. These findings can help inform curriculum redesign and the promotion of Generalism as a rewarding career aspiration.

Thinking differently - Students' cognitive processes when answering two different formats of written question.

BACKGROUND: Single-best answer questions (SBAQs) are common but are susceptible to cueing. Very short answer questions (VSAQs) could be an alternative, and we sought to determine if students' cognitive processes varied across question types and whether students with different performance levels used different methods for answering questions. METHODS: We undertook a 'think aloud' study, interviewing 21 final year medical students at five UK medical schools. Each student described their thought processes and methods used for eight questions of each type. Responses were coded and quantified to determine the relative frequency with which each method was used, denominated on the number of times a method could have been used. RESULTS: Students were more likely to use analytical reasoning methods (specifically identifying key features) when answering VSAQs. The use of test-taking behaviours was more common for SBAQs; students frequently used the answer options to help them reach an answer. Students acknowledged uncertainty more frequently when answering VSAQs. Analytical reasoning was more commonly used by high-performing students compared with low-performing students. CONCLUSIONS: Our results suggest that VSAQs encourage more authentic clinical reasoning strategies. Differences in cognitive approaches used highlight the need for focused approaches to teaching clinical reasoning and dealing with uncertainty.

National inter-rater agreement of standardised simulated-patient-based assessments.

PURPOSE: The forthcoming UK Medical Licensing Assessment will require all medical schools in the UK to ensure that their students pass an appropriately designed Clinical and Professional Skills Assessment (CPSA) prior to graduation and registration with a licence to practice medicine. The requirements for the CPSA will be set by the General Medical Council, but individual medical schools will be responsible for implementing their own assessments. It is therefore important that assessors from different medical schools across the UK agree on what standard of performance constitutes a fail, pass or good grade. METHODS: We used an experimental video-based, single-blinded, randomised, internet-based design. We created videos of simulated student performances of a clinical examination at four scripted standards: clear fail (CF), borderline (BD), clear pass (CPX) and good (GD). Assessors from ten regions across the UK were randomly assigned to watch five videos in 12 different combinations and asked to give competence domain scores and an overall global grade for each simulated candidate. The inter-rater agreement as measured by the intraclass correlation coefficient (ICC) based on a two-way random-effects model for absolute agreement was calculated for the total domain scores. RESULTS: 120 assessors enrolled in the study, with 98 eligible for analysis. The ICC was 0.93 (95% CI 0.81-0.99). The mean percentage agreement with the scripted global grade was 74.4% (range 40.8-96.9%). CONCLUSIONS: The inter-rater agreement amongst assessors across the UK when rating simulated candidates performing at scripted levels is excellent. The level of agreement for the overall global performance level for simulated candidates is also high. These findings suggest that assessors from across the UK viewing the same simulated performances show high levels of agreement of the standards expected of students at a 'clear fail,' 'borderline,' 'clear pass' and 'good' level.

Clinical prioritisation questions: A novel assessment tool to encourage tolerance of uncertainty?

Uncertainty is a common and increasingly acknowledged problem in clinical practice. Current single best answer (SBA) style assessments test areas where there is one correct answer, and as the approach to assessment impacts on the approach to learning, these exams may poorly prepare our future doctors to handle uncertainty. We therefore, need to modify our approach to assessment to emphasize reasoning and introduce the possibility of more than one 'correct' answer. We have developed clinical prioritization questions (CPQs), a novel formative assessment tool in which students prioritize possible responses in order of likelihood. This assessment format was piloted with a group of medical students and evaluated in comparison with the more traditional SBA question format in a team-based learning setting. Students reported that they felt ongoing use would help improve their tolerance of uncertainty (p < 0.01). Furthermore, over 80% of students felt that CPQs were more reflective of real-life clinical practice. Group based discussions were significantly longer when answering CPQs (p < 0.01), suggesting they may promote richer discourse. CPQs may have a role in formative assessment to help equip students with the skills to cope with ambiguity and strengthen clinical reasoning and decision-making. Institutions may find them more practical to implement compared with other clinical reasoning assessment tools.

Interpretation of Serum Gonadotropin Levels in Hyperprolactinaemia.

BACKGROUND/AIMS: Hyperprolactinaemia is a common cause of amenorrhoea due to hypogonadotropic hypogonadism. Prolactin is hypothesised to impede the reproductive axis through an inhibitory action at the hypothalamus. However, limited data exist to aid the interpretation of serum gonadotropins in the context of hyperprolactinaemia. METHODS: Serum gonadotropin values were reviewed in 243 patients with elevated serum monomeric prolactin due to discrete aetiologies at a tertiary reproductive endocrine centre between 2012 and 2015. The cause of hyperprolactinaemia was categorised by an experienced endocrinologist/pituitary multidisciplinary team, unless superseded by histology. The most frequently encountered diagnoses were microprolactinoma (n = 88), macroprolactinoma (n = 46), non-functioning pituitary adenoma (NFPA) (n = 72), drug-induced hyperprolactinaemia (n = 22) and polycystic ovarian syndrome (PCOS) (n = 15). RESULTS: In patients with prolactinoma and modestly raised serum prolactin levels (< 4,000 mU/L), increasingly FSH-predominant gonadotropin values were observed with rising prolactin level, consistent with a progressive reduction in hypothalamic gonadotropin-releasing hormone (GnRH) pulsatility. Patients with prolactinoma and higher prolactin values (> 4,000 mU/L) were more likely to have a reduction in serum levels of both FSH and LH, consistent with direct pituitary gonadotrope dysfunction. Patients with macroadenoma and extremes of serum gonadotropin values (either serum FSH or LH > 8 IU/L) were more likely to have NFPA than prolactinoma. Patients with PCOS and hyperprolactinaemia had LH-predominant secretion in keeping with increased GnRH pulsatility despite a raised prolactin level. CONCLUSION: The pattern of gonadotropin secretion in patients with hyperprolactinaemia reflects the underlying aetiology.

Very-short-answer questions: reliability, discrimination and acceptability.

CONTEXT: Single-best-answer questions (SBAQs) have been widely used to test knowledge because they are easy to mark and demonstrate high reliability. However, SBAQs have been criticised for being subject to cueing. OBJECTIVES: We used a novel assessment tool that facilitates efficient marking of open-ended very-short-answer questions (VSAQs). We compared VSAQs with SBAQs with regard to reliability, discrimination and student performance, and evaluated the acceptability of VSAQs. METHODS: Medical students were randomised to sit a 60-question assessment administered in either VSAQ and then SBAQ format (Group 1, n = 155) or the reverse (Group 2, n = 144). The VSAQs were delivered on a tablet; responses were computer-marked and subsequently reviewed by two examiners. The standard error of measurement (SEM) across the ability spectrum was estimated using item response theory. RESULTS: The review of machine-marked questions took an average of 1 minute, 36 seconds per question for all students. The VSAQs had high reliability (alpha: 0.91), a significantly lower SEM than the SBAQs (p < 0.001) and higher mean item-total point biserial correlations (p < 0.001). The VSAQ scores were significantly lower than the SBAQ scores (p < 0.001). The difference in scores between VSAQs and SBAQs was attenuated in Group 2. Although 80.4% of students found the VSAQs more difficult, 69.2% found them more authentic. CONCLUSIONS: The VSAQ format demonstrated high reliability and discrimination and items were perceived as more authentic. The SBAQ format was associated with significant cueing. The present results suggest the VSAQ format has a higher degree of validity.