Challenge GP: using gamification to bring the reality and uncertainty of a duty doctor's surgery to early year medical students.

Exposing medical student cohorts to the lived reality of uncertainty and complexity experienced by GPs is challenging to achieve. We present a novel teaching concept: 'Challenge GP' designed for early years students. Gamification methodology is used to reproduce key elements of the 'duty GP' experience in a classroom setting where working in teams, students play a competitive card game. Cards drawn at random pose scenarios based on practical, logistical, and ethical dilemmas of a duty doctor surgery. Each team discusses whether to score by reporting a decision or play special cards to pass the dilemma onto, or collaborate with, another team. Answers are facilitated and scored by a GP tutor.Student feedback demonstrated highly effective learning for clinical reasoning, risk management and problem-solving. Students were exposed to the uncertainty and complexity of real-life medicine. Gamification, through competitiveness, increased task engagement. Students learned the value of working in teams under time pressure and grew in confidence by sharing knowledge in a safe environment. Students were enabled to think, feel and practise as real-life clinicians. This became a powerful force in contextualising their theory-based knowledge, aided understanding of the GP role and opened their eyes to a possible career in general practice.

GP led medical student visits to primary schools can provide a valuable learning experience for both students and pupils.

Background: A key clinical skill for undergraduate medical students is communication with children, yet it is becoming increasingly difficult for medical schools to provide sufficient experience within a secondary care setting. One potential solution to this is to develop innovative ways of involving local schools.Aim: To demonstrate what was learned from a pilot school visit and show how this was developed into a successful programme.Method: As part of their GP-based Foundations of Primary Care course, medical students were allocated to local primary schools in their tutorial groups led by their GP tutors. They developed and delivered health promotion activities that were appropriate for school pupils. Review of the visit identified areas of improvement which were used to redesign the programme. Surveys were conducted after the subsequent visit to assess the response of medical students, school pupils and teachers.Learning outcomes: Medical students gained experience in communicating and interacting with school-aged children, and developed teaching and team working skills. School pupils reported change in their health-related knowledge and behaviour and the visits introduced them to the medical profession at a young age. The visits were well received by the teachers who valued the medical students' input.Conclusions: Building on the learning from the pilot school visit, a successful programme was developed that was challenging but ultimately enhanced medical student learning and brought significant benefits for the school pupils. Future developments include the potential to expand the topics taught and developing training in teaching for medical students.

Reimagining medical education for primary care in the time of COVID-19: a world view.

This article sets out to highlight the challenges and opportunities for medical education in primary care realised during the COVID-19 pandemic and now being enacted globally. The themes were originally presented during a webinar involving educationalists from around the world and are subsequently discussed by members of the WONCA working party for education. The article recognises the importance of utilising diversity, addressing inequity and responding to the priority health needs of the community through socially accountable practice. The well-being of educators and learners is identified as priority in response to the ongoing global pandemic. Finally, we imagine a new era for medical education drawing on global connection and shared resources to create a strong community of practice.

'GP Live'- recorded General Practice consultations as a learning tool for junior medical students faced with the COVID-19 pandemic restrictions.

BACKGROUND: First year medical students value doctor and patient contact. However, it can be challenging to achieve positive exposure to primary care on a large scale. The COVID-19 pandemic has placed even greater pressure on placing students in General Practice (GP). AIM: To assess the feasibility and acceptability of showing Year 1 medical students authentic recorded consultations between GPs and patients, and then explore what they gained from this. METHOD: Using Panopto® Video Platform, we pre-recorded real Primary Care consultations, with patient and GP consent, which were then processed securely using the University of Aberdeen server. These were shown to all Year 1 medical students who immediately debriefed these consultations in small groups with a GP tutor. Subsequently two focus groups were held with 11 students to evaluate what they had learnt. LEARNING OUTCOMES: The consultations were easy to record and play during the teaching session, although there were some issues with sound quality. All students in the focus groups enjoyed the experience. They gained new knowledge about the skills of GPs, and recognised GPs as positive role models. Students were able to identify a variety of communication and consultation skills used by the GP, which reinforced their teaching on these delivered elsewhere in the course. CONCLUSION: Using pre-recorded consultations as a teaching tool is reproducible, time-efficient and beneficial to students. We propose that this model of using authentic 'live' interactions between GPs and patients represents a valuable undergraduate educational opportunity and could be utilised by medical schools internationally.

Very-short-answer questions: reliability, discrimination and acceptability.

CONTEXT: Single-best-answer questions (SBAQs) have been widely used to test knowledge because they are easy to mark and demonstrate high reliability. However, SBAQs have been criticised for being subject to cueing. OBJECTIVES: We used a novel assessment tool that facilitates efficient marking of open-ended very-short-answer questions (VSAQs). We compared VSAQs with SBAQs with regard to reliability, discrimination and student performance, and evaluated the acceptability of VSAQs. METHODS: Medical students were randomised to sit a 60-question assessment administered in either VSAQ and then SBAQ format (Group 1, n = 155) or the reverse (Group 2, n = 144). The VSAQs were delivered on a tablet; responses were computer-marked and subsequently reviewed by two examiners. The standard error of measurement (SEM) across the ability spectrum was estimated using item response theory. RESULTS: The review of machine-marked questions took an average of 1 minute, 36 seconds per question for all students. The VSAQs had high reliability (alpha: 0.91), a significantly lower SEM than the SBAQs (p < 0.001) and higher mean item-total point biserial correlations (p < 0.001). The VSAQ scores were significantly lower than the SBAQ scores (p < 0.001). The difference in scores between VSAQs and SBAQs was attenuated in Group 2. Although 80.4% of students found the VSAQs more difficult, 69.2% found them more authentic. CONCLUSIONS: The VSAQ format demonstrated high reliability and discrimination and items were perceived as more authentic. The SBAQ format was associated with significant cueing. The present results suggest the VSAQ format has a higher degree of validity.

Variation in passing standards for graduation-level knowledge items at UK medical schools.

OBJECTIVES: Given the absence of a common passing standard for students at UK medical schools, this paper compares independently set standards for common 'one from five' single-best-answer (multiple-choice) items used in graduation-level applied knowledge examinations and explores potential reasons for any differences. METHODS: A repeated cross-sectional study was conducted. Participating schools were sent a common set of graduation-level items (55 in 2013-2014; 60 in 2014-2015). Items were selected against a blueprint and subjected to a quality review process. Each school employed its own standard-setting process for the common items. The primary outcome was the passing standard for the common items by each medical school set using the Angoff or Ebel methods. RESULTS: Of 31 invited medical schools, 22 participated in 2013-2014 (71%) and 30 (97%) in 2014-2015. Schools used a mean of 49 and 53 common items in 2013-2014 and 2014-2015, respectively, representing around one-third of the items in the examinations in which they were embedded. Data from 19 (61%) and 26 (84%) schools, respectively, met the inclusion criteria for comparison of standards. There were statistically significant differences in the passing standards set by schools in both years (effect sizes (f2 ): 0.041 in 2013-2014 and 0.218 in 2014-2015; both p < 0.001). The interquartile range of standards was 5.7 percentage points in 2013-2014 and 6.5 percentage points in 2014-2015. There was a positive correlation between the relative standards set by schools in the 2 years (Pearson's r = 0.57, n = 18, p = 0.014). Time allowed per item, method of standard setting and timing of examination in the curriculum did not have a statistically significant impact on standards. CONCLUSIONS: Independently set standards for common single-best-answer items used in graduation-level examinations vary across UK medical schools. Further work to examine standard-setting processes in more detail is needed to help explain this variability and develop methods to reduce it.

Peer feedback for examiner quality assurance on MRCGP International South Asia: a mixed methods study.

BACKGROUND: The International Membership Examination (MRCGP[INT]) of the Royal College of General Practitioners UK is a unique collaboration between four South Asian countries with diverse cultures, epidemiology, clinical facilities and resources. In this setting good quality assurance is imperative to achieve acceptable standards of inter rater reliability. This study aims to explore the process of peer feedback for examiner quality assurance with regard to factors affecting the implementation and acceptance of the method. METHODS: A sequential mixed methods approach was used based on focus group discussions with examiners (n = 12) and clinical examination convenors who acted as peer reviewers (n = 4). A questionnaire based on emerging themes and literature review was then completed by 20 examiners at the subsequent OSCE exam. Qualitative data were analysed using an iterative reflexive process. Quantitative data were integrated by interpretive analysis looking for convergence, complementarity or dissonance. The qualitative data helped understand the issues and informed the process of developing the questionnaire. The quantitative data allowed for further refining of issues, wider sampling of examiners and giving voice to different perspectives. RESULTS: Examiners stated specifically that peer feedback gave an opportunity for discussion, standardisation of judgments and improved discriminatory abilities. Interpersonal dynamics, hierarchy and perception of validity of feedback were major factors influencing acceptance of feedback. Examiners desired increased transparency, accountability and the opportunity for equal partnership within the process. The process was stressful for examiners and reviewers; however acceptance increased with increasing exposure to receiving feedback. The process could be refined to improve acceptability through scrupulous attention to training and selection of those giving feedback to improve the perceived validity of feedback and improved reviewer feedback skills to enable better interpersonal dynamics and a more equitable feedback process. It is important to highlight the role of quality assurance and peer feedback as a tool for continuous improvement and maintenance of standards to examiners during training. CONCLUSION: Examiner quality assurance using peer feedback was generally a successful and accepted process. The findings highlight areas for improvement and guide the path towards a model of feedback that is responsive to examiner views and cultural sensibilities.

Bridging the gap: the roles of social capital and ethnicity in medical student achievement.

OBJECTIVES: Within medical education, there is a discrepancy between the achievement level of White students and that of their ethnic minority peers. The processes underlying this disparity have not been adequately investigated or explained. This study utilises social network analysis to investigate the impact of relationships on medical student achievement by ethnicity, specifically by examining homophily (the tendency to interact with others in the same group) by ethnicity, age and role. METHODS: Data from a cross-sectional social network study conducted in one UK medical school are presented and are analysed alongside examination records obtained from the medical school. Participants were sampled across the four hospital placement sites; a total of 158 medical students in their clinical phase (Years 3 and 4) completed the survey. The research was designed and analysed using social capital theory. RESULTS: Although significant patterns of ethnic and religious homophily emerged, no link was found between these factors and achievement. Interacting with problem-based learning (PBL) group peers in study-related activities, and having seniors in a wider academic support network were directly linked to better achievement. Students in higher academic quartiles were more likely to be named by members of their PBL group in study activities and to name at least one tutor or clinician in their network. Students from lower-achieving groups were least likely to have the social capital enabling, and resulting from, interactions with members of more expert social groups. CONCLUSIONS: Lower levels of the social capital that mediates interaction with peers, tutors and clinicians may be the cause of underperformance by ethnic minority students. Because of ethnic homophily, minority students may be cut off from potential and actual resources that facilitate learning and achievement.

Exploring the causes of junior doctors' prescribing mistakes: a qualitative study.

AIMS: Prescribing errors are common and can be detrimental to patient care and costly. Junior doctors are more likely than consultants to make a prescribing error, yet there is only limited research into the causes of errors. The aim of this study was to explore the causes of prescribing mistakes made by doctors in their first year post graduation. METHODS: As part of the EQUIP study, interviews using the critical incident technique were carried out with 30 newly qualified doctors. Participants were asked to discuss in detail any prescribing errors they had made. Participants were purposely sampled across a range of medical schools (18) and hospitals (15). A constant comparison approach was taken to analysis and Reason's model of accident causation was used to present the data. RESULTS: More than half the errors discussed were prescribing mistakes (errors due to the correct execution of an incorrect plan). Knowledge-based mistakes (KBMs) appeared to arise from poor knowledge of practical aspects of prescribing such as dosing, whereas rule-based mistakes (RBMs) resulted from inappropriate application of knowledge. Multiple error-producing and latent conditions were described by participants for RBMs and KBMs. Poor/absent senior support and a fear of appearing incompetent occurred with KBMs. Following erroneous routines or seniors' orders were major contributory factors in RBMs. CONCLUSIONS: Although individual factors such as knowledge and expertise played a role in prescribing mistakes, there were many perceived interrelated factors contributing to error. We conclude that multiple interventions are necessary to address these and further research is essential.