Embedding Assessment Literacy Can Enhance Graduate Attribute Development in a Biomedical Sciences Curriculum.

This paper describes the successful implementation of an assessment literacy strategy within a Biomedical Sciences degree. Teaching was aligned with an assessment literacy framework and aimed to prepare undergraduates for a literature comprehension assessment. Students were introduced to the assessment purpose and an adapted Miller's pyramid model illustrated how the assessment contributed to competency development during their degree. Students read primary research papers and answered questions relating to the publications. They were then introduced to the processes of assessment and collaboratively graded answers of different standards. Finally, student and faculty grades were compared, differences considered, and key characteristics of answers discussed. Most students reported that they understood more about assessment standards than prior to the intervention [139/159 (87.4%)] and felt it had helped prepare them for their exam [138/159 (86.8%)]. The majority also reported they had increased confidence in evaluating data [118/159 (74%)], communicating their reasoning [113/159 (71%)] and considering what a reader needs to know [127/159 (79.9%)]. Students were asked to state the most important thing they had learned from the assessment literacy teaching. Notably, no responses referred to domain-specific knowledge. 129 free text responses were mapped to the University of Edinburgh graduate attribute framework. 93 (72%) statements mapped to the graduate attribute category "Research and Enquiry," 66 (51.16%) mapped to "Communication" and 21 (16.27%) mapped to "Personal and Intellectual Autonomy." To explore any longer-term impact of the assessment literacy teaching, a focus group was held with students from the same cohort, 2 years after the original intervention. Themes from this part of the study included that teaching had provided insights into standards and expectations for the assessment and the benefits of domain specific knowledge. A variety of aspects related to graduate attributes were also identified. Here, assessment literacy as a vehicle for graduate attribute development was an unexpected outcome. We propose that by explicitly engaging students with purpose, process, standards, and expectations, assessment literacy strategies may be used to successfully raise awareness of developmental progression, and enhance skills, aptitudes, and dispositions beneficial to Biomedical Sciences academic achievement and life after university.

Testing anatomy: Dissecting spatial and non-spatial knowledge in multiple-choice question assessment.

Limited research has been conducted on the spatial ability of veterinary students and how this is evaluated within anatomy assessments. This study describes the creation and evaluation of a split design multiple-choice question (MCQ) assessment (totaling 30 questions divided into 15 non-spatial MCQs and 15 spatial MCQs). Two cohorts were tested, one cohort received a 2D teaching method in the academic year 2014/15 (male = 15/108, female 93/108), and the second a 3D teaching method in the academic year 2015/16 (male 14/98, female 84/98). The evaluation of the MCQ demonstrated strong reliability (KR-20 = 0.71 2D and 0.63 3D) meaning the MCQ consistently tests the same construct. Factor analysis of the MCQ provides evidence of validity of the split design of the assessment (RR = 1.11, p = 0.013). Neither cohort outperformed on the non-spatial questions (p > 0.05), however, the 3D cohort performed statistically significantly higher on the spatial questions (p = 0.013). The results of this research support the design of a new anatomy assessment aimed at testing both anatomy knowledge and the problem-solving aspects of anatomical spatial ability. Furthermore, a 3D teaching method was shown to increase students' performance on anatomy questions testing spatial ability.

An exploration of maternity and newborn exposure, training and education among staff working within the North West Ambulance Service.

Aim: Providing emergency and urgent care to pregnant patients and newborns in the pre-hospital setting often presents some of the most challenging and complex incidents attended to by ambulance staff. A service evaluation survey was undertaken to explore current levels of maternity and newborn education, preferred methods of training delivery, exposure and perceived support surrounding maternity and newborn care provision among pre-hospital clinicians working within the North West Ambulance Service (NWAS) NHS Trust. Methods: An online, anonymised survey compromising of 22 questions using multiple choice options and free-text questions was circulated among NWAS staff between 27 May 2021 and 21 June 2021. Questions explored the levels of training, education, exposure and confidence relating to maternal and newborn care in the pre-hospital setting. Insights into preferred approaches to engaging with continuing professional development (CPD) activities were also captured. Data were analysed using built-in Microsoft Forms analytics for quantitative response, with a basic thematic analysis undertaken to synthesise qualitative responses. Results: The survey received 509 responses, with data providing valuable insight relating to gaps in training provision, preferred approaches to CPD and barriers to engagement. Key themes focused on 'pre-registration standards and variations', 'barriers and facilitators to continuing professional development' and 'exposure and skill decline: confidence and knowledge'. Conclusion: Areas for service improvement are highlighted, providing ambulance trusts and integrated care systems with key recommendations. These include maternity and newborn standards for education among paramedic science degree programmes; recognition of pre-hospital emergency maternity and newborn care among maternity providers; the need for exposure and regular multidisciplinary team (MDT) skills training for staff; and a collaborative system-led approach to scaling up and delivering MDT training that acknowledges pre-hospital clinicians as key care providers.

Exploring Student Experiences of an Undergraduate Certificate in Veterinary Medical Education.

The ability to teach is recognized as a core skill for many professionals, including veterinarians, but undergraduate opportunities to develop this skill are not always available. A complementary teaching certificate offered during the clinical years of an undergraduate veterinary program was evaluated to investigate student experiences of the program and the perceived benefits and challenges of participating. The study used a mixed methods approach with questionnaires to provide an overview of the participant experience and semi-structured interviews to gain a deeper insight into students' experiences of the program. Two cohorts completed questionnaires comprising Likert-style and open-ended questions on the 3-year teaching certificate, the first cohort after 1 year of the program and the second cohort at completion. Interviews with participants from both cohorts were thematically analyzed to identify recurring themes. An average of 27% of students per academic year enrolled in the certificate program, most of whom completed it. Additionally, four to six students per cohort applied for Associate Fellow of the Higher Education Academy (AFHEA), and 19 students have achieved this recognition. Key themes from the data included that students felt the certificate built their confidence, increased their veterinary knowledge, and helped them become better teachers, with time management and reflection the biggest challenges. The Undergraduate Certificate of Veterinary Medical Education was seen as a good teaching foundation, while working toward the AFHEA provided some insight into higher education and academic careers. A structured teaching program offers students the opportunity to develop their learning and reflection both as students and future educators.

The VetEd Conference: Evolution of an Educational Community of Practice.

The VetEd conference was developed with the aim of growing an educational community by providing an opportunity to share ideas, innovations, research, and best practices in veterinary education in a friendly, affordable, and inclusive environment. The annual conference has been hosted by the veterinary schools in the UK, Ireland, and the Netherlands, becoming the official conference of the Veterinary Schools Council in 2017. The current study investigates the extent to which the development of the conference has contributed to the evolution of a community of practice. The conference proceedings' abstracts were analyzed to identify trends in number, type, and author information. This was complemented by oral histories exploring the impact of VetEd on developing the veterinary education community. The number of abstracts has increased from 40 (2010) to 137 (2018), and these are predominantly posters, with the major themes being technology-enhanced learning, clinical skills, and assessment. The authors have been increasingly international, representing 8 countries in 2010 and 22 in 2018. Nine interviews were undertaken with those involved in organizing VetEd. The inclusivity of the conference and the engagement of a wide variety of delegate groups are key themes that emerged. Concerns emerged around the organizational challenges and the potential for the conference to outgrow the founding principles in the future. VetEd has become a key event in the annual calendar and represents an initiative that has contributed to the ongoing development of the veterinary education community.

The Use of Lecture Recordings as Study Aids in a Professional Degree Program.

Lecture recording is now common in many educational institutions, leading to discussion about how best to support student learning. In this mixed methods study, we used a survey (n = 46 participants), think-aloud methodologies in observed study sessions (n = 8 participants) and recording analytics (n = 637 recordings) to characterize how veterinary students utilize recordings during their studies. Only 48% of survey respondents considered they were more likely to use recordings as exams approached, but 78% considered they used recordings more when the topic was difficult. In the observed study sessions, students characterized their use of recordings as helping them to control their learning environment, allowing them to pause and rewind challenging topics, and as a jumping off point for future study, allowing them to structure the seeking out of additional information. In a linear model describing the recording analytics, students who had entered higher education directly from high school were more likely to watch more of a lecture than graduate entry students. In addition, the most visited lectures were also the ones with more view time (F(5, 631) = 129.5, R2 = 0.50, p < .001). Overall, this study suggests that veterinary students were selective about their use of recordings in their study strategies, often using them to make up for deficits in their knowledge and understanding, or to supplement their experience at veterinary school. We discuss the consequences and implications for student study skills support.

Veterinary Anatomy Education and Spatial Ability: Where Now and Where Next?

The expanding use of technology to support or replace dissection has implications for educators, who must first understand how students mentally manipulate anatomical images. The psychological literature on spatial ability and general intelligence is relevant to these considerations. This article situates current understandings of spatial ability in the context of veterinary anatomy education. As in medical education, veterinary courses are increasingly using physical and computer-based models and computer programs to supplement or even replace cadavers. In this article, we highlight the importance of spatial ability in the learning of anatomy and make methodological recommendations for future studies to ensure a robust evidence base is developed. Recommendations include ensuring that (a) studies aiming to demonstrate changes in spatial ability include anatomically naïve students and also account for previous anatomical knowledge, (b) studies employ a control group in order to account for the practice effect, and (c) the relationship between spatial ability and general intelligence, and thus other cognitive abilities, is acknowledged.

Development and Evaluation of a Faculty-Based Accredited Continuing Professional Development Route for Teaching and Learning.

This article characterizes and evaluates the development of an accredited, in-house, faculty-based teaching recognition scheme aimed at supporting clinicians and academics to achieve Advance HE Fellowship recognition. The scheme takes 6 to 24 months to complete and forms part of an institution-wide scheme. The evaluation covered 44 months, collecting data on participation rates across the school and 21 semi-structured interviews across 16 staff participants. We describe the outcomes measured alongside key perceived benefits and challenges to support the implementation of similar schemes elsewhere. Across 130 academic staff, there was 61% engagement. In interviews, 11 participants characterized benefits in terms of changes to their teaching, such as adopting new strategies for differing class sizes, and highlighted the benefit of accessible and context-specific development opportunities designed specifically for STEMM (science, technology, engineering, mathematics, and medicine) practitioners and clinicians. Motivations for participating were mainly intrinsic (69%), with international professional recognition also featured (61%, n = 10). Of the 23 participants who withdrew, the largest subgroup (39%) withdrew because they had left the institution, and 35% withdrew because of a lack of time, which encompassed a range of issues. We outline recommendations for implementing similar schemes including protected time, accessible development opportunities, and support for mentors.

Employability as a Guiding Outcome in Veterinary Education: Findings of the VetSet2Go Project.

This paper presents a mini-review of employability as a guiding outcome in veterinary education-its conceptualisation, utility, core elements and dimensions, and pedagogical approaches-through a summary of the findings of a major international project with the same aims (the VetSet2Go project). Guided by a conception of the successful veterinary professional as one capable of navigating and sustainably balancing the (sometimes competing) needs and expectations of multiple stakeholders, the project integrated multiple sources of evidence to derive an employability framework representing the dimensions and capabilities most important to veterinary professional success. This framework provides a useful complement to those based in narrower views of competency and professionalism. One notable difference is its added emphasis on broad success outcomes of satisfaction and sustainability as well as task-oriented efficacy, thus inserting "the self" as a major stakeholder and bringing attention to resilience and sustainable well-being. The framework contains 18 key capabilities consistently identified as important to employability in the veterinary context, aligned to five broad, overlapping domains: veterinary capabilities (task-oriented work performance), effective relationships (approaches to others), professional commitment (approaches to work and the broader professional "mission"), psychological resources (approaches to self), plus a central process of reflective self-awareness and identity formation. A summary of evidence supporting these is presented, as well as recommendations for situating, developing, and accessing these as learning outcomes within veterinary curricula. Though developed within the specific context of veterinarian transition-to-practise, this framework would be readily adaptable to other professions, particularly in other health disciplines.

Developing Miller's Pyramid to Support Students' Assessment Literacy.

Assessment literacy is increasingly recognized as an important concept to consider when developing assessment strategies for courses and programs. Assessment literacy approaches support students in their understanding of assessment expectations and help them both understand and optimize their performance in assessment. In this teaching tip, a model for assessment literacy that builds on the well-known Miller's Pyramid model for assessment in clinical disciplines is proposed and contextualized. The model progresses thinking from assessment methods themselves to consideration of the activities that need to be built into curricula to ensure that assessment literacy is addressed at each level of the pyramid. The teaching tip provides specific examples at each of the levels. Finally, the relevance of this work to overall curriculum design is emphasized.

Success at Veterinary School: Evaluating the Influence of Intake Variables on Year-1 Examination Performance.

A major challenge in admissions to veterinary medical degrees is to select those students most suitable for clinical training programs and careers from a large pool of applicants with very high academic ability. Predicting the success of students in a veterinary course is challenging, and relatively few objective studies have been undertaken to identify factors that facilitate progression through this educational experience. Prior educational attainment is considered by some to be a good predictor of success at undergraduate level. The aims of this study were to analyze intake data such as educational history and demographic factors of students entering the University of Edinburgh and to investigate possible relationships between these data and academic performance in the first year at veterinary school. Data were collated for three veterinary intakes, including school qualification, subjects, grades, grade point average (GPA), degree classification, domicile, gender, and age. Performance was measured by marks achieved in first-year veterinary degree examinations. Relationships between marks and the influence of intake variables were statistically analyzed via ANOVA. For school-leaving entrants, the presence of straight A grades in school was linked to better exam performance. Students with an A grade in Chemistry or Biology performed better; A grades in Mathematics and Physics did not show such a consistent linkage with performance. Higher GPA was associated with better performance in first year for students in a graduate entry program. This study shows prior educational attainment does appear to be linked with subsequent performance in the first year at veterinary school.

Teaching best practice in hand hygiene: student use and performance with a gamified gesture recognition system.

The use of an automated gesture recognition system to teach the commonly adopted, seven-stage hand hygiene technique to veterinary undergraduate students was evaluated. The system features moderate gamification, intended to motivate the student to use the machine repeatedly. The system records each handwash stage, and those found to be difficult are identified and reported back. The gamification element alone was not sufficient to encourage repeated use of the machine, with only 13.6 per cent of 611 eligible students interacting with the machine on one or more occasion. Overall engagement remained low (mean sessions per user: 3.5, ±0.60 confidence interval), even following recruitment of infection control ambassadors who were given a specific remit to encourage engagement with the system. Compliance monitoring was introduced to explore how students used the system. Hand hygiene performance did not improve with repeated use. There was evidence that the stages-fingers interlaced, rotation of the thumb, rotation of the fingertips and rotation of the wrists-were more challenging for students to master (p=0.0197 to p<0.0001) than the back of the hand and of the fingers. Veterinary schools wishing to use such a system should consider adopting approaches that encourage peer buy-in, and highlight the ability to practise difficult stages of the technique.

'Care about my animal, know your stuff and take me seriously': United Kingdom and Australian clients' views on the capabilities most important in their veterinarians.

Success in veterinary practice requires careful balancing of stakeholder needs. The aim of this study was to investigate the current expectations and needs of veterinary clients across a range of practice types. Interviews and focus groups were undertaken with veterinary clients to identify the capabilities of veterinarians that result in the best client experience, generating a 'Veterinary Capability Framework'. This comprised six main capabilities each containing 4-10 behavioural indicators: client relationships; professionalism; communication skills; decision-making and problem solving; commitment to animal welfare; and commitment to quality and the profession. An online survey was then conducted to validate the importance of these capabilities, which was completed by 1446 mostly UK and Australian clients. The data have allowed us to develop a 'Client Hierarchy of Needs' which emphasises the fundamental importance of commitment to animal welfare and veterinary capabilities to the client experience. This study is part of the VetSet2Go project, a collaborative international project to define the capabilities most important for employability and success in the veterinary profession today.

Adaptive Comparative Judgment: A Tool to Support Students' Assessment Literacy.

Comparative judgment in assessment is a process whereby repeated comparison of two items (e.g., assessment answers) can allow an accurate ranking of all the submissions to be achieved. In adaptive comparative judgment (ACJ), technology is used to automate the process and present pairs of pieces of work over iterative cycles. An online ACJ system was used to present students with work prepared by a previous cohort at the same stage of their studies. Objective marks given to the work by experienced faculty were compared to the rankings given to the work by a cohort of veterinary students (n=154). Each student was required to review and judge 20 answers provided by the previous cohort to a free-text short answer question. The time that students spent on the judgment tasks was recorded, and students were asked to reflect on their experiences after engaging with the task. There was a strong positive correlation between student ranking and faculty marking. A weak positive correlation was found between the time students spent on the judgments and their performance on the part of their own examination that contained questions in the same format. Slightly less than half of the students agreed that the exercise was a good use of their time, but 78% agreed that they had learned from the process. Qualitative data highlighted different levels of benefit from the simplest aspect of learning more about the topic to an appreciation of the more generic lessons to be learned.

Getting Started with Peer-Assisted Learning in a Veterinary Curriculum.

Peer-Assisted Learning (PAL) methodologies that involve students teaching other students have been shown to be valid and effective in a variety of disciplines and are gaining increasing interest within veterinary medical education. PAL has been formally embedded within the undergraduate veterinary clinical skills curriculum at the Royal (Dick) School of Veterinary Studies (R(D)SVS), Edinburgh, since 2009 (and informally for several years before this) and has been delivered successfully to over one thousand first-year tutees by over one thousand fourth-year tutors (in their penultimate clinical year). This "teaching tip" article therefore aims to provide an informative overview of PAL for colleagues who may be interested in the methodology and to give practical tips as to how it can be successfully implemented in a veterinary degree program. We will summarize key evidence from the literature, provide a detailed example of how PAL has been implemented and optimized in our own veterinary degree program, include a subset of representative evaluation data from both tutors and tutees, and then conclude by providing colleagues with practical tips and resources (such as planning checklists and lesson plan templates) for implementing a PAL activity at their own school.

Exploring the Link between Mindset and Psychological Well-Being among Veterinary Students.

This study set out to improve our understanding of potential pedagogical factors that may influence the mental health of veterinary students. Previous research has demonstrated that the type of feedback given to children by parents and teachers can strongly influence young people's beliefs in their ability to modify their intelligence-their "mindset." There is also evidence that we can change the mindset of students relating to their intelligence by changing the methods by which we teach and assess. We used a paper-based questionnaire to assess mindset and psychological well-being in veterinary students (n=148). We found an association linking students' mindset to their intelligence and their psychological well-being. Students who believed that their level of intelligence was fixed had significantly lower scores on five out of six areas of psychological well-being compared to students who believed that their intelligence was malleable. Giving process rather than person feedback and reducing assessment methods that encourage comparison with other students could increase the proportion of our students with a growth mindset and, if the association we identified is causal, improve their psychological well-being.

Which professional (non-technical) competencies are most important to the success of graduate veterinarians? A Best Evidence Medical Education (BEME) systematic review: BEME Guide No. 38.

BACKGROUND: Despite the growing prominence of professional (non-technical) competencies in veterinary education, the evidence to support their importance to veterinary graduates is unclear. AIM: To summarize current evidence within the veterinary literature for the importance of professional competencies to graduate success. METHODS: A systematic search of electronic databases was conducted (CAB Abstracts, Web of Science, PubMed, PsycINFO, ERIC, Australian and British Education Index, Dissertations & Theses) from 1988 to 2015 and limited to the veterinary discipline (veterinar* term required). Evidence was sought from consensus-based competence frameworks, surveys of stakeholder perceptions, and empirical evidence linked to relevant outcomes (e.g. employability, client satisfaction or compliance). Data extraction was completed by two independent reviewers and included a quality assessment of each source. RESULTS: Fifty-two sources were included in the review, providing evidence from expert frameworks (10 sources), stakeholder perceptions (30 sources, including one from the previous category), and empirical research (13 sources). Communication skills were the only competency to be well-supported by all three categories of evidence. Other competencies supported by multiple sources of empirical evidence include empathy, relationship-centered care, self-efficacy, and business skills. Other competencies perceived to be relatively more important included awareness of limitations, professional values, critical thinking, collaboration, and resilience. CONCLUSIONS: This review has highlighted the comparatively weak body of evidence supporting the importance of professional competencies for veterinary graduate success, with the exception of communication skills. However we stress this is more indicative of the scarcity of high-quality veterinary-based education research in the field, than of the true priority of these competencies.