Shaping the right conditions in programmatic assessment: how quality of narrative information affects the quality of high-stakes decision-making.

BACKGROUND: Programmatic assessment is increasingly being implemented within competency-based health professions education. In this approach a multitude of low-stakes assessment activities are aggregated into a holistic high-stakes decision on the student's performance. High-stakes decisions need to be of high quality. Part of this quality is whether an examiner perceives saturation of information when making a holistic decision. The purpose of this study was to explore the influence of narrative information in perceiving saturation of information during the interpretative process of high-stakes decision-making. METHODS: In this mixed-method intervention study the quality of the recorded narrative information was manipulated within multiple portfolios (i.e., feedback and reflection) to investigate its influence on 1) the perception of saturation of information and 2) the examiner's interpretative approach in making a high-stakes decision. Data were collected through surveys, screen recordings of the portfolio assessments, and semi-structured interviews. Descriptive statistics and template analysis were applied to analyze the data. RESULTS: The examiners perceived less frequently saturation of information in the portfolios with low quality of narrative feedback. Additionally, they mentioned consistency of information as a factor that influenced their perception of saturation of information. Even though in general they had their idiosyncratic approach to assessing a portfolio, variations were present caused by certain triggers, such as noticeable deviations in the student's performance and quality of narrative feedback. CONCLUSION: The perception of saturation of information seemed to be influenced by the quality of the narrative feedback and, to a lesser extent, by the quality of reflection. These results emphasize the importance of high-quality narrative feedback in making robust decisions within portfolios that are expected to be more difficult to assess. Furthermore, within these "difficult" portfolios, examiners adapted their interpretative process reacting on the intervention and other triggers by means of an iterative and responsive approach.

A personal view on basic education in reproduction: Where are we now and where are we going?

This article explores the current and expected direction of education in reproduction at the Faculty of Veterinary Medicine of Utrecht University. The current reproductive course in the Bachelor's programme is described. Based on the yearly routine course evaluation, changes have been started and continue to be implemented, and the educational ideas behind it are defined. Interactive e-learning modules that combine knowledge clips, animations, and quizzes have been developed. For the practical classes, e-modules with instructional videos have been paired to the written material. Using these new tools during self-study, students have to prepare for the necessary face-to-face classes that contain more in-depth discussions and practical training. In the second part, the author describes his expectations for further educational development. The growth of effective self-study using e-learning, besides traditional textbooks, before more in-depth face-to-face classes is likely to occur. With the growth of modern possibilities, such as the haptic technique and virtual reality, a better preparation in laboratory skills before practical training with animals is expected. In the author's opinion, despite all new learning methods and material, small group, face-to-face lectures, and practical classes with animals or animal material remain absolutely necessary. This article concludes with some lessons learned during the current adaptation of the course.

Single-stage reconstruction of third-degree perineal lacerations in horses under general anesthesia: Utrecht repair method.

OBJECTIVE: To describe perioperative management, surgical procedure, and outcome in mares with third-degree perineal lacerations (TDPL) treated with a single-stage repair, the Utrecht repair method (URM). STUDY DESIGN: Retrospective study. ANIMALS: Twenty mares with TDPL. METHODS: Medical records of mares with TDPL reconstructed with a URM were reviewed for perioperative management; surgical outcome; and postoperative fertility, athletic performance, and complications. RESULTS: Mares ranged in age from 3.5 to 11 years. Long-term follow-up was available for 13 mares. Mean duration of follow-up was 9 years (median, 9.5; range, 2-215 months (17.9 years)). Standardized perioperative fasting and postoperative refeeding protocols were used. Only five mares received supportive gastric medication. Reconstruction of the rectovestibular shelf was successful in 18 of 20 mares. Two of 20 mares developed a small rectovestibular fistula after the initial repair, which was successfully repaired with a second surgery. Other postoperative complications were observed in 13 mares and consisted of mild postanesthetic myositis, facial nerve paralysis, esophageal obstruction, rectal obstipation, partial perineal dehiscence, and rectal or vestibular wind-sucking. Six of seven mares that were subsequently bred became pregnant. One mare was successfully used for embryo recovery, and five of six mares foaled without recurrence of a TDPL. Nine of 13 mares were used for riding at various levels. CONCLUSION: The alternative single-stage reconstruction for TDPL was successful in 18 of 20 mares after a single surgery. No major complications related directly to the technique were noted. CLINICAL SIGNIFICANCE: The URM is a valid alternative surgical technique for repairing TDPL in mares.

Inter-Rater Reliability of Grading Undergraduate Portfolios in Veterinary Medical Education.

The reliability of high-stakes assessment of portfolios containing an aggregation of quantitative and qualitative data based on programmatic assessment is under debate, especially when multiple assessors are involved. In this study carried out at the Faculty of Veterinary Medicine, Utrecht University, the Netherlands, two independent assessors graded the portfolios of students in their second year of the 3-year clinical phase. The similarity of grades (i.e., equal grades) and the level of the grades were studied to estimate inter-rater reliability, taking into account the potential effects of the assessor's background (i.e., originating from a clinical or non-clinical department) and student's cohort group, gender, and chosen master track (Companion Animal Health, Equine Health, or Farm Animal/Public Health). Whereas the similarity between the two grades increased from 58% in the first year the grading system was introduced to around 80% afterwards, the grade level was lower over the next 3 years. The assessor's background had a minor effect on the proportion of similar grades, as well as on grading level. The assessor intraclass correlation was low (i.e., all assessors scored with a similar grading pattern [same range of grades]). The grades awarded to female students were higher but more often dissimilar. We conclude that the grading system was well implemented and has a high inter-rater reliability.

Ultrasonographic appearance of the conceptus, fetal heart rate and profiles of pregnancy-associated glycoproteins (PAG) and prostaglandin F2alpha-metabolite (PGF2alpha-metabolite) after induction of fetal death with aglepristone during early gestation in cattle.

A higher incidence of fetal losses, especially after the use of artificial reproduction techniques, asks for more intensive monitoring of bovine pregnancies. In this study, a model for fetal death (FD) was created by administering the antiprogesterone aglepristone twice, at Day 47 and 48 of gestation (n=5). Control heifers received the solvent (n=5). The temporal relationships between changes in ultrasonographic appearance of fetal fluids and membranes, fetal heart rate (FHR) and peripheral plasma levels of pregnancy-associated glycoprotein (PAG) and PGF2alpha-metabolite as determined by radioimmunoassay associated with FD were monitored at eight hour intervals around treatment. For the analysis of plasma levels the period under study was divided into five epochs (T1: before injection of aglepristone/solvent; T2: from first to second injection; T3: from second injection to FD; T4: from diagnosis of FD to 56 h later; T5: from 56 h to 104 h after diagnosis of FD). Control heifers produced healthy calves at term, but in treated heifers, FD occurred on average at 58 (range 48-80) h after first injection of aglepristone. Fetal death was always preceded by a visible reduction of the amount of allantoic fluid and by segregation of the allantochorionic membrane from the endometrium. FHR remained rather constant in both groups, but a (non-significant) drop in FHR around 8h before FD was diagnosed in four of five treated animals. All fetuses were expulsed after FD. Levels of PAG remained constant or even slightly increased in controls, but decreased in treated animals from T2 onward: levels during T4 and T5 significantly differed from those during T1 and from values in controls during T4 and T5 (P<0.01). PGF2alpha-metabolite levels did not change in the controls, but in the treated group they were significantly higher during T3 when compared to T1 (P<0.05). After this increase, a sharp decrease in PGF2alpha-metabolite level occurred, reaching a significantly lower level at T5 when compared to control animals (P=0.01). It is concluded, that FD induced by aglepristone is preceded by ultrasonographic visible changes in fetal membranes and fluids and a rise in PGF2alpha-metabolite and is followed by a drop in PAG and PGF2alpha-metabolite.