Validation of a Rubric Used for Skills-Based Assessment of Veterinary Students Performing Simulated Ovariohysterectomy on a Model.

Surgical skills are an important competency for new graduates. Simulators offer a means to train and assess veterinary students prior to their first surgical performance. A simulated ovariohysterectomy (OVH) rubric's validity was evaluated using a framework of content evidence, internal structure evidence, and evidence of relationship with other variables, specifically subsequent live surgical performance. Clinically experienced veterinarians (n = 13) evaluated the utility of each rubric item to collect evidence; each item's content validity index was calculated to determine its inclusion in the final rubric. After skills training, veterinary students (n = 57) were assessed using the OVH model rubric in March and August. Internal structure evidence was collected by video-recording 14 students' mock surgeries, each assessed by all five raters to calculate inter-rater reliability. Relationship with other variables evidence was collected by assessing 22 students performing their first live canine OVH in November. Experienced veterinarians included 22 items in the final rubric. The rubric generated scores with good to excellent internal consistency; inter-rater reliability was fair. Students' performance on the March model assessment was moderately correlated with their live surgical performance (ρ = 0.43) and moderately negatively correlated with their live surgical time (ρ = -0.42). Students' performance on the August model assessment, after a summer without surgical skills practice, was weakly correlated with their live surgical performance (ρ = 0.17). These data support validation of the simulated OVH rubric. The continued development of validated assessment instruments is critical as veterinary medicine seeks to become competency based.

The Impact of Extracurricular Surgical Experience on Veterinary Students' Performance of Canine Ovariohysterectomy and Orchidectomy in a Clinical Skills Curriculum.

Veterinary students may pursue extracurricular surgical experiences before performing ovariohysterectomy or orchidectomy in their veterinary curriculum. We sought to evaluate the impact of these experiences on student confidence and subsequent surgical performance during students' first canine ovariohysterectomy or orchidectomy during their veterinary school curriculum. We enrolled 69 third-year veterinary students to complete pre- and post-operative surveys reporting their confidence to perform surgery and self-assessing their performance. Students had all completed five semesters of surgical skills training on models and cadavers but varied in their participation in extracurricular surgical experiences. A subset of students (n = 27) were digitally recorded while performing ovariohysterectomy (16) or orchidectomy (11). Digital recordings were scored by a blinded rater using task-specific rubrics and a global rating scale, and time to perform the procedure was recorded. The number of extracurricular surgeries students had performed was positively correlated with their confidence to perform orchidectomy (r = .78) but not ovariohysterectomy (r = -.17). There was no correlation between extracurricular surgeries performed and subsequent rubric scores or surgical times for the first ovariohysterectomy (r = -.01 and r = -.14, respectively) or orchidectomy (r = .09 and r = -.18, respectively) performed as part of their veterinary curriculum. Our results suggest that extracurricular surgical experiences may not impart a long-term improvement on performance scores or surgical time during students' first surgery of their veterinary curriculum. Additional research is necessary to clarify how model training and extracurricular surgical experiences on live animals interact to affect students' subsequent surgical performance.

Development and Validation of a Canine Castration Model and Rubric.

Veterinary educators use models to allow repetitive practice of surgical skills leading to clinical competence. Canine castration is a commonly performed procedure that is considered a Day One competency for a veterinarian. In this study, we sought to create and evaluate a canine pre-scrotal closed castration model and grading rubric using a validation framework of content evidence, internal structure evidence, and relationship with other variables. Veterinarians (n = 8) and students (n = 32) were recorded while they performed a castration on the model and provided survey feedback. A subset of the students (n = 7) then performed a live canine castration, and their scores were compared with their model scores. One hundred percent of the veterinarians and 91% of the students reported that the model was helpful in training for canine castration. They highlighted several areas for continued improvement. Veterinarians' model performance scores were significantly higher than students', indicating that the model had adequate features to differentiate expert from novice performance. Students' performance on the model strongly correlated with their performance of live castration (r = .82). Surgical time was also strongly correlated (r = .70). The internal consistency of model and live rubric scores were good at .85 and .94, respectively. The framework supported validation of the model and rubric. The canine castration model facilitated cost-efficient practice in a safe environment in which students received instructor feedback and learned through experience without the risk of negatively affecting a patient's well-being. The strong correlation between model and live animal performance scores suggests that the model could be useful for mastery learning.

Effect of anesthetic breathing circuit type on thermal loss in cats during inhalation anesthesia for ovariohysterectomy.

OBJECTIVE: To compare the effects of a nonrebreathing circuit versus a reduced volume circle anesthetic breathing circuit on body temperature change in cats during inhalation anesthesia for ovariohysterectomy. DESIGN: Randomized, controlled clinical trial. ANIMALS: 141 female domestic cats hospitalized for routine ovariohysterectomy. PROCEDURES: Cats were randomly assigned to receive inhalation anesthetics from either a nonrebreathing circuit or a reduced volume circle system with oxygen flow rates of 200 and 30 mL/kg/min (90.9 and 13.6 mL/lb/min), respectively. Body temperatures were monitored throughout the anesthetic period via an intrathoracic esophageal probe placed orally into the esophagus to the level of the heart base. RESULTS: No difference in body temperature was found between the 2 treatment groups at any measurement time. The duration of procedure had a significant effect on body temperature regardless of the type of anesthetic circuit used. CONCLUSIONS AND CLINICAL RELEVANCE: Duration of the procedure rather than the type of anesthetic circuit used for inhalation anesthesia was more influential on thermal loss in cats undergoing ovariohysterectomy.