Does surgical observed structured clinical exam (OSCE) predict clerkship grade, shelf exam scores, and preceptor clinical evaluation?

BACKGROUND: Clinical evaluation of medical student performance has been criticized as variable and subjective. The aim of this study was to assess the correlation of a summative surgical OSCE exam to clinical faculty evaluations as well as surgery shelf exam score and final grades. METHODS: The performance of 392 students who completed the surgical clerkship between 2017 and 2019 was assessed via Pearson Coefficients comparing OSCE grades, clinical evaluations of Medical Knowledge and Patient Care, Communication and Professionalism, the National Board of Medical Examiners (NBME) shelf surgical subject exam, and final clerkship grade. RESULTS: Results demonstrate a statistically significant positive relationship between the OSCE, Shelf score and grade, final clerkship grade, and all clinical evaluations except Communication skills. The greatest correlation occurred between OSCE and shelf scores and grades. Although significant, the degree of correlation with clinical observation was significantly less. CONCLUSION: This study demonstrates that a surgical OSCE has a small positive correlation with clinical knowledge as measured by the NBME shelf exam. There is also an equal correlation with medical knowledge standards, with the OSCE better predicting NBME shelf outcome. This lower correlation to clinical assessment suggests that either the clinical grades contain elements not detected on an OSCE exam but could also support the hypothesis that variability in clinical grades do contain a significant degree of subjectivity.

Inflammatory response of interleukin-1beta and interleukin-6 in septic rats undergoing laparotomy and laparoscopy.

It is generally accepted that greater inflammatory response is observed after laparotomy than laparoscopy in animal models. However, in a previous study, we reported there are no significant differences in the systemic response of tumor necrosis factor (TNF)-alpha between the laparotomy and laparoscopy groups in a rat model of endotoxic shock. The present study extends this investigation to the inflammatory response of 2 additional proinflammatory mediators, interleukin (IL)-1beta and IL-6, in septic rats after laparotomy and laparoscopy in the same animal model. Rats received lipopolysaccharide (LPS) intraperitoneally and underwent laparotomy (n = 5), laparoscopy (n = 5), or no surgical intervention (n = 5). A control group received anesthesia only (n = 5). Serum IL-1beta and IL-6 levels were significantly higher at 2, 4, and 8 hours after LPS injection and were equally suppressed in the laparotomy and laparoscopic groups (P < 0.05). Liver IL-1beta mRNA and protein levels were significantly inhibited at 2, 4, and 8 hours in the laparotomy and laparoscopic groups. Liver IL-6 mRNA (2 and 4 hours) and protein (4 hours) levels were also suppressed significantly in both the laparotomy and laparoscopic groups (P < 0.05). There were no significant differences in hepatic levels of mRNA and protein of IL-beta and IL-6 in both the laparotomy and laparoscopic groups. These results extend our previous finding demonstrating the suppression of TNF-alpha in both the laparotomy and laparoscopic groups. The behavior of the markers used in our study demonstrated that the inflammatory response does not differ between laparotomy and laparoscopic surgery in our rat model of endotoxic shock.

Inhibition of tumor necrosis factor-alpha and inducible nitric oxide synthase correlates with the induction of IL-10 in septic rats undergoing laparotomy and laparoscopy.

Proinflammatory mediators are implicated in the mediation of host response to surgical stress. Greater inflammatory response has been reported after open surgery than after laparoscopic surgery in animal models. This study investigated the inflammatory response of tumor necrosis factor alpha (TNF) and inducible nitric oxide synthase (iNOS) and the anti-inflammatory response of interleukin (IL)-10 after laparotomy and laparoscopy in a rat endotoxic shock model. Rats received lipopolysaccharide (LPS) intraperitoneally and underwent laparotomy (n = 5), laparoscopy (n = 5), or no surgical intervention (n = 5). A control group received anesthesia only (n = 5). Serum TNF levels peaked at 2 hours after LPS injection and were significantly suppressed in animals undergoing laparotomy and laparoscopy ( < 0.05). Serum IL-10 levels were higher at 2 hours in the laparotomy and laparoscopy groups but were higher only in the laparotomy group at 4 hours after LPS injection ( < 0.05). Hepatic iNOS mRNA and protein were significantly inhibited at 4 and 8 hours in the laparotomy and laparoscopy groups in comparison with the animals receiving LPS only ( < 0.05). The induction of IL-10 correlated with the suppression of TNF and iNOS suggests that IL-10 may play a role in downregulating TNF and iNOS in septic rats undergoing laparotomy and laparoscopy.

Surgical careers and preparedness of graduating residents--an outcomes-based study.

PURPOSE: Outcome-based measures have recently become the focus of residency program evaluations. The ultimate outcome of a surgical training program is the successful development of surgical careers by its graduates. METHODS: We developed a survey that was sent to all residents completing our surgical residency from 1989 to 1999 in order to evaluate practice location, type of practice, practice mixture, additional training obtained after residency, Board certification, and membership in the American College (ACS) or other professional societies. Graduates were asked to report their impression of their residency education program's ability to prepare them for surgical practice as well as to give an overall opinion of their training using a scale of 10 (high) to 1 (low). Solicitations were also made for means to improve the training program. RESULTS: Of 32 graduates sent surveys, 30 responded (94%). A total of 29 of 30 responding graduates (97%) are active in surgery. A total of 26 of 30 graduates are in private or government practice, 3 of 30 are full-time academic, and 1 of 30 is completing fellowship training. A total of 13 of 30 (43%) immediately entered practice, whereas 17 of 30 (57%) received additional fellowship training. Board certification has been achieved by 24 graduates. A total of 17 of 30 (59%) are members of the ACS, and 24 of 30 (83%) are members of at least 1 regional or specialty society. The average score for practice preparedness was 8.35. Overall score for the residency program was 8.7. Specific graduate comments demonstrated a perceived need for additional vascular and oncology operative experience that led to changes in our program. These results demonstrate an overall high satisfaction with our training program by graduates over the past 10 years as well as high success rate as evidenced by successful surgical practices by 97% of our graduates. CONCLUSIONS: We believe this type of outcome information provides valuable feedback to programs with regard to planning and development based on the types of careers graduates choose as well as specific changes in curriculum based on perceived deficiencies.