Building and executing a research agenda toward conducting implementation science in medical education.

BACKGROUND: Implementation science (IS) is the study of methods that successfully integrate best evidence into practice. Although typically applied in healthcare settings to improve patient care and subsequent outcomes, IS also has immediate and practical applications to medical education toward improving physician training and educational outcomes. The objective of this article is to illustrate how to build a research agenda that focuses on applying IS principles in medical education. APPROACH: We examined the literature to construct a rationale for using IS to improve medical education. We then used a generalizable scenario to step through a process for applying IS to improve team-based care. PERSPECTIVES: IS provides a valuable approach to medical educators and researchers for making improvements in medical education and overcoming institution-based challenges. It encourages medical educators to systematically build upon the research outcomes of others to guide decision-making while evaluating the successes of best practices in individual environments and generate additional research questions and findings. CONCLUSIONS: IS can act as both a driver and a model for educational research to ensure that best educational practices are easier and faster to implement widely.

Factors Affecting Gender-based Experiences for Residents in Radiation Oncology.

PURPOSE: Although women constitute approximately half of medical school graduates, an uneven gender distribution exists among many specialties, including radiation oncology, where women fill only one third of residency positions. Although multiple social and societal factors have been theorized, a structured review of radiation oncology resident experiences has yet to be performed. METHODS AND MATERIALS: An anonymous and voluntary survey was sent to 611 radiation oncology residents practicing in the United States. Residents were asked about their gender-based experiences in terms of mentorship, their professional and learning environment, and their partnerships and personal life. RESULTS: A total of 203 participants submitted completed survey responses. Fifty-seven percent of respondents were men, and 43% were women, with a mean age of 31 years (standard deviation=3.7 years). Although residents in general value having a mentor, female residents prefer mentors of the same gender (P<.001), and noted having more difficulty finding a mentor (P=.042). Women were more likely to say that they have observed preferential treatment based on gender (P≤.001), and they were more likely to perceive gender-specific biases or obstacles in their professional and learning environment (P<.001). Women selected residency programs based on gender ratios (P<.001), and female residents preferred to see equal numbers of male and female faculty (P<.001). Women were also more likely to perceive work-related strain than their male counterparts (P<.001). CONCLUSIONS: Differences in experiences for male and female radiation oncology residents exist with regard to mentorship and in their professional and learning environment.

When the Mannequin Dies, Creation and Exploration of a Theoretical Framework Using a Mixed Methods Approach.

INTRODUCTION: Controversy exists in the simulation community as to the emotional and educational ramifications of mannequin death due to learner action or inaction. No theoretical framework to guide future investigations of learner actions currently exists. The purpose of our study was to generate a model of the learner experience of mannequin death using a mixed methods approach. METHODS: The study consisted of an initial focus group phase composed of 11 learners who had previously experienced mannequin death due to action or inaction on the part of learners as defined by Leighton (Clin Simul Nurs. 2009;5(2):e59-e62). Transcripts were analyzed using grounded theory to generate a list of relevant themes that were further organized into a theoretical framework. With the use of this framework, a survey was generated and distributed to additional learners who had experienced mannequin death due to action or inaction. Results were analyzed using a mixed methods approach. RESULTS: Forty-one clinicians completed the survey. A correlation was found between the emotional experience of mannequin death and degree of presession anxiety (P < 0.001). Debriefing was found to significantly reduce negative emotion and enhance satisfaction. Sixty-nine percent of respondents indicated that mannequin death enhanced learning. These results were used to modify our framework. CONCLUSIONS: Using the previous approach, we created a model of the effect of mannequin death on the educational and psychological state of learners. We offer the final model as a guide to future research regarding the learner experience of mannequin death.

Using simulation to address hierarchy-related errors in medical practice.

OBJECTIVE: Hierarchy, the unavoidable authority gradients that exist within and between clinical disciplines, can lead to significant patient harm in high-risk situations if not mitigated. High-fidelity simulation is a powerful means of addressing this issue in a reproducible manner, but participant psychological safety must be assured. Our institution experienced a hierarchy-related medication error that we subsequently addressed using simulation. The purpose of this article is to discuss the implementation and outcome of these simulations. METHODS: Script and simulation flowcharts were developed to replicate the case. Each session included the use of faculty misdirection to precipitate the error. Care was taken to assure psychological safety via carefully conducted briefing and debriefing periods. Case outcomes were assessed using the validated Team Performance During Simulated Crises Instrument. Gap analysis was used to quantify team self-insight. Session content was analyzed via video review. RESULTS: Five sessions were conducted (3 in the pediatric intensive care unit and 2 in the Pediatric Emergency Department). The team was unsuccessful at addressing the error in 4 (80%) of 5 cases. Trends toward lower communication scores (3.4/5 vs 2.3/5), as well as poor team self-assessment of communicative ability, were noted in unsuccessful sessions. Learners had a positive impression of the case. CONCLUSIONS: Simulation is a useful means to replicate hierarchy error in an educational environment. This methodology was viewed positively by learner teams, suggesting that psychological safety was maintained. Teams that did not address the error successfully may have impaired self-assessment ability in the communication skill domain.

A 16-month community-based intervention to increase aspirin use for primary prevention of cardiovascular disease.

INTRODUCTION: Cardiovascular diseases are the leading causes of disability and death in the United States. Primary prevention of these events may be achieved through aspirin use. The ability of a community-based intervention to increase aspirin use has not been evaluated. The objective of this study was to evaluate an educational intervention implemented to increase aspirin use for primary prevention of cardiovascular disease in a small city in Minnesota. METHODS: A community-based intervention was implemented during 16 months in a medium-sized community in Minnesota. Messages for aspirin use were disseminated to individuals, health care professionals, and the general population. Independent cross-sectional samples of residents (men aged 45-79, women aged 55-79) were surveyed by telephone to identify candidates for primary prevention aspirin use, examine their characteristics, and determine regular aspirin use at baseline and after the campaign at 4 months and 16 months. RESULTS: In primary prevention candidates, regular aspirin use rates increased from 36% at baseline to 54% at 4 months (odds ratio = 2.05; 95% confidence interval, 1.09-3.88); the increase was sustained at 52% at 16 months (odds ratio = 1.89; 95% confidence interval, 1.02-3.49). The difference in aspirin use rates at 4 months and 16 months was not significant (P = .77). CONCLUSION: Aspirin use rates for primary prevention remain low. A combined public health and primary care approach can increase and sustain primary prevention aspirin use in a community setting.

Case and commentary: using simulation to address hierarchy issues during medical crises.

SUMMARY STATEMENT: Medicine is hierarchical, and both positive and negative effects of this can be exposed and magnified during a crisis. Ideally, hierarchies function in an orderly manner, but when an inappropriate directive is given, the results can be disastrous unless team members are empowered to challenge the order. This article describes a case that uses misdirection and the possibility of simulated "death" to facilitate learning among experienced clinicians about the potentially deadly effects of an unchallenged, inappropriate order. The design of this case, however, raises additional questions regarding both ethics and psychological safety. The ethical concerns that surround the use of misdirection in simulation and the psychological ramifications of incorporating patient death in this context are explored in the commentary. We conclude with a discussion of debriefing strategies that can be used to promote psychological safety during potentially emotionally charged simulations and possible directions for future research.

A replicable model of a health literacy curriculum for a third-year clerkship.

Contrary to recommendations from national medical organizations, medical school education often fails to train students to interact effectively with patients with limited health literacy. The objectives of a new health literacy curriculum in a family medicine clerkship were to increase students' knowledge of health literacy and develop comfort with specific communication skills. Instructional strategies included lectures, practice with standardized patients (SPs), and a facilitated discussion board. At the end of the first year of the curriculum, there was a statistically significant increase in students' knowledge of health literacy. During the final testing with SPs, students achieved high scores for health literacy related communication skills. The curriculum is replicable at other universities and was an effective and efficient way for medical students to learn about health literacy and to acquire valuable skills to improve their patients' understanding of health information.

A multirater instrument for the assessment of simulated pediatric crises.

BACKGROUND: Few validated instruments exist to measure pediatric code team skills. The goal of this study was to develop an instrument for the assessment of resuscitation competency and self-appraisal using multirater and gap analysis methodologies. METHODS: Multirater assessment with gap analysis is a robust methodology that enables the measurement of self-appraisal as well as competency, offering faculty the ability to provide enhanced feedback. The Team Performance during Simulated Crises Instrument (TPDSCI) was grounded in the Accreditation Council for Graduate Medical Education competencies. The instrument contains 5 competencies, each assessed by a series of descriptive rubrics. It was piloted during a series of simulation-based interdisciplinary pediatric crisis resource management education sessions. Course faculty assessed participants, who also did self-assessments. Internal consistency and interrater reliability were analyzed using Cronbach α and intraclass correlation (ICC) statistics. Gap analysis results were examined descriptively. RESULTS: Cronbach α for the instrument was between 0.72 and 0.69. The overall ICC was 0.82. ICC values for the medical knowledge, clinical skills, communication skills, and systems-based practice were between 0.87 and 0.72. The ICC for the professionalism domain was 0.22. Further examination of the professionalism competency revealed a positive skew, 43 simulated sessions (98%) had significant gaps for at least one of the competencies, 38 sessions (86%) had gaps indicating self-overappraisal, and 15 sessions (34%) had gaps indicating self-underappraisal. CONCLUSIONS: The TPDSCI possesses good measures of internal consistency and interrater reliability with respect to medical knowledge, clinical skills, communication skills, systems-based practice, and overall competence in the context of simulated interdisciplinary pediatric medical crises. Professionalism remains difficult to assess. These results provide an encouraging first step toward instrument validation. Gap analysis reveals disparities between faculty and self-assessments that indicate inadequate participant self-reflection. Identifying self-overappraisal can facilitate focused interventions.