Spaced Repetition Flashcards for Teaching Medical Students Psychiatry.

OBJECTIVE: Retrieval practice, often using electronic flashcards, is increasingly utilized among medical students for self-study. In this study, the authors evaluated usage and satisfaction with electronic flashcards based on a medical school psychiatry curriculum. METHODS: First-year medical students at one institution consented to participate and received access to a set of pre-made flashcards. Surveys were distributed that collected demographic information along with measures of prior performance, test anxiety, and prior experience with electronic flashcards. The total number of flashcard reviews and time spent on the platform for each student were collected using statistics internally generated by the platform. Each student's final exam score was also collected. RESULTS: A total of 114 of 129 first year medical students (88%) consented to participate, and 101 students were included in the final analysis. Fifty-eight (56%) were flashcard users with a median of 660 flashcards studied over 2.95 h. A total of 87% of flashcard users found the flashcards to be helpful, and 83% of flashcard users would recommend the flashcards to someone else. Flashcard usage was not associated with final exam scores. CONCLUSIONS: This novel electronic study resource was well-received by first-year medical students for psychiatric instruction in medical school, though usage was not associated with higher exam scores.

Discontinuation of the USMLE Step 2 Clinical Skills Examination: Studying the Past to Define the Future.

The United States Medical Licensing Examination (USMLE) Step 2 Clinical Skills (CS) was discontinued in January 2021, marking a significant milestone in assessment of clinical skills. In this commentary, the authors trace the history of the Step 2 CS exam-beginning with its early roots in the 1960s up to its discontinuation in 2021. In this new era, the medical education community is replete with opportunities for advancing methodology and content associated with clinical skills assessment. The authors propose 3 main lessons gleaned from this rich history and modern evolution, which are aimed at defining a future that includes creative collaboration toward development of comprehensive, equitable, student-focused, and patient-centered clinical performance assessment. First, as it has done throughout history, the medical education community should continue to innovate, collaborate, and improve upon methods of clinical skills assessment. Second, medical educators should continue to shift to more complex and student-driven approaches of assessment, that is, assessments that provide an unstructured environment, are realistic with respect to the natural conditions, and do not limit students to lists of options or force them to take a certain path of reasoning. Third, medical educators should continue to rethink the role of assessment and ensure that all assessments, regardless of stakes or type, provide sufficient feedback for the student to identify areas of strength and weakness.

Evaluating the effectiveness of undergraduate clinical education programs.

Medical schools should use a variety of measures to evaluate the effectiveness of their clinical curricula. Both outcome measures and process measures should be included, and these can be organized according to the four-level training evaluation model developed by Donald Kirkpatrick. Managing evaluation data requires the institution to employ deliberate strategies to monitor signals in real-time and aggregate data so that informed decisions can be made. Future steps in program evaluation includes increased emphasis on patient outcomes and multi-source feedback, as well as better integration of existing data sources.

Communities of Practice in Peer Review: Outlining a Group Review Process.

Traditional peer review remains the gold standard for assessing the merit of scientific scholarship for publication. Challenges to this model include reliance on volunteer contributions of individuals with self-reported expertise; lack of sufficient mentoring and training of new reviewers; and the isolated, noncollaborative nature of individual reviewer processes.The authors participated in an Association of American Medical Colleges peer-review workshop in November 2015 and were intrigued by the process of group peer review. Subsequent discussions led to shared excitement about exploring this model further. The authors worked with the staff and editors of Academic Medicine to perform a group review of 4 submitted manuscripts, documenting their iterative process and analysis of outcomes, to define an optimal approach to performing group peer review.Individual recommendations for each manuscript changed as a result of the group review process. The group process led to more comprehensive reviews than each individual reviewer would have submitted independently. The time spent on group reviews decreased as the process became more refined. Recommendations aligned with journal editor findings. Shared operating principles were identified, as well as clear benefits of group peer review for reviewers, authors, and journal editors.The authors plan to continue to refine and codify an effective process for group peer review. They also aim to more formally evaluate the model, with inclusion of feedback from journal editors and authors, and to compare feedback from group peer reviews versus individual reviewer feedback. Finally, models for expansion of the group-peer-review process are proposed.

A Multi-Institution Collaboration to Define Core Content and Design Flexible Curricular Components for a Foundational Medical School Course: Implications for National Curriculum Reform.

Medical educators have not reached widespread agreement on core content for a U.S. medical school curriculum. As a first step toward addressing this, five U.S. medical schools formed the Robert Wood Johnson Foundation Reimagining Medical Education collaborative to define, create, implement, and freely share core content for a foundational medical school course on microbiology and immunology. This proof-of-concept project involved delivery of core content to preclinical medical students through online videos and class-time interactions between students and facilitators. A flexible, modular design allowed four of the medical schools to successfully implement the content modules in diverse curricular settings. Compared with the prior year, student satisfaction ratings after implementation were comparable or showed a statistically significant improvement. Students who took this course at a time point in their training similar to when the USMLE Step 1 reference group took Step 1 earned equivalent scores on National Board of Medical Examiners-Customized Assessment Services microbiology exam items. Exam scores for three schools ranged from 0.82 to 0.84, compared with 0.81 for the national reference group; exam scores were 0.70 at the fourth school, where students took the exam in their first quarter, two years earlier than the reference group. This project demonstrates that core content for a foundational medical school course can be defined, created, and used by multiple medical schools without compromising student satisfaction or knowledge. This project offers one approach to collaboratively defining core content and designing curricular resources for preclinical medical school education that can be shared.

Is it a match? a novel method of evaluating medical school success.

BACKGROUND: Medical education program evaluation allows for curricular improvements to both Undergraduate (UME) and Graduate Medical Education (GME). UME programs are left with little more than match rates and self-report to evaluate success of graduates in The Match. OBJECTIVE: This manuscript shares a novel method of program evaluation through a systematic assessment of Match outcomes. DESIGN: Surveys were developed and distributed to Program Training Directors (PTDs) at our institution to classify residency programs into which our UME graduates matched using an ordinal response scale and open-ended responses. Outcomes-based measures for UME graduates were collected and analyzed. The relationship between PTD survey data and UME graduates' outcomes were explored. Open-ended response data were qualitatively analyzed using iterative cycles of coding and identifying themes. RESULTS: The PTD survey response rate was 100%. 71% of our graduates matched to programs ranked as 'elite' (36%) or 'top' (35%) tier. The mean total number of 'Honors' grades achieved by UME graduates was 2.6. Data showed that graduates entering elite and top GME programs did not consistently earn Honors in their associated clerkships. A positive correlation was identified between USMLE Step 1 score, number of honors, and residency program rankings for a majority of the programs. Qualitative analysis identified research, faculty, and clinical exposure as necessary characteristics of 'elite' programs:. Factors considered by PTDs in the rating of programs included reputation, faculty, research, national presence and quality of graduates. CONCLUSIONS: This study describes a novel outcomes-based method of evaluating the success of UME programs. Results provided useful feedback about the quality of our UME program and its ability to produce graduates who match in highly-regarded GME programs. The findings from this study can benefit Clerkship Directors, Student Affairs and Curriculam Deans, and residency PTDs as they help students determine their competitiveness forspecialties and specific residency programs.

CaPOW! Using Problem Sets in a Capstone Course to Improve Fourth-Year Medical Students' Confidence in Self-Directed Learning.

PROBLEM: Despite the importance of self-directed learning (SDL) in the field of medicine, individuals are rarely taught how to perform SDL or receive feedback on it. Trainee skill in SDL is limited by difficulties with self-assessment and goal setting. APPROACH: Ninety-two graduating fourth-year medical students from Duke University School of Medicine completed an individualized learning plan (ILP) for a transition-to-residency Capstone course in spring 2015 to help foster their skills in SDL. Students completed the ILP after receiving a personalized report from a designated faculty coach detailing strengths and weaknesses on specific topics (e.g., pulmonary medicine) and clinical skills (e.g., generating a differential diagnosis). These were determined by their performance on 12 Capstone Problem Sets of the Week (CaPOWs) compared with their peers. Students used transitional-year milestones to self-assess their confidence in SDL. OUTCOMES: SDL was successfully implemented in a Capstone course through the development of required clinically oriented problem sets. Coaches provided guided feedback on students' performance to help them identify knowledge deficits. Students' self-assessment of their confidence in SDL increased following course completion. However, students often chose Capstone didactic sessions according to factors other than their CaPOW performance, including perceived relevance to planned specialty and session timing. NEXT STEPS: Future Capstone curriculum changes may further enhance SDL skills of graduating students. Students will receive increased formative feedback on their CaPOW performance and be incentivized to attend sessions in areas of personal weakness.

Expanding Group Peer Review: A Proposal for Medical Education Scholarship.

After participating in a group peer-review exercise at a workshop presented by Academic Medicine and MedEdPORTAL editors at the 2015 Association of American Medical Colleges Medical Education Meeting, the authors realized that the way their work group reviewed a manuscript was very different from the way by which they each would have reviewed the paper as an individual. Further, the group peer-review process yielded more robust feedback for the manuscript's authors than did the traditional individual peer-review process. This realization motivated the authors to reconvene and collaborate to write this Commentary to share their experience and propose the expanded use of group peer review in medical education scholarship.The authors consider the benefits of a peer-review process for reviewers, including learning how to improve their own manuscripts. They suggest that the benefits of a team review model may be similar to those of teamwork and team-based learning in medicine and medical education. They call for research to investigate this, to provide evidence to support group review, and to determine whether specific paper types would benefit most from team review (e.g., particularly complex manuscripts, those receiving widely disparate initial individual reviews). In addition, the authors propose ways in which a team-based approach to peer review could be expanded by journals and institutions. They believe that exploring the use of group peer review potentially could create a new methodology for skill development in research and scholarly writing and could enhance the quality of medical education scholarship.

From the coliseum to the convention centre: a reflection on the current state of medical education conferences and conference-goers.

The advancement of knowledge and development of policy in the field of medical education require critical academic discourse among the most intelligent medical educators; and critical academic discourse requires coffee. In this essay, we reflect on the state of professional development conferences in the field of medical education and the rituals that surround their success. Having begun in ancient Greece, symposia were ripe with debauchery. Today, sedated by the light brown walls of hotel conference centres, symposia are more serious endeavours, engaging men and women in the sometimes turbulent waters of epistemological debate. The abstract submission process (summed up by: 'Yay! It was accepted for presentation' [Deep breath] 'Oh no…it was accepted for presentation'), the 'juggling act' of parent attendees, the acting prowess of abstract presenters and the unapologetic approach to buffet eating are all by-products of the collision of true intellects among medical education scholars. We hold these rituals in high regard and argue that they are required to advance the field of medical education. These rituals bind the walls supporting true progressive thought and innovative research, all fuelled by the glass of wine purchased with that one coveted drink ticket.

Mystery behind the match: an undergraduate medical education-graduate medical education collaborative approach to understanding match goals and outcomes.

BACKGROUND: There is a paucity of information regarding institutional targets for the number of undergraduate medical education (UME) graduates being matched to graduate medical education (GME) programs at their home institutions. At our institution, the Duke University, the number of UME graduates matched to GME programs declined dramatically in 2011. To better understand why this decline may have happened, we sought to identify perceived quality metrics for UME and GME learners, evaluate trends in match outcomes and educational program characteristics, and explore whether there is an ideal retention rate for UME graduates in their home institutions' GME programs. METHODS: We analyzed the number of Duke University UME graduates remaining at Duke for GME training over the past 5 years. We collected data to assess for changing characteristics of UME and GME, and performed descriptive analysis of trends over time to investigate the potential impact on match outcomes. RESULTS: A one-sample t-test analysis showed no statistically significant difference in the number of Duke UME graduates who stayed for GME training. For both UME and GME, no significant changes in the characteristics of either program were found. DISCUSSION: We created a process for monitoring data related to the characteristics or perceived quality of UME and GME programs and developed a shared understanding of what may impact match lists for both UME graduates and GME programs, leaving the Match somewhat less mysterious. While we understand the trend of graduates remaining at their home institutions for GME training, we are uncertain whether setting a goal for retention is reasonable, and so some mystery remains. We believe there is an invaluable opportunity for collaboration between UME and GME stakeholders to facilitate discussion about setting shared institutional goals.

A meaningful MESS (Medical Education Scholarship Support).

BACKGROUND: Graduate medical education faculty bear the responsibility of demonstrating active research and scholarship; however, faculty who choose education-focused careers may face unique obstacles related to the lack of promotion tracks, funding, career options, and research opportunities. Our objective was to address education research and scholarship barriers by providing a collaborative peer-mentoring environment and improve the production of research and scholarly outputs. METHODS: We describe a Medical Education Scholarship Support (MESS) group created in 2013. MESS is an interprofessional, multidisciplinary peer-mentoring education research community that now spans multiple institutions. This group meets monthly to address education research and scholarship challenges. Through this process, we develop new knowledge, research, and scholarly products, in addition to meaningful collaborations. RESULTS: MESS originated with eight founding members, all of whom still actively participate. MESS has proven to be a sustainable unfunded local community of practice, encouraging faculty to pursue health professions education (HPE) careers and fostering scholarship. We have met our original objectives that involved maintaining 100% participant retention; developing increased knowledge in at least seven content areas; and contributing to the development of 13 peer-reviewed publications, eight professional presentations, one Masters of Education project, and one educational curriculum. DISCUSSION: The number of individuals engaged in HPE research continues to rise. The MESS model could be adapted for use at other institutions, thereby reducing barriers HPE researchers face, providing an effective framework for trainees interested in education-focused careers, and having a broader impact on the education research landscape.

Teaching crucial skills: An electrocardiogram teaching module for medical students.

BACKGROUND: Medical student performance in electrocardiogram (ECG) interpretation at our institution could be improved. Varied resources exist to teach students this essential skill. METHODS: We created an ECG teaching module (ECGTM) of 75 cases representing 15 diagnoses to improve medical students' performance and confidence in ECG interpretation. Students underwent pre- and post-clerkship testing to assess ECG interpretation skills and confidence and also end-of-clinical-year testing in ECG and laboratory interpretation. Performance was compared for the years before and during ECGTM availability. RESULTS: Eighty-four percent of students (total n=101) reported using the ECGTM; 98% of those who used it reported it was useful. Students' performance and confidence were higher on the post-test. Students with access to the ECGTM (n=101) performed significantly better than students from the previous year (n=90) on the end-of-year ECG test. CONCLUSIONS: The continuous availability of an ECGTM was associated with improved confidence and ability in ECG interpretation. The ECGTM may be another available tool to help students as they learn to read ECGs.

How We Engage Graduating Professional Students in Interprofessional Patient Safety.

PROBLEM: Interprofessional curricula on patient safety do not acknowledge the culture and vulnerabilities of the student experience and often do not engage students. METHODS: We describe a patient safety collaboration between graduating nursing and medical students during their Capstone courses that fostered conversations about the similarities and differences in professional school experiences around patient safety. Students wrote reflections about an unanticipated patient outcome. Qualitative content analysis was used to characterize themes within student reflections, and to create audience response system questions to highlight differences in each profession's reflections and to facilitate discussion about those differences during the collaboration. FINDINGS: Medical students identified events in which perceived patient outcomes were worse than events identified by nursing students. Nursing students identified more near-miss events. Nursing students positively impacted the event and attributed action to the presence of a clinical instructor and personal responsibility for patient care. Medical students described themselves as "only a witness" and attributed inaction to hierarchy and concern about grades. CONCLUSIONS: Students felt the session would change their future attitudes and behaviors. Stevenson Chudgar Molloy Phillips Engle Clay.

Using Transitional Year Milestones to Assess Graduating Medical Students' Skills During a Capstone Course.

BACKGROUND: Undergraduate medical education (UME) follows the lead of graduate medical education (GME) in moving to competency-based assessment. The means for and the timing of competency-based assessments in UME are unclear. OBJECTIVE: We explored the feasibility of using the Accreditation Council for Graduate Medical Education Transitional Year (TY) Milestones to assess student performance during a mandatory, fourth-year capstone course. METHODS: Our single institution, observational study involved 99 medical students who completed the course in the spring of 2014. Students' skills were assessed by self, peer, and faculty assessment for 6 existing course activities using the TY Milestones. Evaluation completion rates and mean scores were calculated. RESULTS: Students' mean milestone levels ranged between 2.2 and 3.6 (on a 5-level scoring rubric). Level 3 is the performance expected at the completion of a TY. Students performed highest in breaking bad news and developing a quality improvement project, and lowest in developing a learning plan, working in interdisciplinary teams, and stabilizing acutely ill patients. Evaluation completion rates were low for some evaluations, and precluded use of the data for assessing student performance in the capstone course. Students were less likely to complete separate online evaluations. Faculty were less likely to complete evaluations when activities did not include dedicated time for evaluations. CONCLUSIONS: Assessment of student competence on 9 TY Milestones during a capstone course was useful, but achieving acceptable evaluation completion rates was challenging. Modifications are necessary if milestone scores from a capstone are intended to be used as a handoff between UME and GME.

The Impact of a Mandatory Immersion Curriculum in Integrative Medicine for Graduating Medical Students.

BACKGROUND: Although many Americans utilize complementary and alternative medicine (CAM) services and products, few medical school curricula consistently provide instruction in counseling patients on the use of CAM or strategies for identifying credible evidence on the safety and effectiveness of CAM therapies. METHODS: This is a mixed methods study. A sustainable, mandatory, half-day CAM immersion curriculum for graduating medical students is described. Student comfort talking with patients about CAM, their willingness to refer patients to a CAM provider, and adequacy of the CAM curriculum was assessed. RESULTS: Students who participated in this mandatory curriculum, rated the medical school curriculum in CAM as more adequate than students at other medical schools without a mandatory curriculum. Students' narrative comments indicate the curriculum impacts students knowledge about CAM, patient use of CAM, and personal practice with CAM in the future. CONCLUSIONS: The timing of the CAM curriculum near to graduation, students' personal exploration of several CAM modalities through immersion, and student interaction with community CAM providers are aspects of the curriculum that make the curriculum successful and memorable.

A comparison of the effectiveness of the team-based learning readiness assessments completed at home to those completed in class.

PURPOSE: The readiness assurance process (RAP) of team-based learning (TBL) is an important element that ensures that students come prepared to learn. However, the RAP can use a significant amount of class time which could otherwise be used for application exercises. The authors administered the TBL-associated RAP in class or individual readiness assurance tests (iRATs) at home to compare medical student performance and learning preference for physiology content. METHODS: Using cross-over study design, the first year medical student TBL teams were divided into two groups. One group was administered iRATs and group readiness assurance tests (gRATs) consisting of physiology questions during scheduled class time. The other group was administered the same iRAT questions at home, and did not complete a gRAT. To compare effectiveness of the two administration methods, both groups completed the same 12-question physiology assessment during dedicated class time. Four weeks later, the entire process was repeated, with each group administered the RAP using the opposite method. RESULTS: The performance on the physiology assessment after at-home administration of the iRAT was equivalent to performance after traditional in-class administration of the RAP. In addition, a majority of students preferred the at-home method of administration and reported that the at-home method was more effective in helping them learn course content. CONCLUSION: The at-home administration of the iRAT proved effective. The at-home administration method is a promising alternative to conventional iRATs and gRATs with the goal of preserving valuable in-class time for TBL application exercises.

Effect of vitamin E on tamoxifen-treated breast cancer cells.

BACKGROUND: Induction of apoptosis by tamoxifen has been postulated to involve oxidative stress. Tamoxifen (TAM) may act on estrogen receptors (ER) located in the plasma membrane. Our hypothesis that supplemental antioxidant vitamin E (alpha-tocopherol) acts at the plasma membrane to alter the effectiveness of tamoxifen was tested in ER-positive breast cancer cell lines, MCF-7 and T47D. METHODS: Cells were treated in vitro with 20-muM TAM alone and in combination with 10-muM alpha-tocopherol (AT). Estrogen growth signals were quantified by immunohistochemical staining for the mitogen-activated protein kinase p-ERK. Rapid changes in intracellular calcium were detected in TAM-treated MCF-7 and T-47D cells by fluorescence microscopy of cells loaded with the calcium-sensitive dye Fluo 4AM. Apoptosis was assayed by flow cytometry. RESULTS: Proliferating cells in normal medium exhibited strong p-ERK staining. Addition of TAM abolished p-ERK staining and caused cell rounding and death. The addition of AT led to the restoration of cell proliferation and p-ERK expression even in the presence of high-dose TAM. Intracellular calcium rapidly increased in MCF-7 and T47D cells upon exposure to TAM, followed by an increase in caspase activation and eventual apoptosis. The increase in intracellular calcium was abolished by the addition of 10muM AT to TAM, and pan-caspase staining decreased at 5 hours from 72% to 41%. CONCLUSIONS: These studies suggest that supplemental vitamin E decreases the inhibitory effect of TAM on the proliferation of ER+ breast cancer cells and eliminates the rapid rise in intracellular calcium that leads to apoptosis stimulated by TAM. The use of vitamin E acetate supplements may be inadvisable for women taking tamoxifen.