Assessment of Clinical Reasoning in Undergraduate Medical Education: A Pragmatic Approach to Programmatic Assessment.

PURPOSE: Clinical reasoning, a complex construct integral to the practice of medicine, has been challenging to define, teach, and assess. Programmatic assessment purports to overcome validity limitations of judgments made from individual assessments through proportionality and triangulation processes. This study explored a pragmatic approach to the programmatic assessment of clinical reasoning. METHOD: The study analyzed data from 2 student cohorts from the University of Utah School of Medicine (UUSOM) (n = 113 in cohort 1 and 119 in cohort 2) and 1 cohort from the University of Colorado School of Medicine (CUSOM) using assessment data that spanned from 2017 to 2021 (n = 199). The study methods included the following: (1) asking faculty judges to categorize student clinical reasoning skills, (2) selecting institution-specific assessment data conceptually aligned with clinical reasoning, (3) calculating correlations between assessment data and faculty judgments, and (4) developing regression models between assessment data and faculty judgments. RESULTS: Faculty judgments of student clinical reasoning skills were converted to a continuous variable of clinical reasoning struggles, with mean (SD) ratings of 2.93 (0.27) for the 232 UUSOM students and 2.96 (0.17) for the 199 CUSOM students. A total of 67 and 32 discrete assessment variables were included from the UUSOM and CUSOM, respectively. Pearson r correlations were moderate to strong between many individual and composite assessment variables and faculty judgments. Regression models demonstrated an overall adjusted R2 (standard error of the estimate) of 0.50 (0.19) for UUSOM cohort 1, 0.28 (0.15) for UUSOM cohort 2, and 0.30 (0.14) for CUSOM. CONCLUSIONS: This study represents an early pragmatic exploration of regression analysis as a potential tool for operationalizing the proportionality and triangulation principles of programmatic assessment. The study found that programmatic assessment may be a useful framework for longitudinal assessment of complicated constructs, such as clinical reasoning.

Physician reentry-A timely topic for emergency medicine.

As physician workforce shortages persist, physician reentry is an important and timely issue for the specialty of emergency medicine. Physician reentry is defined as a return to clinical practice following an extended period of clinical inactivity not resulting from discipline or impairment. This review provides a general overview of the physician reentry published literature with a focus on the specialty of emergency medicine. Transition into a non-clinical position, personal health, family issues, and career dissatisfaction all contribute to physicians leaving the workforce voluntarily. Previously, the majority of reentry physicians did not pursue additional training prior to returning to the workforce; however, regulatory agencies are now increasingly requiring additional training, standardized testing, and fitness to practice evaluations prior to restarting clinical work. The burden of proof is on the reentry physician to meet the appropriate requirements for licensure, certification, and credentialing prior to returning to clinical work.

Impact of a Dedicated Teaching Attending Experience on a Required Emergency Medicine Clerkship.

INTRODUCTION: One published strategy for improving educational experiences for medical students in the emergency department (ED) while maintaining patient care has been the implementation of dedicated teaching attending shifts. To leverage the advantages of the ED as an exceptional clinical educational environment and to address the challenges posed by the rapid pace and high volume of the ED, our institution developed a clerkship curriculum that incorporates a dedicated clinical educator role - the teaching attending - to deliver quality bedside teaching experiences for students in a required third-year clerkship. The purpose of this educational innovation was to determine whether a dedicated teaching attending experience on a third-year required emergency medicine (EM) clerkship would improve student-reported clinical teaching evaluations and student-reported satisfaction with the overall quality of the EM clerkship. METHODS: Using a five-point Likert-type scale (1 - poor to 5 - excellent), student-reported evaluation ratings and the numbers of graduating students matching into EM were trended for 10 years retrospectively from the inception of the clerkship for the graduating class of 2009 through and including the graduating class of 2019. We used multinomial logistic regression to evaluate whether the presence of a teaching attending during the EM clerkship improved student-reported evaluation ratings for the EM clerkship. We used sample proportion tests to assess the differences between top-box (4 or 5 rating) proportions between years when the teaching attending experience was present and when it was not. RESULTS: For clinical teaching quality, when the teaching attending is present the estimated odds of receiving a rating of 5 is 77.2 times greater (p <0.001) than when the teaching attending is not present and a rating of 4 is 27.5 times greater (p =0.0017). For overall clerkship quality, when the teaching attending is present, the estimated odds of receiving a rating of 5 is 13 times greater (p <0.001) and a rating of 4 is 5.2 times greater (p=0.0086) than when the teaching attending is not present. CONCLUSION: The use of a dedicated teaching attending shift is a successful educational innovation for improving student self-reported evaluation items in a third-year required EM clerkship.

Creating a Cadre of Fellowship-Trained Medical Educators, Part II: A Formal Needs Assessment to Structure Postgraduate Fellowships in Medical Education Scholarship and Leadership.

PURPOSE: Education leaders at the 2012 Academic Emergency Medicine Consensus Conference on education research proposed that dedicated postgraduate education scholarship fellowships (ESFs) might provide an effective model for developing future faculty as scholars. A formal needs assessment was performed to understand the training gap and inform the development of ESFs. METHOD: A mixed-methods needs assessment was conducted of four emergency medicine national stakeholder groups in 2013: department chairs; faculty education/research leaders; existing education fellowship directors; and current education fellows/graduates. Descriptive statistics were reported for quantitative data. Qualitative data from semistructured interviews and free-text responses were analyzed using a thematic approach. RESULTS: Participants were 11/15 (73%) education fellowship directors, 13/20 (65%) fellows/graduates, 106/239 (44%) faculty education/research leaders, and a convenience sample of 26 department chairs. Department chairs expected new education faculty to design didactics (85%) and teach clinically (96%). Faculty education/research leaders thought new faculty were inadequately prepared for job tasks (83.7%) and that ESFs would improve the overall quality of education research (91.1%). Fellowship directors noted that ESFs provide skills, mentorship, and protected time for graduates to become productive academicians. Current fellows/graduates reported pursing an ESF to develop skills in teaching and research methodology. CONCLUSIONS: Stakeholder groups uniformly perceived a need for training in education theory, clinical teaching, and education research. These findings support dedicated, deliberate training in these areas. Establishment of a structure for scholarly pursuits prior to assuming a full-time position will effectively prepare new faculty. These findings may inform the development, implementation, and curricula of ESFs.

Creating a Cadre of Fellowship-Trained Medical Educators: A Qualitative Study of Faculty Development Program Leaders' Perspectives and Advice.

PURPOSE: Well-trained educators fill essential roles across the medical education continuum. Some medical schools offer programs for existing faculty to enhance teaching and scholarship. No standard postgraduate training model exists for residency graduates to attain competency as faculty members before their first academic appointment. The objective of this study is to inform the development of postgraduate medical education fellowships by exploring perceptions of educational leaders who direct well-established faculty development programs. METHOD: The authors undertook a qualitative study, using purposeful sampling to recruit participants and a constant comparative approach to identify themes. They conducted semistructured telephone interviews with directors of faculty development fellowships using an interpretivist/constructivist paradigm (November 2013). Questions addressed curricular and fiscal structure, perceived benefits and challenges, and advice for starting a postgraduate fellowship. RESULTS: Directors reported institutional and participant benefits, notably the creation of a community of educators and pool of potential leaders. Curricular offerings focused on learning theory, teaching, assessment, leadership, and scholarship. Funding and protected time were challenges. Advice for new program directors included evaluating best practices, defining locally relevant goals; garnering sufficient, stable financial support; and rallying leaders' endorsement. CONCLUSIONS: Medical education fellowships cultivate leaders and communities of trained educators but require participants to balance faculty responsibilities with professional development. Advice of current directors can inform the development of postgraduate programs modeled after accredited clinical specialty fellowships. Programs with the support of strategic partners, financial stability, and well-defined goals may allow new faculty to begin their careers with existing competency in medical education skills.

A suggested core content for education scholarship fellowships in emergency medicine.

A working group at the 2012 Academic Emergency Medicine consensus conference on education research in emergency medicine (EM) convened to develop a curriculum for dedicated postgraduate fellowships in EM education scholarship. This fellowship is intended to create future education scholars, equipped with the skills to thrive in academic careers. This proceedings article reports on the consensus of a breakout session subgroup tasked with defining a common core content for education scholarship fellowships. The authors propose that the core content of an EM education scholarship fellowship can be categorized in four distinct areas: career development, theories of learning and teaching methods, education research methods, and educational program administration. This core content can be incorporated into curricula for education scholarship fellowships in EM or other fields and can also be adapted for use in general medical education fellowships.