Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias.

BACKGROUND: The COVID-19 pandemic in parallel with concerns about bias in grading resulted in many medical schools adopting pass/fail clinical grading and relying solely on narrative assessments. However, narratives often contain bias and lack specificity. The purpose of this project was to develop asynchronous faculty development to rapidly educate/re-educate > 2000 clinical faculty spread across geographic sites and clinical disciplines on components of a well-written narrative and methods to minimize bias in the assessment of students. METHODS: We describe creation, implementation, and pilot data outcomes for an asynchronous faculty development curriculum created by a committee of volunteer learners and faculty. After reviewing the literature on the presence and impact of bias in clinical rotations and ways to mitigate bias in written narrative assessments, the committee developed a web-based curriculum using multimedia learning theory and principles of adult learning. Just-in-time supplemental materials accompanied the curriculum. The Dean added completion of the module by 90% of clinical faculty to the department chairperson's annual education metric. Module completion was tracked in a learning management system, including time spent in the module and the answer to a single text entry question about intended changes in behavior. Thematic analysis of the text entry question with grounded theory and inductive processing was used to define themes of how faculty anticipate future teaching and assessment as a result of this curricula. OUTCOMES: Between January 1, 2021, and December 1, 2021, 2166 individuals completed the online module; 1820 spent between 5 and 90 min on the module, with a median time of 17 min and an average time of 20.2 min. 15/16 clinical departments achieved completion by 90% or more faculty. Major themes included: changing the wording of future narratives, changing content in future narratives, and focusing on efforts to change how faculty teach and lead teams, including efforts to minimize bias. CONCLUSIONS: We developed a faculty development curriculum on mitigating bias in written narratives with high rates of faculty participation. Inclusion of this module as part of the chair's education performance metric likely impacted participation. Nevertheless, time spent in the module suggests that faculty engaged with the material. Other institutions could easily adapt this curriculum with provided materials.

Development of a curricular thread to foster medical students' critical reflection and promote action on climate change, health, and equity.

INTRODUCTION: Due to the health consequences arising from climate change, medical students will inevitably interact with affected patients during their training and careers. Accordingly, medical schools must incorporate education on the impacts of climate change on health and equity into their curricula. We created a curricular thread called "Climate Change, Health, and Equity" in the first-year preclinical medical program to teach foundational concepts and foster self-reflection and critical consciousness. METHODS: The authors developed a continuum of practice including administrators, educators and faculty members, students, and community partners to plan and design curricular activities. First-year medical students at Duke University School of Medicine participated in seven mandatory foundational lectures and two experiential learning opportunities in the local community. Following completion of activities, students wrote a critical reflection essay and completed a self-directed learning exercise. Essays were evaluated using the REFLECT rubric to assess if students achieved critical reflection and for thematic analysis by Bloom's Taxonomy. RESULTS: All students (118) submitted essays. A random sample of 30 (25%) essays underwent analysis. Evaluation by the REFLECT rubric underscored that all students were reflecting or critically reflecting on thread content. Thematic analysis highlighted that all students (30/30, 100%) were adept at identifying new areas of medical knowledge and connecting concepts to individual experiences, institutional practices, and public health and policy. Most students (27/30; 90%) used emotionally laden words, expressing negative feelings like frustration and fear but also positive sentiments of solidarity and hope regarding climate change and effects on health. Many students (24/30; 80%) expressed actionable items at every level including continuing self-directed learning and conversing with patients, minimizing healthcare waste, and advocating for climate-friendly policies. CONCLUSION: After participating in the curricular thread, most medical students reflected on cognitive, affective, and actionable aspects relating to climate change, health, and equity.

Seeing is Believing: Inclusion of Biomedical Scientist Educators as Observers on Clinical Rounds.

Increasingly, medical school curricula seek to integrate the biomedical and clinical sciences. Inclusion of the basic sciences into the clinical curricula is less robust than including clinical content early in medical school. We describe inclusion of biomedical scientists on patient care rounds to increase the visibility of biomedical sciences, to nurture relationships between clinicians and biomedical scientists, and to identify additional opportunities for integration throughout medical school.

Interprofessional Substance Use Disorder Education in Health Professions Education Programs: A Scoping Review.

PURPOSE: The authors conducted this scoping review to (1) provide a comprehensive evaluation and summation of published literature reporting on interprofessional substance use disorder (SUD) education for students in health professions education programs and (2) appraise the research quality and outcomes of interprofessional SUD education studies. Their goals were to inform health professions educators of interventions that may be useful to consider as they create their own interprofessional SUD courses and to identify areas of improvement for education and research. METHOD: The authors searched 3 Ovid MEDLINE databases (MEDLINE, In-Process & Other Non-Indexed Citations, and Epub Ahead of Print), Embase.com, ERIC via FirstSearch, and Clarivate Analytics Web of Science from inception through December 7, 2018. The authors used the Medical Education Research Study Quality Instrument (MERSQI) to assess included studies' quality. RESULTS: The authors screened 1,402 unique articles, and 14 met inclusion criteria. Publications dated from 2014 to 2018. Ten (71%) included students from at least 3 health professions education programs. The mean MERSQI score was 10.64 (SD = 1.73) (range, 7.5-15). Interventions varied by study, and topics included general substance use (n = 4, 29%), tobacco (n = 4, 29%), alcohol (n = 3, 21%), and opioids (n = 3, 21%). Two studies (14%) used a nonrandomized 2-group design. Four (29%) included patients in a clinical setting or panel discussion. Ten (72%) used an assessment tool with validity evidence. Studies reported interventions improved students' educational outcomes related to SUDs and/or interprofessionalism. CONCLUSIONS: Interprofessional SUD educational interventions improved health professions students' knowledge, skills, and attitudes toward SUDs and interprofessional collaboration. Future SUD curriculum design should emphasize assessment and measure changes in students' behaviors and patient or health care outcomes. Interprofessional SUD education can be instrumental in preparing the future workforce to manage this pressing and complex public health threat.

One Small Step for Step 1.

Step 1 of the United States Medical Licensing Examination (USMLE) is a multiple-choice exam primarily measuring knowledge about foundational sciences and organ systems. The test was psychometrically designed as pass/fail for licensing boards to decide whether physician candidates meet minimum standards they deem necessary to obtain the medical licensure necessary to practice. With an increasing number of applicants to review, Step 1 scores are commonly used by residency program directors to screen applicants, even though the exam was not intended for this purpose. Elsewhere in this issue, Chen and colleagues describe the "Step 1 climate" that has evolved in undergraduate medical education, affecting learning, diversity, and well-being.Addressing issues related to Step 1 is a challenge. Various stakeholders frequently spend more time demonizing one another rather than listening, addressing what lies under their respective control, and working collaboratively toward better long-term solutions. In this Invited Commentary, the author suggests how different constituencies can act now to improve this situation while aspirational future solutions are developed.One suggestion is to report Step 1 and Step 2 Clinical Knowledge scores as pass/fail and Step 2 Clinical Skills scores numerically. Any changes must be carefully implemented in a way that is mindful of the kind of unintended consequences that have befallen Step 1. The upcoming invitational conference on USMLE scoring (InCUS) will bring together representatives from all stakeholders. Until there is large-scale reform, all stakeholders should commit to taking (at least) one small step toward fixing Step 1 today.

A Framework for Resident Participation in Population Health.

Population health experiences have become more common in medical education. Yet, most resident population health experiences are in patient panel management and fail to connect with the rapidly growing movement of cross-sector, data-driven, and community-led initiatives dedicated to improving the health of populations defined by geography rather than insurer or employer. In this Perspective, the authors present a five-stage framework for residents' participation in the work of these initiatives. The five stages of this framework are (1) organize and prepare, (2) plan and prioritize, (3) implement, (4) monitor and evaluate, and (5) sustain. In applying this approach, residents stand to acquire new population health skills and augment the value and meaning of their work, while institutions stand to improve the health of the communities they serve, including the health of their own employees. However, a paucity of experienced role models and demanding residency schedules present significant challenges to residents effectively partnering with the community. Residencies and institutions will have to be flexible and committed to being a part of these cross-sector, data-driven, and community-led partnerships over the long term.

An Interprofessional Substance Use Disorder Course to Improve Students' Educational Outcomes and Patients' Treatment Decisions.

PURPOSE: Substance use is a public health concern. Health professions organizations recommend improvements in substance use disorder (SUD) education. Mezirow's transformative learning theory was used as the educational framework to develop a course that would provide students with opportunities to improve their understanding of SUDs; to assess, challenge, and reflect on their attitudes toward patients with SUDs; to receive direct observation, assessment, and feedback on behavior change counseling; and to engage in interprofessional education. The study's purpose was to evaluate the impact of an interprofessional SUD course on students' educational outcomes and their attitudes toward interprofessionalism. METHOD: Students from several health professions-medicine, pharmacy, physician assistant, nursing, and social work-attended a monthly interprofessional education SUD course starting in spring 2018. The course, taught by an interprofessional faculty, consisted of 4 interactive classes focused on empathy and recognizing personal bias; behavioral change counseling; and recognition, screening, and treatment of SUDs. Students attended a 12-step recovery meeting and had an optional opportunity to counsel a patient using behavioral change counseling. RESULTS: Seventy-eight students completed the course. Students demonstrated significant improvements in their attitudes toward patients with SUDs and toward interprofessionalism, as measured by the Substance Abuse Attitude Survey and the Student Perceptions of Interprofessional Clinical Education survey. Nearly 70% of students counseled a patient with an SUD, and 93% of counseled patients agreed to follow-up care. CONCLUSIONS: The course (1) enriched students' understanding, attitudes, and behaviors toward patients with SUDs and toward interprofessional collaboration and (2) positively influenced patients' treatment decisions.

A Timely Problem: Parental Leave During Medical Training.

Shifting demographics and concerns about burnout prevention merit a reexamination of existing structures and policies related to leaves of absence that may be necessary during medical training. In this Invited Commentary, the authors address the issue of parental leave for medical students and residents. Discussion about parental leave for these trainees is not new. Despite decades of dialogue, leave policies throughout the undergraduate and graduate medical education continuum lack standardization and are currently ill defined and inadequate. There are a number of barriers to implementation. These include stigma, financial concerns, workforce and duty hours challenges, and the historically rigid timeline for progression from one stage of medical training to the next. Potential solutions include parent-friendly curricular innovations, competency-based medical education, and provision of short-term disability insurance. Most important, adopting more flexible approaches to graduation requirements and specialty board examination eligibility must be addressed at the national level. The authors identify cultural and practical challenges to standardizing parental leave options across the medical education continuum and issue a call to action for implementing potential solutions.

Physician Well-Being: Organizational Strategies for Physician Burnout.

Until recently, most initiatives to address physician burnout have focused on improving the resilience of individual physicians. These measures are necessary but insufficient since it is now recognized that organizations have a major role in causing, preventing, and mitigating physician burnout. Burnout must be addressed by organizational change. The first steps to improving clinician well-being are measurement and monitoring. Several validated scales are available to assess well-being. Results of assessments can be used to engage clinicians in open conversations on issues and potential solutions. Specific leadership behaviors and positive organizational cultures decrease burnout and enhance engagement. There must be an institutional commitment to enhancing physician autonomy and transparent communication, improving the meaning of work, reducing administrative and regulatory burdens, and reducing the stigma related to seeking care.

An Interprofessional Course on Substance Use Disorders for Health Professions Students.

PROBLEM: Substance use disorders (SUDs) affect millions of Americans. Nevertheless, there is insufficient health care resource allocation for these patients. One reason may be the lack of education and training about SUDs in health professions programs. APPROACH: The authors developed a required, interprofessional SUDs course for health professions students completing a one-month psychiatry clerkship within the Duke University Health System starting in November 2015. Students participated in six 1-hour class sessions led by an interdisciplinary faculty. Sessions focused on core areas in SUDs education and used either a lecture with discussion or a small-group team-based learning format. Students completed one motivational interview, attended a 12-step recovery meeting, and wrote a reflection paper. On the first and last day of the clerkship, students measured their attitudes toward individuals with SUDs using the Substance Abuse Attitude Scale (SAAS) and toward interprofessionalism using the Interprofessional Attitudes Scale (IPAS). OUTCOMES: Seventy-one students participated in the course from November 2015 to May 2016. Fifty-nine (83%) students had paired pre- and postcourse SAAS and IPAS data. On the SAAS, students showed significant improvement in their median total score and nonmoralizing, treatment optimism, and treatment intervention scores. On the IPAS, students showed significant improvement in their median score on the teamwork, roles, and responsibilities domain. NEXT STEPS: The authors will continue to assess the course. Starting in academic year 2016-2017, the course will include four additional elements, and beginning in July 2016, accelerated bachelor of science in nursing students will participate in the course.

Developing a model for effective leadership in healthcare: a concept mapping approach.

PURPOSE: Despite increasing awareness of the importance of leadership in healthcare, our understanding of the competencies of effective leadership remains limited. We used a concept mapping approach (a blend of qualitative and quantitative analysis of group processes to produce a visual composite of the group's ideas) to identify stakeholders' mental model of effective healthcare leadership, clarifying the underlying structure and importance of leadership competencies. METHODS: Literature review, focus groups, and consensus meetings were used to derive a representative set of healthcare leadership competency statements. Study participants subsequently sorted and rank-ordered these statements based on their perceived importance in contributing to effective healthcare leadership in real-world settings. Hierarchical cluster analysis of individual sortings was used to develop a coherent model of effective leadership in healthcare. RESULTS: A diverse group of 92 faculty and trainees individually rank-sorted 33 leadership competency statements. The highest rated statements were "Acting with Personal Integrity", "Communicating Effectively", "Acting with Professional Ethical Values", "Pursuing Excellence", "Building and Maintaining Relationships", and "Thinking Critically". Combining the results from hierarchical cluster analysis with our qualitative data led to a healthcare leadership model based on the core principle of Patient Centeredness and the core competencies of Integrity, Teamwork, Critical Thinking, Emotional Intelligence, and Selfless Service. CONCLUSION: Using a mixed qualitative-quantitative approach, we developed a graphical representation of a shared leadership model derived in the healthcare setting. This model may enhance learning, teaching, and patient care in this important area, as well as guide future research.

CaPOW! Using Problem Sets in a Capstone Course to Improve Fourth-Year Medical Students' Confidence in Self-Directed Learning.

PROBLEM: Despite the importance of self-directed learning (SDL) in the field of medicine, individuals are rarely taught how to perform SDL or receive feedback on it. Trainee skill in SDL is limited by difficulties with self-assessment and goal setting. APPROACH: Ninety-two graduating fourth-year medical students from Duke University School of Medicine completed an individualized learning plan (ILP) for a transition-to-residency Capstone course in spring 2015 to help foster their skills in SDL. Students completed the ILP after receiving a personalized report from a designated faculty coach detailing strengths and weaknesses on specific topics (e.g., pulmonary medicine) and clinical skills (e.g., generating a differential diagnosis). These were determined by their performance on 12 Capstone Problem Sets of the Week (CaPOWs) compared with their peers. Students used transitional-year milestones to self-assess their confidence in SDL. OUTCOMES: SDL was successfully implemented in a Capstone course through the development of required clinically oriented problem sets. Coaches provided guided feedback on students' performance to help them identify knowledge deficits. Students' self-assessment of their confidence in SDL increased following course completion. However, students often chose Capstone didactic sessions according to factors other than their CaPOW performance, including perceived relevance to planned specialty and session timing. NEXT STEPS: Future Capstone curriculum changes may further enhance SDL skills of graduating students. Students will receive increased formative feedback on their CaPOW performance and be incentivized to attend sessions in areas of personal weakness.

Improving the Medical Student Performance Evaluation to Facilitate Resident Selection.

The Medical Student Performance Evaluation (MSPE) was introduced as a refinement of the prior "dean's letter" to provide residency program directors with a standardized comprehensive assessment of a medical student's performance throughout medical school. The author argues that, although the MSPE was created with good intentions, many have questioned its efficacy in predicting performance during residency. The author asserts that, despite decades of use and some acknowledged improvement, the MSPE remains a suboptimal tool for informing program directors' decisions about which applicants to interview and rank. In the current approach to MSPEs, there may even be some inherent conflicts of interest that cannot be overcome. In January 2015, an MSPE Task Force was created to review the MSPE over three years and recommend changes to its next iteration. The author believes, however, that expanding this collaborative effort between undergraduate and graduate medical education and other stakeholders could optimize the MSPE's standardization and transparency. The author offers six recommendations for achieving this goal: developing a truly standardized MSPE template; improving faculty accountability in student assessment; enhancing transparency in the MSPE; reconsidering the authorship responsibility of the MSPE; including assessment of compliance with administrative tasks and peer assessments in student evaluations; and embracing milestones for evaluation of medical student performance.

A pilot study of orthopaedic resident self-assessment using a milestones' survey just prior to milestones implementation.

OBJECTIVE: To pilot test if Orthopaedic Surgery residents could self-assess their performance using newly created milestones, as defined by the Accreditation Council on Graduate Medical Education. METHODS: In June 2012, an email was sent to Program Directors and administrative coordinators of the 154 accredited Orthopaedic Surgery Programs, asking them to send their residents a link to an online survey. The survey was adapted from the Orthopaedic Surgery Milestone Project. Completed surveys were aggregated in an anonymous, confidential database. SAS 9.3 was used to perform the analyses. RESULTS: Responses from 71 residents were analyzed. First and second year residents indicated through self-assessment that they had substantially achieved Level 1 and Level 2 milestones. Third year residents reported they had substantially achieved 30/41, and fourth year residents, all Level 3 milestones. Fifth year, graduating residents, reported they had substantially achieved 17 Level 4 milestones, and were extremely close on another 15. No milestone was rated at Level 5, the maximum possible. Earlier in training, Patient Care and Medical Knowledge milestones were rated lower than the milestones reflecting the other four competencies of Practice Based Learning and Improvement, Systems Based Practice, Professionalism, and Interpersonal Communication. The gap was closed by the fourth year. CONCLUSIONS: Residents were able to successfully self-assess using the 41 Orthopaedic Surgery milestones. Respondents' rate improved proficiency over time. Graduating residents report they have substantially, or close to substantially, achieved all Level 4 milestones. Milestone self-assessment may be a useful tool as one component of a program's overall performance assessment strategy.