Perception of Medical Student Mistreatment: Does Specialty Matter?

PURPOSE: Medical student mistreatment is pervasive, yet whether all physicians have a shared understanding of the problem is unclear. The authors presented professionally designed trigger videos to physicians from 6 different specialties to determine if they perceive mistreatment and its severity similarly. METHOD: From October 2016 to August 2018, resident and attending physicians from 10 U.S. medical schools viewed 5 trigger videos showing behaviors that could be perceived as mistreatment. They completed a survey exploring their perceptions. The authors compared perceptions of mistreatment across specialties and, for each scenario, evaluated the relationship between specialty and perception of mistreatment. RESULTS: Six-hundred fifty resident and attending physicians participated. There were statistically significant differences in perception of mistreatment across specialties for 3 of the 5 scenarios: aggressive questioning (range, 74.1%-91.2%), negative feedback (range, 25.4%-63.7%), and assignment of inappropriate tasks (range, 5.5%-25.5%) (P ≤ .001, for all). After adjusting for gender, race, professional role, and prior mistreatment, physicians in surgery viewed 3 scenarios (aggressive questioning, negative feedback, and inappropriate tasks) as less likely to represent mistreatment compared with internal medicine physicians. Physicians from obstetrics-gynecology and "other" specialties perceived less mistreatment in 2 scenarios (aggressive questioning and negative feedback), while family physicians perceived more mistreatment in 1 scenario (negative feedback) compared with internal medicine physicians. The mean severity of perceived mistreatment on a 1 to 7 scale (7 most serious) also varied statistically significantly across the specialties for 3 scenarios: aggressive questioning (range, 4.4-5.4; P < .001), ethnic insensitivity (range, 5.1-6.1; P = .001), and sexual harassment (range, 5.5-6.3; P = .004). CONCLUSIONS: Specialty was associated with differences in the perception of mistreatment and rating of its severity. Further investigation is needed to understand why these perceptions of mistreatment vary among specialties and how to address these differences.

Evolving roles of clerkship directors: have expectations changed?

BACKGROUND: Physician educators directing medical student programs face increasingly more complex challenges to ensure students receive appropriate preparation to care for patients. The Alliance for Clinical Education (ACE) defined expectations of and for clerkship directors in 2003. Since then, much has changed in medical education and health care. METHODS: ACE conducted a panel discussion at the 2016 Association of American Medical Colleges Learn Serve Lead conference, soliciting input on these expectations and the changing roles of clerkship directors. Using workshops as a cross-sectional study design, participants reacted to roles and responsibilities of clerkship directors identified in the literature using an audience response system and completing worksheets. RESULTS: The participants represented different disciplines of medicine and ranged from clerkship directors to deans of curriculum. Essential clerkship director qualifications identified by participants included: enthusiasm, experience teaching, and clinical expertise. Essential tasks included grading and assessment and attention to accreditation standards. Participants felt clerkship directors need adequate resources, including budget oversight, full-time clerkship support, and dedicated time to be the clerkship director. To whom clerkship directors report was mixed. Clerkship directors look to their chair for career advice, and they also report to the dean to ensure educational standards are being met. Expectations to meet accreditation standards and provide exemplary educational experiences can be difficult to achieve if clerkship directors' time and resources are limited. CONCLUSIONS: Participant responses indicated the need for a strong partnership between department chairs and the dean's office so that clerkship directors can fulfill their responsibilities. Our results indicate a need to ensure clerkship directors have the time and resources necessary to manage clinical medical student education in an increasingly complex health care environment. Further studies need to be conducted to obtain more precise data on the true amount of time they are given to do that role.

Biomedical Science Undergraduate Major: A New Pathway to Advance Research and the Health Professions.

PROBLEM: Many students entering professional degree programs, particularly M.D., Ph.D., and M.D./Ph.D., are not well prepared regarding the breadth of scientific knowledge required, communication skills, research experience, reading and understanding the scientific literature, and significant shadowing (for M.D.-related professions). In addition, physician scientists are a needed and necessary part of the academic research environment but are dwindling in numbers. INTERVENTION: In response to predictions of critical shortages of clinician investigators and the lack of proper preparation as undergraduates for these professions, the Biomedical Science (BMS) undergraduate major was created at The Ohio State University to attract incoming college freshmen with interests in scientific research and the healthcare professions. The intent of this major was to graduate an elite cohort of highly talented individuals who would pursue careers in the healthcare professions, biomedical research, or both. CONTEXT: Students were admitted to the BMS major through an application and interview process. Admitted cohorts were small, comprising 22 to 26 students, and received a high degree of individualized professional academic advising and mentoring. The curriculum included a minimum of 4 semesters (or 2 years) of supervised research experience designed to enable students to gain skills in clinical and basic science investigation. In addition to covering the prerequisites for medicine and advanced degrees in health professions, the integrated BMS coursework emphasized research literacy as well as skills related to work as a healthcare professional, with additional emphasis on independent learning, teamwork to solve complex problems, and both oral and written communication skills. Supported by Ohio State's Department of Internal Medicine, a unique clinical internship provided selected students with insights into potential careers as physician scientists. OUTCOME: In this educational case report, we describe the BMS undergraduate major and its outcomes after 10 years of implementation. Major outcomes include the strength of the major's matriculates (average ACT score = 32.6; average high school class percentile rank = 95.5) and the high percentage of BMS students who pursued graduate/professional degrees (91%; n = 110). Other markers of success include the strong focus on research, which resulted in 120 articles published by graduates to date (range = 0-12/student; 43% with at least 1 peer-reviewed journal article). LESSONS LEARNED: Based on its successes, adoption of a similar program at other academic medical centers would help feed the pipeline of well-trained health professionals and biomedical researchers.

Competency-Based Medical Education in the Internal Medicine Clerkship: A Report From the Alliance for Academic Internal Medicine Undergraduate Medical Education Task Force.

As medical educators continue to redefine learning and assessment across the continuum, implementation of competency-based medical education in the undergraduate setting has become a focus of many medical schools. While standards of competency have been defined for the graduating student, there is no uniform approach for defining competency expectations for students during their core clerkship year. The authors describe the process by which an Alliance for Academic Internal Medicine task force developed a paradigm for competency-based assessment of students during their inpatient internal medicine (IM) clerkship. Building on work at the resident and fellowship levels, the task force focused on the development of key learning outcomes as defined by entrustable professional activities (EPAs) that were specific to educational experiences on the IM clerkship, as well as identification of high-priority assessment domains. The work was informed by a national survey of clerkship directors.Six key EPAs emerged: generating a differential diagnosis, obtaining a complete and accurate history and physical exam, obtaining focused histories and clinically relevant physical exams, preparing an oral presentation, interpreting the results of basic diagnostic studies, and providing well-organized clinical documentation. A model for assessment was proposed, with descriptors aligned to the scale of supervision and mapped to Accreditation Council for Graduate Medical Education domains of competence. The proposed paradigm offers a standardized template that may be used across IM clerkships, and which would effectively bridge competency evaluation in the clerkship to fourth-year assessment as well as eventual postgraduate training.

Developing a Conversational Virtual Standardized Patient to Enable Students to Practice History-Taking Skills.

INTRODUCTION: Although traditional virtual patient simulations are designed to teach and assess clinical reasoning skills, few employ conversational dialogue with the patients. The virtual standardized patients (VSPs) described herein represent standardized patients that students interview using natural language. Students take histories and develop differential diagnoses of the VSPs as much as they would with standardized or actual patients. The student-VSP interactions are recorded, creating a comprehensive record of questions and the order in which they were asked, which can be analyzed to assess information-gathering skills. Students document the encounter in an electronic medical record created for the VSPs. METHODS: The VSP was developed by integrating a dialogue management system (ChatScript) with emotionally responsive 3D characters created in a high-fidelity game engine (Unity). The system was tested with medical students at the Ohio State University College of Medicine. Students are able to take a history of a VSP, develop a differential diagnosis, and document the encounter in the electronic medical record. RESULTS: Accuracy of the VSP responses ranged from 79% to 86%, depending on the complexity of the case, type of history obtained, and skill of the student. Students were able to accurately develop an appropriate differential diagnosis on the basis of the information provided by the patient during the encounter. CONCLUSIONS: The VSP enables students to practice their history-taking skills before encounters with standardized or actual patients. Future developments will focus on creating an assessment module that will automatically analyze VSP sessions and provide immediate student feedback.

Coaching the Coach: A Program for Development of Faculty Portfolio Coaches.

PROBLEM: Faculty coaching is recognized as an essential element for effective use of portfolios in undergraduate medical education, yet best practices for training these coaches are uncertain. INTERVENTION: New portfolio coaches participated in a multifaceted training program that included orienting modules, a 7.5-hr training workshop featuring analysis of reflective writing, an Observed Structured Teaching Exercise (OSTE), and subsequent longitudinal coaches' meetings for timely task training. Four desired coaching skills were emphasized in the initial training: creating a safe environment, explicitly using performance data, asking questions that elicit reflection, and guiding the student to develop future goals and plans. We collected and analyzed several outcomes: (a) coaches' self-assessment at key intervals, (b) open-ended written responses to three coaching vignettes, (c) video recordings of the OSTE, and (d) subsequent student evaluation of the coach. In an attempt to capture learning from the workshop, both the responses to written vignettes and the video-recorded encounters were coded for presence or absence of the four desired skills. CONTEXT: Our portfolio and coaching program was instituted as part of a major undergraduate medical education reform. A new cohort of 25 coaches is enrolled with each matriculating student class, and each coach is assigned to work individually with 8-10 students, forming a coaching relationship that continues over 4 years. Coaches are compensated at 5% full-time equivalent. OUTCOME: On coach self-assessment, the majority of coaches reported significant improvement in their perceived ability to assess a student's level of reflection, enhance reflection, use performance data, and guide a student to develop goals and plans. After two semesters, coach perception of improved abilities persisted. Students rated coaches as excellent (82%), reporting that coaches created safe environments (99%), promoted insight (92%), and aided in goal setting (97%). Written responses to vignettes before the OSTE found that several coaches omitted desired behaviors; however, posttraining responses showed no discernable pattern of learning. Coding of the OSTE, in contrast, documented that all coaches demonstrated all four of the desired skills. LESSONS LEARNED: Although coaches reported learning related to key skills, learning was not apparent when responses to written vignettes were examined. In contrast, skills were demonstrated in the OSTE, perhaps due to the added structured tasks as well as anticipation of feedback. In conclusion, this portfolio coach training program achieved its desired aim of providing students with portfolio coaches who demonstrated the desired skills, as reported by both coaches and students.

Development of an Assessment for Entrustable Professional Activity (EPA) 10: Emergent Patient Management.

INTRODUCTION: Medical schools in the United States are encouraged to prepare and certify the entrustment of medical students to perform 13 core entrustable professional activities (EPAs) prior to graduation. Entrustment is defined as the informed belief that the learner is qualified to autonomously perform specific patient-care activities. Core EPA-10 is the entrustment of a graduate to care for the emergent patient. The purpose of this project was to design a realistic performance assessment method for evaluating fourth-year medical students on EPA-10. METHODS: First, we wrote five emergent patient case-scenarios that a medical trainee would likely confront in an acute care setting. Furthermore, we developed high-fidelity simulations to realistically portray these patient case scenarios. Finally, we designed a performance assessment instrument to evaluate the medical student's performance on executing critical actions related to EPA-10 competencies. Critical actions included the following: triage skills, mustering the medical team, identifying causes of patient decompensation, and initiating care. Up to four students were involved with each case scenario; however, only the team leader was evaluated using the assessment instruments developed for each case. RESULTS: A total of 114 students participated in the EPA-10 assessment during their final year of medical school. Most students demonstrated competence in recognizing unstable vital signs (97%), engaging the team (93%), and making appropriate dispositions (92%). Almost 87% of the students were rated as having reached entrustment to manage the care of an emergent patient (99 of 114). Inter-rater reliability varied by case scenario, ranging from moderate to near-perfect agreement. Three of five case-scenario assessment instruments contained items that were internally consistent at measuring student performance. Additionally, the individual item scores for these case scenarios were highly correlated with the global entrustment decision. CONCLUSION: High-fidelity simulation showed good potential for effective assessment of medical student entrustment of caring for the emergent patient. Preliminary evidence from this pilot project suggests content validity of most cases and associated checklist items. The assessments also demonstrated moderately strong faculty inter-rater reliability.

Collaborative Concept Mapping and Critical Thinking in Fourth-Year Medical Students.

OBJECTIVE: To test the hypothesis that small group concept mapping of 4 core neonatal topics as part of a fourth-year allopathic medical student elective would improve critical thinking (CT) as measured by the California Critical Thinking Skills Test (CCTST). To describe any correlations between scores on the CCTST and the step 1 and step 2 Clinical Knowledge parts of the United States Medical Licensing Exam. METHODS: Twenty-seven students participated in this pilot study during a 1-month elective. A pretest CCTST, California Critical Thinking Disposition Inventory (CCTDI), and multiple choice knowledge test (MCKT) were completed immediately before the elective began. Four weekly group sessions were held with assigned reading on each of the 4 neonatal topics. Concept mapping was performed in small groups of 4 to 6 students with a group concept map collected at the end of the exercise. A posttest CCTST and MCKT was completed after the 4 group sessions. RESULTS: Pre-CCTST overall score was 83.9 ± 6, and post-CCTST overall score was 85.6 ± 6.9 (P = .57). Pearson correlation of USMLE step 1 and pre-CCTST showed r(25) = .276, P = .164. Pearson correlation of USMLE step 2 CK and pre-CCTST revealed r(25) = .214, P = .482. The precourse MCKT average was 35%, and the postcourse average 50% (P ≤ .001). CONCLUSIONS: A recent meta-analysis confirms this is the first report of a comparison between the increasingly common CCTST and the USMLE. We confirmed that concept mapping is a valid mechanism to teach content knowledge. Although the difference in the CCTST scores was not significant, this study could serve as an important start toward development of a curriculum devoted to teaching content and improving CT. The small number of students may have prevented us from defining a significant impact.

Medical Student Perceptions of Cost-Conscious Care in an Internal Medicine Clerkship: A Thematic Analysis.

BACKGROUND: Although as much as 87 % of all healthcare spending is directed by physicians, studies have demonstrated that they lack knowledge about the costs of medical care. Similarly, learners have not traditionally received instruction on cost-conscious care. OBJECTIVE: To examine medical students' perceptions of healthcare delivery as it relates to cost consciousness DESIGN: Retrospective qualitative analysis of medical student narratives PARTICIPANTS: Third-year medical students during their inpatient internal medicine clerkship MAIN MEASURES: Students completed a reflective exercise wherein they were asked to describe a scenario in which a patient experienced lack of attention to cost-conscious care, and were asked to identify solutions and barriers. We analyzed these reflections to learn more about students' awareness and perceptions regarding the practice of cost-conscious care within our medical center. KEY RESULTS: Eighty students submitted the assignment between July and December 2012. The most common problems identified included unnecessary tests and treatments (n = 69) and duplicative tests and treatments (n = 20.) With regards to solutions, students described 82 scenarios, with 125 potential solutions identified. Students most commonly used discussion with the team (speak up, ask why) as the process they would use (n = 28) and most often wanted to focus lab testing (n = 38) as the intervention. The most common barriers to high-value care included increased time and effort (n = 19), ingrained practices (n = 17), and defensive medicine or fear of missing something (n = 18.) CONCLUSIONS: Even with minimal clinical experience, medical students were able to identify instances of lack of attention to cost-conscious care as well as potential solutions. Although students identified the hierarchy in healthcare teams as a potential barrier to improving high value care, most students stated they would feel comfortable engaging the team in discussion. Future efforts to empower learners at all levels to question value decisions and to develop and implement solutions may result in improved healthcare.

The IDEA Assessment Tool: Assessing the Reporting, Diagnostic Reasoning, and Decision-Making Skills Demonstrated in Medical Students' Hospital Admission Notes.

UNLABELLED: Construct: Clinical skills are used in the care of patients, including reporting, diagnostic reasoning, and decision-making skills. Written comprehensive new patient admission notes (H&Ps) are a ubiquitous part of student education but are underutilized in the assessment of clinical skills. The interpretive summary, differential diagnosis, explanation of reasoning, and alternatives (IDEA) assessment tool was developed to assess students' clinical skills using written comprehensive new patient admission notes. BACKGROUND: The validity evidence for assessment of clinical skills using clinical documentation following authentic patient encounters has not been well documented. Diagnostic justification tools and postencounter notes are described in the literature (1,2) but are based on standardized patient encounters. To our knowledge, the IDEA assessment tool is the first published tool that uses medical students' H&Ps to rate students' clinical skills. APPROACH: The IDEA assessment tool is a 15-item instrument that asks evaluators to rate students' reporting, diagnostic reasoning, and decision-making skills based on medical students' new patient admission notes. This study presents validity evidence in support of the IDEA assessment tool using Messick's unified framework, including content (theoretical framework), response process (interrater reliability), internal structure (factor analysis and internal-consistency reliability), and relationship to other variables. RESULTS: Validity evidence is based on results from four studies conducted between 2010 and 2013. First, the factor analysis (2010, n = 216) yielded a three-factor solution, measuring patient story, IDEA, and completeness, with reliabilities of .79, .88, and .79, respectively. Second, an initial interrater reliability study (2010) involving two raters demonstrated fair to moderate consensus (κ = .21-.56, ρ =.42-.79). Third, a second interrater reliability study (2011) with 22 trained raters also demonstrated fair to moderate agreement (intraclass correlations [ICCs] = .29-.67). There was moderate reliability for all three skill domains, including reporting skills (ICC = .53), diagnostic reasoning skills (ICC = .64), and decision-making skills (ICC = .63). Fourth, there was a significant correlation between IDEA rating scores (2010-2013) and final Internal Medicine clerkship grades (r = .24), 95% confidence interval (CI) [.15, .33]. CONCLUSIONS: The IDEA assessment tool is a novel tool with validity evidence to support its use in the assessment of students' reporting, diagnostic reasoning, and decision-making skills. The moderate reliability achieved supports formative or lower stakes summative uses rather than high-stakes summative judgments.

Applying adult learning practices in medical education.

The application of the best practices of teaching adults to the education of adults in medical education settings is important in the process of transforming learners to become and remain effective physicians. Medical education at all levels should be designed to equip physicians with the knowledge, clinical skills, and professionalism that are required to deliver quality patient care. The ultimate outcome is the health of the patient and the health status of the society. In the translational science of medical education, improved patient outcomes linked directly to educational events are the ultimate goal and are best defined by rigorous medical education research efforts. To best develop faculty, the same principles of adult education and teaching adults apply. In a systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education, the use of experiential learning, feedback, effective relationships with peers, and diverse educational methods were found to be most important in the success of these programs. In this article, we present 5 examples of applying the best practices in teaching adults and utilizing the emerging understanding of the neurobiology of learning in teaching students, trainees, and practitioners. These include (1) use of standardized patients to develop communication skills, (2) use of online quizzes to assess knowledge and aid self-directed learning, (3) use of practice sessions and video clips to enhance significant learning of teaching skills, (4) use of case-based discussions to develop professionalism concepts and skills, and (5) use of the American Academy of Pediatrics PediaLink as a model for individualized learner-directed online learning. These examples highlight how experiential leaning, providing valuable feedback, opportunities for practice, and stimulation of self-directed learning can be utilized as medical education continues its dynamic transformation in the years ahead.

The subinternship curriculum in internal medicine: a national survey of clerkship directors.

BACKGROUND: The 4th-year internal medicine subinternship (subI), with its strong emphasis on experience-based learning and increased patient responsibilities, is an important component of undergraduate medical education. Discussions have begun amongst educational leaders on the importance of standardizing curriculum and evaluation tools utilized during the subinternship. PURPOSE: The objective of this survey was to describe the current state of educational practices regarding the subI curriculum, use of Clerkship Directors in Internal Medicine (CDIM) curricular guidelines, evaluation methodologies, and subintern call frequency and duty hours. METHODS: The survey was a part of the CDIM annual survey sent to 109 institutional members in 2005. The subinternship survey included 17 questions that addressed the prevalence of formal curricula in the subinternship, use of CDIM curricular guidelines and resources, and the evaluation tools utilized for assessment of the subinternship. Two questions examined the call frequency and duty hours of the subinterns. RESULTS: Eighty-eight members responded (81%). Of the respondents, 37% have a formal curriculum and 35% used CDIM curricular guidelines for the subinternship. More than half of the respondents agreed that the curricular guide helped organize their subI rotations (53%), and 48% agreed that it enhanced the quality of subI education. A global rating summative evaluation form (56%) was the most commonly used evaluation tool in the subinternship. Objective Structured Clinical Examinations (1%) and Mini-Clinical Evaluation Exercise (mini-CEX)(2%) were much less utilized during the subinternship. The respondents expressed an interest in the development of a standardized exam (47%) and clinical assessment tools such as the mini-CEX (59%). The vast majority of IM subinterns participate in 3 to 9 calls per rotation and spend less than 80 hr in the hospital per week. CONCLUSIONS: A formal curriculum is offered in slightly more than one third of subIs. Clerkship directors expressed interest in developing standardized evaluation tools to assess subintern competencies. The majority of IM subinterns spend less than 80 hr in the hospital per week. Further studies are needed to assess barriers to incorporating a formal curriculum and develop standardized tools to assess subintern competencies.

Do attending physicians, nurses, residents, and medical students agree on what constitutes medical student abuse?

BACKGROUND: Whether attending physicians, residents, nurses, and medical students agree on what constitutes medical student abuse, its severity, or influencing factors is unknown. METHOD: We surveyed 237 internal medicine attending physicians, residents, medical students, and nurses at 13 medical schools after viewing five vignettes depicting potentially abusive behaviors. RESULTS: The majority of each group felt the belittlement, ethnic insensitivity, and sexual harassment scenarios represented abuse but that excluding a student from participating in a procedure did not. Only a majority of attending physicians considered the negative feedback scenario as abuse. Medical students rated abuse severity significantly lower than other groups in the belittlement scenario (p<.05). Respondents who felt abused as students were more likely to rate behaviors as abusive (p<.05). CONCLUSIONS: The groups generally agree on what constitutes abuse, but attending physicians and those abused as students may perceive more behaviors as abusive.