Assessing supervisor versus trainee viewpoints of entrustment through cognitive and affective lenses: an artificial intelligence investigation of bias in feedback.

The entrustment framework redirects assessment from considering only trainees' competence to decision-making about their readiness to perform clinical tasks independently. Since trainees and supervisors both contribute to entrustment decisions, we examined the cognitive and affective factors that underly their negotiation of trust, and whether trainee demographic characteristics may bias them. Using a document analysis approach, we adapted large language models (LLMs) to examine feedback dialogs (N = 24,187, each with an associated entrustment rating) between medical student trainees and their clinical supervisors. We compared how trainees and supervisors differentially documented feedback dialogs about similar tasks by identifying qualitative themes and quantitatively assessing their correlation with entrustment ratings. Supervisors' themes predominantly reflected skills related to patient presentations, while trainees' themes were broader-including clinical performance and personal qualities. To examine affect, we trained an LLM to measure feedback sentiment. On average, trainees used more negative language (5.3% lower probability of positive sentiment, p < 0.05) compared to supervisors, while documenting higher entrustment ratings (+ 0.08 on a 1-4 scale, p < 0.05). We also found biases tied to demographic characteristics: trainees' documentation reflected more positive sentiment in the case of male trainees (+ 1.3%, p < 0.05) and of trainees underrepresented in medicine (UIM) (+ 1.3%, p < 0.05). Entrustment ratings did not appear to reflect these biases, neither when documented by trainee nor supervisor. As such, bias appeared to influence the emotive language trainees used to document entrustment more than the degree of entrustment they experienced. Mitigating these biases is nonetheless important because they may affect trainees' assimilation into their roles and formation of trusting relationships.

Investigating feedback orientation in medical learners.

BACKGROUND/PURPOSE: Feedback processes in health professions education (HPE) are not always successful. While recommendations to improve feedback provision dominate the literature, studying specific learner attributes that impact feedback uptake may also improve feedback processes. Feedback orientation is a concept from management science involving four dimensions of learner attributes and attitudes that impact their feedback uptake: utility, accountability, social awareness, and feedback self-efficacy. Feedback orientation may represent a valuable concept in HPE. We aimed to understand medical learners' feedback orientation at different stages in their development. METHODS: We used the Feedback Orientation Scale, a 20-item survey instrument, for a cross-sectional analysis of feedback orientation in medical students and Internal Medicine residents at one large academic center. We performed descriptive statistics and analysis of variance for data analysis. RESULTS: We found the same factors (dimensions) to feedback orientation in our population as in management science. Overall feedback orientation scores were high and were largely consistent across trainee levels. Utility was the domain that was highest across learners, whereas feedback self-efficacy was lowest. CONCLUSIONS: Feedback orientation represents a useful concept to explore medical learners' attitudes toward feedback's role in their development. The four domains can help guide further nuanced feedback research and application.[Box: see text].

Exploring how feedback reflects entrustment decisions using artificial intelligence.

CONTEXT: Clinical supervisors make judgements about how much to trust learners with critical activities in patient care. Such decisions mediate trainees' opportunities for learning and competency development and thus are a critical component of education. As educators apply entrustment frameworks to assessment, it is important to determine how narrative feedback reflecting entrustment may also address learners' educational needs. METHODS: In this study, we used artificial intelligence (AI) and natural language processing (NLP) to identify characteristics of feedback tied to supervisors' entrustment decisions during direct observation encounters of clerkship medical students (3328 unique observations). Supervisors conducted observations of students and collaborated with them to complete an entrustment-based assessment in which they documented narrative feedback and assigned an entrustment rating. We trained a deep neural network (DNN) to predict entrustment levels from the narrative data and developed an explainable AI protocol to uncover the latent thematic features the DNN used to make its prediction. RESULTS: We found that entrustment levels were associated with level of detail (specific steps for performing clinical tasks), feedback type (constructive versus reinforcing) and task type (procedural versus cognitive). In justifying both high and low levels of entrustment, supervisors detailed concrete steps that trainees performed (or did not yet perform) competently. CONCLUSIONS: Framing our results in the factors previously identified as influencing entrustment, we find a focus on performance details related to trainees' clinical competency as opposed to nonspecific feedback on trainee qualities. The entrustment framework reflected in feedback appeared to guide specific goal-setting, combined with details necessary to reach those goals. Our NLP methodology can also serve as a starting point for future work on entrustment and feedback as similar assessment datasets accumulate.

Faculty motivations for leading clinical clerkship electives: A qualitative study.

PURPOSE: Faculty are motivated to pursue clinician-educator careers out of a sense of purpose, duty, connectedness, satisfaction, and mastery. Yet, many suffer from burnout due to a lack of funding, resources, and competing clinical demands. Reasons for clinician-educator participation in unfunded educational leadership positions are underexplored. This study examined faculty members' reasons for volunteering and remaining as clerkship elective directors, an unfunded leadership position. METHODS: In this qualitative study, the authors conducted 17 semi-structured interviews with clerkship elective directors in March 2021. The authors conducted a thematic analysis of deidentified transcripts using motivation theories as a lens. RESULTS: Directors' motivations to engage in this unfunded educational leadership position stemmed from their existing clinician-educator identity and a sense of purpose and duty. Directors are sustained by the satisfaction derived from witnessing the positive impact they have on learners' career development and skills building, the impact of learners on the clinical environment, as well as personal benefits in the mastery of educator skills and enhanced visibility as educators. CONCLUSIONS: Unfunded educational leadership positions can advance clinician-educators' commitment to learners and alter the learning environment. Strategies for faculty recruitment and retention in unfunded leadership positions include ensuring meaningful contact with learners, as well as opportunities for personal career development through skills building and enhanced visibility through recognition.

"What is the mechanism?": Cues, barriers, and opportunities to discuss foundational science during internal medicine rounds.

BACKGROUND: Repeated application of foundational science (FS) during medical reasoning results in encapsulation of knowledge needed to develop clinical expertise. Despite proven benefit of educating learners using a FS framework to anchor clinical decision making, how FS is integrated on clinical rotations has not been well characterized. This study examines how and when FS discussion occurs on internal medicine teaching rounds. MATERIAL AND METHODS: We performed a convergent mixed method study. Six internal medicine teams at a quaternary hospital were observed during rounds and team members interviewed. Transcripts were analyzed using thematic analysis. Descriptive statistics provided a summary of the observations. RESULTS: Our study revealed that rounds used a teacher-centered model where FS knowledge was transmitted as pearls external to the clinical context. FS content arose primarily when the patient was complex. Barriers preventing FS discussion were lack of time and perceived lack of personal FS knowledge. CONCLUSION: Our study describes scenarios that commonly elicit discussion of FS on inpatient medicine rounds highlighting a 'transmission' model of FS knowledge. We suggest a learner-centered model that engages students in the practice of integrating FS into clinical reasoning.

How Do Clinical Electives during the Clerkship Year Influence Career Exploration? A Qualitative Study.

Problem: Although many students begin medical school with some idea of their specialty interest, up to 80% of these students choose a different specialty by their final year. This pivot tends to happen in the clerkship year, when students are immersed in the clinical environment, gaining a practical understanding of the day-to-day work in different fields. Yet, in this year students have limited experiences with specialties. Clinical electives during the clerkship year may aid students in career development. The authors examined student career exploration through the lens of social cognitive career theory (SCCT). SCCT posits three variables that influence career development: personal goals, self-efficacy, and understanding outcome expectations. With this framework, the authors sought to understand how a program of clinical electives during the clerkship year influences students' perceptions of their career exploration. We aimed to: (1) describe an innovative clerkship elective program designed for career exploration, and (2) explore how this influenced students' career exploration using qualitative analysis. Intervention: Beginning in 2018, students at our institution were required to participate in three 2-week clinical electives during their clerkship year, called Clinical Immersive Experiences (CIExes). CIExes were categorized into four different types: apprenticeship, clinical skills building, integrative (multi-disciplinary), or subspecialty. Authors invited fourth year students to participate in interviews (January to March 2019) about how they selected electives and how these electives contributed to their career exploration. Interviews continued until reaching information sufficiency. Authors coded and analyzed transcripts using template analysis. Context: This curricular intervention took place in the context of large-scale curricular redesign. Students began clerkships partway into their second year of medical school. The family and community medicine clerkship, which was previously a 6-week core clerkship, was changed to a longitudinal format, thus freeing up 6 weeks for electives. Other core clerkships included anesthesia (2 weeks), medicine (8 weeks), neurology (4 weeks), obstetrics and gynecology (6 weeks), pediatrics (6 weeks), psychiatry (4 weeks), and surgery (8 weeks). Impact: From 15 student interviews, we identified three major themes. First, CIExes facilitated personalized career exploration. All students felt that at least one elective helped them solidify their decision about a specialty choice. Second, CIExes promoted focused learning and skills development that complemented core rotations. They noted the benefit of positive relationships with supervisors, particularly attendings, during these electives. Third, students highlighted how these electives fostered a positive learning environment and enhanced wellbeing. SCCT clarified how the CIEx program helped students advance their personal goals, self-efficacy, and outcome expectations during a pivotal time in medical school. Lessons Learned: We learned that from the student perspective, the inclusion of clinical electives in the clerkship year benefited students' career exploration by helping them develop and refine their career goals, increase self-efficacy, and test outcome expectations in a meaningful way as anticipated from SCCT. In addition, we found that CIExes created a positive learning environment that allowed deep relationships to develop in fields of interest and that supported a strong sense of wellbeing. Supplemental data for this article is available online at https://doi.org/10.1080/10401334.2021.1891545.

Moving toward Mastery: Changes in Student Perceptions of Clerkship Assessment with Pass/Fail Grading and Enhanced Feedback.

ProblemClerkship grades contribute to a summative assessment culture in clerkships and can therefore interfere with students' learning. For example, by focusing on summative, tiered clerkship grades, students often discount accompanying feedback that could inform future learning. This case report seeks to explore whether an assessment system intervention which eliminated tiered grades and enhanced feedback was associated with changes in student perceptions of clerkship assessment and perceptions of the clinical learning environment. Intervention: In January 2019, our institution eliminated tiered clerkship grading (honors/pass/fail) for medical students during the core clerkship year and implemented pass/fail clerkship grading along with required twice weekly, work-based assessments for formative feedback. Context: In this single institution, cross-sectional survey study, we collected data from fourth-year medical students one year after an assessment system intervention. The intervention entailed changing from honors/pass/fail to pass/fail grading in all eight core clerkships and implementing an electronic system to record twice-weekly real-time formative work-based assessments. The survey queried student perceptions on the fairness and accuracy of grading and the clinical learning environment-including whether clerkships were mastery- or performance-oriented. We compared responses from students one year after the assessment intervention to those from the class one year before the intervention. Comparisons were made using unpaired, two-tailed t-tests or chi-squared tests as appropriate with Cohen's d for effect size estimation for score differences. Content analysis was used to analyze responses from two open-ended questions about feedback and grading. Impact: Survey response rates were similar before and after intervention (76% (127/168) vs. 72% (118/163), respectively) with no between-group differences in demographics. The after-intervention group showed statistically significant increases in the following factors: "grades are transparent and fair" (Cohen's d = 0.80), "students receive useful feedback" (d = 0.51), and "resident evaluation procedures are fair" (d = 0.40). After-intervention respondents perceived the clerkship learning environment to be more mastery-oriented (d = 0.52), less performance approach-oriented (d = 0.63), and less performance avoid-oriented (d = 0.49). There were no statistical differences in the factors "attending evaluation procedures are fair," "evaluations are accurate," "evaluations are biased," or "perception of stereotype threat." Open-ended questions revealed student recommendations to improve clerkship summary narratives, burden of work-based assessment, and in-person feedback. Lessons Learned: After an assessment system change to pass/fail grading with work-based assessments, we observed moderate to large improvements in student perceptions of clerkship grading and the mastery orientation of the learning environment. Our intervention did not improve perceptions around bias in assessment in clerkships. Other medical schools may consider similar interventions to begin to address student concerns with clerkship assessment and promote a more adaptive learning environment.

Residents' Experiences of Negative Emotions toward Patients: Challenges to their Identities.

PhenomenonMedical learners are more likely than practicing physicians to experience negative emotions toward some patients whom they find challenging, and medical students experience such emotions related to their identity as learners. Little is known about experiences of residents, who are further along in their physician identity formation and have greater autonomy and competence. We explored and characterized how residents understand their experiences of the phenomenon of feeling negative emotions toward patients in relation to their identities as residents. Approach: In 2018, 305 final-year obstetrics and gynecology residents were invited to participate in interviews, which we conducted until reaching theoretical sufficiency. In semi-structured interviews conducted by phone, we probed interactions when residents felt negative emotions toward patients, including reasons for their feelings related to their professional identities, strategies, and curricular desires. The authors coded data and identified patterns using thematic analysis. Findings: Nineteen residents were interviewed by phone. Residents experienced negative emotions toward patients because of challenges to their identities as: physicians - wanting respect and specific unexpected patient behaviors; learners - desiring complete autonomy and experiencing challenges with attending physicians; teachers - wanting to be a role model and protect junior learners; and workers - trying to complete tasks. Among the strategies used to manage feelings toward patients, they struggled with "venting", or complaining about patients, which was not always helpful and residents recognized as perceived negatively by students. They desired curricular support for these interactions such as debriefs and other supported reflection, faculty modeling, and communication skills training. Insights: Like medical students and physicians in practice, residents experience negative emotions toward patients, often because of and made more difficult by their identities as physicians, learners, teachers, and workers. Educators should support residents' reflections about these interactions, model compassionate behavior when feeling challenged by patients, and address unhealthy coping strategies.

Emotion in remediation: A scoping review of the medical education literature.

OBJECTIVES: Remediation can be crucial and high stakes for medical learners, and experts agree it is often not optimally conducted. Research from other fields indicates that explicit incorporation of emotion improves education because of emotion's documented impacts on learning. Because this could present an important opportunity for improving remediation, we aimed to investigate how the literature on remediation interventions in medical education discusses emotion. METHODS: The authors used Arksey and O'Malley's framework to conduct a scoping literature review of records describing remediation interventions in medical education, using PubMed, CINAHL Complete, ERIC, Web of Science and APA PsycInfo databases, including all English-language publications through 1 May 2020 meeting search criteria. They included publications discussing remediation interventions either empirically or theoretically, pertaining to physicians or physician trainees of any level. Two independent reviewers used a standardised data extraction form to report descriptive information; they reviewed included records for the presence of mentions of emotion, described the mentions and analysed results thematically. RESULTS: Of 1644 records, 199 met inclusion criteria and were reviewed in full. Of those, 112 (56%) mentioned emotion in some way; others focused solely on cognitive aspects of remediation. The mentions of emotion fell into three themes based on when the emotion was cited as present: during regular coursework or practice, upon referral for remediation and during remediation. One-quarter of records (50) indicated potential intentional incorporation of emotion into remediation programme design, but they were non-specific as to how emotions related to the learning process itself. CONCLUSION: Even though emotion is omnipresent in remediation, medical educators frequently do not factor emotion into the design of remediation approaches and rarely explicitly utilise emotion to improve the learning process. Applications from other fields may help medical educators leverage emotion to improve learning in remediation, including strategies to frame and design remediation.

Evidence for validity for the Cognitive Load Inventory for Handoffs.

CONTEXT: Patient handovers remain a significant patient safety challenge. Cognitive load theory (CLT) can be used to identify the cognitive mechanisms for handover errors. The ability to measure cognitive load types during handovers could drive the development of more effective curricula and protocols. No such measure currently exists. METHODS: The authors developed the Cognitive Load Inventory for Handoffs (CLIH) using a multi-step process, including expert interviews to enhance content validity and talk-alouds to optimise response process validity. The final version contained 28 items. From January to March 2019, we administered a cross-sectional survey to 1807 residents and fellows from a large health care system in the USA. Participants completed the CLIH following a handover. Exploratory factor analysis of data from one-third of respondents identified high-performing items; confirmatory factor analysis of data from the remaining sample assessed model fit. Model fit was evaluated using the comparative fit index (CFI) (>0.90), Tucker-Lewis index (TFI) (>0.80), standardised root mean square residual (SRMR) (<0.08) and root mean square of error of approximation (RMSEA) (<0.08). RESULTS: Participants included 693 trainees (38.4%) (231 in the exploratory study and 462 in the confirmatory study). Eleven items were removed during exploratory factor analysis. Confirmatory factor analysis of the 16 remaining items (five for intrinsic load, seven for extraneous load and four for germane load) supported a three-factor model and met criteria for good model fit: the CFI was 0.95, TFI was 0.93, RMSEA was 0.074 and SRMR was 0.07. The factor structure was comparable for gender and role. Intrinsic, extraneous and germane load scales had high internal consistency. With one exception, scale scores were associated, as hypothesised, with postgraduate level and clinical setting. CONCLUSIONS: The CLIH measures three types of cognitive load during patient handovers. Evidencefor validity is provided for the CLIH's content, response process, internal structure and association with other variables. This instrument can be used to determine the relative drivers of cognitive load during handovers in order to optimize handover instruction and protocols.

Exploring the relationship between emotion and cognitive load types during patient handovers.

Cognitive Load Theory has emerged as an important approach to improving instruction in the health professions workplace, including patient handovers. At the same time, there is growing recognition that emotion influences learning through numerous cognitive processes including motivation, attention, working memory, and long-term memory. This study explores how emotion influences the cognitive load experienced by trainees performing patient handovers. From January to March 2019, 693 (38.7%) of 1807 residents and fellows from a 24-hospital health system in New York city completed a survey after performing a handover. Participants rated their emotional state and cognitive load. The survey included questions about features of the learner, task, and instructional environment. The authors used factor analysis to identify the core dimensions of emotion. Regression analyses explored the relationship between the emotion factors and cognitive load types. Two emotion dimensions were identified representing invigoration and tranquility. In regression analyses, higher levels of invigoration, tranquility, and their interaction were independently associated with lower intrinsic load and extraneous load. The interaction of invigoration and tranquility predicted lower germane load. The addition of the emotion variables to multivariate models including other predictors of cognitive load types significantly increased the amount of variance explained. The study provides a model for measuring emotions in workplace learning. Because emotion appears to have a significant influence on cognitive load types, instructional designers should consider strategies that help trainees regulate emotion in order to reduce cognitive load and improve learning and performance.

How do attending physicians describe cognitive overload among their workplace learners?

OBJECTIVES: Cognitive load theory (CLT) focuses on the limited bandwidth of working memory. Core to CLT is the concept of cognitive overload, which occurs when working memory demands exceed working memory capacity, and learning and performance suffer. Within health professions education (HPE), workplace learning settings are very complex, placing learners at high risk of cognitive overload. Although continuous monitoring of physiologic parameters can indicate states of high cognitive load, how to practically identify cognitively overloaded learners within everyday workplace settings is not well understood. We sought to characterise how attending physicians described their perceiving of cognitive overload among learners in two different workplace settings: the gastrointestinal endoscopy suite and the intensive care unit. METHODS: We performed a secondary qualitative analysis of transcripts of interviews with workplace teachers that had been carried out during two previous studies. These studies had addressed different objectives but both were informed by CLT. Each included questions that prompted participants to reflect on how they perceived cognitive overload to manifest among learners in the workplace. To investigate the phenomenon of cognitive overload, we developed a new codebook and performed content analysis. RESULTS: We analysed 42 interview transcripts (22 endoscopists, 12 hospitalists, eight intensivists). Participants described four behaviours they had witnessed among learners they thought were cognitively overloaded: poor performance on workplace tasks; non-verbal physical manifestations (including posture, eye and body movements and autonomic functions); verbal utterances (words and sounds), and interpersonal interactions with team members. Endoscopists often described individually oriented examples, whereas intensivists and hospitalists tended to frame examples within an interpersonal context. CONCLUSIONS: We identified four overarching ways in which HPE workplace teachers perceived learners as appearing to be cognitively overloaded. Workplace teachers and learners should be mindful of and watch for these signs, which may signal states of cognitive overload. Earlier recognition of cognitive overload may facilitate timely action to reduce cognitive overload and promote learning.

Overcoming the Challenges of Direct Observation and Feedback Programs: A Qualitative Exploration of Resident and Faculty Experiences.

Problem: Prior studies have reported significant negative attitudes amongst both faculty and residents toward direct observation and feedback. Numerous contributing factors have been identified, including insufficient time for direct observation and feedback, poorly understood purpose, inadequate training, disbelief in the formative intent, inauthentic resident-patient clinical interactions, undermining of resident autonomy, lack of trust between the faculty-resident dyad, and low-quality feedback information that lacks credibility. Strategies are urgently needed to overcome these challenges and more effectively engage faculty and residents in direct observation and feedback. Otherwise, the primary goals of supporting both formative and summative assessment will not be realized and the viability of competency-based medical education will be threatened. Intervention: Toward this end, recent studies have recommended numerous strategies to overcome these barriers: protected time for direct observation and feedback; ongoing faculty and resident training on goals and bidirectional, co-constructed feedback; repeated direct observations and feedback within a longitudinal resident-supervisor relationship; utilization of assessment tools with evidence for validity; and monitoring for engagement. Given the complexity of the problem, it is likely that bundling multiple strategies together will be necessary to overcome the challenges. The Direct Observation Structured Feedback Program (DOSFP) incorporated many of the recommended features, including protected time for direct observation and feedback within longitudinal faculty-resident relationships. Using a qualitative thematic approach the authors conducted semi-structured interviews, during February and March, 2019, with 10 supervisors and ten residents. Participants were asked to reflect on their experiences. Interview guide questions explored key themes from the literature on direct observation and feedback. Transcripts were anonymized. Two authors independently and iteratively coded the transcripts. Coding was theory-driven and differences were discussed until consensus was reached. The authors then explored the relationships between the codes and used a semantic approach to construct themes. Context: The DOSFP was implemented in a psychiatry continuity clinic for second and third year residents. Impact: Faculty and residents were aligned around the goals. They both perceived the DOSFP as focused on growth rather than judgment even though residents understood that the feedback had both formative and summative purposes. The DOSFP facilitated educational alliances characterized by trust and respect. With repeated practice within a longitudinal relationship, trainees dropped the performance orientation and described their interactions with patients as authentic. Residents generally perceived the feedback as credible, described feedback quality as high, and valued the two-way conversation. However, when receiving feedback with which they did not agree, residents demurred or, at most, would ask a clarifying question, but then internally discounted the feedback. Lessons Learned: Direct observation and structured feedback programs that bundle recent recommendations may overcome many of the challenges identified by previous research. Yet, residents discounted disagreeable feedback, illustrating a significant limitation and the need for other strategies that help residents reconcile conflict between external data and one's self-appraisal.

Exploring Residents' Experience of Career Development Scholarship Tracks: A Qualitative Case Study Using Social Cognitive Career Theory.

Problem: Trainees enter graduate medical education with professional aspirations that often extend beyond the role of clinician to roles such as educator, innovator, leader, advocate, or researcher. Many residency programs have implemented academic tracks to support career development in these areas. With the exception of research tracks, these tracks generally do not include significant longitudinal protected time and often rely upon 'extra-curricular' effort and possess insufficient structure, mentorship, and accountability. Most prior studies of non-research scholarship tracks have not been theory driven and do not explore in depth the experience of residents who participate. Approach: To address this gap in the literature, we conducted a qualitative case study informed by Social Cognitive Career Theory to explore the professional identity development of residents who participated in a non-research scholarship track that incorporates recommended best practices. The track, Pathways to Expertise Program, incorporates features of successful research tracks: protected time, longitudinal experience, mentorship, platforms for recognition, and accountability. Participants from the first three cohorts were interviewed at the time of their graduation (2017-2019). Semi-structured interviews were conducted, transcribed, and independently coded. Social Cognitive Career Theory informed the organization of codes into themes. Context: The Pathways to Expertise Program was implemented in a psychiatry residency training program in a large urban academic teaching hospital. Impact: Fifteen residents entered Pathways to Expertise Program during the study period and all 15 participated in the study. Fourteen completed the program and presented their projects at the department grand rounds. For dissemination, 12 presented their project findings at one or more national meetings in the form of a poster (20 distributed across 11 residents), workshop (six distributed across four residents), or presentation (two across two residents). Six residents accounted for a total of seven first author publications in peer reviewed journals. All participants described how their self-efficacy increased as a result of new skills (e.g., content, methodology, and scientific communication), mentorship (e.g., content and process guidance), peer and broader support (e.g., small group supervision), persuasive communications (e.g., recognition both locally and nationally), and positive emotional reactions (e.g., triumph). The residents also described expecting compelling benefits (e.g., stronger application for fellowship and expanded career opportunities). Participants indicated that the experience influenced their career goals and how they perceived their professional identities. Lessons Learned: These findings suggest that a longitudinal academic track that incorporates features of successful research tracks (protected time, mentorship, peer support, and accountability for deliverables) can be instrumental in forming and maturing professional identities for non-clinical roles. These tracks can accomplish several important goals, including enhancing resilience via identity formation around passion and purpose and meeting society's need for physicians who are engaged in inquiry and innovation. Implications for the design of academic tracks in general are explored.

Trainee perception of cognitive load during observed faculty staff teaching of procedural skills.

OBJECTIVES: Although teachers impact learners' cognitive load, how specific teaching activities affect intrinsic, germane and extraneous load during procedural skills training is unknown. We sought to characterise teaching activities used in the exemplar procedural setting of colonoscopy, and to explore how they were enacted and how learners perceived them as affecting intrinsic, germane and extraneous cognitive load. METHODS: We observed 10 colonoscopies performed by eight different gastroenterology fellows and supervised by 10 different attending physicians at two hospitals, and recorded the teaching activities observed, as well as details of when they were used and how they were enacted. After the colonoscopy, each fellow completed the Cognitive Load Inventory for Colonoscopy to quantify intrinsic, germane and extraneous load. We then interviewed each fellow to determine how he or she perceived teaching as affecting cognitive load. Qualitative data were subjected to content analysis. Instances of germane load-promoting activities were correlated with measured germane load. RESULTS: We observed 515 instances of teaching activities. The intensity of teaching varied substantially, ranging from 0.7 to 3.3 activities per minute, as did the pattern of teaching activities used by different attending physicians. Little teaching occurred immediately before or after a procedure. Fellows usually perceived teaching as affecting cognitive load in ways that promoted learning, particularly by reducing intrinsic load and increasing germane load. Fellows strongly perceived that the provision of autonomy promoted germane load. Conversely, fellows perceived that excessive teaching increased extraneous load. Instances of germane load-promoting teaching activities correlated moderately with measured germane load. CONCLUSIONS: Teaching in the exemplar procedural setting of colonoscopy affected learners' cognitive load in mostly beneficial ways, yet even 'good' teaching activities had detrimental effects when used excessively. Teachers of procedures should consider learner experience, task complexity and environmental factors to modulate the modality, content and intensity of teaching to promote balanced cognitive load and learning. Teaching more reservedly during the procedure and taking advantage of pre- and post-procedure opportunities may help.

Cognitive load theory for training health professionals in the workplace: A BEME review of studies among diverse professions: BEME Guide No. 53.

AIM: Cognitive load theory (CLT) is of increasing interest to health professions education researchers. CLT has intuitive applicability to workplace settings, yet how CLT should inform teaching, learning, and research in health professions workplaces is unclear. METHOD: To map the existing literature, we performed a scoping review of studies involving cognitive load, mental effort and/or mental workload in professional workplace settings within and outside of the health professions. We included actual and simulated workplaces and workplace tasks. RESULT: Searching eight databases, we identified 4571 citations, of which 116 met inclusion criteria. Studies were most often quantitative. Methods to measure cognitive load included psychometric, physiologic, and secondary task approaches. Few covariates of cognitive load or performance were studied. Overall cognitive load and intrinsic load were consistently negatively associated with the level of experience and performance. Studies consistently found distractions and other aspects of workplace environments as contributing to extraneous load. Studies outside the health professions documented similar findings to those within the health professions, supporting relevance of CLT to workplace learning. CONCLUSION: The authors discuss implications for workplace teaching, curricular design, learning environment, and metacognition. To advance workplace learning, the authors suggest future CLT research should address higher-level questions and integrate other learning frameworks.

Challenges and adaptations in implementing an English-medium medical program:a case study in China.

BACKGROUND: Increasingly, non-English speaking countries use English as the medium of instruction (EMI) to teach academic subjects. This study investigated the challenges and adaptation strategies of teachers and students in an EMI medical education program in China. METHODS: Data were collected on EMI and non-EMI students' test performances and student and teacher perceptions of the program. Test scores and survey results were analyzed using SPSS. Focus group transcripts and open-ended comments from surveys were examined using thematic coding. RESULTS: There were no significant differences in admission and graduation test scores for EMI and non-EMI students. Four challenges with the EMI program were identified: (1) insufficient/inappropriate teaching materials, (2) unsatisfactory teaching, (3) inadequate class interactions, and (4) failure to teach medical humanities. To address these challenges, teachers and students used adaptive strategies, such as the use of alternative textbooks, self-learning skills and Chinese language. CONCLUSIONS: EMI programs are difficult to initiate, requiring faculty development and institutional support, and student self and peer group learning strategies to be successful. The adaptive strategies employed by both students and teachers offer insights into how other EMI programs might strengthen their implementation.

Developing and rewarding teachers as educators and scholars: remarkable progress and daunting challenges.

CONTEXT: This article describes the scholarly work that has addressed the fifth recommendation of the 1988 World Conference on Medical Education: 'Train teachers as educators, not content experts alone, and reward excellence in this field as fully as excellence in biomedical research or clinical practice'. PROGRESS: Over the past 30 years, scholars have defined the preparation needed for teaching and other educator roles, and created faculty development delivery systems to train teachers as educators. To reward the excellence of educators, scholars have expanded definitions of scholarship, defined educator roles and criteria for judging excellence, and developed educator portfolios to make achievements visible for peer review. Despite these efforts, the scholarship of discovery continues to be more highly prized and rewarded than the scholarship of teaching. These values are deeply embedded in university culture and policies. CHALLENGES: To remedy the structural inequalities between researchers and educators, a holistic approach to rewarding the broad range of educational roles and educational scholarship is needed. This requires strong advocacy to create changes in academic rewards and support policies, provide a clear career trajectory for educators using learning analytics, expand programmes for faculty development, support health professions education scholarship units and academies of medical educators, and create mechanisms to ensure high standards for all educators.

Understanding Clerkship Student Roles in the Context of 21st-Century Healthcare Systems and Curricular Reform.

Phenomenon: Preclerkship medical education has undergone extensive reform, and the clerkship years are growing targets for curricular innovation. As institutions implement new preclerkship curricula to better prepare medical students to practice medicine in the context of modern healthcare systems, the perspective of clerkship leaders regarding clerkship student roles and potential for change will facilitate redefining these roles so that preclerkship educational innovations can continue into clerkships. Approach: In this qualitative exploratory study, authors conducted semistructured interviews with clerkship and site directors for eight core clerkships from April to May 2016. Questions addressed how clerkship leaders perceive current student roles and the potential for change. Through iterative consensus building, authors identified themes describing current ideal clerkship student roles applicable to future roles. Findings: Twenty-three of 24 (96%) directors participated. Findings fell into four themes: factors influencing the clerkship role, clerkship student role archetypes, workplace authenticity and value, and potential for change. Student, supervisor, and context factors determine the clerkship student role. Three role archetypes emerged: the apprentice (an assistant completing concrete patient care tasks), the academic (a researcher bringing literature back to the team), and the communicator (an interdisciplinary and patient liaison). Each archetype was considered authentic and valuable. Positive attitudes toward preclerkship curricular changes were associated with openness to evolution of the clerkship students' role. These emerging roles mapped to the archetypes. Insights: Clerkship leaders perceive that student, supervisor, and context factors result in varying emphasis on role archetypes, which in turn lead to different types of learning. Medical educators can use the archetypes to articulate how expanded student roles align learning with clinical needs, particularly as they relate to health systems science and inquiry.