Thresholds of becoming: an exploration of threshold concepts as a means to support professional identity formation in competency-based curricula.

Inherent in every clinical preceptor's role is the ability to understand the learning needs of individual trainees, enabling them to meet their potential. Competency-based medical education frameworks have been developed to this end, but efforts to identify behaviours and activities that define competence are based on mapping knowledge, skills and ability, which can be difficult to integrate into a comprehensive picture of who the trainee is becoming. Professional identity formation, in contrast, prioritizes attention to who trainees are becoming, but provision of detailed guidance to preceptors on how to best support this form of development is challenging. The tension that results limits our ability to optimally support learners as strengths in competency development may mask professional identity development gaps and vice versa. To address this tension, this paper examines how the theory of threshold concepts - troublesome ideas that, once appreciated, fundamentally change how you understand and approach a particular activity - can shine light on professional identity formation and its relationship with developing competence. The recognition and identification of threshold concepts is offered as a means to improve our ability to identify, discuss and support behaviours and actions that impact the learner's capacity to act competently as they develop their identity at various stages of training.

Voices of conference attendees: how should future hybrid conferences be designed?

BACKGROUND: With conference attendees having expressed preference for hybrid meeting formats (containing both in-person and virtual components), organisers are challenged to find the best combination of events for academic meetings. Better understanding what attendees prioritise in a hybrid conference should allow better planning and need fulfilment. METHODS: An online survey with closed and open-ended questions was distributed to registrants of an international virtual conference. Responses were then submitted to descriptive statistical analysis and directed content analysis. RESULTS: 823 surveys (Response Rate = 4.9%) were received. Of the 813 who expressed a preference, 56.9% (N = 463) desired hybrid conference formats in the future, 32.0% (N = 260) preferred in-person conferences and 11.1% (N = 90) preferred virtual conferences. Presuming a hybrid meeting could be adopted, 67.4% (461/684) preferred that virtual sessions take place both during the in-person conference and be spread throughout the year. To optimise in-person components of hybrid conferences, recommendations received from 503 respondents included: prioritising clinical skills sessions (26.2%, N = 132), live international expert presentations and discussions (15.7%, N = 79) and interaction between delegates (13.5%, N = 68). To optimise virtual components, recommendations received from 486 respondents included: prioritising a live streaming platform with international experts' presentations and discussions (24.3%, N = 118), clinical case discussions (19.8%, N = 96) and clinical update sessions (10.1%, N = 49). CONCLUSIONS: Attendees envision hybrid conferences in which organisers can enable the vital interaction between individuals during an in-person component (e.g., networking, viewing and improving clinical skills) while accessing virtual content at their convenience (e.g., online expert presentations with latest advancements, clinical case discussions and debates). Having accessible virtual sessions throughout the year, as well as live streaming during the in-person component of hybrid conferences, allows for opportunity to prolong learning beyond the conference days.

To a fault.

Are first impressions misleading? This commentary explores that question by drawing on the more general cognitive psychology literature aimed at understanding when, why, and how any non-analytic reasoning process can help or hurt decision-making.

An exploration of "real time" assessments as a means to better understand preceptors' judgments of student performance.

Clinical supervisors are known to assess trainee performance idiosyncratically, causing concern about the validity of their ratings. The literature on this issue relies heavily on retrospective collection of decisions, resulting in the risk of inaccurate information regarding what actually drives raters' perceptions. Capturing in-the-moment information about supervisors' impressions could yield better insight into how to intervene. The purpose of this study, therefore, was to gather "real-time" judgments to explore what drives preceptors' judgments of student performance. We performed a prospective study in which physicians were asked to adjust a rating scale in real-time while watching two video-recordings of trainee clinical performances. Scores were captured in 1-s increments, examined for frequency, direction, and magnitude of adjustments, and compared to assessors' final entrustability judgment as measured by the modified Ottawa Clinic Assessment Tool. The standard deviation in raters' judgment was examined as a function of time to determine how long it takes impressions to begin to vary. 20 participants viewed 2 clinical vignettes. Considerable variability in ratings was observed with different behaviours triggering scale adjustments for different raters. That idiosyncrasy occurred very quickly, with the standard deviation in raters' judgments rapidly increasing within 30 s of case onset. Particular moments appeared to generally be influential, but their degree of influence still varied. Correlations between the final assessment and (a) score assigned upon first adjustment of the scale, (b) upon last adjustment, and (c) the mean score, were r = 0.13, 0.32, and 0.57 for one video and r = 0.30, 0.50, and 0.52 for the other, indicating the degree to which overall impressions reflected accumulation of raters' idiosyncratic moment-by-moment observations. Our results demonstrated that variability in raters' impressions begins very early in a case presentation and is associated with different behaviours having different influence on different raters. More generally, this study outlines a novel methodology that offers a new path for gaining insight into factors influencing assessor judgments.

Cliques within the crowd: identifying medical conference attendee subgroups by their motivations for participation.

Conferences enable rapid information sharing and networking that are vital to career development within academic communities. Addressing diverse attendee needs is challenging and getting it wrong wastes resources and dampens enthusiasm for the field. This study explores whether, and how, motivations for attendance can be grouped in relation to preferences to offer guidance to organizers and attendees. A pragmatic constructivist case study approach using mixed methods was adopted. Semi-structured interviews completed with key informants underwent thematic analysis. Survey results outlining attendees' perspectives underwent cluster and factor analysis. Stakeholder interviews (n = 13) suggested attendees could be grouped by motivations predictable from level of specialisation in a field and past engagement with conferences. From n = 1229 returned questionnaires, motivations were clustered into three factors: learning, personal and social. Three groups of attendees were identified. Group 1 (n = 500; 40.7%) was motivated by all factors. Group 2 (n = 345; 28.1%) was mainly motivated by the learning factor. Group 3 (n = 188; 15.3%) scored the social factor highest for in-person conferences and the learning factor highest for virtual meetings. All three groups expressed a preference for hybrid conferences in the future. This study indicates that medical conference attendees can be clustered based on their learning, personal and social motivations for attendance. The taxonomy enables organizers to tailor conference formats with guidance on how to utilize hybrid conferences, thereby enabling better catering to attendees' desires for knowledge gain relative to networking.

Technology and clinician-learner interaction: how clinicians expect introduction of a new electronic health record to affect educational practice.

INTRODUCTION: Electronic health records (EHRs) are increasingly common platforms used in medical settings to capture and store patient information, but their implementation can have unintended consequences. One particular risk is damaging clinician-learner-interactions, but very little has been published about how EHR implementation affects educational practice. Given the importance of stakeholder engagement in change management, this research sought to explore how EHR implementation is anticipated to affect clinician-learner interactions, educational priorities and outcomes. METHODS: Semi-structured interviews were conducted with a group of practicing oncologists who work in outpatient clinics while also providing education to medical student and resident trainees. Data regarding perceived impact on the teaching dynamic between clinicians and learners were collected prior to implementation of an EHR and analyzed thematically. RESULTS: Physician educators expected EHR implementation to negatively influence their engagement in teaching and the learning they themselves normally gain through teaching interactions. Additionally, EHR implementation was expected to influence learners by changing what is taught and the students' role in clinical care and the educational dynamic. Potential benefits included harnessing learners' technological aptitude, modeling adaptive behaviour, and creating new ways for students to be involved in patient care. CONCLUSION: Anticipating the concerns clinicians have about EHR implementation offers both potential to manage change to minimize disruptions caused by implementation and a foundation from which to assess actual educational impacts.

Effect of station format on the psychometric properties of Multiple Mini Interviews.

BACKGROUND: Given the widespread use of Multiple Mini Interviews (MMIs), their impact on the selection of candidates and the considerable resources invested in preparing and administering them, it is essential to ensure their quality. Given the variety of station formats used and the degree to which that factor resides in the control of training programmes that we know so little about, format's effect on MMI quality is a considerable oversight. This study assessed the effect of two popular station formats (interview vs. role-play) on the psychometric properties of MMIs. METHODS: We analysed candidate data from the first 8 years of the Integrated French MMIs (IF-MMI) (2010-2017, n = 11 761 applicants), an MMI organised yearly by three francophone universities and administered at four testing sites located in two Canadian provinces. There were 84 role-play and 96 interview stations administered, totalling 180 stations. Mixed design analyses of variance (ANOVAs) were used to test the effect of station format on candidates' scores and stations' discrimination. Cronbach's alpha coefficients for interview and role-play stations were also compared. Predictive validity of both station formats was estimated with a mixed multiple linear regression model testing the relation between interview and role-play scores with average clerkship performance for those who gained entry to medical school (n = 462). RESULTS: Role-play stations (M = 20.67, standard deviation [SD] = 3.38) had a slightly lower mean score than interview stations (M = 21.36, SD = 3.08), p < 0.01, Cohen's d = 0.2. The correlation between role-play and interview stations scores was r = 0.5 (p < 0.01). Discrimination coefficients, Cronbach's alpha and predictive validity statistics did not vary by station format. CONCLUSION: Interview and role-play stations have comparable psychometric properties, suggesting format to be interchangeable. Programmes should select station format based on match to the personal qualities for which they are trying to select.

The Advice Given During Near-Peer Interactions Before and After Curriculum Change.

PhenomenonNear-peer interactions (NPIs) provide formal and informal mentorship that can allow medical students to share strategies for successful training. Such capacity to convey valuable advice, however, may depend on the similitude of experiences. Given that many factors can disrupt homogeneity, including curriculum renewal, we must better understand whether junior trainees feel disadvantaged when they do not have more senior peers with similar experiences. This study was, therefore, conducted to examine the focus of, and engagement with, advice available through NPIs during curriculum renewal. Approach: We used a generic exploratory qualitative research approach. Twenty MD undergraduate students, seven from the Class of 2019 (the first cohort post-curriculum change), and thirteen from the Class of 2020 (the first cohort with access to more senior students in the new curriculum), participated in semi-structured interviews. Anonymized transcriptions were analyzed with open, axial, and selective coding to generate themes until saturation was attained. Findings: Participants from the Class of 2019 reported having particularly few reasons to seek advice; because curriculum renewal disrupted their near peers' capacity to provide critical insights, students exerted little effort to learn from them. That said, this vacuum was not generally cause for concern. Deeper probing illustrated why: advice given during NPIs in both classes more commonly focused on nonacademic (e.g., work-life balance issues) than academic advice; academic advice, when sought or offered, tended not to be aimed at improving understanding of curriculum dependent content; and, while students in both classes welcomed advice, both were wary of accepting it at face value, precluding a sense of dependence on senior peers. Insights: Students' skepticism about the overall utility of academic advice raises a number of important issues for medical education and training. Positively, it shielded students from feeling loss when advice from similarly trained students was not available, reducing concerns about disadvantage that could arise during periods of curriculum revision. On the other hand, knowing that what students perceive and what educators claim to be important aspects of training can be at odds and knowing that self-assessment is flawed makes it surprising and unsettling, respectively, that participants so readily treated the lessons learned by those who came before them as irrelevant.

Informing the research agenda for optimizing audit and feedback interventions: results of a prioritization exercise.

BACKGROUND: Audit and feedback (A&F) interventions are one of the most common approaches for implementing evidence-based practices. A key barrier to more effective A&F interventions is the lack of a theory-guided approach to the accumulation of evidence. Recent interviews with theory experts identified 313 theory-informed hypotheses, spread across 30 themes, about how to create more effective A&F interventions. In the current survey, we sought to elicit from stakeholders which hypotheses were most likely to advance the field if studied further. METHODS: From the list of 313, three members of the research team identified 216 that were clear and distinguishable enough for prioritization. A web-based survey was then sent to 211 A&F intervention stakeholders asking them to choose up to 50 'priority' hypotheses following the header "A&F interventions will be more effective if…". Analyses included frequencies of endorsement of the individual hypotheses and themes into which they were grouped. RESULTS: 68 of the 211 invited participants responded to the survey. Seven hypotheses were chosen by > 50% of respondents, including A&F interventions will be more effective… "if feedback is provided by a trusted source"; "if recipients are involved in the design/development of the feedback intervention"; "if recommendations related to the feedback are based on good quality evidence"; "if the behaviour is under the control of the recipient"; "if it addresses barriers and facilitators (drivers) to behaviour change"; "if it suggests clear action plans"; and "if target/goal/optimal rates are clear and explicit". The most endorsed theme was Recipient Priorities (four hypotheses were chosen 92 times as a 'priority' hypotheses). CONCLUSIONS: This work determined a set of hypotheses thought by respondents to be to be most likely to advance the field through future A&F intervention research. This work can inform a coordinated research agenda that may more efficiently lead to more effective A&F interventions.

Incentives for clinical teachers: On why their complex influences should lead us to proceed with caution.

INTRODUCTION: When medical education programs have difficulties recruiting or retaining clinical teachers, they often introduce incentives to help improve motivation. Previous research, however, has shown incentives can unfortunately have unintended consequences. When and why that is the case in the context of incentivizing clinical teachers remains unclear. The purposes of this study, therefore, were to understand what values and motivations influence teaching decisions; and to delve deeper into how teaching incentives have been perceived. METHODS: An interpretive description methodology was used to improve understanding of the development and delivery of teaching incentives. A purposeful sampling strategy identified a heterogenous sample of clinical faculty teaching in undergraduate and postgraduate contexts. Sixteen semi-structured interviews were conducted and transcripts were analyzed using an iterative process to develop a thematic structure that accounts for general trends and individual variations. RESULTS: Clinicians articulated interrelated and dynamic personal and environmental factors that had linear, dual-edged and inverted U-shaped impacts on their motivations towards teaching. Barriers were frequently rationalized away, but cumulative barriers often led to teaching attrition. Clinical teachers were motivated when they felt valued and connected to their learners, peers, leadership, and/or the medical education community. While incentives aimed at producing these connections could be perceived as supportive, they could also negatively impact motivation if they were impersonal, inequitable, inefficient, or poorly framed. DISCUSSION/CONCLUSION: These findings reinforce the literature suggesting that it is necessary to proceed with caution when labeling any particular factor as a motivator or barrier to teaching. They take us deeper, however, towards understanding how and why clinical teachers' perceptions are unique, dynamic and fluid. Incentive schemes can be beneficial for teacher recruitment and retention, but must be designed with nuance that takes into account what makes clinicians feel valued if the strategy is to do more good than harm.

The disconnect between knowing and doing in health professions education and practice.

Safe and effective healthcare requires that new knowledge or skills, once learned, are incorporated into professional practice. However, this process is not always straightforward. Learning takes place in complex contexts, requiring practitioners to overcome various motivational, systemic, emotional, and social barriers to the application of knowledge. This paper explores the mechanisms through which individuals translate knowledge into action to provide insight into why disconnects between knowledge and action can arise. As a critical review, the aim was to draw on key literature from multiple fields to analyse and synthesize existing schools of thought and lay a strong conceptual foundation on which knowledge to action gaps might be considered. We iteratively consulted clinicians and experts in various fields to guide literature searches focused on theoretical perspectives that could inform educational and research efforts around knowledge-to-action gaps. Key theoretical perspectives on motivation address when and how individuals decide to take action. Literatures from cognitive science address how clinicians and learners self-regulate to (sometimes) overcome barriers to action. Sociocultural theories examine the ways in which action might be prevented by social norms that conflict with what the individual knows and believes, potentially also giving rise to counter-normative action. No single perspective will entirely explain how health professionals and learners implement knowledge in practice. As a result, the authors offer multiple lenses through which to view the problem, and then propose how each of these lenses might better guide educational and research efforts to untangle this challenging but important issue.

Accuracy of self-monitoring: does experience, ability or case difficulty matter?

CONTEXT: The ability to self-monitor one's performance in clinical settings is a critical determinant of safe and effective practice. Various studies have shown this form of self-regulation to be more trustworthy than aggregate judgements (i.e. self-assessments) of one's capacity in a given domain. However, little is known regarding what cues inform learners' self-monitoring, which limits an informed exploration of interventions that might facilitate improvements in self-monitoring capacity. The purpose of this study is to understand the influence of characteristics of the individual (e.g. ability) and characteristics of the problem (e.g. case difficulty) on the accuracy of self-monitoring by medical students. METHODS: In a cross-sectional study, 283 medical students from 5 years of study completed a computer-based clinical reasoning exercise. Confidence ratings were collected after completing each of six cases and the accuracy of self-monitoring was considered to be a function of confidence when the eventual answer was correct relative to when the eventual answer was incorrect. The magnitude of that difference was then explored as a function of year of seniority, gender, case difficulty and overall aptitude. RESULTS: Students demonstrated accurate self-monitoring by virtue of giving higher confidence ratings (57.3%) and taking a shorter time to work through cases (25.6 seconds) when their answers were correct relative to when they were wrong (41.8% and 52.0 seconds, respectively; p< 0.001 and d > 0.5 in both instances). Self-monitoring indices were related to student seniority and case difficulty, but not to overall ability or student gender. CONCLUSIONS: This study suggests that the accuracy of self-monitoring is context specific, being heavily influenced by the struggles students experience with a particular case rather than reflecting a generic ability to know when one is right or wrong. That said, the apparent capacity to self-monitor increases developmentally because increasing experience provides a greater likelihood of success with presented problems.

Situational cues surrounding family physicians seeking external resources while self-monitoring in practice.

Many models of safe and effective clinical decision making in medical practice emphasize the importance of recognizing moments of uncertainty and seeking help accordingly. This is not always done effectively, but we know little about what cues prompt health professionals to call on resources beyond their own knowledge or skill set. Such information would offer guidance regarding how systems might be designed to offer better individual support. In this study, the authors explored the situational factors that are present during moments of uncertainty that lead primary care physicians to access external resources. To do so, a generic qualitative exploratory analysis was conducted on 72 narratives collected through audio recorder-based, self-observational, journaling completed by 12 purposively selected family physicians. Participants were asked to provide a detailed descriptive account of the circumstances surrounding their consultation of external resources immediately after 6 sequential patient encounters in which they felt compelled to seek such support. Thematic analysis of the transcripts was performed to better understand participants' experiences of the social, contextual, and personal features surrounding decisions to seek support. When doing so we observed that specific features of patient encounters were routinely present when physicians decided to access external sources for help. These included medical aspects of the case (e.g., complex presentations), social aspects (e.g., the presence of another individual), and personal factors (e.g., feeling a need for reassurance). External resources were seen as an opportunity for verification, a mechanism to increase patient satisfaction, and a means through which to defend decision-making. Accessing such resources appeared to influence the physician-patient relationship for various reasons. Recognition and further study of the cues that prompt use of external information will further our understanding of physicians' behavioural responses to challenging/uncertain situations, highlight mechanisms through which a culture of self-directed assessment seeking might be encouraged, and offer guidance regarding ways in which physicians can be encouraged to practice mindfully. Our results make it clear that reasons for which primary care physicians seek the support of external resources may be multifactorial and, therefore, one should be cautious when inferring reasons for the pursuit of such support.

Comfort with uncertainty: reframing our conceptions of how clinicians navigate complex clinical situations.

Learning to take safe and effective action in complex settings rife with uncertainty is essential for patient safety and quality care. Doing so is not easy for trainees, as they often consider certainty to be a necessary precursor for action and subsequently struggle in these settings. Understanding how skillful clinicians work comfortably when uncertain, therefore, offers an important opportunity to facilitate trainees' clinical reasoning development. This critical review aims to define and elaborate the concept of 'comfort with uncertainty' in clinical settings by juxtaposing a variety of frameworks and theories in ways that generate more deliberate ways of thinking about, and researching, this phenomenon. We used Google Scholar to identify theoretical concepts and findings relevant to the topics of 'uncertainty,' 'ambiguity,' 'comfort,' and 'confidence,' and then used preliminary findings to pursue parallel searches within the social cognition, cognition, sociology, sociocultural, philosophy of medicine, and medical education literatures. We treat uncertainty as representing the lived experience of individuals, reflecting the lack of confidence one feels that he/she has an incomplete mental representation of a particular problem. Comfort, in contrast, references confidence in one's capabilities to act (or not act) in a safe and effective manner given the situation. Clinicians' 'comfort with uncertainty' is informed by a variety of perceptual, emotional, and situational cues, and is enabled through a combination of self-monitoring and forward planning. Potential implications of using 'comfort with uncertainty' as a framework for educational and research programs are explored.

Twelve tips for constructing a multiple mini-interview.

Health professions the world over value various competencies in their practitioners that are not easily captured by academic measures of performance. As a result, many programs have begun using multiple mini-interviews (MMIs) to facilitate the selection of candidates who are most likely to demonstrate and further develop such qualities. In this twelve-tips article, the authors offer evidence- and experience-based advice regarding how to construct an MMI that is fit for purpose. The tips are provided chronologically, offering guidance regarding how one might conceptualize their goals for creating an MMI, how to establish a database of stations that are context appropriate, and how to prepare both candidates and examiners for their task. While MMIs have been shown to have utility in many instances, the authors urge caution against over-generalization by stressing the importance of post-MMI considerations including data monitoring and integration between one's admissions philosophy and one's curricular efforts.