Mentorship in medicine is a Complex opportunity.

Mentorship is now recognized as essential to the personal and professional development of physicians. Over the past decade, it has become a common theme in medical education literature, and through this our understanding of mentorship has evolved. Despite this progress, we believe that the prevailing reductionist view of mentorship is oversimplified and may hinder further advances in this space. Instead, we propose that mentorship be viewed through the lens of complexity theory, positioning it as a prototypical complex adaptive system. This shift in perspective will inform our mentorship interventions and evaluations, and can avoid the disappointment that invariably follows when we apply a simple approach to a complex situation.

How can we reduce bias during an academic assessment reappraisal?

Aims: To describe potential sources of bias during an academic assessment reappraisal and ways to mitigate these. Methods: We describe why the typical scenario of an academic assessment reappraisal - where committee members are asked to weigh contrasting accounts of past events that they did not witness, and to rate elusive constructs, such as "fairness" - is prone to multiple types of bias, including attribute substitution, default bias, confirmation bias, and impact bias. We also discuss how increased awareness of sources of bias and of debiasing strategies can improve the validity of decision making. Results: Strategies that can reduce bias in reappraisal include clearly articulating and focusing on the reappraisal question (did bias cause a wrong decision to be made?), educating those involved in the reappraisal of the types of bias that frequently occur in teaching and assessment (including biases that they themselves may introduce to the reappraisal), and ensuring that those involved in the reappraisal contribute equally to making decisions and recommendation. Conclusions: All academic assessments of students, particularly those that involve subjective ratings of performance, are prone to bias, which threatens the integrity of the assessment process. Given the high stakes of academic assessments, we feel that each medical school should have a process for assessment reappraisal that reduces, rather than compounds, the likelihood of wrong assessment decisions.

The grades that clinical teachers give students modifies the grades they receive.

Prior studies have shown a correlation between the grades students receive and how they rate their teacher in the classroom. In this study, the authors probe this association on clinical rotations and explore potential mechanisms. All In-Training Evaluation Reports (ITERs) for students on mandatory clerkship rotations from April 1, 2013 to January 31, 2015 were matched with the corresponding student's rating of their teacher (SRT). The date and time that ITERs and SRTs were submitted was used to divide SRTs into those submitted before versus after the corresponding ITER was submitted. Multilevel, mixed effects linear regression was used to examine the association between SRT, ITER rating, and whether the ITER was submitted before or after SRT. Of 2373 paired evaluations, 1098 (46.3%) SRT were submitted before the teacher had submitted the ITER. There was a significant interaction between explanatory variables: when ITER ratings had not yet been submitted, the regression coefficient for this association was 0.25 (95% confidence interval [0.17, 0.33], p < 0.001), whereas the regression coefficient was significantly higher when ITER ratings were submitted prior to SRT (0.40 [0.31, 0.49], p < 0.001). Finding an association between SRT and ITER when students do not know their ITER ratings suggests that SRTs can capture attributes of effective teaching, but the effect modification when students have access to their ITER rating supports grade satisfaction bias. Further studies are needed to explain the mechanism of grade satisfaction and to identify other biases that may impact the validity of SRT.

How teachers can help learners build storage and retrieval strength.

AIM: To be an effective teacher, content expertise is necessary but alone does not guarantee optimal learning outcomes for students. In this article, the authors discuss ways in which medical teachers can shape the learning of their students and enable them to become more efficient and effective learners. METHODS: Using Bjork and Bjork's new theory of disuse as their framework, the authors discuss strategies to improve storage strength of to-be-learned information and strategies to improve retrieval strength of learned information. RESULTS: Strategies to improve storage strength include optimizing cognitive load, providing causal explanations, and giving effective feedback. Strategies to improve retrieval strength include situated cognition and various types of retrieval practice. CONCLUSIONS: Adopting these teaching strategies should hopefully help teachers improve the learning outcomes of their students, but there is still a need for further research into the science of learning and the science of instruction, including comparative effectiveness of different teaching strategies and how best to translate findings from the psychology literature into medical education.

Weighing the cost of educational inflation in undergraduate medical education.

Despite the fact that the length of medical school training has remained stable for many years, the expectations of graduating medical students (and the schools that train them) continue to increase. In this Reflection, the authors discuss motives for educational inflation and suggest that these are likely innocent, well-intentioned, and subconscious-and include both a propensity to increase expectations of ourselves and others over time, and a reluctance to reduce training content and expectations. They then discuss potential risks of educational inflation, including reduced emphasis on core knowledge and clinical skills, and adverse effects on the emotional, psychological, and financial wellbeing of students. While acknowledging the need to change curricula to improve learning and clinical outcomes, the authors proffer that it is naïve to assume that we can inflate educational expectations at no additional cost. They suggest that before implementing and/or mandating change, we should consider of all the costs that medical schools and students might incur, including opportunity costs and the impact on the emotional and financial wellbeing of students. They propose a cost-effectiveness framework for medical education and advocate prioritization of interventions that improve learning outcomes with no additional costs or are cost-saving without adversely impacting learning outcomes. When there is an additional cost for improved learning outcomes or a decline in learning outcomes as a result of cost saving interventions, they suggest careful consideration and justification of this trade-off. And when there are neither improved learning outcomes nor cost savings they recommend resisting the urge to change.

Are we at risk of groupthink in our approach to teamwork interventions in health care?

CONTEXT: The incidence of medical error, adverse clinical events and poor quality health care is unacceptably high and there are data to suggest that poor coordination of care, or teamwork, contributes to adverse outcomes. So, can we assume that increased collaboration in multidisciplinary teams improves performance and health care outcomes for patients? METHODS: In this essay, the authors discuss some reasons why we should not presume that collective decision making leads to better decisions and collaborative care results in better health care outcomes. RESULTS: Despite an exponential increase in interventions designed to improve teamwork and interprofessional education (IPE), we are still lacking good quality data on whether these interventions improve important outcomes. There are reasons why some of the components of 'effective teamwork', such as shared mental models, team orientation and mutual trust, could impair delivery of health care. For example, prior studies have found that brainstorming results in fewer ideas rather than more, and hinders rather than helps productivity. There are several possible explanations for this effect, including 'social loafing' and cognitive overload. Similarly, attributes that improve cohesion within groups, such as team orientation and mutual trust, may increase the risk of 'groupthink' and group conformity bias, which may lead to poorer decisions. CONCLUSIONS: In reality, teamwork and IPE are not inherently good, bad or neutral; instead, as with any intervention, their effect is modified by the persons involved, the situation and the interaction between persons and situation. Thus, rather than assume better outcomes with teamwork and IPE interventions, as clinicians and educators we must demonstrate that our interventions improve the delivery of health care.

Making progress in the ethical treatment of medical trainees.

There is an inherent conflict within clinician educators as we balance the roles of healthcare provider to patients in need of care with that of educator of learners in need of teaching. In this essay we use Beauchamp and Childress' principles of biomedical ethics as a framework to compare the relationship that clinician educators have with their patients and their learners, and suggest that while we typically apply ethical principles when addressing the needs of our patients, these principles are frequently lacking in our interactions with learners. This dichotomy reflects a person-by-situation interaction that may be partly explained by the expectations of the regulatory bodies that define how clinicians should interact with patients and how educators should interact with learners. The result is that we may fall short in applying respect for autonomy, beneficence/nonmaleficence, and justice when addressing the needs of our learners. Fortunately there are ways in which we can incorporate these ethical principles into our interactions with learners while still adhering to accreditation standards and institutional policy. These include flipped classrooms and simulated learning experiences, incorporating aspects of instructional design that have been shown to improve learning outcomes, providing additional resources to learners with greater needs, and organizing training curricula around entrustable professional activities. Although the consistent application of ethical principles with all learners during all learning experiences is likely unachievable, we can, and should, move towards more ethical treatment of our learners.

The attributes of an effective teacher differ between the classroom and the clinical setting.

Most training programs use learners' subjective ratings of their teachers as the primary measure of teaching effectiveness. In a recent study we found that preclinical medical students' ratings of classroom teachers were associated with perceived charisma and physical attractiveness of the teacher, but not intellect. Here we explored whether the relationship between these variables and teaching effectiveness ratings holds in the clinical setting. We asked 27 Internal Medicine residents to rate teaching effectiveness of ten teachers with whom they had worked on a clinical rotation, in addition to rating each teacher's clinical skills, physical attractiveness, and charisma. We used linear regression to study the association between these explanatory variables and teaching effectiveness ratings. We found no association between rating of physical attractiveness and teaching effectiveness. Clinical skill and charisma were independently associated with rating of teaching effectiveness (regression coefficients [95 % confidence interval] 0.73 [0.60, 0.85], p < 0.001 and 0.12 [0.01, 0.23], p = 0.03, respectively). The variables associated with effectiveness of classroom and clinical teachers differ, suggesting context specificity in teaching effectiveness ratings. Context specificity may be explained by differences in the exposure that learners have to teachers in the classroom versus clinical setting-so that raters in the clinical setting may base ratings upon observed behaviours rather than stereotype data. Alternatively, since subjective ratings of teaching effectiveness inevitably incorporate learners' context-specific needs, the attributes that make a teacher effective in one context may not meet the needs of learners in a different context.

Working memory, reasoning, and expertise in medicine-insights into their relationship using functional neuroimaging.

Clinical reasoning is dependent upon working memory (WM). More precisely, during the clinical reasoning process stored information within long-term memory is brought into WM to facilitate the internal deliberation that affords a clinician the ability to reason through a case. In the present study, we examined the relationship between clinical reasoning and WM while participants read clinical cases with functional magnetic resonance imaging (fMRI). More specifically, we examined the impact of clinical case difficulty (easy, hard) and clinician level of expertise (2nd year medical students, senior gastroenterologists) on neural activity within regions of cortex associated with WM (i.e., the prefrontal cortex) during the reasoning process. fMRI was used to scan ten second-year medical students and ten practicing gastroenterologists while they reasoned through sixteen clinical cases [eight straight forward (easy) and eight complex (hard)] during a single 1-h scanning session. Within-group analyses contrasted the easy and hard cases which were then subsequently utilized for a between-group analysis to examine effects of expertise (novice > expert, expert > novice). Reading clinical cases evoked multiple neural activations in occipital, prefrontal, parietal, and temporal cortical regions in both groups. Importantly, increased activation in the prefrontal cortex in novices for both easy and hard clinical cases suggests novices utilize WM more so than experts during clinical reasoning. We found that clinician level of expertise elicited differential activation of regions of the human prefrontal cortex associated with WM during clinical reasoning. This suggests there is an important relationship between clinical reasoning and human WM. As such, we suggest future models of clinical reasoning take into account that the use of WM is not consistent throughout all clinical reasoning tasks, and that memory structure may be utilized differently based on level of expertise.

Hemispheric activation differences in novice and expert clinicians during clinical decision making.

Clinical decision making requires knowledge, experience and analytical/non-analytical types of decision processes. As clinicians progress from novice to expert, research indicates decision-making becomes less reliant on foundational biomedical knowledge and more on previous experience. In this study, we investigated how knowledge and experience were reflected in terms of differences in neural areas of activation. Novice and expert clinicians diagnosed simple or complex (easy, hard) cases while functional magnetic resonance imaging (fMRI) data were collected. Our results highlight key differences in the neural areas activated in novices and experts during the clinical decision-making process. fMRI data were collected from ten second year medical students (novices) and ten practicing gastroenterologists (experts) while they diagnosed sixteen (eight easy and eight hard) clinical cases via multiple-choice questions. Behavioral data were collected for diagnostic accuracy (correct/incorrect diagnosis) and time taken to assign a clinical diagnosis. Two analyses were performed with the fMRI data. First, data from easy and hard cases were compared within respective groups (easy > hard, hard > easy). Second, neural differences between novices and experts (novice > expert, expert > novice) were assessed. Experts correctly diagnosed more cases than novices and made their diagnoses faster than novices on both easy and hard cases (all p's < 0.05). Time taken to diagnose hard cases took significantly longer for both novices and experts. While similar neural areas were activated in both novices and experts during the decision making process, we identified significant hemispheric activation differences between novice and expert clinicians when diagnosing hard clinical cases. Specifically, novice clinicians had greater activations in the left anterior temporal cortex and left ventral lateral prefrontal cortex whereas expert clinicians had greater activations in the right dorsal lateral, right ventral lateral, and right parietal cortex. Hemispheric differences in activation were not observed between novices and experts while diagnosing easy clinical cases. While clinical decision-making engaged the prefrontal cortex (PFC) in both novices and experts, interestingly we observed expertise related differences in the regions and hemispheres of PFC activation between these groups for hard clinical cases. Specifically, in novices we observed activations in left hemisphere neural regions associated with factual rule-based knowledge, whereas in experts we observed right hemisphere activation in neural regions associated with experiential knowledge. Importantly, at the neural level, our data highlight differences in so called type 2 clinical decision-making processes related to prior knowledge and experience.

How do medical students form impressions of the effectiveness of classroom teachers?

CONTEXT: Teaching effectiveness ratings (TERs) are used to provide feedback to teachers on their performance and to guide decisions on academic promotion. However, exactly how raters make decisions on teaching effectiveness is unclear. OBJECTIVES: The objectives of this study were to identify variables that medical students appraise when rating the effectiveness of a classroom teacher, and to explore whether the relationships among these variables and TERs are modified by the physical attractiveness of the teacher. METHODS: We asked 48 Year 1 medical students to listen to 2-minute audio clips of 10 teachers and to describe their impressions of these teachers and rate their teaching effectiveness. During each clip, we displayed either an attractive or an unattractive photograph of an unrelated third party. We used qualitative analysis followed by factor analysis to identify the principal components of teaching effectiveness, and multiple linear regression to study the associations among these components, type of photograph displayed, and TER. RESULTS: We identified two principal components of teaching effectiveness: charisma and intellect. There was no association between rating of intellect and TER. Rating of charisma and the display of an attractive photograph were both positively associated with TER and a significant interaction between these two variables was apparent (p < 0.001). The regression coefficient for the association between charisma and TER was 0.26 (95% confidence interval [CI] 0.10-0.41) when an attractive picture was displayed and 0.83 (95% CI 0.66-1.00) when an unattractive picture was displayed (p < 0.001). CONCLUSIONS: When medical students rate classroom teachers, they consider the degree to which the teacher is charismatic, although the relationship between this attribute and TER appears to be modified by the perceived physical attractiveness of the teacher. Further studies are needed to identify other variables that may influence subjective ratings of teaching effectiveness and to evaluate alternative strategies for rating teaching effectiveness.

Filling in the gaps of clerkship with a comprehensive clinical skills curriculum.

Although the clinical clerkship model is based upon sound pedagogy, including theories of social learning and situated learning, studies evaluating clinical performance of residents suggests that this model may not fully meet the learning needs of students. Here our objective was to design a curriculum to bridge the learning gaps of the existing clerkship model and then evaluate the impact of this on performance on clerkship summative evaluations. We followed Kern's framework to design our curriculum and then compared performance on the clerkship objective structured clinical examination (OSCE), all summative clerkship multiple choice question (MCQ) examinations, and the Medical Council of Canada Qualifying Examination (MCCQE) Part 1 before and after the introduction of our curriculum. In the 2 years following the introduction of our clinical skills curriculum the mean score on the clerkship OSCE was significantly higher than in the 2 years prior to our curriculum [67.12 (5.3) vs. 62.44 (4.93), p < 0.001, d = 0.91]. With the exception of the surgical clerkship MCQ, performance on all clerkship summative MCQ examinations and MCCQE Part 1 was significantly higher following the introduction of our curriculum. In this study we found a significant improvement in the performance on clerks on summative evaluations of knowledge and clinical skills following the introduction of our clinical skills curriculum. Given the unpredictable nature of clinical rotations, the clerkship will always be a risk of failing to deliver the intended curriculum-so medical schools should continue to explore and evaluate ways of changing the delivery of clerkship training to improve learning outcomes.

Can we predict failure in licensure exams from medical students' undergraduate academic performance?

BACKGROUND: In 2015, the Medical Council of Canada increased the minimum pass level for the Medical Council of Canada Qualifying Examination Part I, and students had a higher rate of failure than in previous years. The purpose of this study was to predict students at an increased odds of examination failure to allow for early, targeted interventions. METHODS: We divided our dataset into a derivation cohort and two validation cohorts and used multiple logistic regression to predict licensing examination failure. We then performed receiver operating characteristics and a sensitivity analysis using different cutoffs for explanatory variables to identify the cutoff threshold with the best predictive value at identifying students at increased odds of failure. RESULTS: After multivariate analysis, only pre-clerkship GPA was a significant independent predictor of failure (OR 0.76, 95% CI [0.66, 0.88], p < 0.001). The probability of failure increased steeply when the pre-clerkship GPA fell below 80% and 76% was found to be the most efficient cutoff for predicting failure (OR 9.37, 95% CI [3.08, 38.41]). CONCLUSIONS: Pre-clerkship performance can predict students at increased odds of licensing examination failure. Further studies are needed to explore whether early interventions for at-risk students alter their examination performance.

CONTEXTE: En 2015, le Conseil médical du Canada a resserré les exigences de réussite à l'examen d'aptitude du Conseil médical du Canada, partie I, entraînant un taux d'échec plus élevé que les années précédentes. L'objectif de cette étude était de détecter les étudiants ayant de plus grande probabilité d'échec à l'examen afin de permettre des interventions ciblées en temps utile. MÉTHODES: Nous avons comparé les données d'une cohorte de dérivation et deux cohortes de validation et nous avons utilisé la régression logistique multiple pour prédire l'échec à l'examen d'aptitude. Nous avons ensuite effectué une analyse de la fonction d'efficacité du récepteur et une analyse de sensibilité en utilisant différents seuils pour les variables explicatives afin de déterminer la meilleure valeur prédictive seuil pour cibler une forte possibilité d'échec chez les étudiants. RÉSULTATS: L'analyse multivariée a révélé que seule la moyenne générale des étudiants était un prédicteur indépendant significatif de l'échec (OR 0.76, 95 % CI [0.66, 0.88], p < 0.001). La probabilité d'échec augmentait fortement lorsque l'indice de moyenne générale tombait en dessous de 80 %. Le seuil le plus efficace pour prédire l'échec s'est avéré être 76 % (OR 9,37, 95 % CI [3,08, 38,41]). CONCLUSIONS: Les résultats scolaires des étudiants en médecine constituent un indicateur de risque d'échec à l'examen d'aptitude. Des études supplémentaires sont nécessaires pour vérifier si une intervention précoce auprès des étudiants à risque peut améliorer leurs résultats à l'examen.

Training the endoscopy trainer: from general principles to specific concepts.

Endoscopy instruction has progressed a great deal in recent years, evolving from the age-old dictum of 'see one, do one' to the current skillful application of sound educational principles. Some of these educational principles are generic and applicable to the teaching of any content at all levels, while others are quite specific to technical skills training. The present review summarizes these important principles under the following headings: creating a learner-centred curriculum; delivering an achievable learning task; and moving from theory to practice. The present article challenges national gastroenterology organizations to embrace these concepts in structured, outcome-based educational programs.

Early use of magnetic endoscopic imaging by novice colonoscopists: improved performance without increase in workload.

BACKGROUND: Magnetic endoscopic imaging represents a recent advance in colonoscopy training. This technique provides adjunct information to the endoscopist, specifically with regard to colonoscope loop formation. OBJECTIVE: To examine the effect of a magnetic endoscopic imager on novice performance and workload in colonoscopy. METHODS: Twenty complete novices received an introductory teaching session followed by the completion of two procedures on a colonoscopy model. One-half of the participants performed their first procedure with the imager, and the second procedure without, while the other one-half were trained with the inverse sequence. Two main outcome measures were recorded: distance achieved and total workload as measured by the National Aeronautics and Space Administration task load index tool. RESULTS: A significant improvement was noted between the first and second colonoscopies, with the best performance recorded for participants who performed their first procedure with the imager, and their second without. The imager did not significantly change the total workload.  DISCUSSION: The study participants paid attention to the magnetic endoscopic imager; however, this did not translate into a measurable increase in novice workload. A delayed learning benefit was conferred to the group exposed to the imager on their first colonoscopy, suggesting that, even at an early training stage, the additional imager information entered working memory and was processed in a useful fashion. The introductory teaching strategy used in the present study was successful as judged by the overall distance achieved and performance improvement seen in all study participants.

Teaching in small portions dispersed over time enhances long-term knowledge retention.

BACKGROUND: A primary goal of education is to promote long-term knowledge storage and retrieval. OBJECTIVE: A prospective interventional study design was used to investigate our research question: Does a dispersed curriculum promote better short- and long-term retention over a massed course? METHODS: Participants included 20 gastroenterology residents from the University of Calgary (N = 10) and University of Toronto (N = 10). Participants completed a baseline test of nutrition knowledge. The nutrition course was imparted to University of Calgary residents for 4 h occurring 1 h weekly over 4 consecutive weeks: dispersed delivery (DD). At the University of Toronto the course was taught in one 4h academic half-day: massed delivery (MD). Post-curriculum tests were administered at 1 week and 3 months to assess knowledge retention. RESULTS: The baseline scores were 46.39 +/- 6.14% and 53.75 +/- 10.69% in the DD and MD groups, respectively. The 1 week post-test scores for the DD and MD groups were 81.67 +/- 8.57%, p < 0.001 and 78.75 +/- 4.43, p < 0.001 which was significantly higher than baseline. The 3-month score was significantly higher in the DD group, but not in the MD group (65.28 +/- 9.88%, p = 0.02 vs. 58.93 +/- 12.06%, p = 0.18). The absolute pre-test to 1-week post-test difference was significantly higher at 35.28 +/- 7.65% among participants in the DD group compared to 25.0 +/- 11.80% in the MD group, p = 0.048. Similarly, the absolute pre-test to 3-month post-test difference was significantly higher at 18.9 +/- 6.7% among the participants in the DD group, compared to 6.8 +/- 11.8% in the MD group, p = 0.021. CONCLUSIONS: Long-term nutrition knowledge is improved with DD compared with MD.