Exploring the use of metacognitive monitoring cues following a diagram completion intervention.

Studying texts constitutes a significant part of student learning in health professions education. Key to learning from text is the ability to effectively monitor one's own cognitive performance and take appropriate regulatory steps for improvement. Inferential cues generated during a learning experience typically guide this monitoring process. It has been shown that interventions to assist learners in using comprehension cues improve their monitoring accuracy. One such intervention is having learners to complete a diagram. Little is known, however, about how learners use cues to shape their monitoring judgments. In addition, previous research has not examined the difference in cue use between categories of learners, such as good and poor monitors. This study explored the types and patterns of cues used by participants after being subjected to a diagram completion task prior to their prediction of performance (PoP). Participants' thought processes were studied by means of a think-aloud method during diagram completion and the subsequent PoP. Results suggest that relying on comprehension-specific cues may lead to a better PoP. Poor monitors relied on multiple cue types and failed to use available cues appropriately. They gave more incorrect responses and made commission errors in the diagram, which likely led to their overconfidence. Good monitors, on the other hand, utilized cues that are predictive of learning from the diagram completion task and seemed to have relied on comprehension cues for their PoP. However, they tended to be cautious in their judgement, which probably made them underestimate themselves. These observations contribute to the current understanding of the use and effectiveness of diagram completion as a cue-prompt intervention and provide direction for future research in enhancing monitoring accuracy.

In experts' words: Translating theory to practice for teaching self-regulated learning.

INTRODUCTION: Health professions education (HPE) should help students to competently self-regulate their learning, preparing them for future challenges. This study explored the perspectives of expert self-regulated learning (SRL) researchers and practitioners on the practical integration of SRL theories into teaching. METHODS: An exploratory qualitative research study was conducted involving semi-structured interviews with acknowledged research leaders in the field of SRL and/or experienced professionals dedicated to teaching SRL strategies for complex skills in different disciplines. The data were analyzed using an iterative thematic approach guided by a six-step framework. RESULTS: Fifteen interviews were conducted with experts from six countries representing diverse contexts, cultures, and disciplines. We identified five themes related to translating theory to practice for teaching SRL in HPE: theoretical issues, cultural aspects, stakeholders' participation, teaching complexity, assessment, and feedback. CONCLUSIONS: This study presents a useful starting point for teaching SRL. The experts suggest a supportive learning environment with the guidance of competent teachers by using general and task-specific teaching and learning strategies, as well as sufficient sources and cycles of feedback, all tailored to the culture and context. These findings call for a shift in faculty development programs to foster teachers to support second-order scaffolding in HPE.

Twelve tips for applying the think-aloud method to capture cognitive processes.

The think-aloud method is an established technique for studying human thought (cognitive) processes. Problem-solving and decision-making are essential skills for medical professionals, and the cognitive processes underlying these skills are complex. Studying these thought processes would enable educators, clinicians, and researchers to modify or refine their approaches and interventions. The think-aloud method has been utilized for capturing cognitive processes in a variety of fields, including computer usability, sports and cognitive psychology. Medical education also recognizes thought processes as valuable data for research and education. This article aims to guide researchers and educators through the preparation and implementation of a think-aloud method to record participants' thought processes during an activity.

Basic psychological needs satisfaction as a mediator between clinical learning climate, self-regulated learning and perceived learning in the nursing education context.

PURPOSE: Self-regulated learning (SRL) can enhance students' learning process. Students need support to effectively regulate their learning. However, the effect of learning climate on SRL behavior, its ultimate effect on learning and the underlying mechanisms have not yet been established. We explored these relationships using self-determination theory. MATERIALS AND METHODS: Nursing students (N = 244) filled in questionnaires about SRL behavior, perceived learning, perceived pedagogical atmosphere and Basic Psychological Needs (BPN) satisfaction after their clinical placement. Structural equation modelling was used to test a model in which perceived pedagogical atmosphere affects SRL behavior and subsequent perceived learning through BPN satisfaction. RESULTS: The tested model had an adequate fit (RMSEA = 0.080, SRMR = 0.051; CFI = 0.972; TLI = 0.950). A positively perceived pedagogical atmosphere contributed to SRL behavior, which was fully explained by BPN satisfaction. SRL partially mediated the contribution of pedagogical atmosphere/BPN to perceived learning. CONCLUSIONS: A learning climate that satisfies students' BPN contributes to their SRL behavior. SRL behavior plays a positive but modest role in the relationship between climate and perceived learning. Without a culture that is supportive of learning, implementation of tools to apply SRL behavior may not be effective. Study limitations include reliance on self-report scales and the inclusion of a single discipline.

Skeptical self-regulation: Resident experiences of uncertainty about uncertainty.

OBJECTIVES: Managing uncertainty is central to expert practice, yet how novice trainees navigate these moments is likely different than what has been described by experienced clinicians. Exploring trainees' experiences with uncertainty could therefore help explicate the unique cues that they attend to, how they appraise their comfort in these moments and how they enact responses within the affordances of their training environment. METHODS: Informed by constructivist grounded theory, we explored how novice emergency medicine trainees experienced and managed clinical uncertainty in practice. We used a critical incident technique to prompt participants to reflect on experiences with uncertainty immediately following a clinical shift, exploring the cues they attended to and the approaches they used to navigate these moments. Two investigators coded line-by-line using constant comparison, organising the data into focused codes. The research team discussed the relationships between these codes and developed a set of themes that supported our efforts to theorise about the phenomenon. RESULTS: We enrolled 13 trainees in their first two years of postgraduate training across two institutions. They expressed uncertainty about the root causes of the patient problems they were facing and the potential management steps to take, but also expressed a pervasive sense of uncertainty about their own abilities and their appraisals of the situation. This, in turn, led to challenges with selecting, interpreting and using the cues in their environment effectively. Participants invoked several approaches to combat this sense of uncertainty about themselves, rehearsing steps before a clinical encounter, checking their interpretations with others and implicitly calibrating their appraisals to those of more experienced team members. CONCLUSIONS: Trainees' struggles with the legitimacy of their interpretations impact their experiences with uncertainty. Recognising these ongoing struggles may enable supervisors and other team members to provide more effective scaffolding, validation and calibration of clinical judgments and patient management.

Warning bells: How clinicians leverage their discomfort to manage moments of uncertainty.

OBJECTIVES: It remains unclear how medical educators can more effectively bridge the gap between trainees' intolerance of uncertainty and the tolerance that experienced physicians demonstrate in practice. Exploring how experienced clinicians experience, appraise and respond to discomfort arising from uncertainty could provide new insights regarding the kinds of behaviours we are trying to help trainees achieve. METHODS: We used a constructivist grounded theory approach to explore how emergency medicine faculty experienced, managed and responded to discomfort in settings of uncertainty. Using a critical incident technique, we asked participants to describe case-based experiences of uncertainty immediately following a clinical shift. We used probing questions to explore cognitive, emotional and somatic manifestations of discomfort, how participants had appraised and responded to these cues, and how they had used available resources to act in these moments of uncertainty. Two investigators coded the data line by line using constant comparative analysis and organised transcripts into focused codes. The entire research team discussed relationships between codes and categories, and developed a conceptual framework that reflected the possible relationships between themes. RESULTS: Participants identified varying levels of discomfort in their case descriptions. They described multiple cues alerting them to problems that were evolving in unexpected ways or problems with aspects of management that were beyond their abilities. Discomfort served as a trigger for participants to monitor a situation with greater attention and to proceed more intentionally. It also served as a prompt for participants to think deliberately about the types of human and material resources they might call upon strategically to manage these uncertain situations. CONCLUSIONS: Discomfort served as a dynamic means to manage and respond to uncertainty. To be 'tolerant' of uncertainty thus requires clinicians to embrace discomfort as a powerful tool with which to grapple with the complex problems pervasive in clinical practice.

Undergraduate Radiology Education During the COVID-19 Pandemic: A Review of Teaching and Learning Strategies [Formula: see text].

The Coronavirus disease 2019 (COVID-19) pandemic has altered how medical education is delivered, worldwide. Didactic sessions have transitioned to electronic/online platforms and clinical teaching opportunities are limited. These changes will affect how radiology is taught to medical students at both the pre-clerkship (ie, year 1 and 2) and clinical (ie, year 3 and 4) levels. In the pre-clerkship learning environment, medical students are typically exposed to radiology through didactic lectures, integrated anatomy laboratories, case-based learning, and ultrasound clinical skills sessions. In the clinical learning environment, medical students primarily shadow radiologists and radiology residents and attend radiology resident teaching sessions. These formats of radiology education, which have been the tenets of the specialty, pose significant challenges during the pandemic. This article reviews how undergraduate radiology education is affected by COVID-19 and explores solutions for teaching and learning based on e-learning and blended learning theory.

Communication skills supervisors' monitoring of history-taking performance: an observational study on how doctors and non-doctors use cues to prepare feedback.

BACKGROUND: Medical students need feedback to improve their patient-interviewing skills because self-monitoring is often inaccurate. Effective feedback should reveal any discrepancies between desired and observed performance (cognitive feedback) and indicate metacognitive cues which are diagnostic of performance (metacognitive feedback). We adapted a cue-utilization model to studying supervisors' cue-usage when preparing feedback and compared doctors' and non-doctors' cue usage. METHOD: Twenty-one supervisors watched a video of a patient interview, choose scenes for feedback, and explained their selection. We applied content analysis to categorize and count cue-use frequency per communication pattern (structuring/facilitating) and scene performance rating (positive/negative) for both doctors and non-doctors. RESULTS: Both groups used cognitive cues more often than metacognitive cues to explain their scene selection. Both groups also used metacognitive cues such as subjective feelings and mentalizing cues, but mainly the doctors mentioned 'missing information' as a cue. Compared to non-doctors, the doctors described more scenes showing negative performance and fewer scenes showing positive narrative-facilitating performance. CONCLUSIONS: Both groups are well able to communicate their observations and provide cognitive feedback on undergraduates' interviewing skills. To improve their feedback, supervisors should be trained to also recognize metacognitive cues, such as subjective feelings and mentalizing cues, and learn how to convert both into metacognitive feedback.

Is there a superior simulator for human anatomy education? How virtual dissection can overcome the anatomic and pedagogic limitations of cadaveric dissection.

Educators must select the best tools to teach anatomy to future physicians and traditionally, cadavers have always been considered the "gold standard" simulator for living anatomy. However, new advances in technology and radiology have created new teaching tools, such as virtual dissection, which provide students with new learning opportunities. Virtual dissection is a novel way of studying human anatomy through patient computed tomography (CT) scans. Through touchscreen technology, students can work together in groups to "virtually dissect" the CT scans to better understand complex anatomic relationships. This article presents the anatomic and pedagogic limitations of cadaveric dissection and explains what virtual dissection is and how this new technology may be used to overcome these limitations.

Monitoring and regulation of learning in medical education: the need for predictive cues.

CONTEXT: Being able to accurately monitor learning activities is a key element in self-regulated learning in all settings, including medical schools. Yet students' ability to monitor their progress is often limited, leading to inefficient use of study time. Interventions that improve the accuracy of students' monitoring can optimise self-regulated learning, leading to higher achievement. This paper reviews findings from cognitive psychology and explores potential applications in medical education, as well as areas for future research. COGNITIVE PSYCHOLOGY: Effective monitoring depends on students' ability to generate information ('cues') that accurately reflects their knowledge and skills. The ability of these 'cues' to predict achievement is referred to as 'cue diagnosticity'. Interventions that improve the ability of students to elicit predictive cues typically fall into two categories: (i) self-generation of cues and (ii) generation of cues that is delayed after self-study. Providing feedback and support is useful when cues are predictive but may be too complex to be readily used. APPLICATION TO MEDICAL EDUCATION: Limited evidence exists about interventions to improve the accuracy of self-monitoring among medical students or trainees. Developing interventions that foster use of predictive cues can enhance the accuracy of self-monitoring, thereby improving self-study and clinical reasoning. First, insight should be gained into the characteristics of predictive cues used by medical students and trainees. Next, predictive cue prompts should be designed and tested to improve monitoring and regulation of learning. Finally, the use of predictive cues should be explored in relation to teaching and learning clinical reasoning. CONCLUSIONS: Improving self-regulated learning is important to help medical students and trainees efficiently acquire knowledge and skills necessary for clinical practice. Interventions that help students generate and use predictive cues hold the promise of improved self-regulated learning and achievement. This framework is applicable to learning in several areas, including the development of clinical reasoning.

The potential of neuroscience for health sciences education: towards convergence of evidence and resisting seductive allure.

Since emergence of the field 'Educational Neuroscience' (EN) in the late nineties of the previous century, a debate has emerged about the potential this field holds to influence teaching and learning in the classroom. By now, most agree that the original claims promising direct translations to teaching and learning were too strong. I argue here that research questions in (health professions) education require multi-methodological approaches, including neuroscience, while carefully weighing what (combination of) approaches are most suitable given a research question. Only through a multi-methodological approach will convergence of evidence emerge, which is so desperately needed for improving teaching and learning in the classroom. However, both researchers and teachers should become aware of the so-called 'seductive allure' of EN; that is, the demonstrable physical location and apparent objectivity of the measurements can be interpreted as yielding more powerful evidence and warranting stronger conclusions than, e.g., behavioral experiments, where in fact oftentimes the reverse is the case. I conclude that our tendency as researchers to commit ourselves to one methodological approach and to addressing educational research questions from a single methodological perspective is limiting progress in educational science and in translation to education.

Systematic viewing in radiology: seeing more, missing less?

To prevent radiologists from overlooking lesions, radiology textbooks recommend "systematic viewing," a technique whereby anatomical areas are inspected in a fixed order. This would ensure complete inspection (full coverage) of the image and, in turn, improve diagnostic performance. To test this assumption, two experiments were performed. Both experiments investigated the relationship between systematic viewing, coverage, and diagnostic performance. Additionally, the first investigated whether systematic viewing increases with expertise; the second investigated whether novices benefit from full-coverage or systematic viewing training. In Experiment 1, 11 students, ten residents, and nine radiologists inspected five chest radiographs. Experiment 2 had 75 students undergo a training in either systematic, full-coverage (without being systematic) or non-systematic viewing. Eye movements and diagnostic performance were measured throughout both experiments. In Experiment 1, no significant correlations were found between systematic viewing and coverage, r = -.10, p = .62, and coverage and performance, r = -.06, p = .74. Experts were significantly more systematic than students F2,25 = 4.35, p = .02. In Experiment 2, significant correlations were found between systematic viewing and coverage, r = -.35, p < .01, but not between coverage and performance, r = .13, p = .31. Participants in the full-coverage training performed worse compared with both other groups, which did not differ between them, F2,71 = 3.95, p = .02. In conclusion, the data question the assumption that systematic viewing leads to increased coverage, and, consequently, to improved performance. Experts inspected cases more systematically, but students did not benefit from systematic viewing training.

Why verifying diagnostic decisions with a checklist can help: insights from eye tracking.

Making a diagnosis involves ratifying or verifying a proposed answer. Formalizing this verification process with checklists, which highlight key variables involved in the diagnostic decision, is often advocated. However, the mechanisms by which a checklist might allow clinicians to improve their verification process have not been well studied. We hypothesize that using a checklist to verify diagnostic decisions enhances analytic scrutiny of key variables, thereby improving clinicians' ability to find and fix mistakes. We asked 16 participants to verify their interpretation of 12 electrocardiograms, randomly assigning half to be verified with a checklist and half with an analytic prompt. While participants were verifying their interpretation, we tracked their eye movements. We analyzed these eye movements using a series of eye tracking variables theoretically linked to analytic scrutiny of key variables. We found that more errors were corrected using a checklist compared to an analytic prompt (.27 ± .53 errors per ECG vs. .04 ± .43, F 1,15 = 8.1, p = .01, η (2) = .20). Checklist use was associated with enhanced analytic scrutiny in all eye tracking measures assessed (F 6,10 = 6.0, p = .02). In this experiment, using a key variable checklist to verify diagnostic decisions improved error detection. This benefit was associated with enhanced analytic scrutiny of those key variables as measured by eye tracking.

Effects of learning content in context on knowledge acquisition and recall: a pretest-posttest control group design.

BACKGROUND: It is generally assumed that learning in context increases performance. This study investigates the relationship between the characteristics of a paper-patient context (relevance and familiarity), the mechanisms through which the cognitive dimension of context could improve learning (activation of prior knowledge, elaboration and increasing retrieval cues), and test performance. METHODS: A total of 145 medical students completed a pretest of 40 questions, of which half were with a patient vignette. One week later, they studied musculoskeletal anatomy in the dissection room without a paper-patient context (control group) or with (ir)relevant-(un)familiar context (experimental groups), and completed a cognitive load scale. Following a short delay, the students completed a posttest. RESULTS: Surprisingly, our results show that students who studied in context did not perform better than students who studied without context. This finding may be explained by an interaction of the participants' expertise level, the nature of anatomical knowledge and students' approaches to learning. A relevant-familiar context only reduced the negative effect of learning the content in context. Our results suggest discouraging the introduction of an uncommon disease to illustrate a basic science concept. Higher self-perceived learning scores predict higher performance. Interestingly, students performed significantly better on the questions with context in both tests, possibly due to a 'framing effect'. CONCLUSIONS: Since studies focusing on the physical and affective dimensions of context have also failed to find a positive influence of learning in a clinically relevant context, further research seems necessary to refine our theories around the role of context in learning.

Finding and fixing mistakes: do checklists work for clinicians with different levels of experience?

Checklists that focus attention on key variables might allow clinicians to find and fix their mistakes. However, whether this approach can be applied to clinicians of varying degrees of expertise is unclear. Novice and expert clinicians vary in their predominant reasoning processes and in the types of errors they commit. We studied 44 clinicians with a range of electrocardiography (ECG) interpretation expertise: novice, intermediate and expert. Clinicians were asked to interpret 10 ECGs, self-report their predominant reasoning strategy and then check their interpretation with a checklist. We found that clinicians of all levels of expertise were able to use the checklist to find and fix mistakes. However, novice clinicians disproportionately benefited. Interestingly, while clinicians varied in their self-reported reasoning strategy, there was no relationship between reasoning strategy and checklist benefit.

Eye movements reveal differences in children's referential processing during narrative comprehension.

Children differ in their ability to build referentially coherent discourse representations. Using a visual world paradigm, we investigated how these differences might emerge during the online processing of spoken discourse. We recorded eye movements of 69 children (6-11 years of age) as they listened to a 7-min story and concurrently viewed a display containing line drawings of the protagonists. Throughout the story, the protagonists were referenced by either a name (e.g., rabbit) or an anaphoric pronoun (e.g., he). Results showed that the probability of on-target fixations increased after children heard a proper name, but not after they heard an anaphoric pronoun. However, differences in the probability of on-target fixation at word onset indicate that the referents of anaphoric pronouns were anticipated by good comprehenders, but less so by poor comprehenders. These findings suggest that comprehension outcomes are related to the online processing of discourse-level cues that regulate the accessibility of entities.

Twelve tips on engaging learners in checking health care decisions.

BACKGROUND: Checking diagnostic and management decisions can help reduce medical error, however, little literature explores how this is best taught. AIMS: To provide practical advice to direct teaching practices. METHODS: The authors conducted a literature review using Medline and PsychInfo using search terms: check or checklist and medical error or diagnostic error, supplemented by a manual search through cited literature. CONCLUSION: Twelve tips for teaching how to check diagnostic and management decisions are presented.

Influences on anatomical knowledge: The complete arguments.

Eight factors are claimed to have a negative influence on anatomical knowledge of medical students: (1) teaching by nonmedically qualified teachers, (2) the absence of a core anatomy curriculum, (3) decreased use of dissection as a teaching tool, (4) lack of teaching anatomy in context, (5) integrated curricula (problem-based learning or systems-based curricula), (6) inadequate assessment of anatomical knowledge, (7) decreased anatomy teaching time, and (8) neglect of vertical integration of anatomy teaching. A recent review revealed a lack of evidence underpinning any of the claims owing to the poor quality of papers, and recommendations were made for education and research on teaching in context and the implementation of vertical integration and of assessment strategies. In this article, we will describe the alleged factors fully, revealing additional recommendations for improving anatomy education by promoting recognition for teaching in institutions, by enhancing the professional recognition of anatomists through the implementation of a national postgraduate training program, and by encouraging anatomists to participate in educational research.

Librarian-Led Assessment of Medical Students' Evidence-Based Medicine Competency: Facilitators and Barriers.

Introduction: We must ensure, through rigorous assessment that physicians have the evidence-based medicine (EBM) skills to identify and apply the best available information to their clinical work. However, there is limited guidance on how to assess EBM competency. With a better understanding of their current role in EBM education, Health Sciences Librarians (HSLs), as experts, should be able to contribute to the assessment of medical student EBM competence. The purpose of this study is to explore the HSLs perspective on EBM assessment practices, both current state and potential future activities. Methods: We conducted focus groups with librarians from across the United States to explore their perceptions of assessing EBM competence in medical students. Participants had been trained to be raters of EBM competence as part of a novel Objective Structured Clinical Examination (OSCE). This OSCE was just the starting point and the discussion covered topics of current EBM assessment and possibility for expanded responsibilities at their own institutions. We used a reflexive thematic analysis approach to construct themes from our conversations. Results: We constructed eight themes in four broad categories that influence the success of librarians being able to engage in effective assessment of EBM: administrative, curricular, medical student, and librarian. Conclusion: Our results inform medical school leadership by pointing out the modifiable factors that enable librarians to be more engaged in conducting effective assessment. They highlight the need for novel tools, like EBM OSCEs, that can address multiple barriers and create opportunities for deeper integration of librarians into assessment processes.