Stakeholders' perception on the implementation of Developmental Progress Assessment: using the Theoretical Domains Framework to document behavioral determinants.

BACKGROUND: The widespread implementation of longitudinal assessment (LA) to document trainees' progression to independent practice rests more on speculative rather than evidence-based benefits. We aimed to document stakeholders' knowledge of- and attitudes towards LA, and identify how the supports and barriers can help or hinder the uptake and sustainable use of LA. METHODS: We interviewed representatives from four stakeholder groups involved in LA. The interview protocols were based on the Theoretical Domains Framework (TDF), which contains a total of 14 behaviour change determinants. Two team members coded the interviews deductively to the TDF, with a third resolving differences in coding. The qualitative data analysis was completed with iterative consultations and discussions with team members until consensus was achieved. Saliency analysis was used to identify dominant domains. RESULTS: Forty-one individuals participated in the study. Three dominant domains were identified. Participants perceive that LA has more positive than negative consequences and requires substantial ressources. All the elements and characteristics of LA are present in our data, with differences between stakeholders. CONCLUSION: Going forward, we could develop and implement tailored and theory driven interventions to promote a shared understanding of LA, and maintain potential positive outcomes while reducing negative ones. Furthermore, ressources to support LA implementation need to be addressed to facilitate its uptake.

Drivers of iPad use by undergraduate medical students: the Technology Acceptance Model perspective.

BACKGROUND: Medical students need to acquire a continuously growing body of knowledge during their training and throughout their practice. Medical training programs should aim to provide students with the skills to manage this knowledge. Mobile technology, for example, could be a strategy used through training and practice. The objective of this study was to identify drivers of using mobile technology (an iPad) in a UGME preclinical settings and to study the evolution of those drivers over time. METHODS: We solicited all students from two cohorts of a preclinical component of a Canadian UGME program. They were asked to answer two online surveys: one on their first year of study and another on the second year. Surveys were built based on the Technology Acceptance Model (TAM) to which other factors were also added. Data from the two cohorts were combined and analysed with partial least squares structural equation modelling (PLS-SEM) to test two measurement models, one for each year. RESULTS: We tested fifteen hypotheses on both data sets (first year and second year). Factors that explained the use of an iPad the first year were knowledge, preferences, perceived usefulness and anticipation. In the second year, perceived usefulness, knowledge and satisfaction explained the use of an iPad. Other factors have also significantly, but indirectly influenced the use of the iPad. CONCLUSIONS: We identified factors that influenced the use of an iPad in a preclinical medical program. These factors differed from the first year to the second year in the program. Our results suggest that interventions should be tailored for different point in time to foster the use of an iPad. Further study should investigate how interventions based on these factors may influence implementation of mobile technology to help students acquire ability to navigate efficiently through medical knowledge.

Self-explanation in learning clinical reasoning: the added value of examples and prompts.

CONTEXT: Recent studies suggest that self-explanation (SE) while diagnosing cases fosters the development of clinical reasoning in medical students; however, the conditions that optimise the impact of SE remain unknown. The example-based learning framework justifies an exploration of students' use of their own SEs combined with the study of examples. This study aimed to assess the impact on medical students' diagnostic performance of: (i) combining students' SEs with their listening to examples of residents' SEs, and (ii) the addition of prompts (specific questions) while working with examples. METHODS: This study consisted of a training phase and an assessment phase conducted 1 week later. In the training phase, 54 Year 3 medical students were randomly assigned to one of three groups. In all groups, students first solved four clinical cases using SE. Subsequently, Group 1 listened to examples of residents' SEs with prompts; Group 2 listened to examples of residents' SEs without prompts, and the control group solved word puzzles. Then, all students again solved the same four cases. One week later, all students solved four similar and four different cases. Students' diagnostic performance and diagnostic accuracy scores were assessed for each case at each time-point. RESULTS: Although all groups' diagnostic accuracy scores on similar cases improved significantly between the training and the assessment phase, Group 1 showed a significantly higher diagnostic performance score after 1 week than the control group (p = 0.037). On different cases, Group 1 obtained significantly higher diagnostic accuracy (p = 0.011) and diagnostic performance (p < 0.001) scores than the control group and a significantly higher diagnostic performance score than Group 2 (p = 0.018). CONCLUSIONS: Self-explanation seems to be an effective technique to help medical students learn clinical reasoning. Its impact is increased significantly by combining it with examples of residents' SEs and prompts. Although students' exposure to examples of clinical reasoning is important, their 'active processing' of these examples appears to be critical to their learning from them.

From see one do one, to see a good one do a better one: learning physical examination skills through peer observation.

BACKGROUND: Learning and mastering the skills required to execute physical exams is of great importance and should be fostered early during medical training. Observing peers has been shown to positively influence the acquisition of psychomotor skills. PURPOSE: The current study investigated the influence of peer observation on the acquisition of psychomotor skills required to execute a physical examination. METHODS: Second-year medical students (N=194) learned the neurological physical examination for low back pain in groups of three. Each student learned and performed the physical examination while the other students observed. Analyses compared the impact of the quantity and the quality of observed performances on students' learning of the physical examination skills. RESULTS: Students benefited from observing peers while they executed their examination. Moreover, observing a high-performing peer increased the acquisition of physical examination skills. CONCLUSIONS: Results suggest that group learning activities that allow students to observe their peers during physical examination should be favored.

Considering the Structured Oral Examinations Beyond Its Psychometrics Properties.

Decisions to set aside Structured Oral Examinations (SOE) are, almost invariably, based on their poor psychometric properties. However, considering the perspectives of the stakeholders might help us to understand its potential contribution. To explore this, we conducted focus groups and individual interviews with stakeholders: students, assessors, and administrators. Students and assessors perceived the SOE as a window on students' clinical reasoning, as an authentic assessment, but as a subjective and stressful method. Administrators emphasized the organizational consequences such as logistical challenges. Consequences must be considered when making decisions about SOE and our results support important positive consequences.

Exploring medical students' use of principles of self-explanation and structured reflection during clerkship.

Background: While educators observe gaps in clerkship students' clinical reasoning (CR) skills, students report few opportunities to develop them. This study aims at exploring how students who used self-explanation (SE) and structured reflection (SR) for CR learning during preclinical training, applied these learning strategies during clerkship. Methods: We conducted an explanatory sequential mixed-methods study involving medical students. With a questionnaire, we asked students how frequently they adopted behaviours related to SE and SR during clerkship. Next, we conducted a focus group with students to explore why they adopted these behaviours. Results: Fifty-two of 198 students answered the questionnaire and five participated in a focus group. Specific behaviours adopted varied from 50% to 98%. We identified three themes about why students used these strategies: as "just in time" learning strategies; to deepen their understanding and identify gaps in knowledge; to develop a practical approach to diagnosis. A fourth theme related to the balance between learning and assessment and its consequence on adopting SE behaviours. Conclusions: Students having experienced SE and SR regularly in preclinical training tend to transpose these strategies into the clerkship providing them with a practical way to reflect deliberately and capture learning opportunities of the unpredictable clinical context.

Contexte: Alors que les éducateurs observent des lacunes dans les compétences de raisonnement clinique (RC) des étudiants en externat, ces derniers font état de peu d'occasions de les développer. Cette étude vise à explorer comment les étudiants qui ont utilisé l'auto-explication (AE) et la réflexion structurée (RS) pour l'apprentissage du raisonnement clinique pendant la formation préclinique, ont appliqué ces stratégies d'apprentissage pendant l'externat. Méthodes: Nous avons mené une étude séquentielle explicative à méthodes mixtes auprès d'étudiants en médecine. À l'aide d'un questionnaire, nous avons demandé aux étudiants à quelle fréquence ils adoptaient des comportements liés à la AE et à la RS pendant l'externat. Ensuite, nous avons organisé un groupe de discussion avec les étudiants afin d'explorer les raisons pour lesquelles ils ont adopté ces comportements. Résultats: Cinquante-deux étudiants sur 198 ont répondu au questionnaire et cinq ont participé à un groupe de discussion. Les comportements spécifiques adoptés variaient de 50 % à 98 %. Nous avons identifié trois thèmes concernant les raisons pour lesquelles les étudiants ont utilisé ces stratégies : comme stratégies d'apprentissage "juste à temps"; pour approfondir leur compréhension et identifier les lacunes dans les connaissances ; pour développer une approche pratique du diagnostic. Un quatrième thème concernait l'équilibre entre l'apprentissage et l'évaluation et ses conséquences sur l'adoption de comportements liés à l'AE. Conclusions: Les étudiants qui ont fait l'expérience de l'AE et de la RS régulièrement au cours de leur formation préclinique ont tendance à transposer ces stratégies dans l'externat, ce qui leur fournit un moyen pratique de réfléchir délibérément et de saisir les opportunités d'apprentissage dans un contexte clinique imprévisible.

Harnessing a knowledge translation framework to implement an undergraduate medical education intervention: A longitudinal study.

INTRODUCTION: Implementation of evidence-informed educational interventions (EEI) involves applying and adapting theoretical and scientific knowledge to a specific context. Knowledge translation (KT) approaches can both facilitate and structure the process. The purpose of this paper is to describe lessons learned from applying a KT approach to help implement an EEI for clinical reasoning in medical students. METHODS: Using the Knowledge to Action framework, we designed and implemented an EEI intended to support the development of students' clinical reasoning skills in a renewed medical curriculum. Using mixed-methods design, we monitored students' engagement with the EEI longitudinally through a platform log; we conducted focus groups with students and stakeholders, and observed the unfolding of the implementation and its continuation. Data are reported according to six implementation outcomes: Fidelity, Feasibility, Appropriateness, Acceptability, Adoption, and Penetration. RESULTS: Students spent a mean of 24 min on the activity (fidelity outcome) with a high completion rate (between 75% and 95%; feasibility outcome) of the entire activity each time it was done. Focus group data from students and stakeholders suggest that the activity was acceptable, appropriate, feasible, adopted and well-integrated into the curriculum. DISCUSSION: Through the process we observed the importance of having a structuring framework, of working closely and deliberatively with stakeholders and students, of building upon concurrent evaluations in order to adapt iteratively the EEI to the local context and, while taking students' needs into consideration, of upholding the EEI's core educational principles.

The influence of medical students' self-explanations on diagnostic performance.

CONTEXT: Skill in clinical reasoning is a highly valued attribute of doctors, but instructional approaches to foster medical students' clinical reasoning skills remain scarce. Self-explanation is an instructional procedure, the positive effects of which on learning have been demonstrated in a variety of domains, but which remain largely unexplored in medical education. OBJECTIVES: The purpose of this study was to investigate the effects of self-explanation on students' learning of clinical reasoning during clerkships and to examine whether these effects are affected by topic familiarity. METHODS: An experimental study with a training phase and an assessment phase was conducted with 36 Year 3 medical students, randomly assigned to one of two groups. In the training phase, students solved 12 clinical cases (four cases on a less familiar topic; four on a more familiar topic; four on filler topics), either generating self-explanations (n = 18) or not (n = 18). The self-explanations were generated after minimal instructions and no feedback was provided to students. One week later, in the assessment phase, students were requested to diagnose 12 different, more difficult cases, similarly distributed among the same more familiar topic, less familiar topic and filler topics, and their diagnostic performance was assessed. RESULTS: In the training phase the performance of the two groups did not differ. However, in the assessment phase 1 week later, a significant interaction was found between self-explanation and case topic familiarity (F(1,34) = 6.18, p < 0.05). Students in the self-explanation condition, compared with those in the control condition, demonstrated better diagnostic performance on subsequent clinical cases, but this effect emerged only for cases concerning the less familiar topic. CONCLUSIONS: The present study shows the beneficial influence of generating self-explanations when dealing with less familiar clinical contexts. Generating self-explanations without feedback resulted in better diagnostic performance than in the control group at 1 week after the intervention.

A layered analysis of self-explanation and structured reflection to support clinical reasoning in medical students.

Self-explanation and structured reflection have been studied independently with results suggesting that both learning interventions can effectively support medical students' clinical reasoning development. Given this evidence, medical schools may want/begin to implement these interventions in their curricula. Implementing educational interventions requires educators to maintain the core philosophy and principles of the interventions intact while adjusting implementation techniques to the specificities of individual learning contexts. Educational scholars have yet to explicitly articulate the philosophy, principles and techniques of self-explanation and structured reflection. Without such descriptions, educators risk failing to realize self-explanation's and structured reflection's effect to support students' clinical reasoning skill development in their implementations. Relying on the layered analysis approach, we articulate the philosophy, principles and techniques of self-explanation and structured reflection. This description is framed within the context of an actual implementation to illustrate the philosophies underpinning self-explanation and structured reflection, the principles that realize those philosophies, and the techniques that can be used to enact those principles. Building on the similarities between self-explanation and structured reflection, while also harnessing their differences, we identify why and how these interventions can be combined in a single implementation, while preserving their philosophies and principles. The layered analysis of self-explanation and structured reflection offers essential insights into the underpinnings of these interventions. They are articulated in this manuscript in hopes that other scholars will continue to refine these descriptions thereby facilitating effective use of self-explanation and structured reflection for clinical reasoning development.

Comparison of Assessment by a Virtual Patient and by Clinician-Educators of Medical Students' History-Taking Skills: Exploratory Descriptive Study.

BACKGROUND: A virtual patient (VP) can be a useful tool to foster the development of medical history-taking skills without the inherent constraints of the bedside setting. Although VPs hold the promise of contributing to the development of students' skills, documenting and assessing skills acquired through a VP is a challenge. OBJECTIVE: We propose a framework for the automated assessment of medical history taking within a VP software and then test this framework by comparing VP scores with the judgment of 10 clinician-educators (CEs). METHODS: We built upon 4 domains of medical history taking to be assessed (breadth, depth, logical sequence, and interviewing technique), adapting these to be implemented into a specific VP environment. A total of 10 CEs watched the screen recordings of 3 students to assess their performance first globally and then for each of the 4 domains. RESULTS: The scores provided by the VPs were slightly higher but comparable with those given by the CEs for global performance and for depth, logical sequence, and interviewing technique. For breadth, the VP scores were higher for 2 of the 3 students compared with the CE scores. CONCLUSIONS: Findings suggest that the VP assessment gives results akin to those that would be generated by CEs. Developing a model for what constitutes good history-taking performance in specific contexts may provide insights into how CEs generally think about assessment.

Exploring residents' spontaneous collaborative skills in a simulated setting context: an exploratory study on CanMEDS collaborator role.

BACKGROUND: Collaboration is an important competence to be acquired by residents. Although improving residents' collaboration via interprofessional education has been investigated in many studies, little is known about the residents' spontaneous collaborative behavior. The purpose of this exploratory study was to describe how residents spontaneously collaborate. METHODS: Seven first-year residents (postgraduate year 1; three from family medicine and one each from ear, nose, and throat, obstetrics/gynecology, general surgery, and orthopedic surgery) participated in two collaborative meetings with actors performing the part of other health professionals (ie, occupational therapist, physiotherapist, nurse, or social worker). Both meetings were built around an issue or conflict with the patients' families reported by one professional. The residents were required to lead the meeting to collect proper information to reach a joint decision. Two team members analyzed the video recordings of the meetings using an emerging-theme qualitative methodology. RESULTS: Although the residents spontaneously knew how to successfully communicate with other professionals, they seemed to struggle with the patient-centered approach and the shared decision-making process. DISCUSSION: Even if the residents performed communication-wise in their collaborative role, they seemed to have perceived themselves as decision makers instead of collaborators in the joint decision process. The results of this study can inform future studies on learning strategies to improve behaviors that would more likely need attention in interprofessional education.