The challenge of transfer to clinical practice: The illusion of learning and illusion of teaching.

There is increasing pressure to accelerate health professions education programs and educators have the challenge of ensuring that students can effectively transfer their learning into clinical practice. In this personal view, we discuss how insights from cognitive science can inform the redesign of current curricula and highlight the challenge of implementing these new approaches for instructional design and assessment. We also recommend that educators disseminate the important lessons learned from their endeavors.

Self-regulated learning microanalysis feedback for developing clinical skills: A pilot study.

INTRODUCTION: The development of clinical skills requires the appropriate use of self-regulated learning (SRL). Students' use of key SRL processes as they perform a clinical skill can be identified by SRL microanalysis and used to provide feedback. SRL-microanalysis feedback only on students' key SRL processes has not been previously researched for developing clinical skills. The aim of this study was to investigate whether SRL-microanalysis feedback only on students' key SRL processes can improve both their use of SRL and their clinical skill performance. METHODS: Twenty-three final year medical students with no experience in the clinical skill required for mechanical ventilation participated in this study. Key SRL processes and clinical skill performance were measured before and after SRL microanalysis feedback. RESULTS: Overall, we found an improvement in the key SRL processes of planning and monitoring of performance, with a significant difference in monitoring. We also found an increase in students' clinical skill performance. DISCUSSION: This study, which is the first in clinical skills, demonstrated that SRL microanalysis feedback only on key SRL processes can improve both students' SRL and their clinical skill performance. studies are recommended with a great number of students and across a variety of clinical skills.

Use of eye tracking in medical education.

Eye tracking has become increasingly applied in medical education research for studying the cognitive processes that occur during the performance of a task, such as image interpretation and surgical skills development. However, analysis and interpretation of the large amount of data obtained by eye tracking can be confusing. In this article, our intention is to clarify the analysis and interpretation of the data obtained from eye tracking. Understanding the relationship between eye tracking metrics (such as gaze, pupil and blink rate) and cognitive processes (such as visual attention, perception, memory and cognitive workload) is essential. The importance of calibration and how the limitations of eye tracking can be overcome is also highlighted.

Using insights from cognitive science for the teaching of clinical skills: AMEE Guide No. 155.

Students have to develop a wide variety of clinical skills, from cannulation to advanced life support, prior to entering clinical practice. An important challenge for health professions' educators is the implementation of strategies for effectively supporting students in their acquisition of different types of clinical skills and also to minimize skill decay over time. Cognitive science provides a unified approach that can inform how to maximize clinical skill acquisition and also minimize skill decay. The Guide discusses the nature of expertise and mastery development, the key insights from cognitive science for clinical skill development and skill retention, how these insights can be practically applied and integrated with current approaches used in clinical skills teaching.

Self-regulated learning processes across different physiotherapy clinical procedural skills and time intervals: A SRL microanalysis study.

PURPOSE OF THE STUDY: The performance of a clinical procedural skill by an individual student is associated with their use of Self-Regulated Learning (SRL) processes. However, previous research has not identified if an individual student has a similarity in their use of SRL processes across different clinical procedural skill tasks and at a time interval. The aim of this pilot study was to explore the similarity in the use of SRL processes by individual students across different clinical procedural skill tasks and at a time interval. METHODS: SRL-microanalysis was used to collect within-subject data on undergraduate physiotherapy students' use of the two key SRL processes (planning and monitoring) during their performance of different goniometry clinical procedural skills tasks and also at a fourth month interval. RESULTS: An individual student's use of key SRL processes across different clinical procedural skill tasks and at a time interval was similar. Also, this similarity was identified for students with initial successful and unsuccessful performances. CONCLUSION: Our findings have implications for the future wider practical implementation of SRL microanalysis to inform personalised SRL feedback for developing the clinical procedural skills of individual students. Further research with a greater number of students and across a wider range of clinical procedural skills will be required to confirm our findings, and also its effectiveness on feedback and future performance.

Identifying the response process validity of clinical vignette-type multiple choice questions: An eye-tracking study.

INTRODUCTION: Clinical vignette-type multiple choice questions (CV-MCQs) are widely used in assessment and identifying the response process validity (RPV) of questions with low and high integration of knowledge is essential. Answering CV-MCQs of different levels of knowledge application and integration can be understood from a cognitive workload perspective and this can be identified by using eye-tracking. The aim of the pilot study was to identify the cognitive workload and RPV of CV-MCQs of different levels of knowledge application and integration by the use eye-tracking. METHODS: Fourteen fourth-year medical students answered a test with 40 CV-MCQs, which were equally divided into low-level and high-level complexity (knowledge application and integration). Cognitive workload was measured using screen-based eye tracking, with the number of fixations and revisitations for each area of interest. RESULTS: We found a higher cognitive workload for high-level complexity (M = 121.74) compared with lower-level complexity questions (M = 51.94) and also for participants who answered questions incorrectly (M = 94.31) compared with correctly (M = 79.36). CONCLUSION: Eye-tracking has the potential to become a useful and practical approach for helping to identify the RPV of CV-MCQs. This approach can be used for improving the design and development of CV-MCQs, and to provide feedback to inform teaching and learning.[Box: see text].

Solutions, enablers and barriers to online learning in clinical medical education during the first year of the COVID-19 pandemic: A rapid review.

AIMS: The COVID-19 pandemic has seen a major disruption to undergraduate and postgraduate clinical medical education. The aim of this rapid review was to identify and synthesize published literature relating to the solutions, enablers and barriers to online learning implemented in clinical medical education during the first year of the COVID-19 pandemic. METHODS: All articles published before March 2021 in peer-reviewed journals, including MedEdPublish, that described authors' experience of online learning in response to the COVID-19 pandemic. A descriptive analysis of the solutions and a qualitative template analysis of enablers and barriers. RESULTS: 87 articles were identified for inclusion. Face to face teaching was maintained with interactive approaches between learners and/or learners and teachers. Several innovative solutions were identified. The enablers were a readiness and rapid response by institutions, with innovation by teachers. The barriers were the lack of planning and resources, usability problems and limited interactivity between teachers and students. CONCLUSIONS: Important and timely evidence was obtained that can inform future policy, practice and research. The findings highlighted the urgent need to use rapid design and implementation methods with greater explicit descriptions in published articles to ensure applicability to other contexts.

The frustrations of adopting evidence-based medical education and how they can be overcome!

Evidence-based medical education has been widely promoted but our discussions with medical educators across different countries has highlighted that adopting this approach can be frustrating. There is often a lack of useful evidence that can inform the practical decisions that medical educators have to make about curriculum development or the way that they should teach, especially in relation to low and middle income countries. To overcome these challenges, we recommend that studies increase their reporting of the context and process of any interventions. We also recommend international collaborations with a common goal to answer a research question that is of importance across different contexts. Future research should also focus on understanding the challenges of implementing evidence-based medical education in different countries.

Avoid 'running before we can walk' in medical education research: The importance of design and development research.

Design and development research has the aim of understanding the feasibility and acceptability of implementing early-stage pilot research before interventions are fully implemented and evaluated for their impact. Increasing the use of design and development research in medical education research requires greater awareness of its importance by all stakeholders, the use of iterative research methodologies, such as educational design research, and the application of modified existing frameworks for healthcare feasibility studies.

Self-regulated learning microanalysis for the study of the performance of clinical examinations by physiotherapy students.

BACKGROUND: Students require feedback on their self-regulated learning (SRL) processes to improve the performance of clinical examinations. The key SRL processes used by students can be identified by SRL-micro-analysis but, this method has not been previously applied to physiotherapy students. The aim of this pilot study was to test a research design that might allow the evaluation of the potential usefulness of SRL microanalysis for the identification of key SRL processes used by physiotherapy students during the performance of a clinical examination skill. The objectives of the pilot study were: 1) to evaluate whether SRL-microanalysis could identify differences in the use of SRL processes between successful and unsuccessful students; 2) to evaluate the reliability of SRL microanalysis ratings produced by different assessors. METHODS: SRL-microanalysis was used with second year physiotherapy students of a Spanish university (n = 26) as they performed a goniometric task. The task required students to obtain a goniometric measurement of the shoulder joint of a peer. Two assessors evaluated student performance and conducted the SRL- microanalysis with all students. An analysis of inter-rater reliability was performed to evaluate the degree of agreement between assessors. RESULTS: The SRL-microanalysis revealed differences in the use of key SRL processes between successful (n = 15: 57.0%) and unsuccessful performers (n = 11: 43.0%): The differences were particularly evident in strategic planning and self-monitoring skills. There was good inter-rater reliability for scoring of strategic planning (k = 0.792), self-monitoring (k = 0.946) and self-evaluation (k = 0.846). CONCLUSION: The use of SRL microanalysis characterized the key SRL processes of physiotherapy students performing a clinical skill with reliability between the assessors. This pilot study supports the potential usefulness of SRL-microanalysis for the identification of key SRL processes in physiotherapy education. Therefore, this study paves the way to the development of a full study, with a larger number of students and more diverse clinical tasks, to evaluate the SRL processes in successful and unsuccessful students.

The Impact of Massed and Spaced-Out Curriculum in Oncology Knowledge Acquisition.

Starting in 2009, cancer has been the leading cause of death in the Netherlands. Oncology is therefore an important part of the medical curriculum in undergraduate education. It is crucial that medical students know about cancer, since doctors will encounter many cases of oncology. We have compared the influence that teaching oncology has when spread over a 3-year curriculum versus concentrated in one semester. The participants comprised 525 medical students from one medical school with comprehensive integrated curricula. Of those, 436 followed the massed curriculum, with oncology concentrated in one semester. The remaining 89 students followed a spaced-out curriculum, in which oncology was spread out over 3 years. To measure students' knowledge, we used their progress test results from 2009 to 2012. All questions about oncology were categorized and selected. Because of our unbalanced sample and missing data and to reduce the chances for a type II error, we compared the growth of oncology questions using mixed effect models. A cubic growth model with an unstructured covariance matrix fitted our data best. At the start, students in the spaced-out curriculum scored higher on oncology questions. The initial growth was faster for the spaced-out curriculum students, whereas the acceleration over time was slower compared to the massed curriculum students. At the end of the growth curve, the knowledge of the massed curriculum students increased faster. In the last test, the massed curriculum students outperformed those in the spaced-out curriculum. The way students acquired and applied their knowledge was similar in both curricula. It seems, however, that students benefitted more from massed than spaced-out education, which may be due to the comprehensive integrated teaching involved.

The Impact of Curriculum Design in the Acquisition of Knowledge of Oncology: Comparison Among Four Medical Schools.

Over the past 5 years, cancer has replaced coronary heart disease as the leading cause of death in the Netherlands. It is thus paramount that medical doctors acquire a knowledge of cancer, since most of them will face many patients with cancer. Studies, however, have indicated that there is a deficit in knowledge of oncology among medical students, which may be due not only to the content but also to the structure of the curriculum. In this study, we compared students' knowledge acquisition in four different undergraduate medical programs. Further, we investigated possible factors that might influence students' knowledge growth as related to oncology. The participants comprised 1440 medical students distributed over four universities in the Netherlands. To measure students' knowledge of oncology, we used their progress test results from 2007 to 2013. The progress test consists of 200 multiple-choice questions; this test is taken simultaneously four times a year by all students. All questions regarding oncology were selected. We first compared the growth of knowledge of oncology using mixed models. Then, we interviewed the oncology coordinator of each university to arrive at a better insight of each curriculum. Two schools showed similar patterns of knowledge growth, with a slight decrease in the growth rate for one of them in year 6. The third school had a faster initial growth with a faster decrease over time compared to other medical schools. The fourth school showed a steep decrease in knowledge growth during years 5 and 6. The interviews showed that the two higher-scoring schools had a more focused semester on oncology, whereas in the others, oncology was scattered throughout the curriculum. Furthermore, the absence of a pre-internship training program seemed to hinder knowledge growth in one school. Our findings suggest that curricula have an influence on students' knowledge acquisition. A focused semester on oncology and a pre-internship preparatory training program are likely to have a positive impact on students' progress in terms of knowledge of oncology.

Comparison of formula and number-right scoring in undergraduate medical training: a Rasch model analysis.

BACKGROUND: Progress testing is an assessment tool used to periodically assess all students at the end-of-curriculum level. Because students cannot know everything, it is important that they recognize their lack of knowledge. For that reason, the formula-scoring method has usually been used. However, where partial knowledge needs to be taken into account, the number-right scoring method is used. Research comparing both methods has yielded conflicting results. As far as we know, in all these studies, Classical Test Theory or Generalizability Theory was used to analyze the data. In contrast to these studies, we will explore the use of the Rasch model to compare both methods. METHODS: A 2 × 2 crossover design was used in a study where 298 students from four medical schools participated. A sample of 200 previously used questions from the progress tests was selected. The data were analyzed using the Rasch model, which provides fit parameters, reliability coefficients, and response option analysis. RESULTS: The fit parameters were in the optimal interval ranging from 0.50 to 1.50, and the means were around 1.00. The person and item reliability coefficients were higher in the number-right condition than in the formula-scoring condition. The response option analysis showed that the majority of dysfunctional items emerged in the formula-scoring condition. CONCLUSIONS: The findings of this study support the use of number-right scoring over formula scoring. Rasch model analyses showed that tests with number-right scoring have better psychometric properties than formula scoring. However, choosing the appropriate scoring method should depend not only on psychometric properties but also on self-directed test-taking strategies and metacognitive skills.

Development of cognitive processing and judgments of knowledge in medical students: Analysis of progress test results.

BACKGROUND: Beside acquiring knowledge, medical students should also develop the ability to apply and reflect on it, requiring higher-order cognitive processing. Ideally, students should have reached higher-order cognitive processing when they enter the clinical program. Whether this is the case, is unknown. We investigated students' cognitive processing, and awareness of their knowledge during medical school. METHODS: Data were gathered from 347 first-year preclinical and 196 first-year clinical students concerning the 2008 and 2011 Dutch progress tests. Questions were classified based upon Bloom's taxonomy: "simple questions" requiring lower and "vignette questions" requiring higher-order cognitive processing. Subsequently, we compared students' performance and awareness of their knowledge in 2008 to that in 2011 for each question type. RESULTS: Students' performance on each type of question increased as students progressed. Preclinical and first-year clinical students performed better on simple questions than on vignette questions. Third-year clinical students performed better on vignette questions than on simple questions. The accuracy of students' judgment of knowledge decreased over time. CONCLUSIONS: The progress test is a useful tool to assess students' cognitive processing and awareness of their knowledge. At the end of medical school, students achieved higher-order cognitive processing but their awareness of their knowledge had decreased.

Implications of clinical simulation in motivation for learning: scoping review.

OBJECTIVE: To identify, synthesize, and analyze the scientific knowledge produced regarding the implications of using clinical simulation for undergraduate nursing or medical students' motivation for learning. METHODS: The search for articles was conducted between July 28 and August 3, 2022, on the PubMed/MEDLINE, Scopus, Web of Science, and SciELO databases. The following was used for the search: P - undergraduate students attending Nursing or Medicine courses; C - motivation for learning, and C - skills and clinical simulation laboratory. The following research question guided the study: "What are the implications of clinical simulation on the motivation for learning of undergraduate students of nursing and medicine?" Of the 1,783 articles found, 13 were included in the sample for analysis. All stages of the selection process were carried out by two independent evaluators. The results were presented as charts and a discursive report. RESULTS: The studies analyzed indicated the beneficial effects of clinical simulation on students' motivation, in addition to other gains such as competencies, technical and non-technical skills, knowledge, belonging, autonomy, clinical judgment, critical and reflective thinking, self-efficacy and decreased anxiety, self-management, and improvements in learning and learning climate. CONCLUSION: Clinical simulation provides a positive learning environment favorable to the development of technical and interpersonal skills and competencies, and raising the level of motivational qualities.