Retrieval practice and spaced learning: preventing loss of knowledge in Dutch medical sciences students in an ecologically valid setting.

INTRODUCTION: Knowledge, once acquired, degrades over time. Exams that contain questions related to previously acquired knowledge ('retrieval practice questions') may promote retrieval practice and spaced learning, and subsequently prevent knowledge loss. To investigate this hypothesis, we compare the score of retrieval practice questions to regular questions in exams of a two-year (bio)medical study program. METHODS: The two-year "Mechanisms of Health and Disease"-program for biomedical sciences and medical students in Nijmegen (the Netherlands) contains 14 spaced exams of 80 questions each. The percentages of correct-, false-, and non-answers were compared between regular questions and retrieval practice questions. Using Pearson correlations between question scores and exam scores (RiT-values), the impact of retrieval practice questions on the internal consistency of exams was determined. Mixed model analyses determined changes in outcomes across time. RESULTS: Analysis of 2006 regular questions and 1728 retrieval practice questions revealed a significantly higher percentage of correct and false answers, and a significantly lower percentage of non-answers, in retrieval practice questions versus regular questions (all P < 0.05). Scores did not change across time. RiT-values were slightly lower in retrieval practice questions, with a small inverse trend across time. CONCLUSION: Our data indicate preservation of knowledge, possibly related to retrieval practice and/or spaced learning. Although the RiT-values of retrieval practice questions were slightly lower than those of regular questions, the discriminative capacity was well within acceptable range. These data highlight the potency of retrieval practice questions to prevent knowledge decrement, without altering exam quality.

Effects of learning content in context on knowledge acquisition and recall: a pretest-posttest control group design.

BACKGROUND: It is generally assumed that learning in context increases performance. This study investigates the relationship between the characteristics of a paper-patient context (relevance and familiarity), the mechanisms through which the cognitive dimension of context could improve learning (activation of prior knowledge, elaboration and increasing retrieval cues), and test performance. METHODS: A total of 145 medical students completed a pretest of 40 questions, of which half were with a patient vignette. One week later, they studied musculoskeletal anatomy in the dissection room without a paper-patient context (control group) or with (ir)relevant-(un)familiar context (experimental groups), and completed a cognitive load scale. Following a short delay, the students completed a posttest. RESULTS: Surprisingly, our results show that students who studied in context did not perform better than students who studied without context. This finding may be explained by an interaction of the participants' expertise level, the nature of anatomical knowledge and students' approaches to learning. A relevant-familiar context only reduced the negative effect of learning the content in context. Our results suggest discouraging the introduction of an uncommon disease to illustrate a basic science concept. Higher self-perceived learning scores predict higher performance. Interestingly, students performed significantly better on the questions with context in both tests, possibly due to a 'framing effect'. CONCLUSIONS: Since studies focusing on the physical and affective dimensions of context have also failed to find a positive influence of learning in a clinically relevant context, further research seems necessary to refine our theories around the role of context in learning.

Effect of binocular disparity on learning anatomy with stereoscopic augmented reality visualization: A double center randomized controlled trial.

Binocular disparity provides one of the important depth cues within stereoscopic three-dimensional (3D) visualization technology. However, there is limited research on its effect on learning within a 3D augmented reality (AR) environment. This study evaluated the effect of binocular disparity on the acquisition of anatomical knowledge and perceived cognitive load in relation to visual-spatial abilities. In a double-center randomized controlled trial, first-year (bio)medical undergraduates studied lower extremity anatomy in an interactive 3D AR environment either with a stereoscopic 3D view (n = 32) or monoscopic 3D view (n = 34). Visual-spatial abilities were tested with a mental rotation test. Anatomical knowledge was assessed by a validated 30-item written test and 30-item specimen test. Cognitive load was measured by the NASA-TLX questionnaire. Students in the stereoscopic 3D and monoscopic 3D groups performed equally well in terms of percentage correct answers (written test: 47.9 ± 15.8 vs. 49.1 ± 18.3; P = 0.635; specimen test: 43.0 ± 17.9 vs. 46.3 ± 15.1; P = 0.429), and perceived cognitive load scores (6.2 ± 1.0 vs. 6.2 ± 1.3; P = 0.992). Regardless of intervention, visual-spatial abilities were positively associated with the specimen test scores (η2 = 0.13, P = 0.003), perceived representativeness of the anatomy test questions (P = 0.010) and subjective improvement in anatomy knowledge (P < 0.001). In conclusion, binocular disparity does not improve learning anatomy. Motion parallax should be considered as another important depth cue that contributes to depth perception during learning in a stereoscopic 3D AR environment.

Online Assessment of Applied Anatomy Knowledge: The Effect of Images on Medical Students' Performance.

Anatomical examinations have been designed to assess topographical and/or applied knowledge of anatomy with or without the inclusion of visual resources such as cadaveric specimens or images, radiological images, and/or clinical photographs. Multimedia learning theories have advanced the understanding of how words and images are processed during learning. However, the evidence of the impact of including anatomical and radiological images within written assessments is sparse. This study investigates the impact of including images within clinically oriented single-best-answer questions on students' scores in a tailored online tool. Second-year medical students (n = 174) from six schools in the United Kingdom participated voluntarily in the examination, and 55 students provided free-text comments which were thematically analyzed. All questions were categorized as to whether their stimulus format was purely textual or included an associated image. The type (anatomical and radiological image) and deep structure of images (question referring to a bone or soft tissue on the image) were taken into consideration. Students scored significantly better on questions with images compared to questions without images (P < 0.001), and on questions referring to bones than to soft tissue (P < 0.001), but no difference was found in their performance on anatomical and radiological image questions. The coding highlighted areas of "test applicability" and "challenges faced by the students." In conclusion, images are critical in medical practice for investigating a patient's anatomy, and this study sets out a way to understand the effects of images on students' performance and their views in commonly employed written assessments.

Does spatial awareness training affect anatomy learning in medical students?

Spatial ability (SA) is the cognitive capacity to understand and mentally manipulate concepts of objects, remembering relationships among their parts and those of their surroundings. Spatial ability provides a learning advantage in science and may be useful in anatomy and technical skills in health care. This study aimed to assess the relationship between SA and anatomy scores in first- and second-year medical students. The training sessions focused on the analysis of the spatial component of objects' structure and their interaction as applied to medicine; SA was tested using the Visualization of Rotation (ROT) test. The intervention group (n = 29) received training and their pre- and post-training scores for the SA tests were compared to a control group (n = 75). Both groups improved their mean scores in the follow-up SA test (P < 0.010). There was no significant difference in SA scores between the groups for either SA test (P = 0.31, P = 0.90). The SA scores for female students were significantly lower than for male students, both at baseline and follow-up (P < 0.010). Anatomy training and assessment were administered by the anatomy department of the medical school, and examination scores were not significantly different between the two groups post-intervention (P = 0.33). However, participants with scores in the bottom quartile for SA performed worse in the anatomy questions (P < 0.001). Spatial awareness training did not improve SA or anatomy scores; however, SA may identify students who may benefit from additional academic support.

The Effect of Passive and Active Education Methods Applied in Repetition Activities on the Retention of Anatomical Knowledge.

This study examines the long-term retention of anatomical knowledge from 180 students after various repetition activities. The retention of anatomical knowledge was assessed by multiple-choice tests at five different points in time: before and after a course in Functional Anatomy, before and after repetition activities that occurred 14 weeks after this course, and 28 weeks after this course to establish long-term retention. Students were divided into five groups: one without any repetition activity, one with a restricted repetition activity (the multiple-choice test), and three groups that were offered repetition activities (traditional lecture, e-learning module, and small group work in the dissection room). During all three repetition activities the same information was conveyed, and this content was not revisited in other courses for the duration of the study. The results showed that students who did not engage in a repetition activity scored significantly lower on the long-term retention test compared to all other groups (ANCOVA: P = 0.0001). Pair-wise comparison with estimated means showed that the other four groups, regardless of the type of repeating activity, did not differ in the amount of knowledge they retained during any of the five assessments (P = 0.008, P = 0.0001, P = 0.001, and P = 0.0001, respectively). This study suggests that the type of repetition activity has no effect on knowledge retention both immediately following the activity and in the long term. It is concluded that the repetition of anatomical knowledge in any form is beneficial for students and will likely improve student outcomes in a curriculum that builds on prior knowledge.

Neuroanatomy Learning: Augmented Reality vs. Cross-Sections.

Neuroanatomy education is a challenging field which could benefit from modern innovations, such as augmented reality (AR) applications. This study investigates the differences on test scores, cognitive load, and motivation after neuroanatomy learning using AR applications or using cross-sections of the brain. Prior to two practical assignments, a pretest (extended matching questions, double-choice questions and a test on cross-sectional anatomy) and a mental rotation test (MRT) were completed. Sex and MRT scores were used to stratify students over the two groups. The two practical assignments were designed to study (1) general brain anatomy and (2) subcortical structures. Subsequently, participants completed a posttest similar to the pretest and a motivational questionnaire. Finally, a focus group interview was conducted to appraise participants' perceptions. Medical and biomedical students (n = 31); 19 males (61.3%) and 12 females (38.7%), mean age 19.2 ± 1.7 years participated in this experiment. Students who worked with cross-sections (n = 16) showed significantly more improvement on test scores than students who worked with GreyMapp-AR (P = 0.035) (n = 15). Further analysis showed that this difference was primarily caused by significant improvement on the cross-sectional questions. Students in the cross-section group, moreover, experienced a significantly higher germane (P = 0.009) and extraneous cognitive load (P = 0.016) than students in the GreyMapp-AR group. No significant differences were found in motivational scores. To conclude, this study suggests that AR applications can play a role in future anatomy education as an add-on educational tool, especially in learning three-dimensional relations of anatomical structures.

An investigation of anatomical competence in junior medical doctors.

Because of a decrease of the time available for anatomy education, decisions need to be made to reduce the relevant content of the anatomy curriculum. Several expert consensus initiatives resulted in lists of structures, lacking analysis of anatomical competence. This study aims to explore the use of anatomical knowledge by medical doctors in an attempt to delineate the nature of anatomical competence. The research question is: what kind of anatomical knowledge do junior medical doctors use during a consultation with a patient presenting with a shoulder complaint? Ten junior medical doctors participated in this stimulated recall study. Each of them was videotaped while performing a consultation with a standardized patient with a complex shoulder complaint. The recording was viewed immediately after. Participants were videotaped again while verbalizing the thoughts they remembered having during the consultation. Verbatim transcriptions were coded by two coders using the qualitative data analysis ATLAS.ti software. Results were that these junior medical doctors used anatomical knowledge in all phases of the consultation, especially during physical examination. The use of anatomical terms was strongly associated with clinical reasoning and it was apparent that every subject visualized relevant anatomical information. Conclusion is that young medical doctors actively use their anatomical knowledge and it seems that the relevant anatomy consists largely of adequate visual representations in memory. Anatomy teachers should focus the students' learning activity on building an adequate visual representation of anatomical structures. This should be supported by assessments that test the quality of the students' visual representations.

What is more effective: a daily or a weekly formative test?

BACKGROUND: Exams in anatomy courses are traditionally summative. Formative testing induces retrieval practice, provides feedback and enhances learning results. We investigated the optimal frequency for retrieval practice during an anatomy course. METHOD: During a first-year course, students were offered four online daily quizzes a week that assessed thoracic anatomy. Once a week they received a quiz about abdominal anatomy. Students immediately received feedback afterwards. In the fourth course week, a survey about participation and satisfaction was taken. 424 students participated in the final summative exam. Trunk wall questions were used as a control. Relationship between participation and test results was investigated with a one-way ANOVA. RESULTS: More frequent participation in formative tests was correlated to higher scores in the summative exam with no difference between daily and weekly quizzes. This effect was found for thorax-abdomen and 'control' trunk wall questions. Participation in weekly quizzes was higher (p < 0.001). All survey responses showed a significant difference in favour of the weekly quiz (p < 0.001). DISCUSSION AND CONCLUSION: Participation in formative quizzes was correlated to summative exam scores. This correlation was not specific for the material tested, probably because of diligence. Student participation and preference were much higher in weekly quizzes.

Exploring the validity of assessment in anatomy: do images influence cognitive processes used in answering extended matching questions?

Assessment is an important aspect of medical education because it tests students' competence and motivates them to study. Various assessment methods, with and without images, are used in the study of anatomy. In this study, we investigated the use of extended matching questions (EMQs). To gain insight into the influence of images on the validity of test items, we focused on students' cognitive processes while they answered questions with and without images. Seventeen first-year medical students answered EMQs about gross anatomy, combined with either labeled images or answer lists, while thinking aloud. The participants' verbal reports were transcribed verbatim and then coded. Initial codes were based on a task analysis and were adapted into final codes during the coding process. Results showed that students used more cues from EMQs with images and visualized more often in EMQs with answer lists. Ready knowledge and verbal reasoning were used equally often in both conditions. In conclusion, EMQs with and without images elicit different results in this think aloud experiment, indicating different cognitive processes. They seem to measure different skills, making them valid for different testing purposes. The take-home message for anatomy teachers is that questions without images seem to test the quality of students' mental images while questions with images test their ability to interpret visual information. It makes sense to use both response formats in tests. Using images from clinical practice instead of anatomical drawings will help to improve test validity.

Anatomical knowledge gain through a clay-modeling exercise compared to live and video observations.

Clay modeling is increasingly used as a teaching method other than dissection. The haptic experience during clay modeling is supposed to correspond to the learning effect of manipulations during exercises in the dissection room involving tissues and organs. We questioned this assumption in two pretest-post-test experiments. In these experiments, the learning effects of clay modeling were compared to either live observations (Experiment I) or video observations (Experiment II) of the clay-modeling exercise. The effects of learning were measured with multiple choice questions, extended matching questions, and recognition of structures on illustrations of cross-sections. Analysis of covariance with pretest scores as the covariate was used to elaborate the results. Experiment I showed a significantly higher post-test score for the observers, whereas Experiment II showed a significantly higher post-test score for the clay modelers. This study shows that (1) students who perform clay-modeling exercises show less gain in anatomical knowledge than students who attentively observe the same exercise being carried out and (2) performing a clay-modeling exercise is better in anatomical knowledge gain compared to the study of a video of the recorded exercise. The most important learning effect seems to be the engagement in the exercise, focusing attention and stimulating time on task.

A tool for teaching three-dimensional dermatomes combined with distribution of cutaneous nerves on the limbs.

A teaching tool that facilitates student understanding of a three-dimensional (3D) integration of dermatomes with peripheral cutaneous nerve field distributions is described. This model is inspired by the confusion in novice learners between dermatome maps and nerve field distribution maps. This confusion leads to the misconception that these two distribution maps fully overlap, and may stem from three sources: (1) the differences in dermatome maps in anatomical textbooks, (2) the limited views in the figures of dermatome maps and cutaneous nerve field maps, hampering the acquisition of a 3D picture, and (3) the lack of figures showing both maps together. To clarify this concept, the learning process can be facilitated by transforming the 2D drawings in textbooks to a 3D hands-on model and by merging the information from the separate maps. Commercially available models were covered with white cotton pantyhose, and borders between dermatomes were marked using the drawings from the students' required study material. Distribution maps of selected peripheral nerves were cut out from color transparencies. Both the model and the cut-out nerve fields were then at the students' disposal during a laboratory exercise. The students were instructed to affix the transparencies in the right place according to the textbook's figures. This model facilitates integrating the spatial relationships of the two types of nerve distributions. By highlighting the spatial relationship and aiming to provoke student enthusiasm, this model follows the advantages of other low-fidelity models.

Do images influence assessment in anatomy? Exploring the effect of images on item difficulty and item discrimination.

Anatomists often use images in assessments and examinations. This study aims to investigate the influence of different types of images on item difficulty and item discrimination in written assessments. A total of 210 of 460 students volunteered for an extra assessment in a gross anatomy course. This assessment contained 39 test items grouped in seven themes. The answer format alternated per theme and was either a labeled image or an answer list, resulting in two versions containing both images and answer lists. Subjects were randomly assigned to one version. Answer formats were compared through item scores. Both examinations had similar overall difficulty and reliability. Two cross-sectional images resulted in greater item difficulty and item discrimination, compared to an answer list. A schematic image of fetal circulation led to decreased item difficulty and item discrimination. Three images showed variable effects. These results show that effects on assessment scores are dependent on the type of image used. Results from the two cross-sectional images suggest an extra ability is being tested. Data from a scheme of fetal circulation suggest a cueing effect. Variable effects from other images indicate that a context-dependent interaction takes place with the content of questions. The conclusion is that item difficulty and item discrimination can be affected when images are used instead of answer lists; thus, the use of images as a response format has potential implications for the validity of test items.

Learning anatomy enhances spatial ability.

Spatial ability is an important factor in learning anatomy. Students with high scores on a mental rotation test (MRT) systematically score higher on anatomy examinations. This study aims to investigate if learning anatomy also oppositely improves the MRT-score. Five hundred first year students of medicine (n = 242, intervention) and educational sciences (n = 258, control) participated in a pretest and posttest MRT, 1 month apart. During this month, the intervention group studied anatomy and the control group studied research methods for the social sciences. In the pretest, the intervention group scored 14.40 (SD: ± 3.37) and the control group 13.17 (SD: ± 3.36) on a scale of 20, which is a significant difference (t-test, t = 4.07, df = 498, P < 0.001). Both groups show an improvement on the posttest compared to the pretest (paired samples t-test, t = 12.21/14.71, df = 257/241, P < 0.001). The improvement in the intervention group is significantly higher (ANCOVA, F = 16.59, df = 1;497, P < 0.001). It is concluded that (1) medical students studying anatomy show greater improvement between two consecutive MRTs than educational science students; (2) medical students have a higher spatial ability than educational sciences students; and (3) if a MRT is repeated there seems to be a test effect. It is concluded that spatial ability may be trained by studying anatomy. The overarching message for anatomy teachers is that a good spatial ability is beneficial for learning anatomy and learning anatomy may be beneficial for students' spatial ability. This reciprocal advantage implies that challenging students on spatial aspects of anatomical knowledge could have a twofold effect on their learning.

Loosely-guided, self-directed learning versus strictly-guided, station-based learning in gross anatomy laboratory sessions.

Anatomy students studying dissected anatomical specimens were subjected to either a loosely-guided, self-directed learning environment or a strictly-guided, preformatted gross anatomy laboratory session. The current study's guiding questions were: (1) do strictly-guided gross anatomy laboratory sessions lead to higher learning gains than loosely-guided experiences? and (2) are there differences in the recall of anatomical knowledge between students who undergo the two types of laboratory sessions after weeks and months? The design was a randomized controlled trial. The participants were 360 second-year medical students attending a gross anatomy laboratory course on the anatomy of the hand. Half of the students, the experimental group, were subjected without prior warning to station-based laboratory sessions; the other half, the control group, to loosely-guided laboratory sessions, which was the course's prevailing educational method at the time. The recall of anatomical knowledge was measured by written reproduction of 12 anatomical names at four points in time: immediately after the laboratory experience, then one week, five weeks, and eight months later. The strictly-guided group scored higher than the loosely-guided group at all time-points. Repeated ANOVA showed no interaction between the results of the two types of laboratory sessions (P = 0.121) and a significant between-subject effect (P ≤ 0.001). Therefore, levels of anatomical knowledge retrieved were significantly higher for the strictly-guided group than for the loosely-guided group at all times. It was concluded that gross anatomy laboratory sessions with strict instructions resulted in the recall of a larger amount of anatomical knowledge, even after eight months.