Fostering novice students' diagnostic ability: the value of guiding deliberate reflection.

BACKGROUND: Deliberate reflection when practising the diagnosis of clinical cases has been shown to develop medical students' diagnostic competence. Adding guidance by cueing reflection or providing modelling of reflection increased the benefits of reflection for advanced (Years 5-6) students. The present study investigated whether we could replicate and extend these findings by comparing the effects of free, cued and modelled reflection on novice students' diagnostic competence. METHODS: A total of 80 third-year medical students participated in a two-phase experiment. In the learning phase, students diagnosed nine clinical cases under one of three conditions: free reflection; cued reflection, and modelled reflection. Two weeks later, all students diagnosed four new examples of the diseases studied in the learning phase and four cases of non-studied related diseases ('adjacent diseases'). The main outcome measurements were diagnostic accuracy scores (range 0-1) on studied and adjacent diseases. RESULTS: For studied diseases, there was a significant effect of experimental condition on diagnostic accuracy (p < 0.02), with the cued-reflection group (mean = 0.58, standard deviation [SD] = 0.23) performing significantly better than the free-reflection group (mean = 0.41, SD = 0.20; p < 0.02). The cued-reflection and modelled-reflection groups (mean = 0.54, SD = 0.22) did not differ in diagnostic accuracy (p > 0.05), nor did the modelled-reflection group perform better than the free-reflection group (p > 0.05). For adjacent diseases, the three groups scored extremely low, without significant differences in performance (p > 0.05). Cued reflection and free reflection were rated as requiring similar effort (p > 0.05) and both were more demanding than studying examples of reflection (both p < 0.001) in the learning phase. CONCLUSIONS: Simply cueing novice students' reflection to focus it on relevant diseases was sufficient to increase diagnostic performance relative to reflection without any guidance. Cued reflection and studying examples of reflection appear to be equally useful approaches for teaching clinical diagnosis to novice students. Students found studying examples of reflection required less effort but cued reflection will certainly demand much less investment from teachers.

Effect of reflection on medical students' situational interest: an experimental study.

CONTEXT: Reflection has been considered crucial to learning. Engaging in reflection while solving problems is expected to foster identification of knowledge gaps and interest in learning more about them, the latter being a major motivational force in learning. Although theoretically sound, this assumption still lacks empirical evidence. This experiment investigated whether reflection while diagnosing clinical cases of different levels of difficulty influences medical students' awareness of knowledge gaps and situational interest. METHODS: Forty-two fourth-year students from a Brazilian medical school were randomly allocated to diagnose six clinical cases (three difficult; three easy), either by following a structured reflection procedure (reflection group) or by giving alternative diagnoses (control group). Subsequently, for each case, all students rated their situational interest and awareness of knowledge gaps. RESULTS: Situational interest was significantly higher in the reflection group than in the control group (mean = 4.10, standard deviation = 0.50 versus mean = 3.65, standard deviation = 0.48, respectively; p = 0.003; range, 1-5). The effect size was large (d = 0.92). Awareness of knowledge gaps was higher in the reflection group than in the control group, but the difference was not significant. Case difficulty influenced both situational interest, which was significantly higher on easy than on difficult cases (mean = 3.96, standard deviation = 0.56 versus mean = 3.80, standard deviation = 0.55, respectively; p = 0.004), and awareness of knowledge gaps, with higher scores observed on difficult compared with easy cases (mean = 3.99, standard deviation = 0.46 versus mean = 3.66, standard deviation = 0.53, respectively; p < .001). No interaction between experimental condition and case difficulty emerged. CONCLUSION: Relative to providing alternative diagnoses while solving cases, structured reflection increased medical students' interest and may therefore be a useful tool for teachers concerned with enhancing students' motivation for learning. Surprisingly, easy cases promoted higher situational interest despite the higher awareness of knowledge gaps on difficult cases. This suggests the potential for case difficulty to inhibit students' interest in learning, a possibility that demands further investigation.

Reflection as a strategy to foster medical students' acquisition of diagnostic competence.

OBJECTIVES: Developing diagnostic competence in students is a major goal of medical education, but there is little empirical evidence on instructional strategies that foster the acquisition of this competence. The aim of this study was to investigate the effects of structured reflection compared with the generation of immediate or differential diagnosis while practising with clinical cases on learning clinical diagnosis. METHODS: This was a three-phase experimental study. During a learning phase, 46 Year 4 students diagnosed six clinical cases under different experimental conditions: structured reflection, immediate diagnosis, or differential diagnosis. This was followed by an immediate test and a delayed test administered 1 week later. Each test consisted of diagnosing four different cases of diseases presented in the learning phase. Performance in diagnosing these new cases was used as a measure of learning. RESULTS: Repeated-measures analysis of variance on the mean diagnostic accuracy scores (range: 0-1) showed a significant interaction between performance moment (i.e. performance in the learning phase and on each test) and instructions followed during the learning phase (p=0.003). Follow-up analyses of this interaction showed that diagnostic performance did not differ between conditions in the learning phase. On the immediate test, scores in the reflection condition (mean=0.48, 95% confidence interval [CI] 0.38-0.58) were significantly lower than scores in the differential diagnosis condition (mean=0.62, 95% CI 0.54-0.70; p=0.012) and marginally lower than those in the immediate diagnosis condition (mean=0.61, 95% CI 0.52-0.70; p=0.04). One week later, however, scores in the reflection condition (mean=0.66, 95% CI 0.56-0.76) significantly outperformed those in the other conditions (differential diagnosis: mean=0.48, 95% CI 0.37-0.58 [p<0.01]; immediate diagnosis: mean=0.52, 95% CI 0.43-0.60 [p=0.01]). Comparisons within experimental conditions showed that performance from the immediate to the delayed test decreased in the immediate and differential diagnosis conditions (immediate diagnosis: p=0.042; differential diagnosis: p=0.012), but increased in the reflection condition (p=0.003). CONCLUSIONS: Structured reflection while practising with cases appears to foster the learning of clinical knowledge more effectively than the generation of immediate or differential diagnoses and therefore seems to be an effective instructional approach to developing diagnostic competence in students.