Beyond right or wrong: More effective feedback for formative multiple-choice tests.

INTRODUCTION: The role of feedback in test-enhanced learning is an understudied area that has the potential to improve student learning. This study investigates the influence of different forms of post-test feedback on retention and transfer of biomedical knowledge within a test-enhanced learning framework. METHODS: 64 participants from a Canadian and an Australian medical school sat two single-best-answer formative multiple choice tests one week apart. We compared the effects of conceptually focused, response-oriented, and simple right/wrong feedback on a learner's ability to correctly answer new (transfer) questions. On the first test occasion, participants received parent items with feedback, and then attempted items closely related (near transfer) to and more distant (far transfer) from parent items. In a repeat test at 1 week, participants were given different near and far transfer versions of parent items. Feedback type, and near and far transfer items were randomized within and across participants. RESULTS: Analysis demonstrated that response-oriented and conceptually focused feedback were superior to traditional right/wrong feedback for both types of transfer tasks and in both immediate and final retention test performance. However, there was no statistically significant difference between response-orientated and conceptually focused groups on near or far transfer problems, nor any differences in performance between our initial test occasion and the retention test 1 week later. As with most studies of transfer, participants' far transfer scores were lower than for near transfer. DISCUSSION: Right/wrong feedback appears to have limited potential to augment test-enhanced learning. Our work suggests that item-level feedback and feedback that identifies and elaborates on key conceptual knowledge are two important areas for future research on learning, retention and transfer.

Factors associated with the subspecialty choices of internal medicine residents in Canada.

BACKGROUND: Currently, there are more residents enrolled in cardiology training programs in Canada than in immunology, pharmacology, rheumatology, infectious diseases, geriatrics and endocrinology combined. There is no published data regarding the proportion of Canadian internal medicine residents applying to the various subspecialties, or the factors that residents consider important when deciding which subspecialty to pursue. To address the concern about physician imbalances in internal medicine subspecialties, we need to examine the factors that motivate residents when making career decisions. METHODS: In this two-phase study, Canadian internal medicine residents participating in the post graduate year 4 (PGY4) subspecialty match were invited to participate in a web-based survey and focus group discussions. The focus group discussions were based on issues identified from the survey results. Analysis of focus group transcripts grew on grounded theory. RESULTS: 110 PGY3 residents participating in the PGY4 subspecialty match from 10 participating Canadian universities participated in the web-based survey (54% response rate). 22 residents from 3 different training programs participated in 4 focus groups held across Canada. Our study found that residents are choosing careers that provide intellectual stimulation, are consistent with their personality, and that provide a challenge in diagnosis. From our focus group discussions it appears that lifestyle, role models, mentorship and the experience of the resident with the specialty appear to be equally important in career decisions. Males are more likely to choose procedure based specialties and are more concerned with the reputation of the specialty as well as the anticipated salary. In contrast, residents choosing non-procedure based specialties are more concerned with issues related to lifestyle, including work-related stress, work hours and time for leisure as well as the patient populations they are treating. CONCLUSION: This study suggests that internal medicine trainees, and particularly males, are increasingly choosing procedure-based specialties while non-procedure based specialties, and in particular general internal medicine, are losing appeal. We need to implement strategies to ensure positive rotation experiences, exposure to role models, improved lifestyle and job satisfaction as well as payment schedules that are equitable between disciplines in order to attract residents to less popular career choices.

Career choice in academic medicine: systematic review.

OBJECTIVES: To review systematically the evidence about what factors influence the decision to choose or not choose a career in academic medicine. DESIGN: A systematic review of relevant literature from 1990 to May 2005. DATA SOURCES: Searches of The Cochrane Library, Medline (using Ovid and PubMed) from 1990 to May 2005, and EMBASE from 1990 to May 2005 were completed to identify relevant studies that explored the influential factors. Additional articles were identified from searching the bibliographies of retrieved articles. SELECTION OF STUDIES: We attempted to identify studies that included residents, fellows, or staff physicians. No restrictions were placed on the study methodologies identified and all articles presenting empirical evidence were retrieved. For cohort, case-control, and cross-sectional studies, minimum inclusion criteria were the presence of defined groups, and the ability to extract relevant data. For surveys that involved case series, minimum inclusion criteria were a description of the population, and the availability of extractable data. Minimum inclusion criteria for qualitative studies were descriptions of the sampling strategy and methods. RESULTS: The search identified 251 abstracts; 25 articles were included in this review. Completion of an MD with a graduate degree or fellowship program is associated with a career in academic medicine. Of the articles identified in this review, this finding is supported by the highest quality of evidence. Similarly, the completion of research and publication of this research in medical school and residency are associated with a career in academic medicine. The desire to teach, conduct research, and the intellectual stimulation and challenge provided in academia may also persuade people to choose this career path. The influence of a role model or a mentor was reported by physicians to impact their decision making. Trainees' interest in academic medicine wanes as they progress through their residency. CONCLUSIONS: In order to revitalize academic medicine, we must engage trainees and retain their interest throughout their training. Research opportunities for medical students, and fellowships or graduate training can meet this challenge and influence career choice. Initiatives to stimulate and maintain interest in academic medicine should be evaluated in prospective studies across multiple sites.

Educational impact of using smartphones for clinical communication on general medicine: more global, less local.

BACKGROUND: Medical trainees increasingly use smartphones in their clinical work. Similar to other information technology implementations, smartphone use can result in unintended consequences. This study aimed to examine the impact of smartphone use for clinical communication on medical trainees' educational experiences. DESIGN: Qualitative research methodology using interview data, ethnographic data, and analysis of e-mail messages. ANALYSIS: We analyzed the interview transcripts, ethnographic data, and e-mails by applying a conceptual framework consisting of 5 educational domains. RESULTS: Smartphone use increased connectedness and resulted in a high level of interruptions. These 2 factors impacted 3 discrete educational domains: supervision, teaching, and professionalism. Smartphone use increased connectedness to supervisors and may improve supervision, making it easier for supervisors to take over but can limit autonomy by reducing learner decision making. Teaching activities may be easier to coordinate, but smartphone use interrupted learners and reduced teaching effectiveness during these sessions. Finally, there may be professionalism issues in relation to how residents use smartphones during encounters with patients and health professionals and in teaching sessions. CONCLUSIONS: We summarized the impact of a rapidly emerging information technology-smartphones-on the educational experience of medical trainees. Smartphone use increase connectedness and allow trainees to be more globally available for patient care but creates interruptions that cause trainees to be less present in their local interactions with staff during teaching sessions. Educators should be aware of these findings and need to develop curriculum to address the negative impacts of smartphone use in the clinical training environment.