Does spaced education improve clinical knowledge among Family Medicine residents? A cluster randomized controlled trial.

Spaced education is a learning strategy to improve knowledge acquisition and retention. To date, no robust evidence exists to support the utility of spaced education in the Family Medicine residency. We aimed to test whether alerts to encourage spaced education can improve clinical knowledge as measured by scores on the Canadian Family Medicine certification examination. METHOD: We conducted a cluster randomized controlled trial to empirically and pragmatically test spaced education using two versions of the Family Medicine Study Guide mobile app. 12 residency training programs in Canada agreed to participate. At six intervention sites, we consented 335 of the 654 (51%) eligible residents. Residents in the intervention group were sent alerts through the app to encourage the answering of questions linked to clinical cases. At six control sites, 299 of 586 (51%) residents consented. Residents in the control group received the same app but with no alerts. Incidence rates of case completion between trial arms were compared using repeated measures analysis. We linked residents in both trial arms to their knowledge scores on the certification examination of the College of Family Physicians of Canada. RESULTS: Over 67 weeks, there was no statistically significant difference in the completion of clinical cases by participants. The difference in mean exam scores and the associated confidence interval did not exceed the pre-defined limit of 4 percentage points. CONCLUSION: Further research is recommended before deploying spaced educational interventions in the Family Medicine residency to improve knowledge.

Preparing residents to deal with human trafficking.

BACKGROUND: Victims of human trafficking (HT) are predisposed to numerous health concerns. Many encounter health care practitioners during captivity, but awareness and knowledge among front-line physicians is low. Limited data exist on attempts to address this within residency training programmes. Formal curriculum time in residency is limited and online modules may be a useful educational option. METHODS: Residents in family medicine, emergency medicine and general paediatrics at the University of Alberta were invited to participate. They completed short surveys to assess knowledge both before and after completing an online learning module either individually (n = 15) or in a facilitated session (n = 17). Baseline and post-intervention changes in self-reported and tested knowledge were assessed. RESULTS: Thirty-two residents completed the pre-intervention survey: only 6% self-identified as somewhat knowledgeable on HT and 16% knew the red flags used to identify victims. Eighty-one percent wanted this topic incorporated into residency training, but only 6% and 25% had received education previously in residency or medical school, respectively. Thirteen percent were comfortable supporting victims, and 6% reported knowing how to provide support. Twenty residents completed the post-intervention survey, with improvements in both self-reported (p < 0.001) and tested (p = 0.005) knowledge of HT. Residents also reported being more prepared to identify victims (p < 0.001), more comfortable supporting victims (p < 0.001) and more confident in knowing how to support victims (p < 0.001). DISCUSSION: Baseline HT knowledge in residents providing first-contact care appears limited. Residency programmes should consider providing more HT education in order to improve competency in care. Although an online module was shown to be effective, protected time might be necessary for the widespread adoption of online education delivery.

Examining Accuracy of Self-Assessment of In-Training Examination Performance in a Context of Guided Self-Assessment.

BACKGROUND AND OBJECTIVES: In our family medicine residency program, we have established a culture of guided self-assessment through a systematic approach of direct observation of residents and documentation of formative feedback. We have observed that our residents have become more accurate in self-assessing their clinical performance. The objective of this study was to examine whether this improved accuracy extended to residents' self-assessment of their medical knowledge and clinical reasoning on the In-Training Examination (ITE). METHODS: In November each year, residents in their first (PGY1) and second (PGY2) years of residency take the ITE (240 multiple-choice questions). Immediately before and right after taking the ITE, residents complete a questionnaire, self-assessing their knowledge and predicting their performances, overall and in eight high-level domains. Consented data from residents who took the ITE in 2009-2015 (n=380, 60% participation rate) were used in the Generalized Estimating Equations analyses. RESULTS: PGY2 residents outperformed PGY1 residents; Canadian medical graduates consistently outperformed international medical graduates; urban and rural residents performed similarly overall. Residents' pre-post self-assessments were in line with residents' actual performance on the overall examination and in the domains of Adult Medicine and Care of Surgical Patients. The underperforming residents in this study accurately predicted both pre- and post-ITE that they would perform poorly. CONCLUSION: Our findings suggest that the ITE operates well in our program. There was a tendency among residents in this study to appropriately adjust their self-assessment of their overall performance after completing the ITE. Irrespective of the residency year, resident self-assessment was less accurate on individual domains.