Video-based lecture engagement in a flipped classroom environment.

PURPOSE: to analyze which factors are associated with students' engagement and participation in video-based lectures in a flipped classroom environment. METHODS: A single-center experience with video-based lectures in undergraduate medical education is described. The activity was applied to the subject of Neurosurgery during two consecutive courses (2021/22 and 2022/23). The videos were available prior to face-to-face classes through the online application Edpuzzle. Information was obtained from the own platform at the end of each course. Multivariable linear regression analyses were performed to assess the association between different variables and the percentage of video viewing, the early dropout rate, and the percentage of audience retention. RESULTS: A total of 109 students registered in Edpuzzle (87.2% of all enrolled students). Fifty-one videos were uploaded each course to cover 11 topics. Mean video viewing rate was 41%. Those videos linked to the earliest classroom lessons showed more percentage of viewing and audience retention than those programmed at the end of the course. With mandatory classroom assistance and homework assignments, the seminar videos were viewed more but retained less audience. Shorter videos were associated with higher viewing and audience adhesion, but the presence of questions embedded throughout the clip did not significantly engage students. No significant difference was observed regarding lesson topics. CONCLUSIONS: It is essential to emphasize the importance of designing strategies to initially engage learners since more than half of our students never connected to the clips. Decreasing engagement was associated with the end of the course and video length. Seminar videos were viewed more but retained less audience. Active learning activities such as quizzes embedded throughout the clips did not significantly engage learners.

Comparison of the effects of apprenticeship training by sandwich feedback and traditional methods on final-semester operating room technology students' perioperative competence and performance: a randomized, controlled trial.

BACKGROUND: Effective feedback is fundamental in clinical education, as it allows trainers to constantly diagnose the trainees' condition, determine their weaknesses, and intervene at proper times. Recently, different feedback-based approaches have been introduced in clinical training; however, the effectiveness of such interventions still needs to be studied extensively, especially in the perioperative field. Therefore, this study sought to compare the effects of apprenticeship training using sandwich feedback and traditional methods on the perioperative competence and performance of Operating Room (OR) technology students. METHODS: Thirty final-semester undergraduate OR technology students taking the apprenticeship courses were randomly allocated into experimental (n = 15) and control (n = 15) groups through the stratified randomization approach. The students in the experimental group experienced Feedback-Based Learning (FBL) using a sandwich model, and the students in the control group participated in Traditional-Based Training (TBT) in six five-hour sessions weekly for three consecutive weeks. All students completed the Persian version of the Perceived Perioperative Competence Scale-Revised (PPCS-R) on the first and last days of interventions. Also, a blinded rater completed a checklist to evaluate all students' performance via Direct Observation of Procedural Skills (DOPS) on the last intervention day. Besides, the students in the FBL filled out a questionnaire regarding their attitude toward the implemented program. RESULTS: The mean total score of the PPCS-R was significantly higher in the FBL than in the TBT on the last intervention day (P < 0.001). Additionally, the increase in mean change of PPCS-R total score from the first to last days was significantly more in the FBL (P < 0.001). Likewise, the FBL students had higher DOPS scores than the TBT ones (P < 0.001). Most FBL students also had a good attitude toward the implemented program (n = 8; 53.3%). CONCLUSION: Apprenticeship training using a sandwich feedback-based approach was superior to the traditional method for enhancing perioperative competence and performance of final-semester OR technology students. Additional studies are required to identify the sustainability of the findings.

Designing feedback processes in the workplace-based learning of undergraduate health professions education: a scoping review.

BACKGROUND: Feedback processes are crucial for learning, guiding improvement, and enhancing performance. In workplace-based learning settings, diverse teaching and assessment activities are advocated to be designed and implemented, generating feedback that students use, with proper guidance, to close the gap between current and desired performance levels. Since productive feedback processes rely on observed information regarding a student's performance, it is imperative to establish structured feedback activities within undergraduate workplace-based learning settings. However, these settings are characterized by their unpredictable nature, which can either promote learning or present challenges in offering structured learning opportunities for students. This scoping review maps literature on how feedback processes are organised in undergraduate clinical workplace-based learning settings, providing insight into the design and use of feedback. METHODS: A scoping review was conducted. Studies were identified from seven databases and ten relevant journals in medical education. The screening process was performed independently in duplicate with the support of the StArt program. Data were organized in a data chart and analyzed using thematic analysis. The feedback loop with a sociocultural perspective was used as a theoretical framework. RESULTS: The search yielded 4,877 papers, and 61 were included in the review. Two themes were identified in the qualitative analysis: (1) The organization of the feedback processes in workplace-based learning settings, and (2) Sociocultural factors influencing the organization of feedback processes. The literature describes multiple teaching and assessment activities that generate feedback information. Most papers described experiences and perceptions of diverse teaching and assessment feedback activities. Few studies described how feedback processes improve performance. Sociocultural factors such as establishing a feedback culture, enabling stable and trustworthy relationships, and enhancing student feedback agency are crucial for productive feedback processes. CONCLUSIONS: This review identified concrete ideas regarding how feedback could be organized within the clinical workplace to promote feedback processes. The feedback encounter should be organized to allow follow-up of the feedback, i.e., working on required learning and performance goals at the next occasion. The educational programs should design feedback processes by appropriately planning subsequent tasks and activities. More insight is needed in designing a full-loop feedback process, in which specific attention is needed in effective feedforward practices.

Enhancing Lessons on the Internet of Things in Science, Technology, Engineering, and Medical Education with a Remote Lab.

Integrating remote Internet of Things (IoT) laboratories into project-based learning (PBL) in higher education institutions (HEIs) while exploiting the approach of technology-enhanced learning (TEL) is a challenging yet pivotal endeavor. Our proposed approach enables students to interact with an IoT-equipped lab locally and remotely, thereby bridging theoretical knowledge with practical application, creating a more immersive, adaptable, and effective learning experience. This study underscores the significance of combining hardware, software, and coding skills in PBL, emphasizing how IoTRemoteLab (the remote lab we developed) supports a customized educational experience that promotes innovation and safety. Moreover, we explore the potential of IoTRemoteLab as a TEL, facilitating and supporting the understanding and definition of the requirements of remote learning. Furthermore, we demonstrate how we incorporate generative artificial intelligence into IoTRemoteLab's settings, enabling personalized recommendations for students leveraging the lab locally or remotely. Our approach serves as a model for educators and researchers aiming to equip students with essential skills for the digital age while addressing broader issues related to access, engagement, and sustainability in HEIs. The practical findings following an in-class experiment reinforce the value of IoTRemoteLab and its features in preparing students for future technological demands and fostering a more inclusive, safe, and effective educational environment.

Deliberate practice of diagnostic clinical reasoning reveals low performance and improvement of diagnostic justification in pre-clerkship students.

PURPOSE: Diagnostic errors are a large burden on patient safety and improving clinical reasoning (CR) education could contribute to reducing these errors. To this end, calls have been made to implement CR training as early as the first year of medical school. However, much is still unknown about pre-clerkship students' reasoning processes. The current study aimed to observe how pre-clerkship students use clinical information during the diagnostic process. METHODS: In a prospective observational study, pre-clerkship medical students completed 10-11 self-directed online simulated CR diagnostic cases. CR skills assessed included: creation of the differential diagnosis (Ddx), diagnostic justification (DxJ), ordering investigations, and identifying the most probable diagnosis. Student performances were compared to expert-created scorecards and students received detailed individualized formative feedback for every case. RESULTS: 121 of 133 (91%) first- and second-year medical students consented to the research project. Students scored much lower for DxJ compared to scores obtained for creation of the Ddx, ordering tests, and identifying the correct diagnosis, (30-48% lower, p < 0.001). Specifically, students underutilized physical exam data (p < 0.001) and underutilized data that decreased the probability of incorrect diagnoses (p < 0.001). We observed that DxJ scores increased 40% after 10-11 practice cases (p < 0.001). CONCLUSIONS: We implemented deliberate practice with formative feedback for CR starting in the first year of medical school. Students underperformed in DxJ, particularly with analyzing the physical exam data and pertinent negative data. We observed significant improvement in DxJ performance with increased practice.

Remote, asynchronous training and feedback enables development of neurodynamic skills in physiotherapy students.

BACKGROUND: During the COVID-19 pandemic, face-to-face teaching and learning of physiotherapy practical skills was limited. Asynchronous, remote training has been effective in development of clinical skills in some health professions. This study aimed to determine the effect of remote, asynchronous training and feedback on development of neurodynamic skills in physiotherapy students. METHODS: Longitudinal repeated measurements study, across four training sessions. Participants engaged in a remote training program for development of upper limb neurodynamic techniques. In this sequential training, participants viewed the online tutorial, practiced independently, and uploaded a video of their performance for formative assessment and feedback from a trained instructor via a checklist and rubric. RESULTS: Intra-subject analyses of 60 third-year physiotherapy students showed that the target standard of performance, with no further significant change in scores, was attained following session 2 for the checklist and session 3 for the rubric. This shows that two sessions are required to learn the procedures, and three sessions yield further improvements in performance quality. CONCLUSION: The remote, asynchronous training and feedback model proved to be an effective strategy for students' development of neurodynamic testing skills and forms a viable alternative to in-person training. This study contributes to the future of acquiring physiotherapy clinical competencies when distance or hybrid practice is required.

Teaching Independent Decision-Making Through a Computer-Based Drug Utilization Review Simulation.

Background: Drug utilization review (DUR) skills are important for pharmacists across all settings. Computer-based DUR simulations to teach student pharmacists are currently scarce. This article describes a computer-based DUR simulation that required limited faculty and financial resources and was implemented in collaboration among 3 institutions. Objective: To describe the innovation of a computer-based DUR simulation and its impact on pharmacy students' knowledge and confidence of DUR skills. Methods: This pre-post educational study assessed a computer-based DUR simulation that replicated the DUR process in dispensing systems. First- and third-year pharmacy students at 3 institutions were guided through simulated patient cases with various medication-related problems. The self-paced activity provided students with immediate, formative feedback and rationale for each option after an attempt was made in lieu of faculty intervention. Students completed pre-and post-assessments to evaluate changes in knowledge and confidence. Knowledge was assessed by comparing results of multiple choice and matching questions on the pre- and post-assessments. Confidence was assessed by the change in self-reported confidence scale measurements. Results: Students at all institutions (N = 405) had nonsignificant changes in knowledge scores from the pre-assessment to the post-assessment, with the exception of 1 question. All confidence survey questions significantly improved from pre- to post-assessment. Conclusion: The DUR educational innovation had a nonsignificant overall impact on students' knowledge but significantly improved confidence in their abilities. Skills-based instruction provides additional practice to increase student confidence.

Tailored Feedback Based on Clinically Relevant Performance Metrics Expedites the Acquisition of Robotic Suturing Skills-An Unblinded Pilot Randomized Controlled Trial.

PURPOSE: Previously, we identified 8 objective suturing performance metrics highly predictive of urinary continence recovery after robotic-assisted radical prostatectomy. Here, we aimed to test the feasibility of providing tailored feedback based upon these clinically relevant metrics and explore the impact on the acquisition of robotic suturing skills. MATERIALS AND METHODS: Training surgeons were recruited and randomized to a feedback group or a control group. Both groups completed a baseline, midterm and final dry laboratory vesicourethral anastomosis (VUA) and underwent 4 intervening training sessions each, consisting of 3 suturing exercises. Eight performance metrics were recorded during each exercise: 4 automated performance metrics (derived from kinematic and system events data of the da Vinci® Robotic System) representing efficiency and console manipulation competency, and 4 suturing technical skill scores. The feedback group received tailored feedback (a visual diagram+verbal instructions+video examples) based on these metrics after each session. Generalized linear mixed model was used to compare metric improvement (Δ) from baseline to the midterm and final VUA. RESULTS: Twenty-three participants were randomized to the feedback group (11) or the control group (12). Demographic data and baseline VUA metrics were comparable between groups. The feedback group showed greater improvement than the control group in aggregate suturing scores at midterm (mean Δ feedback group 4.5 vs Δ control group 1.1) and final VUA (Δ feedback group 5.3 vs Δ control group 4.9). The feedback group also showed greater improvement in the majority of the included metrics at midterm and final VUA. CONCLUSIONS: Tailored feedback based on specific, clinically relevant performance metrics is feasible and may expedite the acquisition of robotic suturing skills.

Development of a formative feedback tool for transanal total mesorectal excision.

INTRODUCTION: Transanal total mesorectal excision (TaTME) is a novel procedure in the treatment of rectal cancer. Current training models for TaTME suggest a period of proctored cases, but no structured feedback tool exists to guide operators during the learning phase. The objective of this study therefore was to develop a formative feedback tool for the critical steps of the transanal portion of TaTME. METHODS: A two-round Delphi study by TaTME experts was conducted to determine the items to be included in the formative feedback tool. Participants rated each step from a prepared list using a Likert scale from 1 (Not relevant) to 5 (Very relevant) with the option to suggest additional steps. Responses to the first round were presented in the second round, where participants rated the revised list of steps. Consensus was defined as > 80% of participants rating the step as 4 or 5 (out of 5). Items were combined when appropriate to avoid redundancy. Rating anchors describing performance (on a 5-point scale) were then developed for each step. The final tool was recirculated and participants rated the finished product on its feasibility and usefulness. RESULTS: Twenty-six TaTME experts were contacted for participation. Fifteen experts (58%) participated in the first round of the study, and eleven (42%) participated in the second round. The majority (14, 93%) had completed fellowship training in colorectal surgery. The first round of the Delphi study contained 34 items, and 32 items met inclusion criteria after the second round. Redundant items were combined into 15 items that comprised the final tool. Out of eight respondents to the feasibility survey, all believed the feedback tool enhances the feedback of learners and would use it for training purposes if available. CONCLUSION: This work describes the development of a novel consensus-based formative feedback tool specific to TaTME.

Application of Feedback Type on Performance of Abdominal Drawing-In Maneuver in Healthy Adults: A Quasi-Experimental Study of Motor Control and Motor Learning.

OBJECTIVE: The aim of this study was to compare the effects of verbal, tactile-verbal, and visual feedback on muscle activation of the lumbar stabilizers relative to extremity movers during an abdominal drawing-in maneuver when feedback is withheld. METHODS: This quasi-experimental study equally divided 54 healthy adults into 3 feedback groups (verbal, tactile-verbal, and visual) who trained twice per week over a 4-week period to perform supine abdominal drawing-in maneuvers. The percentage of maximum voluntary isometric contraction of rectus abdominis, multifidus (MF), erector spinae, and hamstrings (HS) as an outcome measure was acquired using surface electromyography. A 2-way factorial analysis of variance with bootstrapping allowed for comparison of post-pre difference scores across the interaction of feedback and muscle groups. RESULTS: Hamstring activation decreased in those receiving tactile-verbal feedback relative to an increase in participants given visual feedback. Furthermore, when using verbal feedback, HS activity increased relative to a decline in rectus abdominis, and when presenting visual feedback, HS activity increased relative to a decrease in MF. However, no post-pre changes were seen across muscles with tactile-verbal feedback. CONCLUSION: Although tactile-verbal feedback did not increase MF recruitment, it produced less HS activity than visual feedback. Undesirable HS recruitment may reflect boredom or feedback dependency.

Formative feedback generation in a VR-based dental surgical skill training simulator.

Fine motor skill is indispensable for a dentist. As in many other medical fields of study, the traditional surgical master-apprentice model is widely adopted in dental education. Recently, virtual reality (VR) simulators have been employed as supplementary components to the traditional skill-training curriculum, and numerous dental VR systems have been developed academically and commercially. However, the full promise of such systems has yet to be realized due to the lack of sufficient support for formative feedback. Without such a mechanism, evaluation still demands dedicated time of experts in scarce supply. To fill the gap of formative assessment using VR simulators in skill training in dentistry, we present a framework to objectively assess the surgical skill and generate formative feedback automatically. VR simulators enable collecting detailed data on relevant metrics throughout a procedure. Our approach to formative feedback is to correlate procedure metrics with the procedure outcome to identify the portions of a procedure that need to be improved. Specifically, for the errors in the outcome, the responsible portions of the procedure are identified by using the location of the error. Tutoring formative feedback is provided using the video modality. The effectiveness of the feedback system is evaluated with dental students using randomized controlled trials. The findings show the feedback mechanisms to be effective and to have the potential to be used as valuable supplemental training resources.

The "Difficult Learner" in anesthesiology: Challenges, pitfalls, and recommendations.

Struggling learners often require interventions that are time-consuming and emotionally exhausting for both the trainee and faculty. Numerous barriers, including lack of resources, faculty development, and fear of legal retribution, can impede medical educators from developing and implementing robust remediation plans. Despite the large volume of literature citing professionalism education and the "hidden curriculum" as problem areas in medical education, frontline educators lack practical tools and empowerment to address unprofessionalism in trainees. The paucity of resources in this arena has led to decreased job satisfaction, increased burnout, and an exodus from academic medicine. Department leadership acknowledgment and investment in training faculty on remediation strategies for learners in difficulty and providing tools to meet these challenging job demands will improve faculty's job satisfaction and overall well-being. The authors review salient literature and methodology for diagnosing learners in difficulty, with focus on a high-yield, pragmatic approach that can be taken by medical training programs, including those that lack a robust medical education infrastructure.

Faculty Perceptions of Formative Feedback from Medical Students.

Phenomenon: Feedback given by medical students to their teachers during a clerkship has the potential to improve learning by communicating students' needs and providing faculty with information on how to adjust their teaching. Aligning student learning needs and faculty teaching approach could result in increased student understanding and skill development before a clerkship's end. However, little is known about faculty perceptions of formative feedback from medical students and how faculty might respond to such feedback. Approach: In this qualitative study, semistructured interviews of 24 third-year clerkship faculty were conducted to explore faculty opinions about receiving formative feedback from students. Transcripts of these interviews were reviewed, and content analysis was performed. Findings: Faculty endorsed the idea of obtaining formative feedback from medical students. However, probing revealed factors that would significantly influence their receptivity and response to the feedback provided, including (a) who would be giving the feedback, (b) what content was included in the feedback, (c) how the feedback was framed, and (d) why the feedback was given. Although participants endorsed the concept of receiving formative feedback from medical students, their accounts of how they might respond to it presented a mixed picture of receptivity, acceptance, and response. Insights: These findings have practical implications. If formative feedback from medical students to faculty is to be encouraged, institutions need to find ways of creating a feedback culture in which more dialogic models become "the norm" and work with faculty to increase their receptivity to and acceptance of student feedback. This is essential for students to feel safe and be safe from retribution when providing insights into how faculty can better meet their learning needs.

A randomised controlled trial of feedback to improve patient satisfaction and consultation skills in medical students.

BACKGROUND: The use of feedback has been integral to medical student learning, but rigorous evidence to evaluate its education effect is limited, especially in the role of patient feedback in clinical teaching and practice improvement. The aim of the Patient Teaching Associate (PTA) Feedback Study was to evaluate whether additional written consumer feedback on patient satisfaction improved consultation skills among medical students and whether multisource feedback (MSF) improved student performance. METHODS: In this single site, double-blinded randomised controlled trial, 71 eligible medical students from two universities in their first clinical year were allocated to intervention or control and followed up for one semester. They participated in five simulated student-led consultations in a teaching clinic with patient volunteers living with chronic illness. Students in the intervention group received additional written feedback on patient satisfaction combined with guided self-reflection. The control group received usual immediate formative multisource feedback from tutors, patients and peers. Student characteristics, baseline patient-rated satisfaction scores and tutor-rated consultation skills were measured. RESULTS: Follow-up assessments were complete in 70 students attending the MSF program. At the final consultation episodes, both groups improved patient-rated rapport (P = 0.002), tutor-rated patient-centeredness and tutor-rated overall consultation skills (P = 0.01). The intervention group showed significantly better tutor-rated patient-centeredness (P = 0.003) comparing with the control group. Distress relief, communication comfort, rapport reported by patients and tutor-rated clinical skills did not differ significantly between the two groups. CONCLUSIONS: The innovative multisource feedback program effectively improved consultation skills in medical students. Structured written consumer feedback combined with guided student reflection further improved patient-centred practice and effectively enhanced the benefit of an MSF model. This strategy might provide a valuable adjunct to communication skills education for medical students. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry Number ACTRN12613001055796 .

Teaching vs learning: Impact of deliberate practice and formative feedback on developing point of care ultrasound skills.

PURPOSE: The study investigators hypothesized that Point of Care Ultrasound (POCUS) training through bolus didactic and workshop experiences may be sufficient for trainees to learn the cognitive aspects, while an extended period of exposure with formative feedback is responsible for developing the psychomotor skills critical for POCUS. METHODS: The investigators studied trainees over the course of an academic year. They compared trainees' performance on written (cognitive) and observed image acquisition (psychomotor) exams at baseline and at each subsequent quarter, using a stepped-wedge design. They performed linear regression analysis to determine which variables contributed to knowledge and psychomotor skill development. RESULTS: Twenty-six trainees met the study requirements and participated in the POCUS curriculum. Participating in a POCUS rotation was consistently associated with an increase in psychomotor scores. There was no consistent variable to predict an increase in trainee's score on written knowledge assessments. CONCLUSIONS: Extended exposure to POCUS over a 4-week rotation with direct and indirect formative feedback can explain difference in scores on psychomotor skills assessments. Trainees scored similarly on the written assessment with or without a POCUS rotation. Training through didactic and workshop experiences may be sufficient to learn the cognitive aspects, but not psychomotor skills required for POCUS.

Educators' behaviours during feedback in authentic clinical practice settings: an observational study and systematic analysis.

BACKGROUND: Verbal feedback plays a critical role in health professions education but it is not clear which components of effective feedback have been successfully translated from the literature into supervisory practice in the workplace, and which have not. The purpose of this study was to observe and systematically analyse educators' behaviours during authentic feedback episodes in contemporary clinical practice. METHODS: Educators and learners videoed themselves during formal feedback sessions in routine hospital training. Researchers compared educators' practice to a published set of 25 educator behaviours recommended for quality feedback. Individual educator behaviours were rated 0 = not seen, 1 = done somewhat, 2 = consistently done. To characterise individual educator's practice, their behaviour scores were summed. To describe how commonly each behaviour was observed across all the videos, mean scores were calculated. RESULTS: Researchers analysed 36 videos involving 34 educators (26 medical, 4 nursing, 4 physiotherapy professionals) and 35 learners across different health professions, specialties, levels of experience and gender. There was considerable variation in both educators' feedback practices, indicated by total scores for individual educators ranging from 5.7 to 34.2 (maximum possible 48), and how frequently specific feedback behaviours were seen across all the videos, indicated by mean scores for each behaviour ranging from 0.1 to 1.75 (maximum possible 2). Educators commonly provided performance analysis, described how the task should be performed, and were respectful and supportive. However a number of recommended feedback behaviours were rarely seen, such as clarifying the session purpose and expectations, promoting learner involvement, creating an action plan or arranging a subsequent review. CONCLUSIONS: These findings clarify contemporary feedback practice and inform the design of educational initiatives to help health professional educators and learners to better realise the potential of feedback.

A new tool for assessing short debriefings after immersive simulation: validity of the SHORT scale.

BACKGROUND: Simulation is being increasingly used worldwide in healthcare education. However, it is costly both in terms of finances and human resources. As a consequence, several institutions have designed programs offering several short immersive simulation sessions, each followed by short debriefings. Although debriefing is recommended, no tool exists to assess appropriateness of short debriefings after such simulation sessions. We have developed the Simulation in Healthcare retrOaction Rating Tool (SHORT) to assess short debriefings, and provide some validity evidence for its use. METHODS: We designed this scale based on our experience and previously published instruments, and tested it by assessing short debriefings of simulation sessions offered to emergency medicine residents at Laval University (Canada) from 2015 to 2016. Analysis of its reliability and validity was done using Standards for educational and psychological testing. Generalizability theory was used for testing internal structure evidence for validity. RESULTS: Two raters independently assessed 22 filmed short debriefings. Mean debriefing length was 10:35 (min 7:21; max 14:32). Calculated generalizability (reliability) coefficients are φ = 0.80 and φ-λ3 = 0.82. The generalizability coefficient for a single rater assessing three debriefings is φ = 0.84. CONCLUSIONS: The G study shows a high generalizability coefficient (φ ≥ 0.80), which demonstrates a high reliability. The response process evidence for validity provides evidence that no errors were associated with using the instrument. Further studies should be done to demonstrate validity of the English version of the instrument and to validate its use by novice raters trained in the use of the SHORT.

Measuring change in knowledge acquisition of Rwandan residents: using the American Board of Pediatrics International In-Training Examination (I-ITE) as an independent tool to monitor individual and departmental improvements during the Human Resources for Health program: an observational study.

BACKGROUND: Rwanda is the only African country to use the pediatric International In-Training Examination (I-ITE). The objectives of this study were to use the scores from the I-ITE to outline the baseline level of knowledge of Rwandan residents entering the pediatric residency and the trends in knowledge acquisition from 2012 to 2018, during the Human Resources for Health (HRH) Program, an education partnership between the Rwanda Ministry of Health and a consortium of US universities. METHODS: A retrospective descriptive analysis of the I-ITE exam scores, taken by all Rwandan pediatric residents for five of the six academic years of the study period. Individual resident scores were weighted using the non-Rwandan I-ITE sites to minimise confounding from annual variations in exam difficulty. Statistical analysis included descriptives with ANOVA to compare variation in annual mean scores. RESULTS: Eighty-four residents took 213 I-ITE exam sittings over the five exam cycles. The mean weighted I-ITE score of all residents increased from 34% in 2013 to 49% (p < 0.001) in 2018. The 32-point gap between the mean US-ITE and Rwandan I-ITE score in 2012-2013 was reduced to a 16-point gap in 2017-2018. First year resident (PG1) scores, which likely reflect the knowledge level of undergraduate medical students entering the residency program, increased from 34.8 to 44.3% (p = 0.002) between 2013 and 2018. CONCLUSIONS: The I-ITE is an independent, robust tool, measuring both learners and the institutional factors supporting residents. This is the first study to demonstrate that the I-ITE can be used to monitor resident knowledge acquisition in resource-limited settings, where assessment of resident knowledge can be a major challenge facing the academic medicine community. The significant increase in I-ITE scores between 2012 and 18 reflects the substantial curricular reorganisation accomplished through collaboration between Rwandan and US embedded faculty and supports the theory that programs such as HRH are highly effective at improving the quality of residency programs and undergraduate medical education.

Using gamification to develop academic writing skills in dental undergraduate students.

OBJECTIVES: To assess the satisfaction of first-year dental students with gamification and its effect on perceived and actual improvement of academic writing. METHODS: Two first-year classes of dental undergraduate students were recruited for the study which extended over 4 months and ended in January 2015. A pre-intervention assessment of students' academic writing skills was performed using criteria to evaluate writing. The same criteria were used to evaluate the final writing assignment after the intervention. Students' satisfaction with game aspects was assessed. The per cent change in writing score was regressed on scores of satisfaction with game aspects controlling for gender. Perceived improvement in writing was also assessed. RESULTS: Data from 87 (94.6%) students were available for analysis. Students' overall satisfaction with the gamified experience was modest [mean (SD) = 5.9 (2.1)] and so was their overall perception of improvement in writing [mean (SD) = 6.0 (2.2)]. The per cent score of the first assignment was 35.6 which improved to 80 in the last assignment. Satisfaction with playing the game was significantly associated with higher percentage of improvement in actual writing skills [regression coefficient (95% confidence interval) = 21.1 (1.9, 40.2)]. CONCLUSION: Using gamification in an obligatory course for first-year dental students was associated with an improvement in academic writing skills although students' satisfaction with game aspects was modest and their willingness to use gamification in future courses was minimal.

Impact of Expert Commentary and Student Reflection on Veterinary Clinical Decision-Making Skills in an Innovative Electronic-Learning Case-Based Platform.

One challenge in veterinary education is bridging the divide between the nature of classroom examples (well-defined problem solving) and real world situations (ill-defined problem solving). Solving the latter often relies on experiential knowledge, which is difficult to impart to inexperienced students. A multidisciplinary team including veterinary specialists and learning scientists developed an interactive, e-learning case-based module in which students made critical decisions at five specific points (Decision Points [DPs]). After committing to each decision (Original Answers), students reflected on the thought processes of experts making similar decisions, and were allowed to revise their decisions (Revised Answers); both sets of answers were scored. In Phase I, performance of students trained using the module (E-Learning Group) and by lecture (Traditional Group) was compared on the course final examination. There was no difference in performance between the groups, suggesting that the e-learning module was as effective as traditional lecture for content delivery. In Phase II, differences between Original Answers and Revised Answers were evaluated for a larger group of students, all of whom used the module as the sole method of instruction. There was a significant improvement in scores between Original and Revised Answers for four out of five DPs (DP1, p =.004; DP2, p =.04; DP4, p <.001; DP5, p <.001). The authors conclude that the ability to rehearse clinical decision making through this tool, without direct individual feedback from an instructor, may facilitate students' transition from problem solving in a well-structured classroom setting to an ill-structured clinical setting.