The concept of errors in medical education: a scoping review.

The purpose of this scoping review was to explore how errors are conceptualized in medical education contexts by examining different error perspectives and practices. This review used a scoping methodology with a systematic search strategy to identify relevant studies, written in English, and published before January 2021. Four medical education journals (Medical Education, Advances in Health Science Education, Medical Teacher, and Academic Medicine) and four clinical journals (Journal of the American Medical Association, Journal of General Internal Medicine, Annals of Surgery, and British Medical Journal) were purposively selected. Data extraction was charted according to a data collection form. Of 1505 screened studies, 79 studies were included. Three overarching perspectives were identified: 'understanding errors') (n = 31), 'avoiding errors' (n = 25), 'learning from errors' (n = 23). Studies that aimed at'understanding errors' used qualitative methods (19/31, 61.3%) and took place in the clinical setting (19/31, 61.3%), whereas studies that aimed at 'avoiding errors' and 'learning from errors' used quantitative methods ('avoiding errors': 20/25, 80%, and 'learning from errors': 16/23, 69.6%, p = 0.007) and took place in pre-clinical (14/25, 56%) and simulated settings (10/23, 43.5%), respectively (p < 0.001). The three perspectives differed significantly in terms of inclusion of educational theory: 'Understanding errors' studies 16.1% (5/31),'avoiding errors' studies 48% (12/25), and 'learning from errors' studies 73.9% (17/23), p < 0.001. Errors in medical education and clinical practice are defined differently, which makes comparisons difficult. A uniform understanding is not necessarily a goal but improving transparency and clarity of how errors are currently conceptualized may improve our understanding of when, why, and how to use and learn from errors in the future.

The myth of ivory tower versus practice-oriented research: A systematic review of randomised studies in medical education.

CONTEXT: A long-standing myth in medical education research is a divide between two different poles: research aiming to advance theory with little focus on practical applications ('ivory tower' research) and practically oriented research aiming to serve educators and decision-makers with little focus on advancing theory ('in-the-trenches' practice). We explored this myth in a sample of randomised medical education studies using Stokes' four-quadrant framework for the classification of research perspective. METHODS: We searched MEDLINE, Embase, CINAHL, PsychINFO, ERIC, Web of Science and Scopus for studies in medical education using a randomised design that were published between 1 January 2018 and 31 December 2018. We used Stokes' four-quadrant framework to categorise the studies according to their use of theory, concepts and their justification for practical use. We compared medical education research published in medical education journals and clinical journals. RESULTS: A total of 150 randomised studies were included in the analysis. The largest segment of studies (46.7%) was categorised as use-inspired basic research (Pasteur's Quadrant), closely followed by pure applied research (40.7%, Edison's Quadrant). Only a few studies were categorised as aiming to advance knowledge with no thought for practical educational application (2.0%, Bohr's Quadrant). The proportion of studies that included educational concepts and theory differed according to publication in clinical journals or medical education journals: 40.5% vs 71.8%, respectively, P < .001. There were no differences between journals with regard to the proportion of studies that included a practical educational or clinical rationale (P = .99). CONCLUSION: In a large sample of studies using randomised designs, we found no evidence to support the myth that medical education research divides between two singular poles represented by 'ivory tower research' and 'in-the-trenches practice'. We did confirm prevailing assumptions regarding an emphasis on non-theoretical medical education research in clinical journals.

"It was great to break down the walls between patient and provider": liminality in a co-produced advisory course for psychiatry residents.

Although rhetoric abounds about the importance of patient-, person- and relationship-centered approaches to health care, little is known about how to address the problem of dehumanization through medical and health professions education. One promising but under-theorized strategy is to co-produce education in collaboration with health service users. To this end, we co-produced a longitudinal course in psychiatry that paired people with lived experience of mental health challenges as advisors to fourth-year psychiatry residents at the University of Toronto. The goal of this study was to examine this novel, relationship-based course in order to understand co-produced health professions education more broadly. Using qualitative interviews with residents and advisors after the first iteration of the course, we explored how participants made meaning of the course and of what learning, if any, occurred, for whom and how. We found that the anthropological theory of liminality allowed us to understand participants' complex experiences and illuminated how this type of pedagogy may work to achieve its effects. Liminality also helped us understand why some participants resisted the course, and how we could more carefully think about co-produced, humanistic education and transformative learning.

How supervision and educational supports impact medical students' preparation for future learning of endotracheal intubation skills: a non-inferiority experimental trial.

BACKGROUND: Professional education cannot keep pace with the rapid advancements of knowledge in today's society. But it can develop professionals who can. 'Preparation for future learning' (PFL) has been conceptualized as a form of transfer whereby learners use their previous knowledge to learn about and adaptively solve new problems. Improved PFL outcomes have been linked to instructional approaches targeting learning mechanisms similar to those associated with successful self-regulated learning (SRL). We expected training that includes evidence-based SRL-supports would be non-inferior to training with direct supervision using the outcomes of a 'near transfer' test, and a PFL assessment of simulated endotracheal intubation skills. METHOD: This study took place at the University of Toronto from October 2014 to August 2015. We randomized medical students and residents (n = 54) into three groups: Unsupervised, Supported; Supervised, Supported; and Unsupervised, Unsupported. Two raters scored participants' test performances using a Global Rating Scale with strong validity evidence. We analyzed participants' near transfer and PFL outcomes using two separate mixed effects ANCOVAs. RESULTS: For the Unsupervised, Supported group versus the Supervised, Supported group, we found that the difference in mean scores was 0.20, with a 95% Confidence Interval (CI) of - 0.17 to 0.57, on the near transfer test, and was 0.09, with a 95% CI of - 0.28 to 0.46, on the PFL assessment. Neither mean score nor their 95% CIs exceeded the non-inferiority margin of 0.60 units. Compared to the two Supported groups, the Unsupervised, Unsupported group was non-inferior on the near transfer test (differences in mean scores were 0.02 and - 0.22). On the PFL assessment, however, the differences in mean scores were 0.38 and 0.29, and both 95% CIs crossed the non-inferiority margin. CONCLUSIONS: Training with SRL-supports was non-inferior to training with a supervisor. Both interventions appeared to impact PFL assessment outcomes positively, yet inconclusively when compared to the Unsupervised and Unsupported group, By contrast, the Unsupervised, Supported group did not score well on the near transfer test. Based on the observed sensitivity of the PFL assessment, we recommend researchers continue to study how such assessments may measure learners' SRL outcomes  during structured learning experiences.

Correction to: "Getting Everyone on the Same Page": Interprofessional Team Training to Develop Shared Mental Models on Interprofessional Rounds.

This capsule commentary, Capsule Commentary on Liaw et al., "Getting everyone on the same page": interprofessional team training to develop shared mental models on interprofessional rounds," was to have accompanied the article, DOI: https://doi.org/10.1007/s11606-019-05320-z, which appeared in the December 2019 issue.

Social ties between team members affect patient satisfaction: a data-driven approach to handling complex network analyses.

Research from outside the medical field suggests that social ties between team-members influence knowledge sharing, improve coordination, and facilitate task completion. However, the relative importance of social ties among team-members for patient satisfaction remains unknown. In this study, we explored the association between social ties within emergency teams performing simulated caesarean sections (CS) and patient-actor satisfaction. Two hundred seventy-two participants were allocated to 33 teams performing two emergency CSs in a simulated setting. We collected data on social ties between team-members, measured as affective, personal and professional ties. Ties were rated on 5-point Likert scales. In addition, participants' clinical experience, demographic data and their knowledge about team members' roles were surveyed. Perceived patient satisfaction was measured on a 5-point Likert scale. Data was analysed with a linear regression model using elastic net regularization. In total, 109 predictor variables were analysed including 84 related to social ties and 25 related to clinical experience, demographics and knowledge test scores. Of the 84 variables reflecting social ties, 34 (41%) had significant association with patient satisfaction, p < 0.01. By contrast, a significant association with patient satisfaction was found for only one (4%) of the 25 variables reflecting clinical experience, demographics and knowledge of team roles. Affective ties and personal ties were found to be far more important predictors in the statistical model than professional ties and predictors relating to clinical experience. Social ties between emergency team members may be important predictors of patient satisfaction. The results from this study help to enhance our conceptual understanding of social ties and their implications for team-dynamics. Our study challenges existing views of team-performance by placing emphasis on achieving collective competence through affective and personal social ties, rather than focusing on traditional measures of expertise.

Social ties influence teamwork when managing clinical emergencies.

BACKGROUND: Our current understanding of medical team competence is traditionally influenced by an individualistic perspective focusing on individual team members' knowledge, skills as well as on effective communication within the team. However, team dynamics may influence team performance more than previously anticipated. In particular, recent studies in other academic disciplines suggest that social ties between team members may impact team dynamics but this has not been explored for medical teams. We aimed to explore intensive care staff's perceptions about teamwork and performance in clinical emergencies focusing particularly on the teams' social ties. METHODS: Semi-structured interviews were conducted with a purposive sample of intensive care staff. We used a thematic analysis approach to data interpretation. RESULTS: Thematic saturation was achieved after three group interviews and eight individual interviews. Findings demonstrated that social ties influenced teamwork by affecting the teams' ability to co-construct knowledge, coordinate tasks, the need for hierarchy, the degree to which they relied on explicit or implicit communication, as well as their ability to promote adaptive behavior. CONCLUSIONS: Social ties may be an important factor to consider and acknowledge in the design of future team training, as well as for work planning and scheduling of team activities during clinical practice. More research is needed into the causal effect of social ties on team performance and outcome.

Co-producing Psychiatric Education with Service User Educators: a Collective Autobiographical Case Study of the Meaning, Ethics, and Importance of Payment.

OBJECTIVE: Co-production involves service providers and service users collaborating to design and deliver services together and is gaining attention as a means to improve provision of care. Aiming to extend this model to an educational context, the authors assembled a diverse group to develop co-produced education for psychiatry residents and medical students at the University of Toronto over several years. The authors describe the dynamics involved in co-producing psychiatric education as experienced in their work. METHODS: A collaborative autobiographical case study approach provides a snapshot of the collective experiences of working to write a manuscript about paying service users for their contributions to co-produced education. Data were collected from two in-person meetings, personal communications, emails, and online comments to capture the fullest possible range of perspectives from the group about payment. RESULTS: The juxtaposition of the vision for an inclusive process against the budgetary constraints that the authors faced led them to reflect deeply on the many meanings of paying service user educators for their contributions to academic initiatives. These reflections revealed that payment had implications at personal, organizational, and social levels. CONCLUSION: Paying mental health service user educators for their contributions is an ethical imperative for the authors. However, unless payment is accompanied by other forms of demonstrating respect, it aligns with organizational structures and practices, and it is connected to a larger goal of achieving social justice, the role of service users as legitimate knowers and educators and ultimately their impact on learners will be limited.

"Getting Everyone on the Same Page": Interprofessional Team Training to Develop Shared Mental Models on Interprofessional Rounds.

AIM: This study aimed to evaluate the effect of a team training program to support shared mental model (SMM) development in interprofessional rounds. DESIGN AND PARTICIPANTS: A three-arm randomized controlled trial study was conducted for interprofessional teams of 207 health profession learners who were randomized into three groups. PROGRAM DESCRIPTION: The full team training program included a didactic training part on cognitive tools and a virtual simulation to support clinical teamwork in interprofessional round. Group 1 was assigned to the full program, group 2 to the didactic part, and group 3 (control group) with no intervention. The main outcome measure was team performance in full scale simulation. Secondary outcome was interprofessional attitudes. PROGRAM EVALUATION: Teamwork performance and interprofessional attitude scores of the full intervention group were significantly higher (P < 0.05) than those of the control group. The two intervention groups had significantly higher (P < 0.05) attitude scores on interprofessional teamwork compared with the control group. DISCUSSION: Our study indicates the need of both cognitive tools and experiential learning modalities to foster SMM development for the delivery of optimal clinical teamwork performances. Given its scalability and practicality, we anticipate a greater role for virtual simulations to support interprofessional team training.

Optimizing Residents' Performance of Lumbar Puncture: An RCT Comparing the Effect of Preparatory Interventions on Performance and Self-Confidence.

BACKGROUND: Lumbar puncture is often associated with uncertainty and limited experience on the part of residents; therefore, preparatory interventions can be essential. There is growing interest in the potential benefit of videos over written text. However, little attention has been given to whether the design of the videos impacts on subsequent performance. OBJECTIVE: To investigate the effect of different preparatory interventions on learner performance and self-confidence regarding lumbar puncture (LP). DESIGN: Randomized controlled trial in which participants were randomly assigned to one of three interventions as preparation for performing lumbar puncture: 1) goal- and learner-centered video (GLV) presenting procedure-specific process goals and learner-centered information; 2) traditional video (TV) providing expert-driven content, but no process goals; and 3) written text (WT) with illustrations. PARTICIPANTS AND MAIN MEASURES: Participants were PGY-1 doctors without LP experience. After the preparatory intervention, participants performed an LP in a simulated setting with a standardized patient and an assistant. Two content experts, blinded to participant group allocation, assessed video recordings of the performance using the Lumbar Puncture Assessment Tool (LumPAT) and an overall global rating. Participants rated their self-confidence immediately prior to performing the procedure. The primary outcome was the difference in LumPAT scores among groups. KEY RESULTS: A total of 110 PGY-1 doctors were included. Results demonstrated significant differences in LumPAT mean scores among the three groups: GLV, 42.8; TV, 40.6; WT, 38.1 (p = 0.01). The global rating scores were highest in the GLV group (p = 0.026). Self-confidence scores differed significantly among the three groups (p = 0.003), with the TV group scoring the highest. There were no significant correlations between self-confidence scores and performance scores in any of the groups. CONCLUSION: A video designed with procedure-specific process goals and learner-centered information resulted in better subsequent LP performance than a traditionally designed video or written text. Participants' self-confidence was not predictive of their actual performance.

Up or down? A randomized trial comparing image orientations during transvaginal ultrasound training.

INTRODUCTION: There is no international consensus on the orientation of transvaginal ultrasound images and no evidence exists to support the superiority of one image orientation over the other. The aim of this study was to compare learning curves and skills transfer in a group of novices randomized to top-down or bottom-up image orientation, and to determine whether individual preferences for image orientation affect learning and skills transfer. MATERIAL AND METHODS: 60 senior medical students, with no prior ultrasound experience, were randomized to orient the image top-down or bottom-up during training on an ultrasound simulator until attaining expert levels of performance. Participants then completed a transfer test involving a systematic ultrasound examination on a physical mannequin using real ultrasound equipment. Performance was assessed during the transfer test by two independent raters using the objective structured assessment of ultrasound skills (OSAUS) score and a global rating score. RESULTS: The bottom-up group reached the expert level with significantly fewer attempts than did the top-down group [median ± interquartile range: 4 ± 2 vs 5 ± 3] (U = 285.5, P = 0.014). The bottom-up group used less time to achieve the expert level (median ± interquartile range: 3 h 2 m ± 1 h 14 m vs 3 h 28 m ± 2 h 21 m) (U = 301.5, P = 0.029). The two groups performed similarly during the transfer test with respect to their OSAUS scores (top-down 56.7% vs bottom-up 53.2%, P = 0.13). The global rating scores were higher in the top-down group (top-down 57.1% vs bottom-up 50.0%, P = 0.02). CONCLUSIONS: Orientation of the images bottom-up rather than top-down, led to a steeper learning curve, but had little or no impact on the subsequent transfer of skills.

Knowing How and Knowing Why: testing the effect of instruction designed for cognitive integration on procedural skills transfer.

Transfer is a desired outcome of simulation-based training, yet evidence for how instructional design features promote transfer is lacking. In clinical reasoning, transfer is improved when trainees experience instruction integrating basic science explanations with clinical signs and symptoms. To test whether integrated instruction has similar effects in procedural skills (i.e., psychomotor skills) training, we studied the impact of instruction that integrates conceptual (why) and procedural (how) knowledge on the retention and transfer of simulation-based lumbar puncture (LP) skill. Medical students (N = 30) were randomized into two groups that accessed different instructional videos during a 60-min self-regulated training session. An unintegrated video provided procedural How instruction via step-by-step demonstrations of LP, and an integrated video provided the same How instruction with integrated conceptual Why explanations (e.g., anatomy) for key steps. Two blinded raters scored post-test, retention, and transfer performances using a global rating scale. Participants also completed written procedural and conceptual knowledge tests. We used simple mediation regression analyses to assess the total and indirect effects (mediated by conceptual knowledge) of integrated instruction on retention and transfer. Integrated instruction was associated with improved conceptual (p < .001) but not procedural knowledge test scores (p = .11). We found no total effect of group (p > .05). We did find a positive indirect group effect on skill retention (B ab  = .93, p < .05) and transfer (B ab  = .59, p < .05), mediated through participants improved conceptual knowledge. Integrated instruction may improve trainees' skill retention and transfer through gains in conceptual knowledge. Such integrated instruction may be an instructional design feature for simulation-based training aimed at improving transfer outcomes.

Students' Learning Experiences from Didactic Teaching Sessions Including Patient Case Examples as Either Text or Video: A Qualitative Study.

OBJECTIVES: The aim of this study was to explore medical students' learning experiences from the didactic teaching formats using either text-based patient cases or video-based patient cases with similar content. The authors explored how the two different patient case formats influenced students' perceptions of psychiatric patients and students' reflections on meeting and communicating with psychiatric patients. METHODS: The authors conducted group interviews with 30 medical students who volunteered to participate in interviews and applied inductive thematic content analysis to the transcribed interviews. RESULTS: Students taught with text-based patient cases emphasized excitement and drama towards the personal clinical narratives presented by the teachers during the course, but never referred to the patient cases. Authority and boundary setting were regarded as important in managing patients. Students taught with video-based patient cases, in contrast, often referred to the patient cases when highlighting new insights, including the importance of patient perspectives when communicating with patients. CONCLUSION: The format of patient cases included in teaching may have a substantial impact on students' patient-centeredness. Video-based patient cases are probably more effective than text-based patient cases in fostering patient-centered perspectives in medical students. Teachers sharing stories from their own clinical experiences stimulates both engagement and excitement, but may also provoke unintended stigma and influence an authoritative approach in medical students towards managing patients in clinical psychiatry.

The Effects of Simulation-based Transvaginal Ultrasound Training on Quality and Efficiency of Care: A Multicenter Single-blind Randomized Trial.

OBJECTIVE: To explore the effect of adding simulation-based transvaginal ultrasound training to trainees' clinical training compared with only clinical training on quality of and efficiency of care. BACKGROUND: Simulation-based ultrasound training may be an effective adjunct to clinical training, but no studies have examined its effects on quality and efficiency of care. METHODS: Trainees from 4 University Hospitals in East Denmark were included (N = 54). Participants were randomized to either simulation-based ultrasound training and clinical training (intervention group, n = 28), or to clinical training only (control group, n = 26).The primary outcome was patient-reported discomfort during transvaginal ultrasound examinations performed by study participants. Secondary outcomes included patient-reported perceived safety and confidence in ultrasound provider. Finally, the need for trainee supervision or repeated patient examinations was recorded. RESULTS: In total, 1150 patient ratings were collected. The intervention was associated with a reduction of patient discomfort by 18.5% [95% confidence interval (CI), 10.7-25.5; P < 0.001), and with a 7.9% (95% CI, 0.5-14.7; P = 0.04) increase in perceived safety. The intervention group participants received 11.1% (95% CI, 2.5-18.9) higher scores on patients' confidence compared with control group participants (P = 0.01). When the number of days of clinical training was doubled, the odds for trainee supervision or repeated patient examination was reduced by 45.3% (95% CI, 33.5-55.1) and 19.8% (95% CI, 4.1-32.9) in the intervention and control group, respectively (P = 0.005). CONCLUSIONS: Simulation-based ultrasound training improved quality of care and reduced the need for repeated patient examination and trainee supervision.

Assessment of Residents Readiness to Perform Lumbar Puncture: A Validation Study.

BACKGROUND: Lumbar puncture is a common procedure in many specialties. The procedure serves to diagnose life-threatening conditions, often requiring rapid performance. However, junior doctors possess uncertainties regarding performing the procedure and frequently perform below expectations. Hence, proper training and assessment of performance is crucial before entering clinical practice. OBJECTIVE: To develop and collect validity evidence for an assessment tool for lumbar puncture performance, including a standard to determine when trainees are ready for clinical practice. DESIGN: Development of a new tool, based on clinician interviews and a literature review, was followed by an explorative study to gather validity evidence. PARTICIPANTS AND MAIN MEASURES: We interviewed 12 clinicians from different specialties. The assessment tool was used to assess 11 doctors at the advanced beginners' level and 18 novices performing the procedure in a simulated, ward-like setting with a standardized patient. Procedural performance was assessed by three content experts. We used generalizability theory to explore reliability. The discriminative ability of the tool was explored by comparing performance scores between the two groups. The contrasting groups method was used to set a pass/fail standard and the consequences of this was explored. KEY RESULTS: The interviews identified that in addition to the technical aspects of the procedure, non-technical elements involving planning and conducting the procedure are important. Cronbach's alpha = 0.92, Generalizability-coefficient was 0.88 and a Decision-study found one rater was sufficient for low-stakes assessments (G-coefficient 0.71). The discriminative ability was confirmed by a significant difference between the mean scores of novices, 40.9 (SD 6.1) and of advanced beginners, 47.8 (SD 4.0), p = 0.004. A standard of 44.0 was established which was consistent with the raters' global judgments of pass/fail. CONCLUSION: We developed and demonstrated strong validity evidence for the lumbar puncture assessment tool. The tool can be used to assess readiness for practice.

Imperfect practice makes perfect: error management training improves transfer of learning.

CONTEXT: Traditionally, trainees are instructed to practise with as few errors as possible during simulation-based training. However, transfer of learning may improve if trainees are encouraged to commit errors. The aim of this study was to assess the effects of error management instructions compared with error avoidance instructions during simulation-based ultrasound training. METHODS: Medical students (n = 60) with no prior ultrasound experience were randomised to error management training (EMT) (n = 32) or error avoidance training (EAT) (n = 28). The EMT group was instructed to deliberately make errors during training. The EAT group was instructed to follow the simulator instructions and to commit as few errors as possible. Training consisted of 3 hours of simulation-based ultrasound training focusing on fetal weight estimation. Simulation-based tests were administered before and after training. Transfer tests were performed on real patients 7-10 days after the completion of training. Primary outcomes were transfer test performance scores and diagnostic accuracy. Secondary outcomes included performance scores and diagnostic accuracy during the simulation-based pre- and post-tests. RESULTS: A total of 56 participants completed the study. On the transfer test, EMT group participants attained higher performance scores (mean score: 67.7%, 95% confidence interval [CI]: 62.4-72.9%) than EAT group members (mean score: 51.7%, 95% CI: 45.8-57.6%) (p < 0.001; Cohen's d = 1.1, 95% CI: 0.5-1.7). There was a moderate improvement in diagnostic accuracy in the EMT group compared with the EAT group (16.7%, 95% CI: 10.2-23.3% weight deviation versus 26.6%, 95% CI: 16.5-36.7% weight deviation [p = 0.082; Cohen's d = 0.46, 95% CI: -0.06 to 1.0]). No significant interaction effects between group and performance improvements between the pre- and post-tests were found in either performance scores (p = 0.25) or diagnostic accuracy (p = 0.09). CONCLUSIONS: The provision of error management instructions during simulation-based training improves the transfer of learning to the clinical setting compared with error avoidance instructions. Rather than teaching to avoid errors, the use of errors for learning should be explored further in medical education theory and practice.

Practical trials in medical education: linking theory, practice and decision making.

CONTEXT: Concerns have been raised over the gap between education theory and practice and how research can contribute to inform decision makers on their choices and priorities. Little is known about how educational theories and research outcomes produced under optimal conditions in highly controlled settings generalise to the real-life education context. One way of bridging this gap is applying the concept of practical trials in medical education. In this paper we elaborate on characteristics of practical trials and based on examples from medical education we discuss the challenges, limitations and future directions for this kind of research. CURRENT STATE: Practical trials have the overall aim of informing decision makers. They are carried out in real-life settings and are characterised by (i) comparison of viable alternative education strategies, (ii) broad inclusion criteria regarding participants across several settings and (iii) multiple outcome measures with long-term follow-up to evaluate both benefits and risks. Questions posed by practical trials may be proactive in applying theory in the development of educational innovations or reactive to educational reforms and innovations. Non-inferiority or equivalence designs are recommended when comparing viable alternatives and the use of crossover designs, cluster randomisation or stepped wedge trial designs are feasible when studying implementations across several settings. Outcome measures may include variables related to learners, teachers, educational administration, quality of care, patient outcomes and cost. CONCLUSIONS: Practical trials in medical education may contribute to bridge the gap between education theory and practice and aid decision makers in making evidence-based choices and priorities. Conducting practical trials is not without challenges and rigorous design and methods must be applied. Of concern is that the practical focus may lead to failure to include a sound theoretical basis in the research questions and the interventions studied, and that authors fail to obtain informed consent from their participants.

The Predictive Value of Ultrasound Learning Curves Across Simulated and Clinical Settings.

OBJECTIVES: The aim of the study was to explore whether learning curves on a virtual-reality (VR) sonographic simulator can be used to predict subsequent learning curves on a physical mannequin and learning curves during clinical training. METHODS: Twenty midwives completed a simulation-based training program in transvaginal sonography. The training was conducted on a VR simulator as well as on a physical mannequin. A subgroup of 6 participants underwent subsequent clinical training. During each of the 3 steps, the participants' performance was assessed using instruments with established validity evidence, and they advanced to the next level only after attaining predefined levels of performance. The number of repetitions and time needed to achieve predefined performance levels were recorded along with the performance scores in each setting. Finally, the outcomes were correlated across settings. RESULTS: A good correlation was found between time needed to achieve predefined performance levels on the VR simulator and the physical mannequin (Pearson correlation coefficient .78; P < .001). Performance scores on the VR simulator correlated well to the clinical performance scores (Pearson correlation coefficient .81; P = .049). No significant correlations were found between numbers of attempts needed to reach proficiency across the 3 different settings. A post hoc analysis found that the 50% fastest trainees at reaching proficiency during simulation-based training received higher clinical performance scores compared to trainees with scores placing them among the 50% slowest (P = .025). CONCLUSIONS: Performances during simulation-based sonography training may predict performance in related tasks and subsequent clinical learning curves.

Collaborative learning of clinical skills in health professions education: the why, how, when and for whom.

OBJECTIVES: This study is designed to provide an overview of why, how, when and for whom collaborative learning of clinical skills may work in health professions education. WHY: Collaborative learning of clinical skills may influence learning positively according to the non-medical literature. Training efficiency may therefore be improved if the outcomes of collaborative learning of clinical skills are superior or equivalent to those attained through individual learning. HOW: According to a social interaction perspective, collaborative learning of clinical skills mediates its effects through social interaction, motivation, accountability and positive interdependence between learners. Motor skills learning theory suggests that positive effects rely on observational learning and action imitation, and negative effects may include decreased hands-on experience. Finally, a cognitive perspective suggests that learning is dependent on cognitive co-construction, shared knowledge and reduced cognitive load. WHEN AND FOR WHOM: The literature on the collaborative learning of clinical skills in health science education is reviewed to support or contradict the hypotheses provided by the theories outlined above. Collaborative learning of clinical skills leads to improvements in self-efficacy, confidence and performance when task processing is observable or communicable. However, the effects of collaborative learning of clinical skills may decrease over time as benefits in terms of shared cognition, scaffolding and cognitive co-construction are outweighed by reductions in hands-on experience and time on task. CONCLUSIONS: Collaborative learning of clinical skills has demonstrated promising results in the simulated setting. However, further research into how collaborative learning of clinical skills may work in clinical settings, as well as into the role of social dynamics between learners, is required.

How to set the bar in competency-based medical education: standard setting after an Objective Structured Clinical Examination (OSCE).

BACKGROUND: The goal of the Objective Structured Clinical Examination (OSCE) in Competency-based Medical Education (CBME) is to establish a minimal level of competence. The purpose of this study was to 1) to determine the credibility and acceptability of the modified Angoff method of standard setting in the setting of CBME, using the Borderline Group (BG) method and the Borderline Regression (BLR) method as a reference standard; 2) to determine if it is feasible to set different standards for junior and senior residents, and 3) to determine the desired characteristics of the judges applying the modified Angoff method. METHODS: The results of a previous OSCE study (21 junior residents, 18 senior residents, and six fellows) were used. Three groups of judges performed the modified Angoff method for both junior and senior residents: 1) sports medicine surgeons, 2) non-sports medicine orthopedic surgeons, and 3) sports fellows. Judges defined a borderline resident as a resident performing at a level between competent and a novice at each station. For each checklist item, the judges answered yes or no for "will the borderline/advanced beginner examinee respond correctly to this item?" The pass mark was calculated by averaging the scores. This pass mark was compared to that created using both the BG and the BLR methods. RESULTS: A paired t-test showed that all examiner groups expected senior residents to get significantly higher percentage of checklist items correct compared to junior residents (all stations p < 0.001). There were no significant differences due to judge type. For senior residents, there were no significant differences between the cut scores determined by the modified Angoff method and the BG/BLR method. For junior residents, the cut scores determined by the modified Angoff method were lower than the cut scores determined by the BG/BLR Method (all p < 0.01). CONCLUSION: The results of this study show that the modified Angoff method is an acceptable method of setting different pass marks for senior and junior residents. The use of this method enables both senior and junior residents to sit the same OSCE, preferable in the regular assessment environment of CBME.