Situations that prompt teachers in problem-based curricula to reflect on their beliefs, identity and mission.

Teachers have different perceptions of how to enhance student learning. Whereas some take a teacher-centred perspective, others lean more towards a student-centred approach. Many studies in higher education have invoked Korthagen's onion model (2014) to explain how teachers' perspectives can impact their teaching practices. Spanning six interrelated layers, this model contains both outer (environment, behaviour, competencies) and inner (beliefs, identity, and mission) aspects. Focusing essentially on teachers' outer aspects, previous studies have paid scant attention to how particular situations affect teachers' inner aspects and, consequently, how teachers perceive student-centred learning. In this descriptive qualitative study, we explored situations that encouraged or discouraged teachers to embrace student-centred beliefs, identities and missions. We held three focus-group discussions with 18 teachers from two Indonesian medical schools, performing a thematic analysis of the data thus obtained. We found that certain situations made teachers reflect on their inner aspects, which either favourably or adversely affected their acceptance of a student-centred learning approach. Teachers' outer aspects (i.e. their prior problem-based teaching and learning experiences, learning situations from their own training as well as clinical duties) strongly interacted with their inner aspects, thereby shaping their teaching perspectives. Understanding how specific situations can influence teachers' inner aspects might help institutions to design faculty development programmes that address teachers' specific educational needs.

From individual to interprofessional: characteristics of assessment tasks to assess interprofessional collaboration in healthcare education.

To develop independent healthcare professionals able to collaborate in interprofessional teams, health professions education aims to support students in transitioning from an individual perspective to interprofessional collaboration. The five elements that yield the conditions for effective interprofessional collaboration are: (1) positive interdependence, (2) individual accountability, (3) promotive interaction, (4) interpersonal skills, and (5) reflection on team processes. The aim of the current study is to gain insights into how to design tasks to assess a student team as a whole on their interprofessional collaboration. This was a pilot study using a qualitative design to evaluate an interprofessional assessment task. Four interprofessional student teams, comprising physiotherapy, occupational therapy, arts therapy and nursing students (N = 13), completed this task and five assessors used a rubric to assess video recordings of the teams' task completion, and then participated in a group interview. The completed rubrics and the interview transcript were analyzed using content analysis. Findings showed that the combination of individual preparation, an interprofessional team meeting resulting in care agreements and team reflection was a strength of the assessment task, enabling the task to elicit sufficient promotive interaction between students. Areas for improvement of the assessment task were however, due to a lack of interdependence, the care agreements which now proved to be the sum of students' intraprofessional ideas rather than an interprofessional integration of agreements. Additionally, assessors suggested that a series of varying assessment tasks is required to draw conclusions about students' interprofessional competence.

The Balancing Act of Assessment Validity in Interprofessional Healthcare Education: A Qualitative Evaluation Study.

CONSTRUCT & BACKGROUND: In order to determine students' level of interprofessional competencies, there is a need for well-considered and thoroughly designed interprofessional assessments. Current literature about interprofessional assessments focuses largely on the development and validation of assessment instruments such as self-assessments or questionnaires to assess students' knowledge or attitudes. Less is known about the design and validity of integral types of assessment in interprofessional education, such as case-based assessments, or performance assessments. The aim of this study is to evaluate the evidence for and threats to the validity of the decisions about students' interprofessional performances based on such integral assessment task. We investigated whether the assessment prototype is a precursor to practice (authenticity) and whether the assessment provides valid information to determine the level of interprofessional competence (scoring). APPROACH: We used a design-based qualitative research design in which we conducted three group interviews with teachers, students, and interprofessional assessment experts. In semi-structured group interviews, participants evaluated the evidence for and threats to the validity of an interprofessional assessment task, which were analyzed using deductive and inductive content analysis. FINDINGS: Although both evidence for and threats to validity were mentioned, the threats refuting the assessment's validity prevailed. Evidence for the authenticity aspect was that the assessment task, conducting a team meeting, is common in practice. However, its validity was questioned because the assessment task appeared more structured as compared to practice. The most frequently mentioned threat to the scoring aspect was that the process of interprofessional collaboration between the students could not be evaluated sufficiently by means of this assessment task. CONCLUSIONS: This study showed that establishing interprofessional assessment validity requires three major balancing acts. The first is the balance between authenticity and complexity. As interprofessional practice and competencies are complex, interprofessional tasks require build-up or guidance toward this complexity and chaotic practice. The second is that between authenticity and scoring, in which optimal authenticity might lead to threats to scoring and vice versa. Simultaneous optimal authenticity and scoring seems impossible, requiring ongoing evaluation and monitoring of interprofessional assessment validity to ensure authentic yet fair assessments for all participating professions. The third balancing act is between team scoring and individual scoring. As interprofessional practice requires collaboration and synthesis of diverse professions, the team process is at the heart of solving interprofessional tasks. However, to stimulate individual accountability, the individual performance should not be neglected.

Developing student-centred perspectives in PBL: how teacher profiles reveal educational needs for faculty development programmes.

BACKGROUND: In Asian higher education, PBL is not always successful, as few teachers have embraced a student-centred perspective. To cultivate such essential perspectives, faculty development programmes should address teachers' specific educational needs, which sadly is currently not sufficiently the case. This study aimed to identify teacher profiles that would reveal these specific educational needs of teachers and to investigate the relationship between these profiles and the amount of PBL training previously received. METHODS: To identify the said profiles, we performed latent profile analysis on a stratified random sample of 543 teachers based on a survey of teaching perspectives on the six aspects of Korthagen's onion model of reflection (environment, behaviour, competencies, beliefs, identity and mission). Additionally, we employed Chi-square and Mann-Whitney tests to investigate the aforementioned relationship. RESULTS: We identified six teacher profiles that resemble the diffusion of innovations theory's classification of innovation adopters: Innovators, Early adopters, Early majority 1, Early majority 2, Late majority and Laggards. The Chi-square test demonstrated that the amount of PBL training received did not differ significantly across profiles, although teachers with a more innovative profile had undergone slightly more PBL training. The Mann-Whitney test furthermore revealed for three profiles that more PBL training was associated with a higher overall score for student-centredness. When aspects were considered separately, however, this was not the case. CONCLUSIONS: The findings confirmed that current faculty development programmes are not sufficiently tailored to teachers' needs. We therefore propose that faculty development programmes be redesigned to address teachers' specific educational needs as reflected in the profiles based on the 6 aspects of the onion model. We expect such a tailored approach to more effectively promote the development of student-centred perspectives.

Managing uncertainty in decision-making of common congenital cardiac defects.

Decision-making in congenital cardiac care, although sometimes appearing simple, may prove challenging due to lack of data, uncertainty about outcomes, underlying heuristics, and potential biases in how we reach decisions. We report on the decision-making complexities and uncertainty in management of five commonly encountered congenital cardiac problems: indications for and timing of treatment of subaortic stenosis, closure or observation of small ventricular septal defects, management of new-onset aortic regurgitation in ventricular septal defect, management of anomalous aortic origin of a coronary artery in an asymptomatic patient, and indications for operating on a single anomalously draining pulmonary vein. The strategy underpinning each lesion and the indications for and against intervention are outlined. Areas of uncertainty are clearly delineated. Even in the presence of "simple" congenital cardiac lesions, uncertainty exists in decision-making. Awareness and acceptance of uncertainty is first required to facilitate efforts at mitigation. Strategies to circumvent uncertainty in these scenarios include greater availability of evidence-based medicine, larger datasets, standardised clinical assessment and management protocols, and potentially the incorporation of artificial intelligence into the decision-making process.

Development of a questionnaire to measure teachers' student-centred perspectives based on the Onion Model.

BACKGROUND: Teachers with a teacher-centred perspective have difficulties applying student-centred approaches in Problem Based Learning (PBL) because they are inclined to show teacher-centred behaviours. The six aspects explained in Korthagen's Onion Model (environment, behaviour, competencies, beliefs, identity, and mission) are assumed to contribute to teachers' perspectives, showing that both the environment and personal characteristics influence behaviours. For teachers to function properly in PBL, those six aspects should reflect a student-centred perspective. Previous instruments to measure teaching perspectives focused on only a few of these relevant aspects. Therefore, we developed the Student-Centred Perspective of Teachers (SCPT) questionnaire with subscales for each aspect in the Onion Model. This study aimed to provide evidence for its internal and external validity. METHODS: The SCPT was distributed in a survey to 795 teachers from 20 medical schools. For the internal validation, Confirmatory Factor Analysis was performed to analyse theoretical fit model validation, convergent validation, and discriminant validation. For the external validation, teachers' perspective scores were compared among three groups of amount of PBL training using Analysis of Variance (ANOVA) and post-hoc Least Significant Difference (LSD) tests. The p-value for all tests was set at .05. RESULTS: A total of 543 out of 795 teachers (68.3%) participated. Confirmatory Factor Analysis showed the evidence of the SCPT's internal validation with acceptable fit for the six subscales measured by 19 items and the following Composite Reliability scores: environment (.72), behaviour (.74), competencies (.63), beliefs (.55), identity (.76), and mission (.60). All items' factors loadings reached a good standard (.5 or greater). Only the environment subscale had the Average Variance Extracted (AVE) score higher than .5 and the Maximum Shared Variance score lower than the AVE score. ANOVA and Post-hoc LSD tests showed that teachers who participated in more PBL training showed significantly higher student-centred perspectives, providing evidence for external validity. CONCLUSION: The SCPT is a reliable and valid instrument to measure teaching perspectives. Identifying aspects that do not represent the adoption of a student-centred perspective may provide valuable input for faculty development in the context of PBL.

Attracting and retaining physicians in less attractive specialties: the role of continuing medical education.

BACKGROUND: Less attractive specialties in medicine are struggling to recruit and retain physicians. When properly organized and delivered, continuing medical education (CME) activities that include short courses, coaching in the workplace, and communities of practice might offer a solution to this problem. This position paper discusses how educationalists can create CME activities based on the self-determination theory that increase physicians' intrinsic motivation to work in these specialties. MAIN CONTENT: The authors propose a set of guidelines for the design of CME activities that offer physicians meaningful training experiences within the limits of the available resources and support. First, to increase physicians' sense of professional relatedness, educationalists must conduct a learner needs assessment, evaluate CME's long-term outcomes in work-based settings, create social learning networks, and involve stakeholders in every step of the CME design and implementation process. Moreover, providing accessible, practical training formats and giving informative performance feedback that authentically connects to learners' working life situation increases physicians' competence and autonomy, so that they can confidently and independently manage the situations in their practice contexts. For each guideline, application methods and instruments are proposed, making use of relevant literature and connecting to the self-determination theory. CONCLUSIONS: By reducing feelings of professional isolation and reinforcing feelings of competence and autonomy in physicians, CME activities show promise as a strategy to recruit and retain physicians in less attractive specialties.

The medical pause: Importance, processes and training.

Research has shown that taking 'timeouts' in medical practice improves performance and patient safety. However, the benefits of taking timeouts, or pausing, are not sufficiently acknowledged in workplaces and training programmes. To promote this acknowledgement, we suggest a systematic conceptualisation of the medical pause, focusing on its importance, processes and implementation in training programmes. By employing insights from educational and cognitive psychology, we first identified pausing as an important skill to interrupt negative momentum and bolster learning. Subsequently, we categorised constituent cognitive processes for pausing skills into two phases: the decision-making phase (determining when and how to take pauses) and the executive phase (applying relaxation or reflection during pauses). We present a model that describes how relaxation and reflection during pauses can optimise cognitive load in performance. Several strategies to implement pause training in medical curricula are proposed: intertwining pause training with training of primary skills, providing second-order scaffolding through shared control and employing auxiliary tools such as computer-based simulations with a pause function.

Exploring the relationship between emotion and cognitive load types during patient handovers.

Cognitive Load Theory has emerged as an important approach to improving instruction in the health professions workplace, including patient handovers. At the same time, there is growing recognition that emotion influences learning through numerous cognitive processes including motivation, attention, working memory, and long-term memory. This study explores how emotion influences the cognitive load experienced by trainees performing patient handovers. From January to March 2019, 693 (38.7%) of 1807 residents and fellows from a 24-hospital health system in New York city completed a survey after performing a handover. Participants rated their emotional state and cognitive load. The survey included questions about features of the learner, task, and instructional environment. The authors used factor analysis to identify the core dimensions of emotion. Regression analyses explored the relationship between the emotion factors and cognitive load types. Two emotion dimensions were identified representing invigoration and tranquility. In regression analyses, higher levels of invigoration, tranquility, and their interaction were independently associated with lower intrinsic load and extraneous load. The interaction of invigoration and tranquility predicted lower germane load. The addition of the emotion variables to multivariate models including other predictors of cognitive load types significantly increased the amount of variance explained. The study provides a model for measuring emotions in workplace learning. Because emotion appears to have a significant influence on cognitive load types, instructional designers should consider strategies that help trainees regulate emotion in order to reduce cognitive load and improve learning and performance.

Entrustable Professional Activities for Small-Group Facilitation: A Validation Study Using Modified Delphi Technique.

:: Entrustable professional activities (EPAs) provide a novel approach to support teachers' structured professionalization and to assess improvement in teaching competence thereafter. Despite their novelty, it is important to assess EPAs as a construct to ensure that they accurately reflect the work of the targeted profession. BACKGROUND:: The co-creation of an EPA framework for training and entrustment of small-group facilitators has been discussed in the literature. Although a rigorous design process was used to develop the framework, its content validity has not been established yet.Approach: A modified Delphi technique was used. Three survey rounds were conducted from December 2019 to April 2020. Expert health professions educationalists were recruited using purposive sampling and snowball techniques. In Round 1, a rubric consisting of seven items was used to assess the quality of nine pre-designed EPAs. In Round 2, competencies required to perform the agreed-upon EPAs were selected from 12 competencies provided. In Round 3, consensus was sought on sub-activities recommended for agreed-upon EPAs. Quantitative data were analyzed using multiple statistical analyses, including item-wise and rubric-wise content validity indices, asymmetric confidence interval, mean, standard deviation, and response frequencies. Qualitative data were thematically analyzed using content analysis. FINDINGS:: Three of the nine proposed EPAs achieved statistical consensus for retention. These EPAs were: (1) preparing an activity, (2) facilitating a small-group session, and (3) reflecting upon self and the session. Nine of the 12 pre-determined competencies achieved consensus and were then mapped against each agreed-upon EPA based on their relevance. Finally, results indicated consensus on five, six, and four sub-activities for EPA 1, EPA 2, and EPA 3, respectively. CONCLUSIONS:: The final framework delineates three EPAs for small-group facilitation and their associated sub-activities. The full description of each EPA provided in this article includes the title, context, task specification, required competencies, and entrustment resources. Program developers, administrative bodies, and teaching staff may find this EPA framework useful to structure faculty development, to entrust teachers, and to support personal development.

Does high-variation training facilitate transfer of training in paediatric transthoracic echocardiography?

BACKGROUND: Factors that facilitate transfer of training in paediatric echocardiography remain poorly understood. This study assessed whether high-variation training facilitated successful transfer in paediatric echocardiography. METHODS: A mixed-methods study of transfer of technical and interpretive skill application amongst postgraduate trainees. Trainees were randomised to a low or high-variation training group. After a period of 8 weeks intensive echocardiography training, we video-recorded how trainees completed an echocardiogram in a complex cardiac lesion not previously encountered. Blinded quantitative analysis and scoring of trainee performance (echocardiogram performance, report, and technical proficiency) were performed using a validated assessment tool by a blinded cardiologist and senior cardiac physiologist. Qualitative interviews of the trainees were recorded to ascertain trainee experiences during the training and transfer process. RESULTS: Sixteen trainees were enrolled in the study. For the cumulative score for all three components tested (echocardiogram performance, report, and technical proficiency), χ2 = 8.223, p = .016, which showed the high-variation group outperformed the low-variation group. Two common themes which assisted in the transfer emerged from interviews are as follows: (1) use of strategies described in variation theory to describe abnormal hearts, (2) the use of formative live feedback from trainers during hands-on training. CONCLUSION: Training strategies exposing trainees to high-variation training may aid transfer of paediatric echocardiography skills.

Development and validation of teacher and student questionnaires measuring inhibitors of curriculum viability.

BACKGROUND: Curriculum viability is determined by the degree to which quality standards have or have not been met, and by the inhibitors that affect attainment of those standards. The literature reports many ways to evaluate whether a curriculum reaches its quality standards, but less attention is paid to the identification of viability inhibitors in different areas of the curriculum that hamper the attainment of quality. The purpose of this study is to develop and establish the reliability and validity of questionnaires that measure the presence of inhibitors in an undergraduate medical curriculum. METHODS: Teacher and student questionnaires developed by the authors were sent to medical educationalists for qualitative expert validation and to establish their content validity. To establish the response process validity, cognitive interviews were held with teachers and students to clarify any confusion about the meaning of items in the questionnaires. Reliability and construct validity of the questionnaires were established by responses from 575 teachers and 247 final-year medical students. RESULTS: Qualitative expert validation was provided by 21 experts. The initial teacher and student questionnaires containing respectively 62 items to measure 12 theoretical constructs, and 28 items to measure 7 constructs, were modified to improve their clarity and relevance. The overall scale validity index for the questionnaires was, in order, .95 and .94. Following the cognitive interviews, the resultant teacher and student questionnaires were reduced to respectively 52 and 23 items. Furthermore, after the confirmatory analysis, the final version of the teacher questionnaire was reduced to 25 items to measure 6 constructs and the student questionnaire was reduced to 14 items to measure 3 constructs. Good-for-fit indices were established for the final model and Cronbach alphas of, in order, .89 and .81 were found for the teacher and student questionnaire. CONCLUSION: The valid and reliable curriculum viability inhibitor questionnaires for teachers and students developed in this study can be used by medical schools to identify inhibitors to achieve standards in different areas of the curriculum.

Why do graduates choose to work in a less attractive specialty? A cross-sectional study on the role of personal values and expectations.

BACKGROUND: Primary health care (PHC), of which preventive medicine (PM) is a subspecialty, will have to cope with a deficiency of staff in the future, which makes the retention of graduates urgent. This study was conducted in Vietnam, where PM is an undergraduate degree in parallel to medical training. It aims to identify facilitating and hindering factors that impact recruitment and retention of PM graduates in the specialty. METHODS: A cross-sectional study enrolled 167 graduates who qualified as PM doctors from a Vietnamese medical school, between 2012 and 2018. Data were collected via an online questionnaire that asked participants about their motivation and continuation in PM, the major life roles that they were playing, and their satisfaction with their job. Multiple regression analyses were used to identify which life roles and motivational factors were related to the decision to take a PM position and to stay in the specialty, as well as how these factors held for subgroups of graduates (men, women, graduates who studied PM as their first or second study choice). RESULTS: Half of the PM graduates actually worked in PM, and only one fourth of them expressed the intention to stay in the field. Three years after qualification, many graduates had not yet decided whether to pursue a career in PM. Satisfaction with opportunities for continuous education was rated as highly motivating for graduates to choose and to stay in PM. Responsibility for taking care of parents motivated male graduates to choose PM, while good citizenship and serving the community was associated with the retention of graduates for whom PM was their first choice. CONCLUSIONS: The findings demonstrate the importance of social context and personal factors in developing primary care workforce policy. Providing opportunities for continued education and enhancing the attractiveness of PM as an appropriate specialty to doctors who are more attached to family and the community could be solutions to maintaining the workforce in PM. The implications could be useful for other less popular specialties that also struggle with recruiting and retaining staff.

Communication skills supervisors' monitoring of history-taking performance: an observational study on how doctors and non-doctors use cues to prepare feedback.

BACKGROUND: Medical students need feedback to improve their patient-interviewing skills because self-monitoring is often inaccurate. Effective feedback should reveal any discrepancies between desired and observed performance (cognitive feedback) and indicate metacognitive cues which are diagnostic of performance (metacognitive feedback). We adapted a cue-utilization model to studying supervisors' cue-usage when preparing feedback and compared doctors' and non-doctors' cue usage. METHOD: Twenty-one supervisors watched a video of a patient interview, choose scenes for feedback, and explained their selection. We applied content analysis to categorize and count cue-use frequency per communication pattern (structuring/facilitating) and scene performance rating (positive/negative) for both doctors and non-doctors. RESULTS: Both groups used cognitive cues more often than metacognitive cues to explain their scene selection. Both groups also used metacognitive cues such as subjective feelings and mentalizing cues, but mainly the doctors mentioned 'missing information' as a cue. Compared to non-doctors, the doctors described more scenes showing negative performance and fewer scenes showing positive narrative-facilitating performance. CONCLUSIONS: Both groups are well able to communicate their observations and provide cognitive feedback on undergraduates' interviewing skills. To improve their feedback, supervisors should be trained to also recognize metacognitive cues, such as subjective feelings and mentalizing cues, and learn how to convert both into metacognitive feedback.

Starting to Think Like an Expert: An Analysis of Resident Cognitive Processes During Simulation-Based Resuscitation Examinations.

STUDY OBJECTIVE: Simulation is commonly used to teach crisis resource management skills and assess them in emergency medicine residents. However, our understanding of the cognitive processes underlying crisis resource management skills is limited because these processes are difficult to assess and describe. The objective of this study is to uncover and characterize the cognitive processes underlying crisis resource management skills and to describe how these processes vary between residents according to performance in a simulation-based examination. METHODS: Twenty-two of 24 eligible emergency medicine trainees from 1 tertiary academic center completed 1 or 2 resuscitation-based examinations in the simulation laboratory. Resident performance was assessed by a blinded expert using an entrustment-based scoring tool. Participants wore eye-tracking glasses that generated first-person video that was used to augment subsequent interviews led by an emergency medicine faculty member. Interviews were audio recorded and then transcribed. An emergent thematic analysis was completed with a codebook that was developed by 4 research assistants, with subsequent analyses conducted by the lead research assistant with input from emergency medicine faculty. Themes from high- and low-performing residents were subsequently qualitatively compared. RESULTS: Higher-performing residents were better able to anticipate, selectively attend to relevant information, and manage cognitive demands, and took a concurrent (as opposed to linear) approach to managing the simulated patient. CONCLUSION: The results provide new insights into residents' cognitive processes while managing simulated patients in an examination environment and how these processes vary with performance. More work is needed to determine how best to apply these findings to improve crisis resource management education.

Working in preventive medicine or not? Flawed perceptions decrease chance of retaining students for the profession.

BACKGROUND: Recruiting and retaining students in preventive medical (PM) specialties has never been easy; one main challenge is how to select appropriate students with proper motivation. Understanding how students perceive PM practice differently from practicing doctors is necessary to guide students, especially for those for whom PM is only a substitute for medicine as their first study preference, properly during their study and, later, the practice of PM. METHODS: One thousand three hundred eighty-six PM students in four Vietnamese medical schools and 101 PM doctors filled out a questionnaire about the relevance of 44 characteristics of working in PM. ANOVAs were conducted to define the relationship between students' interest, year of study, willingness to work in PM, and the degree to which students had realistic perceptions of PM practice, compared to doctors' perceptions. RESULTS: Overall, compared to doctors' perceptions, students overestimated the importance of most of the investigated PM practice's characteristics. Moreover, students' perception related to their preference and willing to pursue a career in PM after graduation. In particular, students for whom PM was their first choice had more realistic perceptions of community practice than those who chose PM as their second choice. And, second-choice students had more realistic perceptions than first-choice students in their final years of study, but expected higher work stress in PM practice. Students who were willing to pursue a career in PM rated the importance of community practice higher than those who were not. We also found that students' perception changed during training as senior students had more realistic perceptions of clinical aspects and working stress than junior students, even though they overemphasized the importance of the community aspects of PM practice. CONCLUSIONS: To increase the number of students actually entering the PM field after graduation, the flawed perceptions of students about the real working environment of PM doctors should be addressed through vocation-oriented activities in the curriculum targeted on groups of students who are most likely to have unrealistic perceptions. Our findings also have implications for other less attractive primary health care specialties that experience problems with recruiting and retaining students.

Chest X-ray evaluation training: impact of normal and abnormal image ratio and instructional sequence.

CONTEXT: Medical image perception training generally focuses on abnormalities, whereas normal images are more prevalent in medical practice. Furthermore, instructional sequences that let students practice prior to expert instruction (inductive) may lead to improved performance compared with methods that give students expert instruction before practice (deductive). This study investigates the effects of the proportion of normal images and practice-instruction order on learning to interpret medical images. It is hypothesised that manipulation of the proportion of normal images will lead to a sensitivity-specificity trade-off and that students in practice-first (inductive) conditons need more time per practice case but will correctly identify more test cases. METHODS: Third-year medical students (n = 103) learned radiograph interpretation by practising cases with, respectively, 30% or 70% normal radiographs prior to expert instruction (practice-first order) or after expert instruction (instruction-first order). After training, students performed a test (60% normal) and sensitivity (% of correctly identified abnormal radiographs), specificity (% of correctly identified normal radiographs), diagnostic performance (% of correct diagnoses) and case duration were measured. RESULTS: The conditions with 30% of normal images scored higher on sensitivity but the conditions with 70% of normal images scored higher on specificity, indicating a sensitivity and specificity trade-off. Those who participated in inductive conditions took less time per practice case but more per test case. They had similar test sensitivity, but scored lower on test specificity. CONCLUSIONS: The proportion of normal images impacted the sensitivity-specificity trade-off. This trade-off should be an important consideration for the alignment of training with future practice. Furthermore, the deductive conditions unexpectedly scored higher on specificity when participants took less time per case. An inductive approach did not lead to higher diagnostic performance, possibly because participants might already have relevant prior knowledge. Deductive approaches are therefore advised for the training of advanced learners.

A review to identify key perspectives in PBL meta-analyses and reviews: trends, gaps and future research directions.

In the past 50 years, the original McMaster PBL model has been implemented, experimented, revised, and modified, and is still evolving. Yet, the development of PBL is not a series of success stories, but rather a journey of experiments, failures and lessons learned. In this paper, we analyzed the meta-analyses and systematic reviews on PBL from 1992 to present as they provide a focused lens on the PBL research in the past 5 decades. We identified three major waves in the PBL research development, analyzed their impact on PBL research and practice, and offered suggestions of research gaps and future directions for the field. The first wave of PBL research (polarization: 1990-mid 2000) focused on answering the question "Does PBL work?" and the outcomes. The results were conflicting. The researchers took polarizing positions and debated over the merits of PBL throughout this wave. However, the contradictory results and the debates in fact pushed the researchers to look harder for new directions to solve the puzzle. These efforts resulted in the second wave (from outcomes to process: mid 2000-mid 2010) that focused on the question "How does PBL work?" The second wave of PBL research targeted at investigating the effects of implementation constituents, such as assessment formats or single versus curriculum wide implementations. The third wave (specialization: mid 2010 and onward) of PBL research focused on "How does PBL work in different specific contexts?" These research widened our perspectives by expanding our understanding of how PBL manifests itself in different contexts. Given the diversification of PBL and more hybrid PBL models, we suggest "Why does PBL with particular implementation characteristics for specific outcomes work or not work in the condition where it is implemented?" to be the question to answer in the next wave of PBL research.

Collaborative use of virtual patients after a lecture enhances learning with minimal investment of cognitive load.

BACKGROUND: The use of virtual patients (VPs), due to their high complexity and/or inappropriate sequencing with other instructional methods, might cause a high cognitive load, which hampers learning. AIM: To investigate the efficiency of instructional methods that involved three different applications of VPs combined with lectures. METHOD: From two consecutive batches, 171 out of 183 students have participated in lecture and VPs sessions. One group received a lecture session followed by a collaborative VPs learning activity (collaborative deductive). The other two groups received a lecture session and an independent VP learning activity, which either followed the lecture session (independent deductive) or preceded it (independent inductive). All groups were administrated written knowledge acquisition and retention tests as well as transfer tests using two new VPs. All participants completed a cognitive load questionnaire, which measured intrinsic, extraneous and germane load. Mixed effect analysis of cognitive load and efficiency using the R statistical program was performed. RESULTS: The highest intrinsic and extraneous load was found in the independent inductive group, while the lowest intrinsic and extraneous load was seen in the collaborative deductive group. Furthermore, comparisons showed a significantly higher efficiency, that is, higher performance in combination with lower cognitive load, for the collaborative deductive group than for the other two groups. CONCLUSION: Collaborative use of VPs after a lecture is the most efficient instructional method, of those tested, as it leads to better learning and transfer combined with lower cognitive load, when compared with independent use of VPs, either before or after the lecture.

Perception of the usability and implementation of a metacognitive mnemonic to check cognitive errors in clinical setting.

BACKGROUND: Establishing a diagnosis is a complex, iterative process involving patient data gathering, integration and interpretation. Premature closure is a fallacious cognitive tendency of closing the diagnostic process before sufficient data have been gathered. A proposed strategy to minimize premature closure is the use of a checklist to trigger metacognition (the process of monitoring one's own thinking). A number of studies have suggested the effectiveness of this strategy in classroom settings. This qualitative study examined the perception of usability of a metacognitive mnemonic checklist called TWED checklist (where the letter "T = Threat", "W = What if I am wrong? What else?", "E = Evidence" and "D = Dispositional influence") in a real clinical setting. METHOD: Two categories of participants, i.e., medical doctors (n = 11) and final year medical students (Group 1, n = 5; Group 2, n = 10) participated in four separate focus group discussions. Nielsen's 5 dimensions of usability (i.e. learnability, effectiveness, memorability, errors, and satisfaction) and Pentland's narrative network were adapted as the framework to study the usability and the implementation of the checklist in a real clinical setting respectively. RESULTS: Both categories (medical doctors and medical students) of participants found that the TWED checklist was easy to learn and effective in promoting metacognition. For medical student participants, items "T" and "W" were believed to be the two most useful aspects of the checklist, whereas for the doctor participants, it was item "D". Regarding its implementation, item "T" was applied iteratively, items "W" and "E" were applied when the outcomes did not turn out as expected, and item "D" was applied infrequently. The one checkpoint where all four items were applied was after the initial history taking and physical examination had been performed to generate the initial clinical impression. CONCLUSION: A metacognitive checklist aimed to check cognitive errors may be a useful tool that can be implemented in the real clinical setting.