A model of contributors to a trusting patient-physician relationship: a critical review using a systematic search strategy.

BACKGROUND: The lack of trust between patients and physicians has a variety of negative consequences. There are several theories concerning how interpersonal trust is built, and different studies have investigated trust between patients and physicians that have identified single factors as contributors to trust. However, all possible contributors to a trusting patient-physician relationship remain unclear. This review synthesizes current knowledge regarding patient-physician trust and integrates contributors to trust into a model. METHODS: A systematic search was conducted using the databases MEDLINE (Ovid), Embase (Ovid), PsycINFO (Ovid), and Eric (Ovid). We ran simultaneous searches for a combination of the phrases: patient-physician relationship (or synonyms) and trust or psychological safety. Six-hundred and twenty-five abstracts were identified and screened using pre-defined criteria and later underwent full-text article screening. We identified contributors to trust in the eligible articles and critically assessed whether they were modifiable. RESULTS: Forty-five articles were included in the review. Patient-centered factors that contributed modifiable promoters of trust included psychological factors, levels of health education and literacy, and the social environment. Physician-centered factors that added to a trusting patient-physician relationship included competence, communication, interest in the patient, caring, the provisioning of health education, and professionalism. The patient-physician alliance, time spent together, and shared decision-making also contributed to trusting relationships between patients and physicians. External contributors included institutional factors, how payments are made, and additional healthcare services. DISCUSSION: Our model summarized modifiable contributors to a trusting patient-physician relationship. We found that providing sufficient time during patient-physician encounters, ensuring continuity of care, and fostering health education are promising starting points for improving trust between patients and physicians. Future research should evaluate the effectiveness of interventions that address multiple modifiable contributors to a trusting patient-physician relationship.

Sharpening the lens to evaluate interprofessional education and interprofessional collaboration by improving the conceptual framework: a critical discussion.

It has been difficult to demonstrate that interprofessional education (IPE) and interprofessional collaboration (IPC) have positive effects on patient care quality, cost effectiveness of patient care, and healthcare provider satisfaction. Here we propose a detailed explanation for this difficulty based on an adjusted theory about cause and effect in the field of IPE and IPC by asking: 1) What are the critical weaknesses of the causal models predominantly used which link IPE with IPC, and IPE and IPC with final outcomes? 2) What would a more precise causal model look like? 3) Can the proposed novel model help us better understand the challenges of IPE and IPC outcome evaluations? In the format of a critical theoretical discussion, based on a critical appraisal of the literature, we first reason that a monocausal, IPE-biased view on IPC and IPC outcomes does not form a sufficient foundation for proper IPE and IPC outcome evaluations; rather, interprofessional organization (IPO) has to be considered an additional necessary cause for IPC; and factors outside of IPC additional causes for final outcomes. Second, we present an adjusted model representing the "multi-stage multi-causality" of patient, healthcare provider, and system outcomes. Third, we demonstrate the model's explanatory power by employing it to deduce why misuse of the modified Kirkpatrick classification as a causal model in IPE and IPC outcome evaluations might have led to inconclusive results in the past. We conclude by applying the derived theoretical clarification to formulate recommendations for enhancing future evaluations of IPE, IPO, and IPC. Our main recommendations: 1) Focus should be placed on a comprehensive evaluation of factual IPC as the fundamental metric and 2) A step-by-step approach should be used that separates the outcome evaluation of IPE from that of IPC in the overarching quest for proving the benefits of IPE, IPO and IPC for patients, healthcare providers, and health systems. With this critical discussion we hope to enable more effective evaluations of IPE, IPO and IPC in the future.

Development and evaluation of three-dimensional transfers to depict skin conditions in simulation-based education.

Modern medical moulages are becoming increasingly important in simulation-based health professions education. Their lifelikeness is important so that simulation engagement is not disrupted while their standardization is crucial in high-stakes exams. This report describes in detail how three-dimensional transfers are developed and produced so that educators will be able to develop their own. In addition, evaluation findings and lessons learnt from deploying transfers in summative assessments are shared. Step-by-step instructions are given for the creation and application of transfers, including materials and photographic visualizations. We also examined feedback on 10 exam stations (out of a total of 81) with self-developed three-dimensional transfers and complement this with additional lessons learnt. By the time of submission, the authors successfully developed and deployed over 40 different three-dimensional transfers representing different clinical findings in high-stakes exams using the techniques explained in this article or variations thereof. Feedback from students and examiners after completing the OSCE is predominantly positive, with lifelikeness being the quality most often commented upon. Caveats derived from feedback and own experiences are included. The step-by-step approach reported can be adapted and replicated by healthcare educators to build their own three-dimensional transfers. This should widen the scope and the lifelikeness of their simulations. At the same time we propose that this level of lifelikeness should be expected by learners as not to disrupt simulation engagement. Our evaluation of their use in high-stakes assessments suggests they are both useful and accepted.

Medical specialty certification exams studied according to the Ottawa Quality Criteria: a systematic review.

BACKGROUND: Medical specialty certification exams are high-stakes summative assessments used to determine which doctors have the necessary skills, knowledge, and attitudes to treat patients independently. Such exams are crucial for patient safety, candidates' career progression and accountability to the public, yet vary significantly among medical specialties and countries. It is therefore of paramount importance that the quality of specialty certification exams is studied in the scientific literature. METHODS: In this systematic literature review we used the PICOS framework and searched for papers concerning medical specialty certification exams published in English between 2000 and 2020 in seven databases using a diverse set of search term variations. Papers were screened by two researchers independently and scored regarding their methodological quality and relevance to this review. Finally, they were categorized by country, medical specialty and the following seven Ottawa Criteria of good assessment: validity, reliability, equivalence, feasibility, acceptability, catalytic and educational effect. RESULTS: After removal of duplicates, 2852 papers were screened for inclusion, of which 66 met all relevant criteria. Over 43 different exams and more than 28 different specialties from 18 jurisdictions were studied. Around 77% of all eligible papers were based in English-speaking countries, with 55% of publications centered on just the UK and USA. General Practice was the most frequently studied specialty among certification exams with the UK General Practice exam having been particularly broadly analyzed. Papers received an average of 4.2/6 points on the quality score. Eligible studies analyzed 2.1/7 Ottawa Criteria on average, with the most frequently studied criteria being reliability, validity, and acceptability. CONCLUSIONS: The present systematic review shows a growing number of studies analyzing medical specialty certification exams over time, encompassing a wider range of medical specialties, countries, and Ottawa Criteria. Due to their reliance on multiple assessment methods and data-points, aspects of programmatic assessment suggest a promising way forward in the development of medical specialty certification exams which fulfill all seven Ottawa Criteria. Further research is needed to confirm these results, particularly analyses of examinations held outside the Anglosphere as well as studies analyzing entire certification exams or comparing multiple examination methods.

How does multisource feedback influence residency training? A qualitative case study.

INTRODUCTION: Multisource feedback (MSF), also called 360-degree assessment, is one form of assessment used in postgraduate training. However, there is an ongoing discussion on its value, because the factors that influence the impact of MSF and the main impact of MSF are not fully understood. In this study, we investigated both the influencing factors and the impact of MSF on residency training. METHODS: We conducted a qualitative case study within the boundaries of the residency training for paediatricians and paediatric surgeons at a University Hospital. We collected data from seven focus group interviews with stakeholders of MSF (residents, raters and supervisors). By performing a reflexive thematic analysis, we extracted the influencing factors and the impact of MSF. RESULTS: We found seven influencing factors: MSF is facilitated by the announcement of a clear goal of MSF, the training of raters on the MSF instrument, a longitudinal approach of observation, timing not too early and not too late during the rotation, narrative comments as part of the ratings, the residents' self-assessment and a supervisor from the same department. We found three themes on the impact of MSF: MSF supports the professional development of residents, enhances interprofessional teamwork and increases the raters' commitment to the training of residents. CONCLUSION: This study illuminates the influencing factors and impact of MSF on residency training. We offer novel recommendations on the continuity of observation, the timing during rotations and the role of the supervisor. Moreover, by discussing our results through the lens of identity formation theory, this work advances our conceptual understanding of MSF. We propose identity formation theory as a framework for future research on MSF to leverage the potential of MSF in residency training.

Development, production and evaluation of 2-dimensional transfer tattoos to simulate skin conditions in health professions education.

BACKGROUND: Moulages can greatly extend the possibilities of simulation in teaching and assessment. Since moulages that fit an educator's exact needs are often unavailable commercially, this paper explains how 2-dimensional transfer tattoos can be independently developed, produced, and evaluated. METHODS: From representative photographs of the specific skin condition an analogue copy of the pathological finding is drawn. Once validated by the medical expert, it can be digitized by scanning and processed using graphics software. The final digital image file is printed onto transfer paper. Once applied and fixed onto the intended wearer, usually a simulated patient, its authenticity can be confirmed, and further transfer tattoos can be produced. RESULTS: Using this moulage technique we produced 10 different 2-dimensional transfer tattoos to date, including hematoma, Janeway lesions and splinter nails. These moulages are used in clinical skills training, formative and high-stakes summative assessment in undergraduate medical and nursing programs. CONCLUSIONS: By sharing our development process for 2-dimensional transfer tattoos, health profession educators can produce their own that best fit their local educational needs. Due to their high authenticity and standardization, 2-dimensional transfer tattoos are ideal for use in high-stakes assessment.

Completing the picture on student performances in OSCEs: A mixed-methods study on integration of a standardized patient rating.

OBJECTIVE: Good physician communication skills increase patient satisfaction and improve healing processes. Although physicians and patients appear to value communicative competencies differently, students are often evaluated solely by physicians. This study examines whether additional assessment of students by 'standardized patients' (SPs) is useful. METHODS: During their Objective Structured Clinical Examination (OSCE) 238 medical students were additionally rated by SPs at 9 stations according to two items that defined the 'physician-patient relationship' and 'communication'. SPs were informed that their assessment was for research purposes only, with no impact on the assessment of the students. SPs also had the opportunity to comment on their rating of the students. RESULTS: The SPs rated the communicative competencies of students differently than physicians. The two parts of the SP rating are closely related. Inclusion of SP rating in the OSCE would provide higher measurement precision, with more students failing. SPs considered five factors relevant in their rating: 'human connection', 'information flow', 'professionalism', 'competence', and 'exam situation'. CONCLUSION: Our study suggests inclusion of SP rating as additional assessment of student communication skills. PRACTICE IMPLICATIONS: Addition of SP rating in assessments is worthwhile, as it appears to complete the picture of the student performance in their OSCEs.

Measurement precision at the cut score in medical multiple choice exams: Theory matters.

INTRODUCTION: In high-stakes assessment, the measurement precision of pass-fail decisions is of great importance. A concept for analyzing the measurement precision at the cut score is conditional reliability, which describes measurement precision for every score achieved in an exam. We compared conditional reliabilities in Classical Test Theory (CTT) and Item Response Theory (IRT) with a special focus on the cut score and potential factors influencing conditional reliability at the cut score. METHODS: We analyzed 32 multiple-choice exams from three Swiss medical schools comparing conditional reliability at the cut score in IRT and CCT. Additionally, we analyzed potential influencing factors such as the range of examinees' performance, year of study, and number of items using multiple regression. RESULTS: In CTT, conditional reliability was highest for very low and very high scores, whereas examinees with medium scores showed low conditional reliabilities. In IRT, the maximum conditional reliability was in the middle of the scale. Therefore, conditional reliability at the cut score was significantly higher in IRT compared with CTT. It was influenced by the range of examinees' performance and number of items. This influence was more pronounced in CTT. DISCUSSION: We found that conditional reliability shows inverse distributions and conclusions regarding the measurement precision at the cut score depending on the theory used. As the use of IRT seems to be more appropriate for criterion-oriented standard setting in the framework of competency-based medical education, our findings might have practical implications for the design and quality assurance of medical education assessments.

Influences on the implementation of Mini-CEX and DOPS for postgraduate medical trainees' learning: A grounded theory study.

Introduction: In order for Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) to actually have a positive effect on trainees' learning, the way in which the tools are implemented is of key importance. However, there are many factors influencing their implementation. In this study, we aim to develop a comprehensive model of such factors. Methods: Using a constructivist grounded theory approach, we performed eight focus groups. Participants were postgraduate trainees and supervisors from three different specialties; all were experienced with Mini-CEX and/or DOPS. Data were analyzed for recurring themes, underlying concepts and their interactions using constant comparison. Results: We developed a model demonstrating how the implementation of Mini-CEX and DOPS for trainees' learning is influenced by 13 factors relating to four categories: organizational culture (e.g. value of teaching and feedback), work structure (e.g. time for Mini-CEX and DOPS, faculty development), instruments (e.g. content of assessment), and users (e.g. relationship between trainees and supervisors), and their interaction. Conclusions: We developed a complex model of influencing factors relating to four categories. Consideration of this model might support successful implementation and trainees' learning with Mini-CEX and DOPS.

The educational impact of Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) and its association with implementation: A systematic review and meta-analysis.

INTRODUCTION: Mini Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) are used as formative assessments worldwide. Since an up-to-date comprehensive synthesis of the educational impact of Mini-CEX and DOPS is lacking, we performed a systematic review. Moreover, as the educational impact might be influenced by characteristics of the setting in which Mini-CEX and DOPS take place or their implementation status, we additionally investigated these potential influences. METHODS: We searched Scopus, Web of Science, and Ovid, including All Ovid Journals, Embase, ERIC, Ovid MEDLINE(R), and PsycINFO, for original research articles investigating the educational impact of Mini-CEX and DOPS on undergraduate and postgraduate trainees from all health professions, published in English or German from 1995 to 2016. Educational impact was operationalized and classified using Barr's adaptation of Kirkpatrick's four-level model. Where applicable, outcomes were pooled in meta-analyses, separately for Mini-CEX and DOPS. To examine potential influences, we used Fisher's exact test for count data. RESULTS: We identified 26 articles demonstrating heterogeneous effects of Mini-CEX and DOPS on learners' reactions (Kirkpatrick Level 1) and positive effects of Mini-CEX and DOPS on trainees' performance (Kirkpatrick Level 2b; Mini-CEX: standardized mean difference (SMD) = 0.26, p = 0.014; DOPS: SMD = 3.33, p<0.001). No studies were found on higher Kirkpatrick levels. Regarding potential influences, we found two implementation characteristics, "quality" and "participant responsiveness", to be associated with the educational impact. CONCLUSIONS: Despite the limited evidence, the meta-analyses demonstrated positive effects of Mini-CEX and DOPS on trainee performance. Additionally, we revealed implementation characteristics to be associated with the educational impact. Hence, we assume that considering implementation characteristics could increase the educational impact of Mini-CEX and DOPS.

Factors influencing the educational impact of Mini-CEX and DOPS: A qualitative synthesis.

INTRODUCTION: The educational impact of Mini-CEX and DOPS varies greatly and can be influenced by several factors. However, there is no comprehensive analysis and synthesis of the described influencing factors. METHODS: To fill this gap, we chose a two-step approach. First, we performed a systematic literature review and selected articles describing influencing factors on the educational impact of Mini-CEX and DOPS. Second, we performed a qualitative synthesis of these factors. RESULTS: Twelve articles were included, which revealed a model consisting of four themes and nine subthemes as influencing factors. The theme context comprises "time for Mini-CEX/DOPS" and "usability of the tools", and influences the users. The theme users comprises "supervisors' knowledge about how to use Mini-CEX/DOPS", "supervisors' attitude to Mini-CEX/DOPS", "trainees' knowledge about Mini-CEX/DOPS", and "trainees' perception of Mini-CEX/DOPS". These influence the implementation of Mini-CEX and DOPS, including "observation" and "feedback". The theme implementation directly influences the theme outcome, which, in addition to the educational impact, encompasses "trainees' appraisal of feedback". CONCLUSIONS: Our model of influencing factors might help to further improve the use of Mini-CEX and DOPS and serve as basis for future research.

Multiple true-false items: a comparison of scoring algorithms.

Multiple true-false (MTF) items are a widely used supplement to the commonly used single-best answer (Type A) multiple choice format. However, an optimal scoring algorithm for MTF items has not yet been established, as existing studies yielded conflicting results. Therefore, this study analyzes two questions: What is the optimal scoring algorithm for MTF items regarding reliability, difficulty index and item discrimination? How do the psychometric characteristics of different scoring algorithms compare to those of Type A questions used in the same exams? We used data from 37 medical exams conducted in 2015 (998 MTF and 2163 Type A items overall). Using repeated measures analyses of variance (rANOVA), we compared reliability, difficulty and item discrimination of different scoring algorithms for MTF with four answer options and Type A. Scoring algorithms for MTF were dichotomous scoring (DS) and two partial credit scoring algorithms, PS50 where examinees receive half a point if more than half of true/false ratings were marked correctly and one point if all were marked correctly, and PS1/n where examinees receive a quarter of a point for every correct true/false rating. The two partial scoring algorithms showed significantly higher reliabilities (αPS1/n = 0.75; αPS50 = 0.75; αDS = 0.70, αA = 0.72), which corresponds to fewer items needed for a reliability of 0.8 (nPS1/n = 74; nPS50 = 75; nDS = 103, nA = 87), and higher discrimination indices (rPS1/n = 0.33; rPS50 = 0.33; rDS = 0.30; rA = 0.28) than dichotomous scoring and Type A. Items scored with DS tend to be difficult (pDS = 0.50), whereas items scored with PS1/n become easy (pPS1/n = 0.82). PS50 and Type A cover the whole range, from easy to difficult items (pPS50 = 0.66; pA = 0.73). Partial credit scoring leads to better psychometric results than dichotomous scoring. PS50 covers the range from easy to difficult items better than PS1/n. Therefore, for scoring MTF, we suggest using PS50.