'What would my peers say?' Comparing the opinion-based method with the prediction-based method in Continuing Medical Education course evaluation.

Background: Although medical courses are frequently evaluated via surveys with Likert scales ranging from "strongly agree" to "strongly disagree," low response rates limit their utility. In undergraduate medical education, a new method with students predicting what their peers would say, required fewer respondents to obtain similar results. However, this prediction-based method lacks validation for continuing medical education (CME), which typically targets a more heterogeneous group than medical students. Methods: In this study, 597 participants of a large CME course were randomly assigned to either express personal opinions on a five-point Likert scale (opinion-based method; n = 300) or to predict the percentage of their peers choosing each Likert scale option (prediction-based method; n = 297). For each question, we calculated the minimum numbers of respondents needed for stable average results using an iterative algorithm. We compared mean scores and the distribution of scores between both methods. Results: The overall response rate was 47%. The prediction-based method required fewer respondents than the opinion-based method for similar average responses. Mean response scores were similar in both groups for most questions, but prediction-based outcomes resulted in fewer extreme responses (strongly agree/disagree). Conclusions: We validated the prediction-based method in evaluating CME. We also provide practical considerations for applying this method.

Contexte: Bien que les cours de médecine soient fréquemment évalués au moyen d'enquêtes avec des échelles de Likert allant de « totalement d'accord ¼ à « totalement en désaccord ¼, les faibles taux de réponse en limitent l'utilité. Dans l'enseignement médical prédoctoral, une nouvelle méthode dans laquelle les étudiants prédisent ce que leurs pairs diraient, nécessite moins de répondants pour obtenir des résultats similaires. Cependant, cette méthode fondée sur la prédiction n'est pas validée pour la formation médicale continue (FMC), qui cible généralement un groupe plus hétérogène que les étudiants en médecine. Méthodes: Dans cette étude, 597 participants à un grand cours de FMC ont été choisis au hasard pour exprimer leur opinion personnelle sur une échelle de Likert en cinq points (méthode fondée sur l'opinion; n = 300) ou à prédire le pourcentage de leurs pairs choisissant chaque option de l'échelle de Likert (méthode fondée sur la prédiction; n = 297). Pour chaque question, nous avons calculé le nombre minimum de répondants nécessaire pour obtenir des résultats moyens stables à l'aide d'un algorithme itératif. Nous avons comparé les scores moyens et la distribution des scores entre les deux méthodes. Résultats: Le taux de réponse global était de 47 %. La méthode fondée sur la prédiction a nécessité moins de répondants que celle fondée sur l'opinion pour des réponses moyennes similaires. Les scores moyens des réponses étaient similaires dans les deux groupes pour la plupart des questions, mais les résultats fondés sur la prédiction ont donné lieu à moins de réponses extrêmes (totalement d'accord/totalement en désaccord). Conclusions: Nous avons validé la méthode fondée sur la prédiction dans l'évaluation de la FMC. Nous présentons également des considérations pratiques pour la mise en œuvre de cette méthode.

Patterns of Medical Residents' Preferences for Organizational Socialization Strategies to Facilitate Their Transitions: A Q-study.

Introduction: To facilitate various transitions of medical residents, healthcare team members and departments may employ various organizational socialization strategies, including formal and informal onboarding methods. However, residents' preferences for these organizational socialization strategies to ease their transition can vary. This study identifies patterns (viewpoints) in these preferences. Methods: Using Q-methodology, we asked a purposeful sample of early-career residents to rank a set of statements into a quasi-normal distributed grid. Statements were based on previous qualitative interviews and organizational socialization theory. Participants responded to the question, 'What are your preferences regarding strategies other health care professionals, departments, or hospitals should use to optimize your next transition?' Participants then explained their sorting choices in a post-sort questionnaire. We identified different viewpoints based on by-person (inverted) factor analysis and Varimax rotation. We interpreted the viewpoints using distinguishing and consensus statements, enriched by residents' comments. Results: Fifty-one residents ranked 42 statements, among whom 36 residents displayed four distinct viewpoints: Dependent residents (n = 10) favored a task-oriented approach, clear guidance, and formal colleague relationships; Social Capitalizing residents (n = 9) preferred structure in the onboarding period and informal workplace social interactions; Autonomous residents (n = 12) prioritized a loosely structured onboarding period, independence, responsibility, and informal social interactions; and Development-oriented residents (n = 5) desired a balanced onboarding period that allowed independence, exploration, and development. Discussion: This identification of four viewpoints highlights the inadequacy of one-size-fits-all approaches to resident transition. Healthcare professionals and departments should tailor their socialization strategies to residents' preferences for support, structure, and formal/informal social interaction.

Development and evaluation of the Measure of the International Learning Environment Status (MILES) in international higher education.

The aim of this study was to develop and evaluate an instrument to assess international students' perceptions of the international learning environment called 'Measure of the International Learning Environment Status' (MILES). We based the development of the MILES on a solid theoretical framework from Moos by addressing three domains to measure the quality of the international learning environment, namely goal direction, relationships, and system change and system maintenance. We have designed and constructed the instrument in three steps. Firstly, we have collected items from relevant existing instruments and grouped them into the three domains via content analysis. Secondly, we applied a Delphi procedure involving international higher education experts from different stakeholder groups and from different cultural backgrounds to identify and reach consensus on the items comprehensively covering important elements of the international learning environment. Thirdly, we carried out an initial questionnaire evaluation. The final MILES consisted of 47 items with 13 in the first domain, 17 in the second and 17 in the third domain. The content of the domains was clearly in line with Moos theoretical framework and we interpreted the sets of items as goal direction, relationships, and supporting services, respectively. This study provides a comprehensive and systematically developed instrument for future research to better understand international students' perspectives towards the international learning environment that are supported by stakeholders from a range of cultures.

Influence of online collaborative learning on social network and academic performance of medical students: lessons learned from the COVID-19 pandemic.

Introduction: The social distancing restrictions due to the COVID-19 pandemic have changed students' learning environment and limited their social interactions. Therefore, the objective of this study was to investigate the influence of the social distancing restrictions on students' social networks, wellbeing, and academic performance. Methods: We performed a questionnaire study in which 102 students participated before and 167 students during the pandemic. They completed an online questionnaire about how they formed their five peer social networks (study-related support, collaboration, friendship, share information, and learn-from) out-of-class. We performed social network analysis to compare the sizes, structures, and compositions of students' five social networks before and during the pandemic, between first- and second-year students, and between international and domestic students. Additionally, we performed Kruskal-Wallis H test to compare students' academic performance before and during the pandemic. We performed thematic analysis to answers for two open-end questions in the online questionnaire to explore what difficulties students encountered during the COVID-19 pandemic and what support they needed. Results: The results showed that the size of students' social networks during the pandemic was significantly smaller than before the pandemic. Besides, the formation of social networks differed between first- and second-year students, and between domestic and international students. However, academic performance did not decline during the COVID-19 pandemic. Furthermore, we identified three key areas in which students experienced difficulties and needed support by thematic analysis: social connections and interactions, learning and studying, and physical and mental wellbeing. Conclusion: When institutions implement learning with social distancing, such as online learning, they need to consider changes in students' social networks and provide appropriate support.

Towards best practice in developing motor skills: a systematic review on spacing in VR simulator-based psychomotor training for surgical novices.

OBJECTIVE: Repeated practice, or spacing, can improve various types of skill acquisition. Similarly, virtual reality (VR) simulators have demonstrated their effectiveness in fostering surgical skill acquisition and provide a promising, realistic environment for spaced training. To explore how spacing impacts VR simulator-based acquisition of surgical psychomotor skills, we performed a systematic literature review. METHODS: We systematically searched the databases PubMed, PsycINFO, Psychology and Behavioral Sciences Collection, ERIC and CINAHL for studies investigating the influence of spacing on the effectiveness of VR simulator training focused on psychomotor skill acquisition in healthcare professionals. We assessed the quality of all included studies using the Medical Education Research Study Quality Instrument (MERSQI) and the risk of bias using the Cochrane Collaboration's risk of bias assessment tool. We extracted and aggregated qualitative data regarding spacing interval, psychomotor task performance and several other performance metrics. RESULTS: The searches yielded 1662 unique publications. After screening the titles and abstracts, 53 publications were retained for full text screening and 7 met the inclusion criteria. Spaced training resulted in better performance scores and faster skill acquisition when compared to control groups with a single day (massed) training session. Spacing across consecutive days seemed more effective than shorter or longer spacing intervals. However, the included studies were too heterogeneous in terms of spacing interval, obtained performance metrics and psychomotor skills analysed to allow for a meta-analysis to substantiate our outcomes. CONCLUSION: Spacing in VR simulator-based surgical training improved skill acquisition when compared to massed training. The overall number and quality of available studies were only moderate, limiting the validity and generalizability of our findings.

Learning patient-centredness with simulated/standardized patients: A realist review: BEME Guide No. 68.

BACKGROUND: Given the positive outcomes of patient-centred care on health outcomes, future doctors should learn how to deliver patient-centred care. The literature describes a wide variety of educational interventions with standardized patients (SPs) that focus on learning patient-centredness. However, it is unclear which mechanisms are responsible for learning patient-centredness when applying educational interventions with SPs. OBJECTIVE: This study aims to clarify how healthcare learners and professionals learn patient-centredness through interventions involving SPs in different healthcare educational contexts. METHODS: A realist approach was used to focus on what works, for whom, in what circumstances, in what respect and why. Databases were searched through 2019. Nineteen papers were included for analysis. Through inductive and deductive coding, CIC'MO configurations were identified to build partial program theories. These CIC'MOs describe how Interventions with SPs change the Context (C→C') such that Mechanisms (M) are triggered that are expected to foster patient-centredness as Outcome. RESULTS: Interventions with SPs create three contexts which are 'a safe learning environment,' 'reflective practice,' and 'enabling people to learn together.' These contexts trigger the following seven mechanisms: feeling confident, feeling a sense of comfort, feeling safe, self-reflection, awareness, comparing & contrasting perspectives, combining and broadening perspectives. A tentative final program theory with mechanisms belonging to three main learning components (cognitive, regulative metacognitive and affective) is proposed: Interventions with SPs create a safe learning environment (C') in which learners gain feelings of confidence, comfort and safety (affective M). This safe learning environment enables two other mutual related contexts in which learners learn together (C'), through comparing & contrasting, combining and broadening their perspectives (cognitive M) and in which reflective practice (C') facilitates self-reflection and awareness (metacognitive M) in order to learn patient-centeredness. CONCLUSION: These insights offer educators ways to deliberately use interventions with SPs that trigger the described mechanisms for learning patient-centredness.

[Development and validation of a uniform QUality Instrument for ClerKship (QUICK)]. / Hoe meet je de kwaliteit van een coschap?

OBJECTIVE: Because both clerks and medical faculty quality management workers expressed the need for it, we aimed to develop a compact, valid and uniform instrument to assess the quality of Dutch clinical clerkships across all medical faculties in the Netherlands. METHOD: We divided all 249 items from existing published and unpublished clerkship quality instruments into the three essential learning environment domains: content, atmosphere and organisation. In a 3-stage Delphi procedure, the 45 most relevant items from this list were selected that comprehensively covered the three domains. All clinical clerks in the country's northeastern educational region were invited to evaluate their last clerkship using this draft instrument. We used half of these data for item reduction and the other half to validate the final instrument, the QUality Instrument for ClerKships (QUICK). RESULTS: After the Delphi procedure and further item reduction, the QUICK comprises 15 items, 5 in each domain. The internal consistency of the QUICK and each of the three domains was satisfactory (Cronbach's α 0.88, 0.73, 0.84 and 0.67, respectively). The variance of the draft instrument domain scores were explained for >80% by item variance of the final QUICK. A panel of educational experts and medical faculty quality management workers evaluated QUICK's face validity as good. CONCLUSION: The QUICK is a concise and valid instrument to assess the quality of Dutch clinical clerkships. Its repeated use in a quality cycle can contribute to monitoring and ongoing development of the quality of this key phase in the medical education curriculum.

Use of simulation training to teach the ABCDE primary assessment: an observational study in a Dutch University Hospital with a 3-4 months follow-up.

OBJECTIVES: To investigate short-term and long-term effectiveness of simulation training to acquire a structured Airway Breathing Circulation Disability Exposure (ABCDE) approach for medical emergencies; and to examine which skills were learnt and maintained best. DESIGN: An observational study with a 3-4 months follow-up. SETTING: Skills center of the University Medical Center Groningen. PARTICIPANTS: Thirty voluntary participants (21 females and 9 males; 27±2.77 years) of a simulation-based course. INTERVENTION: A 2-day ABCDE-teaching course for residents and non-residents. The course encompasses 24 simulations in which participants perform primary assessments of acute ill patients. Video recordings were taken of each participant performing a primary assessment, before (T1), directly after (T2) and 3-4 months after the intervention (T3). MAIN OUTCOME MEASURES: Physicians' performance in the ABCDE primary assessment at T1, T2 and T3. Two observers scored the primary assessments, blinded to measurement moment, using an assessment form to evaluate the performance with regard to skills essential for a structured ABCDE approach. The Friedman and Wilcoxon signed-rank test were used to compare physicians' performances on the subsequent measurement moments. RESULTS: The mean ranks on the total primary assessment at T1, T2 and T3 were 1.14, 2.62 and 2.24, respectively, and were significantly different, (p<0.001).The mean ranks on the total primary assessment directly after the course (T2 vs T1 p<0.001) and 3-4 months after the course (T3 vs T1 p<0.001) were significantly better than before the course. Certain skills deteriorated during the follow-up. Strikingly, most skills that decrease over time are Crew Resources Management (CRM) skills. CONCLUSION: A course using simulation training is an effective educational tool to teach physicians the ABCDE primary assessment. Certain CRM skills decrease over time, so we recommend organising refresher courses, simulation team training or another kind of simulation training with a focus on CRM skills.

How students and specialists appreciate the mini-clinical evaluation exercise (mini-CEX) in Indonesian clerkships.

BACKGROUND: Cultural differences might challenge the acceptance of the implementation of assessment formats that are developed in other countries. Acceptance of assessment formats is essential for its effectiveness; therefore, we explored the views of students and specialists on the practicality and impact on learning of these formats. This study was conducted to explore Indonesian students' and specialists' appreciation of the implementation of the Mini-Clinical Evaluation Exercise (Mini-CEX) in Indonesian clerkships. METHODS: This study was conducted at the Universitas Gadjah Mada, Indonesia. Participants were 52 students and 21 specialists in neurology and 78 students and 50 specialists in internal medicine. They were asked to complete a 19-item questionnaire that covered the characteristics of the mini-CEX such as its practicality, and the impact on learning and professional development. We used a Mann-Whitney U test to analyse the data. RESULTS: In total, 124 students (46 from neurology and 78 from internal medicine) and 38 specialists (13 from neurology and 25 from internal medicine) participated in this study. Students and specialists were positive about the practicality of the mini-CEX and the impact of this assessment format on learning and on professional development. The Mann-Whitney U test showed that there were no significant differences between students' and specialists' opinions on the mini-CEX, except for 2 items: specialists' appreciation of direct observation (mean rank = 93.16) was statistically significantly higher than students' appreciation of it (mean rank = 77.93; z = 2.065; p < 0.05), but students' appreciation of the item that students' past mini-CEX results affected their recent mini-CEX outcomes (mean rank = 85.29) was significantly higher than specialists' appreciation of it (mean rank = 69.12; z = 2140; p < 0.05). CONCLUSION: Students and specialists were positive about the mini-CEX in Indonesian clerkships, although it was developed and validated in another culture. We found only small differences between their appreciations, which could be explained by the patterns of specialist-student interaction in Indonesian culture as large power distance and low individualism country.

Learning from patients about patient-centredness: A realist review: BEME Guide No. 60.

Background: Patient-centred work is an essential part of contemporary medicine. Literature shows that educational interventions contribute to developing patient-centredness, but there is a lack of insight into the associated learning processes.Objective: Through reviewing articles about educational interventions involving patients, we aspire to develop a program theory that describes the processes through which the educational interventions are expected to result in change. The processes will clarify contextual elements (called contexts) and mechanisms connected to learning patient-centredness.Methods: In our realist review, an initial, rough program theory was generated during the scoping phase, we searched for relevant articles in PubMed, PsycINFO, ERIC, CINAHL and Embase for all years before and through 2016. We included observational studies, case reports, interviews, and experimental studies in which the participants were students, residents, doctors, nurses or dentists. The relevance and rigour of the studies were taken into account during analysis. With deductive as well as inductive coding, we extended the rough program theory.Results: In our review, we classified five different contexts which affect how upcoming professionals learn patient-centredness. These aspects are influenced through components in the intervention(s) related to the learner, the teacher, and the patient. We placed the mechanisms together in four clusters - comparing and combining as well as broadening perspectives, developing narratives and engagement with patients, self-actualisation, and socialisation - to show how the development of (dimensions of) patient-centredness occurs. Three partial-program-theories (that together constituting a whole program theory) were developed, which show how different components of interventions within certain contexts will evoke mechanisms that contribute to patient-centredness.Translation into daily practice: These theories may help us better understand how the roles of patients, learners and teachers interact with contexts such as the kind of knowledge that is considered legitimate or insight in the whole illness trajectory. Our partial program theories open up potential areas for future research and interventions that may benefit learners, teachers, and patients.

Reliability of residents' assessments of their postgraduate medical education learning environment: an observational study.

BACKGROUND: Even in anonymous evaluations of a postgraduate medical education (PGME) program, residents may be reluctant to provide an honest evaluation of their PGME program, because they fear embarrassment or repercussions from their supervisors if their anonymity as a respondent is endangered. This study was set up to test the hypothesis that current residents in a PGME program provide more positive evaluations of their PGME program than residents having completed it. We therefore compared PGME learning environment evaluations of current residents in the program to leaving residents having completed it. METHODS: This observational study used data gathered routinely in the quality cycle of PGME programs at two Dutch teaching hospitals to test our hypothesis. At both hospitals, all current PGME residents are requested to complete the Scan of Postgraduate Education Environment Domains (SPEED) annually. Residents leaving the hospital after completion of the PGME program are also asked to complete the SPEED after an exit interview with the hospital's independent residency coordinator. All SPEED evaluations are collected and analysed anonymously. We compared the residents' grades (on a continuous scale ranging from 0 (poor) to 10 (excellent)) on the three SPEED domains (content, atmosphere, and organization of the program) and their mean (overall department grade) between current and leaving residents. RESULTS: Mean (SD) overall SPEED department grades were 8.00 (0.52) for 287 current residents in 39 PGME programs and 8.07 (0.48) for 170 leaving residents in 39 programs. Neither the overall SPEED department grades (t test, p = 0.53, 95% CI for difference - 0.16 to 0.31) nor the department SPEED domain grades (MANOVA, F(3, 62) = 0.79, p = 0.51) were significantly different between current and leaving residents. CONCLUSIONS: Residents leaving the program did not provide more critical evaluations of their PGME learning environment than current residents in the program. This suggests that current residents' evaluations of their postgraduate learning environment were not affected by social desirability bias or fear of repercussions from faculty.

[Need for a uniform clinical placement quality cycle]. / Behoefte aan uniforme kwaliteitscyclus van coschappen.

OBJECTIVE: To investigate how quality control of clinical placements in the Netherlands is organised, which tools are available for this purpose, and what Dutch clinical placement students think about current clinical placement assessment. DESIGN: Document analysis, literature search and questionnaire. METHOD: In 2017, we asked all 8 medical schools to share their procedures and tools for assessing clinical placement quality with us. We searched various databases to find all published tools developed to measure clinical placement quality. In the same year, we also conducted a survey of 15 clinical placement students per school with questions about current and desired clinical placement assessment. RESULTS: All 8 schools sent detailed information about clinical placement quality assessment contents and procedures. All schools indicated that they are cyclically measuring each clinical placement's quality using evaluations by the clinical placement students. Each school uses its own questionnaire, none of these questionnaires have been validated. Literature search only found two tools specifically developed for assessing clinical placement quality, none of which have been validated for the Dutch language and situation. Clinical placement students feel that not enough noticeable improvement actions are being taken as a result of their evaluations. They preferred a short, uniform questionnaire with questions about clinical placement content, atmosphere and organisation. CONCLUSION: The quality cycle of clinical placements in the Netherlands could be improved with respect to uniformity and implementation of actions for improvement. There is a need for standardisation of the clinical placement quality cycle and for development of a validated Dutch measuring tool for this.

Clinical workplace learning: perceived learning value of individual and group feedback in a collectivistic culture.

BACKGROUND: Feedback is essential for workplace learning. Most papers in this field concern individual feedback. In collectivistic cultures, however, group feedback is common educational practice. This study was conducted to investigate the perceived learning value and characteristics of individual and group feedback in a collectivistic culture. METHODS: During two weeks, on a daily basis, clerkship students (n = 215) from 12 clinical departments at Faculty of Medicine, Universitas Gadjah Mada, Yogyakarta, Indonesia, recorded individual and group feedback moments by using a structured form: the providers, focus and perceived learning value of feedback. Data were analysed with logistic regression and multilevel techniques. RESULTS: Students reported 2687 group and 1535 individual feedback moments. Group feedback more often focused on history taking, clinical judgment, patient management, patient counselling, and professional behaviour (OR ranging from 1.232, p < .01, to 2.152, p < .001), but less often on physical examination (OR = .836, p < .01). Group feedback less often aimed at correcting performance deficiencies (OR = .523, p < .001) and more often at comparing performance to the standard (OR = 2.447, p < .001) and planning action to improve performance (OR = 1.759, p < .001). Group feedback was perceived as more valuable than individual feedback (M = 4.08 and 3.96, respectively, ß group = .065, SE = .026, p < .01). CONCLUSION: In collectivistic cultures, group feedback may add to the array of educational measures that optimize student learning. Congruence between culture and type of feedback may be important for the effectiveness of feedback.

Physician job satisfaction related to actual and preferred job size.

BACKGROUND: Job satisfaction is essential for physicians' well-being and patient care. The work ethic of long days and hard work that has been advocated for decades is acknowledged as a threat for physicians' job satisfaction, well-being, and patient safety. Our aim was to determine the actual and preferred job size of physicians and to investigate how these and the differences between them influence physicians' job satisfaction. METHOD: Data were retrieved from a larger, longitudinal study among physicians starting medical training at Groningen University in 1982/83/92/93 (N = 597). Data from 506 participants (85%) were available for this study. We used regression analysis to investigate the influence of job size on physicians' job satisfaction (13 aspects) and ANOVA to examine differences in job satisfaction between physicians wishing to retain, reduce or increase job size. RESULTS: The majority of the respondents (57%) had an actual job size less than 1.0 FTE. More than 80% of all respondents preferred not to work full-time in the future. Respondents' average actual and preferred job sizes were .85 FTE and .81 FTE, respectively. On average, respondents who wished to work less (35% of respondents) preferred a job size reduction of 0.18 FTE and those who wished to work more (12%) preferred an increase in job size of 0.16 FTE. Job size influenced satisfaction with balance work-private hours most (ß = -.351). Physicians who preferred larger job sizes were - compared to the other groups of physicians - least satisfied with professional accomplishments. CONCLUSIONS: A considerable group of physicians reported a gap between actual and preferred job size. Realizing physicians' preferences as to job size will hardly affect total workforce, but may greatly benefit individual physicians as well as their patients and society. Therefore, it seems time for a shift in work ethic.

Influence of feedback characteristics on perceived learning value of feedback in clerkships: does culture matter?

BACKGROUND: Various feedback characteristics have been suggested to positively influence student learning. It is not clear how these feedback characteristics contribute to students' perceived learning value of feedback in cultures classified low on the cultural dimension of individualism and high on power distance. This study was conducted to validate the influence of five feedback characteristics on students' perceived learning value of feedback in an Indonesian clerkship context. METHODS: We asked clerks in Neurology (n = 169) and Internal Medicine (n = 132) to assess on a 5-point Likert scale the learning value of the feedback they received. We asked them to record whether the feedback provider (1) informed the student what went well, (2) mentioned which aspects of performance needed improvement, (3) compared the student's performance to a standard, (4) further explained or demonstrated the correct performance, and (5) prepared an action plan with the student to improve performance. Data were analyzed using multilevel regression. RESULTS: A total of 250 students participated in this study, 131 from Internal Medicine (response rate 99%) and 119 from Neurology (response rate 70%). Of these participants, 225 respondents (44% males, 56% females) completed the form and reported 889 feedback moments. Students perceived feedback as more valuable when the feedback provider mentioned their weaknesses (ß = 0.153, p < 0.01), compared their performance to a standard (ß = 0.159, p < 0.01), explained or demonstrated the correct performance (ß = 0.324, p < 0.001) and prepared an action plan with the student (ß =0.496, p < 0.001). Appraisal of good performance did not influence the perceived learning value of feedback. No gender differences were found for perceived learning value. CONCLUSIONS: In Indonesia, we could validate four out of the five characteristics for effective feedback. We argue that our findings relate to culture, in particular to the levels of individualism and power distance. The recognized characteristics of what constitutes effective feedback should be validated across cultures.

Supervisor leadership in relation to resident job satisfaction.

BACKGROUND: Research from outside the medical field shows that leadership behaviours influence job satisfaction. Whether the same is true for the medical training setting needs to be explored. The aim of this study was to investigate the influence of residents' overall appreciation of their supervisor's leadership and observation of specific supervisor leadership behaviours on job satisfaction. METHODS: We invited residents (N = 117) to rate how often they observed certain task and relation-oriented leadership behaviours in their supervisor and overall appreciation of their supervisor's leadership. Furthermore, they rated their satisfaction with 13 different aspects of their jobs on a 10-point scale. Using exploratory factor analysis we identified four factors covering different types of job satisfaction aspects: personal growth, autonomy, affective, and instrumental job satisfaction aspects. Influence of overall appreciation for supervisor leadership and observation of certain leadership behaviours on these job satisfaction factors were analysed using multiple regression analyses. RESULTS: The affective aspects of job satisfaction were positively influenced by overall appreciation of leadership (B = 0.792, p = 0.017), observation of specific instructions (B = 0.972, p = 0.008) and two-way communication (B = 1.376, p = 0.008) and negatively by mutual decision-making (B = -1.285, p = 0.007). No effects were found for the other three factors of job satisfaction. CONCLUSIONS: We recommend that supervisors become more aware of whether and how their behaviours influence residents' job satisfaction. Especially providing specific instructions and using two-way communication seem important to help residents deal with their insecurities and to offer them support.

Leadership in the clinical workplace: what residents report to observe and supervisors report to display: an exploratory questionnaire study.

BACKGROUND: Within the current health care system, leadership is considered important for physicians. leadership is mostly self-taught, through observing and practicing. Does the practice environment offer residents enough opportunities to observe the supervisor leadership behaviours they have to learn? In the current study we investigate which leadership behaviours residents observe throughout their training, which behaviours supervisors report to display and whether residents and supervisors have a need for more formal training. METHODS: We performed two questionnaire studies. Study 1: Residents (n = 117) answered questions about the extent to which they observed four basic and observable Situational Leadership behaviours in their supervisors. Study 2: Supervisors (n = 201) answered questions about the extent to which they perceived to display these Situational Leadership behaviours in medical practice. We asked both groups of participants whether they experienced a need for formal leadership training. RESULTS: One-third of the residents did not observe the four basic Situational Leadership behaviours. The same pattern was found among starting, intermediate and experienced residents. Moreover, not all supervisors showed these 4 leadership behaviours. Both supervisors and residents expressed a need for formal leadership training. CONCLUSION: Both findings together suggest that current practice does not offer residents enough opportunities to acquire these leadership behaviours by solely observing their supervisors. Moreover, residents and supervisors both express a need for more formal leadership training. More explicit attention should be paid to leadership development, for example by providing formal leadership training for supervisors and residents.

Development and Validation of the Scan of Postgraduate Educational Environment Domains (SPEED): A Brief Instrument to Assess the Educational Environment in Postgraduate Medical Education.

INTRODUCTION: Current instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality. METHODS: Stepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected. RESULTS: Two hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ≥80% by the items representing the domains in the final SPEED. CONCLUSIONS: The SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity and brevity, the SPEED is promising as useful and easily applicable tool to regularly screen educational environment quality in postgraduate medical education.

The transferability of Western concepts to other cultures: validation of the Zuckerman-Kuhlman Personality Questionnaire in a Saudi Arabic context.

BACKGROUND: The importance of medical education research in Saudi Arabia has been acknowledged increasingly and a lot of concepts used have been derived from the Western world. The question arises, however, whether Western concepts and questionnaires are transferable to societies with different cultures. The aim of this study was to investigate the instrument structure and the reliability of the Arabic version of the Zuckerman-Kuhlman Personality Questionnaire-medium (ZKPQ-m). METHODS: Three statistical methods with decreased amount of strictness were used to analyse our data: Confirmatory Factor Analysis, Procrustes rotation and Principal Component Analysis. RESULTS: Our outcomes did not confirm the original instrument structure. Instead, we found four interpretable components: Emotional Instability, Impulse-seeking, Activeness and Self-Control. However, the amount of explained variance was not very high and the internal consistencies ranged from unsatisfactory to only moderate. The data showed a high percentage of respondents agreeing with more than three items of the Infrequency scale, which may be attributable to the collectivistic culture in Saudi Arabia. CONCLUSION: We did not succeed in replicating the ZKPQ structure in the Arabic context. Social desirability, a common characteristic in collectivistic cultures, may have reduced the replicability of the internal structure of the ZKPQ-m. Different methods to measure concepts in collectivistic cultures may help to get round social desirability.