Maturing through awareness: An exploratory study into the development of educational competencies, identity, and mission of medical educators.

PURPOSE: Faculty development in learning-centred medical education aims to help faculty mature into facilitators of student learning, but it is often ineffective. It is unclear how to support educators' maturation sustainably. We explored how and why medical educators working in learning-centred education, more commonly referred to as student-centred education, mature over time. METHODS: We performed a qualitative follow-up study and interviewed 21 senior physician-educators at two times, ten years apart. A hierarchical model, distinguishing four educator phenotypes, was employed to deductively examine educators' awareness of the workplace context, their educational competencies, identity, and 'mission,' i.e. their source of personal inspiration. Those educators who grew in awareness, as measured by advancing in educator phenotype, were re-interviewed to inductively explore factors they perceived to have guided their maturation. RESULTS: A minority of the medical educators grew in awareness of their educational qualities over the 10-year study period. Regression in awareness did not occur. Maturation as an educator was perceived to be linked to maturation as a physician and to engaging in primarily informal learning opportunities. CONCLUSIONS: Maturation of medical educators can take place, but is not guaranteed, and appears to proceed through a growth in awareness of, successively, educational competencies, identity, and mission. At all stages, maturation is motivated by the task, identity, and mission as a physician.

Becoming a physician for older patients: exploring the professional identity formation of medical students during a nursing home clerkship. A qualitative study.

BACKGROUND: To prepare medical students for the growing population of older patients, an appropriate professional identity formation is desirable. The community of practice of medical school is primarily hospital-based and disease-oriented which will lead to the development of a physician who is mainly focused on cure. This focus alone however is not always appropriate for older persons' health care. The aim of this study is to explore the influence of participating in a nursing home community of practice on the professional identity formation of medical students. METHODS: A qualitative study based on a constructivist research paradigm was conducted, using individual semi-structured, in-depth interviews and a visual narrative method (drawing) as a prompt. Thematic analysis was applied to structure and interpret the data. The study population consisted of fifth-year medical students participating in a six-week nursing home clerkship. Thirteen participants were purposefully sampled. The clerkship took place in nursing homes in the South-West of the Netherlands. RESULTS: The medical students described the nursing home as the living environment of the patients. Actively participating in the patients' care and experiencing the daily life of the patients was meaningful for the physician the students want to become in five ways: (1) a physician with a complete picture; (2) a physician who is close; (3) a physician who is in dialogue; (4) a physician who is able to let go and (5) a physican who collaborates. CONCLUSIONS: Caring for older patients in the nursing home influences the professional identity formation of medical students. Patient-centeredness, personal, holistic and tailored care, approachability and collaboration are important characteristics in becoming a physician for older persons' health care. The context of this care provides relevant learning experiences for this development and the becoming of a physician in general.

'You are not alone.' An exploratory study on open-topic, guided collaborative reflection sessions during the General Practice placement.

BACKGROUND: To support professional development of medical students faced with challenges of the clinical phase, collaborative reflection sessions (CRSs) are used to share and reflect on workplace experiences. Facilitation of CRSs seems essential to optimise learning and to provide important skills for lifelong learning as a professional. However, little is known about which workplace experiences students share in CRSs without advance guidance on specific topics, and how reflecting on these experiences contributes to students' professional development. Therefore, we explored which workplace experiences students shared, what they learned from reflection on these experiences, and how they perceived the value of CRSs. METHODS: We conducted an exploratory study among medical students (N = 99) during their General Practice placement. Students were invited to openly share workplace experiences, without pre-imposed instruction. A thematic analysis was performed on shared experiences and student learning gains. Students' perceptions of CRSs were analysed using descriptive statistics. RESULTS: All 99 students volunteered to fill out the questionnaire. We found four themes relating to students' shared experiences: interactions with patients, complex patient care, diagnostic or therapeutic considerations, and dealing with collegial issues. Regarding students' learning gains, we found 6 themes: learning from others or learning from sharing with others, learning about learning, communication skills, self-regulation, determination of position within the healthcare team, and importance of good documentation. Students indicated that they learned from reflection on their own and peer's workplace experiences. Students valued the CRSs as a safe environment in which to share workplace experiences and helpful for their professional development. CONCLUSIONS: In the challenging General Practice placement, open-topic, guided CRSs provide a helpful and valued learning environment relevant to professional development and offer opportunities for vicarious learning among peers. CRSs may also be a valuable tool to incorporate into other placements.

Professional identity formation of medical students in relation to the care of older persons: a review of the literature.

With the growing population of older persons, medical students have to be well prepared for older persons' health care during medical school. Becoming a doctor is an interplay of building competencies and developing a professional identity. Professional identity formation of medical students is a relatively new educational concept in geriatric medical education. This review aims to explore the concept of professional identity formation of undergraduate medical students in relation to the care of older persons. Twenty-three peer-reviewed studies were included and summarized narratively. Patient-centeredness, caring and compassion, collaboration and holistic care are characteristics of the doctor's professional identity in relation to the care of older persons. Participating in the context of older persons' health care contributes to the becoming of a doctor in general. In this context, the building of relationships with older persons, participating in their lives and role models are important influencers of professional identity formation. Furthermore, the perceptions and expectations medical students have of future doctoring influence their feelings about the care of older persons. To prepare medical students for older persons' health care, professional identity formation seems to be a relevant educational concept.

Longitudinal training models for entrusting students with independent patient care?: A systematic review.

OBJECTIVE: The participation of students from both undergraduate medical education (UGME) and postgraduate medical education (PGME) in independent patient care contributes to the development of knowledge, skills and the professional identity of students. A continuing collaboration between students and their preceptor might contribute to opportunities for students to independently provide patient care. In this systematic review, we aim to evaluate whether longitudinal training models facilitate the independent practice of students and what characteristics of longitudinal training models contribute to this process. METHOD: This systematic review was performed according to the PRISMA guidelines. In May 2020, we performed a search in three databases. Articles evaluating the impact of longitudinal training models on the independent practice of students from both UGME and PGME programmes were eligible for the study. A total of 68 articles were included in the study. Quality of the included studies was assessed using the Quality Assessment Tool for Studies with Diverse Designs (QATSDD). RESULTS: Both UGME and PGME students in longitudinal training models are more frequently allowed to provide patient care independently when compared with their block model peers, and they also feel better prepared for independent practice at the end of their training programme. Several factors related to longitudinal training models stimulate opportunities for students to work independently. The most important factors in this process are the longitudinal relationships with preceptors and with the health care team. CONCLUSION: Due to the ongoing collaboration between students and their preceptor, they develop an intensive and supportive mutual relationship, allowing for the development of a safe learning environment. As a result, the professional development of students is fostered, and students gradually become part of the health care team, allowing them the opportunity to engage in independent patient care.

How learning-centred beliefs relate to awareness of educational identity and mission: An exploratory study among medical educators.

INTRODUCTION: Although learning-centred education would be most effective if all medical educators held learning-centred beliefs, many educators still hold teaching-centred beliefs. A previously developed theoretical model describes a relationship between beliefs, educational identity and 'mission,' meaning that which inspires and drives educators. To increase our understanding of why educators hold certain beliefs, we explored the empirical relationship between educators' beliefs and their awareness of their educational identity and mission. METHODS: A qualitative study was conducted using in-depth interviews with medical educators. We performed a deductive thematic analysis employing two existing models to examine educators' beliefs about teaching and learning and their awareness of their educational identity and mission. RESULTS: Educators demonstrated both teaching-centred and learning-centred beliefs, which aligned with an awareness of their educational identity and mission. While educators who were unaware of both their identity and mission displayed teaching-centred beliefs, educators aware of their identity and mission displayed learning-centred beliefs. Those who were aware of their identity, but not their mission, displayed either teaching- or learning-centredness. CONCLUSIONS: Medical educators' awareness of identity and mission are related to their beliefs about education. Further research is needed into whether beliefs can change over time by increasing identity and mission awareness.

Supervisory dyads' communication and alignment regarding the use of workplace-based observations: a qualitative study in general practice residency.

BACKGROUND: In medical residency, performance observations are considered an important strategy to monitor competence development, provide feedback and warrant patient safety. The aim of this study was to gain insight into whether and how supervisor-resident dyads build a working repertoire regarding the use of observations, and how they discuss and align goals and approaches to observation in particular. METHODS: We used a qualitative, social constructivist approach to explore if and how supervisory dyads work towards alignment of goals and preferred approaches to performance observations. We conducted semi-structured interviews with supervisor-resident dyads, performing a template analysis of the data thus obtained. RESULTS: The supervisory dyads did not frequently communicate about the use of observations, except at the start of training and unless they were triggered by internal or external factors. Their working repertoire regarding the use of observations seemed to be primarily driven by patient safety goals and institutional assessment requirements rather than by providing developmental feedback. Although intended as formative, the institutional test was perceived as summative by supervisors and residents, and led to teaching to the test rather than educating for purposes of competence development. CONCLUSIONS: To unlock the full educational potential of performance observations, and to foster the development of an educational alliance, it is essential that supervisory dyads and the training institute communicate clearly about these observations and the role of assessment practices of- and for learning, in order to align their goals and respective approaches.

Unprofessional behaviour of GP residents and its remediation: a qualitative study among supervisors and faculty.

BACKGROUND: Lapses in professionalism have profound negative effects on patients, health professionals, and society. The connection between unprofessional behaviour during training and later practice requires timely identification and remediation. However, appropriate language to describe unprofessional behaviour and its remediation during residency is lacking. Therefore, this exploratory study aims to investigate which behaviours of GP residents are considered unprofessional according to supervisors and faculty, and how remediation is applied. METHODS: We conducted eight semi-structured focus group interviews with 55 broadly selected supervisors from four Dutch GP training institutes. In addition, we conducted individual semi-structured interviews with eight designated professionalism faculty members. Interview recordings were transcribed verbatim. Data were coded in two consecutive steps: preliminary inductive coding was followed by secondary deductive coding using the descriptors from the recently developed 'Four I's' model for describing unprofessional behaviours as sensitising concepts. RESULTS: Despite the differences in participants' professional positions, we identified a shared conceptualisation in pinpointing and assessing unprofessional behaviour. Both groups described multiple unprofessional behaviours, which could be successfully mapped to the descriptors and categories of the Four I's model. Behaviours in the categories 'Involvement' and 'Interaction' were assessed as mild and received informal, pedagogical feedback. Behaviours in the categories 'Introspection' and 'Integrity', were seen as very alarming and received strict remediation. We identified two new groups of behaviours; 'Nervous exhaustion complaints' and 'Nine-to-five mentality', needing to be added to the Four I's model. The diagnostic phase of unprofessional behaviour usually started with the supervisor getting a 'sense of alarm', which was described as either a 'gut feeling', 'a loss of enthusiasm for teaching' or 'fuss surrounding the resident'. This sense of alarm triggered the remediation phase. However, the diagnostic and remediation phases did not appear consecutive or distinct, but rather intertwined. CONCLUSIONS: The processes of identification and remediation of unprofessional behaviour in residents appeared to be intertwined. Identification of behaviours related to lack of introspection or integrity were perceived as the most important to remediate. The results of this research provide supervisors and faculty with an appropriate language to describe unprofessional behaviours among residents, which can facilitate timely identification and remediation.

What happens under the flag of direct observation, and how that matters: A qualitative study in general practice residency.

INTRODUCTION: In competency-based medical education, direct observation (DO) of residents' skills is scarce, notwithstanding its undisputed importance for credible feedback and assessment. A growing body of research is investigating this discrepancy. Strikingly, in this research, DO as a concrete educational activity tends to remain vague. In this study, we concretised DO of technical skills in postgraduate longitudinal training relationships. METHODS: Informed by constructivist grounded theory, we performed a focus group study among general practice residents. We asked residents about their experiences with different manifestations of DO of technical skills. A framework describing different DO patterns with their varied impact on learning and the training relationship was constructed and refined until theoretical sufficiency was reached. RESULTS: The dominant DO pattern was ad hoc, one-way DO. Importantly, in this pattern, various unpredictable, and sometimes unwanted, scenarios could occur. Residents hesitated to discuss unwanted scenarios with their supervisors, sometimes instead refraining from future requests for DO or even for help. Planned bi-directional DO sessions, though seldom practiced, contributed much to collaborative learning in a psychologically safe training relationship. DISCUSSION AND CONCLUSION: Patterns matter in DO. Residents and supervisors should be made aware of this and educated in maintaining an open dialogue on how to use DO for the benefit of learning and the training relationship.

Medical educators' beliefs about teaching, learning, and knowledge: development of a new framework.

BACKGROUND: The educational beliefs of medical educators influence their teaching practices. Insight into these beliefs is important for medical schools to improve the quality of education they provide students and to guide faculty development. Several studies in the field of higher education have explored the educational beliefs of educators, resulting in classifications that provide a structural basis for diverse beliefs. However, few classification studies have been conducted in the field of medical education. We propose a framework that describes faculty beliefs about teaching, learning, and knowledge which is specifically adapted to the medical education context. The proposed framework describes a matrix in which educational beliefs are organised two dimensionally into belief orientations and belief dimensions. The belief orientations range from teaching-centred to learning-centred; the belief dimensions represent qualitatively distinct aspects of beliefs, such as 'desired learning outcomes' and 'students' motivation'. METHODS: We conducted in-depth semi-structured interviews with 26 faculty members, all of whom were deeply involved in teaching, from two prominent medical schools. We used the original framework of Samuelowicz and Bain as a starting point for context-specific adaptation. The qualitative analysis consisted of relating relevant interview fragments to the Samuelowicz and Bain framework, while remaining open to potentially new beliefs identified during the interviews. A range of strategies were employed to ensure the quality of the results. RESULTS: We identified a new belief dimension and adapted or refined other dimensions to apply in the context of medical education. The belief orientations that have counterparts in the original Samuelowicz and Bain framework are described more precisely in the new framework. The new framework sharpens the boundary between teaching-centred and learning-centred belief orientations. CONCLUSIONS: Our findings confirm the relevance of the structure of the original Samuelowicz and Bain beliefs framework. However, multiple adaptations and refinements were necessary to align the framework to the context of medical education. The refined belief dimensions and belief orientations enable a comprehensive description of the educational beliefs of medical educators. With these adaptations, the new framework provides a contemporary instrument to improve medical education and potentially assist in faculty development of medical educators.

Supervisors' intention to observe clinical task performance: an exploratory study using the theory of planned behaviour during postgraduate medical training.

BACKGROUND: Direct observation of clinical task performance plays a pivotal role in competency-based medical education. Although formal guidelines require supervisors to engage in direct observations, research demonstrates that trainees are infrequently observed. Supervisors may not only experience practical and socio-cultural barriers to direct observations in healthcare settings, they may also question usefulness or have low perceived self-efficacy in performing direct observations. A better understanding of how these multiple factors interact to influence supervisors' intention to perform direct observations may help us to more effectively implement the aforementioned guidelines and increase the frequency of direct observations. METHODS: We conducted an exploratory quantitative study, using the Theory of Planned Behaviour (TPB) as our theoretical framework. In applying the TPB, we transfer a psychological theory to medical education to get insight in the influence of cognitive and emotional processes on intentions to use direct observations in workplace based learning and assessment. We developed an instrument to investigate supervisors intention to perform direct observations. The relationships between the TPB measures of our questionnaire were explored by computing bivariate correlations using Pearson's R tests. Hierarchical regression analysis was performed in order to assess the impact of the respective TPB measures as predictors on the intention to perform direct observations. RESULTS: In our study 82 GP supervisors completed our TPB questionnaire. We found that supervisors had a positive attitude towards direct observations. Our TPB model explained 45% of the variance in supervisors' intentions to perform them. Normative beliefs and past behaviour were significant determinants of this intention. CONCLUSION: Our study suggests that supervisors use their past experiences to form intentions to perform direct observations in a careful, thoughtful manner and, in doing so, also take the preferences of the learner and other stakeholders potentially engaged in direct observations into consideration. These findings have potential implications for research into work-based assessments and the development of training interventions to foster a shared mental model on the use of direct observations.

A practical framework for remediating unprofessional behavior and for developing professionalism competencies and a professional identity.

The relatively new term "Professional Identity Formation" (PIF) complements behavior-based and attitude-based perspectives on professionalism. Unprofessional behavior and its remediation should also be addressed from this perspective. However, a framework is needed to guide discussion and remediation of unprofessional behavior, which can encompass behavior-based, attitude-based, and identity-based perspectives on professionalism. To this end, the authors propose a multi-level professionalism framework which describes, apart from professional behavior, more levels which influence professional performance: environment, competencies, beliefs, values, identity, and mission. The different levels can provide tools for educators to address and discuss unprofessional behavior with their students in a comprehensive way. By reflecting on all the different levels of the framework, educators guard themselves against narrowing the discussion to either professional behavior or professional identity. The multi-level professionalism framework can help educators and students to gain a better understanding of the root of unprofessional behavior, and of remediation strategies that would be appropriate. For despite the recent emphasis on PIF, unprofessional behavior and its remediation will remain important issues in medical education.

From critic to inspirer: four profiles reveal the belief system and commitment to educational mission of medical academics.

BACKGROUND: The educational beliefs of medical academics influence how they act in class and thus influence student learning. One component of these are beliefs academics hold about the qualities of teachers themselves. These teacher qualities range from behaviours and competencies to more personal attributes such as the teacher's identity and mission. However, it is unclear what medical academics believe to be key teacher qualities. Therefore, this study explored the variety of medical academics' beliefs about 'teacher qualities', aiming to identify and characterise profiles of academics with similar beliefs. METHODS: We interviewed 26 expert academics from two medical schools to explore their beliefs about teacher qualities. A concentric onion-model focusing on teacher qualities was used to analyse and categorise the data deductively. Within each theme we developed subthemes inductively. To gain insight into the variety of beliefs we then clustered the participants into teacher profiles according to the themes. To better understand each of the profiles we carried out a quantitative study of the differences between profiles regarding subthemes, contextual and personal factors, and analysed statistical significance using Fisher's exact- and Student's t-tests for categorical and continuous data, respectively. RESULTS: Four profiles of medical academics were identified, corresponding to the most central theme that each participant had reflected on: the 'Inspirer', 'Role-model', 'Practitioner', and 'Critic'. The focus of the profiles varied from external constraining factors within the 'Critic' profile to affective personal qualities within the 'Role-model' and 'Inspirer' profiles. The profiles could be regarded as hierarchically ordered by inclusiveness. Educational institute was the only significant factor related to the profiles. CONCLUSIONS: Besides the relevance of affective teacher qualities, the 'Inspirer' profile demonstrates the importance of developing a clear mission as a teaching academic, centred around student learning and professional development. In our view, academics who inspire their students continue to be inspired themselves. The practical implications are described for faculty development programmes, and for the potential value of using these profiles within medical schools. In the discourse on educational beliefs, the authors argue that more attention should be paid to affective qualities, in particular to explicating the educational mission of academics.

Patterns of direct observation and their impact during residency: general practice supervisors' views.

CONTEXT: Direct observation (DO) of residents' performance, despite the importance that is ascribed to it, does not readily fit in with the practice of postgraduate medical education (PGME); it is infrequent and the quality of observation may be poor in spite of ongoing efforts towards improvement. In recent literature, DO is mostly portrayed as a means to gather information on the performance of residents for purposes of feedback and assessment. The role of DO in PGME is likely to be more complex and poorly understood in the era of outcome-based education. By exploring the possible complexity of DO in workplace learning, our research aims to contribute to a better use of DO in the practice of PGME. METHODS: Constructivist grounded theory informed our data collection and analysis. Data collection involved focus group sessions with supervisors in Dutch general practice who were invited to discuss the manifestations, meanings and effects of DO of technical skills. Theoretical sufficiency was achieved after four focus groups, with a total of 28 participants being included. RESULTS: We found four patterns of DO of technical skills: initial planned DO sessions; resident-initiated ad hoc DO; supervisor-initiated ad hoc DO, and continued planned DO sessions. Different patterns of DO related to varying meanings, such as checking or trusting, and effects, such as learning a new skill or experiencing emotional discomfort, all of them concerning the training relationship, patient safety or residents' learning. CONCLUSIONS: Direct observation, to supervisors, means much more than gathering information for purposes of feedback and assessment. Planned DO sessions are an important routine during the initiation phase of a training relationship. Continued planned bidirectional DO sessions, although infrequently practised, potentially combine most benefits with least side-effects of DO. Ad hoc DO, although much relied upon, is often hampered by internal tensions in supervisors, residents or both.

Self-entrustment: how trainees' self-regulated learning supports participation in the workplace.

Clinical workplaces offer postgraduate trainees a wealth of opportunities to learn from experience. To promote deliberate and meaningful learning self-regulated learning skills are foundational. We explored trainees' learning activities related to patient encounters to better understand what aspects of self-regulated learning contribute to trainees' development, and to explore supervisor's role herein. We conducted a qualitative non-participant observational study in seven general practices. During two days we observed trainee's patient encounters, daily debriefing sessions and educational meetings between trainee and supervisor and interviewed them separately afterwards. Data collection and analysis were iterative and inspired by a phenomenological approach. To organise data we used networks, time-ordered matrices and codebooks. Self-regulated learning supported trainees to increasingly perform independently. They engaged in self-regulated learning before, during and after encounters. Trainees' activities depended on the type of medical problem presented and on patient, trainee and supervisor characteristics. Trainees used their sense of confidence to decide if they could manage the encounter alone or if they should consult their supervisor. They deliberately used feedback on their performance and engaged in reflection. Supervisors appeared vital in trainees' learning by reassuring trainees, discussing experience, knowledge and professional issues, identifying possible unawareness of incompetence, assessing performance and securing patient safety. Self-confidence, reflection and feedback, and support from the supervisor are important aspects of self-regulated learning in practice. The results reflect how self-regulated learning and self-entrustment promote trainees' increased participation in the workplace. Securing organized moments of interaction with supervisors is beneficial to trainees' self-regulated learning.

Stakeholder perspectives on workplace-based performance assessment: towards a better understanding of assessor behaviour.

Workplace-Based Assessment (WBA) plays a pivotal role in present-day competency-based medical curricula. Validity in WBA mainly depends on how stakeholders (e.g. clinical supervisors and learners) use the assessments-rather than on the intrinsic qualities of instruments and methods. Current research on assessment in clinical contexts seems to imply that variable behaviours during performance assessment of both assessors and learners may well reflect their respective beliefs and perspectives towards WBA. We therefore performed a Q methodological study to explore perspectives underlying stakeholders' behaviours in WBA in a postgraduate medical training program. Five different perspectives on performance assessment were extracted: Agency, Mutuality, Objectivity, Adaptivity and Accountability. These perspectives reflect both differences and similarities in stakeholder perceptions and preferences regarding the utility of WBA. In comparing and contrasting the various perspectives, we identified two key areas of disagreement, specifically 'the locus of regulation of learning' (i.e., self-regulated versus externally regulated learning) and 'the extent to which assessment should be standardised' (i.e., tailored versus standardised assessment). Differing perspectives may variously affect stakeholders' acceptance, use-and, consequently, the effectiveness-of assessment programmes. Continuous interaction between all stakeholders is essential to monitor, adapt and improve assessment practices and to stimulate the development of a shared mental model. Better understanding of underlying stakeholder perspectives could be an important step in bridging the gap between psychometric and socio-constructivist approaches in WBA.

GP supervisors' experience in supporting self-regulated learning: a balancing act.

Self-regulated learning is essential for professional development and lifelong learning. As self-regulated learning has many inaccuracies, the need to support self-regulated learning has been recommended. Supervisors can provide such support. In a prior study trainees reported on the variation in received supervisor support. This study aims at exploring supervisors' perspectives. The aim is to explore how supervisors experience self-regulated learning of postgraduate general practitioners (GP) trainees and their role in this, and what helps and hinders them in supervising. In a qualitative study using a phenomenological approach, we interviewed 20 supervisors of first- and third-year postgraduate GP trainees. Supervisors recognised trainee activity in self-regulated learning and adapted their coaching style to trainee needs, occasionally causing conflicting emotions. Supervisors' beliefs regarding their role, trainees' role and the usefulness of educational interventions influenced their support. Supervisors experienced a relation between patient safety, self-regulated learning and trainee capability to learn. Supervisor training was helpful to exchange experience and obtain advice. Supervisors found colleagues helpful in sharing supervision tasks or in calibrating judgments of trainees. Busy practice occasionally hindered the supervisory process. In conclusion, supervisors adapt their coaching to trainees' self-regulated learning, sometimes causing conflicting emotions. Patient safety and entrustment are key aspects of the supervisory process. Supervisors' beliefs about their role and trainees' role influence their support. Supervisor training is important to increase awareness of these beliefs and the influence on their behaviour, and to improve the use of educational instruments. The results align with findings from other (medical) education, thereby illustrating its relevance.

The process of feedback in workplace-based assessment: organisation, delivery, continuity.

OBJECTIVES: Feedback in workplace-based clinical settings often relies on expert trainers' judgements of directly observed trainee performance. There is ample literature on effective feedback, but in practice trainees in workplace-based training are not regularly observed. We aimed to examine external conditions that impact feedback in observational workplace-based assessment (WBA). METHODS: Interviews were conducted and the resulting data analysed using a qualitative, phenomenological approach. Between October 2009 and January 2010, we interviewed 22 postgraduate general practice trainees at two institutions in the Netherlands. Three researchers analysed the transcripts of the interviews. RESULTS: A three-step scheme emerged from the data. Feedback as part of WBA is of greater benefit to trainees if: (i) observation and feedback are planned by the trainee and trainer; (ii) the content and delivery of the feedback are adequate, and (iii) the trainee uses the feedback to guide his or her learning by linking it to learning goals. Negative emotions reported by almost all trainees in relation to observation and feedback led to different responses. Some trainees avoided observation, whereas others overcame their apprehension and actively sought observation and feedback. Active trainers were able to help trainees overcome their fears. Four types of trainer-trainee pairs were distinguished according to their engagement in observation and feedback. External requirements set by training institutions may stimulate inactive trainers and trainees. CONCLUSIONS: In line with the literature, our results emphasise the importance of the content of feedback and the way it is provided, as well as the importance of its incorporation in trainees' learning. Moreover, we highlight the step before the actual feedback itself. The way arrangements for feedback are made appears to be important to feedback in formative WBA. Finally, we outline several factors that influence the success or failure of feedback but precede the process of observation and feedback.

How do postgraduate GP trainees regulate their learning and what helps and hinders them? A qualitative study.

BACKGROUND: Self-regulation is essential for professional development. It involves monitoring of performance, identifying domains for improvement, undertaking learning activities, applying newly learned knowledge and skills and self-assessing performance. Since self-assessment alone is ineffective in identifying weaknesses, learners should seek external feedback too. Externally regulated educational interventions, like reflection, learning portfolios, assessments and progress meetings, are increasingly used to scaffold self-regulation.The aim of this study is to explore how postgraduate trainees regulate their learning in the workplace, how external regulation promotes self-regulation and which elements facilitate or impede self-regulation and learning. METHODS: In a qualitative study with a phenomenologic approach we interviewed first- and third-year GP trainees from two universities in the Netherlands. Twenty-one verbatim transcripts were coded. Through iterative discussion the researchers agreed on the interpretation of the data and saturation was reached. RESULTS: Trainees used a short and a long self-regulation loop. The short loop took one week at most and was focused on problems that were easy to resolve and needed minor learning activities. The long loop was focused on complex or recurring problems needing multiple and planned longitudinal learning activities. External assessments and formal training affected the long but not the short loop. The supervisor had a facilitating role in both loops. Self-confidence was used to gauge competence.Elements influencing self-regulation were classified into three dimensions: personal (strong motivation to become a good doctor), interpersonal (stimulation from others) and contextual (organizational and educational features). CONCLUSIONS: Trainees did purposefully self-regulate their learning. Learning in the short loop may not be visible to others. Trainees should be encouraged to actively seek and use external feedback in both loops. An important question for further research is which educational interventions might be used to scaffold learning in the short loop. Investing in supervisor quality remains important, since they are close to trainee learning in both loops.

Quality of written narrative feedback and reflection in a modified mini-clinical evaluation exercise: an observational study.

BACKGROUND: Research has shown that narrative feedback, (self) reflections and a plan to undertake and evaluate improvements are key factors for effective feedback on clinical performance. We investigated the quantity of narrative comments comprising feedback (by trainers), self-reflections (by trainees) and action plans (by trainer and trainee) entered on a mini-CEX form that was modified for use in general practice training and to encourage trainers and trainees to provide narrative comments. In view of the importance of specificity as an indicator of feedback quality, we additionally examined the specificity of the comments. METHOD: We collected and analysed modified mini-CEX forms completed by GP trainers and trainees. Since each trainee has the same trainer for the duration of one year, we used trainer-trainee pairs as the unit of analysis. We determined for all forms the frequency of the different types of narrative comments and rated their specificity on a three-point scale: specific, moderately specific, not specific. Specificity was compared between trainee-trainer pairs. RESULTS: We collected 485 completed modified mini-CEX forms from 54 trainees (mean of 8.8 forms per trainee; range 1-23; SD 5.6). Trainer feedback was more frequently provided than trainee self-reflections, and action plans were very rare. The comments were generally specific, but showed large differences between trainee-trainer pairs. CONCLUSION: The frequency of self-reflection and action plans varied, all comments were generally specific and there were substantial and consistent differences between trainee-trainer pairs in the specificity of comments. We therefore conclude that feedback is not so much determined by the instrument as by the users. Interventions to improve the educational effects of the feedback procedure should therefore focus more on the users than on the instruments.