Identifying coaching skills to improve feedback use in postgraduate medical education.

OBJECTIVES: Coaching in medical education has recently gained prominence, but minimal attention has been given to key skills and determining how they work to effectively ensure residents are progressing and developing self-assessment skills. This study examined process-oriented and content-oriented coaching skills used in coaching sessions, with particular attention to how supervisors use them to enhance resident acceptance of feedback to enhance learning. METHODS: This qualitative study analysed secondary audiotaped data from 15 supervisors: resident dyads during two feedback sessions, 4 months apart. The R2C2 model was used to engage the resident, build a relationship, explore reactions to feedback, explore resident perceptions of content, and coach for change. Framework analysis was used, including familiarisation with the data, identifying the thematic framework, indexing and charting the data and mapping and interpretation. RESULTS: Process skills included preparation, relationship development, using micro communication skills and techniques to promote reflection and self-assessment by the resident and supervisor flexibility. Content skills related to the specific feedback content included engaging the resident in discussion, ensuring the discussion was collaborative and focused on goal setting, co-developing a Learning Change Plan, ensuring resident commitment and following up on the plan. Together, these skills foster agency in the resident learner. Three overarching themes emerged from the analysis: the interconnectedness of process and content; tensions between encouraging self-direction and ensuring progress and competence; and balancing a coaching dialogue and a teaching monologue. CONCLUSIONS: Effective coaching by supervisors requires a combination of specific process and content skills that are chosen depending on the needs of the individual resident. Mastering these skills helps residents engage and develop agency in their own professional development. These outcomes depend on faculty maintaining a balance between coaching and teaching, encouraging resident self-direction and ensuring progression to competence.

Remediation in Canadian medical residency programs: Established and emerging best practices.

BACKGROUND: Policies to guide remediation in postgraduate medical education exist in all Canadian medical schools. This study examines concordance between these policies and processes, and published "best practices" in remediation. METHOD: We conducted a literature review to identify best practices in the area of remediation. We then reviewed remediation policies from all 13 English medical schools in Canada other than our own and conducted interviews with key informants from each institution. Each policy and interview transcript pair was then reviewed for evidence of pre-defined "best practices." Team members also noted additional potential policy or process enablers of successful remediation. RESULTS: Most policies and processes aligned with some but not all published best practices. For instance, all participating schools tailored remediation strategies to individual resident needs, and a majority encouraged faculty-student relationships during remediation. Conversely, few required the teaching of goal-setting, strategic planning, self-monitoring, and self-awareness. In addition, we identified avoidance of automatic training extension and the use of an educational review board to support the remediation process as enablers for success. DISCUSSION: Remediation policies and practices in Canada align well with published best practices in this area. Based on key informant opinions, flexibility to avoid training extension and use of an educational review board may also support optimal remediation outcomes.

CPD of the future: a partnership between quality improvement and competency-based education.

CONTEXT: Many of those involved in continuing professional development (CPD) over the past 10 years have engaged in discussions about its goals and activities. Whereas in the past CPD was viewed as an education intervention directed towards the medical expert role, recent research highlights the need to expand the scope of CPD and to promote its more explicit role in improving patient care and health outcomes. Recent developments in quality improvement (QI) and competency-based medical education (CBME), guided by appropriate theories of learning and change, can shed light on how the field might best advance. This paper describes principles of QI and CBME and how they might contribute to CPD, explores theoretical perspectives that inform such an integration and suggests a future model of CPD. DISCUSSION: Continuing professional development seeks to improve patient outcomes by increasing physician knowledge and skills and changing behaviours, whereas QI takes the approach of system and process change. Combining the strengths of a CPD approach with strategies known to be effective from the field of QI has the potential to harmonise the contributions of each, and thereby to lead to better patient outcomes. Similarly, competency-based CPD is envisioned to place health needs and patient outcomes at the centre of a CPD system that will be guided by a set of competencies to enhance the quality of practice and the safety of the health system. CONCLUSIONS: We propose that the future CPD system should adhere to the following principles: it should be grounded in the everyday workplace, integrated into the health care system, oriented to patient outcomes, guided by multiple sources of performance and outcome data, and team-based; it should employ the principles and strategies of QI, and should be taken on as a collective responsibility by physicians, CPD provider organisations, regulators and the health system.

Where is the client/patient voice in interprofessional healthcare team assessments? Findings from a one-day forum.

There is a growing interest in interprofessional care (IPC) as a way to provide better healthcare. However, it is difficult to evaluate this mode of healthcare delivery because identifying the appropriate measurement tool is a challenge, given the wide diversity in team composition and settings. Adding to this complexity is a key gap in the IPC evaluation research: the client/patient perspective. This perspective has generally not been included in the development of IPC healthcare team evaluations. The authors received a Canadian Institute for Health Research Planning Grant to host a one-day forum with 24 participants from across Canada representing health professions such as social work, medicine, occupational therapy, and physical therapy, in addition to researchers, client/patient advocates, and hospital administrators. The overarching goal of the forum was to create a demonstration project that supports the development of an IPC assessment tool for healthcare teams that includes clients/patients. Using a concept mapping methodology, participants discussed client/patient inclusion in IPC assessments, and through a consensus process, chose a demonstration project for further development.

Safer obstetric anesthesia through education and mentorship: a model for knowledge translation in Rwanda.

High rates of maternal mortality remain a widespread problem in the developing world. Skilled anesthesia providers are required for the safe conduct of Cesarean delivery and resuscitation during obstetrical crises. Few anesthesia providers in low-resource settings have access to continuing education. In Rwanda, anesthesia technicians with only three years of post-secondary training must manage complex maternal emergencies in geographically isolated areas. The purpose of this special article is to describe implementation of the SAFE (Safer Anesthesia From Education) Obstetric Anesthesia course in Rwanda, a three-day refresher course designed to improve obstetrical anesthesia knowledge and skills for practitioners in low-resource areas. In addition, we describe how the course facilitated the knowledge-to-action (KTA) cycle whereby a series of steps are followed to promote the uptake of new knowledge into clinical practice. The KTA cycle requires locally relevant teaching interventions and continuation of knowledge post intervention. In Rwanda, this meant carefully considering educational needs, revising curricula to suit the local context, employing active experiential learning during the SAFE Obstetric Anesthesia course, encouraging supportive relationships with peers and mentors, and using participant action plans for change, post-course logbooks, and follow-up interviews with participants six months after the course. During those interviews, participants reported improvements in clinical practice and greater confidence in coordinating team activities. Anesthesia safety remains challenged by resource limitations and resistance to change by health care providers who did not attend the course. Future teaching interventions will address the need for team training.

Understanding, teaching and assessing the elements of the CanMEDS Professional Role: canadian program directors' views.

BACKGROUND: Physicians are required to maintain and sustain professional roles during their careers, making the Professional Role an important component of postgraduate education. Despite this, this role remains difficult to define, teach and assess. OBJECTIVE: To (a) understand what program directors felt were key elements of the CanMEDS Professional Role and (b) identify the teaching and assessment methods they used. METHODS: A two-step sequential mixed method design using a survey and semi-structured interviews with Canadian program directors. RESULTS: Forty-six program directors (48% response rate) completed the questionnaire and 10 participated in interviews. Participants rated integrity and honesty as the most important elements of the Role (96%) but most difficult to teach. There was a lack of congruence between elements perceived to be most important and most frequently taught. Role modeling was the most common way of informally teaching professionalism (98%). Assessments were most often through direct feedback from faculty (98%) and feedback from other health professionals and residents (61%). Portfolios (24%) were the least used form of assessment, but they allowed residents to reflect and stimulated self-assessment. CONCLUSION: Program directors believe elements of the Role are difficult to teach and assess. Providing faculty with skills for teaching/assessing the Role and evaluating effectiveness in changing attitudes/behaviors should be a priority in postgraduate programs.

Debriefing Methods for Simulation in Healthcare: A Systematic Review.

ABSTRACT: Debriefing is a critical component in most simulation experiences. With the growing number of debriefing concepts, approaches, and tools, we need to understand how to debrief most effectively because there is little empiric evidence to guide us in their use. This systematic review explores the current literature on debriefing in healthcare simulation education to understand the evidence behind practice and clarify gaps in the literature. The PICO question for this review was defined as "In healthcare providers [P], does the use of one debriefing or feedback intervention [I], compared to a different debriefing or feedback intervention [C], improve educational and clinical outcomes [O] in simulation-based education?" We included 70 studies in our final review and found that our current debriefing strategies, frameworks, and techniques are not based on robust empirical evidence. Based on this, we highlight future research needs.

Positioning continuing education: boundaries and intersections between the domains continuing education, knowledge translation, patient safety and quality improvement.

Public and professional concern about health care quality, safety and efficiency is growing. Continuing education, knowledge translation, patient safety and quality improvement have made concerted efforts to address these issues. However, a coordinated and integrated effort across these domains is lacking. This article explores and discusses the similarities and differences amongst the four domains in relation to their missions, stakeholders, methods, and limitations. This paper highlights the potential for a more integrated and collaborative partnership to promote networking and information sharing amongst the four domains. This potential rests on the premise that an integrated approach may result in the development and implementation of more holistic and effective interdisciplinary interventions. In conclusion, an outline of current research that is informed by the preliminary findings in this paper is also briefly discussed. The research concerns a comprehensive mapping of the relationships between the domains to gain an understanding of potential dissonances between how the domains represent themselves, their work and the work of their 'partner' domains.

Encouraging residents to seek feedback.

AIM: To explore resident and faculty perceptions of the feedback process, especially residents' feedback-seeking activities. METHODS: We conducted focus groups of faculty and residents exploring experiences in giving and receiving feedback, feedback-seeking, and suggestions to support feedback-seeking. Using qualitative methods and an iterative process, all authors analyzed the transcribed audiotapes to identify and confirm themes. RESULTS: Emerging themes fit a framework situating resident feedback-seeking as dependent on four central factors: (1) learning/workplace culture, (2) relationships, (3) purpose/quality of feedback, (4) emotional responses to feedback. Residents and faculty agreed on many supports and barriers to feedback-seeking. Strengthening the workplace/learning culture through longitudinal experiences, use of feedback forms and explicit expectations for residents to seek feedback, coupled with providing a sense of safety and adequate time for observation and providing feedback were suggested. Tensions between faculty and resident perceptions regarding feedback-seeking related to fear of being found deficient, the emotional costs related to corrective feedback and perceptions that completing clinical work is more valued than learning. CONCLUSION: Resident feedback-seeking is influenced by multiple factors requiring attention to both faculty and learner roles. Further study of specific influences and strategies to mitigate the tensions will inform how best to support residents in seeking feedback.

Application of the R2C2 Model to In-the-Moment Feedback and Coaching.

PURPOSE: The R2C2 (relationship, reaction, content, coaching) model is an iterative, evidence-based, theory-informed approach to feedback and coaching that enables preceptors and learners to build relationships, explore reactions and reflections, confirm content, and coach for change and cocreate an action plan. This study explored application of the R2C2 model for in-the-moment feedback conversations between preceptors and learners and the factors that influence its use. METHOD: A qualitative study using framework analysis through the lens of experiential learning was undertaken with 15 trained preceptor-learner dyads. Data were collected during feedback sessions and follow-up interviews between March 2021 and July 2022. The research team familiarized themselves with the data, used a coding template to document examples of the model's application, reviewed the initial framework and revised the coding template, indexed and summarized the data, created a summary document, examined the transcripts for alignment with each model phase, and identified illustrative quotations and overarching themes. RESULTS: Fifteen dyads were recruited from 8 disciplines (11 preceptors were paired with a single resident [n = 9] or a single medical student [n = 2]; 2 preceptors each had 2 residents). All dyads were able to apply the R2C2 phases of building relationships, exploring reactions and reflections, and confirming content. Many struggled with the coaching components, specifically in creating an action plan and follow-up arrangements. Preceptor skill in applying the model, time available for feedback conversations, and the nature of the relationship impacted how the model was applied. CONCLUSIONS: The R2C2 model can be adapted to contexts where in-the-moment feedback conversations occur shortly after a clinical encounter. Experiential learning approaches applying the R2C2 model are critical. Skillful application of the model requires that learners and preceptors go beyond confirming an area of change and deliberately engage in coaching and cocreating an action plan.

Maturational differences in undergraduate medical students' perceptions about feedback.

CONTEXT: Although medical students receive varied feedback throughout their training programmes, research demonstrates that they frequently perceive it as insufficient. However, supervisors tend to perceive that it is adequate. Students' responses to, and use of, feedback are not clearly understood. The purposes of this study were to investigate how medical students recognise, respond to and utilise feedback, and to determine whether there are maturational differences in understandings of the role of feedback across academic years in medical school. METHODS: This was a mixed-methods study collecting qualitative (focus group and open-ended questionnaire items) and quantitative (questionnaire) data across the 5 years of an undergraduate programme. RESULTS: A total of 68 students participated in 10 focus groups. The questionnaire response rate was 46% (564/1233). Data analysis investigated the students' perceptions of feedback and explored patterns of responses across the continuum of undergraduate medical school stages. Maturational differences among the year cohorts within the programme emerged in three general areas: (i) student perceptions of the purpose of feedback; (ii) student recognition of feedback, and (iii) student perceptions regarding the credibility of feedback providers. CONCLUSIONS: Junior students generally perceived the receiving of feedback as a passive activity and preferred positive feedback that confirmed their progress and provided reassurance. More senior students viewed feedback as informing their specific learning needs and personal development. They valued immediate informal verbal feedback and feedback from peers and others, as well as that from senior teachers. Exploring students' progressive degrees of engagement with feedback and its relationship with self-esteem are subjects for further study.

Towards a sociology of knowledge translation: the importance of being dis-interested in knowledge translation.

Over the last 15 years there has been an increasingly energetic search for theories and definitions in the burgeoning area of knowledge translation (KT) in the health care context. The focus has been on the design and evaluation of KT activities with little attention to developing a considered KT theoretical/methodological approach that takes a more distanced critical inquiry to the studying of KT interventions. As such, what has been overlooked in the health professions KT literature to date is a suitably complex conceptualisation of translation that encompasses the multiplicity of KT interventions, the dynamic environments in which they are occurring, and the production of new knowledge which arises from their interactions. Attending to these epistemological issues; i.e. issues of the type of knowledge and how it is produced, is crucial to developing a relational understanding of the production and emergence of context-specific clinical knowledge and practice in KT processes. Such an approach is compared to the traditional KT evaluations by KT practitioners themselves of the compliance or non-compliance of individual and organisational behaviour change. A Sociology of KT (SKT) is proposed to complement the applied and evaluative research practice of implementing planned action KT activities. The purpose of a SKT basic research agenda is to understand both the context-specific nature of KT interventions and the epistemological premises of the activities of KT implementers themselves, in order to advance the science of KT and inform, complement and add to the success of applied and evaluative KT research in the future.

Factors influencing responsiveness to feedback: on the interplay between fear, confidence, and reasoning processes.

Self-appraisal has repeatedly been shown to be inadequate as a mechanism for performance improvement. This has placed greater emphasis on understanding the processes through which self-perception and external feedback interact to influence professional development. As feedback is inevitably interpreted through the lens of one's self-perceptions it is important to understand how learners interpret, accept, and use feedback (or not) and the factors that influence those interpretations. 134 participants from 8 health professional training/continuing competence programs were recruited to participate in focus groups. Analyses were designed to (a) elicit understandings of the processes used by learners and physicians to interpret, accept and use (or not) data to inform their perceptions of their clinical performance, and (b) further understand the factors (internal and external) believed to influence interpretation of feedback. Multiple influences appear to impact upon the interpretation and uptake of feedback. These include confidence, experience, and fear of not appearing knowledgeable. Importantly, however, each could have a paradoxical effect of both increasing and decreasing receptivity. Less prevalent but nonetheless important themes suggested mechanisms through which cognitive reasoning processes might impede growth from formative feedback. Many studies have examined the effectiveness of feedback through variable interventions focused on feedback delivery. This study suggests that it is equally important to consider feedback from the perspective of how it is received. The interplay observed between fear, confidence, and reasoning processes reinforces the notion that there is no simple recipe for the delivery of effective feedback. These factors should be taken into account when trying to understand (a) why self-appraisal can be flawed, (b) why appropriate external feedback is vital (yet can be ineffective), and (c) why we may need to disentangle the goals of performance improvement from the goals of improving self-assessment.

Multisource feedback: an overview of its use and application as a formative assessment.

Multisource feedback (MSF), often termed 360-degree feedback, is a formative performance assessment in which data about an individual's observable workplace behaviors are collected through questionnaires from those interacting with the individual; data are aggregated for anonymity and confidentiality; the aggregated data, along with self-assessment if available, are provided to the individual; and the recipient meets with a trusted individual to review the data and develop an action plan. It is used along the continuum of medical education. This article provides an overview of MSF's utility, its evidence base and cautions.

La rétroaction multisource (RMS), ou rétroaction 360 degrés, est une évaluation formative du rendement dans laquelle des informations sur les comportements observables d'un individu dans son lieu de travail sont recueillies par le biais de questionnaires auprès de ceux avec qui il interagit. Après avoir été agrégées pour garantir l'anonymat et la confidentialité, ces données, et l'auto-évaluation s'il y a lieu, sont remises à la personne évaluée. Accompagnée d'une personne de confiance, elle les examinera et élaborera un plan d'action, qui sera utilisé tout au long du continuum de sa formation médicale. Cet article présente un aperçu de l'utilité et des fondements de la RMS, ainsi que quelques mises en garde.

Features of assessment learners use to make informed self-assessments of clinical performance.

CONTEXT: Conceptualisations of self-assessment are changing as its role in professional development comes to be viewed more broadly as needing to be both externally and internally informed through activities that enable access to and the interpretation and integration of data from external sources. Education programmes use various activities to promote learners' reflection and self-direction, yet we know little about how effective these activities are in 'informing' learners' self-assessments. OBJECTIVES: This study aimed to increase understanding of the specific ways in which undergraduate and postgraduate learners used learning and assessment activities to inform self-assessments of their clinical performance. METHODS: We conducted an international qualitative study using focus groups and drawing on principles of grounded theory. We recruited volunteer participants from three undergraduate and two postgraduate programmes using structured self-assessment activities (e.g. portfolios). We asked learners to describe their perceptions of and experiences with formal and informal activities intended to inform self-assessment. We conducted analysis as a team using a constant comparative process. RESULTS: Eighty-five learners (53 undergraduate, 32 postgraduate) participated in 10 focus groups. Two main findings emerged. Firstly, the perceived effectiveness of formal and informal assessment activities in informing self-assessment appeared to be both person- and context-specific. No curricular activities were considered to be generally effective or ineffective. However, the availability of high-quality performance data and standards was thought to increase the effectiveness of an activity in informing self-assessment. Secondly, the fostering and informing of self-assessment was believed to require credible and engaged supervisors. CONCLUSIONS: Several contextual and personal conditions consistently influenced learners' perceptions of the extent to which assessment activities were useful in informing self-assessments of performance. Although learners are not guaranteed to be accurate in their perceptions of which factors influence their efforts to improve performance, their perceptions must be taken into account; assessment strategies that are perceived as providing untrustworthy information can be anticipated to have negligible impact.

Providing feedback: exploring a model (emotion, content, outcomes) for facilitating multisource feedback.

BACKGROUND: Multi-source feedback (MSF) aims to raise self-awareness of performance and encourage improvement. The ECO model (emotions, content, outcome) is a three-step process developed from the counselling literature to facilitate feedback acceptance and use in MSF. AIMS: The purpose of this study was to explore the acceptability, usefulness and educational impact of the model. METHODS: This was a qualitative study using interviews to explore general practice (GP) trainer and trainee experiences and perceptions of the ECO facilitation model. Interviews were conducted by telephone, recorded, transcribed and analysed using a thematic framework. RESULTS: About 13 GP trainers and trainees participated in the interviews following their MSF discussions using the ECO model. They agreed that the model was useful, simple to use and engaged trainees in reflection upon their feedback and performance. Exploring emotions and clarifying content appeared integral to accepting and using the feedback. Positive feedback was often surprising. Most trainees reported performance improvements following their MSF-ECO session. CONCLUSIONS: The model appeared acceptable and simple to use. Engaging the learner as a partner in the feedback discussion appeared effective. Further research is needed to fully understand the influence of each step in facilitating MSF acceptance and use, and to determine the impact of the ECO model alone upon performance outcomes compared to more traditional provision of MSF feedback.

Feedback data sources that inform physician self-assessment.

BACKGROUND: Self-assessment is a process of interpreting data about one's performance and comparing it to explicit or implicit standards. AIM: To examine the external data sources physicians used to monitor themselves. METHODS: Focus groups were conducted with physicians who participated in three practice improvement activities: a multisource feedback program; a program providing patient and chart audit data; and practice-based learning groups. We used grounded theory strategies to understand the external sources that stimulated self-assessment and how they worked. RESULTS: Data from seven focus groups (49 physicians) were analyzed. Physicians used information from structured programs, other educational activities, professional colleagues, and patients. Data were of varying quality, often from non-formal sources with implicit (not explicit) standards. Mandatory programs elicited variable responses, whereas data and activities the physicians selected themselves were more likely to be accepted. Physicians used the information to create a reference point against which they could weigh their performance using it variably depending on their personal interpretation of its accuracy, application, and utility. CONCLUSIONS: Physicians use and interpret data and standards of varying quality to inform self-assessment. Physicians may benefit from regular and routine feedback and guidance on how to seek out data for self-assessment.

Learning Conversations: An Analysis of the Theoretical Roots and Their Manifestations of Feedback and Debriefing in Medical Education.

Feedback and debriefing are experience-informed dialogues upon which experiential models of learning often depend. Efforts to understand each have largely been independent of each other, thus splitting them into potentially problematic and less productive factions. Given their shared purpose of improving future performance, the authors asked whether efforts to understand these dialogues are, for theoretical and pragmatic reasons, best advanced by keeping these concepts unique or whether some unifying conceptual framework could better support educational contributions and advancements in medical education.The authors identified seminal works and foundational concepts to formulate a purposeful review and analysis exploring these dialogues' theoretical roots and their manifestations. They considered conceptual and theoretical details within and across feedback and debriefing literatures and traced developmental paths to discover underlying and foundational conceptual approaches and theoretical similarities and differences.Findings suggest that each of these strategies was derived from distinct theoretical roots, leading to variations in how they have been studied, advanced, and enacted; both now draw on multiple (often similar) educational theories, also positioning themselves as ways of operationalizing similar educational frameworks. Considerable commonality now exists; those studying and advancing feedback and debriefing are leveraging similar cognitive and social theories to refine and structure their approaches. As such, there may be room to merge these educational strategies as learning conversations because of their conceptual and theoretical consistency. Future scholarly work should further delineate the theoretical, educational, and practical relevance of integrating feedback and debriefing.

In-the-Moment Feedback and Coaching: Improving R2C2 for a New Context.

BACKGROUND: The R2C2, a 4-phase feedback and coaching model, builds relationships, explores reactions, determines content and coaches for change, and facilitates formal feedback conversations between clinical supervisors/preceptors and residents. Formal discussions about performance are typically based on collated information from daily encounter sheets, objective structured clinical examinations, multisource feedback, and other data. This model has not been studied in settings where brief feedback and coaching conversations occur immediately after a specific clinical experience. OBJECTIVE: We explored how supervisors adapt the R2C2 model for in-the-moment feedback and coaching and developed a guide for its use in this context. METHODS: Eleven purposefully selected supervisors were interviewed in 2018 to explore where they used the R2C2 model, how they adapted it for in-the-moment conversations, and phrases used corresponding to each phase that could guide design of a new R2C2 in-the-moment model. RESULTS: Participants readily adapted the model to varied feedback situations; each of the 4 phases were relevant for conversations. Phase-specific phrases that could enable effective coaching conversations in a limited amount of time were identified. Data facilitated a revision of the original R2C2 model for in-the-moment feedback and coaching conversations and design of an accompanying trifold brochure to enable its effective use. CONCLUSIONS: The R2C2 in-the-moment model offers a systematic approach to feedback and coaching that builds on the original model, yet addresses time constraints and the need for an iterative conversation between the reaction and content phases. The model enables supervisors to coach and co-create an action plan with residents to improve performance.

Reflection: a link between receiving and using assessment feedback.

PROBLEM STATEMENT AND BACKGROUND: Feedback is essential to learning and practice improvement, yet challenging both to provide and receive. The purpose of this paper was to explore reflective processes which physicians described as they considered their assessment feedback and the perceived utility of that reflective process. METHODS: This is a qualitative study using principles of grounded theory. We conducted interviews with 28 family physicians participating in a multi-source feedback program and receiving scores across the spectrum from high to low. RESULTS: Feedback, especially negative feedback, evoked reflective responses. Reflection seemed to be the process through which feedback was or was not assimilated and appeared integral to decisions to accept and use the feedback. Facilitated reflection upon feedback was viewed as a positive influence for assimilation and acceptance. CONCLUSIONS: Receiving feedback inconsistent with self-perceptions stimulated physicians' reflective processes. The process of reflection appeared instrumental to feedback acceptance and use, suggesting that reflection may be an important educational focus in the formative assessment and feedback process.