Exploring the development of interprofessional competence and professional identity: A Situated Learning Theory study.

Workplace-based learning provides medical students exposure to interprofessional competencies through repeated exposures and active participation in interprofessional learning activities. Using Situated Learning Theory as our theoretical lens, we explored with medical students how interacting with existing interprofessional teams contributes to development of an expanded health care professional identity. An embedded mixed methods study using semi-structured interviews and questionnaires to assess readiness for interprofessional learning was conducted with 14 medical students completing an elective at an interprofessional pain medicine clinic. Within this workplace-based context, a model identifying key themes and supporting factors contributing to the development of an extended professional identity was developed. These findings help describe the processes by which students gain interprofessional collaboration competence.

Approaches to interpersonal conflict in simulation debriefings: A qualitative study.

CONTEXT: Conflict during simulation debriefing can interfere with learning when psychological safety is threatened. Debriefers often feel unprepared to address conflict between learners and the literature does not provide evidence-based guidance within the simulation setting. The purpose of this study was to describe debriefers' approach to mediating interpersonal conflict and explore when, why and how they adopt mediation strategies. METHODS: We performed a secondary analysis of qualitative data collected as part of a larger study examining simulation debriefers' approaches to debriefing scenarios with different learner characteristics. For this study, we applied thematic analysis to transcripts from simulated debriefings (n = 10) and the associated pre-simulation (n = 11) and post-simulation (n = 10) interviews that focused on interpersonal conflict between learners. RESULTS: Debriefers described struggling with mediating conflict and the importance of self-awareness. Specific mediation strategies included intervening, addressing power relations, reconciling unproductive differences, leveraging different perspectives, circumventing the conflict, and shifting beyond the conflict; each of these strategies encompassed a number of particular skills. Situations that triggered a mediation approach were related to psychological safety, emotional intensity, and opportunities for shared understanding and productive learning. Debriefers applied mediation strategies and skills in a flexible and creative way. CONCLUSIONS: The strategies we have described for mediating interpersonal conflict between learners in simulation debriefing align with notions of psychological safety and may be useful in guiding future professional development for simulation educators.

In Our Own Time: Medical Students' Informal Social Studying and Learning.

Phenomenon: Social studying and learning (SSL) is any independent, elective, self-directed and self-organized approach to learning that involves students working with their peers for the purposes of study, learning, or revision. While in-class collaborative learning has been relatively well-explored, very little is known about how medical students engage in informal SSL or about the impacts it can have. The purpose of this study was to explore medical students' practices and perceptions regarding SSL, and the ways in which this shaped their overall learning experiences. Approach: A constructivist grounded theory study was conducted at the University of Calgary. Data were collected from 23 semi-structured student interviews, which were audio recorded and transcribed. Data were analyzed using iterative data collection, memo-ing, and focused coding. Findings: Despite SSL being a common part of students' medical school experience and something that was promoted by academic advisors, how students actually engaged with SSL varied substantially, including who made use of SSL, how they made use of it, the size and focus of SSL groups, how these groups functioned, and what individuals sought to get out of them. Some students found SSL helped them to be more efficient and focused in their studying, while others benefited from comparing their knowledge and skills with those of their peers. Not everyone benefited, as some students found SSL stressful, unproductive, or socially uncomfortable. While student engagement in SSL was an enabler of academic success for some it could also be an indicator of social isolation and low self-esteem for others. Insights: Understanding how SSL can influence student experiences has the potential to inform students how and why they might engage in SSL, and it can help educators better support their students, particularly in those schools that actively encourage SSL.

An evaluation of Acute Care of at-Risk Newborns (ACoRN), a Canadian education program, in Chinese neonatal nurseries.

BACKGROUND: The Acute Care of at-Risk Newborns (ACoRN) program was developed in Canada to train health care providers in the identification and management of newborns who are at-risk and/or become unwell after birth. The ACoRN process follows a stepwise framework that enables evaluation, decision, and action irrespective of caregiver experience. This study examined the hypothesis that the ACoRN educational program improved clinical practices and outcomes in China. METHODS: In a before-and-after study, ACoRN training was provided to physicians, neonatal nurses, and administrators in 16 county hospitals in Zhejiang, PRC. Demographic and clinical data were collected on babies admitted to neonatal units before (May 1, 2008 to March 31, 2009) and after (June 1, 2010 to April 30, 2012) training. RESULTS: A total of 4,310 babies (1,865 pre- and 2,445 post-training) from 14 sites were included. There were more in-hospital births (97.8% versus 95.6%, P<0.01) in the post-training epoch, fewer babies needing resuscitation (12.7% versus 16.0%, P=0.02), and more babies finishing their care in hospital (67.4% versus 53.1%, P<0.0001). After training, significantly more babies were evaluated as having respiratory distress at admission (14.2% versus 9.4%, P<0.0001); more babies had saturation, glucose and temperature measured on admission and at discharge; and more babies received intravenous fluids (86.3% versus 72.8%, P<0.0001). No significant improvements were noted in mortality (0.49% [post] versus 0.8% [pre], P=0.19 and adjusted odds ratio 0.54, 95% confidence interval: 0.23 to 1.29). CONCLUSIONS: ACoRN training significantly increased patient evaluations and changed clinical practices. However, we were unable to ascertain improvement in morbidity or mortality.

Identifying coaching skills to improve feedback use in postgraduate medical education.

OBJECTIVES: Coaching in medical education has recently gained prominence, but minimal attention has been given to key skills and determining how they work to effectively ensure residents are progressing and developing self-assessment skills. This study examined process-oriented and content-oriented coaching skills used in coaching sessions, with particular attention to how supervisors use them to enhance resident acceptance of feedback to enhance learning. METHODS: This qualitative study analysed secondary audiotaped data from 15 supervisors: resident dyads during two feedback sessions, 4 months apart. The R2C2 model was used to engage the resident, build a relationship, explore reactions to feedback, explore resident perceptions of content, and coach for change. Framework analysis was used, including familiarisation with the data, identifying the thematic framework, indexing and charting the data and mapping and interpretation. RESULTS: Process skills included preparation, relationship development, using micro communication skills and techniques to promote reflection and self-assessment by the resident and supervisor flexibility. Content skills related to the specific feedback content included engaging the resident in discussion, ensuring the discussion was collaborative and focused on goal setting, co-developing a Learning Change Plan, ensuring resident commitment and following up on the plan. Together, these skills foster agency in the resident learner. Three overarching themes emerged from the analysis: the interconnectedness of process and content; tensions between encouraging self-direction and ensuring progress and competence; and balancing a coaching dialogue and a teaching monologue. CONCLUSIONS: Effective coaching by supervisors requires a combination of specific process and content skills that are chosen depending on the needs of the individual resident. Mastering these skills helps residents engage and develop agency in their own professional development. These outcomes depend on faculty maintaining a balance between coaching and teaching, encouraging resident self-direction and ensuring progression to competence.

Exploring anesthesiologists' understanding of situational awareness: a qualitative study.

PURPOSE: This study explored how anesthesiologists understand situational awareness (SA) and how they think SA is learned, taught, and assessed. METHODS: Semi-structured interviews were performed with practicing anesthesiologists involved in teaching. This qualitative study was conducted using constructivist grounded theory techniques (i.e., line-by-line coding, memoing, and constant comparison) in a thematic analysis of interview transcripts. Group meetings were held to develop and review themes emerging from the data. RESULTS: Eighteen anesthesiologists were interviewed. Respondents displayed an understanding of SA using a mixture of examples from clinical experience and everyday life. Despite agreeing on the importance of SA, formal definitions of SA were lacking, and the participants did not explicate the topic of SA in either their practice or their teaching activities. Situational awareness had been learned informally through increasing independence in the clinical context, role modelling, reflection on errors, and formally through simulation. Respondents taught SA through modelling and discussing scanning behaviour, checklists, verbalization of thought processes, and debriefings. Although trainees' understanding of SA was assessed as part of the decision-making process for granting clinical independence, respondents found it difficult to give meaningful feedback on SA to their trainees. CONCLUSION: Although SA is an essential concept in anesthesiology, its use remains rather tacit, primarily due to the lack of a common operational definition of the term. Faculty development is required to help anesthesiologists teach and assess SA more explicitly in the clinical environment.

Competency-based medical education and continuing professional development: A conceptualization for change.

Competency-based medical education (CBME) is as important in continuing professional development (CPD) as at any other stage of a physician's career. Principles of CBME have the potential to revolutionize CPD. Transitioning to CBME-based CPD will require a cultural change to gain commitment from physicians, their employers and institutions, CPD providers, professional organizations, and medical regulators. It will require learning to be aligned with professional and workplace standards. Practitioners will need to develop the expertise to systematically examine their own clinical performance data, identify performance improvement opportunities and possibilities, and develop a plan to address areas of concern. Health care facilities and systems will need to produce data on a regular basis and to develop and train CPD educators who can work with physician groups. Stakeholders, such as medical regulatory authorities who are responsible for licensing physicians and other standard-setting bodies that credential and develop maintenance-of-certification systems, will need to change their paradigm of competency enhancement through CPD.

Core principles of assessment in competency-based medical education.

The meaningful assessment of competence is critical for the implementation of effective competency-based medical education (CBME). Timely ongoing assessments are needed along with comprehensive periodic reviews to ensure that trainees continue to progress. New approaches are needed to optimize the use of multiple assessors and assessments; to synthesize the data collected from multiple assessors and multiple types of assessments; to develop faculty competence in assessment; and to ensure that relationships between the givers and receivers of feedback are appropriate. This paper describes the core principles of assessment for learning and assessment of learning. It addresses several ways to ensure the effectiveness of assessment programs, including using the right combination of assessment methods and conducting careful assessor selection and training. It provides a reconceptualization of the role of psychometrics and articulates the importance of a group process in determining trainees' progress. In addition, it notes that, to reach its potential as a driver in trainee development, quality care, and patient safety, CBME requires effective information management and documentation as well as ongoing consideration of ways to improve the assessment system.

Toward a research agenda for competency-based medical education.

Competency-based medical education (CBME) is both an educational philosophy and an approach to educational design. CBME has already had a broad impact on medical schools, residency programs, and continuing professional development in health professions around the world. As the CBME movement evolves and CBME programs are implemented, a wide range of emerging research questions will warrant scholarly examination. In this paper, we describe a proposed CBME research agenda developed by the International CBME Collaborators. The resulting framework includes questions about the meaning of key concepts of CBME and their implications for learners, faculty members, and institutional structures. Other research questions relate to the learning process, the meaning of entrustment decisions, fundamental measurement issues, and the nature and definition of standards. The exploration of these questions will help to solidify the theoretical foundation of CBME, but many issues related to implementation also need to be addressed. These pertain to, among other things, nurturing independent learning, assembling and using assessment results to make decisions about competence, structuring feedback, supporting remediation, and how best to evaluate the longer-term outcomes of CBME. High-quality research on these questions will require rigorous outcome measures with strong validity evidence. The complexity of CBME necessitates theoretical and methodological diversity. It also requires multi-institutional studies that examine effects at multiple levels, from the learner to the team, the institution, and the health care system. Such a framework of research questions can guide and facilitate scholarly discourse on the theoretical and practical body of knowledge related to competency-based health professions education.

Focused Critical Care Echocardiography: Development and Evaluation of an Image Acquisition Assessment Tool.

OBJECTIVES: Little attention has been placed on assessment tools to evaluate image acquisition quality for focused critical care echocardiography. We designed a novel assessment tool to objectively evaluate the image acquisition skills of critical care trainees learning focused critical care echocardiography and examined the tool for evidence of validity. DESIGN: Prospective observational study. SETTING: Medical-surgical ICUs at a tertiary care teaching hospital. SUBJECTS: Trainees in our critical care medicine fellowship program. INTERVENTIONS: Six trainees completed a focused critical care echocardiography training curriculum followed by performing 20 transthoracic echocardiograms on patients receiving invasive mechanical ventilation. At three assessment intervals (the 1st and 2nd examinations, 10th and 11th examinations, and 19th and 20th examinations), echocardiograms performed by trainees were compared with those of critical care physicians certified in echocardiography and scored according to the focused critical care echocardiography assessment tool. The primary outcome was an efficiency score (overall assessment tool score divided by examination time). Differences in mean efficiency scores between echocardiographers of differing skill levels and changes in trainees' mean efficiency scores with increasing focused critical care echocardiography experience were compared by using t tests. MEASUREMENTS AND MAIN RESULTS: On the initial assessment, mean efficiency scores (SD) for trainees and experienced physicians were 1.55 (0.95) versus 2.78 (1.38), respectively (p = 0.02), and for the second and third assessments, the corresponding efficiency ratings for trainees and experienced physicians were 2.48 (0.97) versus 4.55 (1.32) (p < 0.01) and 2.61 (1.37) versus 4.17 (2.12) (p = 0.04), respectively. CONCLUSIONS: Trainees' efficiency in focused critical care echocardiography image acquisition improved quickly in the first 10 studies, yet, it could not match with the performance of experienced physicians after 20 focused critical care echocardiography studies. The focused critical care echocardiography assessment tool demonstrated evidence of validity and could discern changes in trainees' image acquisition performance with increasing experience.

An exploration of contextual dimensions impacting goals of care conversations in postgraduate medical education.

BACKGROUND: Postgraduate medical trainees are not well prepared difficult conversations about goals of care with patients and families in the acute care clinical setting. While contextual nuances within the workplace can impact communication, research to date has largely focused on individual communication skills. Our objective was to explore contextual factors that influence conversations between trainees and patients/families about goals of care in the acute care setting. METHODS: We conducted an exploratory qualitative study involving five focus groups with Internal Medicine trainees (n = 20) and a series of interviews with clinical faculty (n = 11) within a single Canadian centre. Thematic framework analysis was applied to categorize the data and identify themes and subthemes. RESULTS: Challenges and factors enabling goals of care conversations emerged within individual, interpersonal and system dimensions. Challenges included inadequate preparation for these conversations, disconnection between trainees, faculty and patients, policies around documentation, the structure of postgraduate medical education, and resource limitations; these challenges led to missed opportunities, uncertainty and emotional distress. Enabling factors were awareness of the importance of goals of care conversations, support in these discussions, collaboration with colleagues, and educational initiatives enabling skill development; these factors have resulted in learning, appreciation, and an established foundation for future educational initiatives. CONCLUSIONS: Contextual factors impact how postgraduate medical trainees communicate with patients/families about goals of care. Attention to individual, interpersonal and system-related factors will be important in designing educational programs that help trainees develop the capacities needed for challenging conversations.

Clinical teaching as part of continuing professional development: Does teaching enhance clinical performance?

INTRODUCTION: Physicians identify teaching as a factor that enhances performance, although existing data to support this relationship is limited. PURPOSE: To determine whether there were differences in clinical performance scores as assessed through multisource feedback (MSF) data based on clinical teaching. METHODS: MSF data for 1831 family physicians, 1510 medical specialists, and 542 surgeons were collected from physicians' medical colleagues, co-workers (e.g., nurses and pharmacists), and patients and examined in relation to information about physician teaching activities including percentage of time spent teaching during patient care and academic appointment. Multivariate analysis of variance, partial eta squared effect sizes, and Tukey's HSD post hoc comparisons were used to determine between group differences in total MSF mean and subscale mean performance scores by teaching and academic appointment data. RESULTS: Higher clinical performance scores were associated with holding any academic appointment and generally with any time teaching versus no teaching during patient care. This was most evident for data from medical colleagues, where these differences existed across all specialty groups. CONCLUSION: More involvement in teaching was associated with higher clinical performance ratings from medical colleagues and co-workers. These results may support promoting teaching as a method to enhance and maintain high-quality clinical performance.

Exploring Perceptions of Early-Career Psychiatrists About Their Relationships With the Pharmaceutical Industry.

OBJECTIVES: The pharmaceutical industry has engaged physicians through medical education, patient care, and medical research. New conflict of interest policy has highlighted the challenges to these relationships. The objective of this study was to explore the perceptions that early career psychiatrists (e.g. those within 5 years of entering practice) have regarding their relationship with the pharmaceutical industry. METHODS: Data were collected through semi-structured interviews and were analysed using a grounded theory methodology. Interviews were conducted and analyzed in an iterative way using a constant comparison approach in which data were collected and open coded for themes and subthemes. As new interviews were conducted, the themes were applied to data along with emergent themes and previous interviews recoded until additional interviews failed to provide new themes and thematic saturation was achieved. Through axial coding, a process of relating codes (categories and concepts) to each other, the theory was generated to explain the core variable mediating perceptions participants had about the relationship with industry. RESULTS: The participants described increasing frequency of experiences with industry throughout training into practice. Their perceptions developed through training, physician culture, industry promotion, and their own practices. In managing the relationship with industry, participants would either avoid interactions or engage in behaviors aimed to reduce the risk of influence. Maintaining one's professional integrity was the underlying driver used to manage the relationship with industry. CONCLUSIONS: Psychiatrists develop perceptions about industry through experience and observation leading them to develop their own strategies to manage these relationships while maintaining their professional integrity.

Exploring the Teaching Motivations, Satisfaction, and Challenges of Veterinary Preceptors: A Qualitative Study.

Optimization of clinical veterinary education requires an understanding of what compels veterinary preceptors in their role as clinical educators, what satisfaction they receive from the teaching experience, and what struggles they encounter while supervising students in private practice. We explored veterinary preceptors' teaching motivations, enjoyment, and challenges by undertaking a thematic content analysis of 97 questionnaires and 17 semi-structured telephone interviews. Preceptor motivations included intrinsic factors (obligation to the profession, maintenance of competence, satisfaction) and extrinsic factors (promotion of the veterinary field, recruitment). Veterinarians enjoyed observing the learner (motivation and enthusiasm, skill development) and engaging with the learner (sharing their passion for the profession, developing professional relationships). Challenges for veterinary preceptors included variability in learner interest and engagement, time management, and lack of guidance from the veterinary medicine program. We found dynamic interactions among the teaching motivations, enjoyment, and challenges for preceptors. Our findings suggest that in order to sustain the veterinary preceptor, there is a need to recognize the interplay between the incentives and disincentives for teaching, to foster the motivations and enjoyment for teaching, and to mitigate the challenges of teaching in community private practice.

Supporting Veterinary Preceptors in a Distributed Model of Education: A Faculty Development Needs Assessment.

Effective faculty development for veterinary preceptors requires knowledge about their learning needs and delivery preferences. Veterinary preceptors at community practice locations in Alberta, Canada, were surveyed to determine their confidence in teaching ability and interest in nine faculty development topics. The study included 101 veterinarians (48.5% female). Of these, 43 (42.6%) practiced veterinary medicine in a rural location and 54 (53.5%) worked in mixed-animal or food-animal practice. Participants reported they were more likely to attend an in-person faculty development event than to participate in an online presentation. The likelihood of attending an in-person event differed with the demographics of the respondent. Teaching clinical reasoning, assessing student performance, engaging and motivating students, and providing constructive feedback were topics in which preceptors had great interest and high confidence. Preceptors were least confident in the areas of student learning styles, balancing clinical workload with teaching, and resolving conflict involving the student. Disparities between preceptors' interest and confidence in faculty development topics exist, in that topics with the lowest confidence scores were not rated as those of greatest interest. While the content and format of clinical teaching faculty development events should be informed by the interests of preceptors, consideration of preceptors' confidence in teaching ability may be warranted when developing a faculty development curriculum.

Evaluation of an educational program for essential newborn care in resource-limited settings: Essential Care for Every Baby.

BACKGROUND: Essential Care for Every Baby (ECEB) is an evidence-based educational program designed to increase cognitive knowledge and develop skills of health care professionals in essential newborn care in low-resource areas. The course focuses on the immediate care of the newborn after birth and during the first day or until discharge from the health facility. This study assessed the overall design of the course; the ability of facilitators to teach the course; and the knowledge and skills acquired by the learners. METHODS: Testing occurred at 2 global sites. Data from a facilitator evaluation survey, a learner satisfaction survey, a multiple choice question (MCQ) examination, performance on two objective structured clinical evaluations (OSCE), and pre- and post-course confidence assessments were analyzed using descriptive statistics. Pre-post course differences were examined. Comments on the evaluation form and post-course group discussions were analyzed to identify potential program improvements. RESULTS: Using ECEB course material, master trainers taught 12 facilitators in India and 11 in Kenya who subsequently taught 62 providers of newborn care in India and 64 in Kenya. Facilitators and learners were satisfied with their ability to teach and learn from the program. Confidence (3.5 to 5) and MCQ scores (India: pre 19.4, post 24.8; Kenya: pre 20.8, post 25.0) improved (p < 0.001). Most participants demonstrated satisfactory skills on the OSCEs. Qualitative data suggested the course was effective, but also identified areas for course improvement. These included additional time for hands-on practice, including practice in a clinical setting, the addition of video learning aids and the adaptation of content to conform to locally recommended practices. CONCLUSION: ECEB program was highly acceptable, demonstrated improved confidence, improved knowledge and developed skills. ECEB may improve newborn care in low resource settings if it is part of an overall implementation plan that addresses local needs and serves to further strengthen health systems.

Toward a common understanding: supporting and promoting education scholarship for medical school faculty.

CONTEXT: Education scholarship (ES) is integral to the transformation of medical education. Faculty members who engage in ES need encouragement and recognition of this work. Beginning with the definition of ES as 'an umbrella term which can encompass both research and innovation in health professions education', and which as such represents an activity that is separate and distinct from teaching and leadership, the purpose of our study was to explore how promotion policies and processes are used in Canadian medical schools to support and promote ES. METHODS: We conducted an analysis of the promotion policies of 17 Canadian medical schools and interviews with a key informant at each institution. We drew on an interpretive approach to policy analysis to analyse the data and to understand explicit messages about how ES was represented and supported. RESULTS: Of the 17 schools' promotion documents, only nine contained specific reference to ES. There was wide variation in focus and level of detail. All key informants indicated that ES is recognised and considered for academic promotion. Barriers to the support and recognition of ES included a lack of understanding of ES and its relationship to teaching and leadership. This was manifest in the variability in promotion policies and processes, support systems, and career planning and pathways for ES. CONCLUSIONS: This lack of clarity may make it challenging for medical school faculty members to make sense of how they might successfully align ES within an academic career. There is a need therefore to better articulate ES in promotion policies and support systems. Creating a common understanding of ES, developing guidelines to assess the impact of all forms of ES, developing an informed leadership and system of mentors, and creating explicit role descriptions and guidelines are identified as potential strategies to ensure that ES is appropriately valued.

Family physician practice visits arising from the Alberta Physician Achievement Review.

BACKGROUND: Licensed physicians in Alberta are required to participate in the Physician Achievement Review (PAR) program every 5 years, comprising multi-source feedback questionnaires with confidential feedback, and practice visits for a minority of physicians. We wished to identify and classify issues requiring change or improvement from the family practice visits, and the responses to advice. METHODS: Retrospective analysis of narrative practice visit reports data using a mixed methods design to study records of visits to 51 family physicians and general practitioners who participated in PAR during the period 2010 to 2011, and whose ratings in one or more major assessment domains were significantly lower than their peer group. RESULTS: Reports from visits to the practices of family physicians and general practitioners confirmed opportunities for change and improvement, with two main groupings - practice environment and physician performance. For 40/51 physicians (78%) suggested actions were discussed with physicians and changes were confirmed. Areas of particular concern included problems arising from practice isolation and diagnostic conclusions being reached with incomplete clinical evidence. CONCLUSION: This study provides additional evidence for the construct validity of a regulatory authority educational program in which multi-source performance feedback identifies areas for practice quality improvement, and change is encouraged by supplementary contact for selected physicians.

Family Physician Quality Improvement Plans: A Realist Inquiry Into What Works, for Whom, Under What Circumstances.

INTRODUCTION: Evaluation of quality improvement programs shows variable impact on physician performance often neglecting to examine how implementation varies across contexts and mechanisms that affect uptake. Realist evaluation enables the generation, refinement, and testing theories of change by unpacking what works for whom under what circumstances and why. This study used realist methods to explore relationships between outcomes, mechanisms (resources and reasoning), and context factors of a national multisource feedback (MSF) program. METHODS: Linked data for 50 physicians were examined to determine relationships between action plan completion status (outcomes), MSF ratings, MSF comments and prescribing data (resource mechanisms), a report summarizing the conversation between a facilitator and physician (reasoning mechanism), and practice risk factors (context). Working backward from outcomes enabled exploration of similarities and differences in mechanisms and context. RESULTS: The derived model showed that the completion status of plans was influenced by interaction of resource and reasoning mechanisms with context mediating the relationships. Two patterns were emerged. Physicians who implemented all their plans within six months received feedback with consistent messaging, reviewed data ahead of facilitation, coconstructed plan(s) with the facilitator, and had fewer risks to competence (dyscompetence). Physicians who were unable to implement any plans had data with fewer repeated messages and did not incorporate these into plans, had difficult plans, or needed to involve others and were physician-led, and were at higher risk for dyscompetence. DISCUSSION: Evaluation of quality improvement initiatives should examine program outcomes taking into consideration the interplay of resources, reasoning, and risk factors for dyscompetence.