Medical competence as a multilayered construct.

BACKGROUND: The conceptualisation of medical competence is central to its use in competency-based medical education. Calls for 'fixed standards' with 'flexible pathways', recommended in recent reports, require competence to be well defined. Making competence explicit and measurable has, however, been difficult, in part due to a tension between the need for standardisation and the acknowledgment that medical professionals must also be valued as unique individuals. To address these conflicting demands, a multilayered conceptualisation of competence is proposed, with implications for the definition of standards and approaches to assessment. THE MODEL: Three layers are elaborated. This first is a core layer of canonical knowledge and skill, 'that, which every professional should possess', independent of the context of practice. The second layer is context-dependent knowledge, skill, and attitude, visible through practice in health care. The third layer of personalised competence includes personal skills, interests, habits and convictions, integrated with one's personality. This layer, discussed with reference to Vygotsky's concept of Perezhivanie, cognitive load theory, self-determination theory and Maslow's 'self-actualisation', may be regarded as the art of medicine. We propose that fully matured professional competence requires all three layers, but that the assessment of each layer is different. IMPLICATIONS: The assessment of canonical knowledge and skills (Layer 1) can be approached with classical psychometric conditions, that is, similar tests, circumstances and criteria for all. Context-dependent medical competence (Layer 2) must be assessed differently, because conditions of assessment across candidates cannot be standardised. Here, multiple sources of information must be merged and intersubjective expert agreement should ground decisions about progression and level of clinical autonomy of trainees. Competence as the art of medicine (Layer 3) cannot be standardised and should not be assessed with the purpose of permission to practice. The pursuit of personal excellence in this level, however, can be recognised and rewarded.

Contradictions and Opportunities: Reconciling Professional Identity Formation and Competency-Based Medical Education.

The widespread adoption of Competency-Based Medical Education (CBME) has resulted in a more explicit focus on learners' abilities to effectively demonstrate achievement of the competencies required for safe and unsupervised practice. While CBME implementation has yielded many benefits, by focusing explicitly on what learners are doing, curricula may be unintentionally overlooking who learners are becoming (i.e., the formation of their professional identities). Integrating professional identity formation (PIF) into curricula has the potential to positively influence professionalism, well-being, and inclusivity; however, issues related to the definition, assessment, and operationalization of PIF have made it difficult to embed this curricular imperative into CBME. This paper aims to outline a path towards the reconciliation of PIF and CBME to better support the development of physicians that are best suited to meet the needs of society. To begin to reconcile CBME and PIF, this paper defines three contradictions that must and can be resolved, namely: (1) CBME attends to behavioral outcomes whereas PIF attends to developmental processes; (2) CBME emphasizes standardization whereas PIF emphasizes individualization; (3) CBME organizes assessment around observed competence whereas the assessment of PIF is inherently more holistic. Subsequently, the authors identify curricular opportunities to address these contradictions, such as incorporating process-based outcomes into curricula, recognizing the individualized and contextualized nature of competence, and incorporating guided self-assessment into coaching and mentorship programs. In addition, the authors highlight future research directions related to each contradiction with the goal of reconciling 'doing' and 'being' in medical education.

If we assess, will they learn? Students' perspectives on the complexities of assessment-for-learning.

Introduction: Assessment can positively influence learning, however designing effective assessment-for-learning interventions has proved challenging. We implemented a mandatory assessment-for-learning system comprising a workplace-based assessment of non-medical expert competencies and a progress test in undergraduate medical education and evaluated its impact. Methods: We conducted semi-structured interviews with year-3 and 4 medical students at McGill University to explore how the assessment system had influenced their learning in year 3. We conducted theory-informed thematic analysis of the data. Results: Eleven students participated, revealing that the assessment influenced learning through several mechanisms. Some required little student engagement (i.e., feed-up, test-enhanced learning, looking things up after an exam). Others required substantial engagement (e.g., studying for tests, selecting raters for quality feedback, using feedback). Student engagement was moderated by the perceived credibility of the system and of the costs and benefits of engagement. Credibility was shaped by students' goals-in-context: becoming a good doctor, contributing to the healthcare team, succeeding in assessments. Discussion: Our assessment system failed to engage students enough to leverage its full potential. We discuss the inherent flaws and external factors that hindered student engagement. Assessment designers should leverage easy-to-control mechanisms to support assessment-for-learning and anticipate significant collaborative work to modify learning cultures.

Introduction: L'évaluation peut influencer positivement l'apprentissage mais la conception de dispositifs d'évaluation pour l'apprentissage efficaces s'avère difficile. Nous avons implanté en formation prédoctorale un système obligatoire d'évaluation pour l'apprentissage comprenant une évaluation en milieu clinique des compétences transversales et un test de rendement progressif, puis évalué ses effets. Méthodes: Nous avons mené des entretiens semi-dirigés avec des étudiants en troisième et quatrième années de médecine à l'Université McGill pour explorer la manière dont le système d'évaluation avait influencé leur apprentissage au cours de la troisième année. Nous avons effectué une analyse thématique, informée par la théorie, des données. Résultats: Onze étudiants ont participé. Les résultats indiquent que l'évaluation a influencé leur apprentissage par le biais de plusieurs mécanismes différents. Certains d'entre eux nécessitaient une implication faible de la part de l'étudiant, comme l'identification des objectifs à atteindre (feed-up), l'apprentissage amélioré par les tests, la recherche d'informations après un examen. D'autres exigeaient une implication importante (par exemple, étudier pour les tests, sélectionner les évaluateurs pour obtenir une rétroaction de qualité, mettre à profit la rétroaction). L'implication des étudiants était modulée par leur perception des avantages et des inconvénients de s'impliquer, et de la crédibilité du système. Cette dernière était influencée par les objectifs-en-contexte des étudiants: devenir un bon médecin, contribuer à l'équipe soignante, réussir les épreuves d'évaluation. Discussion: Notre système d'évaluation n'a pas réussi à impliquer suffisamment les étudiants que pour réaliser son potentiel. Nous abordons les défauts inhérents au système ainsi que les facteurs externes qui ont entravé l'implication des apprenants. Pour implanter efficacement un dispositif d'évaluation pour l'apprentissage, les concepteurs d'évaluations devraient optimiser les mécanismes qui sont faciles à contrôler et être prêts à s'investir dans un important travail de collaboration pour changer les cultures d'apprentissage.

Professionalism, Communities of Practice, and Medicine's Social Contract.

While medicine's roots lie deep in antiquity, the modern professions only arose in the middle of the 19th century after which early social scientists examined the nature of professionalism. The relationship between medicine and society received less attention until profound changes occurred in the structure and financing of health care, leading to a perception that medicine's professionalism was being threatened. Starr in 1984 proposed that the relationship was contractual with expectations and obligations on both sides. Other observers refined the concept, believing that the historic term, "social contract," could be applied to the relationship, a concept with which many agree. There was general agreement that society used the concept of the profession to organize the delivery of essential services that it required, including health care. Under the terms of the contract, the medical profession was given financial and nonfinancial rewards, autonomy, and the privilege of self regulation on the understanding that it would be trustworthy, assure the competence of its members, and be devoted to the public good. In examining how the social contract is negotiated, it has been proposed that physicians belong to a "community of practice" that they voluntarily join during their education and training. In joining the community, they accept the norms and values of community members and acquire the identity prescribed by the community. The leaders of the community are responsible for negotiating the social contract on behalf of the medical profession. In so doing, they must ensure that they recognize the importance of devotion to the public good in the maintenance of medicine's professional status.

Clinical Teachers' Perceptions of Their Role in Professional Identity Formation.

PURPOSE: A fundamental goal of medical education is supporting learners in forming a professional identity. While it is known that learners perceive clinical teachers to be critically important in this process, the latter's perspective is unknown. This study sought to understand how clinical teachers perceive their influence on the professional identity formation of learners. METHOD: In 2017, a research assistant conducted 16 semistructured interviews of clinical teachers from 8 specialties at McGill University. The research assistant audiorecorded and subsequently transcribed interviews for analysis. Following principles of qualitative description, the research team developed a coding scheme using both inductive codes (from the words of the participants) and deductive codes (based on the literature and the theory of communities of practice). Through a cross-case analysis, the team then identified salient themes. RESULTS: Participants struggled to describe their influence on learners' professional identity without first being prompted to focus on their own identity and its formation. Once prompted, clinical teachers reported viewing their personal and professional identities as integrated and believed that caring for patients was integral to forming their professional identity. They identified explicit role modeling, engaging in difficult conversations, and providing graded autonomy as ways in which they could influence the identity development of learners. However, they had difficulty discerning the magnitude of their influence. CONCLUSIONS: This study was the first to explore professional identity formation from the perspective of clinical teachers. The 2010 Carnegie Foundation report called for an increased focus on professional identity formation. Giving clinical teachers the space and guidance to reflect on this process, helping them make the implicit explicit, and supporting them in using their own experiences as learners to inform their teaching appear to be critical steps in achieving this goal.

Supporting the development of a professional identity: General principles.

While teaching medical professionalism has been an important aspect of medical education over the past two decades, the recent emergence of professional identity formation as an important concept has led to a reexamination of how best to ensure that medical graduates come to "think, act, and feel like a physician." If the recommendation that professional identity formation as an educational objective becomes a reality, curricular change to support this objective is required and the principles that guided programs designed to teach professionalism must be reexamined. It is proposed that the social learning theory communities of practice serve as the theoretical basis of the curricular revision as the theory is strongly linked to identity formation. Curricular changes that support professional identity formation include: the necessity to establish identity formation as an educational objective, include a cognitive base on the subject in the formal curriculum, to engage students in the development of their own identities, provide a welcoming community that facilitates their entry, and offer faculty development to ensure that all understand the educational objective and the means chosen to achieve it. Finally, there is a need to assist students as they chart progress towards becoming a professional.

The challenges of detecting progress in generic competencies in the clinical setting.

CONTEXT: Competency-based medical education has spurred the implementation of longitudinal workplace-based assessment (WBA) programmes to track learners' development of competencies. These hinge on the appropriate use of assessment instruments by assessors. This study aimed to validate our assessment programme and specifically to explore whether assessors' beliefs and behaviours rendered the detection of progress possible. METHODS: We implemented a longitudinal WBA programme in the third year of a primarily rotation-based clerkship. The programme used the professionalism mini-evaluation exercise (P-MEX) to detect progress in generic competencies. We used mixed methods: a retrospective psychometric examination of student assessment data in one academic year, and a prospective focus group and interview study of assessors' beliefs and reported behaviours related to the assessment. RESULTS: We analysed 1662 assessment forms for 186 students. We conducted interviews and focus groups with 21 assessors from different professions and disciplines. Scores were excellent from the outset (3.5-3.7/4), with no meaningful increase across blocks (average overall scores: 3.6 in block 1 versus 3.7 in blocks 2 and 3; F = 8.310, d.f. 2, p < 0.001). The main source of variance was the forms (47%) and only 1% of variance was attributable to students, which led to low generalisability across forms (Eρ2  = 0.18). Assessors reported using multiple observations to produce their assessments and were reluctant to harm students by consigning anything negative to writing. They justified the use of a consistent benchmark across time by citing the basic nature of the form or a belief that the 'competencies' assessed were in fact fixed attributes that were unlikely to change. CONCLUSIONS: Assessors may purposefully deviate from instructions in order to meet their ethical standards of good assessment. Furthermore, generic competencies may be viewed as intrinsic and fixed rather than as learnable. Implementing a longitudinal WBA programme is complex and requires careful consideration of assessors' beliefs and values.

Medicine as a Community of Practice: Implications for Medical Education.

The presence of a variety of independent learning theories makes it difficult for medical educators to construct a comprehensive theoretical framework for medical education, resulting in numerous and often unrelated curricular, instructional, and assessment practices. Linked with an understanding of identity formation, the concept of communities of practice could provide such a framework, emphasizing the social nature of learning. Individuals wish to join the community, moving from legitimate peripheral to full participation, acquiring the identity of community members and accepting the community's norms.Having communities of practice as the theoretical basis of medical education does not diminish the value of other learning theories. Communities of practice can serve as the foundational theory, and other theories can provide a theoretical basis for the multiple educational activities that take place within the community, thus helping create an integrated theoretical approach.Communities of practice can guide the development of interventions to make medical education more effective and can help both learners and educators better cope with medical education's complexity. An initial step is to acknowledge the potential of communities of practice as the foundational theory. Educational initiatives that could result from this approach include adding communities of practice to the cognitive base; actively engaging students in joining the community; creating a welcoming community; expanding the emphasis on explicitly addressing role modeling, mentoring, experiential learning, and reflection; providing faculty development to support the program; and recognizing the necessity to chart progress toward membership in the community.

Amending Miller's Pyramid to Include Professional Identity Formation.

In 1990, George Miller published an article entitled "The Assessment of Clinical Skills/Competence/Performance" that had an immediate and lasting impact on medical education. In his classic article, he stated that no single method of assessment could encompass the intricacies and complexities of medical practice. To provide a structured approach to the assessment of medical competence, he proposed a pyramidal structure with four levels, each of which required specific methods of assessment. As is well known, the layers are "Knows," "Knows How," "Shows How," and "Does." Miller's pyramid has guided assessment since its introduction; it has also been used to assist in the assessment of professionalism.The recent emphasis on professional identity formation has raised questions about the appropriateness of "Does" as the highest level of aspiration. It is believed that a more reliable indicator of professional behavior is the incorporation of the values and attitudes of the professional into the identity of the aspiring physician. It is therefore proposed that a fifth level be added at the apex of the pyramid. This level, reflecting the presence of a professional identity, should be "Is," and methods of assessing progress toward a professional identity and the nature of the identity in formation should be guided by currently available methods.

Sufficient Competence to Enter the Unsupervised Practice of Orthopaedics: What Is It, When Does It Occur, and Do We Know It When We See It? AOA Critical Issues.

The goal of residency programs is to provide an educational venue with graduated responsibility and increasing levels of independence as preparation for entering the unsupervised practice of medicine. Surgical programs are required to both cultivate and convey skills pursuant to three fundamental domains: a sufficient fund of knowledge, technical competence in surgical procedures, and a degree of professionalism to enable ethical independent practice. Never before has the expectation that residency programs provide graduated responsibility in preparation for entering the unsupervised practice of medicine been so clearly articulated as it has by Nasca in the recent Accreditation Council for Graduate Medical Education (ACGME) work-hour guideline revisions. The Royal College of Physicians and Surgeons has provided similar guidance in Canada. Yet, as we progress further into the second decade of work-hour restrictions, it is unclear that we have adequately defined or can recognize the critical end points essential to trainee competency. What is clear is that we must achieve these end points in a manner different from that prior to the introduction of work-hour restrictions. We present the current state of thinking from North America and contrast this with the evolving medical educational process in the United Kingdom.

A schematic representation of the professional identity formation and socialization of medical students and residents: a guide for medical educators.

Recent calls to focus on identity formation in medicine propose that educators establish as a goal of medical education the support and guidance of students and residents as they develop their professional identity. Those entering medical school arrive with a personal identity formed since birth. As they proceed through the educational continuum, they successively develop the identity of a medical student, a resident, and a physician. Each individual's journey from layperson to skilled professional is unique and is affected by "who they are" at the beginning and "who they wish to become."Identity formation is a dynamic process achieved through socialization; it results in individuals joining the medical community of practice. Multiple factors within and outside of the educational system affect the formation of an individual's professional identity. Each learner reacts to different factors in her or his own fashion, with the anticipated outcome being the emergence of a professional identity. However, the inherent logic in the related processes of professional identity formation and socialization may be obscured by their complexity and the large number of factors involved.Drawing on the identity formation and socialization literature, as well as experience gained in teaching professionalism, the authors developed schematic representations of these processes. They adapted them to the medical context to guide educators as they initiate educational interventions, which aim to explicitly support professional identity formation and the ultimate goal of medical education-to ensure that medical students and residents come to "think, act, and feel like a physician."

How we made professionalism relevant to twenty-first century residents.

The complexity of the current medical trainee work environment, including the impact of social media participation, is underappreciated. Despite rapid adoption of social media by residents and the introduction of social media guidelines targeted at medical professionals, there is a paucity of data evaluating practical methods to incorporate social media into professionalism teaching curricula. We developed a flipped classroom program, focusing on the application of professionalism principles to challenging real-life scenarios including social media-related issues. The pre-workshop evaluation showed that the participants had a good understanding of basic professionalism concepts. A post-workshop survey assessed residents' comfort level with professionalism concepts. The post-workshop survey revealed that the postgraduate trainees perceived significant improvement in their understanding of professionalism (p < 0.05). Resident responses also exposed some challenges of real-life clinical settings. There was an apparent contradiction between placing a high value on personal health and believing that physicians ought to be available to patients at any time. Participants' satisfaction with the course bodes well for continual modification of such courses. Innovative flipped classroom format in combination with simulation-based sessions allows easy incorporation of contemporary professionalism issues surrounding social media.

Reframing medical education to support professional identity formation.

Teaching medical professionalism is a fundamental component of medical education. The objective is to ensure that students understand the nature of professionalism and its obligations and internalize the value system of the medical profession. The recent emergence of interest in the medical literature on professional identity formation gives reason to reexamine this objective. The unstated aim of teaching professionalism has been to ensure the development of practitioners who possess a professional identity. The teaching of medical professionalism therefore represents a means to an end.The principles of identity formation that have been articulated in educational psychology and other fields have recently been used to examine the process through which physicians acquire their professional identities. Socialization-with its complex networks of social interaction, role models and mentors, experiential learning, and explicit and tacit knowledge acquisition-influences each learner, causing them to gradually "think, act, and feel like a physician."The authors propose that a principal goal of medical education be the development of a professional identity and that educational strategies be developed to support this new objective. The explicit teaching of professionalism and emphasis on professional behaviors will remain important. However, expanding knowledge of identity formation in medicine and of socialization in the medical environment should lend greater logic and clarity to the educational activities devoted to ensuring that the medical practitioners of the future will possess and demonstrate the qualities of the "good physician."

The Professionalism Assessment of Clinical Teachers (PACT): the reliability and validity of a novel tool to evaluate professional and clinical teaching behaviors.

Physicians function as clinicians, teachers, and role models within the clinical environment. Negative learning environments have been shown to be due to many factors, including the presence of unprofessional behaviors among clinical teachers. Reliable and valid assessments of clinical teacher performance, including professional behaviors, may provide a foundation for evidence-based feedback to clinical teachers, enable targeted remediation or recognition, and help to improve the learning environment. However, few tools exist for the evaluation of clinical teachers that include a focus on both professional and clinical teaching behaviors. The Professionalism Assessment of Clinical Teachers (PACT) was developed and implemented at one Canadian institution and was assessed for evidence of reliability and validity. Following each clerkship rotation, students in the 2009-2010 third-year undergraduate clerkship cohort (n = 178) anonymously evaluated a minimum of two clinical teachers using the PACT. 4,715 forms on 567 faculty members were completed. Reliability, validity, and free text comments (present in 45 % of the forms) were examined. An average of 8.6 PACT forms were completed per faculty (range 1-60), with a reliability of 0.31 for 2.9 forms (harmonic mean); 12 forms were necessary for a reliability of 0.65. Global evaluations of teachers aligned with ratings of free-text comments (r = 0.77, p < 0.001). Comment length related negatively with overall rating (r = -0.19, p < 0.001). Mean performance related negatively with variability of performance (r = -0.72, p < 0.001), although this may be related to a ceiling effect. Most faculty members were rated highly; however 'provided constructive feedback' was the least well-rated item. Respectful interactions with students appeared to be the most influential item in the global rating of faculty performance. The PACT is a moderately reliable tool for the assessment of professional behaviors of clinical teachers, with evidence supporting its validity.