Philanthropy in health professions education research: determinants of success.

CONTEXT: Fund-raising is a new practice in medical education research. OBJECTIVES: This qualitative study explores a cross-sectional analysis of philanthropy in medical education in Canada and Europe and identifies some common characteristics in the fund-raising system, key roles and characteristics of research sites that have had success. METHODS: Medical education research sites that had received donations greater than Can$100 000 were identified by searching publicly available sources. Interviews were conducted with 25 individuals from these and other sites, in four categories: medical education leaders (n = 9); philanthropy-supported chairholders and researchers (n = 5); donors of over Can$100 000 (n = 7), and advancement professionals (n = 4). Interview transcripts were inductively coded to identify themes. RESULTS: Five factors associated with success in accessing philanthropic sources were identified in the sample: support of the organisation's senior leadership; a charismatic champion who motivates donors; access to an advancement office or foundation; impetus to find funds beyond traditional operating budgets, and understanding of the conceptual and practical dimensions of fund-raising. Three types of donor (medical education insider, donor collective and general philanthropist), four faculty roles (trailblazers, rock stars, 'Who? Me?' people and future fund-raisers) and six stages in the fund-raising cycle were also identified. CONCLUSIONS: Philanthropy is a source of funding with the potential to significantly advance education research. Yet competence in fund-raising is not widely developed among medical education research leaders. Successful accessing of philanthropic sources of funding requires the ability to articulate the impact of philanthropy in medical education research in a way that will interest donors. This appears to be challenging for medical education leaders, who tend to frame their work in academic terms and have trouble competing against other fund-raising domains. Medical education research institutes and centres will benefit from developing greater understanding of the conception and practices of fund-raising.

Toward a research agenda for competency-based medical education.

Competency-based medical education (CBME) is both an educational philosophy and an approach to educational design. CBME has already had a broad impact on medical schools, residency programs, and continuing professional development in health professions around the world. As the CBME movement evolves and CBME programs are implemented, a wide range of emerging research questions will warrant scholarly examination. In this paper, we describe a proposed CBME research agenda developed by the International CBME Collaborators. The resulting framework includes questions about the meaning of key concepts of CBME and their implications for learners, faculty members, and institutional structures. Other research questions relate to the learning process, the meaning of entrustment decisions, fundamental measurement issues, and the nature and definition of standards. The exploration of these questions will help to solidify the theoretical foundation of CBME, but many issues related to implementation also need to be addressed. These pertain to, among other things, nurturing independent learning, assembling and using assessment results to make decisions about competence, structuring feedback, supporting remediation, and how best to evaluate the longer-term outcomes of CBME. High-quality research on these questions will require rigorous outcome measures with strong validity evidence. The complexity of CBME necessitates theoretical and methodological diversity. It also requires multi-institutional studies that examine effects at multiple levels, from the learner to the team, the institution, and the health care system. Such a framework of research questions can guide and facilitate scholarly discourse on the theoretical and practical body of knowledge related to competency-based health professions education.

The show must go on? Patients, props and pedagogy in the theatre of the OSCE.

According to Shakespeare, all the world's a stage, and all the men and women merely players. The objective structured clinical examination (OSCE), that most ubiquitous form of assessment in health professions education, offers us a particular instance of this maxim. Comprising at first glance a world of psychometric data, detailed checklists and global rating scales, the OSCE sets out to facilitate the assessment of a candidate's competence in a highly standardised and objective fashion. Despite this clear intention, OSCEs also offer a rich vein of (often unacknowledged) social and cultural processes. In this commentary, we draw on Goffman's dramaturgy metaphor and our experiences to undertake a wry examination of some of the least intended consequences of OSCEs. We take a satirical look at both the potential impact on patients and the pedagogical implications of this form of assessment. We now urge you to sit back, settle in and enjoy the show, as we raise the curtain on this one-night-only performance!

Assessing competencies using milestones along the way.

This paper presents perspectives and controversies surrounding the use of milestones to assess competency in outcomes-based medical education. Global perspectives (Canada, Europe, and the United States) and developments supporting their rationales are discussed. In Canada, there is a significant movement away from conceptualizing competency based on time, and a move toward demonstration of specific competencies. The success of this movement may require complex (rather than reductionist) milestones that reflect students' progression through complexity and context and a method to narrate their journey. European countries (United Kingdom, France, and Germany) have stressed the complexity associated with time and milestones for medical students to truly achieve competence. To meet the changing demands of medicine, they view time as actually providing students with knowledge and exposure to achieve various milestones. In the United States, milestones are based on sampling throughout professional development to initiate lifelong learning. However, the use of milestones may not imply overall competence (reductionism). Milestones must be developed alongside outcomes-based curriculum with use of faculty and competency committees. The perspectives outlined in this paper underscore emerging challenges for implementing outcomes-based medical education and call for new conceptualizations of competence.

Medical education... meet Michel Foucault.

CONTEXT: There have been repeated calls for the greater use of conceptual frameworks and of theory in medical education. Although it is familiar to few medical educators, Michel Foucault's work is a helpful theoretical and methodological source. METHODS: This article explores what it means to use a 'Foucauldian approach', presents a sample of Foucault's historical-genealogical studies that are relevant to medical education, and introduces the work of four researchers currently undertaking Foucauldian-inspired medical education research. RESULTS: Although they are not without controversy, Foucauldian approaches are employed by an increasing number of scholars and are helpful in shedding light on what it is possible to think, say and be in medical education. CONCLUSIONS: Our hope in sharing this Foucauldian work and perspective is that we might stimulate a dialogue that is forward-looking and optimistic about the possibilities for change in medical education.

The more it changes; the more it remains the same: a Foucauldian analysis of Canadian policy documents relevant to student selection for medical school.

Calls to increase the demographic representativeness of medical classes to better reflect the diversity of society are part of a growing international trend. Despite this, entry into medical school remains highly competitive and exclusive of marginalized groups. To address these questions, we conducted a Foucauldian discourse analysis of 15 publically available policy documents from the websites of Canadian medical education regulatory bodies, using the concepts of "excellence" (institutional or in an applicant), "diversity," and "equity" to frame the analysis. In most documents, there were appeals to broaden definitions of institutional excellence to include concerns for greater social accountability. Equity concerns tended to be represented as needing to be dealt with by people in positions of authority in order to counter a "hidden curriculum." Diversity was represented as an object of value, situated within a discontinuous history. As a rhetorical strategy, documents invoked complex societal shifts to promote change toward a more humanistic medical education system and profession. "Social accountability" was reified as an all-encompassing solution to most issues of representation. Although the policy documents proclaimed rootedness in an ethos of improving the societal responsiveness of the medical profession, our analysis takes a more critical stance towards the discourses identified. On the basis of our research findings, we question whether these calls may contribute to the maintenance of the specific power relations they seek to address. These conclusions lead us to consider the possibility that the discourses represented in the documents might be reframed to take into account issues of power distribution and its productive and reproductive features. A reframing of discourses could potentially generate greater inclusiveness in policy development processes, and afford disadvantaged and marginalized groups more participatory roles in the discussion.

The Psychiatry OSCE: a 20-year retrospective.

OBJECTIVE: Twenty years ago researchers at the University of Toronto launched the Psychiatry Skills Assessment Project (PSAP), a research program exploring Objective Structured Clinical Examinations (OSCEs) in psychiatry. Between 1994 and 2005 PSAP produced publications on the feasibility, reliability, validity, ethics, and practical concerns of OSCEs in psychiatry. The current review has two parts: a review of the state of the art of OSCEs in psychiatry 20 years after they were introduced and documentation of the impact of the PSAP research program. METHODS: A literature search identified all publications on OSCEs and psychiatry. Articles were coded thematically, and locations of agreement and controversies were identified. Bibliometric analysis identified citations of PSAP research papers, which were analyzed thematically. RESULTS: As of May 2013, there were 250 publications related to OSCEs in psychiatry (not including 10 PSAP papers), published in 29 different countries and ten languages. Prominent topics were the validity and acceptability of OSCEs and SPs, systems issues in adopting OSCEs in psychiatry, and the effects on learning. Eighty-eight percent of all publications cited PSAP work (300 citations). Citations were employed for four purposes: as evidence/justification (54 %); to frame replication research (14 %); to support adaptation of OSCEs in other countries and professions (15 %); and for debate (18 %). CONCLUSIONS: Over the past 20 years, use of OSCEs has grown steadily in psychiatry, and several national certification organizations have adopted OSCEs. PSAP work, introduced two decades ago, continues to provide a scholarly foundation for psychometric, practical, and ethical issues of interest to this field.

Residents learning from a narrative experience with dying patients: a qualitative study.

For patients at the end of life, it is crucial to address the psychological, existential, and spiritual distress of patients. Medical education research suggests trainees feel unprepared to provide the whole person, humanistic care held as the ideal. This study used an empirically based narrative intervention, the dignity interview, as an educational intervention with first year residents. The interview helps patients tell and make meaning of their life story. The intervention was aimed at addressing trainee perceived gaps in the non-physical aspects of end-of-life care. It was also intended to stimulate broader reflection on lessons learned in medical education about the value of narrative as part of humanistic care. Twelve first year residents administered a 1 h interview to dying patients. The resident returned to read the transcribed story back to the patient. Semi-structured interviews of the residents were transcribed and analyzed using the constant comparative method to identify emergent themes. This experience was seen as distinct from the 'traditional" medical interview. Residents reflected on lessons learned from patients and on their own professional and personal lives. Residents felt conversations with dying patients, and more broadly the art of soliciting a patient's story are poorly taught and modeled. More concerning, the hidden curriculum seems to be sending messages that learning a patient's story is not the domain of a physician and that it is not valued like the curing and technical imperatives. These findings have implications for medical education's ongoing attempts to better produce humanistic physicians.

Dissecting the doctor: from character to characteristics in North American medical education.

Medical educators develop student selection criteria and design curricula based on underlying assumptions about who is best suited to the profession and how these learners should be taught. Often these assumptions are not made explicit but instead are embedded in the words and phrases used to describe trainees and curricula. They may then be considered inevitable, rather than being seen as particular social constructs. Using Foucauldian critical discourse analysis methodology, the authors examined a major shift in language in the late 1950s in North American medical education texts. The discourse of the good doctor as a man of character, which had been present since the 1910 Flexner Report, was replaced by a new discourse of characteristics. Analysis of this sudden discursive shift shows a change in thinking about the medical trainee and learning environment from a personal journey of discovery to a dissectible set of component parts that could be individually measured and manipulated. Understanding the discursive effects of language that we use will allow medical educators greater insight into the implications and consequences of different constructions of important issues in medical education.

Captive on a carousel: discourses of 'new' in medical education 1910-2010.

Medical educators aim to train physicians with sound scientific knowledge, expert clinical skills and an ability to work effectively with patients, colleagues and health systems. Over the past century, educators have devoted considerable thought and effort to how medical education might be improved. Analysing the language used to describe these initiatives provides insight into assumptions and practices. The authors conducted a Foucauldian critical discourse analysis of prominent recurrent themes in the North American medical education literature. The assembled archive of texts included works of Abraham Flexner, articles from the journal Academic Medicine (including its predecessor journals) and major medical education reports. A series of recurring themes were identified, including the need to avoid over-specialization, the importance of generalism, and the need to broaden criteria for medical student selection. Analysis of these recurring themes allowed identification of a prominent and recurrent discourse of 'new.' This discourse places focus on the future, ignores the ongoing historical nature of issues, suggests a sense of urgency and enables the proposal of modest solutions. It emphasizes changes for individual future doctors, thereby limiting consideration of institutional and systemic factors. Using the image of a carousel, the regular return of themes can be seen as carousel ponies circling around repeatedly in medical education. Identification of this medical education carousel provides an opportunity for medical educators to understand the historical nature of calls for change, and to consider what kinds of reform might be required if they wish to avoid this repetition in the future.

Expert validation of fit-for-purpose guidelines for designing programmes of assessment.

BACKGROUND: An assessment programme, a purposeful mix of assessment activities, is necessary to achieve a complete picture of assessee competence. High quality assessment programmes exist, however, design requirements for such programmes are still unclear. We developed guidelines for design based on an earlier developed framework which identified areas to be covered. A fitness-for-purpose approach defining quality was adopted to develop and validate guidelines. METHODS: First, in a brainstorm, ideas were generated, followed by structured interviews with 9 international assessment experts. Then, guidelines were fine-tuned through analysis of the interviews. Finally, validation was based on expert consensus via member checking. RESULTS: In total 72 guidelines were developed and in this paper the most salient guidelines are discussed. The guidelines are related and grouped per layer of the framework. Some guidelines were so generic that these are applicable in any design consideration. These are: the principle of proportionality, rationales should underpin each decisions, and requirement of expertise. Logically, many guidelines focus on practical aspects of assessment. Some guidelines were found to be clear and concrete, others were less straightforward and were phrased more as issues for contemplation. CONCLUSIONS: The set of guidelines is comprehensive and not bound to a specific context or educational approach. From the fitness-for-purpose principle, guidelines are eclectic, requiring expertise judgement to use them appropriately in different contexts. Further validation studies to test practicality are required.

The future of medical education: a Canadian environmental scan.

OBJECTIVES: One hundred years after the Flexner report remade medical education in North America, many countries are reviewing the purpose and organisation of medical education. In Canada, a national study is being undertaken to define important issues and challenges for the future of medical education. The objectives of this paper are to describe the process of conducting an empirical environmental scan at a national level, and to present the research findings of this scan. METHODS: Thirty national key informant interviews were conducted, transcribed and coded to identify key themes. Interview data were triangulated with data sourced from 34 commissioned literature reviews and a series of national focus groups. RESULTS: Ten key issues or priorities were identified and used to generate detailed review papers used by the Association of Faculties of Medicine of Canada to create a blueprint for the evolution of medical education. The new priorities have major implications for areas ranging from admissions, curriculum content, educational process and the need to articulate the purpose and responsibilities of medical schools in society. DISCUSSION: This research provides a case study of how an empirical research approach can be used to identify and validate priorities for changes in medical education at a national level. This approach may be of interest in other countries.

Flower power: the armoured expert in the CanMEDS competency framework?

Competency frameworks based on roles definitions are currently being used extensively in health professions education internationally. One of the most successful and widely used models is the CanMEDS Roles Framework. The medical literature has raised questions about both the theoretical underpinnings and the practical application of outcomes-based frameworks, however little empirical research has yet been done examining specific roles frameworks. This study examines the historical development of an important early roles framework, the Educating Future Physicians of Ontario (EFPO) roles, which were instrumental in the development of the CanMEDS roles. Prominent discourses related to roles development are examined using critical discourse analysis methodology. Exploration of discourses that emerged in the development of this particular set of roles definitions highlights the contextual and negotiated nature of roles construction. The discourses of threat and protection prevalent in the EFPO roles development offer insight into the visual construction of a centre of medical expertise surrounded by supporting roles (such as collaborator and manager). Non-medical expert roles may perhaps play the part of 'armour' for the authority of medical expertise under threat. This research suggests that it may not be accurate to consider roles as objective ideals. Effective training models may require explicit acknowledgement of the socially negotiated and contextual nature of roles definitions.

Reimagining Bias: Making Strange With Disclosure.

ABSTRACT: Academic presentations in health professions continuing professional development (CPD) often begin with a declaration of real or potential conflicts utilizing a three-slide template or a similar standardized display. These declarations are required in some constituencies. The three-slide template and similar protocols exist to assure learners that the content that follows has been screened, is notionally bias free, and without financial or other influence that might negatively affect health provider behavior. We suggest that there is a potential problem with this type of process that typically focusses in on a narrow definition of conflict of interest. There is the possibility that it does little to confront the issue that bias is a much larger concept and that many forms of bias beyond financial conflict of interest can have devastating effects on patient care and the health of communities. In this article, we hope to open a dialogue around this issue by "making the familiar strange," by asking education organizers and providers to question these standard disclosures. We argue that other forms of bias, arising from the perspectives of the presenter, can also potentially change provider behavior. Implicit biases, for example, affect relationships with patients and can lead to negative health outcomes. We propose that CPD reimagine the process of disclosure of conflicts of interest. We seek to expand reflection on, and disclosure of, perspectives and biases that could affect CPD learners as one dimension of harnessing the power of education to decrease structural inequities.

Exploring how students think: a new method combining think-aloud and concept mapping protocols.

OBJECTIVES: A key element of medical competence is problem solving. Previous work has shown that doctors use inductive reasoning to progress from facts to hypotheses and deductive reasoning to move from hypotheses to the gathering of confirmatory information. No individual assessment method has been designed to quantify the use of inductive and deductive procedures within clinical reasoning. The aim of this study was to explore the feasibility and reliability of a new method which allows for the rapid identification of the style (inductive or deductive) of clinical reasoning in medical students and experts. METHODS: The study included four groups of four participants. These comprised groups of medical students in Years 3, 4 and 5 and a group of specialists in internal medicine, all at a medical school with a 6-year curriculum in France. Participants were asked to solve four clinical problems by thinking aloud. The thinking expressed aloud was immediately transcribed into concept maps by one or two 'writers' trained to distinguish inductive and deductive links. Reliability was assessed by estimating the inter-writer correlation. The calculated rate of inductive reasoning, the richness score and the rate of exhaustiveness of reasoning were compared according to the level of expertise of the individual and the type of clinical problem. RESULTS: The total number of maps drawn amounted to 32 for students in Year 4, 32 for students in Year 5, 16 for students in Year 3 and 16 for experts. A positive correlation was found between writers (R = 0.66-0.93). Richness scores and rates of exhaustiveness of reasoning did not differ according to expertise level. The rate of inductive reasoning varied as expected according to the nature of the clinical problem and was lower in experts (41% versus 67%). CONCLUSIONS: This new method showed good reliability and may be a promising tool for the assessment of medical problem-solving skills, giving teachers a means of diagnosing how their students think when they are confronted with clinical problems.

Co-creating a psychiatric resident program with Ethiopians, for Ethiopians, in Ethiopia: the Toronto Addis Ababa Psychiatry Project (TAAPP).

BACKGROUND: Globalization in medical education often means a "brain drain" of desperately needed health professionals from low- to high-income countries. Despite the best intentions, partnerships that simply transport students to Western medical schools for training have shockingly low return rates. Ethiopia, for example, has sent hundreds of physicians abroad for specialty training over the past 30 years, the vast majority of whom have not returned. This represents a highly problematic net transfer of financial and human resources from the Ethiopian people to Western countries that have failed to develop their own adequate health human resource plans. METHODS: With this background in mind, in 2003 Addis Ababa University invited the University of Toronto to collaborate on the first Ethiopian psychiatric residency program to be run entirely in Ethiopia. Called the Toronto Addis Ababa Psychiatry Project (TAAPP), it was established on the principle of supplementing the ability of the small Addis Ababa University Department of Psychiatry to teach, provide clinical supervision, and to help develop educational capacity. Over the last 6 years the model has involved a large number of University of Toronto faculty and residents who have spent blocks of 1 month each in Addis Ababa. RESULTS: This article describes the first three phases of TAAPP (I) Development of a model residency program; (II) Enhancing clinical, educational and leadership capacity; and (III) Sustainability, faculty development, and continuing education. Between 2003 and 2009, the number of psychiatrists in Ethiopia increased from 11 to 34; the Addis Ababa University Department of Psychiatry faculty increased members from three to nine. There are new departments of psychiatry established in four other university hospitals in Ethiopia outside the capital city. Mental health services are now being integrated within the national system of primary care. CONCLUSION: An important issue that underscores such a partnership is the risk of simply exporting Western, America-centric psychiatric training versus creating culturally appropriate models of education.