How to discuss transferability of qualitative research in health professions education.

Transferability is commonly identified as a quality criterion for qualitative research. This criterion was introduced by Lincoln and Guba to describe the degree to which a study's findings can be transferred to other contexts, settings or respondents. In this How To paper, we present a more nuanced, multidimensional view of transferability and explain relevant concepts, reflexive approaches and specific techniques to guide researchers in discussing transferability. We identify three dimensions of transferability for use in many approaches to qualitative research: applicability, resonance and theoretical engagement. Transferability as applicability relates to providing sufficient information for readers to evaluate the relevance of findings to other contexts. Transferability as resonance requires the researcher to present the research in a way that evokes a sense of familiarity or shared experience. Transferability as theoretical engagement refers to ways the researcher uses theory to frame a problem, connects findings to existing constructs and/or proposes a model or theory that could explain a process or phenomenon. We encourage researchers to consider all three dimensions of transferability when developing and presenting their work, keeping in mind that some dimensions may be more relevant than others based on study methodology and project goals.

How Theory Can Inform Practice: A Case of Easing Transition Into Residency.

Health professions educators aim to optimally prepare trainees for future practice; educational theory can help reach this goal. Below we present an authentic case, I Just Need to Speak With My Eyes, that displays the significant struggles of transitioning into residency training. Using this case, we show how the application of 4 learning mechanisms described in Lave and Wenger's 1,2 theories of situated learning and communities of practice can help ease the transition into residency by addressing issues like self-questioning and emotional turmoil (see the colored boxes below). Situated learning refers to learning in everyday practice and highlights its fundamentally social nature as well as the progressive participation of the learner. 1 Communities of practice builds on the notion of people learning from each other, viewing learning as a shared enterprise among a group of people with a common purpose. 2.

Using framework analysis methods for qualitative research: AMEE Guide No. 164.

Framework analysis methods (FAMs) are structured approaches to qualitative data analysis that originally stem from large-scale policy research. A defining feature of FAMs is the development and application of a matrix-based analytical framework. These methods can be used across research paradigms and are thus particularly useful tools in the health professions education (HPE) researcher's toolbox. Despite their utility, FAMs are not frequently used in HPE research. In this AMEE Guide, we provide an overview of FAMs and their applications, situating them within specific qualitative research approaches. We also report the specific characteristics, advantages, and disadvantages of FAMs in relation to other popular qualitative analysis methods. Using a specific type of FAM-i.e. the framework method-we illustrate the stages typically involved in doing data analysis with an FAM. Drawing on Sandelowski and Barroso's continuum of data transformation, we argue that FAMs tend to remain close to raw data and be descriptive or exploratory in nature. However, we also illustrate how FAMs can be harnessed for more interpretive analyses. We propose that FAMs are valuable resources for HPE researchers and demonstrate their utility with specific examples from the HPE literature.

How do peer group reflection meetings support medical students' learning and personal development during clinical rotations?

BACKGROUND: Medical schools look to support students in coping with challenges and stressors related to clinical rotations. One potential approach is implementing Intervision Meetings (IM): a peer group reflection method during which students address challenging situations and personal development issues with peers, guided by a coach. Its implementation and perceived effectiveness in undergraduate medical education has however not yet been widely studied and described. This study evaluates how students perceive the effect of a three-year IM-programme during their clinical rotations, and explores which processes and specific factors support students' personal development and learning during clinical rotations. METHODS: Using an explanatory Mixed Methodology, medical students participating in IM were asked to evaluate their experiences through a questionnaire at three time points. Questionnaire results were further explored through three focus groups. Data were analysed using descriptive statistics and thematic analysis. RESULTS: Three hundred fifty seven questionnaires were filled out by students across the three time points. Students perceived IM to contribute to their ability to cope with challenging situations during clinical rotations. Participants in the focus groups described how IM created an increase in self-awareness by active self-reflection supported by peers and the coach. Sharing and recognizing each other's' situations, stories or problems; as well as hearing alternative ways of coping, helped students to put things into perspective and try out alternative ways of thinking or behaving. CONCLUSIONS: IM can help students to better deal with stressors during clinical rotations and approach challenges as learning opportunities under the right circumstances. It is a potential method medical schools can use to aid their students on their journey of personal and professional development.

Do you see what I see? Feeding interprofessional workplace learning using a diversity of theories.

In this Commentary, Stalmeijer and Varpio highlight the importance of using different theoretical frameworks to make visible the potential of and need for research into interprofessional learning and guidance during workplace-based learning in the health professions.

Exploring the Impact of Entrustable Professional Activities on Feedback Culture: A Qualitative Study of Anesthesiology Residents and Attendings.

PURPOSE: Entrustable professional activities (EPAs) were introduced as a potential way to optimize workplace-based assessments. Yet, recent studies suggest that EPAs have not yet overcome all of the challenges to implementing meaningful feedback. The aim of this study was to explore the extent to which the introduction of EPAs via mobile app impacts feedback culture as experienced by anesthesiology residents and attending physicians. METHOD: Using a constructivist grounded theory approach, the authors interviewed a purposive and theoretical sample of residents (n = 11) and attendings (n = 11) at the Institute of Anaesthesiology, University Hospital of Zurich, where EPAs had recently been implemented. Interviews took place between February and December 2021. Data collection and analysis were conducted iteratively. The authors used open, axial, and selective coding to gain knowledge and understanding on the interplay of EPAs and feedback culture. RESULTS: Participants reflected on a number of changes in their day-to-day experience of feedback culture with the implementation of EPAs. Three main mechanisms were instrumental in this process: lowering the feedback threshold, change in feedback focus, and gamification. Participants felt a lower threshold to feedback seeking and giving and that the frequency of feedback conversations increased and tended to be more focused on a specific topic and shorter, while feedback content tended to focus more on technical skills and more attention was given to average performances. Residents indicated that the app-based approach fostered a game-like motivation to "climb levels," while attendings did not perceive a game-like experience. CONCLUSIONS: EPAs may offer a solution to problems of infrequent occurrence of feedback and invite attention to average performances and technical competencies, but may come at the expense of feedback on nontechnical skills. This study suggests that feedback culture and feedback instruments have a mutually interacting influence on each other.

Exploring nurses' role in guiding residents' workplace learning: A mixed-method study.

INTRODUCTION: Understanding residents' workplace learning could be optimized by not only considering attending physicians' role but also the role of nurses. While previous studies described nurses' role during discrete activities (e.g. feedback), a more profound understanding of how nurses contribute to residents' learning remains warranted. Therefore, we used the educational concept of guidance and explored the extent to which residents' and nurses' perceptions align regarding nurses' guiding role and which reasons they provide for their perceptions. METHODS: This mixed-method study was conducted at four Dutch university medical centres in 2021. We simultaneously collected quantitative and qualitative data from 103 residents and 401 nurses through a theory-informed questionnaire with a Likert-scale and open-ended questions. We analyzed quantitative data to explore respondents' perceptions of nurses' guiding role by using anova. The thematically analyzed qualitative open comments explored respondents' reasons for their perceptions. RESULTS: Nurses indicated to provide significantly more support (p = .01) and guidance on learning from patient care (p < .01) than perceived by residents. Moreover, nurses indicated that attending physicians did not always involve them in guiding residents, whereas residents perceived nurses were being involved (p < .001). Themes suggest that nurses and residents could be divided into two groups: (i) respondents who felt that guiding was inextricably linked to good interprofessional collaboration and patient care and (ii) respondents who saw the guiding role as limited and emphasised the distinct fields of expertise between nurses and physicians. CONCLUSIONS: Residents and nurses felt that nurses played an important role in guiding residents' workplace learning. However, some residents did not always perceive to be guided. To further capitalise on nurses' guiding role, we suggest that residents can be encouraged to engage in the learning opportunities nurses provide to achieve optimal team-based patient care.

Becoming Agents of Change: Contextual Influences on Medical Educator Professionalization and Practice in a LMIC Context.

Medical educators are particularly needed in Low- and Middle-Income Countries (LMIC), where medical schools have grown rapidly in size, number, and global outlook in response to persistent health workforce shortages and increased expectations of quality care. Educator development is thus the focus of many LMIC programs initiated by universities and governments of high income countries. While signs of medical educator professionalization such as postgraduate qualifications, specialized units, and professional associations have emerged in LMIC, whether these relate to programs originating from outside LMIC contexts is unknown. This study investigated the contextual influences on the long-term impact of an international faculty development program a decade after its delivery in a LMIC context - Vietnam.Ten years after an international aid program to develop clinical skills teaching expertise in Vietnam, we conducted in-depth qualitative interviews with eight medical educators from all eight participating medical schools. Selected for their leadership potential, each participant had completed the Maastricht Masters in Health Professions Education during the program. Interview transcripts underwent thematic analysis, using the Theory of Practice Architectures as a conceptual lens to highlight the contextual influences on professional practice.Four themes were identified: Careers and Practices before, during, and after the program, Unrecognized and Unseen practice, Structural Restraints on individual advancement and collective activity, and the Cultivation of Connections through social traditions. Participants reported being in well-established teaching delivery roles. However, the absence of professionalizing discourses and material resources meant that practice was restricted and determined by institutional leadership and individuals' adaptations.Informed by the theory of practice architectures, we found that change in medical education practice will falter in contexts that lack supporting discursive, material-economic, and socio-political arrangements. While there were emerging signs of individual agency, the momentum of change was not sustained and perhaps unapparent to Western framings of educational leadership. Practice architectures offers a framework for identifying the contextual features which influence practice, from which to design and deliver sustainable and impactful interventions, and to advance context-relevant evaluation and research. Our findings suggest that faculty development delivered across diverse contexts, such as in distributed or transnational medical programs, may have more effect if informed by a practice architectures analysis of each context.

Continuous enhancement of educational quality - fostering a quality culture: AMEE Guide No. 147.

Internal quality assurance (IQA) is one of the core support systems on which schools in the health professions rely to ensure the quality of their educational processes. Through IQA they demonstrate being in control of their educational quality to accrediting bodies and continuously improve and enhance their educational programmes. Although its need is acknowledged by all stakeholders, creating a system of quality assurance has often led to establishing a 'tick-box' exercise overly focusing on quality control while neglecting quality improvement and enhancement. This AMEE Guide uses the concept of quality culture to describe the various dimensions that need to be addressed to move beyond the tick-box exercise. Quality culture can be defined as an organisational culture which consists of a structural/managerial aspect and a cultural/psychological aspect. As such this AMEE Guide addresses tools and processes to further an educational quality culture while also addressing ways in which individual and collective awareness of and commitment to educational quality can be fostered. By using cases within health professions education of both formal and informal learning settings, examples will be provided of how the diverse dimensions of a quality culture can be addressed in practice.

Describing Ultrasound Skills Teaching by Near-Peer and Faculty Tutors Using Cognitive Apprenticeship.

Phenomenon: Ultrasound skills are becoming increasingly important in clinical practice but are resource-intensive to teach. Near-peer tutors often alleviate faculty teaching burden, but little is known about what teaching methods near-peer and faculty tutors use. Using the lens of cognitive apprenticeship, this study describes how much time faculty and near-peer tutors spend on different teaching methods during abdominal ultrasound skills training. Approach: Sixteen near-peer and 16 faculty tutors were videotaped during one 55-min practical ultrasound lesson with randomly assigned students. Videos were directly coded using Cognitive Apprenticeship teaching methods and activities. Segment durations were summed up and compared quantitatively. Findings: All 32 tutors spent most of the time on observing and helping students (Coaching, Median 29:14 minutes), followed by asking open and stimulating questions (Articulation, 12:04 minutes and demonstrating and giving explanations (Modeling, 04:50 minutes). Overall, distributions of teaching methods used were similar between faculty and near-peer tutors. However, faculty tutors spent more time on helping students manually, whereas near-peer tutors spent more time on exploring students' learning gaps and establishing a safe learning climate. Cognitive Apprenticeship was well suited as observational framework to describe ultrasound skills. Insights: Ultrasound train-the-tutor programs should particularly focus on coaching and articulation. Near-peers' similar use of teaching methods adds to the evidence that supports the use of near-peer teaching in ultrasound skills education.

Can We Realize Our Collaborative Potential? A Critical Review of Faculty Roles and Experiences in Interprofessional Education.

PURPOSE: Faculty within interprofessional education (IPE) are essential contributors to IPE implementation efforts. Although the majority of existing IPE literature consists of reports on IPE innovations, few insights are available into the experiences of the faculty members who deliver IPE. This critical narrative review was designed to synthesize the knowledge available about (1) roles assigned to IPE educators and (2) IPE faculty members' experiences of fulfilling these roles. METHOD: Six databases for English-language studies published between 2000 and March 2021 were searched: PubMed, Embase, Web of Science, MEDLINE, CINAHL, PsycINFO, ERIC, and MedEdPortal. A total of 1,717 manuscripts were identified for possible inclusion. After applying inclusion/exclusion criteria, 214 articles constituted the final literature corpus. Harden and Crosby's original framework of 6 roles of medical educators augmented with the manager role introduced in Harden and Lilley's 2018 framework informed the analysis. RESULTS: IPE faculty take on all 6 roles identified by Harden and Crosby: facilitator, planner, information provider, examiner, role model, and resource developer, as well as the manager role. Faculty were most commonly identified as facilitator and planner, and rarely as role models. The authors identified 3 main struggles experienced by IPE faculty: personal (e.g., confidence as a cross-professions educator), interpersonal (e.g., co-teaching IPE), and institutional (e.g., supporting IPE logistics). CONCLUSIONS: This review highlights the complexity of the roles taken on by IPE faculty and the struggles they experience in the process. The results suggest that attention to the different roles that IPE faculty play in educational interventions and to equipping faculty with the necessary competencies, tools, and support, is fundamental to the success of IPE. Future research should harness the explanatory power of theories to help explain dynamics at play between personal, interpersonal, and institutional barriers to identify interventions that can aid IPE faculty in delivering collaboration-ready professionals.

A practical guide to reflexivity in qualitative research: AMEE Guide No. 149.

Qualitative research relies on nuanced judgements that require researcher reflexivity, yet reflexivity is often addressed superficially or overlooked completely during the research process. In this AMEE Guide, we define reflexivity as a set of continuous, collaborative, and multifaceted practices through which researchers self-consciously critique, appraise, and evaluate how their subjectivity and context influence the research processes. We frame reflexivity as a way to embrace and value researchers' subjectivity. We also describe the purposes that reflexivity can have depending on different paradigmatic choices. We then address how researchers can account for the significance of the intertwined personal, interpersonal, methodological, and contextual factors that bring research into being and offer specific strategies for communicating reflexivity in research dissemination. With the growth of qualitative research in health professions education, it is essential that qualitative researchers carefully consider their paradigmatic stance and use reflexive practices to align their decisions at all stages of their research. We hope this Guide will illuminate such a path, demonstrating how reflexivity can be used to develop and communicate rigorous qualitative research.

Applying Landscapes of Practice Principles to the Design of Interprofessional Education.

ISSUE: Although interprofessional education (IPE) is acknowledged as a way to prepare health professions students for future interprofessional collaboration (IPC), there is a need to better ground IPE-design in learning theory. Landscapes of practice and its concepts of knowledgeability and identification are suggested as a framework that may help optimize IPE. This Observation paper provides an explanation of how these concepts might be used in IPE-design. EVIDENCE: We propose using three modes of identification, i.e., engagement, imagination, and alignment, described in this framework, for an IPE-design that fosters IPC skills, professional identity formation, and knowledgeability about a field and its actors. Identification and knowledgeability are through to enable successful collaboration across professional and practice boundaries. IMPLICATIONS: Focusing on identification implies that students develop a sense of relevance to one another in solving complex problems (engagement), they become aware of their own roles and responsibilities in relation to others (imagination), and they gain awareness of the context in which the different professions align and collaborate (alignment). Altogether, this enables students to become knowledgeable in the landscape, which prepares them for successful interprofessional collaboration in practice.

The Senior Medical Resident's New Role in Assessment in Internal Medicine.

PURPOSE: With the introduction of competency-based medical education, senior residents have taken on a new, formalized role of completing assessments of their junior colleagues. However, no prior studies have explored the role of near-peer assessment within the context of entrustable professional activities (EPAs) and competency-based medical education. This study explored internal medicine residents' perceptions of near-peer feedback and assessment in the context of EPAs. METHOD: Semistructured interviews were conducted from September 2019 to March 2020 with 16 internal medicine residents (8 first-year residents and 8 second- and third-year residents) at the University of Toronto, Toronto, Ontario, Canada. Interviews were conducted and coded iteratively within a constructivist grounded theory approach until sufficiency was reached. RESULTS: Senior residents noted a tension in their dual roles of coach and assessor when completing EPAs. Senior residents managed the relationship with junior residents to not upset the learner and potentially harm the team dynamic, leading to the documentation of often inflated EPA ratings. Junior residents found senior residents to be credible providers of feedback; however, they were reticent to find senior residents credible as assessors. CONCLUSIONS: Although EPAs have formalized moments of feedback, senior residents struggled to include constructive feedback comments, all while knowing the assessment decisions may inform the overall summative decision of their peers. As a result, EPA ratings were often inflated. The utility of having senior residents serve as assessors needs to be reexamined because there is concern that this new role has taken away the benefits of having a senior resident act solely as a coach.

Knowledgeability and Identification: Explaining Military Interprofessional Healthcare Teams' Excellence and Readiness.

The importance of successful interprofessional collaboration for effective patient care is generally acknowledged. Research into interprofessional collaboration has thus far been mainly situated in the civilian context and has mostly indicated barriers that prevent successful interprofessional collaboration. However, military interprofessional healthcare teams (MIHTs) seem to be exceptionally successful. Building on the overarching finding of the studies within this special edition-i.e., that MIHTs' readiness and excellence are in part due to healthcare professionals' "shared understanding" of what is needed to effectively serve on an MIHT-this commentary uses the theory of Landscape of Practice as a lens to further explain the processes through which healthcare professionals attain this shared understanding. Used within the fields of Health Professions Education and workplace learning, Landscapes of Practice (LoP) helps to explain how learning occurs within practice. It highlights how, by engaging within the various working environments belonging to a profession, social interactions between the various professionals within that environment form the conduit for learning. LoP highlights that the outcome of this learning process is "knowledgeability," i.e., understanding of how to engage within the field and with its players, resulting in being an acknowledged member of the field. Fostered through a process called "identification," professionals learn to see how their professional practice aligns with that of others and how to effectively collaborate with others. The commentary explains how the findings of the separate studies within this special edition strongly resonate with knowledgeability and identification. It is concluded that civilian interprofessional healthcare teams may benefit from incorporating characteristics of MIHTs in their training programs.

How culture affects validity: understanding Japanese residents' sense-making of evaluating clinical teachers.

OBJECTIVES: Traditionally, evaluation is considered a measurement process that can be performed independently of the cultural context. However, more recently the importance of considering raters' sense-making, that is, the process by which raters assign meaning to their collective experiences, is being recognised. Thus far, the majority of the discussion on this topic has originated from Western perspectives. Little is known about the potential influence of an Asian culture on raters' sense-making. This study explored residents' sense-making associated with evaluating their clinical teachers within an Asian setting to better understand contextual dependency of validity. DESIGN: A qualitative study using constructivist grounded theory. SETTING: The Japanese Ministry of Health, Labour and Welfare has implemented a system to monitor the quality of clinical teaching within its 2-year postgraduate training programme. An evaluation instrument was developed specifically for the Japanese setting through which residents can evaluate their clinical teachers. PARTICIPANTS: 30 residents from 10 Japanese teaching hospitals with experience in evaluating their clinical teachers were sampled purposively and theoretically. METHODS: We conducted in-depth semistructured individual interviews. Sensitising concepts derived from Confucianism and principles of response process informed open, axial and selective coding. RESULTS: Two themes and four subthemes were constructed. Japanese residents emphasised the awareness of their relationship with their clinical teachers (1). This awareness was fuelled by their sense of hierarchy (1a) and being part of the collective society (1b). Residents described how the meaning of evaluation (2) was coloured by their perceived role as senior (2a) and their experienced responsibility for future generations (2b). CONCLUSIONS: Japanese residents' sense-making while evaluating their clinical teachers appears to be situated and affected by Japanese cultural values. These findings contribute to a better understanding of a culture's influence on residents' sense-making of evaluation instruments and the validity argument of evaluation.

The potential of narrative analysis for HPE research: Highlighting five analytic lenses.

CONTEXT: Health professions education (HPE) has increasingly turned to qualitative methodology to address a number of the field's difficult research problems. While several different methodologies have been widely accepted and used in HPE research (e.g., Grounded Theory), others remain largely unknown. In this methodology paper, we discuss the value of narrative analysis (NA) as a set of analytic approaches that offer several lenses that can support HPE scholars' research. METHODS: After briefly discussing the 'narrative turn' in research, we highlight five NA lenses: holistic, situated, linguistic, agentive and sequential. We explore what each lens can offer HPE scholars-highlighting certain aspects of the data-and how each lens is limited-obscuring other aspects. To support these observations, we offer an example of each lens from contemporary HPE scholarship. The manuscript also describes methods that can be employed in NA research and offers two different typologies of NA methods that can be used to access these lenses. CONCLUSIONS: We conclude with a discussion of how different analytic methods can be used to harness each of the lenses. We urge the deliberate selection and use of NA methods and point to the inherent partiality of any NA approach. Reflecting on our position as narrative scholars, we acknowledge how our own lenses illuminate some areas and conceal others as we tell the story of NA. In conclusion, we invite other researchers to benefit from the potential NA promises.