Feedback, learning and becoming: Narratives of feedback in complex performance challenges.

INTRODUCTION: Becoming a general practitioner (or family medicine specialist) is challenging, as trainees learn to manage complex and ambiguous situations. Feedback is a key component of this learning. Although research has tended to focus on feedback's momentary processes and impacts, there is value in seeking to understand the work it does over time and how trainees position themselves across multiple feedback encounters. We ask: how do newly qualified GPs narrate themselves and their experiences with complex performance challenges? Within these narratives, what is the role of feedback? METHODS: The research adopts a holistic and sequential narrative analysis approach, with in-depth narrative interviews of 16 general practice trainees who had just completed their training requirements. The analysis involved restorying the participant narratives chronologically. Each narrative formed a unit of analysis where narrative commonalities across plots, characters, emotions and the role of feedback were interpreted. RESULTS: Four plotlines within GP trainees' stories of complex performance challenges were identified: Journeyperson, Hero's Quest, Solo Journeyer and Endless Struggle. Trainees, supervisors and feedback are positioned differently within these plotlines. Narratives were saturated with emotions. DISCUSSION: The plotlines bring together an alternative way of understanding how feedback, learning and becoming are woven together. They illustrate how multiple interactions with patients, supervisors, peers and systems thread together into an overall trajectory. How a trainee positions themselves as protagonists and who they characterise as their antagonists can help direct the focus of supervisors' feedback conversations.

Researching lived experience in health professional education.

INTRODUCTION: Qualitative approaches have flourished in medical education research. Many research articles use the term 'lived experience' to describe the purpose of their study, yet we have noticed contradictory uses and misrepresentations of this term. In this conceptual paper, we consider three sources of these contradictions and misrepresentations: (1) the conflation of perspectives with experiences; (2) the conflation of experience with lived experience; and (3) the conflation of researching lived experience with phenomenology. We offer suggestions to facilitate more precise use of terminology. ARGUMENT: Our starting point is to free researchers from unnecessary shackles: Not every problem in medical education should be studied through experience, nor should every study of experience be phenomenological. Data based on participants' perceptions, beliefs, opinions and thoughts, while based on reflections of experiences, are not in and of themselves accounts of experience. Lived experiences are situated, primal and pre-reflective; perspectives are more abstract. Lived experience-as opposed to experiences as such-deeply attune to bodies, relationality, space and time. There is also a difference between experiences as lived, how a person makes sense of these and what the researcher interprets and represents. Phenomenology is a meaningful approach to the study of lived experience, but other approaches, such as narrative inquiry and self-study, can also offer useful avenues for undertaking this type of research. DISCUSSION: We aim to broaden researchers' scope with this paper and equip researchers with the information they need to be clear about the meaning and use of the terms experience and lived experience. We also hope to open new methodological possibilities for researching experiences as lived and, through highlighting tensions, to prompt researchers of lived experience to strive for ontological closeness and resonance.

Non-communicable diseases, digital education and considerations for the Indian context - a scoping review.

INTRODUCTION: The increasing ageing of the population with growth in NCD burden in India has put unprecedented pressure on India's health care systems. Shortage of skilled human resources in health, particularly of specialists equipped to treat NCDs, is one of the major challenges faced in India. Keeping in view the shortage of healthcare professionals and the guidelines in NEP 2020, there is an urgent need for more health professionals who have received training in the diagnosis, prevention, and treatment of NCDs. This paper conducts a scoping review and aims to collate the existing evidence on the use of digital education of health professionals within NCD topics. METHODS: We searched four databases (Web of Science, PubMed, EBSCO Education Research Complete, and PsycINFO) using a three-element search string with terms related to digital education, health professions, and terms related to NCD. The inclusion criteria covered the studies to be empirical and NCD-related with the target population as health professionals rather than patients. Data was extracted from 28 included studies that reported on empirical research into digital education related to non-communicable diseases in health professionals in India. Data were analysed thematically. RESULTS: The target groups were mostly in-service health professionals, but a considerable number of studies also included pre-service students of medicine (n = 6) and nursing (n = 6). The majority of the studies included imparted online learning as self-study, while some imparted blended learning and online learning with the instructor. While a majority of the studies included were experimental or observational, randomized control trials and evaluations were also part of our study. DISCUSSION: Digital HPE related to NCDs has proven to be beneficial for learners, and simultaneously, offers an effective way to bypass geographical barriers. Despite these positive attributes, digital HPE faces many challenges for its successful implementation in the Indian context. Owing to the multi-lingual and diverse health professional ecosystem in India, there is a need for strong evidence and guidelines based on prior research in the Indian context.

Data driven or data informed? How general practitioners use data to evaluate their own and colleagues' clinical work in clusters.

In contemporary policy discourses, data are presented as key assets for improving health-care quality: policymakers want health care to become 'data driven'. In this article, we focus on a particular example of this ambition, namely a new Danish national quality development program for general practitioners (GPs) where doctors are placed in so-called 'clusters'. In these clusters, GPs are obliged to assess their own and colleagues' clinical quality with data derived from their own clinics-using comparisons, averages and benchmarks. Based on semi-structured interviews with Danish GPs and drawing on Science and Technology Studies, we explore how GPs understand these data, and what makes them trust-or question-a data analysis. The GPs describe how they change clinical practices based on these discussions of data. So, when and how do data for quality assurance come to influence their perceptions of quality? By exploring these issues, we carve out a role for a sociological engagement with evidence in everyday medical practices. In conclusion, we suggest a need to move from the aim of being data driven to one of being data informed.

Meaning making about performance: A comparison of two specialty feedback cultures.

INTRODUCTION: Specialty trainees often struggle to understand how well they are performing, and feedback is commonly seen as a solution to this problem. However, medical education tends to approach feedback as acontextual rather than located in a specialty-specific cultural world. This study therefore compares how specialty trainees in surgery and intensive care medicine (ICM) make meaning about the quality of their performance and the role of feedback conversations in this process. METHODS: We conducted a qualitative interview study in the constructivist grounded theory tradition. We interviewed 17 trainees from across Australia in 2020, eight from ICM and nine from surgery, and iterated between data collection and analytic discussions. We employed open, focused, axial and theoretical coding. FINDINGS: There were significant divergences between specialties. Surgical trainees had more opportunity to work directly with supervisors, and there was a strong link between patient outcome and quality of care, with a focus on performance information about operative skills. ICM was a highly uncertain practice environment, where patient outcome could not be relied upon as a source of performance information; valued performance information was diffuse and included tacit emotional support. These different 'specialty feedback cultures' strongly influenced how trainees orchestrated opportunities for feedback, made meaning of their performance in their day-to-day patient care tasks and 'patched together' experiences and inputs into an evolving sense of overall progress. DISCUSSION: We identified two types of meaning-making about performance: first, trainees' understanding of an immediate performance in a patient-care task and, second, a 'patched together' sense of overall progress from incomplete performance information. This study suggests approaches to feedback should attend to both, but also take account of the cultural worlds of specialty practice, with their attendant complexities. In particular, feedback conversations could better acknowledge the variable quality of performance information and specialty specific levels of uncertainty.

Digital education for health professionals in India: a scoping review of the research.

BACKGROUND: The World Health Organization (WHO) predicts a global shortfall of 18 million health workers by 2030, particularly in low- and middle-income countries like India. The country faces challenges such as inadequate numbers of health professionals, poor quality of personnel, and outdated teaching styles. Digital education may address some of these issues, but there is limited research on what approaches work best in the Indian context. This paper conducts a scoping review of published empirical research related to digital health professions education in India to understand strengths, weaknesses, gaps, and future research opportunities. METHODS: We searched four databases using a three-element search string with terms related to digital education, health professions, and India. Data was extracted from 36 included studies that reported on empirical research into digital educational innovations in the formal health professions education system of India. Data were analysed thematically. RESULTS: Most study rationales related to challenges facing the Indian health care system, rather than a wish to better understand phenomena related to teaching and learning. Similarly, most studies can be described as general evaluations of digital educational innovations, rather than educational research per se. They mostly explored questions related to student perception and intervention effectiveness, typically in the form of quantitative analysis of survey data or pre- and post-test results. CONCLUSIONS: The analysis revealed valuable insights into India-specific needs and challenges. The Indian health professions education system's size and unique challenges present opportunities for more nuanced, context-specific investigations and contributions to the wider digital education field. This, however, would require a broadening of methodological approaches, in particular rigorous qualitative designs, and a focus on addressing research-worthy educational phenomena.

Assessor discomfort and failure to fail in clinical performance assessments.

BACKGROUND: Assessment of trainee performance in the workplace is critical to ensuring high standards of clinical care. However, some supervisors find the task to be challenging, and may feel unable to deliver their true judgement on a trainee's performance. They may 'keep MUM' (that is, keep mum about undesirable messages) and fail to fail an underperforming trainee. In this study, we explore the effect of discomfort on assessors. METHODS: Using a survey method, supervisors of trainees in the Australasian College of Dermatologists were asked to self-report experiences of discomfort in various aspects of trainee workplace assessment and for their engagement in MUM behaviours including failure to fail. RESULTS: Sixty-one responses were received from 135 eligible assessors. 12.5% of assessors self-reported they had failed to fail a trainee and 18% admitted they had grade inflated a trainee's score on a clinical performance assessment in the previous 12-month period. Assessors who reported higher levels of discomfort in the clinical performance assessment context were significantly more likely to report previously failing to fail a trainee. The study did not reveal significant associations with assessor demographics and self-reports of discomfort or MUM behaviours. CONCLUSIONS: This study reveals the impact of assessor discomfort on the accuracy of assessment information and feedback to trainees, including as a contributing factor to the failure to fail phenomenon. Addressing assessor experience of discomfort offers one opportunity to impact on the complex and multifactorial issue that failure to fail represents.

Trust, power and learning in workplace-based assessment: The trainee perspective.

For trainees to participate meaningfully in workplace-based assessment (WBA), they must have trust in their assessor. However, the trainee's dependent position complicates such trust. Understanding how power and trust influence WBAs may help us make them more effective learning opportunities. We conducted semi-structured interviews with 17 postgraduate anaesthesia trainees across Australia and New Zealand. Sensitised by notions of power, we used constructivist grounded theory methodology to examine trainees' experiences with trusting their supervisors in WBAs. In our trainee accounts, we found that supervisors held significant power to mediate access to learning opportunities and influence trainee progress in training. All episodes where supervisors could observe trainees, from simply working together to formal WBAs, were seen to generate assessment information with potential consequences. In response, trainees actively acquiesced to a deferential role, which helped them access desirable expertise and minimise the risk of reputational harm. Trainees granted trust based on how they anticipated a supervisor would use the power inherent in their role. Trainees learned to ration exposure of their authentic practice to supervisors in proportion to their trust in them. Trainees were more trusting and open to learning when supervisors used their power for the trainee's benefit and avoided WBAs with supervisors they perceived as less trustworthy. If assessment for learning is to flourish, then the trainee-supervisor power dynamic must evolve. Enhancing supervisor behaviour through reflection and professional development to better reward trainee trust would invite more trainee participation in assessment for learning. Modifying the assessment system design to nudge the power balance towards the trainee may also help. Modifications could include designated formative and summative assessments or empowering trainees to select which assessments count towards progress decisions. Attending to power and trust in WBA may stimulate progress towards the previously aspirational goal of assessment for learning in the workplace.

The influence of psychological safety on feedback conversations in general practice training.

INTRODUCTION: Fostering trainee psychological safety is increasingly being recognised as necessary for effective feedback conversations. Emerging literature has explored psychological safety in peer learning, formal feedback and simulation debrief. Yet, the conditions required for psychologically safe feedback conversations in clinical contexts, and the subsequent effects on feedback, have not been explored. METHODS: We conducted a qualitative study using interviews and longitudinal audio-diaries with 12 rural general practice trainees. The data were analysed using framework thematic analysis to identify factors across the data and as individual participant case studies with illustrative vignettes of dynamic interleaving of factors in judgements about feedback conversations. FINDINGS: Findings identify the influence of intrapersonal (e.g. confidence and comfort to seek help), interpersonal (e.g. trust and relationship) and sociocultural factors (e.g. living and working in a rural community) that contribute to psychological safety in the context of everyday feedback conversations. Multiple factors interplayed in feedback conversations where registrars could feel safe and unsafe within one location and even at the one time. DISCUSSION: Participants felt psychologically safe to engage their educators in sanctioned systems of conversation related to the immediate care of the patient and yet unsafe to engage in less patient related performance conversations despite the presence of multiple positive interpersonal factors. The concept of a safe 'container' (contained space) is perhaps idealised when it comes to feedback conversations about performance in the informal and emergent spaces of postgraduate training. More research is needed into understanding how clinical environments can sanction feedback conversations in clinical environments.

Learning to recognise what good practice looks like: how general practice trainees develop evaluative judgement.

The nature of healthcare means doctors must continually calibrate the quality of their work within constantly changing standards of practice. As trainees move into working as fully qualified professionals, they can struggle to know how well they are practising in the absence of formal oversight. They therefore need to build their evaluative judgement: their capability to interpret cues and messages from the clinical environment, allowing them to judge quality of practice. This paper explores how Australian general practice (GP) trainees develop their evaluative judgement. We interviewed 16 GPs, who had recently completed certification requirements, asking them how they managed complex learning challenges across their training trajectory. A thematic analysis was sensitised by conceptualisations of evaluative judgement and feedback for future practice. Findings are reported via three themes: sources of performance relevant information; sense-making about progress within complex learning challenges; and changing practice as evaluative judgement develops. Trainees actively sought to understand what quality practice looked like within complex and ambiguous circumstances but often found it difficult to calibrate their performance. While reflective practice was key to developing evaluative judgment, feedback conversations could provide significant opportunities for trainees and supervisors to co-construct meaning. A 'feedback community' was available for frequent instances where supervisors were absent or not regarded as entirely credible, although feedback conversations in themselves did not necessarily assist trainees to develop evaluative judgement. There is room for a more active role for supervisors in assisting trainees to consider how to independently make sense of learning cues.

"Attending lectures in your pyjamas": student agency in constrained circumstances.

COVID-19 forced the digitalisation of teaching and learning in a response often described as emergency remote teaching (ERT). This rapid response changed the social, spatial, and temporal arrangements of higher education and required important adaptations from educators and students alike. However, while the literature has examined the constraints students faced (e.g. availability of the internet) and the consequences of the pandemic (e.g. student mental health), students' active management of these constraints for learning remains underexplored. This paper aims to "think with" COVID-19 to explore student agency in home learning under constrained circumstances. This qualitative study used semi-structured interviews to understand the day-to-day actions of nineteen undergraduate students managing their learning during the COVID-19 lockdowns in Victoria, Australia. Emirbayer and Mische's multiple dimensions of agency - iterative, projective, and practical-evaluative - are used to explore student experience. The findings illustrate students' adaptability and agency in navigating life-integrated learning, with most of their actions oriented to their present circumstances. This practical evaluative form of agency was expressed through (1) organising self, space, time, and relationships; (2) self-care; and (3) seeking help. Although this study took place in the context of ERT, it has implications beyond the pandemic because higher education always operates under constraints, and in other circumstances, many students still experience emotionally and materially difficult times.

Invoking culture in medical education research: A critical review and metaphor analysis.

INTRODUCTION: 'Culture' is a word frequently invoked within medical education literature to explain challenges faced by learners in practice. While social settings and practices are widely acknowledged as critical influences on medical education, there is vast variability in how the term 'culture' is employed. This may lead to confusion, resulting in assumptions and oversights. OBJECTIVE: This critical literature review aims to characterise how the term 'culture' is explicitly and implicitly conceptualised in medical education research. METHODS: Four leading English language journals in the medical education field were searched in a twelve-month period for research papers or reviews that mentioned culture in title or abstract in a substantive way. A content analysis was undertaken of extracted definitions. In addition, metaphor analysis was used to identify conceptual metaphors, which were subsequently clustered thematically. RESULTS: Our search yielded 26 papers, 8 of which contained definitions, mostly from the organisational literature. We interpreted nine conceptual metaphors related to how the term culture was employed (terroir, divider, dominant force, toxic force, obstacle, microclimate, object, brand and holdall) in four categories (unchanging, powerful, can adapt around, can be used). DISCUSSION: This critical review reveals that medical education as a field: 1) draws most explicitly from the organisational literature; 2) invokes culture in multiple means but in ways that privilege either acontextual human agency or all-powerful social forces; and 3) regards culture as a negative or neutral force but rarely a positive one. There is a notable absence around conceptualisations of 'culture' that allow educator, student and administrator agency but at the same time acknowledge the deep forces that various social settings and practices exert. Other literatures investigating learning cultures and cultural reflexivity focus on this nexus and may provide possible means to advance considerations of culture within medical education research.

The hidden labours of designing the Objective Structured Clinical Examination: a Practice Theory study.

Objective Structured Clinical Examinations (OSCEs) have become ubiquitous as a form of assessment in medical education but involve substantial resource demands and considerable local variation. A detailed understanding of the processes by which OSCEs are designed and administered could improve feasibility and sustainability. This exploration of OSCE design is informed by Practice Theory, which suggests assessment design processes are dynamic, social and situated activities. The overall purpose is to provide insights that inform on-the-ground OSCE administration. Fifteen interviews were conducted with OSCE academics and administrators from three medical schools in Australia, the United Kingdom and Canada. Drawing from post-qualitative inquiry, Schatzki's Practice Theory was used both as a sensibility and as an analytic framework. OSCE design was characterised by planning activities, administration activities, negotiation activities and bureaucratic activities; it involves significant and resource-intensive effort in negotiation and coordination. There was considerable local variation but at the same time activities were remarkably consonant across national boundaries. There was a tension between general understandings such as reliability and validity that underpin the OSCE and the improvisational practices associated with design and administration. Our findings highlighted the role of blueprints as a key coordinating artefact but with too many rules and procedures prompting cycles of bureaucracy and complexity. Emphasising coordination rather than standardisation might ease workloads, support adaptation to local environments and prevent an overly reductive approach to this assessment format.

'You should see a doctor', said the robot: Reflections on a digital diagnostic device in a pandemic age.

AIMS: In three days at the beginning of the COVID-19 pandemic, the Copenhagen Emergency Medical Services developed a digital diagnostic device. The purpose was to assess and triage potential COVID-19 symptoms and to reduce the number of calls to public health-care helplines. The device was used almost 150,000 times in a few weeks and was described by politicians and administrators as a solution and success. However, high usage cannot serve as the sole criterion of success. What might be adequate criteria? And should digital triage for citizens by default be considered low risk? METHODS: This paper reflects on the uncertain aspects of the performance, risks and issues of accountability pertaining to the digital diagnostic device in order to draw lessons for future improvements. The analysis is based on the principles of evidence-based medicine (EBM), the EU and US regulations of medical devices and the taxonomy of uncertainty in health care by Han et al. RESULTS: Lessons for future digital devices are (a) the need for clear criteria of success, (b) the importance of awareness of other severe diseases when triaging, (c) the priority of designing the device to collect data for evaluation and (d) clear allocation of responsibilities. CONCLUSIONS: A device meant to substitute triage for citizens according to its own criteria of success should not by default be considered as low risk. In a pandemic age dependent on digitalisation, it is therefore important not to abandon the ethos of EBM, but instead to prepare the ground for new ways of building evidence of effect.

Approaching culture in medical education: Three perspectives.

BACKGROUND: The notion of culture is increasingly invoked in the medical education literature as a key influence on how educational strategies unfold, and culture change is frequently identified as a necessary precursor to progress. A meaningful perspective on what culture means is often missing from these discussions, however. Without a theoretically grounded notion of culture, calls for culture change are challenging to interpret and to act upon. OBJECTIVE: In this cross-cutting edge paper, we explore how culture has been defined and theorised using three lenses: the organisational perspective; the identity perspective, and the practice perspective. We consider what each perspective might offer to medical education researchers. RESULTS: Each of these perspectives draws on a range of disciplinary influences, and none represents a singular theory of culture. Broadly, the organisational perspective directs our attention to the shared assumptions and values that bind individuals within an organisation. It tends to view culture through a strategic lens; culture may be either a barrier to or a facilitator of the changes that are inevitably required of an organisation if it is to maintain its relevance. The identity perspective, particularly the notion of figured worlds, alerts us to the power of communal narratives to shape how individuals see themselves within particular cultural worlds. The practice perspective emphasises what actually occurs in practice, avoiding symbolic ideas about culture and shared values and instead privileging activity and human-material networks or arrangements. CONCLUSIONS: These diverse perspectives share a common thread- they shift our research gaze beyond the individual, allowing us instead to see how those individuals form organisations, inhabit cultural worlds and constitute practices. They afford substance and direction for explorations of culture, and thus offer the promise of a more nuanced understanding of some of medical education's most challenging problems.

Challenging feedback myths: Values, learner involvement and promoting effects beyond the immediate task.

CONTEXT: Research suggests that feedback in the health professions is less useful than we would like. In this paper, we argue that feedback has become reliant on myths that perpetuate unproductive rituals. Feedback often resembles a discrete episode of an educator "telling," rather than an active and iterative involvement of the learner in a future-facing process. With this orientation towards past events, it is not surprising that learners become defensive or disengaged when they are reminded of their deficits. METHODS: We tackle three myths of feedback: (a) feedback needs praise-criticism balancing rules; (b) feedback is a skill residing within the teacher; and (c) feedback is an input only. For each myth we provide a reframing with supporting examples from the literature. CONCLUSIONS: Equipping learners to engage in feedback processes may reduce the emotional burden on both parties, rendering techniques such as the feedback sandwich redundant. We also highlight the benefits for learners and teachers of conceptualising feedback as a relational activity, and of tracing the effects of information exchanges. These effects may be immediate or latent, and may manifest in different forms such as changes in learner evaluative judgement or professional identity.

Shadow systems in assessment: how supervisors make progress decisions in practice.

Medical educators are tasked with decisions on trainee progression and credentialing for independent clinical practice, which requires robust evidence from workplace-based assessment. It is unclear how the current promotion of workplace-based assessment as a pedagogical approach to promote learning has impacted this use of assessments for decision-making; meeting both these purposes may present unforeseen challenges. In this study we explored how supervisors make decisions on trainee progress in practice. We conducted semi-structured interviews with 19 supervisors of postgraduate anesthesia training across Australia and New Zealand and undertook thematic analysis of the transcripts. Supervisors looked beyond the formal assessment portfolio when making performance decisions. They instead used assessment 'shadow systems' based on their own observation and confidential judgements from trusted colleagues. Supervisors' decision making involved expert judgement of the perceived salient aspects of performance and the standard to be attained while making allowances for the opportunities and constraints of the local learning environment. Supervisors found making progress decisions an emotional burden. When faced with difficult decisions, they found ways to share the responsibility and balance the potential consequences for the trainee with the need to protect their patients. Viewed through the lens of community of practice theory, the development of assessment 'shadow systems' indicates a lack of alignment between local workplace assessment practices and the prescribed programmatic assessment approach to high-stakes progress decisions. Avenues for improvement include cooperative development of formal assessment processes to better meet local needs or incorporating the information in 'shadow systems' into formal assessment processes.

Embracing the tension between vulnerability and credibility: 'intellectual candour' in health professions education.

The tension between expressing vulnerability and seeking credibility creates challenges for learning and teaching. This is particularly true in health care, in which practitioners are regarded as highly credible and making errors can often lead to dire consequences and blame. From a transformative learning perspective, expressing vulnerability may help individuals to access different ways of knowing. By contrast, from a sociological perspective, seeking to maintain credibility results in ritualised interactions and these ritualised encounters can reinforce credibility. One means of embracing this tension between expressing vulnerability and appearing credible is 'intellectual candour', an improvisational expression of doubts, thoughts and problems with the dual purpose of learning and promoting others' learning. Educators' revelations of inner struggles are proposed as a means of inviting reciprocal vulnerability. This builds trust and a platform for learning, particularly of the transformative nature. It also allows modelling of how to balance the vulnerability-credibility tension, which may provide a template for professional practice.