Towards accountability-centred practices: governance in OSCEs subordinating patient and practitioner clinical experience.

New public management ideals and standards have become increasingly adhered to in health professions education; this is particularly apparent in high-stakes assessment, as a gateway to practice. Using an Institutional Ethnographic approach, we looked at the work involved in running high-stakes Objective Structured Clinical Exams (OSCEs) throughout an academic year including use of observations, interviews and textual analysis. In our results, we describe three types of 'work'-standardising work, defensibility work and accountability work-summarising these in the discussion as an Accountability Circuit, which shows the organising role of texts on people's work processes. We show how this form of governance mandates a shift towards accountability-centred practices, away from practices which are person-centred; this lens on accountability-centring during high-stakes assessments invites critique of the often-unquestioned emphasis of new public management in health professions education.

Harnessing insights from an activity system - OSCEs past and present expanding future assessments.

Objective Structured Clinical Examinations (OSCEs) are a dominant, yet problematic, assessment tool across health professions education (HPE). OSCEs' standardised approach aligns with regulatory accountability, allowing learners to exchange exam success for the right to practice. We offer a sociohistorical account of OSCEs' development to support an interpretation of present assessment practices. OSCEs create tensions. Preparing for OSCE success diverts students away from the complexity of authentic clinical environments. Students will not qualify and will, therefore, be of no use to patients without getting marks providing evidence of competence. Performing in a formulaic and often non patient-centred way is the price to pay for a qualification. Acknowledging the stultifying effect of standardising human behaviour for OSCEs opens up possibilities to release latent energy for change in medical education. In this imagined future, the overall object of education is refocused on patient care.

Lost in translation? Paradigm conflict at the primary-secondary care interface.

CONTEXT: Historically, primary care (community and family) medicine has often been viewed as lower status than secondary care (hospital) practice. Current evidence suggests this pattern continues to impact medical practice and education. Medical education has however, yet to fully reflect this power dynamic, with undergraduate training in many institutions maintaining the hegemonic position of secondary care as the prime context for learning. METHODS: In this paper, we present primary and secondary care as conflicting paradigms of medical practice. Using a sociocultural lens drawing on Figured Worlds theory, implications for medical education are explored. CONCLUSIONS: We outline the two paradigms as having distinct epistemologies, identities and practices. Tensions at the primary-secondary care interface can, from a sociocultural perspective, be seen to impact developing identity and day-to-day clinical practice issues such as patient safety. We offer possibilities for engaging with paradigm conflict in meaningful ways and suggest potential changes for future educational policy and practice.

The show must go on? Patients, props and pedagogy in the theatre of the OSCE.

According to Shakespeare, all the world's a stage, and all the men and women merely players. The objective structured clinical examination (OSCE), that most ubiquitous form of assessment in health professions education, offers us a particular instance of this maxim. Comprising at first glance a world of psychometric data, detailed checklists and global rating scales, the OSCE sets out to facilitate the assessment of a candidate's competence in a highly standardised and objective fashion. Despite this clear intention, OSCEs also offer a rich vein of (often unacknowledged) social and cultural processes. In this commentary, we draw on Goffman's dramaturgy metaphor and our experiences to undertake a wry examination of some of the least intended consequences of OSCEs. We take a satirical look at both the potential impact on patients and the pedagogical implications of this form of assessment. We now urge you to sit back, settle in and enjoy the show, as we raise the curtain on this one-night-only performance!

The view from over there: reframing the OSCE through the experience of standardised patient raters.

CONTEXT: Ratings awarded by standardised patients (SPs) in UK objective structured clinical examinations (OSCEs) are typically based on humanistic (non-technical) skills and are complementary to clinician-examiner ratings. In psychometric terms, SP ratings appear to differ from examiner ratings and improve reliability. For the first time, we used qualitative methods from a constructivist perspective to explore SP experiences of rating, and consider how these impact our understanding of assessment. METHODS: We used constructivist grounded theory to analyse data from focus groups and individual semi-structured interviews with 38 SPs and four examiners. Inductive coding, theoretical sampling and constant comparison continued until theoretical saturation was achieved. RESULTS: Standardised patients assessed students on the core process of relationship building. Three theoretical categories informed this process. The SP identity was strongly vocational and was both enacted and reinforced through rating as SPs exerted their agency to protect future patients by promoting student learning. Expectations of performance drew on individual life experiences in formulating expectations of doctors against which students were measured, and the patient experience was a lens through which all interactions were refracted. Standardised patients experienced the examination as real rather than simulated. They rated holistically, prioritised individuality and person-centredness, and included technical skill because the perception of clinical competence was an inextricable part of the patient experience. CONCLUSIONS: The results can be used to reframe understanding of the SP role and of the psychometric discourse of assessment. Ratings awarded by SPs are socially constructed and reveal the complexity of the OSCE process and the unfeasibility of absolute objectivity or standardisation. Standardised patients valued individuality, subjective experience and assessment for learning. The potential of SPs is under-used their greater involvement should be used to promote real partnership as educators move into a post-psychometric era. New-generation assessments should strive to value subjective experience as well as psychometric data in order to utilise the significant potential for learning within assessment.

Proof-of-principle pilot study of oropharyngeal air-pulse application in individuals with dysphagia after hemispheric stroke.

OBJECTIVE: To test the hypothesis that oropharyngeal air-pulse application is associated with increased swallowing rates in individuals with dysphagia secondary to stroke. DESIGN: Case control. SETTING: Stroke rehabilitation hospital or home setting. PARTICIPANTS: Convenience sample of individuals (N=8) with new-onset dysphagia after stroke. INTERVENTIONS: Air-pulse trains were applied to the oropharynx of 8 subjects who presented with dysphagia after hemispheric stroke. Resting swallowing rates were determined for 5 experimental conditions: baseline without air-pulse mouthpiece, baseline with mouthpiece in situ, unilateral right oropharyngeal air-pulse, unilateral left oropharyngeal air-pulse, and bilateral oropharyngeal air-pulse application. Individual swallowing responses were analyzed using a 2-SD band method. MAIN OUTCOME MEASURE: Swallowing rate (swallows/min). RESULTS: Swallowing rates associated with bilateral air-pulse application were greater than baseline in 4 of the 8 subjects. The 4 subjects who demonstrated this response to air-pulse application had greater baseline swallowing rates than did subjects whose swallowing rates were not altered in association with air-pulse application. CONCLUSIONS: Oropharyngeal air-pulse trains can be applied in individuals with swallowing impairment. Air-pulse application is associated with increased resting swallowing rates in some individuals with dysphagia secondary to hemispheric stroke. Further research should extend this proof-of-principle study by examining the efficacy of oropharyngeal air-pulse application in terms of improved swallowing and related outcomes in dysphagic stroke through a large randomized trial.

The level playing field: the impact of assessment practice on professional development.

CONTEXT: The effects of assessment practice on students' learning are unclear, particularly regarding professional development. Corralling in objective structured clinical examinations (OSCEs) is designed to reduce illicit passing of examination information. Candidates completing an examination are kept secluded until the next cohort of examinees has begun. We used the introduction of corralling as a context in which to explore social influences on examination misconduct, with the aims of improving understanding of the hidden effects of assessment, and evaluating the acceptability of corralling from the student perspective. METHODS: A questionnaire was administered to students corralled post-OSCE for the first time. Eleven semi-structured interviews were subsequently conducted. Questionnaire data were analysed for descriptive statistics and thematic analysis of interview transcripts was carried out. RESULTS: The questionnaire response rate was 95.4% (251/263). Before corralling, 80.9% (203/251) of students were aware of the sharing of information among peers and 78.5% (197/251) agreed that such misconduct was unprofessional. The majority were in favour of corralling (90.8%, 228/251). Four themes emerged from the semi-structured interviews: the student network versus the individual; assessment-driven culture; the deferring of professionalism, and the 'level playing field'. Students saw interaction within the student network, on a background of assessment-driven culture, as the key driver in examination misconduct. Conforming to the rules of the social network was prioritized over individual agency, although the mismatch between the rules of the network and the dominant professional discourse caused some conflict for individuals. Deferred professionalism (described as the practice of taking on the norms of professional behaviour only when qualified) was a rationalisation used to minimise this conflict. Corralling provided a 'level playing field' in which the influences of the network were minimised. CONCLUSIONS: Examination misconduct is thus a complex social construction with implications for individual learners in terms of professional development. Corralling is one mechanism for addressing misconduct that is acceptable to students, but assessment processes have important hidden effects which educators should acknowledge.

Revised paper ASIM-D-21-00055R1: "Consulting properly rather than acting": advocating for real patient involvement in summative OSCEs.

BACKGROUND: In this "Advancing simulation practice" article, we offer an expose of the involvement of real patients in Objective Structured Clinical Examinations (OSCEs), inviting educators who traditionally involve solely SPs in their summative OSCEs to consider the practice. The need for standardisation in summative assessments can make educators understandably wary to try this, even if the rhetoric to involve real patients is accepted. We offer this as an instance of the tussle between standardisation and validity experienced throughout health professions education. MAIN TEXT: We offer our experience and empirical evidence of this simulation practice, based on an institutional ethnographic examination of the involvement of real patients in summative OSCEs from an undergraduate medical school in the UK. Our critique demonstrates the merits of this approach as an assessment environment closer to the real clinical environments where these soon-to-be doctors interact in a more authentic way with real patients and their illness experiences. We balance this against the extra work required for all involved and suggest the biggest challenge is in the reorientation work required for both Faculty and students who are institutionalised to expect standardisation above all in assessment. CONCLUSION: We advocate for involving real patients in summative OSCEs and hope that readers may feel compelled and empowered to foster this shift in mindset required to introduce this practice into their assessments.

Scenes, symbols and social roles: raising the curtain on OSCE performances.

INTRODUCTION: Objective structured clinical examinations (OSCEs) are a complex form of assessment, where candidates can interact with 'patients' in a constructed socio-clinical encounter. Conceptualizing OSCEs as a complex socially and culturally situated activity offers important research affordances. There are concerns that OSCEs may encourage more strategic 'tick-box' candidate behaviours and have a potential negative impact on learner identity formation. This study explored, at a micro-level, the social roles and behaviours occurring within the OSCE triad of simulated patients, candidates and examiners. We used a theoretical framework drawn from Goffman's dramaturgy metaphor. METHODS: OSCE candidates, examiners and simulated patients were invited, consented and recruited using maximal variation sampling. Participants were allocated to a summative OSCE circuit that had unobtrusive video cameras. Video footage of 18 stations was transcribed. Analysis was interpretative and iterative until a rich and thick description was achieved. RESULTS: Focusing on elements of Goffman's dramaturgy metaphor, we foregrounded our analysis by considering the performers, costumes, props and the theatre of the OSCE. A combination of symbols, both physical and semiotic, was used to construct and maintain layered roles and identities within this tightly defined socio-clinical setting. Informed by this foregrounding, we then considered the social interactions and behaviours within the OSCE: 'Creating the right impression?', 'A performance of contradictions?' and 'Simulated patients: patients or props?' DISCUSSION: In the pursuit of standardization, OSCEs have potential to mediate less desirable test-taking behaviours that are not entirely patient-centric, and beyond this may have an impact on professional identity. Whilst OSCE checklists provide objectivity, they have potential to promote a presentation of self that is in tension with good medical practice. The certainty of checklists needs to be looked at afresh in order to better reflect the many uncertainties that doctors face in real clinical practice. This research opens up new ways of thinking and enhancing future assessment practices.

Honoring Medicine's Social Contract: A Scoping Review of Critical Consciousness in Medical Education.

PURPOSE: To explore how the construct of critical consciousness has been conceptualized within the medical education literature and identify the main elements of critical consciousness in medical education so as to inform educational strategies to foster socially conscious physicians. METHOD: In March 2019, the authors conducted a literature search of 4 databases and Google Scholar, seeking articles discussing critical consciousness in medical education published any time after 1970. Three of the authors screened articles for eligibility. Two transcribed data using a data extraction form and identified preliminary emerging themes, which were then discussed by the whole research team to ensure agreement. RESULTS: Of the initial 317 articles identified, 20 met study inclusion criteria. The publication of academic articles around critical consciousness in medical education has expanded substantially since 2017. Critical consciousness has been conceptualized in the medical education literature through 4 overlapping themes: (1) social awareness, (2) cultural awareness, (3) political awareness, and (4) awareness of educational dynamics. CONCLUSIONS: Critical consciousness has been conceptualized in medical education as an intellectual construct to foster a reflexive awareness of professional power in health care, to unearth the values and biases legitimizing medicine as currently practiced, and to foster transformation and social accountability. Scholars highlighted its potential to improve sociocultural responsibility and to foster compassion in doctors. Adopting a critical pedagogy approach in medical education can help uphold its social accountability through an intrinsic orientation to action, but any enterprise working toward embedding critical pedagogy within curricula must acknowledge and challenge the current structure and culture of medical education itself.

Why institutional ethnography? Why now? Institutional ethnography in health professions education.

This 'A Qualitative Space' article takes a critical look at Dorothy Smith's approach to inquiry known as institutional ethnography and its potentiality in contemporary health professions education research. We delve into institutional ethnography's philosophical underpinnings, setting out the ontological shift that the researcher needs to make within this critical feminist approach. We use examples of research into frontline healthcare, into the health work of patients and into education to allow the reader to consider what an institutional ethnography research project might offer. We lay out our vision for potential growth for institutional ethnography research within the health professions education field and explain why we see this as the opportune moment to adopt institutional ethnography to meet some of the challenges facing health professions education in a way that offers informed change.

Blurred boundaries: sexuality and power in standardised patients' negotiations of the physical examination.

BACKGROUND: Working with standardised or simulated patients (SPs) is now commonplace in Simulated Learning Environments. Embracing the fact that they are not a homogenous group, some literature suggests expansion of learning with SPs in health professional education by foregrounding their personal experiences. Intimate examination teaching, whether with or without the help of SPs, is protected by a particular degree of ceremony given the degree of potential vulnerability. However, other examinations may be equally intrusive for example the close proximity of an eye examination or a chest examination in a female patient. In this study, we looked at SPs' experiences of boundary crossing in any examinations, sensitised by Foucault's concept of the clinical gaze. We wished to problematise power relations that construct and subject SPs as clinical tools within simulation-based education. METHODS: We collected data from 22 SPs, through five focus groups. Analysis was an iterative process, using thematic analysis. Data collection and reflexive analysis continued iteratively until concepts were fully developed and all theoretical directions explored. RESULTS: Students and SPs construct simulated teaching consultations by negotiating the unequal distribution of power between them. The SPs themselves discussed how they, perhaps unknowingly, acted in accordance with the discourse of the clinical gaze. However, SPs became disempowered when students deviated from the negotiated terms of consent and they used their agency to resist this. The SPs used strong sexual metaphors to express the subjugation they experienced, as discourses of sexuality and gender played out in the Simulated Learning Environment. CONCLUSION: We demonstrate that power dynamics and the clinical gaze can have important consequences within the Simulated Learning Environment. Every physical examination can be potentially 'intimate' and can therefore be underpinned by discourses of sexuality and gendered undertones. In partnership with SPs, simulation-based education should create a teaching space that no longer fosters the discourse of the clinical gaze but facilitates students to learn to reflectively navigate, in the moment, the fine line between touching patients versus touching loved ones, and the blurred boundaries that exist in the gulf between sexual contact and benevolent touch.