Every doctor an educator?

INTRODUCTION: The education of the future health care workforce is fundamental to ensuring safe, effective, and inclusive patient care. Despite this there has been chronic underinvestment in health care education and, even though there is an increased need for educators, the true number of medical educators has been in relative decline for over a decade. PURPOSE: In this paper, we focus on the role of doctors as medical educators. We reflect on the culture in which medical education and training are delivered, the challenges faced, and their origins and sustaining factors. We propose a re-framing of this culture by applying Maslow's principles of the hierarchy of needs to medical educators, not only as individuals but as a specialist group and to the system in which this group works, to instigate actionable change and promote self-actualization for medical educators. DISCUSSION: Promoting and supporting the work of doctors who are educators is critically important. Despite financial investment in some practice areas, overall funding for and the number of medical educators continues to decline. Continuing Professional Development (CPD) schemes such as those offered by specialised medical education associations are welcomed, but without time, funding and a supportive culture from key stakeholders, medical educators cannot thrive and reach their potential. CONCLUSION: We need to revolutionise the culture in which medical education is practised, where medical educators are valued and commensurately rewarded as a diverse group of specialists who have an essential role in training the health care workforce to support the delivery of excellent, inclusive health care for patients. By reimagining the challenges faced as a hierarchy we show that until the fundamental needs of value, funding and time are realised, it will remain challenging to instigate the essential change that is needed.

Understanding patient involvement in judging students' communication skills in OSCEs.

INTRODUCTION: Communication skills are assessed by medically-enculturated examiners using consensus frameworks which were developed with limited patient involvement. Assessments consequently risk rewarding performance which incompletely serves patients' authentic communication needs. Whilst regulators require patient involvement in assessment, little is known about how this can be achieved. We aimed to explore patients' perceptions of students' communication skills, examiner feedback and potential roles for patients in assessment. METHODS: Using constructivist grounded theory we performed cognitive stimulated, semi-structured interviews with patients who watched videos of student performances in communication-focused OSCE stations and read corresponding examiner feedback. Data were analysed using grounded theory methods. RESULTS: A disconnect occurred between participants' and examiners' views of students' communication skills. Whilst patients frequently commented on students' use of medical terminology, examiners omitted to mention this in feedback. Patients' judgements of students' performances varied widely, reflecting different preferences and beliefs. Participants viewed variability as an opportunity for students to learn from diverse lived experiences. Participants perceived a variety of roles to enhance assessment authenticity. DISCUSSION: Integrating patients into communications skills assessments could help to highlight deficiencies in students' communication which medically-enculturated examiners may miss. Overcoming the challenges inherent to this is likely to enhance graduates' preparedness for practice.

Clinical assessors' working conceptualisations of undergraduate consultation skills: a framework analysis of how assessors make expert judgements in practice.

Undergraduate clinical assessors make expert, multifaceted judgements of consultation skills in concert with medical school OSCE grading rubrics. Assessors are not cognitive machines: their judgements are made in the light of prior experience and social interactions with students. It is important to understand assessors' working conceptualisations of consultation skills and whether they could be used to develop assessment tools for undergraduate assessment. To identify any working conceptualisations that assessors use while assessing undergraduate medical students' consultation skills and develop assessment tools based on assessors' working conceptualisations and natural language for undergraduate consultation skills. In semi-structured interviews, 12 experienced assessors from a UK medical school populated a blank assessment scale with personally meaningful descriptors while describing how they made judgements of students' consultation skills (at exit standard). A two-step iterative thematic framework analysis was performed drawing on constructionism and interactionism. Five domains were found within working conceptualisations of consultation skills: Application of knowledge; Manner with patients; Getting it done; Safety; and Overall impression. Three mechanisms of judgement about student behaviour were identified: observations, inferences and feelings. Assessment tools drawing on participants' conceptualisations and natural language were generated, including 'grade descriptors' for common conceptualisations in each domain by mechanism of judgement and matched to grading rubrics of Fail, Borderline, Pass, Very good. Utilising working conceptualisations to develop assessment tools is feasible and potentially useful. Work is needed to test impact on assessment quality.

'What do we do, doctor?' Transitions of identity and responsibility: a narrative analysis.

Transitioning from student to doctor is notoriously challenging. Newly qualified doctors feel required to make decisions before owning their new identity. It is essential to understand how responsibility relates to identity formation to improve transitions for doctors and patients. This multiphase ethnographic study explores realities of transition through anticipatory, lived and reflective stages. We utilised Labov's narrative framework (Labov in J Narrat Life Hist 7(1-4):395-415, 1997) to conduct in-depth analysis of complex relationships between changes in responsibility and development of professional identity. Our objective was to understand how these concepts interact. Newly qualified doctors acclimatise to their role requirements through participatory experience, perceived as a series of challenges, told as stories of adventure or quest. Rules of interaction within clinical teams were complex, context dependent and rarely explicit. Students, newly qualified and supervising doctors felt tensions around whether responsibility should be grasped or conferred. Perceived clinical necessity was a common determinant of responsibility rather than planned learning. Identity formation was chronologically mismatched to accepting responsibility. We provide a rich illumination of the complex relationship between responsibility and identity pre, during, and post-transition to qualified doctor: the two are inherently intertwined, each generating the other through successful actions in practice. This suggests successful transition requires a supported period of identity reconciliation during which responsibility may feel burdensome. During this, there is a fine line between too much and too little responsibility: seemingly innocuous assumptions can have a significant impact. More effort is needed to facilitate behaviours that delegate authority to the transitioning learner whilst maintaining true oversight.

Twelve tips for expanding undergraduate clinical teaching capacity.

Undergraduate medical education has expanded substantially in recent years, through both establishing new programs and increasing student numbers in existing programs. This expansion has placed pressure on the capacity for training students in clinical placements, raising concerns about the risk of dilution of experience, and reducing work readiness. The concerns have been greatest in more traditional environments, where clinical placements in large academic medical centers are often the "gold standard". However, there are ways of exposing medical students to patient interactions and clinical supervisors in many other contexts. In this paper, we share our experiences and observations of expanding clinical placements for both existing and new medical programs in several international locations. While this is not necessarily an easy task, a wide range of opportunities can be accessed by asking the right questions of the right people, often with only relatively modest changes in resource allocation.

'Knowledge leech' to 'part of the team': students' learning in rural communities of practice.

BACKGROUND: Keele Medical School has a small accommodation hub for students placed within ten associated general practices in a predominantly rural area of England. Groups of up to eleven final year students spend fifteen weeks learning generic and transferable clinical skills in these practices. AIM: To explore the evolving perceptions on students on their experiences throughout their placements. METHOD: All ten students placed at the hub between August and December 2013 were invited to participate in focus groups in weeks zero, seven, and fifteen. Analysis was qualitative and thematic. RESULTS: Ten, five and eight students chose to participate in successive focus groups. Five themes were identified from the data; acceptance, learning opportunities, relationships, development, and injustice with a subtheme of isolation. CONCLUSION: The placements had a powerful impact on students' learning and development. Their perceptions changed from seeing themselves as 'knowledge leeches' to legitimate contributors to health care over the course of fifteen weeks. They did not recognise that managing perceived adversity led to personal development. This illustrates the need to both identify perceived adversity and explicitly signpost and scaffold life learning. The students described experiences which challenged them intellectually and offered them opportunities to recognise the breadth and complexity of general practice.

An innovative long final year assistantship in general practice: description and evaluation.

We describe and evaluate an innovative immersive 15 week final year assistantship in general practice. Evaluation data was taken from five years of routinely collected School data and available national comparative data. The assistantship aims to enable students to consolidate knowledge and hone their skills through central participation in the care of large numbers of patients with acute and long term conditions. We estimate that most students consulted with over 450 patients during the assistantship. Students report that they became useful to their practice teams, had multiple episodes of feedback on their performance which they found useful and, in the school exit survey, reported that they were highly prepared for practice. 9.4 per cent of students reported that the assistantship was 'too long' and, especially those who completed the assistantship in the second semester, they were out of hospital for too long before F1. Some described a learning 'plateau' after the 10th week which was addressed by modifications to the assistantship. Nevertheless, in national surveys, our graduates' self-reported preparedness for practice is high, a perception shared by their F1 supervisors. General practice can make a valuable contribution to the education of senior medical students and contribute to their preparedness for practice.

The epidemiology of teaching and training General Practices in England.

There is no national picture of teaching and training practices or the communities they serve. We aimed to describe the association between general practices' engagement with education and their characteristics, locality and patients' health-status and satisfaction. This data linkage study of all English practices calculated odds ratios for teaching and training status and practice, locality and patient variables. Teaching and training practices are larger than practices which do neither (mean list size (SD) 7074 (3736), 10112 (4934), and 5327 (3368) respectively, p < 0.001 and have fewer patients per GP (1932 (951), 1838 (544), and 2117 (1585) respectively, p < 0.001). Their localities have a higher proportion of White British residents (77.99% (24.17), 81.66% (20.81), 73.07% (26.91), p < 0.001). Practices with more GPs (OR 1.21 (95%CI 1.18-1.20)), fewer male GPs (0.45 (0.36-0.55)) and a higher proportion of White British people in their locality (1.30 (1.06-1.60)) were more likely to teach. Practices in rural areas (1.68 (1.43-1.98)), with more GPs (1.22 (1.27-1.39)), more full time equivalent GPs (2.68 (1.64-4.40)), fewer male GPs (0.17 (0.13-0.22)) and a higher proportion of White British people in their locality (1.34 (1.02-1.75)) were more likely to train. Teaching and training practices had higher patient satisfaction (0.293 (0.190, 0.397) and (0.563 (0.442, 0.685)) respectively and quality and outcomes framework scores (0.507 (0.211, 0.804)) and (0.996 (0.650, 1.342)) respectively than those which did not. Educationally engaged practices are unrepresentative in serving less ethnically diverse and (for training practices) less urban environments. Investment is needed to increase the proportion of educational practices in diverse urban localities.

Teaching undergraduate students in rural general practice: an evaluation of a new rural campus in England.

INTRODUCTION: One approach to facilitating student interactions with patient pathways at Keele University School of Medicine, England, is the placement of medical students for 25% of their clinical placement time in general practices. The largest component is a 15-week 'student attachment' in primary care during the final year, which required the development of a new network of teaching practices in a rural district of England about 90 km (60 mi) from the main campus in North Staffordshire. The new accommodation and education hub was established in 2011-2012 to enable students to become immersed in those communities and learn about medical practice within a rural and remote context. Objectives were to evaluate the rural teaching from the perspectives of four groups: patients, general practice tutors, community hospital staff and students. Learning outcomes (as measured by objective structured clinical examinations) of students learning in rural practices in the final year were compared with those in other practices. METHODS: Data were gathered from a variety of sources. Students' scores in cohort-wide clinical assessment were compared with those in other locations. Semi-structured interviews were conducted with general practice tutors and community hospital staff. Serial focus groups explored the perceptions of the students, and questionnaires were used to gather the views of patients. RESULTS: Patients reported positive experiences of students in their consultations, with 97% expressing willingness to see students. The majority of patients considered that teaching in general practice was a good thing. They also expressed altruistic ideas about facilitating learning. The tutors were enthusiastic and perceived that teaching had positive impacts on their practices despite negative effects on their workload. The community hospital staff welcomed students and expressed altruistic ideas about helping them learn. There was no significant difference between the rurally placed students' objective structured clinical examination performance and that of their peers in other locations. Some students had difficulty with the isolation from peers and academic activities, and travel was a problem despite their accommodation close to the practices. CONCLUSIONS: Students valued the learning opportunities offered by the rural practice placements. The general practice tutors, patients and community hospital staff found teaching to be a positive experience overall and perceived a value to the health system and broader community in students learning locally for substantial periods of time. The evaluation has identified some student concerns about transport times and costs, social isolation, and access to resources and administrative tasks, and these are being addressed.

Grades in formative workplace-based assessment: a study of what works for whom and why.

CONTEXT: Grades are commonly used in formative workplace-based assessment (WBA) in medical education and training, but may draw attention away from feedback about the task. A dilemma arises because the self-regulatory focus of a trainee must include self-awareness relative to agreed standards, which implies grading. OBJECTIVES: In this study we aimed to understand the meaning which medical students construct from WBA feedback with and without grades, and what influences this. METHODS: Year 3 students were invited to take part in a randomised crossover study in which each student served as his or her own control. Each student undertook one WBA with and one without grades, and then chose whether or not to be given grades in a third WBA. These preferences were explored in semi-structured interviews. A realist approach to analysis was used to gain understanding of student preferences and the impact of feedback with and without grades. RESULTS: Of 83 students who were given feedback with and without grades, 65 (78%) then chose to have feedback with grades and 18 (22%) without grades in their third WBA. A total of 24 students were interviewed. Students described how grades locate their performance and calibrate their self-assessment. For some, low grades focused attention and effort. Satisfactory and high grades enhanced self-efficacy. CONCLUSIONS: Grades are concrete, powerful and blunt, can be harmful and need to be explained to help students create helpful meaning from them. Low grades risk reducing self-efficacy in some and may encourage others to focus on proving their ability rather than on improvement. A metaphor of the semi-permeable membrane is introduced to elucidate how students reduced potential negative effects and enhanced the positive effects of feedback with grades by selective filtering and pumping. This study illuminates the complexity of the processing of feedback by its recipients, and informs the use of grading in the provision of more effective, tailored feedback.

Conceptualising and Teaching Biomedical Uncertainty to Medical Students: an Exploratory Qualitative Study.

Introduction: Certainty/uncertainty in medicine is a topic of popular debate. This study aims to understand how biomedical uncertainty is conceptualised by academic medical educators and how it is taught in a medical school in the UK. Methods: This is an exploratory qualitative study grounded in ethnographic principles. This study is based on 10 observations of teaching sessions and seven semi-structured qualitative interviews with medical educators from various biomedical disciplines in a UK medical school. The data set was analysed via a thematic analysis. Results: Four main themes were identified after analysis: (1) ubiquity of biomedical uncertainty, (2) constraints to teaching biomedical uncertainty, (3) the 'medic filter' and (4) fluid distinction: core versus additional knowledge. While medical educators had differing understandings of how biomedical uncertainty is articulated in their disciplines, its presence was ubiquitous. This ubiquity did not translate into teaching due to time constraints and assessment strategies. The 'medic filter' emerged as a strategy that educators employed to decide what to include in their teaching. They made distinctions between core and additional knowledge which were defined in varied ways across disciplines. Additional knowledge often encapsulated biomedical uncertainty. Discussion: Even though the perspective that knowledge is socially constructed is not novel in medical education, it is neither universally valued nor universally applied. Moving beyond situativity theories and into broader debates in social sciences provides new opportunities to discuss the nature of scientific knowledge in medical education. We invite a move away from situated learning to situated knowledge.

Enhancing authenticity, diagnosticity and equivalence (AD-Equiv) in multicentre OSCE exams in health professionals education: protocol for a complex intervention study.

INTRODUCTION: Objective structured clinical exams (OSCEs) are a cornerstone of assessing the competence of trainee healthcare professionals, but have been criticised for (1) lacking authenticity, (2) variability in examiners' judgements which can challenge assessment equivalence and (3) for limited diagnosticity of trainees' focal strengths and weaknesses. In response, this study aims to investigate whether (1) sharing integrated-task OSCE stations across institutions can increase perceived authenticity, while (2) enhancing assessment equivalence by enabling comparison of the standard of examiners' judgements between institutions using a novel methodology (video-based score comparison and adjustment (VESCA)) and (3) exploring the potential to develop more diagnostic signals from data on students' performances. METHODS AND ANALYSIS: The study will use a complex intervention design, developing, implementing and sharing an integrated-task (research) OSCE across four UK medical schools. It will use VESCA to compare examiner scoring differences between groups of examiners and different sites, while studying how, why and for whom the shared OSCE and VESCA operate across participating schools. Quantitative analysis will use Many Facet Rasch Modelling to compare the influence of different examiners groups and sites on students' scores, while the operation of the two interventions (shared integrated task OSCEs; VESCA) will be studied through the theory-driven method of Realist evaluation. Further exploratory analyses will examine diagnostic performance signals within data. ETHICS AND DISSEMINATION: The study will be extra to usual course requirements and all participation will be voluntary. We will uphold principles of informed consent, the right to withdraw, confidentiality with pseudonymity and strict data security. The study has received ethical approval from Keele University Research Ethics Committee. Findings will be academically published and will contribute to good practice guidance on (1) the use of VESCA and (2) sharing and use of integrated-task OSCE stations.

Pilot Evaluation of an Online Resource for Learning Paediatric Chest Radiograph Interpretation.

Introduction and aims Assessment of chest radiographs is a fundamental clinical skill, often taught opportunistically. Medical students are taught how to read adult chest radiographs, however, in our experience, there is often a lack of structured training for the interpretation of pediatric chest radiographs. Our aim was to develop and evaluate an online approach for medical students to learn this skill.  Materials and methods Ericsson's expertise acquisition theory was used to develop 10 sets of 10 practice radiographs which were graded using the X-ray difficulty score. Medical student volunteers (from Keele University School of Medicine) were recruited in the paediatric rotation of their first clinical year. Pre- and post-training tests of identical difficulty were offered. A semistructured focus group was conducted after the tests, the transcription of which was analyzed using grounded theory. Results Of 117 students in the year, 54 (46%) originally volunteered. The engagement was initially high but fell during the year, particularly during the pre-examination block. The high drop-out rate made the quantitative measurement of effectiveness difficult. The focus group suggested that pressure of other work, exam preparation, technical factors, and inflexibility of the study protocol reduced engagement. Conclusions Although the topic covered was seen as important and relevant to exams, the current system requires development to make it more effective and engaging.

Measuring the Effect of Examiner Variability in a Multiple-Circuit Objective Structured Clinical Examination (OSCE).

PURPOSE: Ensuring that examiners in different parallel circuits of objective structured clinical examinations (OSCEs) judge to the same standard is critical to the chain of validity. Recent work suggests examiner-cohort (i.e., the particular group of examiners) could significantly alter outcomes for some candidates. Despite this, examiner-cohort effects are rarely examined since fully nested data (i.e., no crossover between the students judged by different examiner groups) limit comparisons. In this study, the authors aim to replicate and further develop a novel method called Video-based Examiner Score Comparison and Adjustment (VESCA), so it can be used to enhance quality assurance of distributed or national OSCEs. METHOD: In 2019, 6 volunteer students were filmed on 12 stations in a summative OSCE. In addition to examining live student performances, examiners from 8 separate examiner-cohorts scored the pool of video performances. Examiners scored videos specific to their station. Video scores linked otherwise fully nested data, enabling comparisons by Many Facet Rasch Modeling. Authors compared and adjusted for examiner-cohort effects. They also compared examiners' scores when videos were embedded (interspersed between live students during the OSCE) or judged later via the Internet. RESULTS: Having accounted for differences in students' ability, different examiner-cohort scores for the same ability of student ranged from 18.57 of 27 (68.8%) to 20.49 (75.9%), Cohen's d = 1.3. Score adjustment changed the pass/fail classification for up to 16% of students depending on the modeled cut score. Internet and embedded video scoring showed no difference in mean scores or variability. Examiners' accuracy did not deteriorate over the 3-week Internet scoring period. CONCLUSIONS: Examiner-cohorts produced a replicable, significant influence on OSCE scores that was unaccounted for by typical assessment psychometrics. VESCA offers a promising means to enhance validity and fairness in distributed OSCEs or national exams. Internet-based scoring may enhance VESCA's feasibility.

The real costs of teaching medical students in general practice: a cost-collection survey of teaching practices across England.

BACKGROUND: Current funding arrangements for undergraduate medical student placements in general practice are widely regarded as outdated, inequitable, and in need of urgent review. AIM: To undertake a detailed costing exercise to inform the setting of a national English tariff for undergraduate medical student placements in general practice. DESIGN AND SETTING: A cost-collection survey in teaching practices across all regions of England between January 2017 and February 2017. METHOD: A cost-collection template was sent to 50 selected teaching practices across all 25 medical schools in England following the development of a cost-collection tool and an initial pilot study. Detailed guidance on completion was provided for practices. Data were analysed by the Department of Health and Social Care. RESULTS: A total of 49 practices submitted data. The mean cost per half-day student placement in general practice was 111 GBP, 95% confidence interval = 100 to 121 (146 USD), with small differences between students in different years of study. Based on 10 sessions per student per week this equated to around 1100 GBP (1460 USD) per student placement week. CONCLUSION: The costs of undergraduate placements in general practice are considerably greater than funding available at time of writing, and broadly comparable with secondary care funding in the same period. The actual cost of placing a medical student full time in general practice for a 37-week academic year is 40 700 GBP (53 640 USD) compared with the average payment rate of only 22 000 GBP (28 990 USD) per year at the time this study was undertaken.

Deploying a clinical innovation in the context of actor-patient consultations in general practice: a prelude to a formal clinical trial.

BACKGROUND: Innovations to be deployed during consultations with patients may influence the clinical performance of the medical practitioner. This study examined the impact on General Practitioners' (GPs) consultation performance of novel computer software, designed for use while consulting the patient. METHODS: Six GPs were video recorded consulting six actor-patients in a simulated clinical environment. Two sessions were recorded with six consultations per GP. Five cases presented cancer symptoms which warranted a referral for specialist investigation. Practitioners were invited to use a novel software package to process referrals made during the consultations in the second session. Two assessors independently reviewed the consultation performance using the Leicester Assessment Package (LAP). Inter-rater agreement was assessed by a Bland-Altman plot of the difference in score against the average score. RESULTS: Sixty of the seventy two consultations were successfully recorded. Each video consultation was scored twice by two assessors leaving 120 LAP scores available for analysis. There was no evidence of a difference in the variance with increasing score (Pitmans test p = 0.09). There was also no difference in the mean differences between assessor scores whether using the software or not (T-test, P = 0.49) CONCLUSION: The actor-patient consultation can be used to test clinical innovations as a prelude to a formal clinical trial. However the logistics of the study may impact on the validity of the results and need careful planning. Ideally innovations should be tested within the context of a laboratory designed for the purpose, incorporating a pool of practitioners whose competencies have been established and assessors who can be blinded to the aims of the study.

Perceptions of UK medical students on rural clinical placements.

INTRODUCTION: Rural clinical placements are now commonly used to both promote awareness of rural health careers and expand clinical placement networks in Australia, North America and elsewhere. However in the United Kingdom (UK) there is no clear workforce or health education policy that encourages rural background student recruitment, rural clinical placements, rural oriented curricula or rural health education infrastructure, because deprivation and poor health status are regarded as urban phenomena. The question for one new medical school in regional/rural UK is: can increasing the utilisation of rural primary care practices both resolve teaching capacity constraints and offer students valuable learning opportunities about rural health? This article reports an exploration of students' views on the value of rural clinical placements in a new curriculum designed to address regional deprivation and workforce needs. METHODS: Medical students in Year 1 and Year 3 of a regional medical school were invited to attend focus group discussions that explored their understanding of rural health and life and the attractions of and barriers to expanding rural clinical placements. The Year 1 students were in the new curriculum and therefore more likely to be allocated a rural clinical placement in their more senior years. The discussions were audio-recorded, transcribed and thematically analysed. RESULTS: Themes that emerged were: what is rural? how different is rural from urban?; differences in rural and urban learning, logistic issues, and choosing a rural placement. Student perceptions in both groups were rather negative about rural placements. Rural practices were thought to provide a narrow range of patient contact and learning opportunities, and rural life was thought to be unattractive, especially out of formal placement hours. Even relatively small distances from friends and social outlets were regarded as barriers. Year 1 students were more positive about the possibility of a rural placement, although they knew at admission that the school would be expanding into rural communities and may therefore have been more open to the concept. CONCLUSION: Ruralization of health professional education in the UK faces substantial challenges. More may need to be done to increase recruitment of rural-interested students, foster rural career interest during courses, recruit rural role models, develop rural curricula and establish the infrastructure to support rural clinical placements. These initiatives will require greater political will and some investment by education, heath and community development agencies.

Checklists for assessment and certification of clinical procedural skills omit essential competencies: a systematic review.

OBJECTIVE: To develop generic criteria for the global assessment of clinical procedural competence and to quantify the extent to which existing checklists allow for holistic assessment of procedural competencies. METHODS: We carried out a systematic review and qualitative analysis of published clinical procedural skills assessment checklists and enumerated the contents of each. Source materials included all English-language papers published from 1990 to June 2005, identified from 18 databases, which described or referred to an assessment document for any clinical procedural skill. A pair of reviewers identified key generic themes and sub-themes through in-depth analysis of a subset of 20 checklists with iterative agreement and independent retesting of a coding framework. The resulting framework was independently applied to all checklists by pairs of reviewers checking for the emergence of new themes and sub-themes. Main outcome measures were identification of generic clinical procedural skills and the frequency of occurrence of each in the identified checklists. RESULTS: We identified 7 themes ('Procedural competence', represented in 85 [97%] checklists; 'Preparation', 65 [74%]; 'Safety', 45 [51%]; 'Communication and working with the patient', 32 [36%]; 'Infection control', 28 [32%]; 'Post-procedural care', 24 [27%]; 'Team working', 13 [15%]) and 37 sub-themes, which encapsulated all identified checklists. Of the sub-themes, 2 were identified after the initial coding framework had been finalised. CONCLUSIONS: It is possible to develop generic criteria for the global assessment of clinical procedural skills. A third and a half of checklists, respectively, do not enable explicit assessment of the key competencies 'Infection control' and 'Safety'. Their assessment may be inconsistent in assessments which use such checklists.