Addressing obstetricians' awareness of compassion, communication, and self-care when caring for families experiencing stillbirth: Evaluation of a novel educational workshop using applied drama techniques.

INTRODUCTION: Obstetricians describe feeling shocked and isolated following stillbirth. Few receive adequate training in how to care for bereaved parents or themselves. We developed a novel workshop for trainee obstetricians using applied drama techniques-in collaboration with the National Theatre of Ireland, the national training body for obstetricians and gynaecologists, and patient support groups-to teach obstetricians skills in communication and self-care around the time of stillbirth. MATERIALS AND METHODS: Five workshops, delivered January-May 2018, are the focus of this evaluation. Senior trainees in Obstetrics attended and completed a post-workshop evaluation questionnaire. Five-point Likert scales were used to assess participants' communication and support skills pre- and post- the workshop, and their views on pre-specified attributes needed when caring for families experiencing stillbirth and aspects of the workshop. Quantitative and qualitative data were analysed using descriptive statistics and content analysis, respectively. RESULTS: 39/59 (66%) workshop participants completed the questionnaires. Most had received no prior training in caring for families experiencing antenatal (31/39, 80%) or intrapartum (34/39, 87%) stillbirth. Following the workshop there was a significant improvement in trainee's level of confidence in breaking bad news, communicating clearly with the family when breaking bad news, recognising the emotional needs of the family, recognising their own emotional responses, and supporting their colleagues. Trainees were positive about the workshop content and delivery; 90% stated they would recommend it to a colleague. DISCUSSION: Adequate, appropriate, and stimulating education and training in stillbirth care and self-care is clearly needed to improve patient care. Our findings demonstrate that this novel educational workshop using applied drama techniques-developed in collaboration with diverse stakeholders and underpinned by the views of parents and obstetricians who had experience of stillbirth-is an acceptable and appropriate way of training obstetricians in how to care for bereaved parents and/or to engage in self-care.

Doctors' engagement with a formal system of continuing professional development in Ireland: a qualitative study in perceived benefits, barriers and potential improvements.

OBJECTIVES: To examine experiences of participation in a mandatory system of continuing professional development (CPD) among doctors in Ireland, in order to identify areas for improvement. DESIGN: A qualitative cross-sectional design was used. PARTICIPANTS: 1408 participants (701 male, 707 female) were recruited via email from a population of 4350 doctors enrolled on a Royal College of Physicians of Ireland Professional Competence Scheme (PCS) for the 2017/2018 year, and completed an online survey as part of a larger study examining experiences and attitudes towards participation in PCS. A subset of the sample (434 participants) responded to an optional open-ended question about PCS participation. Responses to the open-ended question were analysed using thematic analysis. RESULTS: Thematic analysis resulted in five main themes relating to perceived barriers to PCS participation across a wide range of areas: 'Evidence of participation', 'The structure of PCS', 'Questioning the benefits of formal CPD', 'Workplace challenges' and 'Access issues'. CONCLUSIONS: Taken together, the five themes outlined in this study give a wide-ranging, in-depth picture of the challenges faced by Irish doctors, which expand on well-documented factors such as time constraints, to illustrate a series of complex, interacting factors. Some barriers, such as difficulty obtaining evidence of participation, may be relatively easily addressed. Others, such as issues with the way the PCS is structured, are more intractable, and require further research to understand more fully and develop appropriate solutions.

Attitudes, Perceived Benefits, and Experiences of Engagement With Professional Competence Schemes for Doctors in Ireland: Findings From a National Survey.

INTRODUCTION: This study aimed to assess the attitudes, perceived benefits, and experiences of engaging with a formal system of continuing professional development (CPD) in the form of Professional Competence Schemes (PCSs) among doctors in Ireland. METHODS: The study utilized an anonymous online survey measure with both open-ended and Likert-scale questions. The measure examined general attitudes, perceived impact, and experiences of engagement with PCS. This study examines the scale items only. All 4350 doctors enrolled on a PCS were invited through email to complete the survey. One thousand four hundred eight doctors participated, indicating a response rate of 32%. RESULTS: Descriptive and inferential statistics (analysis of variance and Kruskal-Wallis) were performed on the scale items using IBM SPSS statistics, with group comparisons examining differences in responses according to gender and current primary role. A majority (80%) of respondents had positive overall attitudes to PCS. Most participants reported that CPD positively impacts their practice across a wide range of areas, particularly patient care. Most participants reported positive experiences engaging with PCS, although a minority reported difficulties, including lack of time to participate in and record CPD activities, difficulties obtaining evidence of participation, and feeling that their CPD activities are not easily captured by the PCS system. Significant differences in responses according to role were found for overall attitudes (confidence interval = 95%, P < .00) and overall experiences of PCS (confidence interval = 95%, P < .00) with nonconsultant hospital doctors emerging as a particularly vulnerable group with less positive attitudes and experiences. DISCUSSION: Across the board overall attitudes, perceived impact and experiences of PCS were positive, and indicate that doctors feel that PCS is a valuable and beneficial activity. However, a minority of respondents reported experiencing difficulties with engagement, and these areas of difficulty represent targets for future improvement.

Doctors' attitudes to, beliefs about, and experiences of the regulation of professional competence: a scoping review protocol.

BACKGROUND: Historically, individual doctors were responsible for maintaining their own professional competence. More recently, changing patient expectations, debate about the appropriateness of professional self-regulation, and high-profile cases of malpractice have led to a move towards formal regulation of professional competence (RPC). Such programmes require doctors to demonstrate that they are fit to practice, through a variety of means. Participation in RPC is now part of many doctors' professional lives, yet it remains a highly contested area. Cost, limited evidence of impact, and lack of relevance to practice are amongst the criticisms cited. Doctors' attitudes towards RPC, their beliefs about its objectives and effectiveness, and their experiences of trying to meet its requirements can impact engagement with the process. We aim to conduct a scoping review to map the empirical literature in this area, to summarise the key findings, and to identify gaps for future research. METHODS: We will conduct our review following the six phases outlined by Arksey and O'Malley, and Levac. We will search seven electronic databases: Academic Search Complete, Business Source Complete, CINAHL, PsycINFO, PubMed, Social Sciences Full Text, and SocINDEX for relevant publications, and the websites of medical regulatory and educational organisations for documents. We will undertake backward and forward citation tracking of selected studies and will consult with international experts regarding key publications. Two researchers will independently screen papers for inclusion and extract data using a piloted data extraction tool. Data will be collated to provide a descriptive summary of the literature. A thematic analysis of the key findings will be presented as a narrative summary of the literature. DISCUSSION: We believe that this review will be of value to those tasked with the design and implementation of RPC programmes, helping them to maximise doctors' commitment and engagement, and to researchers, pointing to areas that would benefit from further enquiry. This research is timely; internationally existing programmes are evolving, new programmes are being initiated, and many jurisdictions do not yet have programmes in place. There is an opportunity for learning across different programmes and from the experiences of established programmes. Our review will support that learning. SYSTEMATIC REVIEW REGISTRATION: PROSPERO does not register scoping reviews.

Is the learning value of workplace-based assessment being realised? A qualitative study of trainer and trainee perceptions and experiences.

PURPOSE: Workplace-based assessments (WBAs) were originally intended to inform learning and development by structuring effective observation-based feedback. The success of this innovation has not yet been established due in part to the widely varied tools, implementation strategies and research approaches. Using a conceptual framework of experience, trajectories and reifications in workplace learning, we aimed to explore trainer and trainee experiences and perceptions of the learning value of WBAs. STUDY DESIGN: Trainers and trainees who had used at least one WBA in the previous year were invited to participate in semistructured interviews for this phenomenological study. We used a template analysis method to explore and compare the experiences of the two groups, using the emergent themes to develop an understanding of the impact of these experiences on perceptions of learning value. RESULTS: Nine trainers and eight trainees participated in the study. Common themes emerged among the two groups around issues of responsibility and engagement along with (mis)understandings of the purpose of the individual tools. Trainer-specific themes emerged related to the concurrent implementation of a new e-portfolio and perceptions of increased workload. Trainees associated WBA with a training structure support value but could not translate experiences into learning values. CONCLUSIONS: WBAs provide trainees with a justified reason to approach trainers for feedback. WBAs, however, are not being reified as the formative assessments originally intended. A culture change may be required to change the focus of WBA research and reconceptualise this set of tools and methods as a workplace learning practice.

A BEME (Best Evidence in Medical Education) review of the use of workplace-based assessment in identifying and remediating underperformance among postgraduate medical trainees: BEME Guide No. 43.

INTRODUCTION: The extent to which workplace-based assessment (WBA) can be used as a facilitator of change among trainee doctors has not been established; this is particularly important in the case of underperforming trainees. The aim of this review is to examine the use of WBA in identifying and remediating performance among this cohort. METHODS: Following publication of a review protocol a comprehensive search of eight databases took place to identify relevant articles published prior to November 2015. All screening, data extraction and analysis procedures were performed in duplicate or with quality checks and necessary consensus methods throughout. Given the study-level heterogeneity, a descriptive synthesis approach informed the study analysis. RESULTS: Twenty studies met the inclusion criteria. The use of WBA within the context of remediation is not supported within the existing literature. The identification of underperformance is not supported by the use of stand-alone, single-assessor WBA events although specific areas of underperformance may be identified. Multisource feedback (MSF) tools may facilitate identification of underperformance. CONCLUSION: The extent to which WBA can be used to detect and manage underperformance in postgraduate trainees is unclear although evidence to date suggests that multirater assessments (i.e. MSF) may be of more use than single-rater judgments (e.g. mini-clinical evaluation exercise).

Profiling postgraduate workplace-based assessment implementation in Ireland: a retrospective cohort study.

In 2010, workplace-based assessment (WBA) was formally integrated as a method of formative trainee assessment into 29 basic and higher specialist medical training (BST/HST) programmes in six postgraduate training bodies in Ireland. The aim of this study is to explore how WBA is being implemented and to examine if WBA is being used formatively as originally intended. A retrospective cohort study was conducted and approved by the institution's Research Ethics Committee. A profile of WBA requirements was obtained from 29 training programme curricula. A data extraction tool was developed to extract anonymous data, including written feedback and timing of assessments, from Year 1 and 2 trainee ePortfolios in 2012-2013. Data were independently quality assessed and compared to the reference standard number of assessments mandated annually where relevant. All 29 training programmes mandated the inclusion of at least one case-based discussion (max = 5; range 1-5). All except two non-clinical programmes (93 %) required at least two mini-Clinical Evaluation Exercise assessments per year and Direct Observation of Procedural Skills assessments were mandated in 27 training programmes over the course of the programme. WBA data were extracted from 50 % of randomly selected BST ePortfolios in four programmes (n = 142) and 70 % of HST ePortfolios (n = 115) in 21 programmes registered for 2012-2013. Four programmes did not have an eligible trainee for that academic year. In total, 1142 WBAs were analysed. A total of 164 trainees (63.8 %) had completed at least one WBA. The average number of WBAs completed by HST trainees was 7.75 (SD 5.8; 95 % CI 6.5-8.9; range 1-34). BST trainees completed an average of 6.1 assessments (SD 9.3; 95 % CI 4.01-8.19; range 1-76). Feedback-of varied length and quality-was provided on 44.9 % of assessments. The majority of WBAs were completed in the second half of the year. There is significant heterogeneity with respect to the frequency and quality of feedback provided during WBAs. The completion of WBAs later in the year may limit available time for feedback, performance improvement and re-evaluation. This study sets the scene for further work to explore the value of formative assessment in postgraduate medical education.

A BEME (Best Evidence in Medical Education) systematic review of the use of workplace-based assessment in identifying and remediating poor performance among postgraduate medical trainees.

BACKGROUND: Workplace-based assessments were designed to facilitate observation and structure feedback on the performance of trainees in real-time clinical settings and scenarios. Research in workplace-based assessments has primarily centred on understanding psychometric qualities and performance improvement impacts of trainees generally. An area that is far less understood is the use of workplace-based assessments for trainees who may not be performing at expected or desired standards, referred to within the literature as trainees 'in difficulty' or 'underperforming'. In healthcare systems that increasingly depend on service provided by junior doctors, early detection (and remediation) of poor performance is essential. However, barriers to successful implementation of workplace-based assessments (WBAs) in this context include a misunderstanding of the use and purpose of these formative assessment tools. This review aims to explore the impact - or effectiveness - of workplace-based assessment on the identification of poor performance and to determine those conditions that support and enable detection, i.e. whether by routine or targeted use where poor performance is suspected. The review also aims to explore what effect (if any) the use of WBA may have on remediation or on changing clinical practice. The personal impact of the detection of poor performance on trainees and/or trainers may also be explored. METHODS/DESIGN: Using BEME (Best Evidence in Medical Education) Collaboration review guidelines, nine databases will be searched for English-language records. Studies examining interventions for workplace-based assessment either routinely or in relation to poor performance will be included. Independent agreement (kappa .80) will be achieved using a randomly selected set of records prior to commencement of screening and data extraction using a BEME coding sheet modified as applicable (Buckley et al., Med Teach 31:282-98, 2009) as this has been used in previous WBA systematic reviews (Miller and Archer, BMJ doi:10.1136/bmj.c5064, 2010) allowing for more rigorous comparisons with the published literature. Educational outcomes will be evaluated using Kirkpatrick's framework of educational outcomes using Barr's adaptations (Barr et al., Evaluations of interprofessional education; a United Kingdom review of health and social care, 2000) for medical education research. DISCUSSION: Our study will contribute to an ongoing international debate regarding the applicability of workplace-based assessments as a meaningful formative assessment approach within the context of postgraduate medical education. SYSTEMATIC REVIEW REGISTRATION: The review has been registered by the BEME Collaboration www.bemecollaboration.org .