Points to consider: EULAR-UEMS standards for the training of European rheumatologists.

BACKGROUND: Postgraduate rheumatology training programmes are already established at a national level in most European countries. However, previous work has highlighted a substantial level of heterogeneity in the organisation and, in part, content of programmes. OBJECTIVE: To define competences and standards of knowledge, skills and professional behaviours required for the training of rheumatologists. METHODS: A European Alliance of Associations for Rheumatology (EULAR) task force (TF) of 23 experts, including two members of the European Union of Medical Specialists (UEMS) section of rheumatology, was convened. The mapping phase consisted of the retrieval of key documents on specialty training in rheumatology and other related specialties across a broad set of international sources. The content of these documents was extracted and represented the foundation for the document draft that underwent several rounds of online discussion within the TF, and afterwards was also distributed to a broad group of stakeholders for collecting feedback. The list of generated competences was voted on during the TF meetings, while the level of agreement (LoA) with each statement was established by anonymous online voting. RESULTS: A total of 132 international training curricula were retrieved and extracted. In addition to the TF members, 253 stakeholders commented and voted on the competences through an online anonymous survey. The TF developed (1) an overarching framework indicating the areas that should be addressed during training, (2) 7 domains defining broad areas that rheumatology trainees should master by the end of the training programme, (3) 8 core themes defining the nuances of each domain and (4) 28 competences that trainees should acquire to cover each of the areas outlined in the overarching framework. A high LoA was achieved for all competences. CONCLUSION: These points to consider for EULAR-UEMS standards for the training of European rheumatologists are now defined. Their dissemination and use can hopefully contribute to harmonising training across European countries.

2019 EULAR points to consider for the assessment of competences in rheumatology specialty training.

BACKGROUND AND AIM: Striving for harmonisation of specialty training and excellence of care in rheumatology, the European League Against Rheumatism (EULAR) established a task force to develop points to consider (PtCs) for the assessment of competences during rheumatology specialty training. METHODS: A systematic literature review on the performance of methods for the assessment of competences in rheumatology specialty training was conducted. This was followed by focus groups in five selected countries to gather information on assessment practices and priorities. Combining the collected evidence with expert opinion, the PtCs were formulated by the multidisciplinary task force, including rheumatologists, medical educationalists, and people with rheumatic and musculoskeletal diseases. The level of agreement (LoA) for each PtC was anonymously voted online. RESULTS: Four overarching principles and 10 PtCs were formulated. The overarching principles highlighted the importance of assessments being closely linked to the rheumatology training programme and protecting sufficient time and resources to ensure effective implementation. In the PtCs, two were related to overall assessment strategy (PtCs 1 and 5); three focused on formative assessment and portfolio (PtCs 2-4); three focused on the assessment of knowledge, skills or professionalism (PtCs 6-8); one focused on trainees at risk of failure (PtC 9); and one focused on training the trainers (PtC 10). The LoA (0-10) ranged from 8.75 to 9.9. CONCLUSION: These EULAR PtCs provide European guidance on assessment methods throughout rheumatology training programmes. These can be used to benchmark current practices and to develop future strategies, thereby fostering continuous improvement in rheumatology learning and, ultimately, in patient care.

2019 EULAR recommendations for the generic core competences of health professionals in rheumatology.

BACKGROUND/OBJECTIVES: To maintain and optimise the quality of care provided by health professionals in rheumatology (HPRs), adequate educational offerings are needed. This task force (TF) aimed to develop evidence-based recommendations for the generic core competences of HPRs, with specific reference to nurses, physical therapists (PTs) and occupational therapists (OTs) to serve as a basis for their postgraduate education. METHODS: The EULAR standardised operating procedures for the development of recommendations were followed. A TF including rheumatologists, nurses, PTs, OTs, patient-representatives, an educationalist, methodologists and researchers from 12 countries met twice. In the first TF meeting, 13 research questions were defined to support a systematic literature review (SLR). In the second meeting, the SLR evidence was discussed and recommendations formulated. Subsequently, level of evidence and strength of recommendation were assigned and level of agreement (LoA) determined (0-10 rating scale). RESULTS: Three overarching principles were identified and 10 recommendations were developed for the generic core competences of HPRs. The SLR included 79 full-text papers, 20 of which addressed the competences, knowledge, skills, attitudes and/or educational needs of HPRs from multiple professions. The average LoA for each recommendation ranged from 9.42 to 9.79. Consensus was reached both on a research and educational agenda. CONCLUSION: Evidence and expert opinion informed a set of recommendations providing guidance on the generic core competences of HPRs. Implementation of these recommendations in the postgraduate education of HPRs at the international and national level is advised, considering variation in healthcare systems and professional roles.

EULAR portfolio for Rheumatology training: a EULAR School of Rheumatology initiative.

OBJECTIVE: About half of the rheumatology trainees do not use a portfolio. This project was established to reach consensus about the content of a EULAR portfolio for Rheumatology training and subsequently develop portfolio assessment forms. METHODS: After establishing a portfolio working group (WG), including nine rheumatologists and one educationalist, a systematic literature review (SLR) on the content and structure of portfolios for postgraduate learning was conducted (November 2018). This was followed by a survey among WG members and members of the EMerging EUlar NETwork, inquiring about the content and structure of existing national portfolios. The portfolio WG selected the key components of the portfolio, taking previous experience and feasibility into account. Assessment forms (eg, case-based discussion) were developed and pilot-tested. RESULTS: 13/2034 articles were included in the SLR (12 high/1 moderate risk of bias). Information on procedural skills, personal reflections, learning goals and multisource feedback was most often included a portfolio. Twenty-five respondents completed the survey (response≈50%). Feedback from assessors, reflective writing and formulation of learning goals were considered important dimensions to be covered in a portfolio. Six key components of the portfolio were established: curriculum vitae, personal development plan, clinical work, professional behaviours, education and research activities. Suggested minimal content for each component was formulated. Four assessment forms were successfully pilot-tested by 11 rheumatologists and their trainees. CONCLUSION: A EULAR portfolio for Rheumatology training and assessment forms were developed. Portfolio implementation, particularly in countries without an existing portfolio, may promote a higher standard of rheumatology training across Europe.

Strategies for the assessment of competences during rheumatology training across Europe: results of a qualitative study.

OBJECTIVES: To gain insight into current methods and practices for the assessment of competences during rheumatology training, and to explore the underlying priorities and rationales for competence assessment. METHODS: We used a qualitative approach through online focus groups (FGs) of rheumatology trainers and trainees, separately. The study included five countries-Denmark, the Netherlands, Slovenia, Spain and the United Kingdom. A summary of current practices of assessment of competences was developed, modified and validated by the FGs based on an independent response to a questionnaire. A prioritising method (9 Diamond technique) was then used to identify and justify key assessment priorities. RESULTS: Overall, 26 participants (12 trainers, 14 trainees) participated in nine online FGs (2 per country, Slovenia 1 joint), totalling 12 hours of online discussion. Strong nationally (the Netherlands, UK) or institutionally (Spain, Slovenia, Denmark) standardised approaches were described. Most groups identified providing frequent formative feedback to trainees for developmental purposes as the highest priority. Most discussions identified a need for improvement, particularly in developing streamlined approaches to portfolios that remain close to clinical practice, protecting time for quality observation and feedback, and adopting systematic approaches to incorporating teamwork and professionalism into assessment systems. CONCLUSION: This paper presents a clearer picture of the current practice on the assessment of competences in rheumatology in five European countries and the underlying rationale of trainers' and trainees' priorities. This work will inform EULAR Points-to-Consider for the assessment of competences in rheumatology training across Europe.

Assessment of competences in rheumatology training: results of a systematic literature review to inform EULAR points to consider.

OBJECTIVE: To summarise the literature on the assessment of competences in postgraduate medical training. METHODS: A systematic literature review was performed within a EULAR taskforce on the assessment of competences in rheumatology training and other related specialities (July 2019). Two searches were performed: one search for rheumatology and one for related medical specialities. Two reviewers independently identified eligible studies and extracted data on assessment methods. Risk of bias was assessed using the medical education research study quality instrument. RESULTS: Of 7335 articles in rheumatology and 2324 reviews in other specialities, 5 and 31 original studies were included, respectively. Studies in rheumatology were at variable risk of bias and explored only direct observation of practical skills (DOPS) and objective structured clinical examinations (OSCEs). OSCEs, including clinical, laboratory and imaging stations, performed best, with a good to very good internal consistency (Cronbach's α=0.83-0.92), and intrarater reliability (r=0.80-0.95). OSCEs moderately correlated with other assessment tools: r=0.48 vs rating by programme directors; r=0.2-0.44 vs multiple-choice questionnaires; r=0.48 vs DOPS. In other specialities, OSCEs on clinical skills had a good to very good inter-rater reliability and OSCEs on communication skills demonstrated a good to very good internal consistency. Multisource feedback and the mini-clinical evaluation exercise showed good feasibility and internal consistency (reliability), but other data on validity and reliability were conflicting. CONCLUSION: Despite consistent data on competence assessment in other specialities, evidence in rheumatology is scarce and conflicting. Overall, OSCEs seem an appropriate tool to assess the competence of clinical skills and correlate well with other assessment strategies. DOPS, multisource feedback and the mini-clinical evaluation exercise are feasible alternatives.

Development of generic core competences of health professionals in rheumatology: a systematic literature review informing the 2018 EULAR recommendations.

Objective: To identify generic competences on the desired knowledge, skills and of health professionals in rheumatology (HPRs) to inform the respective EULAR recommendations. Methods: A systematic literature review was performed on the generic core competences (defined as knowledge, skills or attitudes) of HPRs (nurses, physical therapists (PTs) or occupational therapists (OTs)). Literature was obtained from electronic databases, published EULAR recommendations and via personal communication with representatives of national rheumatology societies and experts in the field. Qualitative, quantitative and mixed methods studies were included, and their methodological quality was scored using appropriate instruments. Results: From 766 references reviewed, 79 fulfilled the inclusion criteria. Twenty studies addressed competences of multiple HPRs: 15 were of qualitative design, 1 quantitative, 1 mixed-methods, 2 systematic reviews and 1 opinion paper. The methodological quality of most studies was medium to high. Five studies concerned the development of a comprehensive set of competences. Key competences included: basic knowledge of rheumatic diseases, holistic approach to patient management, effective communication with colleagues and patients and provision of education to patients. The proposed competences were confirmed in studies focusing on one or more specific competences, on a rheumatic disease or on a specific profession (nurses, PTs or OTs). Conclusion: Generic competences were identified for HPRs. Data were mostly derived from qualitative studies. All identified studies varied and were at national level, highlighting the need for the harmonisation of HPR competences across Europe. These findings underpin the development of EULAR recommendations for the core competences of HPRs.

Developing a professional approach to work-based assessments in rheumatology.

This chapter discusses how doctors in key European countries develop and maintain professional standards of clinical knowledge in their specialism, rheumatology, with particular reference to how they are assessed in the workplace. The authors discuss key educational theories related to learning and assessment, including experiential learning, reflective practice, how formative and summative assessments drive experiential learning and the essential principles of reliability and validity. This chapter also considers the challenge of ensuring that professional attitudes towards assessment and reflective practice are developed alongside cognitive and practical skills, with reference to current frameworks, including the UK and North America. The chapter lists, describes and explains the main summative assessments used in postgraduate medicine in the UK. We advocate the development of the professional reflective-practitioner attitude as the best way of approaching the range of work-based assessments that trainees need to engage in. Our account concludes by briefly discussing the barriers that may impede professional approaches to assessing competence in rheumatology. A summary states how individual practitioners may contribute to a more effective process in their roles as assessors and trainees.