Evidence of learning in workplace-based assessments in a Family Medicine Training Programme.

BACKGROUND:  Learning portfolios (LPs) provide evidence of workplace-based assessments (WPBAs) in clinical settings. The educational impact of LPs has been explored in high-income countries, but the use of portfolios and the types of assessments used for and of learning have not been adequately researched in sub-Saharan Africa. This study investigated the evidence of learning in registrars' LPs and the influence of the training district and year of training on assessments. METHODS:  A cross-sectional study evaluated 18 Family Medicine registrars' portfolios from study years 1-3 across five decentralised training sites affiliated with the University of the Witwatersrand. Descriptive statistics were calculated for the portfolio and quarterly assessment (QA) scores and self-reported clinical skills competence levels. The competence levels obtained from the portfolios and university records served as proxy measures for registrars' knowledge and skills. RESULTS:  The total LP median scores ranged from 59.9 to 81.0, and QAs median scores from 61.4 to 67.3 across training years. The total LP median scores ranged from 62.1 to 83.5 and 62.0 to 67.5, respectively in QAs across training districts. Registrars' competence levels across skill sets did not meet the required standards. Higher skills competence levels were reported in the women's health, child health, emergency care, clinical administration and teaching and learning domains. CONCLUSION:  The training district and training year influence workplace-based assessment (WPBA) effectiveness. Ongoing faculty development and registrar support are essential for WPBA.Contribution: This study contributes to the ongoing discussion of how to utilise WPBA in resource-constrained sub-Saharan settings.

Implementation and Impact of an Adapted Digital Perioperative Competency-Building Tool to Enhance Teaching, Learning And Feedback in Postgraduate Competency-Based Medical Education.

OBJECTIVES: The purpose of this educational intervention was to introduce, iteratively adapt, and implement a digital formative assessment tool in a surgical speciality. The study also evaluated the intervention's impact on perioperative teaching, learning, feedback, and surgical competency. DESIGN: A participatory action research model with a mixed methods approach. SETTING: This study was performed over 10 months in an institutional hospital in South Africa with a general surgery department. PARTICIPANTS: Twelve supervising surgical trainers/faculty and 12 surgical trainees/residents consented to participate in the intervention. RESULTS: The first 4 months of the intervention focused on relationship building, a multi-stakeholder contextual needs assessment and training sessions to support a shared mindset and shift in the teaching and learning culture. The final adapted perioperative competency-building tool comprised a 23-item assessment with four open-text answers (Table 1). Over the following 6-month period, 48 workplace-based competency-building perioperative evaluations were completed. Most trainees took less than 5 minutes to self-assess (67%) before most trainers (67%) took less than 5 minutes to give oral feedback to the trainee after the perioperative supervised learning encounter. On average, the digital tool took 6 minutes to complete during the bidirectional perioperative teaching and learning encounter with no negative impact on the operational flow. All trainers and trainees reported the training and implementation of the digital tool to be beneficial to teaching, learning, feedback, and the development of surgical competency. Analysis of the completed tools revealed several trainees showing evidence of progression in surgical competency for index procedures within the speciality. The focus groups and interviews also showed a change in the teaching and learning culture: more positively framed, frequent, structured, and specific feedback, improved accountability, and trainee-trainer perioperative readiness for teaching. Highlighted changes included the usefulness of trainee self-assessment before perioperative trainer feedback and the tool's value in improving competency to Kirkpatrick Level 4. CONCLUSION: Implementing an adapted digital Workplace-Based Assessment (WBA) tool using a participatory action research model has proven successful in enhancing the effectiveness of supervised perioperative teaching and learning encounters. This approach has improved teaching and feedback practices, facilitated the development of surgical competency, and ultimately impacted the overall culture to Kirkpatrick level 4. Importantly, it has positively influenced the trainee-trainer relationship dynamic. Based on these positive outcomes, we recommend using this effective method and our relationship-centred framework for implementing formative competency-building tools in future studies. By doing so, larger-scale and successful implementation of Competency-Based Medical Education (CBME) could be achieved in various contexts. This approach can potentially enhance teaching and learning encounters, promote competency development, and improve the overall educational experience for surgical trainees and trainers.

Specialist training: workplace-based assessments impact on teaching, learning and feedback to support competency-based postgraduate programs.

BACKGROUND: Workplace-based assessments (WBAs) are part of a competency-based curriculum where training progression is dependent on the achievement of defined competencies in a real-world clinical environment. There is a significant literature gap on the impact of WBAs implemented in resource constrained countries and their contextual challenges. This study aimed to examine the use, impact, and educational context of WBAs in South African medical specialist training programs drawing on perspectives from both trainees and trainers to identify educational challenges and propose effective solutions. METHODS: A mixed methods national electronic survey was conducted with specialist medical trainees and supervising trainers from all eight specialist training institutions in South Africa involving 16 specialities. The survey responses were voluntary and anonymous. The survey was closed after seven months when data saturation was achieved. Descriptive statistical analysis was performed using SPSS Version 27 (SPSS Inc, 2012, Chicago, IL) for the quantitative analysis. The thematic coding framework for the qualitative analysis was facilitated by NVivo Version 12 software. RESULTS: There were 108 ethnically diverse supervising trainers and 248 specialist trainees' survey respondents. Across the 16 medical specialities, 45% of the respondents were using WBAs. Despite contextual resource and staff challenges, this study found that WBAs had a positive impact to Kirkpatrick level 2 in providing actionable feedback to improve competency. WBA users had a significantly higher rating for trainee supervision (p < 0.01), general quality of feedback on trainee competence (< 0.01) and the specialist training program (p = 0.03) compared to WBA non-users. They also had a higher rating for the assessment of the trainee as a professional (p < 0.01); scholar (p < 0.01); communicator (p < 0.01); collaborator (p = 0.001) and leader/manager (p < 0.001) based on the AfriMEDS competency framework. Racism, sexism and favouritism were challenges that negatively affected the training programs. CONCLUSION: Overall, this study reports that the use of WBAs had a substantially favourable impact on teaching, learning, feedback and supports a competency-based approach to specialist training programs. Addressing the contextual concerns that negatively impact training; training the trainees and trainers about their relationship, roles and responsibilities; and focusing on a trainee-centred, inclusive and empowering teaching approach will help further enhance its effectiveness.

Competency-based medical education in the United States: What the otolaryngologist needs to know.

Competency-based medical education (CBME) is an outcomes-focused approach to educating medical professionals that will be central to future efforts to improve resident training in otolaryngology. The transition to CBME for otolaryngology in the United States will require the development of specialty-specific assessments and benchmarks, the financial and administrative support for implementation, the professional development of faculty and learners, and the cooperation of all major stakeholders in graduate medical education. In this article, we describe the need for evidence-based innovation in surgical training, the history of CBME in the United States, and the progress towards defining "entrustable professional activities" as the building blocks of assessments for CBME. We explore what such a paradigm shift in surgical education could mean for academic otolaryngologists by examining innovative educational practices in other surgical specialties and discussing foreseeable challenges in implementation for the American healthcare system.

The Use, Effectiveness, and Impact of Workplace-Based Assessments on Teaching, Supervision and Feedback Across Surgical Specialties.

OBJECTIVE: To investigate the use and effectiveness of Workplace-based assessments (WBAs) and their impact on training, feedback, and perioperative teaching in surgical training programs. DESIGN: A mixed methods cross-sectional, national electronic survey was conducted with surgical trainees and consultant trainers. SETTINGS: The trainees and supervising faculty were from all 8 major surgical training universities across 11 surgical disciplines in South Africa. PARTICIPANTS: A total of 108 surgical trainees and 41 supervising consultant trainers from 11 surgical disciplines across 8 surgical training universities responded to the survey. RESULTS: The most significant educational gap identified by both the surgical trainees and trainers across all surgical disciplines was inadequate perioperative feedback. A third of the respondents were currently using workplace-based assessments. The WBA users (both trainees and trainers) had a higher rating for the general quality of surgical feedback than WBA nonusers (p = 0.02). WBA users also had a higher rating for the general quality of feedback given to trainees on their skills and competence (p = 0.04) and a higher rating for trainee supervision (p = 0.01) and the specialist training program overall (p = 0.01). The WBA users also had a higher rating for the assessment of competencies such as the trainee as an effective communicator (p < 0.01) and collaborator (p = 0.04). CONCLUSION: This study found that the use of WBAs enhances the quality and effectiveness of feedback in surgical training programs. We also found that the use of WBAs enhance perioperative teaching and learning and improves the assessment of relational competencies. This was also associated with high ratings for the quality of trainee supervision. Faculty and trainee development, strengthening the trainee-trainer relationship, and integrating iterative stakeholder feedback could help realize the full potential of WBAs to augment surgical training across disciplines.

Which Entrustment-Supervision Scale is Right for Pharmacy Education?

Entrustable professional activities (EPAs) are an outgrowth of the competency-based educational model to support workplace-based learner assessments and evaluation. A learner's performance of EPAs is assessed by the degree of provided entrustment and required supervision rather than by a score, percentage, or letter grade typically assigned in traditional academic coursework. Entrustment-supervision (ES) scales are used to document learner progression and steer learner development over time. The purpose of this article is to critique various ES tools in health professions education for utilization within an EPA framework for learner assessment in workplace-based settings and to determine which will best suit pharmacy education. Exploring the advantages and disadvantages across all types of ES scales is a critical step in determining the most useful ES tool for use within a specific pharmacy institution and across the Academy. An ES scale with the traditional 5 levels, a prospective assessment frame, and increased stratification at lower levels should be recommended by the Academy and utilized in workplace-based settings for formative and summative assessment to provide more valid assessment of learners, support the ideal of life-long learning, and give more meaning for pharmacy faculty and learners within assessment.

Predicting Resident Competence for Otolaryngology Key Indicator Procedures.

OBJECTIVE: Competency-based surgical education requires practical assessments and meaningful benchmarks. In otolaryngology, key indicator procedure (KIP) minima are indicators of surgical exposure during training, yet it remains unknown how many times trainees must be evaluated on KIPs to ensure operative competence. Herein, we used Bayesian mixed effects models to compute predicted performance expectations for KIPs. METHODS: From November 2017 to September 2021, a smartphone application (SIMPL OR) was used by attendings at five otolaryngology training programs to rate resident operative performance after each case on a five-level scale. Bayesian mixed effects models were used to estimate the probability that postgraduate year (PGY) 3, 4, or 5 trainees would earn a "practice-ready" (PR) rating on a subsequent evaluation based on their previously earned PR ratings for each KIP. Probabilities of earning a subsequent PR rating were examined for interpretability, and cross-validation was used to assess predictive validity. RESULTS: A total of 842 assessments of KIPs were submitted by 72 attendings for 92 residents PGY 2-5. The predictive model had an average Area Under the Receiver Operating Curve of 0.77. The number of prior PR ratings that senior residents needed to attain a 95% probability of earning a PR rating on a subsequent evaluation was estimated for each KIP. For example, for mastoidectomies, PGY4 residents needed to earn 10 PR ratings whereas PGY5 residents needed 4 PR ratings on average to have a 95% probability of attaining a PR rating on a subsequent evaluation. CONCLUSION: Predictive modeling can inform assessment benchmarks for competency-based surgical education. LEVEL OF EVIDENCE: NA Laryngoscope, 133:3341-3345, 2023.

Commentary on alignment of medical student assessment and vocational training in psychiatry and addiction medicine.

OBJECTIVE: To comment upon the potential for alignment of medical student assessment and vocational specialist training through the RANZCP-CanMEDS model of Entrustable Professional Activities (EPAs) and Workplace-Based Assessments (WBAs). We discuss a specific post hoc example of such an alignment in an Australian graduate medical school in Psychiatry and Addiction Medicine. CONCLUSIONS: Vocational training models of assessment, such as the RANZCP specialist training program for psychiatrists, can potentially be mapped to medical student education in formative and summative assessment through CanMEDs-based EPAs and WBAs, to assist in transition to specialist training.

Review of the validity of DOPS as an assessment tool for the procedural skills of surgical trainees.

INTRODUCTION: Surgical trainees at all stages are mandated to use workplace-based assessments (WBAs) to gain feedback from their trainers. Direct observation of procedural skills (DOPS) is a tool to assess hands-on surgical skills. This review of the literature seeks to ascertain how valid DOPS are as an assessment tool for the procedural skills of surgical trainees according to the American Psychology Association (APA) validity framework. METHODS: Relevant literature was identified through a structured search of Medline, CINAHL and Web of Science databases, with further papers included on citation review. Following this, papers meeting the inclusion and exclusion criteria were included in the final review specifying those investigating WBAs including DOPS, assessments in practice rather than simulation and specifically for postgraduate surgical trainees. FINDINGS: Sixteen papers were included in the final analysis. Extracted data from the returned papers were assessed for evidence of validity in each of the five domains on the APA framework: validity based on consequence, response process, reliability, content and relationship to other variables. There are studies that show good parameters for reliability and validity for specific DOPS used in endoscopy and otolaryngology. However, there is confusion over the purpose of DOPS among trainers and trainees as to whether they should be used formatively or summatively. Recent changes to the surgical curriculum have sought to address this, and further work into the impact of this needs to be done.

Opportunities to Increase Workplace Feedback: A Multi-institutional Examination.

OBJECTIVE: While feedback is an essential component of resident education, there are few large-scale studies examining when and under what conditions formative feedback is provided. Workplace-based assessment systems offer an opportunity to identify factors influencing when faculty provides feedback to trainees. Influential factors affecting feedback may provide targets for increasing and improving feedback in resident education. DESIGN: Data on whether dictated feedback was provided were obtained from the Society for Improving Medical Professional Learning (SIMPL) mobile application. We used generalized linear mixed effects models to identify the degree to which faculty members, procedures, surgical case characteristics, and trainee performance were associated with whether narrative feedback was provided using SIMPL. SETTING: This study was conducted using data from members of the SIMPL collaborative. PARTICIPANTS: 67,434 evaluations from 70 general surgery programs were included from 2015 to 2021. Of these, 25,355 evaluations included dictated feedback. RESULTS: Approximately 61% of the variation in whether dictated feedback was provided was attributable to the individual faculty member. Compared to residents who achieved autonomy ratings of "Active Help," residents who achieved ratings of "Supervision Only" (odds ratio (OR) = 0.80, 95% confidence interval (CI) = 0.72, 0.88) had a lower likelihood of receiving dictated feedback. Residents who achieved ratings of "Intermediate" (OR = 0.81, CI = 0.74, 0.89), "Practice-Ready" (OR = 0.50, CI = 0.45, 0.57), or "Exceptional (OR = 0.64, CI = 0.54, 0.76) showed a lower likelihood of receiving dictated feedback compared to those rated as "Inexperienced." Cases rated as "High" in terms of complexity were associated with an increased likelihood of having dictation (OR = 1.35, CI = 1.26, 1.44). CONCLUSIONS: The largest contributing factor for whether dictated feedback is included in a SIMPL evaluation are factors specific to the attending surgeon. Resident performance, resident autonomy, and case complexity had only modest associations with feedback decisions. Efforts to improve the amount of formative feedback for trainees should be directed towards reducing the variation in which attending surgeons elect to provide feedback.

[Workplace-based Assessments: A Needs Analysis of Residents and Supervisors]. / Arbeitsplatz-basierte Assessments: eine Bedarfsanalyse bei Assistenzärztinnen und ­ärzten sowie ihren Supervisierenden.

Workplace-based Assessments: A Needs Analysis of Residents and Supervisors Abstract. During residency training, four workplace-based assessments (WBA) are planned per year in the form of Mini-CEX and/or DOPS. They were introduced as a tool for giving feedback and defining learning objectives in the clinical setting. The aim of the present study is to identify facilitating and inhibiting factors. The results will provide information to improve the use of this learning tool to effectively promote learning in the workplace. First, all users must be trained in its use. In particular, it is important to provide immediate and specific feedback that identifies opportunities for improvement and sets achievable learning goals. Documentation should be user-friendly and provide an overview of the learning process. WBAs should not be perceived as a duty, but as a tool for valuable learning moments.

Competency-Based Education and Practice in Physical Therapy: It's Time to Act!

Competency-based education (CBE) is a concept, a philosophy, and an approach to educational design where learner progression occurs when competency is demonstrated. It assumes a set of standard defined performance outcomes for any level of professional practice-students, residents, or practicing physical therapists. Those outcomes are based on the health needs of society and guide the curricular design, implementation, and evaluation of health professions education programs. Lack of a CBE framework-with no required demonstration of competence throughout one's career-has the potential to lead to variation in physical therapists' skills and to unwarranted variation in practice, potentially hindering delivery of the highest quality of patient care. CBE requires a framework that includes a commonly understood language; standardized, defined performance outcomes at various stages of learner development; and a process to assess whether competence has been demonstrated. The purpose of this perspective article is to (1) highlight the need for a shared language, (2) provide an overview of CBE and the impetus for the change, (3) propose a shift toward CBE in physical therapy, and (4) discuss the need for the profession to adopt a mindset requiring purposeful practice across one's career to safely and most efficiently practice in a given area. Utilizing a CBE philosophy throughout one's career should ensure high-quality and safe patient care to all-patient care that can adapt to the changing scope of physical therapist practice as well as the health care needs of society. The physical therapy profession is at a point at which we must step up the transition to a competency-based system of physical therapist education.

Core EPAs in the Acting Internship: Early Outcomes from an Interdepartmental Experience.

INTRODUCTION: The Core Entrustable Professional Activities for Entering Residency (Core EPAs) are clinical activities all interns should be able to perform on the first day of residency with indirect supervision. The acting (sub) internship (AI) rotation provides medical students the opportunity to be assessed on advanced Core EPAs. MATERIALS AND METHODS: All fourth-year AI students were taught Core EPA skills and performed these clinical skills under direct supervision. Formative feedback and direct observation data were provided via required workplace-based assessments (WBAs). Supervising physicians rated learner performance using the Ottawa Clinic Assessment Tool (OCAT). WBA and pre-post student self-assessment data were analyzed to assess student performance and gauge curriculum efficacy. RESULTS: In the 2017-2018 academic year, 167 students completed two AI rotations at our institution. By their last WBA, 91.2% of students achieved a target OCAT supervisory scale rating for both patient handoffs and calling consults. Paired sample t tests of the student pre-post surveys showed statistically significant improvement in self-efficacy on key clinical functions of the EPAs. DISCUSSION: This study demonstrates that the AI rotation can be structured to include a Core EPA curriculum that can assess student performance utilizing WBAs of directly observed clinical skills. CONCLUSIONS: Our clinical outcomes data demonstrates that the majority of fourth-year medical students are capable of performing advanced Core EPAs at a level acceptable for intern year by the conclusion of their AI rotations. WBA data collected can also aid in ad hoc and longitudinal summative Core EPA entrustment decisions. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s40670-021-01208-y.

[Update Medical Studies 2020: Bern]. / Update Medizinstudium 2020: Bern.

Update Medical Studies 2020: Bern Abstract. The education of the young Bernese medical students is problem-based as well as practice-oriented. The didactical concept of the Bachelor Studies is a guided self-study accompanied by concept lectures and interactive tutorials. The clinical skills are taught in a highly structured way, beginning with e-learning, seminars and Bedside Teaching. The Master Studies are based on evidence-based clinical education. The well-structured internships are the heart of the Bernese Master Studies; they enable the early inclusion of the students in the medical practice of the various healthcare disciplines. The communication trainings as well as the sonography courses are examples for the innovative development of the Bernese curriculum. The rotations in GP practices give an insight into the primary healthcare.

Exploring How the New Entrustable Professional Activity Assessment Tools Affect the Quality of Feedback Given to Medical Oncology Residents.

The post-graduate medical programs at Queen's University transitioned to a competency-based medical education framework on July 1, 2017. In advance of this transition, the Medical Oncology program participated in a pilot of six Entrustable Professional Activities (EPAs) focused workplace-based assessment (WBA) tools with faculty and residents. The purpose of this sequential explanatory mixed method study was to determine the extent to which these WBAs provided quality feedback for residents. The WBAs were introduced into daily clinical practice and, once completed, were collected by the research team. A resident focus group (n = 4) and faculty interviews (n = 5) were also conducted. Focus group and interview data were analyzed using an emergent thematic analysis. Data from the completed assessment tools were analyzed using both descriptive statistics and a literature-informed framework developed to assess the quality of feedback. Six main findings emerged: Verbal feedback is preferred over written; providing both written and verbal feedback is important; effective feedback was seen as timely, specific, and actionable; the process was conceptualized as coaching rather than high stakes; there were logistical concerns about the WBAs, and additional clarification about the WBA tools is needed. This study provides insight into faculty and resident perceptions of quality feedback and the potential for WBA tools to assist in providing effective feedback to residents as we shift to competency-based medical education in Canada. Our results suggest the need for additional faculty development around the use of the tools, and their intended role, and the elements of quality feedback.

OSCEs are outdated: clinical skills assessment should be centred around workplace-based assessments (WPBAS) to put the 'art' back into medicine.

This article was migrated. The article was marked as recommended. OSCEs have gradually replaced 'long cases' as the mainstay of undergraduate clinical skills assessment because of their objectivity, consistency and reliability. But the aspects of OSCEs which make them so reliable increasingly encourage students to prepare strategically, who often adopt a robotic 'tickbox' approach, rather than use OSCEs as a tool to learn clinical skills for safe competent real-life practice. Thus, whilst OSCEs facilitate technical competence, they do not prepare students for the unique nuances that make medicine an 'art' as well as a science. In pursuit of consistency and reliability, we are sacrificing validity and not preparing future doctors for the innate nuances and variability that make medicine so unique- and which often come as a shock to newly qualified doctors who orientate their undergraduate learning around OSCEs rather than real life. The doctors of the future will need to be adaptable and be able to vary their practice depending on the clinical and biopsychosocial context much more so than before. To drive their learning accordingly, we need a paradigm shift in medical education and assessment. WPBAs should now take centre-stage in undergraduate clinical assessment, with OSCEs significantly scaled back.

Competency Evaluations in the Next Accreditation System: Contributing to Guidelines and Implications.

UNLABELLED: CONSTRUCT: This study examines validity evidence of end-of-rotation evaluation scores used to measure competencies and milestones as part of the Next Accreditation System (NAS) of the Accreditation Council for Graduate Medical Education (ACGME). BACKGROUND: Since the implementation of the milestones, end-of-rotation evaluations have surfaced as a potentially useful assessment method. However, validity evidence on the use of rotation evaluation scores as part of the NAS has not been studied. This article examines validity evidence for end-of-rotation evaluations that can contribute to developing guidelines that support the NAS. APPROACH: Data from 2,701 end-of-rotation evaluations measuring 21 out of 22 Internal Medicine milestones for 142 residents were analyzed (July 2013-June 2014). Descriptive statistics were used to measure the distribution of ratings by evaluators (faculty, n = 116; fellows, n = 59; peer-residents, n = 131), by postgraduate years. Generalizability analysis and higher order confirmatory factor analysis were used to examine the internal structure of ratings. Psychometric implications for combining evaluation scores using composite score reliability were examined. RESULTS: Milestone ratings were significantly higher for each subsequent year of training (15/21 milestones). Faculty evaluators had greater variability in ratings across milestones, compared to fellows and residents; faculty ratings were generally correlated with milestone ratings from fellows (r = .45) and residents (r = .25), but lower correlations were found for Professionalism and Interpersonal and Communication Skills. The Φ-coefficient was .71, indicating good reliability. Internal structure supported a 6-factor solution, corresponding to the hierarchical relationship between the milestones and the 6 core competencies. Evaluation scores corresponding to Patient Care, Medical Knowledge, and Practice-Based Learning and Improvement had higher correlations to milestones reported to the ACGME. Mean evaluation ratings predicted problem residents (odds ratio = 5.82, p < .001). CONCLUSIONS: Guidelines for rotation evaluations proposed in this study provide useful solutions that can help program directors make decisions on resident progress and contribute to assessment systems in graduate medical education.

Surgical Trainers' Experience and Perspectives on Workplace-Based Assessments.

BACKGROUND: Workplace-based assessments (WBAs) were designed to provide formative feedback to trainees throughout their surgical career. Several studies highlight dissatisfaction with WBAs, and some feel they lack validity and reliability and exist as a "tick-box exercise." No studies have looked at the attitudes of the assessor. AIM: The aim of this study was to evaluate perceptions and experience of the 4 intercollegiate surgical curriculum programme WBAs by assessors. METHODS: An 18-item electronic questionnaire, including 6-point Likert scoring questions, was e-mailed to all surgical program directors for distribution to general surgery trainers within their deanery. RESULTS: In total, 64 responses were received. All trainers had been trained in using WBAs. Trainers had the most experience with procedure-based assessments (PBAs)-72% of trainers had completed more than 25 PBAs. Trainers felt PBAs were the most beneficial WBA, and both PBAs and case-based discussions were regarded as significantly more useful than mini-clinical evaluation exercise (p < 0.05). More than 74% stated that WBAs were mainly initiated by trainees, and only 10% had specific sessions allocated to complete WBAs. CONCLUSION: WBAs are regarded as beneficial to trainees. The results suggest that assessors feel case-based discussions and PBAs, which assess higher thinking and practice of complex practical skills, respectively, are significantly more useful than assessments involved in observing more straightforward clinical and procedural interactions.

Opinions of the ePortfolio and workplace-based assessments: a survey of core medical trainees and their supervisors.

Since the introduction of Modernising Medical Careers in 2005, the electronic portfolio (ePortfolio) and workplace based assessments (WPBAs) have become integral, yet anecdotally controversial, components of postgraduate medical training. In this multi-centre, survey-based study, we looked at core medical trainees and trainers in the Northwest London region and their opinions of the ePortfolio and WPBAs. Our results demonstrate mixed feelings regarding these tools, with 60% of trainees stating that their training had not benefited from the use of an ePortfolio. 53% of trainers felt that feedback sessions with their trainees were useful; however 70% of them cited difficulties in fitting the required number of assessments within their clinical schedule. Overall, if implemented correctly, the ePortfolio and WPBAs are potentially powerful tools in the education and development of trainee doctors. However, improvements in mentoring and feedback may be needed to experience the full benefits of this system.

An introduction to workplace-based assessments.

Recent trends in medical education are moving rapidly away from gaining a certain number of marks in high-stakes examinations and towards gathering evidence of clinical competence and professional behavior observed in clinical environments (workplace-based learning). In the Miller's framework for assessing clinical competence, workplace-based methods of assessment target the highest level of the pyramid and collect information about doctors' performance in their everyday practice. Direct Observation of Procedural Skills (DOPS), Mini-Clinical Evaluation Exercise (mini-CEX) and Case-based discussion (CbD) are some of the most commonly used methods of workplace-based assessments. I explain these three methods of assessment and their advantages and discuss that if incorporated in a structured program of teaching for doctors in training, they can promote active, learner-centered learning and facilitate provision of developmental verbal feedback to the trainee immediately afterwards.