Workplace-based assessment for international medical graduates: at what cost?

OBJECTIVE: To estimate the cost of resources required to deliver a program to assess international medical graduates (IMGs) in Newcastle, Australia, known as the Workplace Based Assessment (WBA) Program. DESIGN AND SETTING: A costing study to identify and evaluate the resources required and the overheads of delivering the program for a cohort of 15 IMGs, based on costs in 2012. MAIN OUTCOME MEASURES: Labour-related costs. RESULTS: The total cost in 2012 for delivering the program to a typical cohort of 15 candidates was $243,384. This equated to an average of $16,226 per IMG. After allowing for the fees paid by IMGs, the WBA Program had a deficit of $153,384, or $10,226 per candidate, which represents the contribution made by the health system. CONCLUSION: The cost per candidate to the health system of this intensive WBA program for IMGs is small.

A systematic approach to workplace-based assessment for international medical graduates.

OBJECTIVES: To test whether a summative workplace-based assessment (WBA) is feasible and acceptable for international medical graduates (IMGs). DESIGN, SETTING AND PARTICIPANTS: A 6-month trial with 27 IMGs from teaching hospitals in Newcastle, Australia. IMGs were assessed by 65 trained assessors from different disciplines, using blueprinted, preset criteria. MAIN OUTCOME MEASURES: Mini-clinical evaluation exercises, case-based discussions, in-training assessments and multisource feedback. At the end of the trial, assessors and candidates gave feedback. RESULTS: All IMGs were successful at the end of the assessment. The format was well received and acceptable to the candidates and assessors. CONCLUSIONS: WBA is feasible and acceptable to assessors and candidates for assessment of IMGs, but it is intensive in use of resources and time.

Longitudinal Outcome of Programmatic Assessment of International Medical Graduates.

INTRODUCTION: Australia depends on international medical graduates (IMGs) to meet workforce shortages. The current standard assessment for IMGs is by clinical examination in observed structured clinical encounter (OSCE) format lasting 200 minutes. There are concerns about adequateness of this assessment as it does not test the qualities required to practice in a new country. We introduced a programmatic performance-based assessment for IMGs to prepare them to meet these challenges. The workplace-based assessment (WBA) program involves six-month longitudinal programmatic assessments comprising of 12 mini-clinical evaluation exercises (Mini-CEX), five case-based discussions (CBD), two in-training assessments (ITAs) and two sets of multisource feedback (MSF) assessments. We assessed 254 IMGs since 2010. We conducted a survey to evaluate the satisfaction with the program and the outcomes of these doctors. METHODS: We surveyed 254 candidates from 2010 to 2020. The survey used "SelectSurvey" tool with 12 questions and free-text comments. All candidates were sent the survey link to their last registered mobile phone using "Telstra Instant Messaging Service". We analysed the data using Microsoft "Excel". RESULTS: We received 153 (60%) responses. Amongst them, 141 (92%) candidates did not require further supervised practice for general registration and 129 (84%) candidates hold general/specialist registration. The candidates found the program useful and felt well supported. They appreciated real patient encounters. The feedback with positive critiquing was helpful in improving their clinical practice. The negative themes were program costs and frustration with the length of the program. CONCLUSION: Upon completion of the WBA program and obtaining the AMC certificate, most of the doctors were able to gain general registration. Seventy-eight (50%) candidates chose to continue their careers within the local area with 124 (80%) of them within the state. Our survey shows a comprehensive assessment program with immediate constructive feedback produces competent doctors to fill the medical workforce shortages.