RESUMO
INTRODUCTION: It is unknown when and how often competency assessments should occur in pharmacy education. Using inhaler technique as an example competency, the study objectives were to measure the proportion of near-graduation students demonstrating correct technique approximately one year after initial training and to measure reliability between assessors. METHODS: A sample of 45 near-graduation pharmacy students with prior education on correct inhaler technique participated in this direct observation study at the University of Otago. Five trained assessors simultaneously rated each participant's inhaler technique demonstration using a checklist. RESULTS: Of 37 participants demonstrating a pressurized metered dose inhaler, 21.62% demonstrated correct technique. No participants among eight volunteers demonstrated proper use of a dry powder inhaler. On average, two steps were performed correctly for each inhaler type. Steps with the highest error rate were "hold the inhaler upright and shake well," "breath out gently, away from the inhaler," and "keep breathing in slowly and deeply". The intraclass correlation coefficient for any inhaler type was excellent (0.91), suggesting assessors had strong reliability. CONCLUSIONS: Students did not retain ability to correctly demonstrate inhaler technique one year after initial instruction. This finding supports the notion that demonstrable tasks may need to be frequently assessed to ensure the task is mastered and becomes a routine part of a student's practice. It also suggests that assessment of milestones and/or entrustable professional activities may need to occur at different time points throughout a program, rather than allowing for "signing off" prematurely.