Assessment of inhaler technique among fourth-year pharmacy students: Implications for the use of entrustable professional activities.

INTRODUCTION: It is unknown when and how often competency assessments should occur in pharmacy education. Using inhaler technique as an example competency, the study objectives were to measure the proportion of near-graduation students demonstrating correct technique approximately one year after initial training and to measure reliability between assessors. METHODS: A sample of 45 near-graduation pharmacy students with prior education on correct inhaler technique participated in this direct observation study at the University of Otago. Five trained assessors simultaneously rated each participant's inhaler technique demonstration using a checklist. RESULTS: Of 37 participants demonstrating a pressurized metered dose inhaler, 21.62% demonstrated correct technique. No participants among eight volunteers demonstrated proper use of a dry powder inhaler. On average, two steps were performed correctly for each inhaler type. Steps with the highest error rate were "hold the inhaler upright and shake well," "breath out gently, away from the inhaler," and "keep breathing in slowly and deeply". The intraclass correlation coefficient for any inhaler type was excellent (0.91), suggesting assessors had strong reliability. CONCLUSIONS: Students did not retain ability to correctly demonstrate inhaler technique one year after initial instruction. This finding supports the notion that demonstrable tasks may need to be frequently assessed to ensure the task is mastered and becomes a routine part of a student's practice. It also suggests that assessment of milestones and/or entrustable professional activities may need to occur at different time points throughout a program, rather than allowing for "signing off" prematurely.

Which Part of a Short, Global Risk Assessment, the Risk Instrument for Screening in the Community, Predicts Adverse Healthcare Outcomes?

The Risk Instrument for Screening in the Community (RISC) is a short, global risk assessment to identify community-dwelling older adults' one-year risk of institutionalisation, hospitalisation, and death. We investigated the contribution that the three components of the RISC (concern, its severity, and the ability of the caregiver network to manage concern) make to the accuracy of the instrument, across its three domains (mental state, activities of daily living (ADL), and medical state), by comparing their accuracy to other assessment instruments in the prospective Community Assessment of Risk and Treatment Strategies study. RISC scores were available for 782 patients. Across all three domains each subtest more accurately predicted institutionalisation compared to hospitalisation or death. The caregiver network's ability to manage ADL more accurately predicted institutionalisation (AUC 0.68) compared to hospitalisation (AUC 0.57, P = 0.01) or death (AUC 0.59, P = 0.046), comparing favourably with the Barthel Index (AUC 0.67). The severity of ADL (AUC 0.63), medical state (AUC 0.62), Clinical Frailty Scale (AUC 0.67), and Charlson Comorbidity Index (AUC 0.66) scores had similar accuracy in predicting mortality. Risk of hospitalisation was difficult to predict. Thus, each component, and particularly the caregiver network, had reasonable accuracy in predicting institutionalisation. No subtest or assessment instrument accurately predicted risk of hospitalisation.