ABSTRACT
PURPOSE: The Advanced Clinician Practitioner in Arthritis Care (ACPAC) Program was developed to train experienced physical and occupational therapists within extended practice roles with the aim of facilitating optimal, timely, and appropriate delivery of health care to patients with arthritis. This paper presents (1) the development of the ACPAC Program and (2) performance across the programme, as well as early quantitative and qualitative changes in clinical practice roles for the 2006 through 2008 cohorts of ACPAC Program graduates (n=19). METHODS: Measurement of change in skills and knowledge involved standardized baseline and end-of-programme examinations as well as self-evaluation of a number of areas of clinical competence. Practice-focused surveys issued at baseline, mid-programme, and end of programme, as well as at 6 and 12 months after graduation, evaluated the practitioners' integration of advanced knowledge and skills acquired during the ACPAC Program into their extended practice roles. RESULTS: Participants significantly increased their scores on examinations of clinical knowledge (p<0.001) and skills (p<0.001) from baseline through programme completion. There was an increase in frequency of performance of clinical tasks and assumption of responsibilities related to their extended practice roles from the beginning to the end of the programme. The five areas that changed in relation to these new roles were increased clinical responsibilities, efficiencies in practice settings, roles as educational leaders and mentors in the field of arthritis care, inter-professional collaboration, and improved access to care for patients with arthritis, particularly in remote areas. CONCLUSION: Graduates of the ACPAC Program have demonstrated knowledge and skills for practising in extended roles that enhance the available human health resource pool for patients with arthritis.
Subject(s)
Arthritis , Education, Professional , Clinical Competence , Delivery of Health Care , Delivery of Health Care, Integrated , Diagnostic Self Evaluation , Humans , Surveys and QuestionnairesABSTRACT
PURPOSE: Performance assessment using high fidelity simulation is problematic, due to the difficulty in developing valid and reliable evaluation tools. The Delphi technique is a consensus based content generation method used for multiple purposes such as policy development, best-evidence practice guidelines and competency assessments. The purpose of this study was to develop checklists using a modified Delphi technique to evaluate the performance of practicing anesthesiologists managing two simulated scenarios. METHODS: The templates for two simulation scenarios were emailed to five anesthesiologists who were asked to generate performance items. Data were collated anonymously and returned. An a priori decision was made to delete items endorsed by = 20% of participants. This process of collection, collation and re-evaluation was repeated until consensus was reached. Four independent raters used the checklist to assess three subjects managing the two simulation scenarios. Interrater reliability was assessed using average measures intraclass correlation (ICC) and repeated measures analysis of variance (ANOVA) was used to assess differences in difficulty between scenarios. RESULTS: The final checklists included 131 items for scenario 1 and 126 items for scenario 2. The mean inter-rater reliability was 0.921 for scenario 1 and 0.903 for scenario 2. Repeated measures ANOVA revealed no statistically significant difference in difficulty between scenarios. DISCUSSION: The Delphi technique can be very useful to generate consensus based evaluation tools with high content and face validity compared to subjective evaluative tools. Since there was no difference in scenario difficulty, these scenarios can be used to determine the effect of educational interventions on performance.