Exploring How the New Entrustable Professional Activity Assessment Tools Affect the Quality of Feedback Given to Medical Oncology Residents.

The post-graduate medical programs at Queen's University transitioned to a competency-based medical education framework on July 1, 2017. In advance of this transition, the Medical Oncology program participated in a pilot of six Entrustable Professional Activities (EPAs) focused workplace-based assessment (WBA) tools with faculty and residents. The purpose of this sequential explanatory mixed method study was to determine the extent to which these WBAs provided quality feedback for residents. The WBAs were introduced into daily clinical practice and, once completed, were collected by the research team. A resident focus group (n = 4) and faculty interviews (n = 5) were also conducted. Focus group and interview data were analyzed using an emergent thematic analysis. Data from the completed assessment tools were analyzed using both descriptive statistics and a literature-informed framework developed to assess the quality of feedback. Six main findings emerged: Verbal feedback is preferred over written; providing both written and verbal feedback is important; effective feedback was seen as timely, specific, and actionable; the process was conceptualized as coaching rather than high stakes; there were logistical concerns about the WBAs, and additional clarification about the WBA tools is needed. This study provides insight into faculty and resident perceptions of quality feedback and the potential for WBA tools to assist in providing effective feedback to residents as we shift to competency-based medical education in Canada. Our results suggest the need for additional faculty development around the use of the tools, and their intended role, and the elements of quality feedback.

Involving ophthalmology departmental stakeholders in developing workplace-based assessment tools.

OBJECTIVE: As competency-based medical education (CBME) rolls out across Canada, the assessment process is changing. Our purpose was to involve stakeholders in the selection and modification of workplace-based assessment (WBA) tools for use in an ophthalmology residency program. DESIGN: This is a qualitative case study conducted in one ophthalmology department at a midsized teaching hospital in eastern Ontario. PARTICIPANTS: Ophthalmology faculty and residents within the Emergency Eye Clinic participated in the study. METHODS: Phase 1 consisted of faculty piloting the tools and providing written feedback. Phase 2 consisted of 2 focus groups, 1 for residents (n = 9) and 1 for faculty (n = 6), to explore their experiences with the 4 piloted adapted WBA tools. RESULTS: Residents and faculty discussed ongoing issues with buy-in and formalizing feedback through the new assessment process. Residents also reiterated the need for more constructive feedback delivered in a timely and sensitive manner. Generally, residents did not value numerical scales on the tools and preferred written comments. Both residents and faculty valued oral over written feedback given the interactive nature of oral feedback. CONCLUSIONS: This study provides insight into faculty and resident perspectives about WBA tools within one ophthalmology department. These results informed the development of WBA tools within the department and highlighted the importance of shifting the assessment culture to accommodate programmatic approaches to assessment in CBME. Involving key stakeholders in the change process has been a valuable strategy. Future research should examine whether or not these perspectives change after CBME implementation.