The Quality of Operative Performance Narrative Feedback: A Retrospective Data Comparison Between End of Rotation Evaluations and Workplace-based Assessments.

OBJECTIVE: To describe the quality of operative performance feedback using evaluation tools commonly used by general surgery residency training programs. SUMMARY OF BACKGROUND DATA: The majority of surgical training programs administer an evaluation through which faculty members may rate and comment on trainee operative performance at the end of the rotation (EOR). Many programs have also implemented the system for improving and measuring procedural learning (SIMPL), a workplace-based assessment tool with which faculty can rate and comment on a trainee's operative performance immediately after a case. It is unknown how the quality of narrative operative performance feedback delivered with these tools compares. METHODS: The authors collected EOR evaluations and SIMPL narrative comments on trainees' operative performance from 3 university-based surgery training programs during the 2016-2017 academic year. Two surgeon raters categorized comments relating to operative skills as being specific or general and as encouraging and/or corrective. Comments were then classified as effective, mediocre, ineffective, or irrelevant. The frequencies with which comments were rated as effective were compared using Chi-square analysis. RESULTS: The authors analyzed a total of 600 comments. 10.7% of EOR and 58.3% of SIMPL operative performance evaluation comments were deemed effective (P < 0.0001). CONCLUSIONS: Evaluators give significantly higher quality operative performance feedback when using workplace-based assessment tools rather than EOR evaluations.

An Appreciative Inquiry Approach to the Core Competencies: Taking it From Theory to Practice.

OBJECTIVE: To operationalize the surgical core competencies by using a qualitative inquiry strategy to explore how surgical competence is behaviorally demonstrated by faculty. DESIGN: Categorical general and vascular surgery residents completed a survey soliciting opinions regarding which faculty were deemed most representative of each core competency. The surveys served as a theoretical sample, as surgeons selected were then interviewed, and interviews transcribed. A qualitative research approach using grounded theory coding methods was used for transcript analysis. Iterative coding was performed, and emergent themes were then extracted from transcript analysis. SETTING: Southern Illinois University School of Medicine, Department of Surgery in Springfield, IL, a tertiary academic center. PARTICIPANTS: Fourteen of 19 residents completed the survey (74% response rate). Two surgeons were selected for each competency. A total of 7 interviews were performed, with 4 surgeons being chosen for 2 competencies. RESULTS: Emergent themes revealed that competent surgeons shared qualities that drove their development and execution of each competency. These qualities included self-awareness, a selfless character, responsibility and ownership, context awareness, reliance on relationships and community, and a pattern of habit formation and discipline. Additionally, the competencies were noted to be pursued in an interrelated and interdependent fashion. CONCLUSIONS: Surgeons deemed competent in any core domain shared common qualities. Further study exploring how each of these is identified, developed and taught is warranted. The competencies are an inter-related matrix whose development and execution correlates with foundational personal disciplines.