Key Issues in Surgical Residency Education: Recommendations of the Blue Ribbon II Committee Residency Education Subcommittee.

In September 2022, a summit was convened by the American Board of Surgery (ABS) to discuss competency-based reform in surgical education. A key output of that summit was the recommendation that the prior work of the Blue Ribbon I Committee convened 20 years earlier be revived. With leadership from the American College of Surgeons (ACS) and the American Surgical Association (ASA) , the Blue Ribbon Committee (BRC) II was subsequently convened. This paper describes the output of the Residency Education Subcommittee of the BRC II Committee. The Subcommittee organized its work around prioritized themes including curriculum, assessment, and transition to practice. Top recommendations, time-based action steps, potential barriers, and required resources were detailed and vetted through group discussion, broader Committee review and critique, and subsequent refinement. Primary concluding emphases included transitioning to a competency-based training model, facilitating dynamically capable curricular reform emphasizing the digital transformation of surgical care, using predictive analytic assessment strategies to optimize training effectiveness and efficiency, and creating mentorship strategies to govern the transition from training to independent practice in an outcomes-accountable fashion. It was recognized that coordinated efforts across existing organizational structures will be required, informed by dataset integration strategies that meaningfully measure educational and related patient outcomes.

A systems approach for institutional CBME adoption at Queen's University.

The Royal College of Physicians and Surgeons of Canada (RCPSC) has begun the transition to Competency by Design (CBD), a new curricular model for residency education that 'ensure[s] competence, but teaches for excellence'. By 2022, all Canadian specialty programs are anticipated to have completed the CBD cohort process which includes workshops facilitated by a Royal College Clinician Educator. Queen's University in Ontario, Canada, was granted approval by the RCPSC to embark upon an accelerated path to competency-based medical education (CBME) for all our postgraduate specialties. This accelerated path allowed us to take an institutional approach for CBME implementation and ensure that all specialities were part of a system-wide change. Our unique institution-wide approach to CBD is the first of its kind across Canada. From both a theoretical and practical perspective we undertook CBME using a systems approach that allowed us to build the foundations for CBME, implement the change, and plan for sustainability. This has created opportunities to bridge and connect the various programs involved in the implementation of CBME on Queen's campus. The systems approach was an essential part of our strategy to develop a community dedicated to ensuring a successful CBME implementation.

Eight-year outcomes of a competency-based residency training program in orthopedic surgery.

Background: The Division of Orthopaedic Surgery at the University of Toronto implemented a pilot residency training program that used a competency-based framework in July of 2009. The competency-based curriculum (CBC) deployed an innovative, modularized approach that dramatically intensified both the structured learning elements and the assessment processes. Methods: This paper discusses the initial curriculum design of the CBC pilot program; the refinement of the curriculum using curriculum mapping that allowed for efficiencies in educational delivery; details of evaluating resident competence; feedback from external reviews by accrediting bodies; and trainee and program outcomes for the first eight years of the program's implementation. Results: Feedback from the residents, the faculty, and the postgraduate residency training accreditation bodies on the CBC has been positive and suggests that the essential framework of the program may provide a valuable tool to other programs that are contemplating embarking on transition to competency-based education. Conclusions: While the goal of the program was not to shorten training per se, efficiencies gained through a modular, competency-based program have resulted in shortened time to completion of residency training for some learners.

Simulation for Teaching Orthopaedic Residents in a Competency-based Curriculum: Do the Benefits Justify the Increased Costs?

BACKGROUND: Although simulation-based training is becoming widespread in surgical education and research supports its use, one major limitation is cost. Until now, little has been published on the costs of simulation in residency training. At the University of Toronto, a novel competency-based curriculum in orthopaedic surgery has been implemented for training selected residents, which makes extensive use of simulation. Despite the benefits of this intensive approach to simulation, there is a need to consider its financial implications and demands on faculty time. QUESTIONS/PURPOSES: This study presents a cost and faculty work-hours analysis of implementing simulation as a teaching and evaluation tool in the University of Toronto's novel competency-based curriculum program compared with the historic costs of using simulation in the residency training program. METHODS: All invoices for simulation training were reviewed to determine the financial costs before and after implementation of the competency-based curriculum. Invoice items included costs for cadavers, artificial models, skills laboratory labor, associated materials, and standardized patients. Costs related to the surgical skills laboratory rental fees and orthopaedic implants were waived as a result of special arrangements with the skills laboratory and implant vendors. Although faculty time was not reimbursed, faculty hours dedicated to simulation were also evaluated. The academic year of 2008 to 2009 was chosen to represent an academic year that preceded the introduction of the competency-based curriculum. During this year, 12 residents used simulation for teaching. The academic year of 2010 to 2011 was chosen to represent an academic year when the competency-based curriculum training program was functioning parallel but separate from the regular stream of training. In this year, six residents used simulation for teaching and assessment. The academic year of 2012 to 2013 was chosen to represent an academic year when simulation was used equally among the competency-based curriculum and regular stream residents for teaching (60 residents) and among 14 competency-based curriculum residents and 21 regular stream residents for assessment. RESULTS: The total costs of using simulation to teach and assess all residents in the competency-based curriculum and regular stream programs (academic year 2012-2013) (CDN 155,750, USD 158,050) were approximately 15 times higher than the cost of using simulation to teach residents before the implementation of the competency-based curriculum (academic year 2008-2009) (CDN 10,090, USD 11,140). The number of hours spent teaching and assessing trainees increased from 96 to 317 hours during this period, representing a threefold increase. CONCLUSIONS: Although the financial costs and time demands on faculty in running the simulation program in the new competency-based curriculum at the University of Toronto have been substantial, augmented learner and trainer satisfaction has been accompanied by direct evidence of improved and more efficient learning outcomes. CLINICAL RELEVANCE: The higher costs and demands on faculty time associated with implementing simulation for teaching and assessment must be considered when it is used to enhance surgical training.

Gastrointestinal Endoscopy Competency Assessment Tool: reliability and validity evidence.

BACKGROUND: Rigorously developed and validated direct observational assessment tools are required to support competency-based colonoscopy training to facilitate skill acquisition, optimize learning, and ensure readiness for unsupervised practice. OBJECTIVE: To examine reliability and validity evidence of the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT) for colonoscopy for use within the clinical setting. DESIGN: Prospective, observational, multicenter validation study. Sixty-one endoscopists performing 116 colonoscopies were assessed using the GiECAT, which consists of a 7-item global rating scale (GRS) and 19-item checklist (CL). A second rater assessed procedures to determine interrater reliability by using intraclass correlation coefficients (ICCs). Endoscopists' first and second procedure scores were compared to determine test-retest reliability by using ICCs. Discriminative validity was examined by comparing novice, intermediate, and experienced endoscopists' scores. Concurrent validity was measured by correlating scores with colonoscopy experience, cecal and terminal ileal intubation rates, and physician global assessment. SETTING: A total of 116 colonoscopies performed by 33 novice (<50 previous procedures), 18 intermediate (50-500 previous procedures), and 10 experienced (>1000 previous procedures) endoscopists from 6 Canadian hospitals. MAIN OUTCOME MEASUREMENTS: Interrater and test-retest reliability, discriminative, and concurrent validity. RESULTS: Interrater reliability was high (total: ICC=0.85; GRS: ICC=0.85; CL: ICC=0.81). Test-retest reliability was excellent (total: ICC=0.91; GRS: ICC=0.93; CL: ICC=0.80). Significant differences in GiECAT scores among novice, intermediate, and experienced endoscopists were noted (P<.001). There was a significant positive correlation (P<.001) between scores and number of previous colonoscopies (total: ρ=0.78, GRS: ρ=0.80, CL: Spearman's ρ=0.71); cecal intubation rate (total: ρ=0.81, GRS: Spearman's ρ=0.82, CL: Spearman's ρ=0.75); ileal intubation rate (total: Spearman's ρ=0.82, GRS: Spearman's ρ=0.82, CL: Spearman's ρ=0.77); and physician global assessment (total: Spearman's ρ=0.90, GRS: Spearman's ρ=0.94, CL: Spearman's ρ=0.77). LIMITATIONS: Nonblinded assessments. CONCLUSION: This study provides evidence supporting the reliability and validity of the GiECAT for use in assessing the performance of live colonoscopies in the clinical setting.

Gastrointestinal Endoscopy Competency Assessment Tool: development of a procedure-specific assessment tool for colonoscopy.

BACKGROUND: Ensuring competence remains a seminal objective of endoscopy training programs, professional organizations, and accreditation bodies; however, no widely accepted measure of endoscopic competence currently exists. OBJECTIVE: By using Delphi methodology, we aimed to develop and establish the content validity of the Gastrointestinal Endoscopy Competency Assessment Tool for colonoscopy. DESIGN: An international panel of endoscopy experts rated potential checklist and global rating items for their importance as indicators of the competence of trainees learning to perform colonoscopy. After each round, responses were analyzed and sent back to the experts for further ratings until consensus was reached. MAIN OUTCOME MEASUREMENTS: Consensus was defined a priori as ≥80% of experts, in a given round, scoring ≥4 of 5 on all remaining items. RESULTS: Fifty-five experts agreed to be part of the Delphi panel: 43 gastroenterologists, 10 surgeons, and 2 endoscopy managers. Seventy-three checklist and 34 global rating items were generated through a systematic literature review and survey of committee members. An additional 2 checklist and 4 global rating items were added by Delphi panelists. Five rounds of surveys were completed before consensus was achieved, with response rates ranging from 67% to 100%. Seven global ratings and 19 checklist items reached consensus as good indicators of the competence of clinicians performing colonoscopy. LIMITATIONS: Further validation required. CONCLUSION: Delphi methodology allowed for the rigorous development and content validation of a new measure of endoscopic competence, reflective of practice across institutions. Although further evaluation is required, it is a promising step toward the objective assessment of competency for use in colonoscopy training, practice, and research.

Lessons learned in the pursuit of a dream.

CONTEXT: The author describes a career in which he combined clinical surgery with the formal study of medical education. In the 1980s, when the author embarked on this career track, it was an uncommon pathway. Over the last 30 years there has been an exponential increase in the number of individuals who have made medical education their principal academic focus. This paper provides examples from the author's personal story and lessons derived from that experience. PROCESS: The author outlines his experience of attaining formal training in education and concludes that this training was a foundational element in his pursuit of a career in health education research. The author describes his involvement in the transition from paper and pencil-based tests to performance-based testing in high-stakes examinations. He describes the development of a research centre in health professions education and the establishment of a simulation centre. The author's experiences in the development of an examination intended to measure technical skills, in the adoption of surgical safety checklists and in the elaboration of a programme in competency-based education are discussed. DISCUSSION: The author describes several of the lessons learned in the course of his career in medical education. He argues that successful enterprises in scholarship in medicine are almost invariably the product of interdisciplinarity. He describes the power of a joint venture between a university and an academic hospital. He argues that the geographical footprint of an emerging centre is critical. He discusses the importance of graduate studentship in an emerging discipline and enterprise.

Validation of a structured training and assessment curriculum for technical skill acquisition in minimally invasive surgery: a randomized controlled trial.

OBJECTIVE: : To develop and validate an ex vivo comprehensive curriculum for a basic laparoscopic procedure. BACKGROUND: : Although simulators have been well validated as tools to teach technical skills, their integration into comprehensive curricula is lacking. Moreover, neither the effect of ex vivo training on learning curves in the operating room (OR), nor the effect on nontechnical proficiency has been investigated. METHODS: : This randomized single-blinded prospective trial allocated 20 surgical trainees to a structured training and assessment curriculum (STAC) group or conventional residency training. The STAC consisted of case-based learning, proficiency-based virtual reality training, laparoscopic box training, and OR participation. After completion of the intervention, all participants performed 5 sequential laparoscopic cholecystectomies in the OR. The primary outcome measure was the difference in technical performance between the 2 groups during the first laparoscopic cholecystectomy. Secondary outcome measures included differences with respect to learning curves in the OR, technical proficiency of each sequential laparoscopic cholecystectomy, and nontechnical skills. RESULTS: : Residents in the STAC group outperformed residents in the conventional group in the first (P = 0.004), second (P = 0.036), third (P = 0.021), and fourth (P = 0.023) laparoscopic cholecystectomies. The conventional group demonstrated a significant learning curve in the OR (P = 0.015) in contrast to the STAC group (P = 0.032). Residents in the STAC group also had significantly higher nontechnical skills (P = 0.027). CONCLUSIONS: : Participating in the STAC shifted the learning curve for a basic laparoscopic procedure from the operating room into the simulation laboratory. STAC-trained residents had superior technical proficiency in the OR and nontechnical skills compared with conventionally trained residents. (The study registration ID is NCT01560494.).

A novel approach to assessing technical competence of colorectal surgery residents: the development and evaluation of the Colorectal Objective Structured Assessment of Technical Skill (COSATS).

OBJECTIVE: To develop and evaluate an objective method of technical skills assessment for graduating subspecialists in colorectal (CR) surgery-the Colorectal Objective Structured Assessment of Technical Skill (COSATS). BACKGROUND: It may be reasonable for the public to assume that surgeons certified as competent have had their technical skills assessed. However, technical skill, despite being the hallmark of a surgeon, is not directly assessed at the time of certification by surgical boards. METHODS: A procedure-based, multistation technical skills examination was developed to reflect a sample of the range of skills necessary for CR surgical practice. These consisted of bench, virtual reality, and cadaveric models. Reliability and construct validity were evaluated by comparing 10 graduating CR residents with 10 graduating general surgery (GS) residents from across North America. Expert CR surgeons, blinded to level of training, evaluated performance using a task-specific checklist and a global rating scale. The mean global rating score was used as the overall examination score and a passing score was set at "borderline competent for CR practice." RESULTS: The global rating scale demonstrated acceptable interstation reliability (0.69) for a homogeneous group of examinees. Both the overall checklist and global rating scores effectively discriminated between CR and GS residents (P < 0.01), with 27% of the variance attributed to level of training. Nine CR residents but only 3 GS residents were deemed competent. CONCLUSIONS: The Colorectal Objective Structured Assessment of Technical Skill effectively discriminated between CR and GS residents. With further validation, the Colorectal Objective Structured Assessment of Technical Skill could be incorporated into the colorectal board examination where it would be the first attempt of a surgical specialty to formally assess technical skill at the time of certification.

Competency-based education: a new model for teaching orthopaedics.

The current methods used to train residents to become orthopaedic surgeons are based on tradition, not evidence-based models. Educators have only a limited ability to assess trainees for competency using validated tests in various domains. The reduction in resident work hours limits the time available for clinical training, which has resulted in some calls for lengthening the training process. Another approach to address limited training hours is to focus training in a program that allows residents to graduate from a rotation based on demonstrated competency rather than on time on a service. A pilot orthopaedic residency curriculum, which uses a competency-based framework of resident training and maximizes the use of available training hours, has been designed and is being implemented.

Aging-associated reductions in AMP-activated protein kinase activity and mitochondrial biogenesis.

Recent studies have demonstrated a strong relationship between aging-associated reductions in mitochondrial function, dysregulated intracellular lipid metabolism, and insulin resistance. Given the important role of the AMP-activated protein kinase (AMPK) in the regulation of fat oxidation and mitochondrial biogenesis, we examined AMPK activity in young and old rats and found that acute stimulation of AMPK-alpha(2) activity by 5'-aminoimidazole-4-carboxamide-1-beta-D-ribofuranoside (AICAR) and exercise was blunted in skeletal muscle of old rats. Furthermore, mitochondrial biogenesis in response to chronic activation of AMPK with beta-guanidinopropionic acid (beta-GPA) feeding was also diminished in old rats. These results suggest that aging-associated reductions in AMPK activity may be an important contributing factor in the reduced mitochondrial function and dysregulated intracellular lipid metabolism associated with aging.

A comparison of 2 ex vivo training curricula for advanced laparoscopic skills: a randomized controlled trial.

OBJECTIVE: To compare the effectiveness and cost of 2 ex vivo training curricula for laparoscopic suturing. BACKGROUND: Although simulators have been developed to teach laparoscopic suturing, a barrier to their wide implementation in training programs is a lack of knowledge regarding their relative training benefit and their associated cost. METHOD: This prospective single-blinded randomized trial allocated 24 surgical residents to train to proficiency using either a virtual reality (VR) simulator or box trainer. All residents then placed intracorporeal laparoscopic stitches during a Nissen fundoplication on a patient. The operating room (OR) cases were video-recorded and technical proficiency was assessed using 2 validated tools. OR performance of both groups was compared to that of conventionally trained residents and to fellowship-trained surgeons. A cost analysis of box training, VR training, and conventional residency training across Canadian surgical programs was performed. RESULTS: After ex vivo training, no significant differences in laparoscopic suturing in the OR were found between the 2 groups with respect to time (P = 0.74)-global rating score (P = 0.65) or checklist score (P = 0.97). It took conventionally trained residents 6 practice attempts in the OR to achieve the technical proficiency of the ex vivo trained groups (P = 0.83). VR training was more efficient than box training (transfer effectiveness ratio of 2.31 vs 1.13). The annual cost of training 5 residents on the FLS trainer box was $11,975.00, on the VR simulator was $77,500.00, and conventional residency training was $17,380.00. Over 5 years, box training was the most cost-effective option for all programs, and VR training was more cost-effective for programs with more 10 residents. CONCLUSIONS: Training on either a VR simulator or on a box trainer significantly decreased the learning curve necessary to learn laparoscopic suturing. VR training, however, is the more efficient training modality, whereas box training the more cost-effective option.

A surgical safety checklist to reduce morbidity and mortality in a global population.

BACKGROUND: Surgery has become an integral part of global health care, with an estimated 234 million operations performed yearly. Surgical complications are common and often preventable. We hypothesized that a program to implement a 19-item surgical safety checklist designed to improve team communication and consistency of care would reduce complications and deaths associated with surgery. METHODS: Between October 2007 and September 2008, eight hospitals in eight cities (Toronto, Canada; New Delhi, India; Amman, Jordan; Auckland, New Zealand; Manila, Philippines; Ifakara, Tanzania; London, England; and Seattle, WA) representing a variety of economic circumstances and diverse populations of patients participated in the World Health Organization's Safe Surgery Saves Lives program. We prospectively collected data on clinical processes and outcomes from 3733 consecutively enrolled patients 16 years of age or older who were undergoing noncardiac surgery. We subsequently collected data on 3955 consecutively enrolled patients after the introduction of the Surgical Safety Checklist. The primary end point was the rate of complications, including death, during hospitalization within the first 30 days after the operation. RESULTS: The rate of death was 1.5% before the checklist was introduced and declined to 0.8% afterward (P=0.003). Inpatient complications occurred in 11.0% of patients at baseline and in 7.0% after introduction of the checklist (P<0.001). CONCLUSIONS: Implementation of the checklist was associated with concomitant reductions in the rates of death and complications among patients at least 16 years of age who were undergoing noncardiac surgery in a diverse group of hospitals.

Paradoxical effects of increased expression of PGC-1alpha on muscle mitochondrial function and insulin-stimulated muscle glucose metabolism.

Peroxisome proliferator-activated receptor-gamma coactivator (PGC)-1alpha has been shown to play critical roles in regulating mitochondria biogenesis, respiration, and muscle oxidative phenotype. Furthermore, reductions in the expression of PGC-1alpha in muscle have been implicated in the pathogenesis of type 2 diabetes. To determine the effect of increased muscle-specific PGC-1alpha expression on muscle mitochondrial function and glucose and lipid metabolism in vivo, we examined body composition, energy balance, and liver and muscle insulin sensitivity by hyperinsulinemic-euglycemic clamp studies and muscle energetics by using (31)P magnetic resonance spectroscopy in transgenic mice. Increased expression of PGC-1alpha in muscle resulted in a 2.4-fold increase in mitochondrial density, which was associated with an approximately 60% increase in the unidirectional rate of ATP synthesis. Surprisingly, there was no effect of increased muscle PGC-1alpha expression on whole-body energy expenditure, and PGC-1alpha transgenic mice were more prone to fat-induced insulin resistance because of decreased insulin-stimulated muscle glucose uptake. The reduced insulin-stimulated muscle glucose uptake could most likely be attributed to a relative increase in fatty acid delivery/triglyceride reesterfication, as reflected by increased expression of CD36, acyl-CoA:diacylglycerol acyltransferase1, and mitochondrial acyl-CoA:glycerol-sn-3-phosphate acyltransferase, that may have exceeded mitochondrial fatty acid oxidation, resulting in increased intracellular lipid accumulation and an increase in the membrane to cytosol diacylglycerol content. This, in turn, caused activation of PKC, decreased insulin signaling at the level of insulin receptor substrate-1 (IRS-1) tyrosine phosphorylation, and skeletal muscle insulin resistance.

Overexpression of uncoupling protein 3 in skeletal muscle protects against fat-induced insulin resistance.

Insulin resistance is a major factor in the pathogenesis of type 2 diabetes and is strongly associated with obesity. Increased concentrations of intracellular fatty acid metabolites have been postulated to interfere with insulin signaling by activation of a serine kinase cascade involving PKCtheta in skeletal muscle. Uncoupling protein 3 (UCP3) has been postulated to dissipate the mitochondrial proton gradient and cause metabolic inefficiency. We therefore hypothesized that overexpression of UCP3 in skeletal muscle might protect against fat-induced insulin resistance in muscle by conversion of intramyocellular fat into thermal energy. Wild-type mice fed a high-fat diet were markedly insulin resistant, a result of defects in insulin-stimulated glucose uptake in skeletal muscle and hepatic insulin resistance. Insulin resistance in these tissues was associated with reduced insulin-stimulated insulin receptor substrate 1- (IRS-1-) and IRS-2-associated PI3K activity in muscle and liver, respectively. In contrast, UCP3-overexpressing mice were completely protected against fat-induced defects in insulin signaling and action in these tissues. Furthermore, these changes were associated with a lower membrane-to-cytosolic ratio of diacylglycerol and reduced PKCtheta activity in whole-body fat-matched UCP3 transgenic mice. These results suggest that increasing mitochondrial uncoupling in skeletal muscle may be an excellent therapeutic target for type 2 diabetes mellitus.

Competency-based resident education-The Canadian perspective.

Canada has been a leader in competency-based medical education for some years. Postgraduate training programs are typically 5 years in duration with opportunities to pursue 2-year subspecialty training after certification in a primary specialty. The introduction of competency-based models in Canada has progressed from a single orthopedic surgery training program at the University of Toronto through the adoption of competency-based medical education in 29 training programs at a single medical school, and the implementation across all 68 disciplines overseen by the Royal College of Physicians and Surgeons of Canada. This article outlines the introduction of competency-based medical education in postgraduate medical education in Canada.

Addressing the severe shortage of health care providers in Ethiopia: bench model teaching of technical skills.

CONTEXT: There is a severe shortage of health care workers in Ethiopia. This situation must be addressed by the efficient training of mass cohorts of students. OBJECTIVES: This study aimed to demonstrate that bench model training is a feasible approach to teaching surgical skills in Ethiopia. METHODS: A pre-test, simulation-based training intervention and post-test design was used. Two objective structured assessments of technical skills (OSATS) and a bench-top simulation training session were administered at the Black Lion Hospital, Addis Ababa, Ethiopia. Participants included 19 surgical residents who volunteered as trainees. Five surgical faculty members and one senior resident from the Black Lion Hospital, as well as two faculty members from the University of Toronto, participated as trainers and evaluators. The intervention consisted of OSATS tests comprising four stations, covering knot tying, closure of skin laceration, elliptical excision and bowel anastomosis. Tests were separated by 2-hour practice sessions. Main outcome measures included previously validated instruments comprising global rating scales (GRS) and skill-specific checklists (SSC). RESULTS: The measures showed no improvement on knot tying (GRS: P = 0.14; SSC: P = 0.7), marginal improvement on closure of laceration (GRS: P = 0.48; SSC: P = 0.003), and improvements on excision (GRS: P = 0.012; SSC: P = 0.003) and bowel anastomosis (GRS: P < 0.001; SSC: P < 0.001). CONCLUSIONS: The bench models and scoring schemes developed in Toronto, Canada were directly applicable in Addis Ababa, Ethiopia. This approach may prove a feasible, safe and cost-effective method for training a multitude of health care professionals in technical skills and may help to address the human resources deficit in Africa.

Comparison of faculty versus structured peer-feedback for acquisitions of basic and intermediate-level surgical skills.

PURPOSE: Video feedback and faculty feedback has been shown to improve surgical performance; however, consistent access to faculty is challenging. We studied the utility of structured peer-feedback (PF) compared to faculty-feedback (FF) during acquisition of basic and intermediate surgical skills. METHODOLOGY: Two randomized non-inferiority trials were conducted with 1st (n = 30) and 2nd year (n = 29) medical students learning skin-lesion excision and closure (S), and single-layer hand-sewn bowel anastomosis (B), respectively. Five attempts were performed. PF participants used an Objective Structured Assessment of Technical Skills tool to guide feedback. Blinded raters assessed video-recorded performance, time and Integrity of the completed task were also assessed. RESULTS: For both tasks performance by PF was comparable to FF (P = 0.111). Both groups improved significantly: performance (B:P < 0.0001, S:P = 0.035), time (B:P = 0.043, S:P < 0.0001) and integrity (B:P < 0.0001, S:P < 0.032). CONCLUSION: Structured peer-feedback is equivalent to faculty-feedback in the acquisition of basic and intermediate surgical skills, giving students freedom to practice independently.

Comparison of Personal Video Technology for Teaching and Assessment of Surgical Skills.

BACKGROUND: Improvements in personal technology have made video recording for teaching and assessment of surgical skills possible. OBJECTIVE: This study compared 5 personal video-recording devices based on their utility (image quality, hardware, mounting options, and accessibility) in recording open surgical procedures. METHODS: Open procedures in a simulated setting were recorded using smartphones and tablets (MOB), laptops (LAP), sports cameras such as GoPro (SC), single-lens reflex cameras (DSLR), and spy camera glasses (SPY). Utility was rated by consensus between 2 investigators trained in observation of technology using a 5-point Likert scale (1, poor, to 5, excellent). RESULTS: A total of 150 hours of muted video were reviewed with a minimum 1 hour for each device. Image quality was good (3.8) across all devices, although this was influenced by the device-mounting requirements (4.2) and its proximity to the area of interest. Device hardware (battery life and storage capacity) was problematic for long procedures (3.8). Availability of devices was high (4.2). CONCLUSIONS: Personal video-recording technology can be used for assessment and teaching of open surgical skills. DSLR and SC provide the best images. DSLR provides the best zoom capability from an offset position, while SC can be placed closer to the operative field without impairing sterility. Laptops provide best overall utility for long procedures due to video file size. All devices require stable recording platforms (eg, bench space, dedicated mounting accessories). Head harnesses (SC, SPY) provide opportunities for "point-of-view" recordings. MOB and LAP can be used for multiple concurrent recordings.

Delivering on the promise of competency based medical education - an institutional approach.

The Royal College of Physicians and Surgeons of Canada (RCPSC) adopted a plan to transform, over a seven-year horizon (2014-2021), residency education across all specialties to competency-based medical education (CBME) curriculum models. The RCPSC plan recommended implementing a more responsive and accountable training model with four discrete stages of training, explicit, specialty specific entrustable professional activities, with associated milestones, and a programmatic approach to assessment across residency education. Embracing this vision, the leadership at Queen's University (in Kingston, Ontario, Canada) applied for and was granted special permission by the RCPSC to embark on an accelerated institutional path. Over a three-year period, Queen's took CBME from concept to reality through the development and implementation of a comprehensive strategic plan. This perspective paper describes Queen's University's approach of creating a shared institutional vision, outlines the process of developing a centralized CBME executive team and twenty-nine CBME program teams, and summarizes proactive measures to ensure program readiness for launch. In so doing, Queen's created a community of support and CBME expertise that reinforces shared values including fostering co-production, cultivating responsive leadership, emphasizing diffusion of innovation, and adopting a systems-based approach to transformative change.