The DIAMOND portal: An innovative platform for sharing translational research workforce training and assessment resources.

Although several initiatives have produced core competency domains for training the translational science workforce, training resources to help clinical research professionals advance these skills reside primarily within local departments or institutions. The Development, Implementation, and AssessMent of Novel Training in Domain (DIAMOND) project was designed to make this training more readily and publicly available. DIAMOND includes a digital portal to catalog publicly available educational resources and an ePortfolio to document professional development. DIAMOND is a nationally crowdsourced, federated, online catalog providing a platform for practitioners to find and share training and assessment materials. Contributors can share their own educational materials using a simple intake form that creates an electronic record; the portal enables users to browse or search this catalog of digital records and access the resources. Since September 2018, the portal has been visited more than 5,700 times and received over 280 contributions from professionals. The portal facilitates opportunities to connect and collaborate regarding future applications of these resources. Consequently, growing the collection and increasing numbers of both contributors and users remains a priority. Results from a small subset of users indicated over half accomplished their purpose for visiting the site, while qualitative results showed that users identified several benefits and helpful features of the ePortfolio.

Student Satisfaction With Blackboard-Style Videos.

Blackboard-style videos with simple drawings illustrating concepts have become immensely popular in recent years. However, there has been no published research evaluating their efficacy in nursing education. This pilot study evaluates the use of blackboard-style videos in an online pathophysiology course. Quantitative and qualitative evaluation data were analyzed to evaluate student satisfaction. The data indicated that students were highly satisfied with the course and the delivery of content using blackboard-style videos. The qualitative analysis uncovered two key themes explaining the high level of satisfaction: visual plus narrative explanations support learning and student control over pacing enhances learning.

Simulation-based learning: From theory to practice.

Comments on the article, ""Stimulating Reflective Practice Using Collaborative Reflective Training in Breaking Bad News Simulations," by Kim, Hernandez, Lavery, and Denmark (see record 2016-18380-001). Kim et al. are applauded for engaging and supporting the development of simulation-based education, and for their efforts to create an interprofessional learning environment. However, we hope further work on alternate methods of debriefing leverage the already inherent activation of learners that builds on previous experience, fosters reflection and builds skills. What is needed is the transference of learning theories into our educational research efforts that measure the effectiveness, validation, and reliability of behavior based performance change. The majority of breaking bad news (BBN) curricula limit program evaluations to reports of learner satisfaction, confidence and self-efficacy, rather than determining the successful translation of effective and humanistic interpersonal skills into long-term clinical practice (Rosenbaum et al., 2004). Research is needed to investigate how educational programs affect provider-patient-family interaction, and ultimately patient and family understanding, to better inform our teaching BBN skills. (PsycINFO Database Record

Exploring the Content of Intraoperative Teaching.

INTRODUCTION: Much teaching to surgical residents takes place in the operating room (OR). The explicit content of what is taught in the OR, however, has not previously been described. This study investigated the content of what is taught in the OR, specifically during laparoscopic cholecystectomies (LCs), for which a cognitive task analysis (CTA), explicitly delineating individual steps, was available in the literature. METHODS: A checklist of necessary technical and decision-making steps to be executed during performance of LCs, anchored in the previously published CTA, was developed. A convenience sample of LCs was identified over a 12-month period from February 2011 to February 2012. Using the checklist, a trained observer recorded explicit teaching that occurred regarding these steps during each observed case. All observations were tallied and analyzed. RESULTS: In all, 51 LCs were observed; 14 surgery attendings and 33 residents participated in the observed cases. Of 1042 observable teaching points, only 560 (53.7%) were observed during the study period. As a proportion of all observable steps, technical steps were observed more frequently, 377 (67.3%), than decision-making steps, 183 (32.7%). Also when focusing on technical and decision-making steps alone, technical steps were taught more frequently (60.9% vs 43.3%). CONCLUSIONS: Only approximately half of all possible observable teaching steps were explicitly taught during LCs in this study. Technical steps were more frequently taught than decision-making steps. These findings may have important implications: a better understanding of the content of intraoperative teaching would allow educators to steer residents' preoperative preparation, modulate intraoperative instruction by members of the surgical faculty, and guide residents to the most appropriate teaching venues.

Surgeons' Leadership Styles and Team Behavior in the Operating Room.

BACKGROUND: The importance of leadership is recognized in surgery, but the specific impact of leadership style on team behavior is not well understood. In other industries, leadership is a well-characterized construct. One dominant theory proposes that transactional (task-focused) leaders achieve minimum standards and transformational (team-oriented) leaders inspire performance beyond expectations. STUDY DESIGN: We videorecorded 5 surgeons performing complex operations. Each surgeon was scored on the Multifactor Leadership Questionnaire, a validated method for scoring transformational and transactional leadership style, by an organizational psychologist and a surgeon researcher. Independent coders assessed surgeons' leadership behaviors according to the Surgical Leadership Inventory and team behaviors (information sharing, cooperative, and voice behaviors). All coders were blinded. Leadership style (Multifactor Leadership Questionnaire) was correlated with surgeon behavior (Surgical Leadership Inventory) and team behavior using Poisson regression, controlling for time and the total number of behaviors, respectively. RESULTS: All surgeons scored similarly on transactional leadership (range 2.38 to 2.69), but varied more widely on transformational leadership (range 1.98 to 3.60). Each 1-point increase in transformational score corresponded to 3 times more information-sharing behaviors (p < 0.0001) and 5.4 times more voice behaviors (p = 0.0005) among the team. With each 1-point increase in transformational score, leaders displayed 10 times more supportive behaviors (p < 0.0001) and displayed poor behaviors 12.5 times less frequently (p < 0.0001). Excerpts of representative dialogue are included for illustration. CONCLUSIONS: We provide a framework for evaluating surgeons' leadership and its impact on team performance in the operating room. As in other fields, our data suggest that transformational leadership is associated with improved team behavior. Surgeon leadership development, therefore, has the potential to improve the efficiency and safety of operative care.

How to recruit, retain, and reap the rewards of working with PhD/EdD educators in surgery.

BACKGROUND: PhD and EdD educators in departments of surgery have and are increasingly becoming valuable colleagues. Professional educators typically assist chairpersons and program directors by positively impacting the education, research, and service missions. OBJECTIVE: The purpose of this article is 3-fold: (1) to identify ways of finding prospective PhD/EdD educators, (2) to recognize ways to work with educators in a complimentary way so the educator and directors mutually benefit, and (3) to identify various ways departments and programs can benefit from employing a professional educator.

Using an Objective Structured Clinical Examination to test adherence to Joint Commission National Patient Safety Goal--associated behaviors.

BACKGROUND: A study was conducted at a tertiary care academic medical center to assess a simulation-based, single-station Objective Structured Clinical Examination (OSCE) designed to evaluate intern trainees' familiarity with and adherence to behaviors associated with Joint Commission National Patient Safety Goals and The Joint Commission Universal Protocol for Preventing Wrong Site, Wrong Procedure, Wrong Person Surgery. METHOD: Subjects were interns, from all disciplines, completing basic skills training during intern orientation. The OSCE scenario was designed to assess 13 behaviors associated with four National Patient Safety Goals (1, 2, 3, and 7) from 2009 and 2010 and the Universal Protocol. Sessions were digitally recorded and independently reviewed by two observers, who scored behaviors using a standardized score sheet. Behaviors were assigned point values and tabulated for all trainees. Kappa coefficient was calculated to assess interrater reliability. RESULTS: One-hundred eleven (74.5%) of 149 interns completed the station. The average time to completion was 6.9 minutes (standard deviation [SD] 1.8; range, 3.5-12.6). Interns scored an average of 9.5 points (SD, 4.7; range, 2-20; mode, 8) of 26. The interrater reliability for the two reviewers was 0.9. Interns most frequently requested chlorhexidine to sterilize the patient's skin (98.2% of interns demonstrated); identifying an unlabeled medication vial as inappropriate for use was the most frequently missed item (8.1% of interns demonstrated). CONCLUSIONS: Behaviors related to tenets of patient safety and quality care can be assessed using a simple to design and execute OSCE. Using simulation to test behaviors associated with the National Patient Safety Goals may be a desirable adjunct to traditional simple knowledge-based tests.

Residents can successfully teach basic surgical skills in the simulation center.

OBJECTIVES: Basic surgical skills are frequently taught to surgical interns in simulation centers. Faculty recruitment for teaching of these sessions can be difficult. The goal of this study was to determine whether senior surgical residents can effectively teach basic surgical skills to provide an alternative to faculty-led instruction. DESIGN, SETTING, AND PARTICIPANTS: Academic medical center. Twenty-eight surgical interns. In this randomized controlled trial, interns were randomized to receive teaching by either faculty or senior residents. Two-hour teaching sessions for each group consisted of modeling and guided practice. All interns underwent baseline knot-tying and suturing skill assessment using a previously validated standardized task scoring scheme and completed a confidence survey. After teaching sessions, both groups underwent repeated skill testing and were again surveyed. RESULTS: Twenty-eight interns started in the surgery program at our institution during the year of this study. Seventeen of 27 (62.9%) interns participated in both teaching sessions and completed all skill assessments and surveys; 7 (41.2%) interns were taught by faculty, 10 (58.8%) by residents. Overall, skills training improved in both groups for knot-tying, running suture, and subcuticular suture performance. Confidence performing knot-tying tasks also improved. Interns taught by faculty members and residents demonstrated similar levels of improvement in speed and accuracy, although faculty instruction improved speed of performing the simple suturing task (-144 vs -27 s, p = 0.04). CONCLUSIONS: In the simulation center, teaching by senior surgical residents and faculty members resulted in comparable improvement in interns' basic surgical skills. These findings could increase the skill instructor pool for teaching in the simulation center, potentially easing recruitment and providing senior residents with teaching opportunities.

Assessing physician leadership styles: application of the situational leadership model to transitions in patient acuity.

BACKGROUND: The situational leadership model suggests that an effective leader adapts leadership style depending on the followers' level of competency. PURPOSE: We assessed the applicability and reliability of the situational leadership model when observing residents in simulated hospital floor-based scenarios. METHODS: Resident teams engaged in clinical simulated scenarios. Video recordings were divided into clips based on Emergency Severity Index v4 acuity scores. Situational leadership styles were identified in clips by two physicians. Interrater reliability was determined through descriptive statistical data analysis. RESULTS: There were 114 participants recorded in 20 sessions, and 109 clips were reviewed and scored. There was a high level of interrater reliability (weighted kappa r = .81) supporting situational leadership model's applicability to medical teams. A suggestive correlation was found between frequency of changes in leadership style and the ability to effectively lead a medical team. CONCLUSIONS: The situational leadership model represents a unique tool to assess medical leadership performance in the context of acuity changes.

Protecting patients from an unsafe system: the etiology and recovery of intraoperative deviations in care.

OBJECTIVE: To understand the etiology and resolution of unanticipated events in the operating room (OR). BACKGROUND: The majority of surgical adverse events occur intraoperatively. The OR represents a complex, high-risk system. The influence of different human, team, and organizational/environmental factors on safety and performance is unknown. METHODS: We video-recorded and transcribed 10 high-acuity operations, representing 43.7 hours of patient care. Deviations, defined as delays and/or episodes of decreased patient safety, were identified by majority consensus of a multidisciplinary team. Factors that contributed to each event and/or mitigated its impact were determined and attributed to the patient, providers, or environment/organization. RESULTS: Thirty-three deviations (10 delays, 17 safety compromises, 6 both) occurred--with a mean of 1 every 79.4 minutes. These deviations were multifactorial (mean 3.1 factors). Problems with communication and organizational structure appeared repeatedly at the root of both types of deviations. Delays tended to be resolved with vigilance, communication, coordination, and cooperation, while mediation of safety compromises was most frequently accomplished with vigilance, leadership, communication, and/or coordination. The organization/environment was not found to play a direct role in compensation. CONCLUSIONS: Unanticipated events are common in the OR. Deviations result from poor organizational/environmental design and suboptimal team dynamics, with caregivers compensating to avoid patient harm. Although recognized in other high-risk domains, such human resilience has not yet been described in surgery and has major implications for the design of safety interventions.

Master surgeons' operative teaching philosophies: a qualitative analysis of parallels to learning theory.

OBJECTIVES: Practicing within the Halstedian model of surgical education, academic surgeons serve dual roles as physicians to their patients and educators of their trainees. Despite this significant responsibility, few surgeons receive formal training in educational theory to inform their practice. The goal of this work was to gain an understanding of how master surgeons approach teaching uncommon and highly complex operations and to determine the educational constructs that frame their teaching philosophies and approaches. DESIGN: Individuals included in the study were queried using electronically distributed open-ended, structured surveys. Responses to the surveys were analyzed and grouped using grounded theory and were examined for parallels to concepts of learning theory. SETTING: Academic teaching hospital. PARTICIPANTS: Twenty-two individuals identified as master surgeons. RESULTS: Twenty-one (95.5%) individuals responded to the survey. Two primary thematic clusters were identified: global approach to teaching (90.5% of respondents) and approach to intraoperative teaching (76.2%). Many of the emergent themes paralleled principles of transfer learning theory outlined in the psychology and education literature. Key elements included: conferring graduated responsibility (57.1%), encouraging development of a mental set (47.6%), fostering or expecting deliberate practice (42.9%), deconstructing complex tasks (38.1%), vertical transfer of information (33.3%), and identifying general principles to structure knowledge (9.5%). CONCLUSIONS: Master surgeons employ many of the principles of learning theory when teaching uncommon and highly complex operations. The findings may hold significant implications for faculty development in surgical education.

Impact of online education on intern behaviour around joint commission national patient safety goals: a randomised trial.

PURPOSE: To compare the effectiveness of two types of online learning methodologies for improving the patient-safety behaviours mandated in the Joint Commission National Patient Safety Goals (NPSG). METHODS: This randomised controlled trial was conducted in 2010 at Massachusetts General Hospital and Brigham and Women's Hospital (BWH) in Boston USA. Incoming interns were randomised to either receive an online Spaced Education (SE) programme consisting of cases and questions that reinforce over time, or a programme consisting of an online slide show followed by a quiz (SQ). The outcome measures included NPSG-knowledge improvement, NPSG-compliant behaviours in a simulation scenario, self-reported confidence in safety and quality, programme acceptability and programme relevance. RESULTS: Both online learning programmes improved knowledge retention. On four out of seven survey items measuring satisfaction and self-reported confidence, the proportion of SE interns responding positively was significantly higher (p<0.05) than the fraction of SQ interns. SE interns demonstrated a mean 4.79 (36.6%) NPSG-compliant behaviours (out of 13 total), while SQ interns completed a mean 4.17 (32.0%) (p=0.09). Among those in surgical fields, SE interns demonstrated a mean 5.67 (43.6%) NPSG-compliant behaviours, while SQ interns completed a mean 2.33 (17.9%) (p=0.015). Focus group data indicates that SE was more contextually relevant than SQ, and significantly more engaging. CONCLUSION: While both online methodologies improved knowledge surrounding the NPSG, SE was more contextually relevant to trainees and was engaging. SE impacted more significantly on both self-reported confidence and the behaviour of surgical residents in a simulated scenario.

Deconstructing intraoperative communication failures.

BACKGROUND: Communication failure is a common contributor to adverse events. We sought to characterize communication failures during complex operations. METHODS: We video recorded and transcribed six complex operations, representing 22 h of patient care. For each communication event, we determined the participants and the content discussed. Failures were classified into four types: audience (key individuals missing), purpose (issue nonresolution), content (insufficient/inaccurate information), and/or occasion (futile timing). We added a systems category to reflect communication occurring at the organizational level. The impact of each identified failure was described. RESULTS: We observed communication failures in every case (mean 29, median 28, range 13-48), at a rate of one every 8 min. Cross-disciplinary exchanges resulted in failure nearly twice as often as intradisciplinary ones. Discussions about or mandated by hospital policy (20%), personnel (18%), or other patient care (17%) were most error prone. Audience and purpose each accounted for >40% of failures. A substantial proportion (26%) reflected flawed systems for communication, particularly those for disseminating policy (29% of system failures), coordinating personnel (27%), and conveying the procedure planned (27%) or the equipment needed (24%). In 81% of failures, inefficiency (extraneous discussion and/or work) resulted. Resource waste (19%) and work-arounds (13%) also were frequently seen. CONCLUSIONS: During complex operations, communication failures occur frequently and lead to inefficiency. Prevention may be achieved by improving synchronous, cross-disciplinary communication. The rate of failure during discussions about/mandated by policy highlights the need for carefully designed standardized interventions. System-level support for asynchronous perioperative communication may streamline operating room coordination and preparation efforts.

Utilization of a cognitive task analysis for laparoscopic appendectomy to identify differentiated intraoperative teaching objectives.

BACKGROUND: Experts become automated when performing surgery, making it difficult to teach complex procedures to trainees. Cognitive task analysis (CTA) enables experts to articulate operative steps and cognitive decisions in complex procedures such as laparoscopic appendectomy, which can then be used to identify central teaching points. METHODS: Three local surgeon experts in laparoscopic appendectomy were interviewed using critical decision method-based CTA methodology. Interview transcripts were analyzed, and a cognitive demands table (CDT) was created for each expert. The individual CDTs were reviewed by each expert for completeness and then combined into a master CDT. Percentage agreement on operative steps and decision points was calculated for each expert. The experts then participated in a consensus meeting to review the master CDT. Each surgeon expert was asked to identify in the master CDT the most important teaching objectives for junior-level and senior-level residents. The experts' responses for junior-level and senior-level residents were compared using a χ(2) test. RESULTS: The surgeon experts identified 24 operative steps and 27 decision points. Eighteen of the 24 operative steps (75%) were identified by all 3 surgeon experts. The percentage of operative steps identified was high for each surgeon expert (96% for surgeon 1, 79% for surgeon 2, and 83% for surgeon 3). Of the 27 decision points, only 5 (19%) were identified by all 3 surgeon experts. The percentage of decision points identified varied by surgeon expert (78% for surgeon 1, 59% for surgeon 2, and 48% for surgeon 3). When asked to identify key teaching points, the surgeon experts were more likely to identify operative steps for junior residents (9 operative steps and 6 decision points) and decision points for senior residents (4 operative steps and 13 decision points) (P < .01). CONCLUSIONS: CTA can deconstruct the essential operative steps and decision points associated with performing a laparoscopic appendectomy. These results provide a framework to identify key teaching principles to guide intraoperative instruction. These learning objectives could be used to guide resident level-appropriate teaching of an essential general surgery procedure.

A low-fidelity total abdominal hysterectomy teaching model for obstetrics and gynecology residents.

INTRODUCTION: The objective is to develop a low-fidelity total abdominal hysterectomy (TAH) model for resident training with the purpose to improve residents' knowledge of anatomy, instruments, instrument handling, suture selection, and steps of a TAH. METHODS: A TAH model was created using products purchased from a crafts store. Obstetrics and gynecology residents (second-year residents and fourth-year residents) were subjected to a lecture followed by a simulated TAH. Before and after the course, subjects were given a survey to assess their confidence regarding the different surgical aspects of the TAH. Confidence was assessed regarding knowledge of anatomy, instruments, instrument handling, suture selection, incision site, steps of the TAH, and global confidence. Statistical analysis was performed using nonparametric tests. A P < 0.05 was considered significant. RESULTS: A low-fidelity TAH model was created. Eight second-year residents and seven fourth-year residents were studied. As expected, second-year residents had a lower median number of hysterectomies performed as primary surgeon when compared with fourth-year residents [0.5 (0.0-1.75) vs. 51.0 (50.0-53.0); P < 0.05]. Despite this difference, after having undergone the course, both resident classes demonstrated either statistical trends or significantly increased surgical confidence in all areas studied. CONCLUSION: Our novel, low-fidelity TAH simulation model and course improves obstetrics and gynecology residents' confidence in surgical skills and knowledge, particularly for those with less surgical experience. The total cost to make approximately 18 models was US $60.00.

War stories: a qualitative analysis of narrative teaching strategies in the operating room.

BACKGROUND: "War stories" are commonplace in surgical education, yet little is known about their purpose, construct, or use in the education of trainees. METHODS: Ten complex operations were videotaped and audiotaped. Narrative stories were analyzed using grounded theory to identify emergent themes in both the types of stories being told and the teaching objectives they illustrated. RESULTS: Twenty-four stories were identified in 9 of the 10 cases (mean, 2.4/case). They were brief (mean, 58 seconds), illustrative of multiple teaching points (mean, 1.5/story), and appeared throughout the operations. Anchored in personal experience, these stories taught both clinical (eg, operative technique, decision making, error identification) and programmatic (eg, resource management, professionalism) topics. CONCLUSIONS: Narrative stories are used frequently and intuitively by physicians to emphasize a variety of intraoperative teaching points. They socialize trainees in the culture of surgery and may represent an underrecognized approach to teaching the core competencies. More understanding is needed to maximize their potential.

Postgame analysis: using video-based coaching for continuous professional development.

BACKGROUND: The surgical learning curve persists for years after training, yet existing continuing medical education activities targeting this are limited. We describe a pilot study of a scalable video-based intervention, providing individualized feedback on intraoperative performance. STUDY DESIGN: Four complex operations performed by surgeons of varying experience--a chief resident accompanied by the operating senior surgeon, a surgeon with less than 10 years in practice, another with 20 to 30 years in practice, and a surgeon with more than 30 years of experience--were video recorded. Video playback formed the basis of 1-hour coaching sessions with a peer-judged surgical expert. These sessions were audio recorded, transcribed, and thematically coded. RESULTS: The sessions focused on operative technique--both technical aspects and decision-making. With increasing seniority, more discussion was devoted to the optimization of teaching and facilitation of the resident's technical performance. Coaching sessions with senior surgeons were peer-to-peer interactions, with each discussing his preferred approach. The coach alternated between directing the session (asking probing questions) and responding to specific questions brought by the surgeons, depending on learning style. At all experience levels, video review proved valuable in identifying episodes of failure to progress and troubleshooting alternative approaches. All agreed this tool is a powerful one. Inclusion of trainees seems most appropriate when coaching senior surgeons; it may restrict the dialogue of more junior attendings. CONCLUSIONS: Video-based coaching is an educational modality that targets intraoperative judgment, technique, and teaching. Surgeons of all levels found it highly instructive. This may provide a practical, much needed approach for continuous professional development.

Feasibility and impact of a case-based palliative care workshop for general surgery residents.

BACKGROUND: The American Board of Surgery has emphasized that palliative care education should be included in surgical training. The few formal curricula for teaching palliative care, although effective, are time-intensive and have low longitudinal participation rates. The aim of this project was to design a feasible and effective palliative care intervention for general surgery residency training. STUDY DESIGN: A multidisciplinary group developed a 2-hour case-based palliative care workshop including a brief introductory didactic, 4 case-based scenarios, and role-playing exercises. Program effectiveness was assessed using pre- and 3 weeks post-workshop surveys to measure attitudes toward and knowledge of palliative care. Fisher's exact test was used for data analysis; statistical significance was accepted at p < 0.05. RESULTS: Twenty-two (88%) residents attended the workshop and completed the baseline survey; 16 (72.7%) completed the post-workshop survey. The workshop changed residents' attitudes to be more consistent with accepted palliative care principles. Statistically significant shifts were seen in attitudes about the use of total parenteral nutrition for malignant small bowel obstruction (31.8% disagree with use pre- vs 68.8% post-workshop; p < 0.0001); the use of surgical therapy for malignant small bowel obstruction (45.5% disagree pre- vs 68.8% post-workshop; p = 0.002); and that depression is normal in terminal illness (22.7% disagree pre- vs 43.8% post-workshop; p = 0.002). Residents also performed considerably better on knowledge questions about CPR, patient autonomy, and withdrawal of life-sustaining therapy. CONCLUSIONS: A brief, interactive workshop is effective in changing general surgery residents' attitudes toward and knowledge of palliative care. The results demonstrate that a single teaching session is a useful intervention.