RESUMO
BACKGROUND: Surgical safety checklists reduce adverse events, but monitoring adherence to checklists is confounded by observation bias. The ORBB platform can monitor checklist compliance and correlate compliance with outcomes. This study aims to evaluate the association between checklist compliance and patient outcomes using the ORBB platform. METHODS: This is a retrospective analysis of data from the electronic medical record of cases performed in ORBB-equipped operating rooms at a single quaternary referral center. All patients who did not opt out and underwent surgery at UT Southwestern Medical Center in ORBB-equipped rooms from August 2020 to September 2022 were included. The ORBB platform was set-up in five operating rooms and surgical safety checklist compliance was monitored by way of AI-based video review. RESULTS: Overall, 4581 patients were included in this analysis.. Performance on the checklist was associated with lower mortality (OR, 0.96; 95% CI, 0.94-0.98; P < 0.05), and decreased length of stay (estimate [E]: -0.02 days; 95% CI, -0.03 to -0.005; P < 0.05). Performance during "timeouts" was associated with mortality (OR, 0.97; 95% CI, 0.94-0.99; P < 0.05). "Debriefings" were independently associated with mortality (OR, 0.98; 95% CI, 0.96-0.99; P < 0.05), length of stay (Estimate, -0.0009 days; 95% CI, -0.02 to -0.001; P < 0.05), and ICU admission (OR, 0.99; 95% CI, 0.98-0.99; P < 0.05). CONCLUSION: Procedures performed by surgical teams who performed better on the surgical safety checklist tended to have better outcomes. This innovative technology could substantially enhance our ability to understand and mitigate threats to patients in real-time.
RESUMO
OBJECTIVES: This study aimed to investigate adverse events (AEs) in trauma resuscitation, evaluate contributing factors, and assess methods, such as trauma video review (TVR), to mitigate AEs. BACKGROUND: Trauma remains a leading cause of global mortality and morbidity, necessitating effective trauma care. Despite progress, AEs during trauma resuscitation persist, impacting patient outcomes and the healthcare system. Identifying and analyzing AEs and their determinants are crucial for improving trauma care. METHODS: This narrative review explored the definition, identification, and assessment of AEs associated with trauma resuscitation within the trauma system. It includes various studies and assessment tools such as STAT Taxonomy and T-NOTECHs. Additionally, it assessed the role of TVR in detecting AEs and strategies to enhance patient safety. CONCLUSION: Integrated with standardized tools, TVR shows promise for identifying AEs. Challenges include ensuring reporting consistency and integrating approaches into existing protocols. Future research should prioritize linking trauma team performance to patient outcomes, and develop sustainable TVR programs to enhance patient safety.
Assuntos
Segurança do Paciente , Ressuscitação , Gravação em Vídeo , Ferimentos e Lesões , Humanos , Ferimentos e Lesões/terapia , Ressuscitação/métodos , Erros Médicos/prevenção & controle , Centros de TraumatologiaRESUMO
OBJECTIVE: Identify how surgical team members uniquely contribute to teamwork and adapt their teamwork skills during instances of uncertainty. BACKGROUND: The importance of surgical teamwork in preventing patient harm is well documented. Yet, little is known about how key roles (nurse, anesthesiologist, surgeon, and medical trainee) uniquely contribute to teamwork during instances of uncertainty, particularly when adapting to and rectifying an intraoperative adverse event (IAE). METHODS: Audiovisual data of 23 laparoscopic cases from a large community teaching hospital were prospectively captured using OR Black Box. Human factors researchers retrospectively coded videos for teamwork skills (backup behavior, coordination, psychological safety, situation assessment, team decision-making, and leadership) by team role under 2 conditions of uncertainty: associated with an IAE versus no IAE. Surgeons identified IAEs. RESULTS: In all, 1015 instances of teamwork skills were observed. Nurses adapted to IAEs by expressing more backup behavior skills (5.3× increase; 13.9 instances/hour during an IAE vs 2.2 instances/hour when no IAE) while surgeons and medical trainees expressed more psychological safety skills (surgeons: 3.6× increase; 30.0 instances/hour vs 6.6 instances/hour and trainees: 6.6× increase; 31.2 instances/hour vs 4.1 instances/hour). All roles expressed fewer situation assessment skills during an IAE versus no IAE. CONCLUSIONS: OR Black Box enabled the assessment of critically important details about how team members uniquely contribute during instances of uncertainty. Some teamwork skills were amplified, while others dampened when dealing with IAEs. The knowledge of how each role contributes to teamwork and adapts to IAEs should be used to inform the design of tailored interventions to strengthen interprofessional teamwork.
Assuntos
Salas Cirúrgicas , Equipe de Assistência ao Paciente , Humanos , Incerteza , Laparoscopia , Adaptação Psicológica , Complicações Intraoperatórias/prevenção & controle , Estudos Prospectivos , Feminino , Masculino , Liderança , Estudos Retrospectivos , Competência ClínicaRESUMO
BACKGROUND: Large-scale evaluation of surgical safety checklist performance has been limited by the need for direct observation. The operating room (OR) Black Box is a multichannel surgical data capture platform that may allow for the holistic evaluation of checklist performance at scale. STUDY DESIGN: In this retrospective cohort study, data from 7 North American academic medical centers using the OR Black Box were collected between August 2020 and January 2022. All cases captured during this period were analyzed. Measures of checklist compliance, team engagement, and quality of checklist content review were investigated. RESULTS: Data from 7,243 surgical procedures were evaluated. A time-out was performed during most surgical procedures (98.4%, n = 7,127), whereas a debrief was performed during 62.3% (n = 4,510) of procedures. The mean percentage of OR staff who paused and participated during the time-out and debrief was 75.5% (SD 25.1%) and 54.6% (SD 36.4%), respectively. A team introduction (performed 42.6% of the time) was associated with more prompts completed (31.3% vs 18.7%, p < 0.001), a higher engagement score (0.90 vs 0.86, p < 0.001), and a higher percentage of team members who ceased other activities (80.3% vs 72%, p < 0.001) during the time-out. CONCLUSIONS: Remote assessment using OR Black Box data provides useful insight into surgical safety checklist performance. Many items included in the time-out and debrief were not routinely discussed. Completion of a team introduction was associated with improved time-out performance. There is potential to use OR Black Box metrics to improve intraoperative process measures.
Assuntos
Lista de Checagem , Salas Cirúrgicas , Humanos , Estudos Retrospectivos , Segurança do Paciente , BenchmarkingRESUMO
With a synchronised data capture and analysis platform, comprehensive data can be collected from the operating room (OR), like in most high-risk industries. This review summarises the various benefits from capturing data from every procedure in the OR. From every surgery there are millions of data which, when synchronised and analysed, can help us to identify, understand and mitigate safety threats. Data can be used to increase efficiency, to identify and predict adverse events, and to increase the quality of teaching in the OR. The rapid advances in modern technology and the introduction of high-reliability culture in healthcare will result in more data-driven, precise, and safer surgical care.
Assuntos
Salas Cirúrgicas , Humanos , Reprodutibilidade dos TestesRESUMO
BACKGROUND: Although numerous studies have established cognitive biases as contributors to surgical adverse events, their prevalence and impact in surgery are unknown. This review aimed to describe types of cognitive bias in surgery, their impact on surgical performance and patient outcomes, their source, and the mitigation strategies used to reduce their effect. METHODS: A literature search was conducted on 9 April and 6 December 2021 using MEDLINE, Embase, PsycINFO, Scopus, Web of Science, Cochrane Central Register of Controlled Trials, and the Cochrane Database of Systematic Reviews. Included studies investigated how cognitive biases affect surgery and the mitigation strategies used to combat their impact. The National Institutes of Health tools were used to assess study quality. Inductive thematic analysis was used to identify themes of cognitive bias impact on surgical performance. RESULTS: Thirty-nine studies were included, comprising 6514 surgeons and over 200 000 patients. Thirty-one types of cognitive bias were identified, with overconfidence, anchoring, and confirmation bias the most common. Cognitive biases differentially influenced six themes of surgical performance. For example, overconfidence bias associated with inaccurate perceptions of ability, whereas anchoring bias associated with inaccurate risk-benefit estimations and not considering alternative options. Anchoring and confirmation biases associated with actual patient harm, such as never events. No studies investigated cognitive bias source or mitigation strategies. CONCLUSION: Cognitive biases have a negative impact on surgical performance and patient outcomes across all points of surgical care. This review highlights the scarcity of research investigating the sources that give rise to cognitive biases in surgery and the mitigation strategies that target these factors.
Assuntos
Cognição , Estados Unidos , Humanos , ViésRESUMO
Intraoperative adverse events (iAEs) impact the outcomes of surgery, and yet are not routinely collected, graded, and reported. Advancements in artificial intelligence (AI) have the potential to power real-time, automatic detection of these events and disrupt the landscape of surgical safety through the prediction and mitigation of iAEs. We sought to understand the current implementation of AI in this space. A literature review was performed to PRISMA-DTA standards. Included articles were from all surgical specialties and reported the automatic identification of iAEs in real-time. Details on surgical specialty, adverse events, technology used for detecting iAEs, AI algorithm/validation, and reference standards/conventional parameters were extracted. A meta-analysis of algorithms with available data was conducted using a hierarchical summary receiver operating characteristic curve (ROC). The QUADAS-2 tool was used to assess the article risk of bias and clinical applicability. A total of 2982 studies were identified by searching PubMed, Scopus, Web of Science, and IEEE Xplore, with 13 articles included for data extraction. The AI algorithms detected bleeding (n = 7), vessel injury (n = 1), perfusion deficiencies (n = 1), thermal damage (n = 1), and EMG abnormalities (n = 1), among other iAEs. Nine of the thirteen articles described at least one validation method for the detection system; five explained using cross-validation and seven divided the dataset into training and validation cohorts. Meta-analysis showed the algorithms were both sensitive and specific across included iAEs (detection OR 14.74, CI 4.7-46.2). There was heterogeneity in reported outcome statistics and article bias risk. There is a need for standardization of iAE definitions, detection, and reporting to enhance surgical care for all patients. The heterogeneous applications of AI in the literature highlights the pluripotent nature of this technology. Applications of these algorithms across a breadth of urologic procedures should be investigated to assess the generalizability of these data.
RESUMO
Intraoperative teamwork is vital for patient safety. Conventional tools for studying intraoperative teamwork typically rely on behaviorally anchored rating scales applied at the individual or team level, while others capture narrative information across several units of analysis. This prospective observational study characterizes teamwork using two conventional tools (Operating Theatre Team Non-Technical Skills Assessment Tool [NOTECHS]; Team Emergency Assessment Measure [TEAM]), and one alternative approach (modified-Systems Engineering Initiative for Patient Safety [SEIPS] model). We aimed to explore the advantages and disadvantages of each for providing feedback to improve teamwork practice. Fifty consecutive surgical cases at a Canadian academic hospital were recorded with the OR Black Box®, analyzed by trained raters, and summarized descriptively. Teamwork performance was consistently high within and across cases rated with NOTECHS and TEAMS. For cases analyzed with the modified-SEIPS tool, both optimal and suboptimal teamwork behaviors were identified, and team resilience was frequently observed. NOTECHS and TEAM provided summative assessments and overall pattern descriptions, while SEIPS facilitated a deeper understanding of teamwork processes. As healthcare organizations continue to prioritize teamwork improvement, SEIPS may provide valuable insights regarding teamwork behavior and the broader context influencing performance. This may ultimately enhance the development and effectiveness of multi-level teamwork interventions.
Assuntos
Relações Interprofissionais , Salas Cirúrgicas , Humanos , Equipe de Assistência ao Paciente , CanadáRESUMO
BACKGROUND: Intraoperative adverse events lead to patient injury and death, and are increasing. Early warning systems (EWSs) have been used to detect patient deterioration and save lives. However, few studies have used EWSs to monitor surgical performance and caution about imminent technical errors. Previous (non-surgical) research has investigated neural activity to predict future motor errors using electroencephalography (EEG). The present proof-of-concept cohort study investigates whether EEG could predict technical errors in surgery. METHODS: In a large academic hospital, three surgical fellows performed 12 elective laparoscopic general surgeries. Audiovisual data of the operating room and the surgeon's neural activity were recorded. Technical errors and epochs of good surgical performance were coded into events. Neural activity was observed 40 s prior and 10 s after errors and good events to determine how far in advance errors were detected. A hierarchical regression model was used to account for possible clustering within surgeons. This prospective, proof-of-concept, cohort study was conducted from July to November 2021, with a pilot period from February to March 2020 used to optimize the technique of data capture and included participants who were blinded from study hypotheses. RESULTS: Forty-five technical errors, mainly due to too little force or distance (n = 39), and 27 good surgical events were coded during grasping and dissection. Neural activity representing error monitoring (p = .008) and motor uncertainty (p = .034) was detected 17 s prior to errors, but not prior to good surgical performance. CONCLUSIONS: These results show that distinct neural signatures are predictive of technical error in laparoscopic surgery. If replicated with low false-alarm rates, an EEG-based EWS of technical errors could be used to improve individualized surgical training by flagging imminent unsafe actions-before errors occur and cause patient harm.
Assuntos
Competência Clínica , Laparoscopia , Humanos , Estudos de Coortes , Estudos Prospectivos , Laparoscopia/efeitos adversos , EletroencefalografiaRESUMO
OBJECTIVE: This study aimed to assess the relationship between surgeons' leadership style and team behavior in the hybrid operating room through video coding. Secondly, possible fluctuations possible fluctuations in leadership styles and team behavior during operative phases were studied. BACKGROUND: Leadership is recognized as a key component to successful team functioning in high-risk industries. The 'full range of leadership' theory is commonly used to evaluate leadership, marking transformational, transactional, and passive. Few studies have examined the effects of these leadership styles on team behavior in surgery and/or their fluctuations during surgery. METHODS: A single-center study included patients planned for routine endovascular procedures. A medical data capture system was used to allow post hoc video coding through Behavior Anchored Rating Scales. Multilevel statistical analysis was performed to assess possible correlations between leadership style and 3 team behavior indicators (speaking up, knowledge sharing, and collaboration) on an operative phase level. RESULTS: Twenty-two cases were analyzed (47 hours recording). Transformational leadership is positively related to the extent to which team members work together (γ=0.20, P <0.001), share knowledge (γ=0.45, P <0.001), and speak up (γ=0.64, P <0.001). Passive leadership is significantly positively correlated with speaking up (γ=0.29, P =0.004). Leadership style and team behavior clearly fluctuate during a procedure, with similar patterns across different types of endovascular procedures. CONCLUSIONS: Consistent with other professional fields, surgeons' transformational leadership enhances team behavior, especially during the most complex operative phases. This suggests that encouraging surgeons to learn and actively implement a transformational leadership style is meaningful to enhance patient safety and team performance.
Assuntos
Salas Cirúrgicas , Cirurgiões , Humanos , Liderança , Estudos Prospectivos , Segurança do PacienteRESUMO
OBJECTIVE: Not all trainees reach technical competency even after completing surgical training. While assessment of technical skill is not part of the residency interview process, identifying under-performers early on may help identify opportunities for individualized, targeted training. The objectives of this study were to (1) create predictive learning curve (LC) models for each of 3 basic laparoscopic tasks to identify performers versus underperformers and (2) evaluate the use of LCs to identify underperformers during selection into surgical training. DESIGN: Predictive LC models were created for laparoscopic pattern cutting (PC), peg transfer (PT) and intra-corporeal knots (IC) over 40 repetitions by 65 novice trainees in 2014. Trainees were categorized as performers and underperformers. Receiver operator characteristic analysis determined the minimum number of repetitions required to predict individual LCs, which were then used to determine the proportion of underperformers. SETTING: Technical performance was assessed onsite at the Canadian Residence Matching Service (CaRMS) interviews, after interview completion (January 2015). PARTICIPANTS: Applicants to general surgery (GS) and gynecology (OBGYN) participated in a skills assessment during. RESULTS: The PC, PT and IC tasks required a minimum of 8, 10, and 5 repetitions respectively, to predict overall performance. Predictive values for each task had excellent sensitivity and specificity: 1.00, 1.00 (PC); 1.00, 1.00 (PT); and 0.94, 1.00 (IC). Eighty applicants completed 8 PC repetitions; 16% were identified as underperformers. CONCLUSIONS: Individual LCs for three different laparoscopic tasks can be predicted with excellent sensitivity and specificity based on 10 repetitions or less. This information can be used to identify trainees who may have difficulty with laparoscopic technical skills early on.
Assuntos
Internato e Residência , Laparoscopia , Humanos , Curva de Aprendizado , Canadá , Laparoscopia/educação , Competência ClínicaRESUMO
BACKGROUND: The hybrid room (HR) is a complex, high-risk environment, requiring teams (surgeons, anesthesiologists, nurses, technologists) to master various skills, including the 'As Low As Reasonably Achievable' principle of radiation safety. This prospective single center cohort reports the first use of the Operating Room Black Box (ORBB) in a HR. This medical data recording system captures procedural and audio-visual data to facilitate structured team performance analysis. METHODS: Patients planned for endovascular repair of an infrarenal abdominal aortic aneurysm (EVAR) or treatment of symptomatic iliac-femoral-popliteal atherosclerotic disease (Peripheral Vascular Interventions or PVI) were included. Validated measures and established assessment tools were used to assess (non-)technical skills, radiation safety performance and environmental distractions. RESULTS: Six EVAR and sixteen PVI procedures were captured. Technical performance for one EVAR was rated 19/35 on the procedure-specific scale, below the 'acceptable' score of 21. Technical skills were rated above acceptable in all PVI procedures. Shared decision making and leadership were rated highly in 12/22 cases, whereas surgical communication and nurses' task management were rated low in 14/22 cases. Team members rarely stepped back from the C-arm during digital subtraction angiography. Radiation safety behavior was scored below 'acceptable' in 14/22 cases. A median (interquartile range) number of 12 (6-23) auditory distractions was observed per procedure. CONCLUSIONS: The ORBB facilitates holistic workplace-based assessment of endovascular performance in a HR by combining objective assessment parameters and rating scale-based evaluations. Strengths and weaknesses were identified in team members' (non-)technical and radiation safety practices. This technology has the potential to improve vascular surgical practice, though human input remains crucial. (NCT04854278).
Assuntos
Aneurisma da Aorta Abdominal , Implante de Prótese Vascular , Procedimentos Endovasculares , Humanos , Aneurisma da Aorta Abdominal/diagnóstico por imagem , Aneurisma da Aorta Abdominal/cirurgia , Implante de Prótese Vascular/efeitos adversos , Implante de Prótese Vascular/métodos , Procedimentos Endovasculares/efeitos adversos , Procedimentos Endovasculares/métodos , Estudos Prospectivos , Resultado do TratamentoRESUMO
Introduction. The operating room (OR) Black Box is an innovative technology that captures and compiles extensive real-time data from the OR, allowing identification and analysis of factors that influence intraoperative procedures and performances - ultimately improving patient safety. Implementation of this kind of technology is still an emerging research area and prone to face challenges. Methods. Observational study running from May 2017 to May 2021 conducted at Copenhagen University Hospital - Rigshospitalet, Denmark, involving 152 OR staff and 306 patients. Feasibility of the OR Black Box was assessed in accordance with Bowen's framework with 8 focus areas. Results. The OR Black Box had a high level of acceptability among stakeholders with 100% participation from management, 93% from OR staff, and 98% from patients. The implementation process improved over time, and an average of 80% of the surgeries conducted were captured. The practical aspects such as numerous formal and informal meetings, ethical and legal approval, recruitment of patients were acceptable, albeit time-consuming. The OR Black Box was adopted without any changes in scheduled surgery program, but capturing hours were adjusted to match the surgery program and relocation of OR staff declining to provide consent was possible. Conclusions. Implementation of the OR Black Box was feasible yet challenging. Management, nearly all staff, and patients embraced the initiative; however, ongoing evaluation, information meetings, and commitment from stakeholders are required and crucial to sustain momentum, continue implementation and expansion. Ideas from this study can be useful in the implementation of similar initiatives.
Assuntos
Salas Cirúrgicas , Humanos , Estudos de ViabilidadeRESUMO
Objective: To identify change management (CM) strategies for implementing novel artificial intelligence and similar novel technologies in operating rooms and create a new CM model for future trials and applications inspired by the abovementioned strategies and established models. Methods: Key phases of technology implementation were defined, and strategies for transformational CM were created and applied in a recent CM experience at our institution between October 15, 2020 and October 15, 2021. We appraised existing CM models and propose the newly created model. Results: The key phases of the technology implementation were as follows: (1) team assembly; (2) committee approvals; (3) CM; and (4) system installation and go-live. Key strategies were (1) assemble team with necessary expertise; (2) anticipate potential institutional cultural and regulatory hurdles; (3) add agility to project planning and execution; (4) accommodate institutional culture and regulations; (5) early clinical partner buy-in and stakeholder engagement; and (6) consistent communication, all of which contributed to the new CM model creation. Conclusion: Key CM strategies and a new CM model addressing the unique needs and characteristics of operating room novel technology implementation were identified and created. The new model may be customized and tested for individual institution and project's needs and characteristics.
RESUMO
OBJECTIVE: We report for the first time the use of the Operating Room Black Box (ORBB) to track checklist compliance, engagement, and quality. BACKGROUND: Implementation of operative checklists is associated with improved outcomes. Compliance is difficult to monitor. Most studies report either no assessment of checklist compliance or deployed in-person short-term assessment. The ORBB a novel artificially intelligence-driven data analytic platform affords the opportunity to assess checklist compliance without disrupting surgical workflow. METHODS: This was a retrospective review of prospectively collected ORBB data. Operative cases included elective surgery at a quaternary referral center. Cases were analyzed as prepolicy change (first 9 months) or as a postpolicy change (last 9 months). Measures of checklist compliance, engagement, and quality were assessed. RESULTS: There were 3879 cases that were performed and monitored for checklist compliance between August 15, 2020, and February 20, 2022. The overall scores for compliance, engagement, and quality were 81%, 84%, and 67% respectively. When broken down by phase, the scores for time-out were compliance 100%, engagement 98%, and quality 61%. Scores for the debrief phase were 81% for compliance, 98% for engagement, and 66% for quality. After a hospital policy change, the debrief scores improved significantly (85%; P <0.001 for compliance, 88%; P <0.001 for engagement and 71%; P <0.001 for quality). CONCLUSIONS: ORBB provides the unprecedented ability to assess not only compliance with surgical safety checklists but also engagement and quality. Utilization of this technology allows the assessment of compliance in near real time and to accurately address safety threats that may arise from noncompliance.
Assuntos
Lista de Checagem , Salas Cirúrgicas , Humanos , Segurança do Paciente , Estudos Retrospectivos , Fidelidade a DiretrizesRESUMO
INTRODUCTION: Surgical errors often occur because of human factor-related issues. A medical data recorder (MDR) may be used to analyze human factors in the operating room. The aims of this study were to assess intraoperative safety threats and resilience support events by using an MDR and to identify frequently discussed safety and quality improvement issues during structured postoperative multidisciplinary debriefings using the MDR outcome report. METHODS: In a cross-sectional study, 35 standard laparoscopic procedures were performed and recorded using the MDR. Outcome data were analyzed using the automated Systems Engineering Initiative for Patient Safety model. The video-assisted MDR outcome report reflects on safety threat and resilience support events (categories: person, tasks, tools and technology, psychical and external environment, and organization). Surgeries were debriefed by the entire team using this report. Qualitative data analysis was used to evaluate the debriefings. RESULTS: A mean (SD) of 52.5 (15.0) relevant events were identified per surgery. Both resilience support and safety threat events were most often related to the interaction between persons (272 of 360 versus 279 of 400). During the debriefings, communication failures (also category person) were the main topic of discussion. CONCLUSIONS: Patient safety threats identified by the MDR and discussed by the operating room team were most frequently related to communication, teamwork, and situational awareness. To create an even safer operating culture, educational and quality improvement initiatives should aim at training the entire operating team, as it contributes to a shared mental model of relevant safety issues.
Assuntos
Segurança do Paciente , Gestão da Segurança , Estudos Transversais , Humanos , Erros Médicos/prevenção & controle , Salas Cirúrgicas , Equipe de Assistência ao PacienteRESUMO
INTRODUCTION: Eye tracking (ET) is a popular tool to study what factors affect the visual behaviour of surgical team members. To our knowledge, there have been no reviews to date that evaluate the broad use of ET in surgical research. This review aims to identify and assess the quality of this evidence, to synthesize how ET can be used to inform surgical practice, and to provide recommendations to improve future ET surgical studies. METHODS: In line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, a systematic literature review was conducted. An electronic search was performed in MEDLINE, Cochrane Central, Embase, and Web of Science databases up to September 2020. Included studies used ET to measure the visual behaviour of members of the surgical team during surgery or surgical tasks. The included studies were assessed by two independent reviewers. RESULTS: A total of 7614 studies were identified, and 111 were included for data extraction. Eleven applications were identified; the four most common were skill assessment (41%), visual attention assessment (22%), workload measurement (17%), and skills training (10%). A summary was provided of the various ways ET could be used to inform surgical practice, and three areas were identified for the improvement of future ET studies in surgery. CONCLUSIONS: This review provided a comprehensive summary of the various applications of ET in surgery and how ET could be used to inform surgical practice, including how to use ET to improve surgical education. The information provided in this review can also aid in the design and conduct of future ET surgical studies.
Assuntos
Tecnologia de Rastreamento Ocular , Cirurgia Geral , HumanosRESUMO
OBJECTIVE: Competency-based surgical education requires detailed and actionable feedback to ensure adequate and efficient skill development. Comprehensive operative capture systems such as the Operating Room Black Box (ORBB; Surgical Safety Technologies, Inc), which continuously records and synchronizes multiple sources of intraoperative data, have recently been integrated into hybrid rooms to provide targeted feedback to endovascular teams. The objective of this study is to develop step, error, and event frameworks to evaluate technical performance in elective endovascular aortic repair (EVAR) comprehensively captured by the ORBB (Surgical Safety Technologies, Inc; Toronto, Canada). METHODS: This study is based upon a modified Delphi consensus process to create evaluation frameworks for steps, errors, and events in EVAR. International experts from Vascular Surgery and Interventional Radiology were identified, based on their records of publications and invited presentations, or serving on relevant journal editorial boards. In an initial open-ended survey round, experts were asked to volunteer a comprehensive list of steps, errors, and events for a standard EVAR of an infrarenal aorto-iliac aneurysm (AAA). In subsequent survey rounds, the identified items were presented to the expert panel to rate on a 5-point Likert scale. Delphi survey rounds were repeated until the process reached consensus with a predefined agreement threshold (Cronbach α>0.7). The final frameworks were constructed with items achieving an agreement (responses of 4 or 5) from greater than 70% of experts. RESULTS: Of 98 invited proceduralists, 38 formed the expert consensus panel (39%), consisting of 29 vascular surgeons and 9 interventional radiologists, with 34% from North America and 66% from Europe. Consensus criteria were met following the third round of the Delphi consensus process (Cronbach α=0.82-0.93). There were 15, 32, and 25 items in the error, step, and event frameworks, respectively (within-item agreement=74%-100%). CONCLUSION: A detailed evaluation tool for the procedural steps, errors, and events in infrarenal EVAR was developed. This tool will be validated on recorded procedures in future work: It may focus skill development on common errors and hazardous steps. This tool might be used to provide high-quality feedback on technical performance of trainees and experienced surgeons alike, thus promoting surgical mastery.
Assuntos
Aneurisma da Aorta Abdominal , Procedimentos Endovasculares , Humanos , Técnica Delphi , Competência Clínica , Resultado do Tratamento , Procedimentos Cirúrgicos Vasculares , Consenso , Procedimentos Endovasculares/efeitos adversos , Procedimentos Endovasculares/educação , Aneurisma da Aorta Abdominal/diagnóstico por imagem , Aneurisma da Aorta Abdominal/cirurgiaRESUMO
Recent developments in data science in general and machine learning in particular have transformed the way experts envision the future of surgery. Surgical Data Science (SDS) is a new research field that aims to improve the quality of interventional healthcare through the capture, organization, analysis and modeling of data. While an increasing number of data-driven approaches and clinical applications have been studied in the fields of radiological and clinical data science, translational success stories are still lacking in surgery. In this publication, we shed light on the underlying reasons and provide a roadmap for future advances in the field. Based on an international workshop involving leading researchers in the field of SDS, we review current practice, key achievements and initiatives as well as available standards and tools for a number of topics relevant to the field, namely (1) infrastructure for data acquisition, storage and access in the presence of regulatory constraints, (2) data annotation and sharing and (3) data analytics. We further complement this technical perspective with (4) a review of currently available SDS products and the translational progress from academia and (5) a roadmap for faster clinical translation and exploitation of the full potential of SDS, based on an international multi-round Delphi process.