Assessment of Open Surgery Suturing Skill: Image-based Metrics Using Computer Vision.

OBJECTIVE: This paper presents a computer vision algorithm for extraction of image-based metrics for suturing skill assessment and the corresponding results from an experimental study of resident and attending surgeons. DESIGN: A suturing simulator that adapts the radial suturing task from the Fundamentals of Vascular Surgery (FVS) skills assessment is used to collect data. The simulator includes a camera positioned under the suturing membrane, which records needle and thread movement during the suturing task. A computer vision algorithm processes the video data and extracts objective metrics inspired by expert surgeons' recommended best practice, to "follow the curvature of the needle." PARTICIPANTS AND RESULTS: Experimental data from a study involving subjects with various levels of suturing expertise (attending surgeons and surgery residents) are presented. Analysis shows that attendings and residents had statistically different performance on 6 of 9 image-based metrics, including the four new metrics introduced in this paper: Needle Tip Path Length, Needle Swept Area, Needle Tip Area and Needle Sway Length. CONCLUSION AND SIGNIFICANCE: These image-based process metrics may be represented graphically in a manner conducive to training. The results demonstrate the potential of image-based metrics for assessment and training of suturing skill in open surgery.

Prosthetic outcomes after amputation and the impact of mobility level on survival.

OBJECTIVE: Lower extremity amputation continues to be necessary in a significant number of patients with peripheral vascular disease. The 5-year survival following lower limb loss is markedly reduced. Many of these patients are never fitted with a prosthesis, and there is a dearth of knowledge regarding the barriers to prosthetic attainment. The goal of this study was to identify the risk factors for not receiving a prosthesis and the effect of mobility level on survival following major amputation. METHODS: This was a retrospective analysis of all patients that underwent lower extremity amputation by surgeons in our practice from January 1, 2010, to December 31, 2019. Abstracted data included: age, sex, race, body mass index, comorbidities, American Society of Anesthesiologists score, statin use, level of amputation, stump revision, fitting for prosthesis, type of prosthesis, and the United States' Medicare Functional Classification Level, also called K level. Survival was determined using a combination of sources, including the Social Security Death Master File, searches of multiple genealogic registries, and general internet searches. Multivariable logistic regression was used to determine risk factors associated with prosthesis attainment. Multivariable Cox proportional hazard regression with time-dependent covariates was performed to assess risk factors associated with 5-year mortality. RESULTS: A total of 464 patients were included in this study. The mean age was 65 years, and mean body mass index was 27 kg/m2. The majority of patients were male (68%), White (56%), diabetic (62%), and hypertensive (76%), and underwent below-the-knee amputation (69%). Prosthetic attainment occurred in 185 (40%). On multivariable analysis, age >81 years and current tobacco use were associated with no prosthetic fitting. Overall 5-year survival was 41.9% (95% confidence interval [CI], 37.6%-46.6%) (below-the-knee amputation, 47.7% [95% CI, 42.5%-53.5%]; above-the-knee amputation, 28.7% [95% CI, 22.1%-37.2%]). On multivariable analysis, age >60 years, congestive heart failure, above-the-knee amputation, and no prosthetic attainment were associated with decreased survival. Increasing K level was incrementally associated with improved survival. CONCLUSIONS: This study has identified several patient factors associated with prosthetic attainment, as well as multiple factors predictive of reduced survival after amputation. Being referred for prosthetic fitting was associated with improved survival not explained by patient characteristics and comorbidities. The Medicare Functional Classification Level K level predicts survival. More research is needed to determine the barriers to prosthetic attainment and if improving a patients K level will improve survival.

Measuring hand movement for suturing skill assessment: A simulation-based study.

BACKGROUND: To maximize patient safety, surgical skills education is increasingly adopting simulation-based curricula for formative skills assessment and training. However, many standardized assessment tools rely on human raters for performance assessment, which is resource-intensive and subjective. Simulators that provide automated and objective metrics from sensor data can address this limitation. We present an instrumented bench suturing simulator, patterned after the clock face radial suturing model from the Fundamentals of Vascular Surgery, for automated and objective assessment of open suturing skills. METHODS: For this study, 97 participants (35 attending surgeons, 32 residents, and 30 novices) were recruited at national vascular conferences. Automated hand motion metrics, especially focusing on rotational motion analysis, were developed from the inertial measurement unit attached to participants' hands, and the proposed suite of metrics was used to differentiate between the skill levels of the 3 groups. RESULTS: Attendings' and residents' performances were found to be significantly different from novices for all metrics. Moreover, most of our novel metrics could successfully distinguish between finer skill differences between attending and resident groups. In contrast, traditional operative skill metrics, such as time and path length, were unable to distinguish attendings from residents. CONCLUSION: This study provides evidence for the effectiveness of rotational motion analysis in assessing suturing skills. The suite of inertial measurement unit-based hand motion metrics introduced in this study allows for the incorporation of hand movement data for suturing skill assessment.

Assessment of open surgery suturing skill: Simulator platform, force-based, and motion-based metrics.

Objective: This paper focuses on simulator-based assessment of open surgery suturing skill. We introduce a new surgical simulator designed to collect synchronized force, motion, video and touch data during a radial suturing task adapted from the Fundamentals of Vascular Surgery (FVS) skill assessment. The synchronized data is analyzed to extract objective metrics for suturing skill assessment. Methods: The simulator has a camera positioned underneath the suturing membrane, enabling visual tracking of the needle during suturing. Needle tracking data enables extraction of meaningful metrics related to both the process and the product of the suturing task. To better simulate surgical conditions, the height of the system and the depth of the membrane are both adjustable. Metrics for assessment of suturing skill based on force/torque, motion, and physical contact are presented. Experimental data are presented from a study comparing attending surgeons and surgery residents. Results: Analysis shows force metrics (absolute maximum force/torque in z-direction), motion metrics (yaw, pitch, roll), physical contact metric, and image-enabled force metrics (orthogonal and tangential forces) are found to be statistically significant in differentiating suturing skill between attendings and residents. Conclusion and significance: The results suggest that this simulator and accompanying metrics could serve as a useful tool for assessing and teaching open surgery suturing skill.

Sex, age, and other barriers for prosthetic referral following amputation and the impact on survival.

BACKGROUND: Despite advances in peripheral vascular disease treatment, lower extremity amputation continues to be necessary in a significant number of patients. Up to 80% of amputees are not referred for prosthetic fitting. The factors contributing to referral decisions have not been adequately investigated, nor has the impact of prosthetic referral on survival. We characterized differences between patients who were successfully referred to our in-house prosthetists and those who were not, and identified factors associated with prosthetic referral and predictive of survival. METHODS: This was a retrospective analysis of all patients who underwent lower extremity amputation by surgeons in our practice from January 1, 2010, to June 30, 2017. Data regarding age, sex, race, body mass index (BMI), diabetes, hypertension, hyperlipidemia, end-stage renal disease, prior coronary artery bypass graft surgery, congestive heart failure, tobacco use, American Society of Anesthesiologists (ASA) score, previous arterial procedure, chronic obstructive pulmonary disease, statin use, postoperative ambulatory status, level of amputation, stump revision, and referral for prosthesis were collected. Survival was determined from a combination of sources, including the Social Security Death Master Index, multiple genealogic registries, and internet searches. Multivariable logistic regression was used to determine risk factors associated with prosthesis referral. Multivariable Cox proportional hazard regression with time-dependent covariates was performed to assess risk factors associated with 5-year mortality. RESULTS: There were 293 patients included in this study. Mean age was 66 years, and mean BMI 27 kg/m2. The majority of patients were male (69%), white (53%), with diabetes (65.4%) and hypertension (77.5%), and underwent below-the-knee amputation (BKA) (73%). Prosthetic referral occurred in 123 (42.0%). Overall 5-year survival was 61.7% (95% confidence interval [CI], 55.9%-68.1%) (BKA 64.7% [95% CI, 57.9%-72.3%]; above-the-knee amputation 53.8% [95% CI, 43.4%-66.6%]). On multivariate analysis, age >70 years, female sex, diabetes, ASA score 4 or 5, and current tobacco use were associated with no referral for prosthetic fitting. Patients with BMI 25 to 30, a previous arterial procedure, BKA, and history of stump revision were more likely to be referred. Factors associated with decreased survival were increasing age, higher ASA class, black race, and BMI; prosthetic referral was seen to be protective. CONCLUSIONS: We identified multiple patient factors associated with prosthetic referral, as well as several characteristics predictive of reduced survival after amputation. Being referred for prosthetic fitting was associated with improved survival not explained by patient characteristics and comorbidities. Further research is needed to determine whether the factors identified as associated with nonreferral are markers for patient characteristics that make them clinically unsuitable for prosthetic fitting or if they are symptoms of unconscious bias or of the patient's access to care.

Ensuring equity, diversity, and inclusion in the Society for Vascular Surgery: A report of the Society for Vascular Surgery Task Force on Equity, Diversity, and Inclusion.

Diversity, equity, and inclusion represent interconnected goals meant to ensure that all individuals, regardless of their innate identity characteristics, feel welcomed and valued among their peers. Equity is achieved when all individuals have equal access to leadership and career advancement opportunities as well as fair compensation for their work. It is well-known that the unique backgrounds and perspectives contributed by a diverse workforce strengthen and improve medical organizations overall. The Society for Vascular Surgery (SVS) is committed to supporting the highest quality leadership, patient care, surgical education, and societal recommendations through promoting diversity, equity, and inclusion within the SVS. The overarching goal of this document is to provide specific context and guidance for enhancing diversity, equity, and inclusion within the SVS as well as setting the tone for conduct and processes beyond the SVS, within other national and regional vascular surgery organizations and practice settings.

A Novel Platform for Assessment of Surgical Suturing Skill: Preliminary Results.

In this work, we describe a novel platform for quantifying surgical suturing skill. Forces and user movements are recorded using sensors during suturing maneuvers performed on a suture patch. Preliminary results from a pilot experiment suggest that force data could be used for objective assessment of suturing skill.

A systematic review of assessment of skill acquisition and operative competency in vascular surgical training.

OBJECTIVE: The aim of this systematic review is to describe the literature and assessment tools evaluating vascular surgical operative performance that could potentially be used for the assessment of educational outcomes applicable to the Milestone Project and the Next Accreditation System. METHODS: A systematic review of PubMed/MEDLINE, EMBASE, PsycINFO, and key journals from 1985 to 2013 was performed to identify English-language articles describing assessment of vascular surgical skills and competence. Qualifying studies were abstracted for data concerning study aims, study and assessment setting, skills measured, and metrics used to determine competency. Strengths, weaknesses, and psychometric robustness of the assessment tools were determined. RESULTS: The literature search identified 617 citations. After title and abstract review, 65 articles were retrieved for full-text assessment and 48 articles were included in the final review. Twenty-nine articles assessed open vascular skills; 19, endovascular skills; six, nontechnical skills; and one, teamwork skills. The majority (84%) of studies were performed in a simulated environment, four (8%) were performed in the operating room, and the remaining three were performed in both a simulated environment and an operating room. Strengths and weaknesses of assessment tools were study and assessor dependent, with none applicable to all study scenarios or procedures. CONCLUSIONS: The literature describing assessment tools pertinent to vascular surgery is diverse. Existing assessment tools may be relevant to individual technical skill acquisition assessment; however, an operative assessment tool relevant to vascular/endovascular surgery and generalizable to the wide spectrum of technical and nontechnical skills pertinent to vascular surgery needs to be developed, validated, and implemented to allow the practical assessment of resident readiness to operate in an unsupervised setting.

Analysis of the current applicant pool to vascular surgery: who are they and where do they come from?

There is a manpower crisis in vascular surgery. There may be too few vascular surgeons to meet the demands imposed by the aging of the "Baby-Boom" generation. More than 20% of vascular surgery positions were not filled through the match in 2004 and 2005. The number of vascular surgery training positions has doubled in the past 15 years, based on manpower studies projecting a need for additional vascular surgeons. During the same time period, the number of vascular surgery applicants has remained static. In addition, the proportion of international medical graduates has increased significantly. Furthermore, medical students appear to be selecting "lifestyle-friendly" specialties, such as emergency medicine, radiology, ophthalmology, anesthesiology, and dermatology, with increasing frequency. Approximately 60% of undergraduates in the United States and almost 50% of graduating medical students are currently women. Yet only about 25% of general surgery residents and less than 20% of current vascular surgery trainees are women. Strategies to expand the applicant pool for vascular surgery are needed and discussed in this article.