Differences Between Attending and Trainee Surgeon Performance Using Objective Performance Indicators During Robot-Assisted Lobectomy.

OBJECTIVE: Existing approaches for assessing surgical performance are subjective and prone to bias. In contrast, utilizing digital kinematic and system data from the surgical robot allows the calculation of objective performance indicators (OPIs) that may differentiate technical skill and competency. This study compared OPIs of trainees and attending surgeons to assess differences during robotic lobectomy (RL). METHODS: There were 50 cardiothoracic surgery residents and 7 attending surgeons who performed RL on a left upper lobectomy of an ex vivo perfused model. A novel recorder simultaneously captured video and data from the system and instruments. The lobectomy was annotated into discrete tasks, and OPIs were analyzed for both hands during 6 tasks: exposure of the superior pulmonary vein, upper division of the pulmonary artery and bronchus, and the stapling of these structures. RESULTS: There were significant differences between attendings and trainees in all tasks. Among 20 OPIs during exposure tasks, significant differences were observed for the left hand in 31 of 60 (52%) of OPIs and for the right hand in 42 of 60 (70%). During stapling tasks, significant differences were observed for the stapling hand in 28 of 60 (47%) of OPIs and for the nonstapling hand in 14 of 60 (25%). CONCLUSIONS: Use of a novel data and video recorder to generate OPIs for both hands revealed significant differences in the operative gestures performed by trainees compared to attendings during RL. This method of assessing performance has potential for establishing objective competency benchmarks and use for tracking progress.

Comparison of Global Evaluative Assessment of Robotic Surgery with objective performance indicators for the assessment of skill during robotic-assisted thoracic surgery.

BACKGROUND: The Global Evaluative Assessment of Robotic Skills is a popular but ultimately subjective assessment tool in robotic-assisted surgery. An alternative approach is to record system or console events or calculate instrument kinematics to derive objective performance indicators. The aim of this study was to compare these 2 approaches and correlate the Global Evaluative Assessment of Robotic Skills with different types of objective performance indicators during robotic-assisted lobectomy. METHODS: Video, system event, and kinematic data were recorded from the robotic surgical system during left upper lobectomy on a standardized perfused and pulsatile ex vivo porcine heart-lung model. Videos were segmented into steps, and the superior vein dissection was graded independently by 2 blinded expert surgeons with Global Evaluative Assessment of Robotic Skills. Objective performance indicators representing categories for energy use, event data, movement, smoothness, time, and wrist articulation were calculated for the same task and compared to Global Evaluative Assessment of Robotic Skills scores. RESULTS: Video and data from 51 cases were analyzed (44 fellows, 7 attendings). Global Evaluative Assessment of Robotic Skills scores were significantly higher for attendings (P < .05), but there was a significant difference in raters' scores of 31.4% (defined as >20% difference in total score). The interclass correlation was 0.44 for 1 rater and 0.61 for 2 raters. Objective performance indicators correlated with Global Evaluative Assessment of Robotic Skills to varying degrees. The most highly correlated Global Evaluative Assessment of Robotic Skills domain was efficiency. Instrument movement and smoothness were highly correlated among objective performance indicator categories. Of individual objective performance indicators, right-hand median jerk, an objective performance indicator of change of acceleration, had the highest correlation coefficient (0.55). CONCLUSION: There was a relatively poor overall correlation between the Global Evaluative Assessment of Robotic Skills and objective performance indicators. However, both appear strongly correlated for certain metrics such as efficiency and smoothness. Objective performance indicators may be a potentially more quantitative and granular approach to assessing skill, given that they can be calculated mathematically and automatically without subjective interpretation.

A novel approach to quantifying surgical workflow in robotic-assisted lobectomy.

INTRODUCTION: Understanding surgical workflow is critical for optimizing efficiencies and outcomes; however, most research evaluating workflow is impacted by observer subjectivity, limiting its reproducibility, scalability, and actionability. To address this, we developed a novel approach to quantitatively describe workflow within robotic-assisted lobectomy (RL). We demonstrate the utility of this approach by analysing features of surgical workflow that correlate with procedure duration. METHODS: RL was deconstructed into 12 tasks by expert thoracic surgeons. Task start and stop times were annotated across videos of 10 upper RLs (5 right and 5 left). Markov Networks were used to estimate both the likelihood of transitioning from one task to another and each task-transition entropy (i.e. complexity). Associations between the frequency with which each task was revisited intraoperatively and procedure duration were assessed using Pearson's correlation coefficient. RESULTS: Entropy calculations identified fissure dissection and hilar node dissection as tasks with especially complex transitions, while mediastinal lymph node dissection and division of pulmonary veins were less complex. The number of transitions to three tasks significantly correlated with case duration (fissure dissection (R = 0.69, p = 0.01), dissect arteries (R = 0.59, p = 0.03), and divide arteries (R = 0.63, p = 0.03)). CONCLUSION: This pilot demonstrates the feasibility of objectively quantifying workflow between RL tasks and introduces entropy as a new metric of task-transition complexity. These innovative measures of surgical workflow enable detailed characterization of a given surgery and might indicate behaviour that impacts case progression. We discuss how these measures can serve as a foundation and be combined with relevant clinical information to better understand factors influencing surgical inefficiency.

Objective performance indicators of cardiothoracic residents are associated with vascular injury during robotic-assisted lobectomy on porcine models.

Surgical training relies on subjective feedback on resident technical performance by attending surgeons. A novel data recorder connected to a robotic-assisted surgical platform captures synchronized kinematic and video data during an operation to calculate quantitative, objective performance indicators (OPIs). The aim of this study was to determine if OPIs during initial task of a resident's robotic-assisted lobectomy (RL) correlated with bleeding during the procedure. Forty-six residents from the 2019 Thoracic Surgery Directors Association Resident Boot Camp completed RL on an ex vivo perfused porcine model while continuous video and kinematic data were recorded. For this pilot study, RL was segmented into 12 tasks and OPIs were calculated for the initial major task. Cases were reviewed for major bleeding events and OPIs of bleeding cases were compared to those who did not. Data from 42 residents were complete and included in the analysis. 10/42 residents (23.8%) encountered bleeding: 10/40 residents who started with superior pulmonary vein exposure and 0/2 residents who started with pulmonary artery exposure. Twenty OPIs for both hands were assessed during the initial task. Six OPIs related to instrument usage or smoothness of motion were significant for bleeding. Differences were statistically significant for both hands (p < 0.05). OPIs showing bimanual asymmetry indicated lower proficiency. This study demonstrates that kinematic and video analytics can establish a correlation between objective performance metrics and bleeding events in an ex vivo perfused lobectomy. Further study could assist in the development of focused exercises and simulation on objective domains to help improve overall performance and reducing complications during RL.

Surface-enhanced Raman spectroscopic analysis of centrifugally filtered HBV serum samples.

BACKGROUND: Raman spectroscopy is an effective tool for detecting and discriminating centrifugally filtered hepatitis B virus serum and centrifugally filtered control serum. OBJECTIVES: The purpose of current study is to separate high molecular weight fractions from low molecular weight fractions present hepatitis B serum to increase the disease diagnostic ability of surface enhanced Raman spectroscopy (SERS). METHODS: Clinically diagnosed centrifugally filtered serum samples of hepatitis B patients are subjected for surface enhanced Raman spectroscopy (SERS) in comparison with centrifugally filtered serum samples of healthy individuals by using silver nanoparticles (Ag-NPs) as SERS substrates. Some SERS spectral features are solely observed in centrifugally filtered serum samples of hepatitis B and some SERS spectral are solely observed in centrifugally filtered serum samples of healthy individuals. The diagnostic ability of SERS is further enhanced with different statistical techniques like principal component analysis (PCA), partial least square discriminant analysis (PLS-DA) and partial least square regression analysis (PLSR) have applied. RESULTS: The disease biomarkers of hepatitis B are more pronounced after their centrifugation as compared with uncentrifuged form. Statistical tools like principal component analysis (PCA) and partial least square discriminant analysis (PLS-DA) clearly differentiated centrifugally filtered serum samples of hepatitis B from centrifugally filtered serum samples of healthy individuals. Furthermore, partial least square regression analysis (PLSR) has been applied for predicting unknown viral load of centrifugally filtered serum sample of hepatitis B. CONCLUSION: SERS technique along with chemometric tools have successfully differentiated centrifugally filtered serum samples of hepatitis B from centrifugally filtered serum samples of healthy individuals. The centrifugal filtration process has increased the differentiation accuracy of PLS-DA in terms of percentage 98% and regression accuracy of PLSR regression analysis in terms of RMSEP (0.30 IU/mL) of this diagnostic method as compared with that of uncentrifuged method.