Deep Learning Analysis of Surgical Video Recordings to Assess Nontechnical Skills.

Importance: Assessing nontechnical skills in operating rooms (ORs) is crucial for enhancing surgical performance and patient safety. However, automated and real-time evaluation of these skills remains challenging. Objective: To explore the feasibility of using motion features extracted from surgical video recordings to automatically assess nontechnical skills during cardiac surgical procedures. Design, Setting, and Participants: This cross-sectional study used video recordings of cardiac surgical procedures at a tertiary academic US hospital collected from January 2021 through May 2022. The OpenPose library was used to analyze videos to extract body pose estimations of team members and compute various team motion features. The Non-Technical Skills for Surgeons (NOTSS) assessment tool was employed for rating the OR team's nontechnical skills by 3 expert raters. Main Outcomes and Measures: NOTSS overall score, with motion features extracted from surgical videos as measures. Results: A total of 30 complete cardiac surgery procedures were included: 26 (86.6%) were on-pump coronary artery bypass graft procedures and 4 (13.4%) were aortic valve replacement or repair procedures. All patients were male, and the mean (SD) age was 72 (6.3) years. All surgical teams were composed of 4 key roles (attending surgeon, attending anesthesiologist, primary perfusionist, and scrub nurse) with additional supporting roles. NOTSS scores correlated significantly with trajectory (r = 0.51, P = .005), acceleration (r = 0.48, P = .008), and entropy (r = -0.52, P = .004) of team displacement. Multiple linear regression, adjusted for patient factors, showed average team trajectory (adjusted R2 = 0.335; coefficient, 10.51 [95% CI, 8.81-12.21]; P = .004) and team displacement entropy (adjusted R2 = 0.304; coefficient, -12.64 [95% CI, -20.54 to -4.74]; P = .003) were associated with NOTSS scores. Conclusions and Relevance: This study suggests a significant link between OR team movements and nontechnical skills ratings by NOTSS during cardiac surgical procedures, suggesting automated surgical video analysis could enhance nontechnical skills assessment. Further investigation across different hospitals and specialties is necessary to validate these findings.

Applications of artificial intelligence in diagnosis of uncommon cystoid macular edema using optical coherence tomography imaging: A systematic review.

Cystoid macular edema (CME) is a sight-threatening condition often associated with inflammatory and diabetic diseases. Early detection is crucial to prevent irreversible vision loss. Artificial intelligence (AI) has shown promise in automating CME diagnosis through optical coherence tomography (OCT) imaging, but its utility needs critical evaluation. This systematic review assesses the application of AI to diagnosis CME, specifically focusing on disorders like postoperative CME (Irvine Gass syndrome) and retinitis pigmentosa without obvious vasculopathy, using OCT imaging. A comprehensive search was conducted across 6 databases (PubMed, Scopus, Web of Science, Wiley, ScienceDirect, and IEEE) from 2018 to November, 2023. Twenty-three articles met the inclusion criteria and were selected for in-depth analysis. We evaluate AI's role in CME diagnosis and its performance in "detection", "classification", and "segmentation" of OCT retinal images. We found that convolutional neural network (CNN)-based methods consistently outperformed other machine learning techniques, achieving an average accuracy of over 96 % in detecting and identifying CME from OCT images. Despite certain limitations such as dataset size and ethical concerns, the synergy between AI and OCT, particularly through CNNs, holds promise for significantly advancing CME diagnostics.