Assessment of resectability of pancreatic cancer using novel immersive high-performance virtual reality rendering of abdominal computed tomography and magnetic resonance imaging.

PURPOSE: Virtual reality (VR) allows for an immersive and interactive analysis of imaging data such as computed tomography (CT) and magnetic resonance imaging (MRI). The aim of this study is to assess the comprehensibility of VR anatomy and its value in assessing resectability of pancreatic ductal adenocarcinoma (PDAC). METHODS: This study assesses exposure to VR anatomy and evaluates the potential role of VR in assessing resectability of PDAC. Firstly, volumetric abdominal CT and MRI data were displayed in an immersive VR environment. Volunteering physicians were asked to identify anatomical landmarks in VR. In the second stage, experienced clinicians were asked to identify vascular involvement in a total of 12 CT and MRI scans displaying PDAC (2 resectable, 2 borderline resectable, and 2 locally advanced tumours per modality). Results were compared to 2D standard PACS viewing. RESULTS: In VR visualisation of CT and MRI, the abdominal anatomical landmarks were recognised by all participants except the pancreas (30/34) in VR CT and the splenic (31/34) and common hepatic artery (18/34) in VR MRI, respectively. In VR CT, resectable, borderline resectable, and locally advanced PDAC were correctly identified in 22/24, 20/24 and 19/24 scans, respectively. Whereas, in VR MRI, resectable, borderline resectable, and locally advanced PDAC were correctly identified in 19/24, 19/24 and 21/24 scans, respectively. Interobserver agreement as measured by Fleiss κ was 0.7 for CT and 0.4 for MRI, respectively (p < 0.001). Scans were significantly assessed more accurately in VR CT than standard 2D PACS CT, with a median of 5.5 (IQR 4.75-6) and a median of 3 (IQR 2-3) correctly assessed out of 6 scans (p < 0.001). CONCLUSION: VR enhanced visualisation of abdominal CT and MRI scan data provides intuitive handling and understanding of anatomy and might allow for more accurate staging of PDAC and could thus become a valuable adjunct in PDAC resectability assessment in the future.

Magnetic resonance cholangiopancreatography enhanced by virtual reality as a novel tool to improve the understanding of biliary anatomy and the teaching of surgical trainees.

Objective: The novel picture archiving and communication system (PACS), compatible with virtual reality (VR) software, displays cross-sectional images in VR. VR magnetic resonance cholangiopancreatography (MRCP) was tested to improve the anatomical understanding and intraoperative performance of minimally invasive cholecystectomy (CHE) in surgical trainees. Design: We used an immersive VR environment to display volumetric MRCP data (Specto VRTM). First, we evaluated the tolerability and comprehensibility of anatomy with a validated simulator sickness questionnaire (SSQ) and examined anatomical landmarks. Second, we compared conventional MRCP and VR MRCP by matching three-dimensional (3D) printed models and identifying and measuring common bile duct stones (CBDS) using VR MRCP. Third, surgical trainees prepared for CHE with either conventional MRCP or VR MRCP, and we measured perioperative parameters and surgical performance (validated GOALS score). Setting: The study was conducted out at Clarunis, University Center for Gastrointestinal and Liver Disease, Basel, Switzerland. Participants: For the first and second study step, doctors from all specialties and years of experience could participate. In the third study step, exclusively surgical trainees were included. Of 74 participating clinicians, 34, 27, and 13 contributed data to the first, second, and third study phases, respectively. Results: All participants determined the relevant biliary structures with VR MRCP. The median SSQ score was 0.75 (IQR: 0, 3.5), indicating good tolerability. Participants selected the corresponding 3D printed model faster and more reliably when previously studying VR MRCP compared to conventional MRCP: We obtained a median of 90 s (IQR: 55, 150) and 72.7% correct answers with VR MRCP versus 150 s (IQR: 100, 208) and 49.6% correct answers with conventional MRCP, respectively (p < 0.001). CBDS was correctly identified in 90.5% of VR MRCP cases. The median GOALS score was higher after preparation with VR MRCP than with conventional MRCP for CHE: 16 (IQR: 13, 22) and 11 (IQR: 11, 18), respectively (p = 0.27). Conclusions: VR MRCP allows for a faster, more accurate understanding of displayed anatomy than conventional MRCP and potentially leads to improved surgical performance in CHE in surgical trainees.