Evaluation of how users interface with holographic augmented reality surgical scenes: Interactive planning MR-Guided prostate biopsies.

BACKGROUND: User interfaces play a vital role in the planning and execution of an interventional procedure. The objective of this study is to investigate the effect of using different user interfaces for planning transrectal robot-assisted MR-guided prostate biopsy (MRgPBx) in an augmented reality (AR) environment. METHOD: End-user studies were conducted by simulating an MRgPBx system with end- and side-firing modes. The information from the system to the operator was rendered on HoloLens as an output interface. Joystick, mouse/keyboard, and holographic menus were used as input interfaces to the system. RESULTS: The studies indicated that using a joystick improved the interactive capacity and enabled operator to plan MRgPBx in less time. It efficiently captures the operator's commands to manipulate the augmented environment representing the state of MRgPBx system. CONCLUSIONS: The study demonstrates an alternative to conventional input interfaces to interact and manipulate an AR environment within the context of MRgPBx planning.

Study of Moisture-Curable Hybrid NIPUs Based on Glycerol with Various Diamines: Emergent Advantages of PDMS Diamines.

A sol/gel curing method is used in this work to synthesize hybrid partially bio-based polyhydroxyurethanes (PHUs) from dicarbonates derived from glycerol and various diamines. The method consists of end-capping the PHU prepolymers with moisture-sensitive groups, so sealants and adhesives can be produced from partially sustainable hybrid PHUs (HPHUs), similar to their preparation from end-capped conventional polyurethanes. Diglycerol dicarbonate (DGC) is synthesized and polymerized with different diamines of various chain lengths, and the resulting structural and thermal properties of the PHUs are qualitatively and quantitively characterized. This characterization led to two potential candidates: PHU 4, made of DGC and a poly(propylene glycol) diamine, and PHU 10, prepared from DGC and a poly(dimethylsiloxane) diamine. These polymers, with respective relative number-average molecular weights of 3200 and 7400 g/mol, are end-capped and left to cure under ambient lab conditions (22 °C and 40-50% humidity), and the curing processes are monitored rheologically. Notably, moisture curing does not require any catalyst. The chemical stability of the resulting hybrid PHUs (HPHUs) 4 and 10 in pure water is investigated to check the viability of applying them under outdoor conditions. Only HPHU 10 is found to be resistant to water and shows hydrophobicity with a contact angle of 109°. Tensile tests are conducted on HPHU 10 samples cured under lab conditions for a week and others cured for another week while being immersed in water. The mechanical properties, tensile strength and elongation at break, improve with the samples cured in water, indicating the high-water repellency of HPHU 10.

Lattice-Boltzmann interactive blood flow simulation pipeline.

PURPOSE: Cerebral aneurysms are one of the prevalent cerebrovascular disorders in adults worldwide and caused by a weakness in the brain artery. The most impressive treatment for a brain aneurysm is interventional radiology treatment, which is extremely dependent on the skill level of the radiologist. Hence, accurate detection and effective therapy for cerebral aneurysms still remain important clinical challenges. In this work, we have introduced a pipeline for cerebral blood flow simulation and real-time visualization incorporating all aspects from medical image acquisition to real-time visualization and steering. METHODS: We have developed and employed an improved version of HemeLB as the main computational core of the pipeline. HemeLB is a massive parallel lattice-Boltzmann fluid solver optimized for sparse and complex geometries. The visualization component of this pipeline is based on the ray marching method implemented on CUDA capable GPU cores. RESULTS: The proposed visualization engine is evaluated comprehensively and the reported results demonstrate that it achieves significantly higher scalability and sites updates per second, indicating higher update rate of geometry sites' values, in comparison with the original HemeLB. This proposed engine is more than two times faster and capable of 3D visualization of the results by processing more than 30 frames per second. CONCLUSION: A reliable modeling and visualizing environment for measuring and displaying blood flow patterns in vivo, which can provide insight into the hemodynamic characteristics of cerebral aneurysms, is presented in this work. This pipeline increases the speed of visualization and maximizes the performance of the processing units to do the tasks by breaking them into smaller tasks and working with GPU to render the images. Hence, the proposed pipeline can be applied as part of clinical routines to provide the clinicians with the real-time cerebral blood flow-related information.

Moving object tracking in clinical scenarios: application to cardiac surgery and cerebral aneurysm clipping.

BACKGROUND AND OBJECTIVES: Surgical procedures such as laparoscopic and robotic surgeries are popular since they are invasive in nature and use miniaturized surgical instruments for small incisions. Tracking of the instruments (graspers, needle drivers) and field of view from the stereoscopic camera during surgery could further help the surgeons to remain focussed and reduce the probability of committing any mistakes. Tracking is usually preferred in computerized video surveillance, traffic monitoring, military surveillance system, and vehicle navigation. Despite the numerous efforts over the last few years, object tracking still remains an open research problem, mainly due to motion blur, image noise, lack of image texture, and occlusion. Most of the existing object tracking methods are time-consuming and less accurate when the input video contains high volume of information and more number of instruments. METHODS: This paper presents a variational framework to track the motion of moving objects in surgery videos. The key contributions are as follows: (1) A denoising method using stochastic resonance in maximal overlap discrete wavelet transform is proposed and (2) a robust energy functional based on Bhattacharyya coefficient to match the target region in the first frame of the input sequence with the subsequent frames using a similarity metric is developed. A modified affine transformation-based registration is used to estimate the motion of the features following an active contour-based segmentation method to converge the contour resulted from the registration process. RESULTS AND CONCLUSION: The proposed method has been implemented on publicly available databases; the results are found satisfactory. Overlap index (OI) is used to evaluate the tracking performance, and the maximum OI is found to be 76% and 88% on private data and public data sequences.