Virtual reality assisted microscopy data visualization and colocalization analysis.

BACKGROUND: Confocal microscopes deliver detailed three-dimensional data and are instrumental in biological analysis and research. Usually, this three-dimensional data is rendered as a projection onto a two-dimensional display. We describe a system for rendering such data using a modern virtual reality (VR) headset. Sample manipulation is possible by fully-immersive hand-tracking and also by means of a conventional gamepad. We apply this system to the specific task of colocalization analysis, an important analysis tool in biological microscopy. We evaluate our system by means of a set of user trials. RESULTS: The user trials show that, despite inaccuracies which still plague the hand tracking, this is the most productive and intuitive interface. The inaccuracies nevertheless lead to a perception among users that productivity is low, resulting in a subjective preference for the gamepad. Fully-immersive manipulation was shown to be particularly effective when defining a region of interest (ROI) for colocalization analysis. CONCLUSIONS: Virtual reality offers an attractive and powerful means of visualization for microscopy data. Fully immersive interfaces using hand tracking show the highest levels of intuitiveness and consequent productivity. However, current inaccuracies in hand tracking performance still lead to a disproportionately critical user perception.

Mitochondrial event localiser (MEL) to quantitativelydescribe fission, fusion and depolarisation in the three-dimensional space.

Mitochondrial fission and fusion play an important role not only in maintaining mitochondrial homeostasis but also in preserving overall cellular viability. However, quantitative analysis based on the three-dimensional localisation of these highly dynamic mitochondrial events in the cellular context has not yet been accomplished. Moreover, it remains largely uncertain where in the mitochondrial network depolarisation is most likely to occur. We present the mitochondrial event localiser (MEL), a method that allows high-throughput, automated and deterministic localisation and quantification of mitochondrial fission, fusion and depolarisation events in large three-dimensional microscopy time-lapse sequences. In addition, MEL calculates the number of mitochondrial structures as well as their combined and average volume for each image frame in the time-lapse sequence. The mitochondrial event locations can subsequently be visualised by superposition over the fluorescence micrograph z-stack. We apply MEL to both control samples as well as to cells before and after treatment with hydrogen peroxide (H2O2). An average of 9.3/7.2/2.3 fusion/fission/depolarisation events per cell were observed respectively for every 10 sec in the control cells. With peroxide treatment, the rate initially shifted toward fusion with and average of 15/6/3 events per cell, before returning to a new equilibrium not far from that of the control cells, with an average of 6.2/6.4/3.4 events per cell. These MEL results indicate that both pre-treatment and control cells maintain a fission/fusion equilibrium, and that depolarisation is higher in the post-treatment cells. When individually validating mitochondrial events detected with MEL, for a representative cell for the control and treated samples, the true-positive events were 47%/49%/14% respectively for fusion/fission/depolarisation events. We conclude that MEL is a viable method of quantitative mitochondrial event analysis.

Regression adjusted colocalisation colour mapping (RACC): A novel biological visual analysis method for qualitative colocalisation analysis of 3D fluorescence micrographs.

The qualitative analysis of colocalisation in fluorescence microscopy is of critical importance to the understanding of biological processes and cellular function. However, the degree of accuracy achieved may differ substantially when executing different yet commonly utilized colocalisation analyses. We propose a novel biological visual analysis method that determines the correlation within the fluorescence intensities and subsequently uses this correlation to assign a colourmap value to each voxel in a three-dimensional sample while also highlighting volumes with greater combined fluorescence intensity. This addresses the ambiguity and variability which can be introduced into the visualisation of the spatial distribution of correlation between two fluorescence channels when the colocalisation between these channels is not considered. Most currently employed and generally accepted methods of visualising colocalisation using a colourmap can be negatively affected by this ambiguity, for example by incorrectly indicating non-colocalised voxels as positively correlated. In this paper we evaluate the proposed method by applying it to both synthetic data and biological fluorescence micrographs and demonstrate how it can enhance the visualisation in a robust way by visualising only truly colocalised regions using a colourmap to indicate the qualitative measure of the correlation between the fluorescence intensities. This approach may substantially support fluorescence microscopy applications in which precise colocalisation analysis is of particular relevance.

A Comparative Study of Features for Acoustic Cough Detection Using Deep Architectures.

Automatic cough detection is key to tracking the condition of patients suffering from tuberculosis. We evaluate various acoustic features for performing cough detection using deep architectures. As most previous studies have adopted features designed for speech recognition, we assess the suitability of these techniques as well as their respective extraction parameters. Short-time Fourier transform (STFT), mel-frequency cepstral coefficients (MFCC) and mel-scaled filter banks (MFB) were evaluated using deep neural networks, convolutional neural networks and long-short term models. We find experimentally that, by regarding each cough sound as a single input feature instead of multiple shorter features, better performance can be achieved. Longer analysis windows also provide enhancement in contrast to the classic 25 ms frame. Although MFCC performance is improved by sinusoidal liftering, STFT and MFB lead to better results. Using MFB and the optimum segment and frame lengths, an improvement exceeding 7% in the area under the receiver operating characteristic curve across all classifiers is achieved.

Computer simulation and physical phantom models for estimating the dielectric properties of rhinoceros tissue.

In vivo and ex vivo sensors have the potential to aid tracking and anti-poaching endeavours and provide new insights into rhinoceros physiology and environment. However, the propagation of electromagnetic signals in rhinoceros tissue is currently not known. We present simulation and agar models of the rhinoceros that allow the investigation of electromagnetic propagation by in vivo and ex vivo devices without the need for surgery. Since the dielectric properties of rhinoceros tissue have not been documented, the conductivity and permittivity of the skin, fat, muscle, blood and other organs are first approximated by means of a meta-analysis that includes animals with similar physical properties. Subsequently, we develop anatomical models that include dermal layers, internal organs and a skeleton. We also develop a flank model that serves as an approximation of the anatomical model in certain situations. These models are used to determine the viability of communication between an in vivo device and an ex vivo device attached to the hind leg of the animal. Two types of antenna (microstrip-fed planar elliptical monopole antenna and printed inverted-F antenna) and three feasible implant locations (back, neck and chest) are considered. In addition to the computer models, phantom recipes using salt, sugar and agar are developed to match the dielectric properties of each tissue type at the industrial, scientific and medical (ISM) frequencies of 403MHz, 910MHz and 2.4GHz. The average error between the measured and theoretically predicted dielectric values was 6.22% over all recipes and 4.49% for the 2.4 GHz recipe specifically. When considering the predicted efficiency of the transmitting and receiving antennas, an agreement of 67.38% was demonstrated between the computer simulations and laboratory measurements using the agar rhinoceros flank models. Computer simulations using the anatomical model of the rhinoceros indicate that the chest is the optimal implant location and that best signal propagation is achieved using the planar inverted-F antenna (PIFA). Using this configuration, the simulations indicate that communication between the implant and an ex vivo device attached to the hind leg is challenging but possible. Furthermore, we find that the inclusion of factors such as the density and temperature of the phantom materials were found to be critical to the achievement of good agreement between practice and simulation.

Improved region of interest selection and colocalization analysis in three-dimensional fluorescence microscopy samples using virtual reality.

Although modern fluorescence microscopy produces detailed three-dimensional (3D) datasets, colocalization analysis and region of interest (ROI) selection is most commonly performed two-dimensionally (2D) using maximum intensity projections (MIP). However, these 2D projections exclude much of the available data. Furthermore, 2D ROI selections cannot adequately select complex 3D structures which may inadvertently lead to either the exclusion of relevant or the inclusion of irrelevant data points, consequently affecting the accuracy of the colocalization analysis. Using a virtual reality (VR) enabled system, we demonstrate that 3D visualization, sample interrogation and analysis can be achieved in a highly controlled and precise manner. We calculate several key colocalization metrics using both 2D and 3D derived super-resolved structured illumination-based data sets. Using a neuronal injury model, we investigate the change in colocalization between Tau and acetylated α-tubulin at control conditions, after 6 hours and again after 24 hours. We demonstrate that performing colocalization analysis in 3D enhances its sensitivity, leading to a greater number of statistically significant differences than could be established when using 2D methods. Moreover, by carefully delimiting the 3D structures under analysis using the 3D VR system, we were able to reveal a time dependent loss in colocalization between the Tau and microtubule network as an early event in neuronal injury. This behavior could not be reliably detected using a 2D based projection. We conclude that, using 3D colocalization analysis, biologically relevant samples can be interrogated and assessed with greater precision, thereby better exploiting the potential of fluorescence-based image analysis in biomedical research.