Highly sensitive quantitative phase microscopy and deep learning aided with whole genome sequencing for rapid detection of infection and antimicrobial resistance.

Current state-of-the-art infection and antimicrobial resistance (AMR) diagnostics are based on culture-based methods with a detection time of 48-96 h. Therefore, it is essential to develop novel methods that can do real-time diagnoses. Here, we demonstrate that the complimentary use of label-free optical assay with whole-genome sequencing (WGS) can enable rapid diagnosis of infection and AMR. Our assay is based on microscopy methods exploiting label-free, highly sensitive quantitative phase microscopy (QPM) followed by deep convolutional neural networks-based classification. The workflow was benchmarked on 21 clinical isolates from four WHO priority pathogens that were antibiotic susceptibility tested, and their AMR profile was determined by WGS. The proposed optical assay was in good agreement with the WGS characterization. Accurate classification based on the gram staining (100% recall for gram-negative and 83.4% for gram-positive), species (98.6%), and resistant/susceptible type (96.4%), as well as at the individual strain level (100% sensitivity in predicting 19 out of the 21 strains, with an overall accuracy of 95.45%). The results from this initial proof-of-concept study demonstrate the potential of the QPM assay as a rapid and first-stage tool for species, strain-level classification, and the presence or absence of AMR, which WGS can follow up for confirmation. Overall, a combined workflow with QPM and WGS complemented with deep learning data analyses could, in the future, be transformative for detecting and identifying pathogens and characterization of the AMR profile and antibiotic susceptibility.

Virtual labeling of mitochondria in living cells using correlative imaging and physics-guided deep learning.

Mitochondria play a crucial role in cellular metabolism. This paper presents a novel method to visualize mitochondria in living cells without the use of fluorescent markers. We propose a physics-guided deep learning approach for obtaining virtually labeled micrographs of mitochondria from bright-field images. We integrate a microscope's point spread function in the learning of an adversarial neural network for improving virtual labeling. We show results (average Pearson correlation 0.86) significantly better than what was achieved by state-of-the-art (0.71) for virtual labeling of mitochondria. We also provide new insights into the virtual labeling problem and suggest additional metrics for quality assessment. The results show that our virtual labeling approach is a powerful way of segmenting and tracking individual mitochondria in bright-field images, results previously achievable only for fluorescently labeled mitochondria.

Artefact removal in ground truth deficient fluctuations-based nanoscopy images using deep learning.

Image denoising or artefact removal using deep learning is possible in the availability of supervised training dataset acquired in real experiments or synthesized using known noise models. Neither of the conditions can be fulfilled for nanoscopy (super-resolution optical microscopy) images that are generated from microscopy videos through statistical analysis techniques. Due to several physical constraints, a supervised dataset cannot be measured. Further, the non-linear spatio-temporal mixing of data and valuable statistics of fluctuations from fluorescent molecules that compete with noise statistics. Therefore, noise or artefact models in nanoscopy images cannot be explicitly learned. Here, we propose a robust and versatile simulation-supervised training approach of deep learning auto-encoder architectures for the highly challenging nanoscopy images of sub-cellular structures inside biological samples. We show the proof of concept for one nanoscopy method and investigate the scope of generalizability across structures, and nanoscopy algorithms not included during simulation-supervised training. We also investigate a variety of loss functions and learning models and discuss the limitation of existing performance metrics for nanoscopy images. We generate valuable insights for this highly challenging and unsolved problem in nanoscopy, and set the foundation for the application of deep learning problems in nanoscopy for life sciences.