Harnessing nonlinear frequency upconversion of Talbot effect with flexible Talbot lengths.

We report on a simple experimental scheme demonstrating nonlinear frequency upconversion of the Talbot effect with controllable Talbot lengths at high conversion efficiency. Using a microlens array (MLA) as an array illuminator at 1064 nm onto a 1.2-mm-thick BiBO crystal, we have observed the second harmonic Talbot effect in green at 532 nm with a Talbot length twice that of the pump Talbot length. However, the Talbot length is constant for fixed parameters of the periodic object and the laser wavelength. With the formulation of a suitable theoretical framework, we have implemented a generic experimental scheme based on the Fourier transformation technique to independently control the Talbot lengths of the MLA in both the pump and the second harmonic, overcoming the stringent dependence of MLA parameters on the self-images. Deploying the current technique, we have been able to tune the Talbot lengths from zT = 26 cm to zT = 62.4 cm in the pump and zT = 12.4 cm to zT = 30.8 cm in the second harmonic, respectively. The single pass conversion efficiency of the Talbot images is 2.91% W-1, an enhancement of a factor of 106 as compared to the previous reports. This generic experimental scheme can be used to generate long-range self-images of periodic structures and also to program desired Talbot planes at required positions at both pump and upconverted frequency to avoid any mechanical constraints of experiments.

Bubble-propelled micromotors for ammonia generation.

Micromotors have emerged as promising tools for environmental remediation, thanks to their ability to autonomously navigate and perform specific tasks at the microscale. In this study, we present the development of MnO2 tubular micromotors modified with laccase for enhanced oxidation of organic pollutants by providing an additional oxidative catalytic pathway for pollutant removal. These modified micromotors exhibit efficient ammonia generation through the catalytic decomposition of urea, suggesting their potential application in the field of green energy generation. Compared to bare micromotors, the MnO2 micromotors modified with laccase exhibit a 20% increase in rhodamine B degradation. Moreover, the generation of ammonia increased from 2 to 31 ppm in only 15 min, evidencing their high catalytic activity. To enable precise tracking of the micromotors and measurement of their speed, a deep-learning-based tracking system was developed. Overall, this work expands the potential applicability of bio-catalytic tubular micromotors in the energy field.

Roadmap on Deep Learning for Microscopy.

Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the past decade. This Roadmap is written collectively by prominent researchers and encompasses selected aspects of how machine learning is applied to microscopy image data, with the aim of gaining scientific knowledge by improved image quality, automated detection, segmentation, classification and tracking of objects, and efficient merging of information from multiple imaging modalities. We aim to give the reader an overview of the key developments and an understanding of possibilities and limitations of machine learning for microscopy. It will be of interest to a wide cross-disciplinary audience in the physical sciences and life sciences.

Microplankton life histories revealed by holographic microscopy and deep learning.

The marine microbial food web plays a central role in the global carbon cycle. However, our mechanistic understanding of the ocean is biased toward its larger constituents, while rates and biomass fluxes in the microbial food web are mainly inferred from indirect measurements and ensemble averages. Yet, resolution at the level of the individual microplankton is required to advance our understanding of the microbial food web. Here, we demonstrate that, by combining holographic microscopy with deep learning, we can follow microplanktons throughout their lifespan, continuously measuring their three-dimensional position and dry mass. The deep-learning algorithms circumvent the computationally intensive processing of holographic data and allow rapid measurements over extended time periods. This permits us to reliably estimate growth rates, both in terms of dry mass increase and cell divisions, as well as to measure trophic interactions between species such as predation events. The individual resolution provides information about selectivity, individual feeding rates, and handling times for individual microplanktons. The method is particularly useful to detail the rates and routes of organic matter transfer in micro-zooplankton, the most important and least known group of primary consumers in the oceans. Studying individual interactions in idealized small systems provides insights that help us understand microbial food webs and ultimately larger-scale processes. We exemplify this by detailed descriptions of micro-zooplankton feeding events, cell divisions, and long-term monitoring of single cells from division to division.

Picture a glass of seawater. It looks clear and empty, but in reality, it contains one hundred million bacteria, about one hundred thousand other single-celled organisms, and a few microscopic animals. In fact, the majority of life in the ocean is microscopic and we know relatively little about it. Nevertheless, these microbes have a major impact on our lives. Microscopic algae known as phytoplankton, for example, produce half of the oxygen we breathe. For animals, birds and other large organisms in the ocean, we have a good understanding of who eats who and where the material ends up. However, for phytoplankton and other microbes, we depend on bulk measurements and averages of large groups. Bachimanchi et al. developed a method to follow individual microbes living in seawater and to observe how they move, grow, consume each other and reproduce. The team combined holographic microscopy with artificial intelligence to follow multiple planktons, diatoms and other microbes throughout their life span and continuously measured their three-dimensional location and mass. This made it possible to estimate how fast the organisms were growing and moving, and to observe what they ate. The experiments revealed new insights into how micro-zooplankton, diatoms and other microbes in the ocean interact with each other. This new method may be useful for researchers who would like to track the movements and whereabouts of microscopic planktons, bacteria or other microbes for extended periods of time. It is also a rapid method for counting, sizing, and weighing cells in suspension. The hardware used in this method is relatively cheap, and Bachimanchi et al. have shared all the computer code with examples and demonstrations in a public database to enable other researchers to use it.

Single-shot self-supervised object detection in microscopy.

Object detection is a fundamental task in digital microscopy, where machine learning has made great strides in overcoming the limitations of classical approaches. The training of state-of-the-art machine-learning methods almost universally relies on vast amounts of labeled experimental data or the ability to numerically simulate realistic datasets. However, experimental data are often challenging to label and cannot be easily reproduced numerically. Here, we propose a deep-learning method, named LodeSTAR (Localization and detection from Symmetries, Translations And Rotations), that learns to detect microscopic objects with sub-pixel accuracy from a single unlabeled experimental image by exploiting the inherent roto-translational symmetries of this task. We demonstrate that LodeSTAR outperforms traditional methods in terms of accuracy, also when analyzing challenging experimental data containing densely packed cells or noisy backgrounds. Furthermore, by exploiting additional symmetries we show that LodeSTAR can measure other properties, e.g., vertical position and polarizability in holographic microscopy.