Non-line-of-sight imaging using phasor-field virtual wave optics.

Non-line-of-sight imaging allows objects to be observed when partially or fully occluded from direct view, by analysing indirect diffuse reflections off a secondary relay surface. Despite many potential applications1-9, existing methods lack practical usability because of limitations including the assumption of single scattering only, ideal diffuse reflectance and lack of occlusions within the hidden scene. By contrast, line-of-sight imaging systems do not impose any assumptions about the imaged scene, despite relying on the mathematically simple processes of linear diffractive wave propagation. Here we show that the problem of non-line-of-sight imaging can also be formulated as one of diffractive wave propagation, by introducing a virtual wave field that we term the phasor field. Non-line-of-sight scenes can be imaged from raw time-of-flight data by applying the mathematical operators that model wave propagation in a conventional line-of-sight imaging system. Our method yields a new class of imaging algorithms that mimic the capabilities of line-of-sight cameras. To demonstrate our technique, we derive three imaging algorithms, modelled after three different line-of-sight systems. These algorithms rely on solving a wave diffraction integral, namely the Rayleigh-Sommerfeld diffraction integral. Fast solutions to Rayleigh-Sommerfeld diffraction and its approximations are readily available, benefiting our method. We demonstrate non-line-of-sight imaging of complex scenes with strong multiple scattering and ambient light, arbitrary materials, large depth range and occlusions. Our method handles these challenging cases without explicitly inverting a light-transport model. We believe that our approach will help to unlock the potential of non-line-of-sight imaging and promote the development of relevant applications not restricted to laboratory conditions.

Towards a more accurate light transport model for non-line-of-sight imaging.

Non-line-of-sight (NLOS) imaging systems involve the measurement of an optical signal at a diffuse surface. A forward model encodes the physics of these measurements mathematically and can be inverted to generate a reconstruction of the hidden scene. Some existing NLOS imaging techniques rely on illuminating the diffuse surface and measuring the photon time of flight (ToF) of multi-bounce light paths. Alternatively, some methods depend on measuring high-frequency variations caused by shadows cast by occluders in the hidden scene. While forward models for ToF-NLOS and Shadow-NLOS have been developed separately, there has been limited work on unifying these two imaging modalities. Dove et al introduced a unified mathematical framework capable of modeling both imaging techniques [Opt. Express27, 18016 (2019)10.1364/OE.27.018016]. The authors utilize this general forward model, known as the two frequency spatial Wigner distribution (TFSWD), to discuss the implications of reconstruction resolution for combining the two modalities but only when the occluder geometry is known a priori. In this work, we develop a graphical representation of the TFSWD forward model and apply it to novel experimental setups with potential applications in NLOS imaging. Furthermore, we use this unified framework to explore the potential of combining these two imaging modalities in situations where the occluder geometry is not known in advance.

How good are collimated Gaussian beams produced with engineered diffusers?

Collimating a Gaussian beam from an uncollimated laser source has been achieved via the deployment of engineered diffusers (EDs)-also referred to as light shaping diffusers. When compared to conventional pinhole-based optical collimation systems, this method of beam collimation ensures high optical transmission efficiency at the expense of the introduction of additional speckle and a resulting reduction in spatial coherence. Despite a lower collimation quality, these ED-produced collimated beams are attractive and promising in terms of their deployment in various benchtop or tabletop systems that involve shorter beam propagation distances of up to a few meters while requiring a high optical power throughput. This paper aims to further the understanding of collimation quality and propagation properties of ED-produced Gaussian collimated beams via carefully designed experiments and accompanying analysis. We measure and document the beam divergence, Rayleigh distance, and M 2 factor, as well as evolution of the wavefront radius of curvature (RoC), of these ED-generated beams over a few meters of propagation-a propagation distance which encapsulates a vast majority of optical systems. We further investigate the changes in the beam profile with the addition of a laser speckle reducer (SR) and compare the ED-produced beams with a near-ideal collimated beam produced with spatial filtering systems.

Measuring the radius of curvature of spherical surfaces with actively tunable Fizeau and Twyman-Green interferometers.

Accurate and repeatable measurement of the radius of curvature (RoC) of spherical sample surfaces is of great importance in optics. This importance lies in the ubiquitous use of spherical optical elements such as curved mirrors and lenses. Due to a high measurement sensitivity, interferometric techniques are often deployed for accurate characterization of the sample surface RoC. One method by which a typical commercial Fizeau or Twyman-Green (TG) interferometer measures surface RoC is via scanning between two principal retroreflective optical configurations-namely, the confocal and catseye configurations. Switching between these two configurations is typically achieved by moving an optical head along the axis of the propagating laser beam and the RoC is estimated by measuring the magnitude of mechanical motion to switch between the two principal configurations. In this paper, we propose a motion-free catseye/confocal-imaging-based sample RoC measurement system. The necessity of bulk motion to switch between the two configurations is circumvented via the use of an actively controlled varifocal lens. We demonstrate the usefulness of the proposed innovation in RoC measurements with either the TG or the Fizeau interferometer. Furthermore, we convert a commercial motion-based Zygo RoC measurement system into a motion-free one by introducing a tunable lens inside the apparatus and using it to accurately characterize the RoC of different test samples. We also compute the wavefront aberrations for all spherical sample surfaces from the recorded measurement data.

Artificial Intelligence and Infectious Disease Imaging.

The mass production of the graphics processing unit and the coronavirus disease 2019 (COVID-19) pandemic have provided the means and the motivation, respectively, for rapid developments in artificial intelligence (AI) and medical imaging techniques. This has led to new opportunities to improve patient care but also new challenges that must be overcome before these techniques are put into practice. In particular, early AI models reported high performances but failed to perform as well on new data. However, these mistakes motivated further innovation focused on developing models that were not only accurate but also stable and generalizable to new data. The recent developments in AI in response to the COVID-19 pandemic will reap future dividends by facilitating, expediting, and informing other medical AI applications and educating the broad academic audience on the topic. Furthermore, AI research on imaging animal models of infectious diseases offers a unique problem space that can fill in evidence gaps that exist in clinical infectious disease research. Here, we aim to provide a focused assessment of the AI techniques leveraged in the infectious disease imaging research space, highlight the unique challenges, and discuss burgeoning solutions.

Low-loss tunable beam collimator and expander assembly with no moving parts using an engineered diffuser and varifocal lenses.

In this paper, we present a novel design for a tunable beam collimator. A variable collimator assists in achieving an adaptive size of an output collimated beam. Alternatively, it can also provide an adjustable output beam divergence angle for a noncollimated beam output. Tunable collimators are highly desirable for various applications in testing, engineering, and measurements. Such devices are also useful in providing tunable illumination of samples or targets in microscopes and emulating different target distances for characterizing the performance of camera systems in laboratory settings. The proposed collimator has two distinct advantages: it is light-efficient compared with pinhole-based collimator designs, and it delivers a large range of output beam sizes without involving the mechanical motion of bulk components. These attributes are achieved via the use of an engineered diffuser (in the place of a pinhole) and a pair of large aperture tunable focus lenses, which deliver a tunable magnification to the output collimated beam. In laboratory experiments, we achieve an optical transmission efficiency of 90% for the proposed tunable collimator.

Simultaneous thickness and phase index measurements with a motion-free actively tunable Twyman-Green interferometer.

In this paper, we present a scheme to simultaneously measure the thickness and refractive index of parallel plate samples, involving no bulk mechanical motion, by deploying an electronically tunable Twyman-Green interferometer configuration. The active electronic control with no bulk mechanical motion is realized via the introduction of a tunable focus lens within the classical motion-based Twyman-Green interferometer configuration. The resulting interferometer is repeatable and delivers accurate estimates of the thickness and refractive index of a sample under test. Elimination of bulk motion also promises a potential for miniaturization. We develop a theoretical model for estimating sample thickness and index values using this reconfigurable interferometer setup and present detailed experimental results that demonstrate the working principle of the proposed interferometer.

Non-line-of-sight-imaging using dynamic relay surfaces.

The non-line-of-sight (NLOS) imaging problem has attracted a lot of interest in recent years. The objective is to produce images of objects that are hidden around a corner, using the information encoded in the time-of-flight (ToF) of photons that scatter multiple times after incidence at a given relay surface. Most current methods assume a Lambertian, flat and static relay surface, with non-moving targets in the hidden scene. Here we show NLOS reconstructions for a relay surface that is non-planar and rapidly changing during data acquisition. Our NLOS imaging system exploits two different detectors to collect the ToF data; one pertaining to the relay surface and another one regarding the ToF information of the hidden scene. The system is then able to associate where the multiply-scattered photons originated from the relay surface. This step allows us to account for changing relay positions in the reconstruction algorithm. Results show that the reconstructions for a dynamic relay surface are similar to the ones obtained using a traditional non-dynamic relay surface.

Phasor field waves: experimental demonstrations of wave-like properties.

Time-of-flight (ToF) non-line-of-sight (NLoS) imaging reconstructs images of scenes with light that have undergone diffuse reflections. While, in the past, ToF light propagation and reconstruction methods have been described using their own inverse methods, it has recently been shown that ToF light transport can be described as the propagation of a wave, allowing it to be modeled by the same methods that are applied for direct imaging with electromagnetic or sound waves. This wave of fluctuating optical irradiance is called the phasor field (P-field) wave. Here, we perform a series of experiments to show the wave-like behavior of this P-field wave. We design a P-field source and detector and use them to demonstrate interference of P-field waves in a double slit experiment, as well as mutually-independent focusing and imaging of P-field waves and their optical carrier. Besides establishing the properties of P-field waves, our work demonstrates that imaging of ToF signals is possible without any computation enabling fast and energy-efficient NLoS imaging systems.

Phasor field waves: A Huygens-like light transport model for non-line-of-sight imaging applications.

Non-line-of-sight (NLOS) imaging has recently attracted a lot of interest from the scientific community. The goal of this paper is to provide the basis for a comprehensive mathematical framework for NLOS imaging that is directly derived from physical concepts. We introduce the irradiance phasor field (P-field) as an abstract quantity for irradiance fluctuations, akin to the complex envelope of the Electrical field (E-field) that is used to describe propagation of electromagnetic energy. We demonstrate that the P-field propagator is analogous to the Huygens-Fresnel propagator that describes the propagation of other waves and show that NLOS light transport can be described with the processing methods that are available for LOS imaging. We perform simulations to demonstrate the accuracy and validity of the P-field formulation and provide experimental results to demonstrate a Huygens-like P-field summation behavior.

Low-cost Gaussian beam profiling with circular irises and apertures.

The fundamental Gaussian TEM00 mode is the most common mode of propagation within various optical devices, modules, and systems. Beam profilers are widely used in accurately ascertaining the cross-sectional irradiance profile of a TEM00 mode for free-space optical communication systems as well as tracking beam evolution when propagating within optical submodules. We demonstrate beam profiling methods that use low-cost, off-the-shelf, widely available circular apertures such as circular irises and spatial filters. In order to demonstrate beam profiling with any circular aperture, we first derive exact analytical expressions for power transmittance of the TEM00 mode through a decentered circular aperture and then use this mathematical derivation to estimate the irradiance profile of a Gaussian beam by 1) fixing the location of a circular aperture and changing its radius, and 2) scanning the entire area of the beam profile by translating a circular aperture of a fixed radius across the region of interest. This method is fast and easily reproducible and simply puts to use circular irises/circular spatial filters, which are commonly available in most optical laboratories. Consequently, the proposed method provides cheap and convenient means to estimate the profile of a Gaussian beam with simple optical components. Our experimental results demonstrate a performance that is comparable to a standard knife-edge-based estimate of beam profile. Moreover, a strong agreement with presented theory validates the analytical expressions derived in this paper.

Robust motion-free and error-correcting method of estimating the focal length of a lens.

This paper presents a motion-free technique to characterize the focal length of any spherical convex or concave lens. The measurement test-bench uses a Gaussian laser beam, an electronically controlled variable focus lens (ECVFL), a digital micro-mirror device (DMD), and a standard photo-detector (PD). The method requires measuring beam spot sizes for different focal length settings of the ECVFL and using the measurement data to obtain a focal length estimate through an iterative least-squares-based curve-fitting algorithm. The method is also shown to overcome potential measurement errors that arise due to inaccurate placement of optical components on the test-bench as well as unknown principal plane locations of asymmetric lens samples such as plano-convex lenses. Contrary to the commercially deployed and other proposed methods of focal length characterization, this method does not involve any bulk mechanical motion of optical elements. This approach eliminates measurement errors due to gradual mechanical wear and tear and improves measurement repeatability by minimizing mechanical hysteresis. The compact and fully automated method delivers fast, repeatable, and reliable measurements, which we believe makes it ideal for deployment in industrial lens production units and characterizing lenses used in sensitive imaging systems and various other optical experiments and systems. Measured focal lengths are within the 1% manufacturer-provided tolerance values showing excellent agreement between theory and experiments. We also demonstrate measurement robustness by rectifying discrepancies between known and actual separation distances on the measurement test bench.

Improved laser-based triangulation sensor with enhanced range and resolution through adaptive optics-based active beam control.

Various existing target ranging techniques are limited in terms of the dynamic range of operation and measurement resolution. These limitations arise as a result of a particular measurement methodology, the finite processing capability of the hardware components deployed within the sensor module, and the medium through which the target is viewed. Generally, improving the sensor range adversely affects its resolution and vice versa. Often, a distance sensor is designed for an optimal range/resolution setting depending on its intended application. Optical triangulation is broadly classified as a spatial-signal-processing-based ranging technique and measures target distance from the location of the reflected spot on a position sensitive detector (PSD). In most triangulation sensors that use lasers as a light source, beam divergence-which severely affects sensor measurement range-is often ignored in calculations. In this paper, we first discuss in detail the limitations to ranging imposed by beam divergence, which, in effect, sets the sensor dynamic range. Next, we show how the resolution of laser-based triangulation sensors is limited by the interpixel pitch of a finite-sized PSD. In this paper, through the use of tunable focus lenses (TFLs), we propose a novel design of a triangulation-based optical rangefinder that improves both the sensor resolution and its dynamic range through adaptive electronic control of beam propagation parameters. We present the theory and operation of the proposed sensor and clearly demonstrate a range and resolution improvement with the use of TFLs. Experimental results in support of our claims are shown to be in strong agreement with theory.

Nonbulk motion system for simultaneously measuring the refractive index and thickness of a sample using tunable optics and spatial signal processing-based Gaussian beam imaging.

This paper presents a novel approach to simultaneously measuring the thickness and refractive index of a sample. The design uses an electronically controlled tunable lens (ECTL) and a microelectromechanical-system-based digital micromirror device (DMD). The method achieves the desired results by using the DMD to characterize the spatial profile of a Gaussian laser beam at different focal length settings of the ECTL. The ECTL achieves tunable lensing through minimal motion of liquid inside a transparent casing, whereas the DMD contains an array of movable micromirrors, which make it a reflective spatial light modulator. As the proposed system uses an ECTL, a DMD, and other fixed optical components, it measures the thickness and refractive index without requiring any motion of bulk components such as translational and rotational stages. A motion-free system improves measurement repeatability and reliability. Moreover, the measurement of sample thickness and refractive index can be completely automated because the ECTL and DMD are controlled through digital signals. We develop and discuss the theory in detail to explain the measurement methodology of the proposed system and present results from experiments performed to verify the working principle of the method. Refractive index measurement accuracies of 0.22% and 0.2% were achieved for two BK-7 glass samples used, and the thicknesses of the two samples were measured with a 0.1 mm accuracy for each sample, corresponding to a 0.39% and 0.78% measurement error, respectively, for the aforementioned samples.

Toward the design of a motion-free tunable coupling module for varying spatial beam profiles: foundations of optimal coupling of a Gaussian mode into a fiber collimator with a dynamic two-lens system.

In this paper, we present analytical expressions for the coupling of the fundamental Gaussian mode into a fiber collimator (FC) using a two-lens system. For this two-lens system, we also derive the limiting condition imposed on the focal lengths of the two individual lenses and their mutual separation for near-to-perfect mode coupling into the FC. Variations in the spatial mode profile of a Gaussian beam may occur due to various reasons. These include controlled changes in the beam profile inside mode-division multiplexed systems, and undesired spatial profile variations in beams that pass through turbulent media. The necessity of a dynamic mode-coupling module is dictated by the need to optimally couple Gaussian beams with dynamically changing spatial profiles. Using the analytical expressions derived for mode-coupling efficiency and the resulting lens separation condition that is imposed on a two-lens coupling system, we propose the design of a dynamic two-lens mode-coupling system with a pair of electronically controlled tunable lenses. The proposed dynamic coupling module is motion free and involves the movement of bulk components in order to achieve optimal coupling. The experimental results are also presented to verify the theoretical claims and the working principle of a two-lens mode-coupling system. The results of the experiments are discussed in detail and an excellent agreement is demonstrated between the proposed theoretical framework and the experimental results.

Texture Estimation for Abnormal Tissue Segmentation in Brain MRI.

This chapter discusses multifractal texture estimation and characterization of brain lesions (necrosis, edema, enhanced tumor, nonenhanced tumor, etc.) in magnetic resonance (MR) images. This work formulates the complex texture of tumor in MR images using a stochastic model known as multifractional Brownian motion (mBm). Mathematical derivations of the mBm model and corresponding algorithm to extract the spatially varying multifractal texture feature are discussed. Extracted multifractal texture feature is fused with other effective features to enhance the tissue characteristics. Segmentation of the tissues is performed using a feature-based classification method. The efficacy of the mBm texture feature in segmenting different abnormal tissues is demonstrated using a large-scale publicly available clinical dataset. Experimental results and performance of the methods confirm the efficacy of the proposed technique in an automatic segmentation of abnormal tissues in multimodal (T1, T2, Flair, and T1contrast) brain MRIs.

Weak grip strength among persons with multiple sclerosis having minimal disability is not related to agility or integrity of the corticospinal tract.

INTRODUCTION: Mobility impairment is common in multiple sclerosis (MS); however, agility has received less attention. Agility requires strength and neuromuscular coordination to elicit controlled propulsive rapid whole-body movement. Grip strength is a common method to assess whole body force production, but also reflects neuromuscular integrity and global brain health. Impaired agility may be linked to loss of neuromuscular integrity (reflected by grip strength or corticospinal excitability). OBJECTIVES: We aimed to determine whether grip strength would be associated with agility and transcranial magnetic stimulation (TMS)-based indices of corticospinal excitability and inhibition in persons with MS having low disability. We hypothesized that low grip strength would predict impaired agility and reflect low corticospinal excitability. METHODS: We recruited 34 persons with relapsing MS (27 females; median [range] age 45.5 [21.0-65.0] years) and mild disability (median [range] Expanded Disability Status Scale 2.0 [0-3.0]), as well as a convenience sample of age- and sex-matched apparently healthy controls. Agility was tested by measuring hop length during bipedal hopping on an instrumented walkway. Grip strength was measured using a calibrated dynamometer. Corticospinal excitability and inhibition were examined using TMS-based motor evoked potential (MEP) and corticospinal silent period (CSP) recruitment curves, respectively. RESULTS: MS participants had significantly lower grip strength than controls independent of sex. Females with and without MS had weaker grip strength than males. There were no statistically significant sex or group differences in agility. After controlling for sex, weaker grip strength was associated with shorter hop length in controls only (r = 0.645, p < .05). Grip strength did not significantly predict agility in persons with MS, nor was grip strength predicted by corticospinal excitability or inhibition. CONCLUSIONS: In persons with MS having low disability, grip strength (normalized to body mass) was reduced despite having intact agility and walking performance. Grip strength was not associated with corticospinal excitability or inhibition, suggesting peripheral neuromuscular function, low physical activity or fitness, or other psychosocial factors may be related to weakness. Low grip strength is a putative indicator of early neuromuscular aging in persons with MS having mild disability and normal mobility.

Robust, motion-free optical characterization of samples using actively-tunable Twyman-Green interferometry.

Optical interferometry-based techniques are ubiquitous in various measurement, imaging, calibration, metrological, and astronomical applications. Repeatability, simplicity, and reliability of measurements have ensured that interferometry in its various forms remains popular-and in fact continues to grow-in almost every branch of measurement science. In this paper, we propose a novel actively-controlled optical interferometer in the Twyman-Green configuration. The active beam control within the interferometer is a result of using an actively-controlled tunable focus lens in the sample arm of the interferometer. This innovation allows us to characterize transparent samples cut in the cubical geometry without the need for bulk mechanical motion within the interferometer. Unlike thickness/refractive index measurements with conventional Twyman-Green interferometers, the actively-tunable interferometer enables bulk-motion free thickness or refractive index sample measurements. With experimental demonstrations, we show excellent results for various samples that we characterized. The elimination of bulk motion from the measurement process promises to enable miniaturization of actively-tunable Twyman-Green interferometers for various applications.

Novel machine-learning analysis of SARS-CoV-2 infection in a subclinical nonhuman primate model using radiomics and blood biomarkers.

Detection of the physiological response to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection is challenging in the absence of overt clinical signs but remains necessary to understand a full subclinical disease spectrum. In this study, our objective was to use radiomics (from computed tomography images) and blood biomarkers to predict SARS-CoV-2 infection in a nonhuman primate model (NHP) with inapparent clinical disease. To accomplish this aim, we built machine-learning models to predict SARS-CoV-2 infection in a NHP model of subclinical disease using baseline-normalized radiomic and blood sample analyses data from SARS-CoV-2-exposed and control (mock-exposed) crab-eating macaques. We applied a novel adaptation of the minimum redundancy maximum relevance (mRMR) feature-selection technique, called mRMR-permute, for statistically-thresholded and unbiased feature selection. Through performance comparison of eight machine-learning models trained on 14 feature sets, we demonstrated that a logistic regression model trained on the mRMR-permute feature set can predict SARS-CoV-2 infection with very high accuracy. Eighty-nine percent of mRMR-permute selected features had strong and significant class effects. Through this work, we identified a key set of radiomic and blood biomarkers that can be used to predict infection status even in the absence of clinical signs. Furthermore, we proposed and demonstrated the utility of a novel feature-selection technique called mRMR-permute. This work lays the foundation for the prediction and classification of SARS-CoV-2 disease severity.

Computed Tomography Imaging for Monitoring of Marburg Virus Disease: a Nonhuman Primate Proof-Of-Concept Study.

Marburg virus (MARV) is a highly virulent zoonotic filovirid that causes Marburg virus disease (MVD) in humans. The pathogenesis of MVD remains poorly understood, partially due to the low number of cases that can be studied, the absence of state-of-the-art medical equipment in areas where cases are reported, and limitations on the number of animals that can be safely used in experimental studies under maximum containment animal biosafety level 4 conditions. Medical imaging modalities, such as whole-body computed tomography (CT), may help to describe disease progression in vivo, potentially replacing ethically contentious and logistically challenging serial euthanasia studies. Towards this vision, we performed a pilot study, during which we acquired whole-body CT images of 6 rhesus monkeys before and 7 to 9 days after intramuscular MARV exposure. We identified imaging abnormalities in the liver, spleen, and axillary lymph nodes that corresponded to clinical, virological, and gross pathological hallmarks of MVD in this animal model. Quantitative image analysis indicated hepatomegaly with a significant reduction in organ density (indicating fatty infiltration of the liver), splenomegaly, and edema that corresponded with gross pathological and histopathological findings. Our results indicated that CT imaging could be used to verify and quantify typical MVD pathogenesis versus altered, diminished, or absent disease severity or progression in the presence of candidate medical countermeasures, thus possibly reducing the number of animals needed and eliminating serial euthanasia. IMPORTANCE Marburg virus (MARV) is a highly virulent zoonotic filovirid that causes Marburg virus disease (MVD) in humans. Much is unknown about disease progression and, thus, prevention and treatment options are limited. Medical imaging modalities, such as whole-body computed tomography (CT), have the potential to improve understanding of MVD pathogenesis. Our study used CT to identify abnormalities in the liver, spleen, and axillary lymph nodes that corresponded to known clinical signs of MVD in this animal model. Our results indicated that CT imaging and analyses could be used to elucidate pathogenesis and possibly assess the efficacy of candidate treatments.