Neutron phase filtering for separating phase- and attenuation signal in aluminium and anodic aluminium oxide.

Neutron imaging has gained significant importance as a material characterisation technique and is particularly useful to visualise hydrogenous materials in objects opaque to other radiations. Fields of application include investigations of hydrogen in metals as well as metal corrosion, thanks to the fact that neutrons can penetrate metals better than e.g. X-rays and are highly sensitive to hydrogen. However, at interfaces refraction effects sometimes obscure the attenuation image, which is used for hydrogen quantification. Refraction, a differential phase effect, diverts the neutron beam away from the interface in the image leading to intensity gain and intensity loss regions, which are superimposed to the attenuation image, thus obscuring the interface region and hindering quantitative analyses of e.g. hydrogen content in the vicinity of the interface. For corresponding effects in X-ray imaging, a phase filter approach was developed and is generally based on transport-of-intensity considerations. Here, we compare such an approach, that has been adapted to neutrons, with another simulation-based assessment using the ray-tracing software McStas. The latter appears superior and promising for future extensions which enable fitting forward models via simulations in order to separate phase and attenuation effects and thus pave the way for overcoming quantitative limitations at refracting interfaces.

Variable Splitting and Fusing for Image Phase Retrieval.

Phase Retrieval is defined as the recovery of a signal when only the intensity of its Fourier Transform is known. It is a non-linear and non-convex optimization problem with a multitude of applications including X-ray crystallography, microscopy and blind deconvolution. In this study, we address the problem of Phase Retrieval from the perspective of variable splitting and alternating minimization for real signals and seek to develop algorithms with improved convergence properties. An exploration of the underlying geometric relations led to the conceptualization of an algorithmic step aiming to refine the estimate at each iteration via recombination of the separated variables. Following this, a theoretical analysis to study the convergence properties of the proposed method and justify the inclusion of the recombination step was developed. Our experiments showed that the proposed method converges substantially faster compared to other state-of-the-art analytical methods while demonstrating equivalent or superior performance in terms of quality of reconstruction and ability to converge under various setups.

Ptychographic phase retrieval via a deep-learning-assisted iterative algorithm.

Ptychography is a powerful computational imaging technique with microscopic imaging capability and adaptability to various specimens. To obtain an imaging result, it requires a phase-retrieval algorithm whose performance directly determines the imaging quality. Recently, deep neural network (DNN)-based phase retrieval has been proposed to improve the imaging quality from the ordinary model-based iterative algorithms. However, the DNN-based methods have some limitations because of the sensitivity to changes in experimental conditions and the difficulty of collecting enough measured specimen images for training the DNN. To overcome these limitations, a ptychographic phase-retrieval algorithm that combines model-based and DNN-based approaches is proposed. This method exploits a DNN-based denoiser to assist an iterative algorithm like ePIE in finding better reconstruction images. This combination of DNN and iterative algorithms allows the measurement model to be explicitly incorporated into the DNN-based approach, improving its robustness to changes in experimental conditions. Furthermore, to circumvent the difficulty of collecting the training data, it is proposed that the DNN-based denoiser be trained without using actual measured specimen images but using a formula-driven supervised approach that systemically generates synthetic images. In experiments using simulation based on a hard X-ray ptychographic measurement system, the imaging capability of the proposed method was evaluated by comparing it with ePIE and rPIE. These results demonstrated that the proposed method was able to reconstruct higher-spatial-resolution images with half the number of iterations required by ePIE and rPIE, even for data with low illumination intensity. Also, the proposed method was shown to be robust to its hyperparameters. In addition, the proposed method was applied to ptychographic datasets of a Simens star chart and ink toner particles measured at SPring-8 BL24XU, which confirmed that it can successfully reconstruct images from measurement scans with a lower overlap ratio of the illumination regions than is required by ePIE and rPIE.

Coherent X-ray diffraction imaging of single particles: background impact on 3D reconstruction.

Coherent diffractive imaging with X-ray free-electron lasers could enable structural studies of macromolecules at room temperature. This type of experiment could provide a means to study structural dynamics on the femtosecond timescale. However, the diffraction from a single protein is weak compared with the incoherent scattering from background sources, which negatively affects the reconstruction analysis. This work evaluates the effects of the presence of background on the analysis pipeline. Background measurements from the European X-ray Free-Electron Laser were combined with simulated diffraction patterns and treated by a standard reconstruction procedure, including orientation recovery with the expand, maximize and compress algorithm and 3D phase retrieval. Background scattering did have an adverse effect on the estimated resolution of the reconstructed density maps. Still, the reconstructions generally worked when the signal-to-background ratio was 0.6 or better, in the momentum transfer shell of the highest reconstructed resolution. The results also suggest that the signal-to-background requirement increases at higher resolution. This study gives an indication of what is possible at current setups at X-ray free-electron lasers with regards to expected background strength and establishes a target for experimental optimization of the background.

A high-performance reconstruction method for partially coherent ptychography.

Ptychography is now integrated as a tool in mainstream microscopy allowing quantitative and high-resolution imaging capabilities over a wide field of view. However, its ultimate performance is inevitably limited by the available coherent flux when implemented using electrons or laboratory X-ray sources. We present a universal reconstruction algorithm with high tolerance to low coherence for both far-field and near-field ptychography. The approach is practical for partial temporal and spatial coherence and requires no prior knowledge of the source properties. Our initial visible-light and electron data show that the method can dramatically improve the reconstruction quality and accelerate the convergence rate of the reconstruction. The approach also integrates well into existing ptychographic engines. It can also improve mixed-state and numerical monochromatisation methods, requiring a smaller number of coherent modes or lower dimensionality of Krylov subspace while providing more stable and faster convergence. We propose that this approach could have significant impact on ptychography of weakly scattering samples.

Spatially-coded Fourier ptychography: flexible and detachable coded thin films for quantitative phase imaging with uniform phase transfer characteristics.

Fourier ptychography (FP) is an enabling imaging technique that produces high-resolution complex-valued images with extended field coverages. However, when FP images a phase object with any specific spatial frequency, the captured images contain only constant values, rendering the recovery of the corresponding linear phase ramp impossible. This challenge is not unique to FP but also affects other common microscopy techniques -- a rather counterintuitive outcome given their widespread use in phase imaging. The underlying issue originates from the non-uniform phase transfer characteristic inherent in microscope systems, which impedes the conversion of object wavefields into discernible intensity variations. To address this challenge, we present spatially-coded Fourier ptychography (scFP), a new method that synergizes FP with spatial-domain coded detection for true quantitative phase imaging. In scFP, a flexible and detachable coded thin film is attached atop the image sensor in a regular FP setup. The spatial modulation of this thin film ensures a uniform phase response across the entire synthetic bandwidth. It improves reconstruction quality and corrects refractive index underestimation issues prevalent in conventional FP and related tomographic implementations. The inclusion of the coded thin film further adds a new dimension of measurement diversity in the spatial domain. The development of scFP is expected to catalyse new research directions and applications for phase imaging, emphasizing the need for true quantitative accuracy with uniform frequency response.

Two-plus-two fringe projection profilometry based on phase-shifted coding.

In fringe projection profilometry based on temporal phase unwrapping, determining a fringe order map commonly requires a large number of fringes. To reduce the fringe number, this paper proposes a concise absolute phase retrieval algorithm just by projecting four fringes. The first two orthogonal fringes with relatively large frequency can collect reliable height information. The second two fringes are designed the same as the first two, but the only difference is that each 2π-phase of them is shifted by a unique amount, which can robustly label a large number of fringe orders. For decoding the fringes, we develop an average intensity one-time extraction algorithm, which allows for the rapid acquisition of the two pairs of alternating current components. From this, the wrapped phase containing height information and the stair-coded phase providing fringe orders can be directly extracted by arctangent operation in a point-to-point manner. Furthermore, we also develop a universal fringe order correction algorithm that can simultaneously correct the common errors and the misalignment between the wrapped phase and fringe orders. Experiment results demonstrate that this method achieves comparable accuracy and adaptability to the phase-coding method, while utilizing two fewer fringes.

Correcting directional dark field x-ray imaging artefacts using position dependent image deblurring and attenuation removal.

In recent years, a novel x-ray imaging modality has emerged that reveals unresolved sample microstructure via a "dark-field image", which provides complementary information to conventional "bright-field" images, such as attenuation and phase-contrast modalities. This x-ray dark-field signal is produced by unresolved microstructures scattering the x-ray beam resulting in localised image blur. Dark-field retrieval techniques extract this blur to reconstruct a dark-field image. Unfortunately, the presence of non-dark-field blur such as source-size blur or the detector point-spread-function can affect the dark-field retrieval as they also blur the experimental image. In addition, dark-field images can be degraded by the artefacts induced by large intensity gradients from attenuation and propagation-based phase contrast, particularly around sample edges. By measuring any non-dark-field blurring across the image plane and removing it from experimental images, as well as removing attenuation and propagation-based phase contrast, we show that a directional dark-field image can be retrieved with fewer artefacts and more consistent quantitative measures. We present the details of these corrections and provide "before and after" directional dark-field images of samples imaged at a synchrotron source. This paper utilises single-grid directional dark-field imaging, but these corrections have the potential to be broadly applied to other x-ray imaging techniques.

Off-axis digital lensless holographic microscopy based on spatially multiplexed interferometry.

Significance: Digital holographic microscopy (DHM) is a label-free microscopy technique that provides time-resolved quantitative phase imaging (QPI) by measuring the optical path delay of light induced by transparent biological samples. DHM has been utilized for various biomedical applications, such as cancer research and sperm cell assessment, as well as for in vitro drug or toxicity testing. Its lensless version, digital lensless holographic microscopy (DLHM), is an emerging technology that offers size-reduced, lightweight, and cost-effective imaging systems. These features make DLHM applicable, for example, in limited resource laboratories, remote areas, and point-of-care applications. Aim: In addition to the abovementioned advantages, in-line arrangements for DLHM also include the limitation of the twin-image presence, which can restrict accurate QPI. We therefore propose a compact lensless common-path interferometric off-axis approach that is capable of quantitative imaging of fast-moving biological specimens, such as living cells in flow. Approach: We suggest lensless spatially multiplexed interferometric microscopy (LESSMIM) as a lens-free variant of the previously reported spatially multiplexed interferometric microscopy (SMIM) concept. LESSMIM comprises a common-path interferometric architecture that is based on a single diffraction grating to achieve digital off-axis holography. From a series of single-shot off-axis holograms, twin-image free and time-resolved QPI is achieved by commonly used methods for Fourier filtering-based reconstruction, aberration compensation, and numerical propagation. Results: Initially, the LESSMIM concept is experimentally demonstrated by results from a resolution test chart and investigations on temporal stability. Then, the accuracy of QPI and capabilities for imaging of living adherent cell cultures is characterized. Finally, utilizing a microfluidic channel, the cytometry of suspended cells in flow is evaluated. Conclusions: LESSMIM overcomes several limitations of in-line DLHM and provides fast time-resolved QPI in a compact optical arrangement. In summary, LESSMIM represents a promising technique with potential biomedical applications for fast imaging such as in imaging flow cytometry or sperm cell analysis.

Subgradient-projection-based stable phase-retrieval algorithm for X-ray ptychography.

X-ray ptychography is a lensless imaging technique that visualizes the nano-structure of a thick specimen which cannot be observed with an electron microscope. It reconstructs a complex-valued refractive index of the specimen from observed diffraction patterns. This reconstruction problem is called phase retrieval (PR). For further improvement in the imaging capability, including expansion of the depth of field, various PR algorithms have been proposed. Since a high-quality PR method is built upon a base PR algorithm such as ePIE, developing a well performing base PR algorithm is important. This paper proposes an improved iterative algorithm named CRISP. It exploits subgradient projection which allows adaptive step size and can be expected to avoid yielding a poor image. The proposed algorithm was compared with ePIE, which is a simple and fast-convergence algorithm, and its modified algorithm, rPIE. The experiments confirmed that the proposed method improved the reconstruction performance for both simulation and real data.

Multi frame holograms batched optimization for binary phase spatial light modulators.

Phase retrieval methods used in computer generated holograms such as Gerchberg-Saxton and gradient descent give results which are prone to noise and other defects. This work builds up on the idea of time-averaging multiple hologram frames, first introduced in methods like One-Step Phase-Retrieval and Adaptive One-Step Phase-Retrieval. The proposed technique called Multi-Frame Holograms Batched Optimization uses the L-BFGS optimization algorithm to simultaneously generate a batch of binary phase holograms which result in an average reconstructed image of improved fidelity and fast algorithmic convergence, both in the Fraunhoffer and the Fresnel regimes. The results are compared to One-Step Phase-Retrieval and Adaptive One-Step Phase-Retrieval in simulation and experimentally, proving the superiority of the proposed approach. This technique can be easily extended to other spatial modulation methods.

Influence of loss function and electron dose on ptychography of 2D materials using the Wirtinger flow.

Iterative phase retrieval is based on minimising a loss function as a measure of the consistency of an initial guess and underlying experimental data. Under ideal experimental conditions, real data contains Poissonian noise due to counting statistics. In this work, we use the Wirtinger Flow concept in combination with four common loss functions, being the L1 loss, the mean-squared error (MSE), the amplitude loss and the Poisson loss. Since only the latter reflects the counting statistics as an asymmetric Poisson distribution correctly, our simulation study focuses on two main cases. Firstly, high-dose momentum-resolved scanning transmission electron microscopy (STEM) of an MoS2 monolayer is considered for phase retrieval. In this case, it is found that the four losses perform differently with respect to chemical sensitivity and frequency transfer, which we interprete in terms of the substantially different signal level in the bright and dark field part of diffraction patterns. Remedies are discussed using further simulations, addressing the use of virtual ring detectors for the dark field, or restricting loss calculation to the bright field. Secondly, a dose series is presented down to 100 electrons per diffraction pattern. It is found that all losses yield qualitatively reasonable structural data in the phase, whereas only MSE and Poisson loss range at the correct amplitude level. Chemical contrast is, in general, reliably obtained using the Poisson concept, which also provides the most continuous spatial frequency transfer as to the reconstructed object transmission function.

Soft Contact Lens Engraving Characterization by Wavefront Holoscopy.

Permanent engravings on contact lenses provide information about the manufacturing process and lens positioning when they are placed on the eye. The inspection of their morphological characteristics is important, since they can affect the user's comfort and deposit adhesion. Therefore, an inverted wavefront holoscope (a lensless microscope based on Gabor's principle of in-line digital holography) is explored for the characterization of the permanent marks of soft contact lenses. The device, based on an in-line transmission configuration, uses a partially coherent laser source to illuminate the soft contact lens placed in a cuvette filled with a saline solution for lens preservation. Holograms were recorded on a digital sensor and reconstructed by back propagation to the image plane based on the angular spectrum method. In addition, a phase-retrieval algorithm was used to enhance the quality of the recovered images. The instrument was experimentally validated through a calibration process in terms of spatial resolution and thickness estimation, showing values that perfectly agree with those that were theoretically expected. Finally, phase maps of different engravings for three commercial soft contact lenses were successfully reconstructed, validating the inverted wavefront holoscope as a potential instrument for the characterization of the permanent marks of soft contact lenses. To improve the final image quality of reconstructions, the geometry of lenses should be considered to avoid induced aberration effects.

A modified phase-retrieval algorithm to facilitate automatic de novo macromolecular structure determination in single-wavelength anomalous diffraction.

The success of experimental phasing in macromolecular crystallography relies primarily on the accurate locations of heavy atoms bound to the target crystal. To improve the process of substructure determination, a modified phase-retrieval algorithm built on the framework of the relaxed alternating averaged reflection (RAAR) algorithm has been developed. Importantly, the proposed algorithm features a combination of the π-half phase perturbation for weak reflections and enforces the direct-method-based tangent formula for strong reflections in reciprocal space. The proposed algorithm is extensively demonstrated on a total of 100 single-wavelength anomalous diffraction (SAD) experimental datasets, comprising both protein and nucleic acid structures of different qualities. Compared with the standard RAAR algorithm, the modified phase-retrieval algorithm exhibits significantly improved effectiveness and accuracy in SAD substructure determination, highlighting the importance of additional constraints for algorithmic performance. Furthermore, the proposed algorithm can be performed without human intervention under most conditions owing to the self-adaptive property of the input parameters, thus making it convenient to be integrated into the structural determination pipeline. In conjunction with the IPCAS software suite, we demonstrated experimentally that automatic de novo structure determination is possible on the basis of our proposed algorithm.

Ghostbuster: A phase retrieval diffraction tomography algorithm for cryo-EM.

Ewald sphere curvature correction, which extends beyond the projection approximation, stretches the shallow depth of field in cryo-EM reconstructions of thick particles. Here we show that even for previously assumed thin particles, reconstruction artifacts which we refer to as ghosts can appear. By retrieving the lost phases of the electron exitwaves and accounting for the first Born approximation scattering within the particle, we show that these ghosts can be effectively eliminated. Our simulations demonstrate how such ghostbusting can improve reconstructions as compared to existing state-of-the-art software. Like ptychographic cryo-EM, our Ghostbuster algorithm uses phase retrieval to improve reconstructions, but unlike the former, we do not need to modify the existing data acquisition pipelines.

On the connection between uniqueness from samples and stability in Gabor phase retrieval.

Gabor phase retrieval is the problem of reconstructing a signal from only the magnitudes of its Gabor transform. Previous findings suggest a possible link between unique solvability of the discrete problem (recovery from measurements on a lattice) and stability of the continuous problem (recovery from measurements on an open subset of R2). In this paper, we close this gap by proving that such a link cannot be made. More precisely, we establish the existence of functions which break uniqueness from samples without affecting stability of the continuous problem. Furthermore, we prove the novel result that counterexamples to unique recovery from samples are dense in L2(R). Finally, we develop an intuitive argument on the connection between directions of instability in phase retrieval and certain Laplacian eigenfunctions associated to small eigenvalues.

Fast autofocusing of recorded planes by salient feature region for coherent diffraction imaging.

In multi-distance coherent diffraction imaging, the task of distance calculation for multi-diffraction images is cumbersome. The information features are hard-to-extract and the region of interest extraction algorithms are difficult to be adopted. A universal salient feature region selection algorithm by using the area with the highest density of corners is proposed to extract the most representative feature region. In addition, equally spaced recording modes and mismatched diffraction distances will result in system noise and destroy image quality. The polydirectional maximum gradient is offered as a sharpness criterion to weigh a quantitative feature for the final pattern. A fast, sensitive, and high-accuracy autofocusing and sample reconstruction can be achieved using only a small number of images while ensuring that morphological properties and quantification of the reconstructions are not compromised. The proposed method is promising for biological and medical dynamic observations for computational imaging systems.

Phase retrieval for X-ray differential phase contrast radiography with knowledge transfer learning from virtual differential absorption model.

Grating-based X-ray phase contrast radiography and computed tomography (CT) are promising modalities for future medical applications. However, the ill-posed phase retrieval problem in X-ray phase contrast imaging has hindered its use for quantitative analysis in biomedical imaging. Deep learning has been proved as an effective tool for image retrieval. However, in practical grating-based X-ray phase contrast imaging system, acquiring the ground truth of phase to form image pairs is challenging, which poses a great obstacle for using deep leaning methods. Transfer learning is widely used to address the problem with knowledge inheritance from similar tasks. In the present research, we propose a virtual differential absorption model and generate a training dataset with differential absorption images and absorption images. The knowledge learned from the training is transferred to phase retrieval with transfer learning techniques. Numerical simulations and experiments both demonstrate its feasibility. Image quality of retrieved phase radiograph and phase CT slices is improved when compared with representative phase retrieval methods. We conclude that this method is helpful in both X-ray 2D and 3D imaging and may find its applications in X-ray phase contrast radiography and X-ray phase CT.

Quantitative phase contrast X-ray tomography of aluminium metal matrix composite.

The quantitative assessment of micro-structure and load-induced damages in Al-SiC metal matrix composites (MMC) is important for its design optimization, performance evaluation and structure-property correlation. X-ray Phase contrast micro-tomography is potentially used for evaluation of its 3 dimensional micro-structure manifested in the form of voids, cracks, embedded particles, and load-induced damages. However, the contrast between Al matrix and SiC particles is insufficient for their clear morphological identification and quantitative assessment. In the present study, we have proposed and applied single image-based phase retrieval as a pre-processing step to micro-tomography reconstruction for improved assessment of micro-structure and cohesion-induced damages in Al-SiC MMC. The advantages of applying different phase retrieval techniques in the enhancement of image quality and morphological quantification of SiC particles, pores and cohesion damages are discussed. It is observed that the Paganin method offers the best improvement in contrast to noise ratio for the measurement of SiC particles embedded in the Al matrix.

Protocol using similarity score and improved shrink-wrap algorithm for better convergence of phase-retrieval calculation in X-ray diffraction imaging.

In X-ray diffraction imaging (XDI), electron density maps of a targeted particle are reconstructed computationally from the diffraction pattern alone using phase-retrieval (PR) algorithms. However, the PR calculations sometimes fail to yield realistic electron density maps that approximate the structure of the particle. This occurs due to the absence of structure amplitudes at and near the zero-scattering angle and the presence of Poisson noise in weak diffraction patterns. Consequently, the PR calculation becomes a bottleneck for XDI structure analyses. Here, a protocol to efficiently yield realistic maps is proposed. The protocol is based on the empirical observation that realistic maps tend to yield low similarity scores, as suggested in our prior study [Sekiguchi et al. (2017), J. Synchrotron Rad. 24, 1024-1038]. Among independently and concurrently executed PR calculations, the protocol modifies all maps using the electron-density maps exhibiting low similarity scores. This approach, along with a new protocol for estimating particle shape, improved the probability of obtaining realistic maps for diffraction patterns from various aggregates of colloidal gold particles, as compared with PR calculations performed without the protocol. Consequently, the protocol has the potential to reduce computational costs in PR calculations and enable efficient XDI structure analysis of non-crystalline particles using synchrotron X-rays and X-ray free-electron laser pulses.