Experimental and simulation investigation of stereo-DIC via a deep learning algorithm based on initial speckle positioning technology.

For the deep-learning-based stereo-digital image correlation technique, the initial speckle position is crucial as it influences the accuracy of the generated dataset and deformation fields. To ensure measurement accuracy, an optimized extrinsic parameter estimation algorithm is proposed in this study to determine the rotation and translation matrix of the plane in which the speckle is located between the world coordinate system and the left camera coordinate system. First, the accuracy of different extrinsic parameter estimation algorithms was studied by simulations. Subsequently, the dataset of stereo speckle images was generated using the optimized extrinsic parameters. Finally, the improved dual-branch CNN deconvolution architecture was proposed to output displacements and strains simultaneously. Simulation results indicate that DAS-Net exhibits enhanced expressive capabilities, as evidenced by a reduction in displacement errors compared to previous research. The experimental results reveal that the mean absolute percentage error between the stereo-DIC results and the generated dataset is less than 2%, suggesting that the initial speckle positioning technology effectively minimizes the discrepancy between the images in the dataset and those obtained experimentally. Furthermore, the DAS-Net algorithm accurately measures the displacement and strain fields as well as their morphological characteristics.

Integration of photothermal water evaporation with photocatalytic microplastics upcycling via nanofluidic thermal management.

Photothermal heating and photocatalytic treatment are two solar-driven water processing approaches by harnessing NIR and UV-vis light, respectively, which can fully utilize solar energy if integrated. However, it remains a challenge to achieve high performance in both approaches when integrated in a material due to uncontrollable heat diffusion. Here, we report a demonstration of heat confinement on photothermal sites and fluid cooling on photocatalysis sites at the nanoscale, within a well-designed heat and fluid confinement nanofiber reactor. Photothermal and photocatalytic nanostructures were alternatively aligned in electrospun nanofibers for on-demand nanofluidic thermal management as well as easy folding into 3D structures with enhanced light utilization and mass transfer. Such a design showed simultaneously high photothermal evaporation rate (2.59 kg m-2 h-1, exceeding the limit rate) and efficient photocatalytic upcycling of microplastics pollutant into valued products. Enabled by controlled photothermal heating, the valued main product (i.e., methyl acetate) can be evaporated out with 100% selectivity by in situ separation.

Refraction correction for deep-water three-dimensional visual measurement based on multi-objective optimization.

Refraction-induced errors affect the accuracy of three-dimensional visual measurements in deepwater environments. In this study, a binocular camera refractive imaging model was established, and a calibration method for the refraction parameters was proposed for high-accuracy shape and deformation measurements in deep-water environments. First, an initial estimate of the refractive axis was obtained using a three-dimensional calibration target. Then, the errors in the distance between the spatial point pairs and the reprojection errors are taken as the dual optimization objectives, and the Non-dominated Sorting Genetic Algorithm II is applied to optimize the refraction parameters. To efficiently calculate the reprojection error, an improved numerical computation method is proposed to accelerate the calculation of the analytical forward projection. Underwater experiments were conducted to verify the method's effectiveness. The results showed that the average error of the absolute position of the reconstructed points was less than 1.1 mm and the average error of the displacement was less than 0.04 mm. This study provides a sound solution for accurate three-dimensional visual measurement in deep-water environments.

Hierarchical triphase diffusion photoelectrodes for photoelectrochemical gas/liquid flow conversion.

Photoelectrochemical device is a versatile platform for achieving various chemical transformations with solar energy. However, a grand challenge, originating from mass and electron transfer of triphase-reagents/products in gas phase, water/electrolyte/products in liquid phase and catalyst/photoelectrode in solid phase, largely limits its practical application. Here, we report the simulation-guided development of hierarchical triphase diffusion photoelectrodes, to improve mass transfer and ensure electron transfer for photoelectrochemical gas/liquid flow conversion. Semiconductor nanocrystals are controllably integrated within electrospun nanofiber-derived mat, overcoming inherent brittleness of semiconductors. The mechanically strong skeleton of free-standing mat, together with satisfactory photon absorption, electrical conductivity and hierarchical pores, enables the design of triphase diffusion photoelectrodes. Such a design allows photoelectrochemical gas/liquid conversion to be performed continuously in a flow cell. As a proof of concept, 16.6- and 4.0-fold enhancements are achieved for the production rate and product selectivity of methane conversion, respectively, with remarkable durability.

Single-Camera Three-Dimensional Digital Image Correlation with Enhanced Accuracy Based on Four-View Imaging.

Owing to the advantages of cost-effectiveness, compactness, and the avoidance of complicated camera synchronization, single-camera three-dimensional (3D) digital image correlation (DIC) techniques have gained increasing attention for deformation measurement of materials and structures. In the traditional single-camera 3D-DIC system, the left and right view images can be recorded by a single camera using diffraction grating, a bi-prism, or a set of planar mirrors. To further improve the measurement accuracy of single-camera 3D-DIC, this paper introduces a single-camera four-view imaging technique by installing a pyramidal prism in front of the camera. The 3D reconstruction of the measured points before and after deformation is realized with eight governing equations induced by four views, and the strong geometric constraints of four views can help to improve the measurement accuracy. A static experiment, a rigid body translation experiment, and a four-point bending experiment show that the proposed single-camera 3D-DIC method can achieve higher measurement accuracy than the dual-view single-camera 3D-DIC techniques and that the single-camera 3D-DIC method has advantages in reducing both random error and systematic error.

Snapshot compressive imaging based digital image correlation: temporally super-resolved full-resolution deformation measurement.

The limited throughput of a digital image correlation (DIC) system hampers measuring deformations at both high spatial resolution and high temporal resolution. To address this dilemma, in this paper we propose to integrate snapshot compressive imaging (SCI)-a recently proposed computational imaging approach-into DIC for high-speed, high-resolution deformation measurement. Specifically, an SCI-DIC system is established to encode a sequence of fast changing speckle patterns into a snapshot and a high-accuracy speckle decompress SCI (Sp-DeSCI) algorithm is proposed for computational reconstruction of the speckle sequence. To adapt SCI reconstruction to the unique characteristics of speckle patterns, we propose three techniques under SCI reconstruction framework to secure high-precision reconstruction, including the normalized sum squared difference criterion, speckle-adaptive patch search strategy, and adaptive group aggregation. For efficacy validation of the proposed Sp-DeSCI, we conducted extensive simulated experiments and a four-point bending SCI-DIC experiment on real data. Both simulation and real experiments verify that the Sp-DeSCI successfully removes the deviations of reconstructed speckles in DeSCI and provides the highest displacement accuracy among existing algorithms. The SCI-DIC system together with the Sp-DeSCI algorithm can offer temporally super-resolved deformation measurement at full spatial resolution, and can potentially replace conventional high-speed DIC in real measurements.

Internal displacement measurements based on color fluorescent speckle pattern by multispectral stereo-DIC and refractive index correction.

Fluorescent digital image correlation (DIC) is becoming popular for measuring 3D profiles and deformations in external surfaces. However, the simultaneous monitoring of interior layers is highly challenging due to the penetrability and refraction of light using monochromatic fluorescence. We propose a color fluorescent speckle pattern (CFSP) method for measuring the internal displacement of transparent objects based on multispectral stereo-DIC and refractive index correction. During sample fabrication, fluorescent speckle patterns exciting different colors are fabricated on both the surface and interior layers of objects. A virtual color stereo-DIC system is utilized to capture the CFSP on the surface and interior layers simultaneously from two different perspectives. Different color channels are practically equivalent to synchronized monochrome vision systems, having separate CFSP in external and internal measurements. In multispectral stereo-DIC calculation, the external surface is initially reconstructed through one channel of the system even if the surface is non-planar. Based on Snell's law and the CFSP method, the internal layer is then reconstructed and corrected by establishing the geometry of the refractive stereo-DIC through another channel. The relative error of the thickness between two planar layers was proved to decrease from 33.4% to 0.7% after refractive index correction. Further experimental results validate the efficacy of this method for correcting the profile of the non-planar arc profile and determining the internal deformations of disc materials.

Dual stereo-digital image correlation system for simultaneous measurement of overlapped wings with a polarization RGB camera and fluorescent speckle patterns.

Simultaneous monitoring of overlapped multi-wing structure by stereo-digital image correlation (stereo-DIC) may be used to quantify insect motion and deformation. We propose a dual stereo-DIC system based on multispectral imaging with a polarization RGB camera. Different fluorescent speckle patterns were fabricated on wings, which emit red and blue spectra under ultraviolet light that were imaged and separated using a polarization RGB camera and auxiliary optical splitting components. The resulting dual stereo-DIC system was validated through translation experiments with transparent sheets and reconstructed overlapped insect wings (cicadas). Dynamic measurements of the Ruban artificial flier indicate the efficacy of this approach to determining real insect flight behavior.

Experimental verification of full-field accuracy in stereo-DIC based on the ESPI method.

This paper proposes a method to merge stereo-digital image correlation (DIC) and electronic speckle pattern interferometry (ESPI) data by camera calibration. The proposed method is employed to verify the accuracy of full-field out-of-plate displacements measured by stereo-DIC in a cantilever beam test. The mean absolute error and the root mean square error (RMSE) of the full-field displacement measured by four-megapixel cameras are 0.849 µm and 1.08 µm at 60 mm field of view, respectively, and the RMSE of the central area is 0.615 µm. The errors are not uniformly distributed because of the imperfect calibration. When the lenses are changed and the field of view reaches 120 mm, the RMSE is 1.48 µm with uniform distribution. These accuracies could be traced back to the laser wavelength to confirm the stereo-DIC data. The proposed method can be used not only to verify the full-field measurement accuracy of DIC but also to determine the rigid-body displacement for ESPI with a high-precision stereo-DIC. Thus, the displacement vector can be obtained. Furthermore, it can unify the coordinate of multiple ESPI systems to achieve a large range of high-precision three-dimensional deformation measurements.

Optimization of multiscale digital speckle patterns for multiscale deformation measurement using stereo-digital image correlation.

Simultaneous monitoring of multiple fields of view (FOVs) by multiscale stereo-digital image correlation (stereo-DIC) can quantify the deformation of a material when localized phenomena occur within a larger FOV or moving object. In multiscale deformation measurement via stereo-DIC, optimization of the digital speckle patterns (DSPs) is essential to achieve high accuracy and efficiency. This work optimizes and fabricates multispectral DSPs used for multiple scales. First, an optimization of the DSP for two FOVs is achieved using both spatial modulation and specified spectra. A spatially modulated DSP is compared with two spectral DSPs achieved by visible and ultraviolet-excited blue light. Then, a spatially modulated visible DSP fabricated by an ultraviolet printer overlaid with an ultraviolet-excited blue DSP fabricated by a photosensitive seal is designed for multiscale stereo-DIC measurements of three FOVs. Experiments were performed to illustrate the functionality and utility of this multiscale DSP. Such experimental analyses can supply adequate full-field data to validate localized or kinetic mechanical behavior.

Non-uniform model of relationship between surface strain and rust expansion force of reinforced concrete.

When operating within the environments rich with sodium chloride, steel bars of reinforced concrete structures are often subject to corrosion caused by surrounding erosive materials, and the associated rust expansion force due to corrosion takes a critical role in determining the durability of relevant reinforced concrete structures. By investigating the corrosion course of steel reinforcement with theory of elasticity, a numerical rust expansion model is established for the moment of concrete surface rupture based on non-uniform sin function. Cuboid reinforced concrete specimen with squared cross sections is tested to analyze the rust expansion when concrete cracks due to corrosive forces. The utility of the established expansion model is validated by numerical simulation with Abaqus through the comparison between the associated outcomes. The impacts of steel bar diameter and concrete cover thickness on the magnitude of rust expansion force are discussed.

Digital image correlation with improved efficiency by pixel selection.

With the increase in digital image correlation (DIC) applications, the computational efficiency of DIC is becoming increasingly important. In previous studies, real-time DIC was realized with a relatively small subset. However, a small subset does not always include sufficient gray gradient information. In this paper, a pixel selection strategy is proposed to improve the computational efficiency of DIC further, allowing a real-time deformation measurement with a large subset. Within the subset, zero weight is assigned to unreliable pixels as a way of pursuing maximum efficiency. The modulus of the local intensity gradient vector of each pixel in the reference image is used as the criterion for reliability. Numerical and real experiments conducted to validate the feasibility and effectiveness of the strategy showed that the computational speed of DIC could be improved about 2 times.

Accuracy analysis of an orthogonally arranged four-camera 3D digital image correlation system.

To reduce the uncertainty region of a three-dimensional (3D) position, a four-camera 3D digital image correlation (3D-DIC) system was built by orthogonally arranging two sets of two-camera DIC systems. The theoretical model proposed herein revealed the relationship between 3D coordinates and system parameters and the propagation of the matching error to the position error. Numerical simulation and experiment were conducted to verify the theory. The simulation and experimental results indicated that the 3D position error of the four-camera system was smaller than that of the two-camera DIC system. The present contribution proves the feasibility of using four-camera DIC systems to improve measurement accuracy.

Digital image correlation with reduced bias error based on digital signal upsampling theory.

Based on digital signal upsampling theory, a new computing strategy has been proposed to reduce the bias error in digital image correlation (DIC) caused by intensity interpolation. For each subset, before subpixel image matching, the subimage around the target subset was processed by increasing the sampling rate with an integer factor. The increase of the sampling rate is realized by resampling in the digital domain. The combination of digital signal upsampling processing with DIC can greatly reduce the interpolation bias error. The measurement accuracy of the proposed computing strategy was investigated in this study. Both numerical experiments and real-world experiments have been conducted in order to verify the effectiveness of the proposed computing strategy. The results indicate that the bias error can be significantly reduced without sacrificing the standard deviation error. With the proposed computing strategy, high-accuracy DIC measurement with near-negligible bias error is expected.

Camera array-based digital image correlation for high-resolution strain measurement.

Digital image correlation (DIC) is a well-known technique for non-contact, non-destructive, full-field deformation measurement in experimental solid mechanics. Although DIC has been widely used in science and engineering, the resolution of strain measurement with DIC is limited by imaging resolution and is much lower than that obtained with a strain gauge. To achieve a breakthrough in strain measurement using DIC, a camera array-based DIC method is proposed herein for high-resolution strain measurement. Twenty-five industrial cameras were assembled into a plane array, with each camera capturing a part of the specimen. A novel calibration-based image stitching method is proposed and was applied to these images and their corresponding displacement fields. The strain field was then calculated based on the stitched displacement fields. The use of the camera array greatly improved the measurement spatial resolution of DIC and made high-resolution strain measurement possible. Both static error analysis and four point-bending experiments were performed to demonstrate the feasibility and effectiveness of the proposed method, and a full-field strain resolution of 10 µ ε was achieved.

Whole-field macro- and micro-deformation characteristic of unbound water-loss in dentin hard tissue.

High-resolution deformation measurements in a functionally graded hard tissue such as human dentin are essential to understand the unbound water-loss mediated changes and their role in its mechanical integrity. Yet a whole-field, 3-dimensional (3D) measurement and characterization of fully hydrated dentin in both macro- and micro-scales remain to be a challenge. This study was conducted in 2 stages. In stage-1, a stereo-digital image correlation approach was utilized to determine the water-loss and load-induced 3D deformations of teeth in a sagittal section over consecutively acquired frames, from a fully hydrated state to nonhydrated conditions for a period up to 2 hours. The macroscale analysis revealed concentrated residual deformations at the dentin-enamel-junction and the apical regions of root in the direction perpendicular to the dentinal tubules. Significant difference in the localized deformation characteristics was observed between the inner and outer aspects of the root dentin. During quasi-static loadings, further increase in the residual deformation was observed in the dentin. In stage-2, dentin microstructural variations induced by dynamic water-loss were assessed with environmental scanning electron microscopy and atomic force microscopy (AFM), showing that the dynamic water-loss induced distention of dentinal tubules with concave tubular edges, and concurrent contraction of intertubular dentin with convex profile. The findings from the current macro- and micro-scale analysis provided insight on the free-water-loss induced regional deformations and ultrastructural changes in human dentin.

Optimized digital speckle patterns for digital image correlation by consideration of both accuracy and efficiency.

The technique of digital image correlation (DIC), which has been widely used for noncontact deformation measurements in both the scientific and engineering fields, is greatly affected by the quality of speckle patterns in terms of its performance. This study was concerned with the optimization of the digital speckle pattern (DSP) for DIC in consideration of both the accuracy and efficiency. The root-mean-square error of the inverse compositional Gauss-Newton algorithm and the average number of iterations were used as quality metrics. Moreover, the influence of subset sizes and the noise level of images, which are the basic parameters in the quality assessment formulations, were also considered. The simulated binary speckle patterns were first compared with the Gaussian speckle patterns and captured DSPs. Both the single-radius and multi-radius DSPs were optimized. Experimental tests and analyses were conducted to obtain the optimized and recommended DSP. The vector diagram of the optimized speckle pattern was also uploaded as reference.

Shape measurement with modified phase-shift lateral shearing interferometry illumination and radial basis function.

Three-dimensional shapes of objects were evaluated with modified phase-shift lateral shearing interferometry illumination and radial basis function. A simple optical system was developed to create the fringe pattern based on the Murty interferometer. The phase shift was generated only by moving a plane-parallel plate along an in-plane parallel direction. A novel moving radial basis function method was presented to improve the quality of fringe patterns. And the proper calculation window size was given based on numerical simulation. Three-dimensional shapes of two kinds of objects were determined to verify the feasibility and effectiveness of the proposed method, and the reconstructed height distributions were in good accordance with the referenced data.

Noninvasive, three-dimensional full-field body sensor for surface deformation monitoring of human body in vivo.

Noninvasive, three-dimensional (3-D), full-field surface deformation measurements of the human body are important for biomedical investigations. We proposed a 3-D noninvasive, full-field body sensor based on stereo digital image correlation (stereo-DIC) for surface deformation monitoring of the human body in vivo. First, by applying an improved water-transfer printing (WTP) technique to transfer optimized speckle patterns onto the skin, the body sensor was conveniently and harmlessly fabricated directly onto the human body. Then, stereo-DIC was used to achieve 3-D noncontact and noninvasive surface deformation measurements. The accuracy and efficiency of the proposed body sensor were verified and discussed by considering different complexions. Moreover, the fabrication of speckle patterns on human skin, which has always been considered a challenging problem, was shown to be feasible, effective, and harmless as a result of the improved WTP technique. An application of the proposed stereo-DIC-based body sensor was demonstrated by measuring the pulse wave velocity of human carotid artery.

Extrinsic calibration of a non-overlapping camera network based on close-range photogrammetry.

In this paper, an extrinsic calibration method for a non-overlapping camera network is presented based on close-range photogrammetry. The method does not require calibration targets or the cameras to be moved. The visual sensors are relatively motionless and do not see the same area at the same time. The proposed method combines the multiple cameras using some arbitrarily distributed encoded targets. The calibration procedure consists of three steps: reconstructing the three-dimensional (3D) coordinates of the encoded targets using a hand-held digital camera, performing the intrinsic calibration of the camera network, and calibrating the extrinsic parameters of each camera with only one image. A series of experiments, including 3D reconstruction, rotation, and translation, are employed to validate the proposed approach. The results show that the relative error for the 3D reconstruction is smaller than 0.003%, the relative errors of both rotation and translation are less than 0.066%, and the re-projection error is only 0.09 pixels.