Reconstruction of transparent objects using phase shifting profilometry based on diffusion models.

Phase shifting profilometry is an important technique for reconstructing the three-dimensional (3D) geometry of objects with purely diffuse surfaces. However, it is challenging to measure the transparent objects due to the pattern aliasing caused by light refraction and multiple reflections inside the object. In this work, we analyze the aliasing fringe pattern formation for transparent objects and then, propose to learn the front surface light intensity distribution based on the formation principle by using the diffusion models for generating the non-aliased fringe patterns reflected from the front surface only. With the generated fringe patterns, the 3D shape of the transparent objects can be reconstructed via the conventional structured light. We show the feasibility and performance of the proposed method on the data of purely transparent objects that are not seen in the training stage. Moreover, we found it could be generalized to other cases with local-transparent and translucent objects, showing the potential capability of the diffusion based learnable framework in tackling the problems of transparent object reconstruction.

Kinematic target surface sensing based on improved deep optical flow tracking.

Reconstruction of moving target surfaces based on active image sensing techniques, such as phase-shifting profilometry, has attracted intensive research in recent years. The measurement error caused by object motion can be addressed successfully by tracking the object movement. However, it either requires high-cost color imaging equipment or is limited by the assumption of 2D translation movement. Therefore, this paper proposes what we believe to be a new method to reconstruct the kinematic object surfaces with any 2D movement sensed by affordable monochrome camera. An improved RAFT optical flow algorithm is proposed to track the object based on the object fringe pattern image directly. The feature points on the object are retrieved immune to the fringe pattern illumination. Then, the RANSAC algorithm and an iteration selection process are employed to select feature points with high quality optical flow. At last, the motion is described mathematically, and the dynamic object is reconstructed successfully. Experiments are presented to verify the effectiveness of the proposed method.

Self-wrinkling coating for impact resistance and mechanical enhancement.

Protective materials are essential for personal, electronic, and military defenses owing to their efficient impact-resistant and energy-absorbing properties. Inspired by the bottom-up fabrication process and energy dissipation mechanism of natural organisms with hierarchical structures, we demonstrated a self-wrinkled photo-curing coating as a new protective material for enhancing the anti-impact property of the substrates. Owing to the self-assembly of polydimethylsiloxane (PDMS) containing polymeric photoinitiator on the surface, the liquid coating formulation was photo-cured by one-step UV irradiation with simultaneous generation of self-wrinkled surface morphology and a gradient cross-linked architecture. The maximum impact resistance height (hmax) of the glass substrate coated with plain coating increased from 120 to 180 cm when coated with wrinkled gradient coating. Furthermore, the Young's modulus, fracture stress, and toughness of the wrinkled gradient coating film improved from 39.6 MPa, 2.4 MPa, and 74.1 MJ/cm3 to 235.0 MPa (∼5× increase), 18.5 MPa (∼6.6× increase), and 845.0 MJ/cm3 (∼10.8× increase) compared to the pure coating film as reference. The theoretical simulation and experimental results proved that the surface self-wrinkled morphology and intrinsic hierarchical architecture contribute to the energy dissipation and impact resistance of the cured coating. The photo-curing process, a bottom-up strategy, is conducted in a non-contact mode compared with nano-printing and lithography, enabling bulk materials to be engineered.

Refractive three-dimensional reconstruction for underwater stereo digital image correlation.

Measuring the three-dimensional (3D) deformation of submerged objects through different media with the stereo digital image correlation (stereo-DIC) method involves the refractive optical imaging problem where the non-linear transmission of light is induced by a change of medium density. The problem invalidates the underlying single viewpoint assumption of the perspective model in regular stereo-DIC, thereby resulting in erroneous measurements of 3D shape and deformation. In this work, we propose a refractive stereo-DIC method that overcomes the problem by considering light refraction in 3D reconstruction. We formulate a full refractive reconstruction geometry description based on Snell's law of flat refraction and the regular triangulation. This allows the true shape to be effectively reconstructed by tracing and establishing the refracted ray-paths based on the regular 3D reconstruction, without reformulating the camera model and image formation. The refractive stereo-DIC is finally established by integrating the refractive 3D reconstruction into the regular DIC framework for measuring accurate 3D shape and deformation of submerged objects. We experiment the proposed approach with underwater 3D shape and deformation measurements. Both results prove its feasibility and correctness, further heralding our approach as a flexible solution that could readily extend the stereo-DIC to fluid-immersed 3D deformation characterization.

Light-Induced Programmable 2D Ordered Patterns Based on a Hyperbranched Poly(ether amine) (hPEA)-Functionalized Graphene Film.

Dynamic complex surface topography with ordered and tunable morphologies, which can provide on-demand control of surface properties to realize smart surfaces, is gaining much attention yet remains challenging in terms of fabrication. Here, a facile, robust, and controllable method is demonstrated to fabricate programmable two-dimensional (2D) ordered patterns with multiresponsive 2D ultrathin materials, comprised of anthracene-capped hyperbranched poly(ether amine) (hPEA-AN)-functionalized graphene (hPEA-AN@G). By combining the stimuli-responsiveness and UV sensitivity of hPEA-AN and excellent out-of-plane deformation and NIR-to-thermal conversion of graphene, the process of "writing/uploading" initial information is conducted through the initial exposure to 365 nm UV light to generate the 2D ordered pattern first; second, inducing swelling strain via moisture to create the hierarchical topographic pattern (orderly oriented pattern) is the process of "modification and erasable rewriting"; third, alternating NIR or 254 nm UV light blanket exposure are the two ways of erasing the information. Consequently, taking advantage of the multiresponsive dynamic wrinkling/ordered patterning, we can program globally 2D ordered surface patterns with diverse morphologies on demand and manipulate the resulted surface properties as desired.

Real-time matching strategy for rotary objects using digital image correlation.

Real-time monitoring of structural health conditions for rotary objects is of importance for safety assessments. In this work, an efficient algorithm based on digital image correlation is presented to achieve accurate rotational matching in real time. The proposed algorithm measures rotation in object motion with an integer pixel search followed by a subpixel correlation refinement. In the integer pixel search, the reference subset is rotated inversely to facilitate the correlation computation between the reference and target subsets. Then an independent and global integer pixel search for each point of interest is performed by applying the particle swarm optimization algorithm. Finally, a modified iterative registration algorithm is introduced to refine the displacement in the subpixel level by considering both the rotation angle and displacement components. Simulation and rotation experiments demonstrate that the proposed method achieves rapid and accurate measurements and is an effective method for retrieving the rotation data of rotating structures.

An Infrared Defect Sizing Method Based on Enhanced Phase Images.

Infrared thermography (IRT) is a full-field, contactless technique that has been widely used for nondestructive evaluation of structural materials due to many advantages. One of the major limitations of IRT is the fuzzy edge and low contrast in the inspected images-as well as the cost of the system. An efficient image post-processing with an affordable and portable device is of great interest to the engineering society. In this study, a convenient and economical inspection system using common halogen lamps was constructed. The corresponding image-processing scheme, which includes Fourier phase analysis and specific image enhancement was developed to identify defects with sharp and clear edges and good contrast. This system was applied to localized of defects in glass-fiber-reinforced composite panels. The results showed that defects with an effective diameter as small as 5 mm can be detected with excellent image quality. As a conclusion, the developed system provides an economic alternative to traditional infrared thermography which is able to identify defects with good qualities.

Geometry constrained correlation adjustment for stereo reconstruction in 3D optical deformation measurements.

Recovering the geometric shape of deformable objects from images is essential to optical three-dimensional (3D) deformation measurements and is also actively pursued by researchers. Most of the existing techniques retrieve the shape data with triangulation based on pre-estimated stereo correspondences. In this paper, we instead propose to recover depth information directly from images of a binocular vision system for 3D deformation estimation. Given a calibrated geometry of the system, the reprojection error is parameterized by the depth and then described with local intensity dissimilarity between a stereo pair in considering spatial deformation. Afterward, a correlation adjustment model is formulated to estimate the depth parameter by minimizing the error. As a solving strategy, we show the Gauss-Newton linearization of the proposed model and its initialization. 3D displacement estimation based on depth information is also presented. Experiments, including rigid translation and bending deformation measurements, are conducted to verify the performance of the proposed method. Results show that the proposed method is accurate yet precise in 3D deformation estimations. Other underlying developments are underway.

Multifunctional Polymer Sponge with Molecule Recognition: Facile Mechanic Induced Separation.

Polymer sponges with molecular recognition provide a facile approach to water purification and industrial separation with easy operation, but its fabrication is still challenging because some critical issues of selective adsorption, high mechanical strength, and easy collection/re-use are difficult to be achieved in one material. Here, inspired by natural sponges, novel multifunctional polymer sponges were developed which were fabricated by ice-templating with multifunctional amine polyethylenimine and diepoxide cross-linker poly(ethylene glycol) diglycidyl ether for highly efficient harvesting of dyes and simultaneous pure water recovery both in mechanic pressing and filtration processes. The as-prepared sponge (SP-1) was further modified by poly(caffeic acid) through a simple dipping-cross-linking process to obtain the hybrid polymer sponge (SP-2), which showed higher compressive strength than SP-1. These sponges possessed a cross-linked three-dimensional macroporous structure with quick water absorbing properties over ten times of their own weight within 20 s directed by capillary. The adsorption behavior of the obtained polymer sponges to 11 hydrophilic dyes was studied in detail by mechanic induced separation. All these polymer sponges exhibited a high selective adsorption to hydrophilic dyes in water. For example, SP-1 has high adsorption capacity over 150 µmol/g to erythrosin B, which is 20 times higher than that of calcein. With the modified poly(caffeic acid) layer, SP-2 exhibited different adsorption properties for methylene blue (180 µmol/g) to SP-1 (∼0 µmol/g), indicating that the tailorable structures of the sponge can regulate their selectivity to guest molecules. Based on the unique recognition to guest molecules, the methodology of dynamic separation of the dye's mixture in water was demonstrated by using these sponges through mechanical pressing or fast filtration, which provides a facile alternative with easy operation for water purification.

Ultralarge Nanosheets Fabricated by the Hierarchical Self-Assembly of Porphyrin-Ended Hyperbranched Poly (ether amine) (TPP-hPEA).

An ultralarge sheet with remarkable lateral dimensions of 10 µm × 10 µm-20 µm × 20 µm is fabricated by the hierarchical self-assembly of porphyrin-ended hyperbranched poly(ether amine) (tetraphenylporphyrin (TPP)-hPEA) in solution. The obtained TPP-hPEA amphiphiles can self-assemble from ultrathin single-layered nanosheets with a thickness of 4 nm to ultralarge multilayered nanosheets with thicknesses from 30 to 70 nm. The lateral dimensions increase from 2 × 2 µm to 5 × 5 µm, and eventually to 10 × 10 µm. In-situ dynamic light scattering and UV-vis spectroscopy studies suggest a hierarchical growth self-assembly mechanism with a self-assembly process that relies on π-π stacking. This 2D self-assembly method provides a significant potential guide for the preparation of ultralarge nanosheets in solution.

General model for phase shifting profilometry with an object in motion.

When implementing the phase shifting profilometry to reconstruct an object, the object is always required to be kept stable as multiple fringe patterns are required. Movement during the measurement will cause failed reconstruction. This paper proposes a general model describing the fringe patterns with any three-dimensional movement based on phase shifting profilometry. The object movement is classified as five types and their characteristics are analyzed respectively. Then, by introducing a virtual plane, the influence on the phase value caused by different types of movement is described mathematically and a new model including movement information is proposed. At last, with the help of the movement tracking and least-square algorithm, the moving object is reconstructed with high accuracy. The proposed method can remove the reference plane during the reconstruction of the moving object, which extends the application range of the phase shifting profilometry. The effectiveness of the proposed model is verified by the experiments.

Dynamic control of the location of nanoparticles in hybrid co-assemblies.

We herein demonstrated an approach to control the spatial distribution of components in hybrid microspheres. Hybrid core-shell structured microspheres (CSMs) prepared through co-assembly were used as starting materials, which are comprised of anthracene-ended hyperbranched poly(ether amine) (AN-hPEA) in the shell and crystallized anthracene containing polyhedral oligomer silsesquioxane (AN-POSS). Upon thermal annealing at a temperature higher than the melting point of AN-POSS, the diffusion of AN-POSS from the core to the shell of CSM leads to a transition of morphology from the core-shell structure to core-transition-shell to the more stable homogeneous morphology, which has been revealed by experimental results of TEM and DSC. The mechanism for the morphology transition of CSM induced by the diffusion of AN-POSS was disclosed by a dissipative particle dynamics (DPD) simulation. A mathematical model for the diffusion of POSS in the hybrid microsphere is established according to Fick's law of diffusion and can be used to quantify its distribution in CSM. Thus, the spatial distribution of POSS in the microsphere can be controlled dynamically by tuning the temperature and time of thermal annealing.