Influence of projector pixel shape on ultrahigh-resolution 3D shape measurement.

The state-of-art three-dimensional (3D) shape measurement with digital fringe projection (DFP) techniques assume that the influence of projector pixel shape is negligible. However, our research reveals that when the camera pixel size is much smaller than the projector pixel size in object space (e.g., 1/5), the shape of projector pixel can play a critical role on ultimate measurement quality. This paper evaluates the performance of two shapes of projector pixels: rectangular and diamond shaped. Both simulation and experimental results demonstrated that when the camera pixel size is significantly smaller than the projector pixel size, it is advantageous for ultrahigh resolution 3D shape measurement system to use a projector with rectangular-shaped pixels than a projector with diamond-shaped pixels.

High-speed and high-accuracy 3D surface measurement using a mechanical projector.

This paper presents a method to achieve high-speed and high-accuracy 3D surface measurement using a custom-designed mechanical projector and two high-speed cameras. We developed a computational framework that can achieve absolute shape measurement in sub-pixel accuracy through: 1) capturing precisely phase-shifted fringe patterns by synchronizing the cameras with the projector; 2) generating a rough disparity map between two cameras by employing a standard stereo-vision method using texture images with encoded statistical patterns; and 3) utilizing the wrapped phase as a constraint to refine the disparity map. The projector can project binary patterns at a speed of up to 10,000 Hz, and the camera can capture the required number of phase-shifted fringe patterns with 1/10,000 second, and thus 3D shape measurement can be realized as high as 10,000 Hz regardless the number of phase-shifted fringe patterns required for one 3D reconstruction. Experimental results demonstrated the success of our proposed method.

Pixel-wise absolute phase unwrapping using geometric constraints of structured light system.

This paper presents a method to unwrap phase pixel by pixel by solely using geometric constraints of the structured light system without requiring additional image acquisition or another camera. Specifically, an artificial absolute phase map, Φmin, at a given virtual depth plane z = zmin, is created from geometric constraints of the calibrated structured light system; the wrapped phase is pixel-by-pixel unwrapped by referring to Φmin. Since Φmin is defined in the projector space, the unwrapped phase obtained from this method is absolute for each pixel. Experimental results demonstrate the success of this proposed novel absolute phase unwrapping method.

Enhanced two-frequency phase-shifting method.

One of the major challenges of employing a two-frequency (or two-wavelength) phase-shifting algorithm for absolute three-dimensional shape measurement is its sensitivity to noise. Therefore, three- or more-frequency phase-shifting algorithms are often used in lieu of a two-frequency phase-shifting algorithm for applications where the noise is severe. This paper proposes a method to use geometric constraints of digital fringe projection system to substantially reduce the noise impact by allowing the use of more than one period of equivalent phase map for temporal phase unwrapping. Experiments successfully verified the enhanced performance of the proposed method without increasing the number of patterns.

Event fusion photometric stereo network.

Photometric stereo methods typically rely on RGB cameras and are usually performed in a dark room to avoid ambient illumination. Ambient illumination poses a great challenge in photometric stereo due to the restricted dynamic range of the RGB cameras. To address this limitation, we present a novel method, namely Event Fusion Photometric Stereo Network (EFPS-Net), which estimates the surface normals of an object in an ambient light environment by utilizing a deep fusion of RGB and event cameras. The high dynamic range of event cameras provides a broader perspective of light representations that RGB cameras cannot provide. Specifically, we propose an event interpolation method to obtain ample light information, which enables precise estimation of the surface normals of an object. By using RGB-event fused observation maps, our EFPS-Net outperforms previous state-of-the-art methods that depend only on RGB frames, resulting in a 7.94% reduction in mean average error. In addition, we curate a novel photometric stereo dataset by capturing objects with RGB and event cameras under numerous ambient light environments.

Portable high-resolution automated 3D imaging for footwear and tire impression capture.

The forensic science community raised the need for improved evidence recognition, collection, and visualization analytical instrumentation for field and laboratory use. While the 3D optical techniques for imaging static objects have been extensively studied, there is still a major gap between current knowledge and collecting high-quality footwear and tire impression evidence. Among optical means for 3D imaging, digital fringe projection (DFP) techniques reconstruct 3D shape from phase information, achieving camera-pixel spatial resolution. This paper presents a high-resolution 3D imaging technology using DFP techniques dedicated to footwear and tire impression capture. We developed fully automated software algorithms and a graphical user interface (GUI) that allow anyone without training to operate for high-quality 3D data capture. We performed accuracy evaluations and comparisons comparing with the commercial high-end 3D scanner and carried out qualitative tests for various impressions comparing with the current practices. Overall, our technology achieves similar levels of accuracy and resolution with a high-end commercially available 3D scanner, while having the merits of being (1) more affordable; (2) much easier to operate; and (3) more robust. Compared with the current practice of casting, our technology demonstrates its superiority because it (1) is non-destructive; (2) collects more evidence detail than casts, especially when an impression is fragile; (3) requires less time and money to collect each piece of evidence; and (4) results in a digital file that can easily be shared with other examiners.