FibAR: Embedding Optical Fibers in 3D Printed Objects for Active Markers in Dynamic Projection Mapping.

This paper presents a novel active marker for dynamic projection mapping (PM) that emits a temporal blinking pattern of infrared (IR) light representing its ID. We used a multi-material three dimensional (3D) printer to fabricate a projection object with optical fibers that can guide IR light from LEDs attached on the bottom of the object. The aperture of an optical fiber is typically very small; thus, it is unnoticeable to human observers under projection and can be placed on a strongly curved part of a projection surface. In addition, the working range of our system can be larger than previous marker-based methods as the blinking patterns can theoretically be recognized by a camera placed at a wide range of distances from markers. We propose an automatic marker placement algorithm to spread multiple active markers over the surface of a projection object such that its pose can be robustly estimated using captured images from arbitrary directions. We also propose an optimization framework for determining the routes of the optical fibers in such a way that collisions of the fibers can be avoided while minimizing the loss of light intensity in the fibers. Through experiments conducted using three fabricated objects containing strongly curved surfaces, we confirmed that the proposed method can achieve accurate dynamic PMs in a significantly wide working range.

Color Photometric Stereo Using Multi-Band Camera Constrained by Median Filter and Occluding Boundary.

One of the main problems faced by the photometric stereo method is that several measurements are required, as this method needs illumination from light sources from different directions. A solution to this problem is the color photometric stereo method, which conducts one-shot measurements by simultaneously illuminating lights of different wavelengths. However, the classic color photometric stereo method only allows measurements of white objects, while a surface-normal estimation of a multicolored object using this method is theoretically impossible. Therefore, it is necessary to add some constraints to estimate the surface normal of a multicolored object using the framework of the color photometric stereo method. In this study, a median filter is employed as the constraint condition of albedo, and the surface normal of the occluding boundary is employed as the constraint condition of the surface normal. By employing a median filter as the constraint condition, the smooth distribution of the albedo and normal is calculated while the sharp features at the boundary of different albedos and normals are preserved. The surface normal at the occluding boundary is propagated into the inner part of the object region, and forms the abstract shape of the object. Such a surface normal gives a great clue to be used as an initial guess to the surface normal. To demonstrate the effectiveness of this study, a measurement device that can realize the multispectral photometric stereo method with seven colors is employed instead of the classic color photometric stereo method with three colors.

[Using Super Resolution to Denoise on PET Images].

A high-resolution display panel comes to practical use, but the resolution of the indicated contents does not change. The up-sampling processing is applied to indication of the low-resolution contents. In the up-sampling process, the super resolution enables an up-sampling process which estimates information of high frequency components lost by sampling while analyzing input images is noticed. In this paper, we aimed at reconstructing an image of normal resolution in which the influence of statistical noise is reduced by applying super resolution after down-sampling processing is applied to positron emission tomography (PET) image with many statistical noises. To evaluate the noise reduction effect, we compared it with the Gaussian filter which is frequently used to reduce the influence of the statistical noise of the PET image. A 3D Hoffman brain phantom was used to evaluate objectively by peak signal-to-noise ratio and power spectral density. The objective index of the PET image applying super resolution is positive results, suggesting the possibility of being useful as compared with the conventional method.

2-DOF auto-calibration for a 3D endoscope system based on active stereo.

For endoscopic medical treatment, measuring the size and shape of lesions, such as tumors, is important. We are developing a 3D endoscope system to measure the shape and size of living tissues based on active stereo. In previous works, our group attached a pattern projector outside the endoscope head. Since this increased the diameter of the endoscope, the burden and the risks of the patients would increase. In this paper, we set the pattern projector inside the instrument channel of the endoscope instead of mounting it outside, so that it can be deployed whenever required. This does not increase the size of the endoscope and facilitates the measuring process. However, since the projector is not physically fixed to the endoscope anymore prior to the operation, we propose an "auto-calibration" technique where extrinsic parameters are calibrated intra-operatively from a point marker on the projector observed simultaneously on the target surface. In the experiment, we show that the external parameters were successfully calibrated to obtain 3D reconstructions properly with the overall systems. The accuracy of the auto-calibration was validated by confirming that the epipolar constraints were kept, and a 3D reconstruction of a human tissue was demonstrated.

Calibration of a 3D endoscopic system based on active stereo method for shape measurement of biological tissues and specimen.

For endoscopic medical treatment, measuring the size and shape of the lesion, such as a tumor, is important for the improvement of diagnostic accuracy. We are developing a system to measure the shapes and sizes of living tissue by active stereo method using a normal endoscope on which a micro pattern projector is attached. In order to perform 3D reconstruction, estimating the intrinsic and extrinsic parameters of the endoscopic camera and the pattern projector is required. Particularly, calibration of the pattern projector is difficult. In this paper, we propose a simultaneous estimation method of both intrinsic and extrinsic parameters of the pattern projector. This simplifies the calibration procedure required in practical scenes. Furthermore, we have developed an efficient user interface to intuitively operate the calibration and reconstruction procedures. Using the developed system, we measured the shape of an internal tissue of the soft palate of a human and a biological specimen.

[Bilateral filter applied to bone scintigraphy].

The aim of this study is to improve the image quality using a post process rather than a correction process at acquisition time. We used a smoothing filter that is widely used on a compact digital camera. Especially for nuclear medicine, when we use a short acquisition time, we will get images that have a large increase in statistical noise. For those images, we validated the efficiency of the smoothing filter by assessing two characteristic parameters. In addition, we defined the best smoothing filter parameters to get stable images that reduced the influence of statistical noise.

Noncontact measurement of cardiac beat by using active stereo with waved-grid pattern projection.

We propose a method to observe cardiac beat from 3D shape information of body surface by using the active stereo with waved-grid pattern projection, and report preliminary experiments to evaluate validities of the proposed method. By comparing results of our method with those of electrocardiogram (ECG), we confirmed sufficient correspondences between peak intervals of depth changes between contiguous frames measured by the active stereo and R-R intervals measured by ECG. We proposed the visualization of the spatial distribution of depth change plotted on the 3D shape of chest surface. We confirm that the spatial phase difference, which is caused by heart pump ability, appears in the 3-D shape change of chest surface.

Proposal on 3-D endoscope by using grid-based active stereo.

In this paper, we propose a novel 3-D endoscope system by using grid-based active stereo. In the proposed system, projection of a waved-grid pattern that consists of vertical and horizontal sinusoidal lines realizes accurate shape acquisition in sub-pixel accuracy. We develop a small pattern projector implementable to a head of a ready-made endoscope, and examine 3-D shape reconstruction by actual equipment. As the result of the measurement for a known-shaped object, which is a hexagonal cylinder, the error of length measurement is below 0.9% and the error of angle measurement is below 2.2%. We make a measurement of animal organ meat, and confirm that the system can reconstruct a 3-D shape of the organ surface.

Basic study on non-contact measurement of cardiac beat by using grid-based active stereo.

We propose a new non-contact measurement of cardiac beat from 3D shape information of body surface by using grid-based active stereo, and basically examine the validity of the proposed method. By simultaneous measurement with our proposed method and ECG, there are sufficient correspondences between peak intervals of inter-frame depth changes measured by our method and R-R intervals measured by ECG.