Specular Detection on Glossy Surface Using Geometric Characteristics of Specularity in Top-View Images.

In an autonomous driving assistance system (ADAS), top views effectively represent objects around the vehicle on a 2D plane. Top-view images are therefore widely used to detect lines in ADAS applications such as lane-keeping assistance and parking assistance. Because line detection is a crucial step for these applications, the false positive detection of lines can lead to failure of the system. Specular reflections from a glossy surface are often the cause of false positives, and since certain specular patterns resemble actual lines in the top-view image, their presence induces false positive lines. Incorrect positions of the lines or parking stalls can thus be obtained. To alleviate this problem, we propose two methods to estimate specular pixels in the top-view image. The methods use a geometric property of the specular region: the shape of the specular region is stretched long in the direction of the camera as the distance between the camera and the light source becomes distant, resulting in a straight line. This property can be used to distinguish the specular region in images. One estimates the pixel-wise probability of the specularity using gradient vectors obtained from an edge detector and the other estimates specularity using the line equation of each line segment obtained by line detection. To evaluate the performance of the proposed method, we added our methods as a pre-processing step to existing parking stall detection methods and investigated changes in their performance. The proposed methods improved line detection performance by accurately estimating specular components in the top-view images.

Differential processing of binocular and monocular gloss cues in human visual cortex.

The visual impression of an object's surface reflectance ("gloss") relies on a range of visual cues, both monocular and binocular. Whereas previous imaging work has identified processing within ventral visual areas as important for monocular cues, little is known about cortical areas involved in processing binocular cues. Here, we used human functional MRI (fMRI) to test for brain areas selectively involved in the processing of binocular cues. We manipulated stereoscopic information to create four conditions that differed in their disparity structure and in the impression of surface gloss that they evoked. We performed multivoxel pattern analysis to find areas whose fMRI responses allow classes of stimuli to be distinguished based on their depth structure vs. material appearance. We show that higher dorsal areas play a role in processing binocular gloss information, in addition to known ventral areas involved in material processing, with ventral area lateral occipital responding to both object shape and surface material properties. Moreover, we tested for similarities between the representation of gloss from binocular cues and monocular cues. Specifically, we tested for transfer in the decoding performance of an algorithm trained on glossy vs. matte objects defined by either binocular or by monocular cues. We found transfer effects from monocular to binocular cues in dorsal visual area V3B/kinetic occipital (KO), suggesting a shared representation of the two cues in this area. These results indicate the involvement of mid- to high-level visual circuitry in the estimation of surface material properties, with V3B/KO potentially playing a role in integrating monocular and binocular cues.

'Proto-rivalry': how the binocular brain identifies gloss.

Visually identifying glossy surfaces can be crucial for survival (e.g. ice patches on a road), yet estimating gloss is computationally challenging for both human and machine vision. Here, we demonstrate that human gloss perception exploits some surprisingly simple binocular fusion signals, which are likely available early in the visual cortex. In particular, we show that the unusual disparity gradients and vertical offsets produced by reflections create distinctive 'proto-rivalrous' (barely fusible) image regions that are a critical indicator of gloss. We find that manipulating the gradients and vertical components of binocular disparities yields predictable changes in material appearance. Removing or occluding proto-rivalrous signals makes surfaces look matte, while artificially adding such signals to images makes them appear glossy. This suggests that the human visual system has internalized the idiosyncratic binocular fusion characteristics of glossy surfaces, providing a straightforward means of estimating surface attributes using low-level image signals.

Key characteristics of specular stereo.

Because specular reflection is view-dependent, shiny surfaces behave radically differently from matte, textured surfaces when viewed with two eyes. As a result, specular reflections pose substantial problems for binocular stereopsis. Here we use a combination of computer graphics and geometrical analysis to characterize the key respects in which specular stereo differs from standard stereo, to identify how and why the human visual system fails to reconstruct depths correctly from specular reflections. We describe rendering of stereoscopic images of specular surfaces in which the disparity information can be varied parametrically and independently of monocular appearance. Using the generated surfaces and images, we explain how stereo correspondence can be established with known and unknown surface geometry. We show that even with known geometry, stereo matching for specular surfaces is nontrivial because points in one eye may have zero, one, or multiple matches in the other eye. Matching features typically yield skew (nonintersecting) rays, leading to substantial ortho-epipolar components to the disparities, which makes deriving depth values from matches nontrivial. We suggest that the human visual system may base its depth estimates solely on the epipolar components of disparities while treating the ortho-epipolar components as a measure of the underlying reliability of the disparity signals. Reconstructing virtual surfaces according to these principles reveals that they are piece-wise smooth with very large discontinuities close to inflection points on the physical surface. Together, these distinctive characteristics lead to cues that the visual system could use to diagnose specular reflections from binocular information.

Synchronising a stereoscopic surgical video stream using specular reflection.

PURPOSE: A stereoscopic surgical video stream consists of left-right image pairs provided by a stereo endoscope. While the surgical display shows these image pairs synchronised, most capture cards cause de-synchronisation. This means that the paired left and right images may not correspond once used in downstream tasks such as stereo depth computation. The stereo synchronisation problem is to recover the corresponding left-right images. This is particularly challenging in the surgical setting, owing to the moist tissues, rapid camera motion, quasi-staticity and real-time processing requirement. Existing methods exploit image cues from the diffuse reflection component and are defeated by the above challenges. METHODS: We propose to exploit the specular reflection. Specifically, we propose a powerful left-right comparison score (LRCS) using the specular highlights commonly occurring on moist tissues. We detect the highlights using a neural network, characterise them with invariant descriptors, match them, and use the number of matches to form the proposed LRCS. We perform evaluation against 147 existing LRCS in 44 challenging robotic partial nephrectomy and robotic-assisted hepatic resection video sequences with simulated and real de-synchronisation. RESULTS: The proposed LRCS outperforms, with an average and maximum offsets of 0.055 and 1 frames and 94.1±3.6% successfully synchronised frames. In contrast, the best existing LRCS achieves an average and maximum offsets of 0.3 and 3 frames and 81.2±6.4% successfully synchronised frames. CONCLUSION: The use of specular reflection brings a tremendous boost to the real-time surgical stereo synchronisation problem.

On the physics of ultrasound transmission for in-plane needle tracking in guided interventions.

Objective.In ultrasound (US) guided interventions, the accurate visualization and tracking of needles is a critical challenge, particularly during in-plane insertions. An inaccurate identification and localization of needles lead to severe inadvertent complications and increased procedure times. This is due to the inherent specular reflections from the needle with directivity depending on the angle of incidence of the US beam, and the needle inclination.Approach.Though several methods have been proposed for improved needle visualization, a detailed study emphasizing the physics of specular reflections resulting from the interaction of transmitted US beam with the needle remains to be explored. In this work, we discuss the properties of specular reflections from planar and spherical wave US transmissions respectively through multi-angle plane wave (PW) and synthetic transmit aperture (STA) techniques for in-plane needle insertion angles between 15°-50°.Main Results.The qualitative and quantitative results from simulations and experiments reveal that the spherical waves enable better visualization and characterization of needles than planar wavefronts. The needle visibility in PW transmissions is severely degraded by the receive aperture weighting during image reconstruction than STA due to greater deviation in reflection directivity. It is also observed that the spherical wave characteristics starts to alter to planar characteristics due to wave divergence at large needle insertion depths.Significance.The study highlights that synergistic transmit-receive imaging schemes addressing the physical properties of reflections from the transmit wavefronts are imperative for the precise imaging of needle interfaces and hence have strong potential in elevating the quality of outcomes from US guided interventional practices.

Elliptical specularity detection in endoscopy with application to normal reconstruction.

PURPOSE: To detect specularities as elliptical blobs in endoscopy. The rationale is that in the endoscopic setting, specularities are generally small and that knowing the ellipse coefficients allows one to reconstruct the surface normal. In contrast, previous works detect specular masks as free-form shapes and consider the specular pixels as nuisance. METHODS: A pipeline combining deep learning with handcrafted steps for specularity detection. This pipeline is general and accurate in the context of endoscopic applications involving multiple organs and moist tissues. A fully convolutional network produces an initial mask which specifically finds specular pixels, being mainly composed of sparsely distributed blobs. Standard ellipse fitting follows for local segmentation refinement in order to only keep the blobs fulfilling the conditions for successful normal reconstruction. RESULTS: Convincing results in detection and reconstruction on synthetic and real images, showing that the elliptical shape prior improves the detection itself in both colonoscopy and kidney laparoscopy. The pipeline achieved a mean Dice of 84% and 87% respectively in test data for these two use cases, and allows one to exploit the specularities as useful information for inferring sparse surface geometry. The reconstructed normals are in good quantitative agreement with external learning-based depth reconstruction methods manifested, as shown by an average angular discrepancy of [Formula: see text] in colonoscopy. CONCLUSION: First fully automatic method to exploit specularities in endoscopic 3D reconstruction. Because the design of current reconstruction methods can vary considerably for different applications, our elliptical specularity detection could be of potential interest in clinical practice thanks to its simplicity and generalisability. In particular, the obtained results are promising towards future integration with learning-based depth inference and SfM methods.

Calculation of Spectral Optical Constants Using Combined Ellipsometric and Reflectance Methods for Smooth and Rough Bulk Samples.

Spectra of the optical constants n and k of a substance are often deduced from spectroscopic measurements, performed on a thick and homogeneous sample, and from a model used to simulate these measurements. Spectra obtained for n and k using the ellipsometric method generally produce polarized reflectance simulations in strong agreement with the experimental measurements, but they sometimes introduce significant discrepancies over limited spectral ranges, whereas spectra of n and k obtained with the single-angle reflectance method require a perfectly smooth sample surface to be viable. This paper presents an alternative method to calculate n and k. The method exploits both ellipsometric measurements and s-polarized specular reflectance measurements, and compensates for potential surface scattering effects with the introduction of a specularity factor. It is applicable to bulk samples having either a smooth or a rough surface. It provides spectral optical constants that are consistent with s-polarized reflectance measurements. Demonstrations are performed in the infrared region using a glass slide (smooth surface) and a pellet of compressed ammonium sulfate powder (rough surface).

Computational Model for Human 3D Shape Perception From a Single Specular Image.

In natural conditions the human visual system can estimate the 3D shape of specular objects even from a single image. Although previous studies suggested that the orientation field plays a key role for 3D shape perception from specular reflections, its computational plausibility, and possible mechanisms have not been investigated. In this study, to complement the orientation field information, we first add prior knowledge that objects are illuminated from above and utilize the vertical polarity of the intensity gradient. Then we construct an algorithm that incorporates these two image cues to estimate 3D shapes from a single specular image. We evaluated the algorithm with glossy and mirrored surfaces and found that 3D shapes can be recovered with a high correlation coefficient of around 0.8 with true surface shapes. Moreover, under a specific condition, the algorithm's errors resembled those made by human observers. These findings show that the combination of the orientation field and the vertical polarity of the intensity gradient is computationally sufficient and probably reproduces essential representations used in human shape perception from specular reflections.

Glottal Gap tracking by a continuous background modeling using inpainting.

The visual examination of the vibration patterns of the vocal folds is an essential method to understand the phonation process and diagnose voice disorders. However, a detailed analysis of the phonation based on this technique requires a manual or a semi-automatic segmentation of the glottal area, which is difficult and time consuming. The present work presents a cuasi-automatic framework to accurately segment the glottal area introducing several techniques not explored before in the state of the art. The method takes advantage of the possibility of a minimal user intervention for those cases where the automatic computation fails. The presented method shows a reliable delimitation of the glottal gap, achieving an average improvement of 13 and 18% with respect to two other approaches found in the literature, while reducing the error of wrong detection of total closure instants. Additionally, the results suggest that the set of validation guidelines proposed can be used to standardize the criteria of accuracy and efficiency of the segmentation algorithms.

Lifetime of high-order thickness resonances of thin silicon membranes.

Femtosecond laser pulses are used to excite and probe high-order longitudinal thickness resonances at a frequency of ∼270 GHz in suspended Si membranes with thickness ranging from 0.4 to 15 µm. The measured acoustic lifetime scales linearly with the membrane thickness and is shown to be controlled by the surface specularity which correlates with roughness characterized by atomic force microscopy. Observed Q-factor values up to 2400 at room temperature result from the existence of a local maximum of the material Q in the sub-THz range. However, surface specularity would need to be improved over measured values of ∼0.5 in order to achieve high Q values in nanoscale devices. The results support the validity of the diffuse boundary scattering model in analyzing thermal transport in thin Si membranes.

Regeneration in youngBunodactis verrucosa Pennant (actinaria, anthozoa).

YoungBunodactis verrucosa Pennant at the 12 tentacle stage are employed to test the applicability of the polar coordinate model to coelenterate regeneration. The animals are cut along every radius into fragments of 3 to 9 segments. Most fragments are patent 3-4 weeks later, but small fragments have a higher mortality rate than large fragments. Some fragments do not regenerate and occasionally tentacles fuse, thereby reducing the number of segments. Small fragments tend to regenerate more tentacies than large fragments, but large fragments may regenerate great numbers of supernumerary tentacles. Twenty-two percent of the fragments restore the missing number of tentacles, while 76% of all fragments produce an even number of tentacles.Fragments restoring the correct numbers of tentacles show a marked tendency to form the correct tentacles (regulative regeneration). Fragments regenerating two less than the number of tentacles already present show a marked tendency to reproduce tentacles of the types already present (miror image formation). Other fragments produce missing segments (forward regeneration), or those already present (reverse regeneration) at lower frequencies.No fragments beginning or ending with the number 1 directive tentacle fail to regenerate entirely, while first cycle segments maximally remote from segment 1 are associated with the absence of regeneration. No fragments beginning or ending with the number 4 directive tentacle fail to undergo forward regeneration, regulate or produce a mirror image when the appropriate number of segments are regenerated. In contrast, segment 4 is associated with a low frequency of reverse regeneration, and second cycle segments cut away from immediate contact with segment 4 show an increase in the frequency of reverse regeneration. Controls through morphogenic substances rather than polar coordinates seem to explain these results. Such substances would control the number and direction of tentacle regeneration.

Fi(ful)gurações do espelho em literatura e psicanálise / Fi(ful)guraciones del espejo en literatura y psicoanálisis / Fi(ful)gurations of the mirror in literature and psychoanalysis

O autor examina dois contos que compartilham o mesmo título, O espelho, e possuem autorias diversas. Eles foram escritos em épocas diferentes por Machado de Assis e por Guimarães Rosa. Considerando as dessemelhanças estilísticas de ambos, o autor propõe uma análise crítica psicanalítica orientada a partir de duas perspectivas diferentes - eventualmente suplementares - da noção de especularidade em psicanálise, as de Donald Winnicott e Jacques Lacan.(AU)

El autor examina dos cuentos que comparten el mismo título, El espejo, y poseen diferentes paternidades literarias. Estos fueron escritos en momentos distintos por Machado de Assis y Guimarães Rosa. Considerando sus desigualdades estilísticas, el autor propone un análisis crítico psicoanalítico orientado por dos perspectivas diferentes – eventualmente suplementarias - de la noción de la especularidad en el psicoanálisis, la de Donald Winnicott y la de Jacques Lacan.(AU)

The author examines two short stories that share the same title, The mirror, and possess several authorships. They were written at different times by Machado de Assis and Guimarães Rosa. Considering their stylistic dissimilarities, the author proposes a guided psychoanalytic critical analysis starting from two different perspectives - eventually supplemental - of the especularity notion in psychoanalysis, the ones of Donald Winnicott and Jacques Lacan.(AU)