Relaxation-Based Radiometric Normalization for Multitemporal Cross-Sensor Satellite Images.

Multitemporal cross-sensor imagery is fundamental for the monitoring of the Earth's surface over time. However, these data often lack visual consistency because of variations in the atmospheric and surface conditions, making it challenging to compare and analyze images. Various image-normalization methods have been proposed to address this issue, such as histogram matching and linear regression using iteratively reweighted multivariate alteration detection (IR-MAD). However, these methods have limitations in their ability to maintain important features and their requirement of reference images, which may not be available or may not adequately represent the target images. To overcome these limitations, a relaxation-based algorithm for satellite-image normalization is proposed. The algorithm iteratively adjusts the radiometric values of images by updating the normalization parameters (slope (α) and intercept (ß)) until a desired level of consistency is reached. This method was tested on multitemporal cross-sensor-image datasets and showed significant improvements in radiometric consistency compared to other methods. The proposed relaxation algorithm outperformed IR-MAD and the original images in reducing radiometric inconsistencies, maintaining important features, and improving the accuracy (MAE = 2.3; RMSE = 2.8) and consistency of the surface-reflectance values (R2 = 87.56%; Euclidean distance = 2.11; spectral angle mapper = 12.60).

Dual Guided Aggregation Network for Stereo Image Matching.

Stereo image dense matching, which plays a key role in 3D reconstruction, remains a challenging task in photogrammetry and computer vision. In addition to block-based matching, recent studies based on artificial neural networks have achieved great progress in stereo matching by using deep convolutional networks. This study proposes a novel network called a dual guided aggregation network (Dual-GANet), which utilizes both left-to-right and right-to-left image matchings in network design and training to reduce the possibility of pixel mismatch. Flipped training with a cost volume consistentization is introduced to realize the learning of invisible-to-visible pixel matching and left−right consistency matching. In addition, suppressed multi-regression is proposed, which suppresses unrelated information before regression and selects multiple peaks from a disparity probability distribution. The proposed dual network with the left−right consistent matching scheme can be applied to most stereo matching models. To estimate the performance, GANet, which is designed based on semi-global matching, was selected as the backbone with extensions and modifications on guided aggregation, disparity regression, and loss function. Experimental results on the SceneFlow and KITTI2015 datasets demonstrate the superiority of the Dual-GANet compared to related models in terms of average end-point-error (EPE) and pixel error rate (ER). The Dual-GANet with an average EPE performance = 0.418 and ER (>1 pixel) = 5.81% for SceneFlow and average EPE = 0.589 and ER (>3 pixels) = 1.76% for KITTI2005 is better than the backbone model with the average EPE performance of = 0.440 and ER (>1 pixel) = 6.56% for SceneFlow and average EPE = 0.790 and ER (>3 pixels) = 2.32% for KITTI2005.

Spectral and spatial kernel water quality mapping.

An empirical approach through remote sensing generally produces a robust data model of water quality for inland and coastal water. Traditional regressions in water quality mapping fail because the bio-optical relationship of turbid water exhibits nonlinear and heterogeneous patterns. In addition, in situ data are generally insufficient in the water quality mapping. Mapping based on a relatively small amount of water quality samples is considered a practical issue in environmental monitoring. Learning-based algorithms that require a large amount of data are inapplicable in this case. According to the concept of Nadaraya-Watson estimator, the kernel model can estimate nonlinear and spatially varying water quality maps effectively in turbid water.Experiments indicate that the kernel estimator provides better goodness-of-fit between the observed and derived concentrations of water quality parameter, e.g., chlorophyll-a in turbid water. The kernel estimator is feasible for a relatively small size of ground observations. Approximately 30% improvement of cross-validation error was identified in this approach when compared with traditional regressions. The model offers a robust approach without further calibrations for estimating the spatial patterns of water quality by using remote sensing reflectance and a small set of observations, considering spatial and spectral information, e.g., multiple bands and band ratios.

Spatial integration framework of solar, wind, and hydropower energy potential in Southeast Asia.

Amid its massive increase in energy demand, Southeast Asia has pledged to increase its use of renewable energy by up to 23% by 2025. Geospatial technology approaches that integrate statistical data, spatial models, earth observation satellite data, and climate modeling can be used to conduct strategic analyses for understanding the potential and efficiency of renewable energy development. This study aims to create the first spatial model of its kind in Southeast Asia to develop multi-renewable energy from solar, wind, and hydropower, further broken down into residential and agricultural areas. The novelty of this study is the development of a new priority model for renewable energy development resulting from the integration of area suitability analysis and the estimation of the amount of potential energy. Areas with high potential power estimations for the combination of the three types of energy are mostly located in northern Southeast Asia. Areas close to the equator, have a lower potential than the northern countries, except for southern regions. Solar photovoltaic (PV) plant construction is the most area-intensive type of energy generation among the considered energy sources, requiring 143,901,600 ha (61.71%), followed by wind (39,618,300 ha; 16.98%); a combination of solar PV and wind (37,302,500 ha; 16%); hydro (7,665,200 ha; 3.28%); a combination of hydro and solar PV (3,792,500 ha; 1.62%); and a combination of hydro and wind (582,700 ha; 0.25%). This study is timely and important because it will inform policies and regional strategies for transitioning to renewable energy, with consideration of the different characteristics present in Southeast Asia.

Spectral narrowing and manipulation in an optical parametric oscillator using periodically poled lithium niobate electro-optic polarization-mode converters.

We report a unique spectral narrowing and manipulation technique in an optical parametric oscillator (OPO) realized by an integrated periodically poled lithium niobate comprising an optical parametric gain medium sandwiched by two electro-optic polarization-mode converters (EO PMCs). We achieved a manipulation of the gain spectrum of the OPO via EO and/or temperature control of the EO PMCs, in which we obtained single to multiple signal spectral peaks from the OPO with a spectral width reduced by up to 10 times and peak intensity increased by up to 6 times in comparison with the original signal. Fast EO tuning of the narrowed signal spectral peak has also been demonstrated.

A high capacity 3D steganography algorithm.

In this paper, we present a very high-capacity and low-distortion 3D steganography scheme. Our steganography approach is based on a novel multilayered embedding scheme to hide secret messages in the vertices of 3D polygon models. Experimental results show that the cover model distortion is very small as the number of hiding layers ranges from 7 to 13 layers. To the best of our knowledge, this novel approach can provide much higher hiding capacity than other state-of-the-art approaches, while obeying the low distortion and security basic requirements for steganography on 3D models.

Spectral Feature Selection Optimization for Water Quality Estimation.

The spatial heterogeneity and nonlinearity exhibited by bio-optical relationships in turbid inland waters complicate the retrieval of chlorophyll-a (Chl-a) concentration from multispectral satellite images. Most studies achieved satisfactory Chl-a estimation and focused solely on the spectral regions from near-infrared (NIR) to red spectral bands. However, the optical complexity of turbid waters may vary with locations and seasons, which renders the selection of spectral bands challenging. Accordingly, this study proposes an optimization process utilizing available spectral models to achieve optimal Chl-a retrieval. The method begins with the generation of a set of feature candidates, followed by candidate selection and optimization. Each candidate links to a Chl-a estimation model, including two-band, three-band, and normalized different chlorophyll index models. Moreover, a set of selected candidates using available spectral bands implies an optimal composition of estimation models, which results in an optimal Chl-a estimation. Remote sensing images and in situ Chl-a measurements in Lake Kasumigaura, Japan, are analyzed quantitatively and qualitatively to evaluate the proposed method. Results indicate that the model outperforms related Chl-a estimation models. The root-mean-squared errors of the Chl-a concentration obtained by the resulting model (OptiM-3) improve from 11.95 mg · m - 3 to 6.37 mg · m - 3 , and the Pearson's correlation coefficients between the predicted and in situ Chl- a improve from 0.56 to 0.89.

Generation of Escher Arts with Dual Perception.

Escher transmutation is a graphic art that smoothly transforms one tile pattern into another tile pattern with dual perception. A classic example is the artwork called Sky and Water, in which a compelling figure-ground arrangement is applied to portray the transmutation of a bird in sky and a fish in water. The shape of a bird is progressively deformed and dissolves into the background while the background gradually reveals the shape of a fish. This paper introduces a system to create a variety of Escher-like transmutations, which includes the algorithms for initializing a tile pattern with dual figure-ground arrangement, for searching for the best matched shape of a user-specified motif from a database, and for transforming the content and shapes of tile patterns using a content-aware warping technique. The proposed system, integrating the graphic techniques of tile initialization, shape matching, and shape warping, allows users to create various Escher-like transmutations with minimal user interaction. Experimental results and conducted user studies demonstrate the feasibility and flexibility of the proposed system in Escher art generation.

A remote data access architecture for home-monitoring health-care applications.

With the aging of the population and the increasing patient preference for receiving care in their own homes, remote home care is one of the fastest growing areas of health care in Taiwan and many other countries. Many remote home-monitoring applications have been developed and implemented to enable both formal and informal caregivers to have remote access to patient data so that they can respond instantly to any abnormalities of in-home patients. The aim of this technology is to give both patients and relatives better control of the health care, reduce the burden on informal caregivers and reduce visits to hospitals and thus result in a better quality of life for both the patient and his/her family. To facilitate their widespread adoption, remote home-monitoring systems take advantage of the low-cost features and popularity of the Internet and PCs, but are inherently exposed to several security risks, such as virus and denial-of-service (DoS) attacks. These security threats exist as long as the in-home PC is directly accessible by remote-monitoring users over the Internet. The purpose of the study reported in this paper was to improve the security of such systems, with the proposed architecture aimed at increasing the system availability and confidentiality of patient information. A broker server is introduced between the remote-monitoring devices and the in-home PCs. This topology removes direct access to the in-home PC, and a firewall can be configured to deny all inbound connections while the remote home-monitoring application is operating. This architecture helps to transfer the security risks from the in-home PC to the managed broker server, on which more advanced security measures can be implemented. The pros and cons of this novel architecture design are also discussed and summarized.

Metamorphosis of 3D polyhedral models using progressive connectivity transformations.

Three-dimensional metamorphosis is a powerful technique to produce a 3D shape transformation between two or more existing models. In this paper, we propose a novel 3D morphing technique that avoids creating a merged embedding that contains the faces, edges, and vertices of two given embeddings. This novel 3D morphing technique dynamically adds or removes vertices to gradually transform the connectivity of 3D polyhedrons from a source model into a target model and simultaneously creates the intermediate shapes. In addition, a priority control function provides the animators with control of arising or dissolving of input models' features in a morphing sequence. This is a useful tool to control a morphing sequence more easily and flexibly. Several examples of aesthetically pleasing morphs are demonstrated using the proposed method.

Morphable Word Clouds for Time-Varying Text Data Visualization.

A word cloud is a visual representation of a collection of text documents that uses various font sizes, colors, and spaces to arrange and depict significant words. The majority of previous studies on time-varying word clouds focuses on layout optimization and temporal trend visualization. However, they do not fully consider the spatial shapes and temporal motions of word clouds, which are important factors for attracting people's attention and are also important cues for human visual systems in capturing information from time-varying text data. This paper presents a novel method that uses rigid body dynamics to arrange multi-temporal word-tags in a specific shape sequence under various constraints. Each word-tag is regarded as a rigid body in dynamics. With the aid of geometric, aesthetic, and temporal coherence constraints, the proposed method can generate a temporally morphable word cloud that not only arranges word-tags in their corresponding shapes but also smoothly transforms the shapes of word clouds over time, thus yielding a pleasing time-varying visualization. Using the proposed frame-by-frame and morphable word clouds, people can observe the overall story of a time-varying text data from the shape transition, and people can also observe the details from the word clouds in frames. Experimental results on various data demonstrate the feasibility and flexibility of the proposed method in morphable word cloud generation. In addition, an application that uses the proposed word clouds in a simulated exhibition demonstrates the usefulness of the proposed method.

Feature-guided shape-based image interpolation.

A feature-guided image interpolation scheme is presented. It is an effective and improved, shape-based interpolation method used for interpolating image slices in medical applications. The proposed method integrates feature line-segments to guide the shape-based method for better shape interpolation. An automatic method for finding these line segments is given. The proposed feature-guided shape-based method can manage translation, rotation and scaling situations when the slices have similar shapes. It can also interpolate intermediate shapes when the successive slices do not have similar shapes. This method is experimentally evaluated using artificial and real two-dimensional and three-dimensional data. The proposed method generated satisfactory interpolated results in these experiments. We demonstrate the practicality, effectiveness and reproducibility of the proposed method for interpolating medical images.

Drawing Road Networks with Mental Maps.

Tourist and destination maps are thematic maps designed to represent specific themes in maps. The road network topologies in these maps are generally more important than the geometric accuracy of roads. A road network warping method is proposed to facilitate map generation and improve theme representation in maps. The basic idea is deforming a road network to meet a user-specified mental map while an optimization process is performed to propagate distortions originating from road network warping. To generate a map, the proposed method includes algorithms for estimating road significance and for deforming a road network according to various geometric and aesthetic constraints. The proposed method can produce an iconic mark of a theme from a road network and meet a user-specified mental map. Therefore, the resulting map can serve as a tourist or destination map that not only provides visual aids for route planning and navigation tasks, but also visually emphasizes the presentation of a theme in a map for the purpose of advertising. In the experiments, the demonstrations of map generations show that our method enables map generation systems to generate deformed tourist and destination maps efficiently.

Double-Sided 2.5D Graphics.

This paper introduces double-sided 2.5D graphics, aiming at enriching the visual appearance when manipulating conventional 2D graphical objects in 2.5D worlds. By attaching a back texture image on a single-sided 2D graphical object, we can enrich the surface and texture detail on 2D graphical objects and improve our visual experience when manipulating and animating them. A family of novel operations on 2.5D graphics, including rolling, twisting, and folding, are proposed in this work, allowing users to efficiently create compelling 2.5D visual effects. Very little effort is needed from the user's side. In our experiment, various creative designs on double-sided graphics were worked out by the recruited participants including a professional artist, which show and demonstrate the feasibility and applicability of our proposed method.

Content-aware video retargeting using object-preserving warping.

A novel content-aware warping approach is introduced for video retargeting. The key to this technique is adapting videos to fit displays with various aspect ratios and sizes while preserving both visually salient content and temporal coherence. Most previous studies solve this spatiotemporal problem by consistently resizing content in frames. This strategy significantly improves the retargeting results, but does not fully consider object preservation, sometimes causing apparent distortions on visually salient objects. We propose an object-preserving warping scheme with object-based significance estimation to reduce this unpleasant distortion. In the proposed scheme, visually salient objects in 3D space-time space are forced to undergo as-rigid-as-possible warping, while low-significance contents are warped as close as possible to linear rescaling. These strategies enable our method to consistently preserve both the spatial shapes and temporal motions of visually salient objects and avoid overdeformations on low-significance objects, yielding a pleasing motion-aware video retargeting. Qualitative and quantitative analyses, including a user study and experiments on complex videos containing diverse cameras and dynamic motions, show a clear superiority of our method over related video retargeting methods.

Human motion retrieval from hand-drawn sketch.

The rapid growth of motion capture data increases the importance of motion retrieval. The majority of the existing motion retrieval approaches are based on a labor-intensive step in which the user browses and selects a desired query motion clip from the large motion clip database. In this work, a novel sketching interface for defining the query is presented. This simple approach allows users to define the required motion by sketching several motion strokes over a drawn character, which requires less effort and extends the users' expressiveness. To support the real-time interface, a specialized encoding of the motions and the hand-drawn query is required. Here, we introduce a novel hierarchical encoding scheme based on a set of orthonormal spherical harmonic (SH) basis functions, which provides a compact representation, and avoids the CPU/processing intensive stage of temporal alignment used by previous solutions. Experimental results show that the proposed approach can well retrieve the motions, and is capable of retrieve logically and numerically similar motions, which is superior to previous approaches. The user study shows that the proposed system can be a useful tool to input motion query if the users are familiar with it. Finally, an application of generating a 3D animation from a hand-drawn comics strip is demonstrated.

Template-based 3D model fitting using dual-domain relaxation.

We introduce a template fitting method for 3D surface meshes. A given template mesh is deformed to closely approximate the input 3D geometry. The connectivity of the deformed template model is automatically adjusted to facilitate the geometric fitting and to ascertain high quality of the mesh elements. The template fitting process utilizes a specially tailored Laplacian processing framework, where in the first, coarse fitting stage we approximate the input geometry with a linearized biharmonic surface (a variant of LS-mesh), and then the fine geometric detail is fitted further using iterative Laplacian editing with reliable correspondence constraints and a local surface flattening mechanism to avoid foldovers. The latter step is performed in the dual mesh domain, which is shown to encourage near-equilateral mesh elements and significantly reduces the occurrence of triangle foldovers, a well-known problem in mesh fitting. To experimentally evaluate our approach, we compare our method with relevant state-of-the-art techniques and confirm significant improvements of results. In addition, we demonstrate the usefulness of our approach to the application of consistent surface parameterization (also known as cross-parameterization).