Weighted Error Entropy-Based Information Theoretic Learning for Robust Subspace Representation.

In most of the existing representation learning frameworks, the noise contaminating the data points is often assumed to be independent and identically distributed (i.i.d.), where the Gaussian distribution is often imposed. This assumption, though greatly simplifies the resulting representation problems, may not hold in many practical scenarios. For example, the noise in face representation is usually attributable to local variation, random occlusion, and unconstrained illumination, which is essentially structural, and hence, does not satisfy the i.i.d. property or the Gaussianity. In this article, we devise a generic noise model, referred to as independent and piecewise identically distributed (i.p.i.d.) model for robust presentation learning, where the statistical behavior of the underlying noise is characterized using a union of distributions. We demonstrate that our proposed i.p.i.d. model can better describe the complex noise encountered in practical scenarios and accommodate the traditional i.i.d. one as a special case. Assisted by the proposed noise model, we then develop a new information-theoretic learning framework for robust subspace representation through a novel minimum weighted error entropy criterion. Thanks to the superior modeling capability of the i.p.i.d. model, our proposed learning method achieves superior robustness against various types of noise. When applying our scheme to the subspace clustering and image recognition problems, we observe significant performance gains over the existing approaches.

Unmixing Convolutional Features for Crisp Edge Detection.

This article presents a context-aware tracing strategy (CATS) for crisp edge detection with deep edge detectors, based on an observation that the localization ambiguity of deep edge detectors is mainly caused by the mixing phenomenon of convolutional neural networks: Feature mixing in edge classification and side mixing during fusing side predictions. The CATS consists of two modules: A novel tracing loss that performs feature unmixing by tracing boundaries for better side edge learning, and a context-aware fusion block that tackles the side mixing by aggregating the complementary merits of learned side edges. Experiments demonstrate that the proposed CATS can be integrated into modern deep edge detectors to improve localization accuracy. With the vanilla VGG16 backbone, in terms of BSDS500 dataset, our CATS improves the F-measure (ODS) of the RCF and BDCN deep edge detectors by 12 and 6 percent, respectively when evaluating without using the morphological non-maximal suppression scheme for edge detection.

Interaction-Temporal GCN: A Hybrid Deep Framework For Covid-19 Pandemic Analysis.

The Covid-19 pandemic is still spreading around the world and seriously imperils humankind's health. This swift spread has caused the public to panic and look to scientists for answers. Fortunately, these scientists already have a wealth of data-the Covid-19 reports that each country releases, reports with valuable spatial-temporal properties. These data point toward some key actions that humans can take in their fight against Covid-19. Technically, the Covid-19 records can be described as sequences, which represent spatial-temporal linkages among the data elements with graph structure. Therefore, we propose a novel framework, the Interaction-Temporal Graph Convolution Network (IT-GCN), to analyze pandemic data. Specifically, IT-GCN introduces ARIMA into GCN to model the data which originate on nodes in a graph, indicating the severity of the pandemic in different cities. Instead of regular spatial topology, we construct the graph nodes with the vectors via ARIMA parameterization to find out the interaction topology underlying in the pandemic data. Experimental results show that IT-GCN is able to capture the comprehensive interaction-temporal topology and achieve well-performed short-term prediction of the Covid-19 daily infected cases in the United States. Our framework outperforms state-of-art baselines in terms of MAE, RMSE and MAPE. We believe that IT-GCN is a valid and reasonable method to forecast the Covid-19 daily infected cases and other related time-series. Moreover, the prediction can assist in improving containment policies.

Distorted Building Image Matching with Automatic Viewpoint Rectification and Fusion.

Building image-matching plays a critical role in the urban applications. However, finding reliable and sufficient feature correspondences between the real-world urban building images that were captured in widely separate views are still challenging. In this paper, we propose a distorted image matching method combining the idea of viewpoint rectification and fusion. Firstly, the distorted images are rectified to the standard view with the transform invariant low-rank textures (TILT) algorithm. A local symmetry feature graph is extracted from the building images, followed by multi-level clustering using the mean shift algorithm, to automatically detect the low-rank texture region. After the viewpoint rectification, the Oriented FAST and Rotated BRIEF (ORB) feature is used to match the images. The grid-based motion statistics (GMS) and RANSAC techniques are introduced to remove the outliers and preserve the correct matching points to deal with the mismatched pairs. Finally, the matching results for the rectified views are projected to the original viewpoint space, and the matches before and after distortion rectification are fused to further determine the final matches. The experimental results show that both the number of matching pairs and the matching precision for the distorted building images can be significantly improved while using the proposed method.

Image-Based Localization Aided Indoor Pedestrian Trajectory Estimation Using Smartphones.

Accurately determining pedestrian location in indoor environments using consumer smartphones is a significant step in the development of ubiquitous localization services. Many different map-matching methods have been combined with pedestrian dead reckoning (PDR) to achieve low-cost and bias-free pedestrian tracking. However, this works only in areas with dense map constraints and the error accumulates in open areas. In order to achieve reliable localization without map constraints, an improved image-based localization aided pedestrian trajectory estimation method is proposed in this paper. The image-based localization recovers the pose of the camera from the 2D-3D correspondences between the 2D image positions and the 3D points of the scene model, previously reconstructed by a structure-from-motion (SfM) pipeline. This enables us to determine the initial location and eliminate the accumulative error of PDR when an image is successfully registered. However, the image is not always registered since the traditional 2D-to-3D matching rejects more and more correct matches when the scene becomes large. We thus adopt a robust image registration strategy that recovers initially unregistered images by integrating 3D-to-2D search. In the process, the visibility and co-visibility information is adopted to improve the efficiency when searching for the correspondences from both sides. The performance of the proposed method was evaluated through several experiments and the results demonstrate that it can offer highly acceptable pedestrian localization results in long-term tracking, with an error of only 0.56 m, without the need for dedicated infrastructures.

Activity Recognition and Semantic Description for Indoor Mobile Localization.

As a result of the rapid development of smartphone-based indoor localization technology, location-based services in indoor spaces have become a topic of interest. However, to date, the rich data resulting from indoor localization and navigation applications have not been fully exploited, which is significant for trajectory correction and advanced indoor map information extraction. In this paper, an integrated location acquisition method utilizing activity recognition and semantic information extraction is proposed for indoor mobile localization. The location acquisition method combines pedestrian dead reckoning (PDR), human activity recognition (HAR) and landmarks to acquire accurate indoor localization information. Considering the problem of initial position determination, a hidden Markov model (HMM) is utilized to infer the user's initial position. To provide an improved service for further applications, the landmarks are further assigned semantic descriptions by detecting the user's activities. The experiments conducted in this study confirm that a high degree of accuracy for a user's indoor location can be obtained. Furthermore, the semantic information of a user's trajectories can be extracted, which is extremely useful for further research into indoor location applications.