Seminars

Covariance Tracking using Model Update Based on Means on Riemannian Manifolds

Speaker: 
Mark Moyou
Start Time: 
Monday, April 22, 2013 - 11:00
Location: 
F.W. Olin Engineering Complex, Room 313
Abstract: 

We propose a simple and elegant algorithm to track nonrigid objects using a covariance based object description and an update mechanism based on means on Riemannian manifolds. We represent an object window as the covariance matrix of features, therefore we manage to capture the spatial and statistical properties as well as their correlation within the same representation. The covariance matrix enables efficient fusion of different types of features and modalities, and its dimensionality is small. We incorporated a model update algorithm using the elements of Riemmanian geometry. The update mechanism effectively adapts to the undergoing object deformations and appearance changes. The covariance tracking method does not make any assumption on the measurement noise and the motion of the tracked objects, and provides the global optimal solution. We show that it is capable of accurately detecting the non-rigid, moving objects in non-stationary camera sequences while achieving a promising detection rate of 97.4 percent.

Paper Link: http://coewww.rutgers.edu/riul/research/papers/pdf/covtrack.pdf

Projection pursuit via white noise matrices

Speaker: 
Lok Acharya
Start Time: 
Monday, April 8, 2013 - 11:00
Location: 
F.W. Olin Engineering Complex, Room 313
Abstract: 

Projection pursuit is a technique for locating projections from highto low-dimensional space that reveal interesting non-linear features of a dataset, such as clustering and outliers. The two key components of projection pursuit are the chosen measure of interesting features (the projection index) and its algorithm. In this paper, a white noise matrix based on the Fisher information matrix is proposed for use as the projection index. This matrix index is easily estimated by the kernel method. The eigenanalysis of the estimated matrix index provides a set of solution projections that are most similar to white noise. Application to simulated data and real data sets shows that our algorithm successfully reveals interesting features in fairly high dimensions with a practical sample size and low computational effort.

Paper Link: http://sankhya.isical.ac.in/search/72b2/13571_2011_8_PrintPDF.pdf

Region Covariance: A Fast Descriptor for Detection and Classification

Speaker: 
Mark Moyou
Start Time: 
Monday, March 25, 2013 - 11:00
Location: 
F.W. Olin Engineering Complex, Room 313
Abstract: 

We describe a new region descriptor and apply it to two problems, object detection and texture classification. The covariance of d-features, e.g., the three-dimensional color vector, the norm of first and second derivatives of intensity with respect to x and y, etc., characterizes a region of interest. We describe a fast method for computation of covariances based on integral images. The idea presented here is more general than the image sums or histograms, which were already published before, and with a series of integral images the covariances are obtained by a
few arithmetic operations. Covariance matrices do not lie on Euclidean space, therefore we use a distance metric involving generalized eigenvalues which also follows from the Lie group structure of positive definite matrices. Feature matching is a simple nearest neighbor search under the distance metric and performed extremely rapidly using the integral images. The performance of the covariance features is superior to other methods, as it is shown, and large rotations and illumination changes are also absorbed by the covariance matrix.

Paper Link: http://www.merl.com/papers/docs/TR2005-111.pdf

Fisher information distance: a geometrical reading

Speaker: 
Rana Haber
Start Time: 
Monday, March 18, 2013 - 11:00
Location: 
F.W. Olin Engineering Complex, Room 313
Abstract: 

This paper is a strongly geometrical approach to the Fisher distance, which is a measure of dissimilarity between two probability distribution functions. This, as well as other divergence measures, are also used in many applications to establish a proper data average. It focuses on statistical models of the normal probability distribution functions and takes advantage of the connection with the classical hyperbolic geometry to derive closed forms for the Fisher distance in several cases. Connections with the well-known Kullback-Leibler divergence measure are also devised. The main purpose is to widen the range of possible interpretations and relations of the Fisher distance and its associated geometry for the prospective applications, in particular to information theory.

Paper Link: http://arxiv.org/pdf/1210.2354.pdf

Life Beyond Bases: The Advent of Frames (Part I)

Speaker: 
Eddy Ihou
Start Time: 
Monday, March 11, 2013 - 11:00
Location: 
F.W. Olin Engineering Complex, Room 313
Abstract: 

Given a signal, we represent it in another system, typically a basis, where its characteristics are more readily apparent in the transform coefficients. However, these representations are typically nonredundant, and thus corruption or loss of transform coefficients can be serious.In comes redundancy; we build a safety net into our representation so that we can avoid those disasters. The redundant counterpart of a basis is called a frame [no one seems to know why they are called frames,perhaps because of the bounds in (25)?]. It is generally acknowledged (at least in the signal processing and harmonic analysis communities) that frames were born in 1952 in the paper by Duffin and Schaeffer [32]. Despite being over half a century old, frames gained popularity only in the last decade, due mostly to the work of the three wavelet pioneers—Daubechies, Grossman, and Meyer.

Paper Link: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4286567&tag=1

Diffusion Kernels on Statistical Manifolds

Speaker: 
Nenad Mijatovic
Start Time: 
Monday, February 25, 2013 - 11:00
Location: 
F.W. Olin Engineering Complex, Room 313
Abstract: 

A family of kernels for statistical learning is introduced that exploits the geometric structure of statistical models. The kernels are based on the heat equation on the Riemannian manifold defined by the Fisher information metric associated with a statistical family, and generalize the Gaussian kernel of Euclidean space. As an important special case, kernels based on the geometry of multinomial families are derived, leading to kernel-based learning algorithms that apply naturally to discrete data. Bounds on covering numbers and Rademacher averages for the kernels are proved using bounds on the eigenvalues of the Laplacian on Riemannian manifolds. Experimental results
are presented for document classification, for which the use of multinomial geometry is natural and well motivated, and improvements are obtained over the standard use of Gaussian or linear kernels, which have been the standard for text classification.

Paper link: http://jmlr.csail.mit.edu/papers/volume6/lafferty05a/lafferty05a.pdf

Advances in matrix manifolds for computer vision

Speaker: 
Lok Acharya
Start Time: 
Monday, February 11, 2013 - 11:00
Location: 
F.W. Olin Engineering Complex, Room 313
Abstract: 

The attention paid to matrix manifolds has grown considerably in the computer vision community in recent years. There are a wide range of important applications including face recognition, action recognition, clustering, visual tracking, and motion grouping and segmentation. The increased popularity of matrix manifolds is due partly to the need to characterize image features in non-Euclidean spaces. Matrix manifolds provide rigorous formulations allowing patterns to be naturally expressed and classified in a particular
parameter space. This paper gives an overview of common matrix manifolds employed in computer vision and presents a summary of related applications. Researchers in computer vision should find this survey beneficial due to the overview of matrix manifolds, the discussion as well as the collective references.

Quasi-Newton Methods: A New Direction

Speaker: 
Naveed Iqbal
Start Time: 
Monday, February 4, 2013 - 11:00
Location: 
F.W. Olin Engineering Complex, Room 313
Abstract: 

Four decades after their invention, quasi-Newton methods are still state of the art in unconstrained numerical optimization. Although not usually interpreted thus, these are
learning algorithms that fitt a local quadratic approximation to the objective function. We show that many, including the most popular, quasi-Newton methods can be interpreted as approximations of Bayesian linear regression under varying prior assumptions. This new notion elucidates some shortcomings of classical algorithms, and lights the way to a novel nonparametric quasi-Newton method, which is able to make more e efficient use of available information at computational cost similar to its predecessors.

Paper Link: http://www.is.tuebingen.mpg.de/fileadmin/user_upload/files/publications/...

An Iterative Locally Linear Embedding Algorithm

Speaker: 
Mark Moyou
Start Time: 
Monday, January 28, 2013 - 11:00
Location: 
F.W. Olin Engineering Complex, Room 313
Abstract: 

Locally Linear embedding (LLE) is a popular dimension reduction method. In this paper, we systematically improve the two main steps of LLE: (A) learning the graph weights W, and (B) learning the embedding Y. We propose a sparse nonnegative W learning algorithm. We propose a weighted formulation for learning Y and show the results are identical to normalized cuts spectral clustering. We further propose to iterate the two steps in LLE repeatedly to improve the results. Extensive experiment results show that iterative LLE algorithm significantly improves both classification and clustering results.

Paper Link : http://arxiv.org/ftp/arxiv/papers/1206/1206.6463.pdf

Principle Manifolds and Nonlinear Dimensionality Reduction Via Tangent Space Alignment

Speaker: 
Rana Haber
Start Time: 
Monday, January 14, 2013 - 11:00
Location: 
F.W. Olin Engineering Complex, Room 313
Abstract: 

We present a new algorithm for manifold learning and nonlinear dimensionality reduction. Based on a set of unorganized data points sampled with noise from a parameterized manifold, the local geometry of the manifold is learned by constructing an approximation for the tangent space at each point, and those tangent spaces are then aligned to give the global coordinates of the data points with respect to the underlying manifold. We also present an error analysis of our algorithm showing that reconstruction errors can be quite small in some cases. We illustrate our algorithm using curves and surfaces both in 2D/3D Euclidean spaces and higher dimensional Euclidean spaces. We also address several theoretical and algorithmic issues for further research and improvements

Paper Link: http://epubs.siam.org/doi/pdf/10.1137/S1064827502419154

Pages