Geometry-aware principal component analysis for symmetric positive definite matrices
Horev, Inbal; Yger, Florian; Sugiyama, Masashi (2016), Geometry-aware principal component analysis for symmetric positive definite matrices, Machine Learning, p. 1-30. 10.1007/s10994-016-5605-5
TypeArticle accepté pour publication ou publié
Journal nameMachine Learning
MetadataShow full item record
University of Tokyo
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
University of Tokyo
Abstract (EN)Symmetric positive definite (SPD) matrices in the form of covariance matrices, for example, are ubiquitous in machine learning applications. However, because their size grows quadratically with respect to the number of variables, high-dimensionality can pose a difficulty when working with them. So, it may be advantageous to apply to them dimensionality reduction techniques. Principal component analysis (PCA) is a canonical tool for dimensionality reduction, which for vector data maximizes the preserved variance. Yet, the commonly used, naive extensions of PCA to matrices result in sub-optimal variance retention. Moreover, when applied to SPD matrices, they ignore the geometric structure of the space of SPD matrices, further degrading the performance. In this paper we develop a new Riemannian geometry based formulation of PCA for SPD matrices that (1) preserves more data variance by appropriately extending PCA to matrix data, and (2) extends the standard definition from the Euclidean to the Riemannian geometries. We experimentally demonstrate the usefulness of our approach as pre-processing for EEG signals and for texture image classification.
Subjects / Keywordsdimensionality reduction; PCA; Riemannian geometry; SPD manifold; Grassmann manifold
Showing items related by title and author.
Ensemble learning based on functional connectivity and Riemannian geometry for robust workload estimation Corsi, Marie-Constance; Chevallier, Sylvain; Barthélemy, Quentin; Hoxha, Isabelle; Yger, Florian Communication / Conférence