Bayesian matrix completion: prior specification and consistency
Rousseau, Judith; Chopin, Nicolas; Cottet, Vincent; Alquier, Pierre (2014), Bayesian matrix completion: prior specification and consistency. https://basepub.dauphine.fr/handle/123456789/13662
TypeDocument de travail / Working paper
External document linkhttp://arxiv.org/pdf/1406.1440.pdf
MetadataShow full item record
Abstract (EN)Low-rank matrix estimation from incomplete measurements recently received increased attention due to the emergence of several challenging applications, such as recommender systems; see in particular the famous Netflix challenge. While the behaviour of algorithms based on nuclear norm minimization is now well understood [SRJ05, SS05, CP09, CT09, CR09, Gro11, RT11, Klo11, KLT11], an as yet unexplored avenue of re- search is the behaviour of Bayesian algorithms in this context. In this paper, we briefly review the priors used in the Bayesian literature for ma- trix completion. A standard approach is to assign an inverse gamma prior to the singular values of a certain singular value decomposition of the ma- trix of interest; this prior is conjugate. However, we show that two other types of priors (again for the singular values) may be conjugate for this model: a gamma prior, and a discrete prior. Conjugacy is very convenient, as it makes it possible to implement either Gibbs sampling or Variational Bayes. Interestingly enough, the maximum a posteriori for these different priors is related to the nuclear norm minimization problems. Our main contribution is to prove the consistency of the posterior expectation when the discrete prior is used. We also compare all these priors on simulated datasets, and on the classical MovieLens and Netflix datasets.
Subjects / KeywordsBayesian matrix completion
Showing items related by title and author.
Bayesian nonparametric estimation of the spectral density of a long or intermediate memory Gaussian process Rousseau, Judith; Chopin, Nicolas; Liseo, Brunero (2012) Article accepté pour publication ou publié
Some discussions of D. Fearnhead and D. Prangle's Read Paper "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation" Singh, Sumeetpal S.; Sedki, Mohammed; Jasra, Ajay; Pudlo, Pierre; Robert, Christian P.; Lee, Anthony; Marin, Jean-Michel; Kosmidis, Ioannis; Girolami, Mark; Andrieu, Christophe; Cornebise, Julien; Doucet, Arnaud; Barthelme, Simon; Chopin, Nicolas (2012) Article accepté pour publication ou publié