Regularization in regression: comparing Bayesian and frequentist methods in a poorly informative situation
Celeux, Gilles; El Anbari, Mohammed; Marin, Jean-Michel; Robert, Christian P. (2012), Regularization in regression: comparing Bayesian and frequentist methods in a poorly informative situation, Bayesian Analysis, 7, 2, p. 477-502. http://dx.doi.org/10.1214/12-BA716
TypeArticle accepté pour publication ou publié
External document linkhttp://fr.arXiv.org/abs/1010.0300
Journal nameBayesian Analysis
MetadataShow full item record
Abstract (EN)We propose a global noninformative approach for Bayesian variable selection that builds on Zellner's g-priors and is similar to Liang et al. (2008). Our proposal does not require any kind of calibration. In the case of a benchmark, we compare Bayesian and frequentist regularization approaches under a low informative constraint when the number of variables is almost equal to the number of observations. The simulated and real dataset experiments we present here highlight the appeal of Bayesian regularization methods, when compared with alternatives. They dominate frequentist methods in the sense they provide smaller prediction errors while selecting the most relevant variables in a parsimonious way.
Subjects / KeywordsBayesian variable; frequentist methods; regularization
Showing items related by title and author.
Some discussions on the Read Paper Beyond subjective and objective in statistics" by A. Gelman and C. Hennig" Celeux, Gilles; Jewson, Jack; Josse, Julie; Marin, Jean-Michel; Robert, Christian P. (2017) Document de travail / Working paper
Some discussions of D. Fearnhead and D. Prangle's Read Paper "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation" Singh, Sumeetpal S.; Sedki, Mohammed; Jasra, Ajay; Pudlo, Pierre; Robert, Christian P.; Lee, Anthony; Marin, Jean-Michel; Kosmidis, Ioannis; Girolami, Mark; Andrieu, Christophe; Cornebise, Julien; Doucet, Arnaud; Barthelme, Simon; Chopin, Nicolas (2012) Article accepté pour publication ou publié