
BCMA-ES: a conjugate prior Bayesian optimization view
Benhamou, Éric; Saltiel, David; Laraki, Rida; Atif, Jamal (2020), BCMA-ES: a conjugate prior Bayesian optimization view. https://basepub.dauphine.psl.eu/handle/123456789/22299
View/ Open
Type
Document de travail / Working paperDate
2020Series title
Preprint LamsadePublished in
Paris
Metadata
Show full item recordAuthor(s)
Benhamou, ÉricLaboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Saltiel, David
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Laraki, Rida

Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Atif, Jamal
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Abstract (EN)
CMA-ES is one of the state of the art evolutionary optimization methods because of its capacity to adapt covariance to information geometry. It uses prior information to form a best guess about the distribution of the minimum. We show this can be reformulated as a Bayesian optimization problem for the sampling of the optimum. Thanks to Normal Inverse Wishart (NIW) distribution, that is a conjugate prior for the multi variate normal distribution, we can derive a numerically efficient algorithm Bayesian CMA-ES that obtains similar performance as the traditional CMA-ES on multiple benchmarks and provides a new justification for the CMA-ES updates equations. This novel paradigm for Bayesian CMA-ES provides a powerful bridge between evolutionary and Bayesian optimization, showing the profound similarities and connections between these traditionally opposed methods and opening horizon for variations and mix strategies on these methods.Subjects / Keywords
CMA-ES; Bayesian optimization; Normal inverse Wishart; conjugate priorRelated items
Showing items related by title and author.
-
Benhamou, Éric; Atif, Jamal; Laraki, Rida; Saltiel, David (2020) Document de travail / Working paper
-
Benhamou, Éric; Saltiel, David; Ohana, Jean-Jacques; Atif, Jamal; Laraki, Rida Communication / Conférence
-
Saltiel, David; Benhamou, Eric; Laraki, Rida; Atif, Jamal (2021) Communication / Conférence
-
Benhamou, Eric; Atif, Jamal; Laraki, Rida (2018) Document de travail / Working paper
-
Benhamou, Éric; Saltiel, David; Verel, Sébastien; Teytaud, Fabien (2020) Document de travail / Working paper