Bayesian CMA-ES: a new approach
Benhamou, Eric; Saltiel, David; Verel, Sébastien (2020), Bayesian CMA-ES: a new approach, GECCO '20: Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion, ACM - Association for Computing Machinery : New York, NY, p. 203-204. 10.1145/3377929.3389913
Type
Communication / ConférenceDate
2020Conference title
GECCO '20: Genetic and Evolutionary Computation ConferenceConference date
2020-07Conference city
CancunConference country
MexicoBook title
GECCO '20: Proceedings of the 2020 Genetic and Evolutionary Computation Conference CompanionPublisher
ACM - Association for Computing Machinery
Published in
New York, NY
ISBN
978-1-4503-7127-8
Number of pages
1953Pages
203-204
Publication identifier
Metadata
Show full item recordAuthor(s)
Benhamou, Eric
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Saltiel, David
Laboratoire d'Informatique Signal et Image de la Côte d'Opale [LISIC]
Verel, Sébastien

Laboratoire d'Informatique Signal et Image de la Côte d'Opale [LISIC]
Abstract (EN)
This paper introduces a novel theoretically sound approach for the celebrated CMA-ES algorithm. Assuming the parameters of the multi variate normal distribution for the minimum follow a conjugate prior distribution, we can derive the optimal update at each iteration step thanks to Bayesian statistics. Update formulae are very similar to the vanilla (μ/λ) CMA-ES. We also use variance contraction and dilatation to accommodate for local and global search. As a result, this Bayesian framework provides a justification for the update of the CMA-ES algorithm and gives a new version of CMA-ES assuming normal-Inverse Wishart prior that has similar convergence speed and efficiency as the vanilla (μ/λ) CMA-ES on test functions ranging from cone, Rastrigin to Schwefel 1 and 2 functions.Subjects / Keywords
Bayesian; CMA-ES; Normal-inverse-wishart; Conjugate priorRelated items
Showing items related by title and author.
-
Benhamou, Éric; Saltiel, David; Verel, Sébastien; Teytaud, Fabien (2020) Document de travail / Working paper
-
Benhamou, Éric; Saltiel, David; Guez, Beatrice; Paris, Nicolas (2020) Document de travail / Working paper
-
Benhamou, Éric; Saltiel, David; Laraki, Rida; Atif, Jamal (2020) Document de travail / Working paper
-
Benhamou, Éric; Saltiel, David; Tabachnik, Serge; Wong, Sui Kai; Chareyron, François (2021) Document de travail / Working paper
-
Benhamou, Eric; Atif, Jamal; Laraki, Rida (2018) Document de travail / Working paper