
NGO-GM: Natural Gradient Optimization for Graphical Models
Benhamou, Éric; Atif, Jamal; Laraki, Rida; Saltiel, David (2020), NGO-GM: Natural Gradient Optimization for Graphical Models. https://basepub.dauphine.fr/handle/123456789/21206
View/ Open
Type
Document de travail / Working paperExternal document link
https://hal.archives-ouvertes.fr/hal-02886514Date
2020Series title
Preprint LamsadePublished in
Paris
Metadata
Show full item recordAuthor(s)
Benhamou, ÉricLaboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Atif, Jamal
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Laraki, Rida

Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Saltiel, David
Abstract (EN)
This paper deals with estimating model parameters in graphical models. We reformulate it as an information geometric optimization problem and introduce a natural gradient descent strategy that incorporates additional meta parameters. We show that our approach is a strong alternative to the celebrated EM approach for learning in graphical models. Actually, our natural gradient based strategy leads to learning optimal parameters for the final objective function without artificially trying to fit a distribution that may not correspond to the real one. We support our theoretical findings with the question of trend detection in financial markets and show that the learned model performs better than traditional practitioner methods and is less prone to overfitting.Subjects / Keywords
OptimizationRelated items
Showing items related by title and author.
-
Benhamou, Éric; Saltiel, David; Laraki, Rida; Atif, Jamal (2020) Document de travail / Working paper
-
Benhamou, Éric; Saltiel, David; Ohana, Jean-Jacques; Atif, Jamal; Laraki, Rida Communication / Conférence
-
Saltiel, David; Benhamou, Eric; Laraki, Rida; Atif, Jamal (2021) Communication / Conférence
-
Benhamou, Eric; Atif, Jamal; Laraki, Rida (2019-01) Document de travail / Working paper
-
Benhamou, Eric; Atif, Jamal; Laraki, Rida (2018) Document de travail / Working paper