Show simple item record

dc.contributor.authorBompaire, Martin*
dc.contributor.authorGaïffas, Stéphane*
dc.contributor.authorBacry, Emmanuel*
dc.date.accessioned2020-05-04T13:29:50Z
dc.date.available2020-05-04T13:29:50Z
dc.date.issued2018
dc.identifier.urihttps://basepub.dauphine.fr/handle/123456789/20687
dc.language.isoenen
dc.subjectconvex objectives
dc.subject.ddc519en
dc.titleDual Optimization for convex constrained objectives without the gradient-Lipschitz assumptions
dc.typeDocument de travail / Working paper
dc.description.abstractenThe minimization of convex objectives coming from linear supervised learning problems, such as penalized generalized linear models, can be formulated as finite sums of convex functions. For such problems, a large set of stochastic first-order solvers based on the idea of variance reduction are available and combine both computational efficiency and sound theoretical guarantees (linear convergence rates). Such rates are obtained under both gradient-Lipschitz and strong convexity assumptions. Motivated by learning problems that do not meet the gradient-Lipschitz assumption, such as linear Poisson regression, we work under another smoothness assumption, and obtain a linear convergence rate for a shifted version of Stochastic Dual Coordinate Ascent (SDCA) that improves the current state-of-the-art. Our motivation for considering a solver working on the Fenchel-dual problem comes from the fact that such objectives include many linear constraints, that are easier to deal with in the dual. Our approach and theoretical findings are validated on several datasets, for Poisson regression and another objective coming from the negative log-likelihood of the Hawkes process, which is a family of models which proves extremely useful for the modeling of information propagation in social networks and causality inference.
dc.publisher.cityParisen
dc.identifier.citationpages36
dc.relation.ispartofseriestitleCahier de recherche CEREMADE, Université Paris Dauphine-PSL
dc.identifier.urlsitehttps://arxiv.org/abs/1807.03545
dc.subject.ddclabelProbabilités et mathématiques appliquéesen
dc.description.ssrncandidatenon
dc.description.halcandidatenon
dc.description.readershiprecherche
dc.description.audienceInternational
dc.date.updated2020-10-26T11:33:14Z
hal.person.labIds89626*
hal.person.labIds542130*
hal.person.labIds60*


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record