
A Nonmonotone Matrix-Free Algorithm for Nonlinear Equality-Constrained Least-Squares Problems
Bergou, El Houcine; Diouane, Youssef; Kungurtsev, Vyacheslav; Royer, Clément W. (2021), A Nonmonotone Matrix-Free Algorithm for Nonlinear Equality-Constrained Least-Squares Problems, SIAM Journal on Scientific Computing, 43, 5, p. S743-S766. 10.1137/20M1349138
View/ Open
Type
Article accepté pour publication ou publiéDate
2021Journal name
SIAM Journal on Scientific ComputingVolume
43Number
5Publisher
SIAM - Society for Industrial and Applied Mathematics
Pages
S743-S766
Publication identifier
Metadata
Show full item recordAuthor(s)
Bergou, El HoucineDiouane, Youssef
Kungurtsev, Vyacheslav
Royer, Clément W.
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Abstract (EN)
Least squares form one of the most prominent classes of optimization problems with numerous applications in scientific computing and data fitting. When such formulations aim at modeling complex systems, the optimization process must account for nonlinear dynamics by incorporating constraints. In addition, these systems often incorporate a large number of variables, which increases the difficulty of the problem and motivates the need for efficient algorithms amenable to large-scale implementations. In this paper, we propose and analyze a Levenberg--Marquardt algorithm for nonlinear least squares subject to nonlinear equality constraints. Our algorithm is based on inexact solves of linear least-squares problems that only require Jacobian-vector products. Global convergence is guaranteed by the combination of a composite step approach and a nonmonotone step acceptance rule. We illustrate the performance of our method on several test cases from data assimilation and inverse problems; our algorithm is able to reach the vicinity of a solution from an arbitrary starting point and can outperform the most natural alternatives for these classes of problems.Subjects / Keywords
Nonlinear least squares; Equality constraints; Levenberg-Marquardt method; Iterative linear algebra; PDE-constrained optimizationRelated items
Showing items related by title and author.
-
Chavent, Guy (1988) Article accepté pour publication ou publié
-
Fast solver for some computational imaging problems: A regularized weighted least-squares approach Zhang, Bo; Makram-Ebeid, Sherif; Prevost, Raphaël; Pizaine, Guillaume (2014) Article accepté pour publication ou publié
-
Al Khoury, Philippe; Chavent, Guy (2006) Communication / Conférence
-
Chavent, Guy (1991) Communication / Conférence
-
Nonconvergence of the plain Newton-min algorithm for linear complementarity problems with a P-matrix Gilbert, J. Charles; Ben Gharbia, Ibtihel (2012) Article accepté pour publication ou publié