HABIBOULLAH, Monsieur Mohamed Laghdaf (2023) A Proximal Modified Quasi-Newton Method for Nonsmooth Regularized Optimization PFE - Project Graduation, ENSTA.

This is the latest version of this item.

[img]
Preview
PDF
989Kb

Abstract

We develop method R2N, a modified quasi-Newton method for minimizing the sum of a smooth 𝑓 with Lipschitz gradient and lower semi-continuous prox-bounded h. Both 𝑓 and h may be nonconvex and may be bound constrained. At each iteration, our method computes a step by minimizing the sum of a convex quadratic quasi-Newton model of 𝑓 , a model of h, and an adaptive quadratic regularization term. A step may be computed by way of methods R2 [2] or TRDH [21]. In variant R2N-DH, the model of 𝑓 is diagonal, which allows us to compute a step without resort to a subproblem solver for a few separable h that are relevant in applications. R2N-DH can also be used as subproblem solver inside R2N. We establish global convergence of a first-order stationarity measure to zero and a worst-case evaluation complexity bound of 𝑂(𝜖−2) to bring said measure below 𝜖 ∈ (0, 1). Furthermore, we extend our analysis to consider worst-case complexity in more general scenarios, even when the approximation of the Hessian is unbounded. We describe our Julia implementation and report numerical experience on inverse problems, and a minimum-rank matrix completion problem.

Item Type:Thesis (PFE - Project Graduation)
Uncontrolled Keywords:Nonsmooth optimization, Nonconvex optimization, Regularized optimization, Composite optimization, Modified quasi-Newton method, Proximal quasi-Newton method, Proximal gradient method
Subjects:Mathematics and Applications
ID Code:9941
Deposited By:Mohamed laghdaf Habiboullah
Deposited On:19 janv. 2024 09:34
Dernière modification:19 janv. 2024 09:34

Available Versions of this Item

Repository Staff Only: item control page