Bareilles, Gilles (2019) Structured Acceleration of Optimization methods for Machine Learning problems PFE - Project Graduation, ENSTA.



When solving composite optimization problems, which are fundamental in machine learning applications, finding the optimal point quickly and its structure are two tasks which call for accelerated first order methods, and identification promoting algorithms. The main part of this internship is dedicated towards exploring numerically the interplay between acceleration and structure identification for first-order methods. We propose a method which benefits from a convergence rate matching the accelerated first order method, and which is empirically more stable in terms of structure identification. The second part of this project is turned towards the field of multi-stage stochastic programming. With ever more expressive models, the need arises for methods able to tackle large-scale problems on distributed infrastructure, going beyond the celebrated progressive hedging algorithm. We derive incremental randomized versions of the progressive hedging algorithm, and demonstrate numerically their efficiency.

Item Type:Thesis (PFE - Project Graduation)
Subjects:Mathematics and Applications
ID Code:7652
Deposited By:Gilles Bareilles
Deposited On:27 janv. 2020 14:45
Dernière modification:27 janv. 2020 14:45

Repository Staff Only: item control page