
A Stochastic Proximal Polyak Step Size
Recently, the stochastic Polyak step size (SPS) has emerged as a competitive adaptive step size scheme for stochastic gradient descent. Here we develop ProxSPS, a proximal variant of SPS that can...
OpenReviewA Stochastic Proximal Polyak Step Size
Fabian Schaipp, Robert M. Gower, Michael Ulbrich
Action editor: Stephen Becker.
https://openreview.net/forum?id=jWr41htaB3
#regularization #proxsps #proximal

A Stochastic Proximal Polyak Step Size
Recently, the stochastic Polyak step size (SPS) has emerged as a competitive adaptive step size scheme for stochastic gradient descent. Here we develop ProxSPS, a proximal variant of SPS that can...
OpenReview
A Stochastic Proximal Polyak Step Size
Recently, the stochastic Polyak step size (SPS) has emerged as a competitive adaptive step size scheme for stochastic gradient descent. Here we develop ProxSPS, a proximal variant of SPS that can...
OpenReview