Logo del repository
  1. Home
 
Opzioni

A piecewise conservative method for unconstrained convex optimization

Scagliotti, A.
•
Colli Franzone, P.
2022
  • journal article

Periodico
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS
Abstract
We consider a continuous-time optimization method based on a dynamical system, where a massive particle starting at rest moves in the conservative force field generated by the objective function, without any kind of friction. We formulate a restart criterion based on the mean dissipation of the kinetic energy, and we prove a global convergence result for strongly-convex functions. Using the Symplectic Euler discretization scheme, we obtain an iterative optimization algorithm. We have considered a discrete mean dissipation restart scheme, but we have also introduced a new restart procedure based on ensuring at each iteration a decrease of the objective function greater than the one achieved by a step of the classical gradient method. For the discrete conservative algorithm, this last restart criterion is capable of guaranteeing a qualitative convergence result. We apply the same restart scheme to the Nesterov Accelerated Gradient (NAG-C), and we use this restarted NAG-C as benchmark in the numerical experiments. In the smooth convex problems considered, our method shows a faster convergence rate than the restarted NAG-C. We propose an extension of our discrete conservative algorithm to composite optimization: in the numerical tests involving non-strongly convex functions with l(1)-regularization, it has better performances than the well known efficient Fast Iterative Shrinkage-Thresholding Algorithm, accelerated with an adaptive restart scheme.
DOI
10.1007/s10589-021-00332-0
WOS
WOS:000721416800001
Archivio
http://hdl.handle.net/20.500.11767/129532
info:eu-repo/semantics/altIdentifier/scopus/2-s2.0-85119667968
https://arxiv.org/abs/2009.11233
Diritti
metadata only access
Soggetti
  • Convex optimization

  • Accelerated first-ord...

  • Restart strategies

  • Conservative dynamica...

  • Settore MAT/08 - Anal...

google-scholar
Get Involved!
  • Source Code
  • Documentation
  • Slack Channel
Make it your own

DSpace-CRIS can be extensively configured to meet your needs. Decide which information need to be collected and available with fine-grained security. Start updating the theme to match your nstitution's web identity.

Need professional help?

The original creators of DSpace-CRIS at 4Science can take your project to the next level, get in touch!

Realizzato con Software DSpace-CRIS - Estensione mantenuta e ottimizzata da 4Science

  • Impostazioni dei cookie
  • Informativa sulla privacy
  • Accordo con l'utente finale
  • Invia il tuo Feedback