13/04/2021

Generalization of quasi-newton methods: Application to robust symmetric multisecant updates

Damien Scieur, Lewis Liu, Thomas Pumir, Nicolas Boumal

Keywords:

Abstract Paper Similar Papers

Abstract: Quasi-Newton (qN) techniques approximate the Newton step by estimating the Hessian using the so-called secant equations. Some of these methods compute the Hessian using several secant equations but produce non-symmetric updates. Other quasi-Newton schemes, such as BFGS, enforce symmetry but cannot satisfy more than one secant equation. We propose a new type of quasi-Newton symmetric update using several secant equations in a least-squares sense. Our approach generalizes and unifies the design of quasi-Newton updates and satisfies provable robustness guarantees.

 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AISTATS 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 10:25 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 4:51 
 0
 0
 0
 0
 15:49 
 0
 0
 0
 0
 8:02 
 0
 0
 0
 0
 14:59 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 14:53 
 0
 0
 0
 0
 5:26 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 4:22 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 15:46 
 0
 0
 0
 0
 25:40 
 0
 0
 0
 0
 13:53 
 0
 0
 0
 0
 3:01 
 0
 0
 0
 0
 17:35 
 0
 0
 0
 0
 5:33 
 0
 0
 0
 0
 15:31 
 0
 0
 0
 0
 3:13 
 0
 0
 0
 0
 3:24 
 0
 0
 0
 0
 12:26 
 0
 0
 0
 0
 13:31 
 0
 0
 0
 0
 2:52 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 18:42 
 0
 0
 0
 0
 13:06 
 0
 0
 0
 0
 10:47 
 0
 0
 0
 0
 22:04 
 0
 0
 0
 0
 13:55 
 0
 0
 0
 0
 14:31 
 0
 0
 0
 0
 4:50 
 0
 0
 0
 0
 14:00 
 0
 0
 0
 1
 3:01 
 0
 0
 0
 0
 14:11 
 0
 0
 0
 0
 12:53 
 0
 0
 0
 0
 5:21 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 6:26