Documentation

UW Connect

Optimal Newton-type methods for nonconvex smooth optimization

Room: 
Room 3280B 3rd floor, teaching lab, WID

Coralia Cartis 
Lecturer, School Of Mathematics, University of Edinburgh, United Kingdom 
Monday, November 14, 2011 
4:00 PM, Wisconsin Institute for Discovery (WID), Room 3280B 3rd floor, teaching lab), Anyone without WID access can use the special events elevator on the WID 1st floor (near Aldo coffee shop) to access the WID 3rd floor teaching lab.

We show that the steepest-descent and Newton's methods for unconstrained nonconvex optimization under standard assumptions may both require a number of iterations and function evaluations arbitrarily close to the steepest-descent's global worst-case complexity bound. This implies that the latter upper bound is essentially tight for steepest descent and that Newton's method may be as slow as the steepest-descent method in the worst case. Then the cubic regularization of Newton's method (Griewank (1981), Nesterov & Polyak (2006)) is considered and extended to large-scale problems, while preserving the same order of its improved worst-case complexity (by comparison to that of steepest-descent); this improved worst-case bound is also proved to be essentially tight. We further show that the cubic regularization approach is, in fact, optimal from a worst-case complexity point of view amongst a class of second-order methods. Time permitting, the problem-evaluation complexity of constrained optimization will also be discussed, and shown to have, surprisingly, the same order as a function of the accuracy as in the unconstrained case. This is joint work with Nick Gould (Rutherford Appleton Laboratory, UK) and Philippe Toint (University of Namur, Belgium).

Event Date:
Monday, November 14, 2011 - 4:00pm - 5:00pm (ended)