Show simple item record

dc.contributor.authorYezzi, Anthony
dc.contributor.authorSundaramoorthi, Ganesh
dc.date.accessioned2017-12-28T07:32:11Z
dc.date.available2017-12-28T07:32:11Z
dc.date.issued2017-11-27
dc.identifier.urihttp://hdl.handle.net/10754/626461
dc.description.abstractFollowing the seminal work of Nesterov, accelerated optimization methods have been used to powerfully boost the performance of first-order, gradient-based parameter estimation in scenarios where second-order optimization strategies are either inapplicable or impractical. Not only does accelerated gradient descent converge considerably faster than traditional gradient descent, but it also performs a more robust local search of the parameter space by initially overshooting and then oscillating back as it settles into a final configuration, thereby selecting only local minimizers with a basis of attraction large enough to contain the initial overshoot. This behavior has made accelerated and stochastic gradient search methods particularly popular within the machine learning community. In their recent PNAS 2016 paper, Wibisono, Wilson, and Jordan demonstrate how a broad class of accelerated schemes can be cast in a variational framework formulated around the Bregman divergence, leading to continuum limit ODE's. We show how their formulation may be further extended to infinite dimension manifolds (starting here with the geometric space of curves and surfaces) by substituting the Bregman divergence with inner products on the tangent space and explicitly introducing a distributed mass model which evolves in conjunction with the object of interest during the optimization process. The co-evolving mass model, which is introduced purely for the sake of endowing the optimization with helpful dynamics, also links the resulting class of accelerated PDE based optimization schemes to fluid dynamical formulations of optimal mass transport.
dc.publisherarXiv
dc.relation.urlhttp://arxiv.org/abs/1711.09867v1
dc.relation.urlhttp://arxiv.org/pdf/1711.09867v1
dc.rightsArchived with thanks to arXiv
dc.titleAccelerated Optimization in the PDE Framework: Formulations for the Active Contour Case
dc.typePreprint
dc.contributor.departmentComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
dc.contributor.departmentElectrical Engineering Program
dc.contributor.departmentVisual Computing Center (VCC)
dc.eprint.versionPre-print
dc.contributor.institutionSchool of Electrical and Computer Engineering, Georgia Institute of Technology
dc.identifier.arxividarXiv:1711.09867
kaust.personSundaramoorthi, Ganesh
refterms.dateFOA2018-06-14T05:36:46Z


Files in this item

Thumbnail
Name:
1711.09867v1.pdf
Size:
3.094Mb
Format:
PDF
Description:
Preprint

This item appears in the following Collection(s)

Show simple item record