Initial Improvement of the Hybrid Accelerated Gradient Descent Process

Stefan Panic, Milena J. Petrovic, Miroslava Mihajlov Carevic

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

We improve the convergence properties of the iterative scheme for solving unconstrained optimisation problems introduced in Petrovic et al. ['Hybridization of accelerated gradient descent method', Numer. Algorithms (2017), doi:10.1007/s11075-017-0460-4] by optimising the value of the initial step length parameter in the backtracking line search procedure. We prove the validity of the algorithm and illustrate its advantages by numerical experiments and comparisons.

Original languageEnglish
Pages (from-to)331-338
Number of pages8
JournalBulletin of the Australian Mathematical Society
Volume98
Issue number2
DOIs
Publication statusPublished - 1 Oct 2018
Externally publishedYes

    Fingerprint

Keywords

  • convergence rate
  • gradient descent methods
  • Line search
  • Newton method

ASJC Scopus subject areas

  • Mathematics(all)

Cite this