RUS  ENG
Full version
JOURNALS // Avtomatika i Telemekhanika // Archive

Avtomat. i Telemekh., 2019 Issue 9, Pages 64–90 (Mi at15342)

This article is cited in 16 papers

Algorithms of robust stochastic optimization based on mirror descent method

A. V. Nazina, A. S. Nemirovskyb, A. B. Tsybakovc, A. B. Juditskyd

a Trapeznikov Institute of Control Sciences, Russian Academy of Sciences, Moscow, Russia
b Georgia Institute of Technology, Atlanta, USA
c CREST, ENSAE, Paris, France
d Université Grenoble Alpes, Grenoble, France

Abstract: We propose an approach to the construction of robust non-Euclidean iterative algorithms by convex composite stochastic optimization based on truncation of stochastic gradients. For such algorithms, we establish sub-Gaussian confidence bounds under weak assumptions about the tails of the noise distribution in convex and strongly convex settings. Robust estimates of the accuracy of general stochastic algorithms are also proposed.

Keywords: robust iterative algorithms, stochastic optimization algorithms, convex composite stochastic optimization, mirror descent method, robust confidence sets.


Received: 18.07.2018
Revised: 03.09.2018
Accepted: 08.11.2018

DOI: 10.1134/S000523101909006X


 English version:
Automation and Remote Control, 2019, 80:9, 1607–1627

Bibliographic databases:


© Steklov Math. Inst. of RAS, 2025