RUS  ENG
Full version
JOURNALS // Doklady Rossijskoj Akademii Nauk. Mathematika, Informatika, Processy Upravlenia // Archive

Dokl. RAN. Math. Inf. Proc. Upr., 2023 Volume 514, Number 2, Pages 212–224 (Mi danma466)

SPECIAL ISSUE: ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING TECHNOLOGIES

Optimal analysis of method with batching for monotone stochastic finite-sum variational inequalities

A. Pichugina, M. Pechina, A. Beznosikova, A. Savchenkob, A. Gasnikova

a Moscow Institute of Physics and Technology, Dolgoprudny, Russian Federation
b Sber AI Lab, Moscow, Russian Federation

Abstract: Variational inequalities are a universal optimization paradigm that is interesting in itself, but also incorporates classical minimization and saddle point problems. Modern realities encourage to consider stochastic formulations of optimization problems. In this paper, we present an analysis of a method that gives optimal convergence estimates for monotone stochastic finite-sum variational inequalities. In contrast to the previous works, our method supports batching and does not lose the oracle complexity optimality. The effectiveness of the algorithm, especially in the case of small but not single batches is confirmed experimentally.

Keywords: stochastic optimization, variational inequalities, finite-sum problems, batching.

UDC: 004.8

Presented: A. A. Shananin
Received: 01.09.2023
Revised: 15.09.2023
Accepted: 18.10.2023

DOI: 10.31857/S2686954323601598


 English version:
Doklady Mathematics, 2023, 108:suppl. 2, S348–S359

Bibliographic databases:


© Steklov Math. Inst. of RAS, 2024