RUS  ENG
Full version
JOURNALS // Computer Research and Modeling // Archive

Computer Research and Modeling, 2019 Volume 11, Issue 3, Pages 379–395 (Mi crm718)

This article is cited in 1 paper

MATHEMATICAL MODELING AND NUMERICAL SIMULATION

One method for minimization a convex Lipschitz-continuous function of two variables on a fixed square

D. A. Pasechnyuka, F. S. Stonyakinbc

a Presidential Physics and Mathematics Lyceum No. 239, 8 Kirochnaya st., Saint-Petersburg, 191028, Russia
b V. I. Vernadsky Crimean Federal University, 4 V. Vernadsky ave., Simferopol, 295007, Russia
c Moscow Institute of Physics and Technology, 9 Institutsky ave., Dolgoprudny, 141070, Russia

Abstract: In the article we have obtained some estimates of the rate of convergence for the recently proposed by Yu. E. Nesterov method of minimization of a convex Lipschitz-continuous function of two variables on a square with a fixed side. The idea of the method is to divide the square into smaller parts and gradually remove them so that in the remaining sufficiently small part. The method consists in solving auxiliary problems of one-dimensional minimization along the separating segments and does not imply the calculation of the exact value of the gradient of the objective functional. The main result of the paper is proved in the class of smooth convex functions having a Lipschitz-continuous gradient. Moreover, it is noted that the property of Lipschitz-continuity for gradient is sufficient to require not on the whole square, but only on some segments. It is shown that the method can work in the presence of errors in solving auxiliary one-dimensional problems, as well as in calculating the direction of gradients. Also we describe the situation when it is possible to neglect or reduce the time spent on solving auxiliary one-dimensional problems. For some examples, experiments have demonstrated that the method can work effectively on some classes of non-smooth functions. In this case, an example of a simple non-smooth function is constructed, for which, if the subgradient is chosen incorrectly, even if the auxiliary one-dimensional problem is exactly solved, the convergence property of the method may not hold. Experiments have shown that the method under consideration can achieve the desired accuracy of solving the problem in less time than the other methods (gradient descent and ellipsoid method) considered. Partially, it is noted that with an increase in the accuracy of the desired solution, the operating time for the Yu. E. Nesterov's method can grow slower than the time of the ellipsoid method.

Keywords: minimization problem, convex functional, Lipshitz-continuous functional, Lipshitz-continuous gradient, non-smooth functional, subgradient, gradient method, ellipsoid method, rate of convergence.

UDC: 519.86

Received: 08.01.2019
Revised: 08.02.2019
Accepted: 22.04.2019

DOI: 10.20537/2076-7633-2019-11-3-379-395



© Steklov Math. Inst. of RAS, 2024