RUS  ENG
Full version
JOURNALS // Russian Journal of Cybernetics // Archive

Russian Journal of Cybernetics, 2023 Volume 4, Issue 4, Pages 41–53 (Mi uk134)

Theoretical foundations of artificial neural network application to approximation and interpolation problems

A. D. Smorodinovab, T. V. Gavrilenkoab, V. A. Galkinab

a Surgut Branch of Federal State Institute “Scientific Research Institute for System Analysis of the Russian Academy of Sciences”, Surgut, Russian Federation
b Surgut State University, Surgut, Russian Federation

Abstract: We studied the theoretical foundations of artificial neural networks as applied to the possibility of approximating functions of many variables by superposition of functions of one variable. We considered the most important universal approximation theorems. We also studied the approximation theorems with the required number of neurons in a layer (width constraint) or the number of layers in a neural network (depth constraint), and the theorems in which their authors prove the existence of min bounds both for the number of layers and for the number of neurons per layer.

Keywords: universal approximation theorem, Kolmogorov-Arnold theorem, Tsybenko theorem, approximation of functions, artificial neural networks.

DOI: 10.51790/2712-9942-2023-4-4-04



© Steklov Math. Inst. of RAS, 2024