RUS  ENG
Full version
JOURNALS // Artificial Intelligence and Decision Making // Archive

Artificial Intelligence and Decision Making, 2023 Issue 2, Pages 89–97 (Mi iipr28)

Machine learning, neural networks

Parabola as an activation function of artificial neural networks

M. V. Khachumovabc, Yu. G. Emel'yanovaa

a Ailamazyan Program Systems Institute of Russian Academy of Sciences, Veskovo, Yaroslavl region, Russia
b Federal Research Center "Computer Science and Control" of Russian Academy of Sciences, Moscow, Russia
c Peoples' Friendship University of Russia, Moscow, Russia

Abstract: The use of parabola and its branches as a nonlinearity expanding the logical capabilities of artificial neurons is considered. In particular, the applicability of parabola branches for constructing an s-shaped function suitable for tuning a neural network by reverse error propagation is determined. The implementation of the XOR function on two and three neurons using the proposed approach is demonstrated. The main advantage of the parabola over the sigmoid is a simpler implementation, which speeds up the work of artificial neural networks.

Keywords: sigmoid, parabola, s-shaped activation function, neuron, neural network, XOR problem, tuning rate.

DOI: 10.14357/20718594230207



Bibliographic databases:


© Steklov Math. Inst. of RAS, 2024