RUS  ENG
Full version
JOURNALS // Informatika i Ee Primeneniya [Informatics and its Applications] // Archive

Inform. Primen., 2024 Volume 18, Issue 1, Pages 78–83 (Mi ia890)

Logic of deception in machine learning

A. A. Grusho, N. A. Grusho, M. I. Zabezhailo, V. O. Piskovski, E. E. Timonina, S. Ya. Shorgin

Federal Research Center “Computer Science and Control” of the Russian Academy of Sciences, 44-2 Vavilov Str., Moscow 119333, Russian Federation

Abstract: The issues of potential change in the work of artificial neural networks under various influences on training data is the urgent task. Violation of the correct operation of the artificial neural network with hostile effects on the training sample was called poisoning. The paper provides the simplest model of neural network formation in which the features used in training are based only on the predominance of the number of homogeneous elements. Changes in the samples of the training sample allow one to build Back Doors which, in turn, allow one to implement incorrect classification as well as embed errors into the software system, up to malicious code. The correct model of training sample poisoning which allows one to implement Back Door and triggers for classification errors is constructed in the paper. The simplest nature of the constructed model of functioning and formation of deception allows one to believe that the causal logic of the realization of a possible real attack on a complex artificial intelligence system has been restored correctly. This conclusion allows one in the future to correctly build the subsystems of monitoring, anomaly analysis, and control of the functionality of the entire artificial intelligence system.

Keywords: finite classification task, cause-and-effect relationships, machine learning, poisoning.

Received: 15.01.2024

DOI: 10.14357/19922264240111



© Steklov Math. Inst. of RAS, 2024