RUS  ENG
Full version
JOURNALS // Informatics and Automation // Archive

Informatics and Automation, 2024 Issue 23, volume 3, Pages 886–908 (Mi trspy1307)

Robotics, Automation and Control Systems

Classification of spatial temporal patterns based on neuromorphic networks

F. Gundelakh, L. Stankevich

Peter the Great Saint-Petersburg Polytechnic University (SPbPU)

Abstract: This work is devoted to the problems of developing neuromorphic classifiers of spatiotemporal patterns, as well as their application in neurointerfaces. Classifiers of spatiotemporal patterns based on neural networks, support vector machines, deep neural networks, and Riemannian geometry are considered. A comparative study of these classifiers is carried out in the plane of the accuracy of multiclass recognition of electroencephalographic signals showing time-dependent bioelectrical activity in different areas of the brain during the imagination of different movements. It is shown that such classifiers can provide an accuracy of 60-80% when recognizing from two to four classes of imaginary movements. A new type of classifier based on a neuromorphic network, based on the biosimilar neurons built on the Izhikevich model, is proposed. The network processes input spike sequences and generates pulse streams of different frequencies at the outputs. The network is trained using the Supervised STDP algorithm based on labeled information containing examples of the correct recognition of the required pattern classes. The recognized pattern class is determined by the maximum frequency of the output sequence. The neuromorphic classifier showed an average classification accuracy of 90% for 4 classes of imaginary commands and a maximum of 95%. By modeling the robot control task in the virtual environment it is shown that such accuracy is sufficient for the effective use of the classifier as part of a non-invasive brain-computer interface for non-contact control of robotic devices.

Keywords: spatiotemporal patterns, classification, neural networks, support vectors, Riemannian geometry, neuromorphic networks, neurointerface, electroencephalography, imaginary movements, non-contact control.

UDC: 681.3

Received: 15.10.2023

DOI: 10.15622/ia.23.3.9



© Steklov Math. Inst. of RAS, 2024