RUS  ENG
Full version
JOURNALS // Journal of the Belarusian State University. Mathematics and Informatics // Archive

Journal of the Belarusian State University. Mathematics and Informatics, 2022 Volume 1, Pages 97–102 (Mi bgumi181)

Short communications

Space semantic aware loss function for embedding creation in case of transaction data

M. E. Vatkin, D. A. Vorobey, M. V. Yakovlev, M. G. Krivova

Sber Bank, 6 Muliavina Boulevard, Minsk 220005, Belarus

Abstract: Transaction data are the most popular data type of bank domain, they are often represented as sparse vectors with a large number of features. Using sparse vectors in deep learning tasks is computationally inefficient and may lead to overfitting. Àutoencoders are widely applied to extract new useful features in a lower dimensional space. In this paper we propose to use a novel loss function based on the metric that estimates the quality of mapping the semantic structure of the original tabular data to the embedded space. The proposed loss function allows preserving the item relation structure of the original space during the dimension reduction transformation. The obtained results show the improvement of the resulting embedding properties while using the combination of the new loss function and the traditional mean squared error one.

Keywords: data; embedding; vector; loss function; autoencoder.

UDC: 004.852

Received: 21.10.2021
Revised: 08.11.2021
Accepted: 14.02.2022

Language: English

DOI: 10.33581/2520-6508-2022-1-97-102



© Steklov Math. Inst. of RAS, 2024