RUS  ENG
Full version
JOURNALS // Informatsionnye Tekhnologii i Vychslitel'nye Sistemy // Archive

Informatsionnye Tekhnologii i Vychslitel'nye Sistemy, 2023 Issue 1, Pages 71–81 (Mi itvs798)

MATH MODELING

Approximate estimation using the accelerated maximum entropy method. Part 2. Study of the properties of estimates

Yu. A. Dubnov, A. V. Boulytchev

Federal Research Center "Computer Science and Control" of Russian Academy of Sciences, Moscow, Russia

Abstract: In this paper, we investigate a method of approximate entropy estimation, designed to speed up the classical method of maximum entropy estimation due to the use of regularization in the optimization problem. This method is compared with the method of maximum likelihood and Bayesian estimation, both experimentally and in terms of theoretical calculations for some special cases. Estimation methods are tested on the example of a linear regression problem with errors of various types, including asymmetric distributions as well as a multimodal distribution in the form of a mixture of Gaussian components.

Keywords: probabilistic mathematical model, maximum entropy method, linear regression, regularization, errors distribution.

DOI: 10.14357/20718632230107



Bibliographic databases:


© Steklov Math. Inst. of RAS, 2025