RUS  ENG
Full version
JOURNALS // Upravlenie Bol'shimi Sistemami // Archive

UBS, 2019 Issue 82, Pages 28–43 (Mi ubs1022)

Mathematical Control Theory

On density estimation via fourier series

D. V. Belomestny, L. Iosipoi

National Research University Higher School of Economics, Moscow

Abstract: In this paper, we consider the classical statistical problem of probability density estimation based on a sample from this distribution. This problem naturally arises in many applications when one aims at investigation of a probability structure in a random process. For instance, it is possible to identify some structure in a complex system using density estimation. In this paper, a new approach to estimate a density function is proposed. This approach is based on approximation of a log-density via Fourier series with coefficients obtained by solving a system of linear equations. Analysis of theoretical properties of such estimate is the main purpose of this work. As the main results, we prove bounds on the difference between target density and its approximation in the supremum norm and the Kullback-Leibler divergence. Obtained rates are parametric and have order with high probability, which is a standard rate in parametric estimation problems. The constants in the rates are obtained up to an absolute factor, which means that we investigated the dependence on all parameters. As a numerical example, we consider a problem of Cauchy density estimation.

Keywords: density estimation, Fourier series, Kullback–Leibler divergence.

UDC: 519.23
BBK: 22.172

Received: September 3, 2019
Published: November 30, 2019

DOI: 10.25728/ubs.2019.82.2



© Steklov Math. Inst. of RAS, 2024