RUS  ENG
Full version
JOURNALS // Avtomatika i Telemekhanika // Archive

Avtomat. i Telemekh., 2022 Issue 11, Pages 121–144 (Mi at16086)

Stochastic Systems

$\mathcal {L}_1$-optimal filtering of Markov jump processes. III. Identification of system parameters

A. V. Borisov

Federal Research Center “Computer Science and Control,” Russian Academy of Sciences, Moscow, 119333 Russia

Abstract: The present paper is a continuation of the series of articles [1, 2] and is devoted to solving the problem of estimating the parameters of hidden Markov models. The hidden state is a homogeneous Markov jump process with a finite set of states. The available observations are indirect and contain Wiener processes whose intensities are different and depend on the hidden state. Both the intensity matrix of Markov state transitions and the drift and diffusion parameters of the observations are subject to estimation. For identification, an iterative algorithm based on smoothing the state of the system based on observations over a fixed time interval is proposed. Then, according to these estimates, the parameters are reconstructed. The paper describes in detail all the numerical schemes for estimating the state and for identifying the parameters. A set of illustrative numerical examples is presented, demonstrating the high quality of the proposed identification estimates.

Keywords: hidden Markov model, multiplicative noise in observations, smoothing on fixed observation interval, $\mathcal {L}_1$, EM algorithm.

Presented by the member of Editorial Board: A. I. Kibzun

Received: 04.04.2022
Revised: 10.07.2022
Accepted: 28.07.2022

DOI: 10.31857/S0005231022110058


 English version:
Automation and Remote Control, 2022, 83:11, 1773–1791


© Steklov Math. Inst. of RAS, 2025