RUS  ENG
Full version
JOURNALS // Avtomatika i Telemekhanika // Archive

Avtomat. i Telemekh., 2022 Issue 9, Pages 109–127 (Mi at15931)

This article is cited in 1 paper

Stochastic Systems

Practical implementation of the solution of the stabilization problem for a linear system with discontinuous random drift by indirect observations

A. V. Borisov, A. V. Bosov

Federal Research Center “Computer Science and Control,” Russian Academy of Sciences, Moscow, 119333 Russia

Abstract: We study the implementation of the optimal control strategy obtained in [1] and supplemented in [2]. The algorithm for optimal stabilization of a linear stochastic differential system in a position determined by a piecewise constant Markov drift has been tested in a substantial number of model experiments. The drift value is observed indirectly; i.e., the control problem is solved in the statement with incomplete information. Practical implementation is complicated by the instability of Euler–Maruyama numerical schemes that implement the Wonham filter, which is a key element of the optimal control strategy. To perform calculations, the Wonham filter is approximated by stable schemes based on the optimal filtering of Markov chains by discretized observations [3]. These schemes have different implementation complexity and orders of accuracy. The paper presents a comparative analysis of the control performance for various stable approximations to the Wonham filter and its typical implementation using the Euler–Maruyama scheme. In addition, three versions of discretized filters are compared and final recommendations are given for their application in the problem of stabilizing a system with hopping drift.

Keywords: linear differential system control, continuous-time Markov chain, quadratic objective function, Wonham filter, Euler-Maruyama scheme, discretized filter.

Presented by the member of Editorial Board: B. M. Miller

Received: 05.04.2022
Revised: 15.05.2022
Accepted: 10.06.2022

DOI: 10.31857/S0005231022090069


 English version:
Automation and Remote Control, 2022, 83:9, 1417–1432


© Steklov Math. Inst. of RAS, 2024