RUS  ENG
Full version
JOURNALS // Dal'nevostochnyi Matematicheskii Zhurnal // Archive

Dal'nevost. Mat. Zh., 2002 Volume 3, Number 1, Pages 58–60 (Mi dvmg116)

This article is cited in 1 paper

Stochastic control of discrete Markov process parameter

G. Sh. Tsitsiashvili, M. A. Osipova

Institute of Applied Mathematics, Far-Eastern Branch of the Russian Academy of Sciences

Abstract: Consider a functioning of discrete Markov process in random environment. That is the process behavior is defined by some randomly varying parameter. Suppose that stationary distributions of the process under fixed meanings of the parameter are known. A problem is to choose rules of parameter ramdom variation so that the stationary distribution of obtained process equals to probability mixture of stationary distributions of this process under fixed parameter meanings. Traditional product theorem gives a respond to this question only if stationary distributions, which correspond to the fixed parameter meanings, coincide with each other. In this paper new and sufficiently simple condition on random parameter variation is introduced. This condition gives a solution of considered problem in general case.

UDC: 519.2

MSC: Primary 60K25; Secondary 60K30

Received: 19.03.2002



© Steklov Math. Inst. of RAS, 2024