RUS  ENG
Full version
JOURNALS // Teoriya Veroyatnostei i ee Primeneniya // Archive

Teor. Veroyatnost. i Primenen., 1976 Volume 21, Issue 1, Pages 157–163 (Mi tvp3304)

This article is cited in 5 papers

Short Communications

A finite controlled Markov chain with small break probability

R. Ya. Čitašvili

Institute of Economics and Law of Academy of Sciences of GSSR, Tbilisi

Abstract: The paper deals with a controlled Markov chain with a finite number of states $s\in S$ and a finite number of decisions $a\in A$. The optimality criterion is defined by $\mathbf E^{\pi}\widetilde L$, where $\widetilde L$ is a functional invariant with respect to shifts of the trajectory $(s_n,a_n;\,n\ge 1)$, and can be approximated, for small break probabilities, by the criterion defined by $\mathbf E^{\pi}c(s_{\tau},a_{\tau})$. Existence of an optimal stationary policy is proved, and a method for its construction is given.

Received: 05.08.1974


 English version:
Theory of Probability and its Applications, 1976, 21:1, 158–163

Bibliographic databases:


© Steklov Math. Inst. of RAS, 2024