RUS  ENG
Full version
JOURNALS // Teoriya Veroyatnostei i ee Primeneniya // Archive

Teor. Veroyatnost. i Primenen., 1975 Volume 20, Issue 4, Pages 855–864 (Mi tvp3366)

This article is cited in 20 papers

Short Communications

A controlled finite Markov chain with arbitrary set of decisions

R. Ya. Chitashvili

Instutite of economics and law, Academy of Sciences, Georgian SSR

Abstract: We consider a controlled Markov chain with a finite set $S$ of states $s$ and an arbitrary set $A$ of decisions $a$ and with the optimality criterion of the form
$$ \mathbf E^\pi\biggl[\sum_{n=1}^\tau r(s_n,a_n)+c(s_\tau,a_\tau)\biggr], $$
where the stopping moment $\tau$ does not depend on $(s_n,a_n);n\ge1)$ and has the geometric distribution.
Sufficient conditions for the existence of $(k,\varepsilon)$-optimal policies are found.

Received: 15.08.1974


 English version:
Theory of Probability and its Applications, 1976, 20:4, 839–847

Bibliographic databases:


© Steklov Math. Inst. of RAS, 2024