On sequentially controlled Markov processes

We consider Markov processes with continuous time, where the switching of the controls takes place at random (independent of the future) moments of time. We derive Bellman's cost equation and the existence of $(p,\varepsilon)$ optimal strategies, prove the measurability of cost and give an excessive characterization of cost.
Bibliography: 9 titles.