On optimizing the control in stochastic discrete time systems by stochastic approximation

The paper discusses the problem of optimal control in stochastic systems with finite state and control spaces with rather general assumptions on the sequence of noises. Convergence, in a certain sense, of the proposed process stochastic approximation based solution is proven.