RUS  ENG
Full version
JOURNALS // Informatika i Ee Primeneniya [Informatics and its Applications] // Archive

Inform. Primen., 2016 Volume 10, Issue 4, Pages 72–88 (Mi ia447)

This article is cited in 10 papers

Analytical solution of the optimal control task of a semi-Markov process with finite set of states

P. V. Shnurkova, A. K. Gorsheninb, V. V. Belousovb

a National Research University Higher School of Economics, 34 Tallinskaya Str., Moscow, 123458, Russian Federation
b Institute of Informatics Problems, Federal Research Center "Computer Science and Control" of the Russian Academy of Sciences, 44-2 Vavilova Str., Moscow 119333, Russian Federation

Abstract: The theoretical verification of the new method of finding the optimal strategy of control of a semi-Markov process with finite set of states is presented. The paper considers Markov randomized strategies of control, determined by a finite collection of probability measures, corresponding to each state. The quality characteristic is the stationary cost index. This index is a linear-fractional integral functional, depending on collection of probability measures, giving the strategy of control. Explicit analytical forms of integrands of numerator and denominator of this linear-fractional integral functional are known. The basis of consequent results is the new generalized and strengthened form of the theorem about an extremum of a linear-fractional integral functional. It is proved that problems of existence of an optimal control strategy of a semi-Markov process and finding this strategy can be reduced to the task of numerical analysis of global extremum for the given function, depending on finite number of real arguments.

Keywords: optimal control of a semi-Markov process; stationary cost index of quality control; linear-fractional integral functional.

Received: 15.07.2016

DOI: 10.14357/19922264160408



Bibliographic databases:


© Steklov Math. Inst. of RAS, 2024