RUS  ENG
Full version
JOURNALS // Avtomatika i Telemekhanika // Archive

Avtomat. i Telemekh., 2021 Issue 12, Pages 90–104 (Mi at15853)

This article is cited in 4 papers

Stochastic Systems

An analytical method for the analysis of inhomogeneous continuous Markov processes with piecewise constant transition intensities

K. A. Vytovtov, E. A. Barabanova

Trapeznikov Institute of Control Sciences, Russian Academy of Sciences, Moscow, 117997 Russia

Abstract: The article deals with an inhomogeneous Markov process with finitely many discrete states, continuous time, and piecewise constant transition intensities. For the first time, analytical expressions are presented that describe both the transient and steady-state modes of the random process. To solve this problem, the fundamental matrix of the Kolmogorov system of differential equations is found in closed form in terms of elementary functions. In addition, an inhomogeneous process with periodically varying transition intensities is considered. For this case, the conditions for the existence of a steady-state mode are presented. Results of numerical calculations are provided for processes without jumps, with jumps, and with periodic jumps in the transition intensities.

Keywords: inhomogeneous Markov process, piecewise constant transition intensity, Kolmogorov equation.

Presented by the member of Editorial Board: B. M. Miller

Received: 29.01.2021
Revised: 03.05.2021
Accepted: 30.06.2021

DOI: 10.31857/S0005231021120060


 English version:
Automation and Remote Control, 2021, 82:12, 2112–2124

Bibliographic databases:


© Steklov Math. Inst. of RAS, 2024