RUS  ENG
Full version
JOURNALS // Matematicheskoe modelirovanie // Archive

Matem. Mod., 2017 Volume 29, Number 5, Pages 133–146 (Mi mm3853)

This article is cited in 2 papers

Numerical methods of identification for discrete-state continuous-time Markov processes

L. S. Kuravsky, P. A. Marmalyuk, G. A. Yuryev, P. N. Dumin

Moscow State University of Psychology and Education, Computer Science Faculty

Abstract: A numerical technique for identification of discrete-state continuous-time Markov models is presented. Appropriate algorithms including gradient method, the exhaustive search method and the brute force of significant parameters based on sensitivity analysis of minimization criterion are presented. A study of performance characteristics was carried out, the procedure and conditions of computer experiments are presented including types of models in use, parameters of the algorithms, parameters of the computer system. Analysis of computer experiments showed advantages of the developed identification methods over the classical first order gradient method.

Keywords: Markov models, models identification, multivariate non-linear optimization.

Received: 05.05.2016



Bibliographic databases:


© Steklov Math. Inst. of RAS, 2024