RUS  ENG
Full version
JOURNALS // Avtomatika i Telemekhanika // Archive

Avtomat. i Telemekh., 2017 Issue 8, Pages 91–99 (Mi at14857)

Stochastic Systems

Non-uniqueness of solutions of the Hamilton–Jacobi–Bellman equation for time-average control

S. V. Anulova

Trapeznikov Institute of Control Sciences, Russian Academy of Sciences, Moscow, Russia

Abstract: In control of diffusion processes a very useful instrument is the equation for optimal strategy and cost. For the version of infinite time horizon with time averaging this equation is much more complicated than for the version of finite time horizon, and even than for the version of infinite time horizon with discounting. In particular, the equation solution may be non-unique. This problem of non-uniqueness is researched in book of A. Arapostathis et al., 2012, for special models – near-monotone. The result received in the book is extended in the article to an important general case—models with restrictions in control which guarantee ergodicity of the process. Besides we correct the proofs from the book.

Keywords: $1$-dimensional diffusion process, non-degenerate diffusion, ergodic control, Hamilton-Jacobi-Bellman equation, non-uniqueness of solutions to Hamilton–Jacobi–Bellman equation.

Presented by the member of Editorial Board: B. M. Miller

Received: 12.12.2016


 English version:
Automation and Remote Control, 2017, 78:8, 1430–1437

Bibliographic databases:


© Steklov Math. Inst. of RAS, 2025