RUS  ENG
Full version
JOURNALS // Problemy Upravleniya // Archive

Probl. Upr., 2010 Issue 1, Pages 7–11 (Mi pu2)

Mathematical problems of control theory

Maximizing the time until a controlled random walk in the quadrant hits the boundary

S. V. Anulova

Institute of Control Sciences, Russian Academy of Sciences

Abstract: At every moment the control acts on only one of the two coordinates of the random walk with a fixed impact. A strategy, optimal for a whole family of criteria (mean hitting time, probability of never hitting, and so on) has been found. Solving the Bellman equation has been avoided owing to favorable properties of the model: symmetry, monotonicity, decomposability. The model has arisen while studying economic problems.

Keywords: controlled random walk, Bellman equation.

UDC: 519.217.8;330.46



© Steklov Math. Inst. of RAS, 2025