Abstract:
It is shown that the continuous Kiefer–Wolfowitz procedure for estimating the maximum of a regression surface converges, under some conditions, almost surely to the maximum.
An analoguos result is proved for the continuous Robbins–Monro procedure of stochastic approximation.