Online estimation of a smooth regression function

The tracking (recursive) type estimator for a one-dimensional regression estimation problem with equidistant design is proposed. It is proven that, out of the inevitable initial layer, this estimator has the optimal rate of convergence of quadratic risk to zero if the sample size goes to infinity.