Limit theorems for stopped random sequences. I: Rates of convergence and asymptotic expansions

Stopped random sequences with record regeneration are considered and limit theorems refining the normal approximation are proved. Particular cases of such sequences are stopped random walks, recurrent Markov renewal processes, and certain procedures of sequential estimation.