Methods for solving constrained extremum problems in the presence of random noise

The extemum problem with equation-type constraints is considered, when the measurements of all functions and their gradients are subject to noise. Three methods of solution are described: they are modifications of the method of Lagrange multipliers, the method of penalty functions, and the method of penalty estimates respectively. The methods are shown to be convergent in a specific probability sense.