Absence of bottlenecks in a neural network determines its generic functional properties

It is proved that an artificial neural network with smooth activation functions and without bottlenecks is a Morse function for almost all, with respect to the Lebesgue measure, sets of weights.