Bayesian Learning for Pattern Classification in the Class of Density Functions Representable as the Square of the Sum of an Orthogonal Series

We solve the Bayesian learning problem for pattern classification in a wide class of smooth densities. A simple lower bound on risk is obtained, characterizing the potential solvability of the classification problem using a learning sample of a given (preferably small) volume.