RUS  ENG
Full version
JOURNALS // Teoriya Veroyatnostei i ee Primeneniya // Archive

Teor. Veroyatnost. i Primenen., 1960 Volume 5, Issue 1, Pages 29–37 (Mi tvp4811)

This article is cited in 8 papers

Limit Approach under the Signs of Information and Entropy

R. L. Dobrushin

Moscow

Abstract: The main result of this paper amounts to the following statement: If a sequence of pairs of random variables $(\xi_n,\eta_n)$ is given and this sequence converges in variation to a pair of random variables $(\xi,\eta)$, then $\lim _{n\to\infty}I(\xi_n,\eta_n)=I(\xi,\eta)(I(\xi,\eta)$ is the information of the pair $(\xi,\eta)$ if and only if the sequence of corresponding information densities is uniformly integrable. A similar result is proved for entropies and for a new concept in information within a probability $E$ of events. Conditions are found for the convergence of these quantities.

Received: 13.05.1959


 English version:
Theory of Probability and its Applications, 1960, 5:1, 25–32


© Steklov Math. Inst. of RAS, 2024