RUS  ENG
Full version
JOURNALS // Problemy Peredachi Informatsii // Archive

Probl. Peredachi Inf., 2017 Volume 53, Issue 2, Pages 3–15 (Mi ppi2232)

This article is cited in 1 paper

Information Theory

Entropy of a stationary process and entropy of a shift transformation in its sample space

B. M. Gurevichab

a Kharkevich Institute for Information Transmission Problems, Russian Academy of Sciences, Moscow, Russia
b Lomonosov Moscow State University, Moscow, Russia

Abstract: We construct a class of non-Markov discrete-time stationary random processes with countably many states for which the entropy of the one-dimensional distribution is infinite, while the conditional entropy of the “present” given the “past” is finite and coincides with the metric entropy of a shift transformation in the sample space. Previously, such situation was observed in the case of Markov processes only.

UDC: 621.391.1+519.2

Received: 16.06.2016
Revised: 06.11.2016


 English version:
Problems of Information Transmission, 2017, 53:2, 103–113

Bibliographic databases:


© Steklov Math. Inst. of RAS, 2025