RUS  ENG
Full version
JOURNALS // Problemy Peredachi Informatsii // Archive

Probl. Peredachi Inf., 2021 Volume 57, Issue 4, Pages 24–33 (Mi ppi2352)

This article is cited in 1 paper

Information Theory

On the maximum $f$-divergence of probability distributions given the value of their coupling

V. V. Prelov

Kharkevich Institute for Information Transmission Problems, Russian Academy of Sciences, Moscow, Russia

Abstract: The paper is a supplement to the author's paper [1]. Here we present explicit upper bounds (which are optimal in some cases) on the maximum value of the $f$-divergence $D_f(P \| Q)$ of discrete probability distributions $P$ and $Q$ provided that the distribution $Q$ (or its minimal component $q_{\min}$) and the value of the coupling of $P$ and $Q$ are fixed. We also obtain an explicit expression for the maximum value of the divergence $D_f(P \| Q)$ provided that only the value of the coupling of $P$ and $Q$ is given. Results of [1] concerning the Kullback–Leibler divergence and $\chi^2$-divergence are particular cases of the results proved in the present paper.

Keywords: $f$-divergence, Kullback–Leibler divergence, $\chi^2$-divergence, coupling of discrete probability distributions.

UDC: 621.391 : 519.72

Received: 12.11.2021
Revised: 16.11.2021
Accepted: 16.11.2021

DOI: 10.31857/S0555292321040021


 English version:
Problems of Information Transmission, 2021, 57:4, 321–330

Bibliographic databases:


© Steklov Math. Inst. of RAS, 2025