A counterpart of Jensen's discrete inequality for differentiable convex mappings and applications in information theory

Abstract

We derive a counterpart of Jensen's discrete inequality for differentiable convex mappings defined on open subsets of R n . The result is applied to several convex functions. In particular, we obtain some meaningful bounds for entropy, conditional entropy, and mutual information arising from the theory of information.