Cost-capacity problem as a “dual” to the rate-distortion theory

Abstract

A cost-capacity problem in information theory will be discussed. This problem is a dual to the rate-distortion problem raised and solved by C.E. Shannon. Although the problem might be a little extension of usual information theory without cost consideration, the following problems will be solved: how the amount of information is limited by cost, and how we can “pack” information in the transmission channel for a given allowable cost. A few examples for cost-capacity function will also be given.