This paper investigates the asymptotic and nonasymptotic behavior of the quantized primal-dual (PD) algorithm in network utility maximization (NUM) problems, in which a group of agents maximizes the sum of their individual concave objective functions under linear constraints. In the asymptotic scenario, we use the information-theoretic notion of differential entropy power to establish universal bounds on the maximum exponential convergence rates of joint PD, primal and dual variables under optimum-achieving quantization schemes. These results provide tradeoffs between the speed of exponential convergence, the agents' objective functions, the communication bit rates, and the number of agents and constraints. In the nonasymptotic scenario, we obtain lower bounds on the mean square distance of joint PD, primal and dual variables from the optimal solution at any time instant. These bounds hold regardless of the quantization scheme used.