In this paper, we propose a novel optimization approach to designing wideband infinite impulse response (IIR) digital fractional order differentiators (DFODs) with improved accuracy at low frequency bands. In the new method, the objective function is formulated as an optimization problem with two tuning parameters to control the error distribution over frequencies. The gradient based optimizer (GBO) is effectively employed on the proposed objective function. A wide range of design examples are presented to illustrate the effectiveness of the proposed approach. The proposed approximations are compared to those of recent literature in terms magnitude, phase, and group delay errors. The result reveal that our method can attain approximations have a favorable low frequency performance (with about 60% of relative magnitude error reduction) and maintain a comparable accuracy at most of the Nyquist band to those of the existing ones. Thus, our approximations can be attractive for low frequency applications.