Inorganic insulating powder can potentially be used in nuclear power plant cables, fire-resistant cables, and so on due to its high heat resistance and radiation resistance. It is of great academic and engineering value to study the dielectric properties of inorganic insulating powder. In this paper, we aim to study the nonlinear dielectric properties via the measurement of the time-domain polarization current spectrum under the application of a DC electric field. Three kinds of silica powders are measured by a measurement system with adjustable pressure. The effects of powder shape, particle size, and packing pressure and temperature on the dependence of relaxation polarization and electrical conductivity on the applied electric field are studied. The experimental results show that the relationship between electrical conductivity and the electric field of inorganic insulating powder presents two different characteristics, i.e., field-induced enhancement and field-induced weakening. The relationship between conductance and temperature shows an increase with temperature. That is, the electrical conductivity increases or decreases with the increase in temperature. The inorganic powder insulation can be regarded as a composite, which is composed of inorganic powder particles and air gaps. The interface between the powder particles and air gaps contributes a lot to the polarization of inorganic insulating powder. The phenomena (including the field-induced weakening characteristic between relaxation polarization and electric field and the decrease characteristic of polarization with increasing temperature) can be explained by a simplified interface polarization mechanism.