Due to their great potential for energy conservation and emission reduction, electric vehicles (EVs) have attracted the attention of governments around the world and become more popular. However, the high penetration rate of EVs has brought great challenges to the operation of the Active Distribution Network (ADN). On the other hand, EVs will be equipped with more intelligent chargers in the future, which supports the EVs’ high flexibility in both active and reactive power control. In this paper, a distributed optimization model of ADN is proposed by employing the collaborative active and reactive power control capability of EVs. Firstly, the preference of EV users is taken into account and the charging mode of EVs is divided into three categories: rated power charging, non-discharging, and flexible charging–discharging. Then, the reactive power compensation capacity of the plugged-in EV is deduced based on the circuit topology of the intelligent charger and the active–reactive power control model of the EV is established subsequently. Secondly, considering the operation constraints of ADN and the charging–discharging constraints of EVs over the operation planning horizon, the optimization objective of the model is proposed, which consists of two parts: “minimizing energy cost” and “improving voltage profile”. Finally, a distributed solution method is proposed based on the Alternating Direction Method of Multipliers (ADMM). The proposed model is implemented on a 33-bus ADN. The obtained results demonstrate that it is beneficial to achieve lower energy cost and increase the voltage profile of the ADN. In addition, the energy demand of EV batteries in their plugin intervals is met, and the demand preference of EV users is guaranteed.