As the development of renewable energy sources, rechargeable batteries play a more and more important role in many applications such as energy storage systems and new energy vehicles. Numerous cells are usually combined to provide the desired energy and power capacity. Equalization circuits are therefore essential to eliminate the inconsistency of the cells. Most of the present equalization techniques neglect the critical issue of equalization overlap that some cells are charged and discharged repetitively in a single equalization process with redundant energy transfer. It induces the degeneration of the equalization performance and the health of the batteries. Even for some techniques without equalization overlap for the in-module equalization, this issue still appears when combining the modules into a pack due to the coupling relationship between the modules and the cells. To address this problem, this paper proposes a novel decoupled and modularized architecture of equalization circuit. With the improved circuit design and the dedicated algorithm, the equalization overlap can be eliminated as possible. Experimental results show that the proposed approach can obviously reduce the equalization loss and improve the equalization efficiency and speed in comparison with the conventional techniques.