With the gradual development of bidirectional interacted future distribution network, it is necessary to enter distributed clean power sources with various characteristics, including wind turbine and solar panel. Traditional centralized control has difficulties to fulfill the demands of future distribution networks for safe, stable, and efficient operation. Aiming at the constrained power allocation problem widely studied in smart grid, with the cooperative control algorithm of continuous multi-agent system, this paper proposed a distributed optimization allocation strategy, which is free by the initial state. The proposed distributed algorithm implements parameterization by adding auxiliary variables. In the iterative process, the algorithm only needs to know the state of the distributed power supply of the neighbor, and finally solve the global optimal solution of the system. The simulations prove that the proposed scheme can effectively improve the economic dispatch performance. Furthermore, comparing to the existing algorithm, the proposed algorithm achieves faster optimal solution.