This paper presents a novel evolutionary algorithm entitled Dynamic Partition Search Algorithm (DPSA) for global optimization problems with continuous variables. The DPSA is a population-based stochastic search algorithm in nature, which mainly consists of initialization process and evolution process. In the initialization process, the DPSA randomly generates an initial population of members from a specific search space and finds a leader. In the evolution process, the DPSA applies two groups to balance exploration ability and exploitation ability, in which one group is in charge of exploring new region via a dynamic partition strategy, and the other group relies on Cauchy distributions to exploit the region around the best member. Later, numerical experiments are conducted for 24 classical benchmark functions with 100, 1000 or even 10000 dimensions. And the performance of the proposed DPSA is compared with a state-of-the-art cooperative coevolving particle swarm optimization (CCPSO2), and two existing differential evolution (DE) algorithms. The experimental results show that DPSA has a better performance than the algorithms used for comparison, especially for high dimensional optimization problems. In addition, the numerical computational results also demonstrate that the DPSA has good scalability, and it is an effective evolutionary algorithm for solving large-scale global optimization problems.