Two-stage double-suction centrifugal pumps have both a large flow and high head. However, due to the complexity of their flow passage components, efficiency has always been a major problem, and the corresponding head is also prone to insufficiency. In this study, an improved design for a two-stage double-suction centrifugal pump unit with a specific speed of 25.9 was developed with the help of a computer. The computational fluid dynamics (CFD) method was used to evaluate the performance and loss of the unit in the process of improvement. The unit’s inlet division section, two semi-spiral suction chambers, two impellers for the first stage, two inter-stage channels, a double-suction impeller for the second stage, and the volute were able to be improved. Through a total of 39 improvements, the efficiency under multiple working conditions was comprehensively improved, and the head had a reasonable margin in meeting the requirements. After the improvements, the flow pattern in the inter-stage channel and volume were significantly improved through the check of the streamline. This research successfully improved the performance of a two-stage double-suction centrifugal pump unit, and it has significant engineering value.