Using the sea clutter image from X-Band radar for current retrieval is an effective way of obtaining information on ocean currents. Traditional methods used for current retrieval have been based on the least squares algorithm, which is not only simple and efficient but also generally speaking accurate. In order to improve the precision of current retrieval, this paper has, as its goal, the study of the used radar connected with sea clutter imaging for current retrieval, with the particle swarm optimization (PSO) algorithm being proposed. This method is achieved by obtaining a three-dimensional image spectrum, taking the high-order dispersion relation model as the theoretical distribution model of the wave energy points of three-dimensional image spectra, using a forward model within the PSO framework, and considering the requirements of the order of the model, weights and optimal distribution of the energy points, and so on in fitness function. Simulation results show that, compared with the traditional ILSM methods, the method provided in this paper is more flexible, with a capacity for a high dispersion relationship order, higher precision, and an increased stability in terms of current inversion.