Reverberation is the main background interference for active sonar detection in shallow sea. Reverberation suppression is crucial for enhancing the performance of active sonar. In this paper, a reverberation suppression method based on low-rank sparse decomposition is proposed. First, both the sparseness property of the targets and the non-local self-correlation property of the reverberation are used to construct a range azimuth patch matrix model. The reverberation suppression problem is then transformed into an optimization problem for the recovery of a low-rank sparse matrix. The validity of the proposed method is verified by using the measured data. Results show that, compared with the reverberation pre-whitening and sparse fractional Fourier transform methods, the proposed method significantly improves the reverberation suppression performance and achieves a better detection result when the signal-to-interference ratio is below -2 dB.