Rolling bearings are extensively employed in industrial production as essential support components for rotating machinery. However, under conditions of high load and harsh operation, bearings are highly susceptible to failure. The weak vibration signals associated with these failures may be obscured by complex harmonic interference and strong noise, posing challenges for the accurate diagnosis of rolling bearing failures. In this paper, an autoregressive integrated moving average and competitive K-singular value decomposition (ARIMA-CK-SVD) algorithm is proposed to realize effective extraction of faulty pulse signals in a strong interference environment. First, the ARIMA model is used to preprocess the original signal to eliminate the interference of harmonic components. Second, a method is proposed for the adaptive selection of parameters in the ARIMA model, with consideration given to the characteristics of K-SVD. Subsequently, a competitive mechanism is introduced during the dictionary update phase of the algorithm to adjust the pattern of atomic updates and eliminate noise atoms. Finally, the effectiveness of the ARIMA-CK-SVD has been validated through simulation experiments and engineering tests.