For early mechanical fault diagnosis, stochastic resonance (SR) breaks the previous perception that “noise is useless” and uses internal noise or external noise to enhance weak fault characteristics. Moreover, the fractional-order derivative can reinforce noise-enhanced weak fault detection. However, in the face of extremely low signal-to-noise ratio conditions, the enhancement effect of fractional SR induced by a single excitation of internal noise or external noise is unsatisfactory. To solve the above drawbacks, this paper investigates two-stage benefits of both internal and external noise to enhance early fault detection of machinery by exciting parallel array of fractional SR, and using the signal-to-noise ratio (SNR) to adjust these parameters of fractional SR. Then, two experiments including rolling element bearings and gearboxes were performed to validate it. Experimental results show that the proposed method takes on obvious detection ability for low SNR signals, where the amplitude at the fault characteristic frequency is amplified by beyond 300 times in bearing and gearbox fault experiments than one-stage those. In addition, it is also found that as the noise intensity and the number of iterations increase, the amplitude at the fault characteristic frequency tends to the peak value and then falls into a saturation value. Finally, compared with empirical mode decomposition (EMD), the proposed method can amplify the amplitude at the fault characteristic frequency beyond 1000 times in bearing and gearbox fault experiments. It was concluded that the proposed method has obvious advantages in extracting weak fault characteristics of machinery submerged by strong background noise.