Although various vibration energy harvesters have been designed over the past few decades, efforts to develop efficient, broadband energy harvesters continue. This work provides a detailed insight into a bistable vibration harvester subjected to correlated Gaussian white noise, with the friction between the rack and pinion described by the slip-stick model. Using the harmonic balance method, the frequency response curve of the amplitude under different mass ratios is discussed. The system response will be enhanced with an increased mass ratio for sinusoidal excitation, but not in the case of random excitation. By employing the stochastic average of the energy envelope, the dynamical governing equation of the harvester is solved, and the probability density functions (PDFs) under different damping coefficients, nonlinear stiffness of the restoring force, and excitation intensities are derived. The results are compared with those from Monte Carlo simulations (MCS) and show good accuracy. The results reveal the presence of P-bifurcations. When the nonlinear stiffness and damping coefficient vary, the number of peaks in the PDFs of system displacement and velocity changes. By adjusting the system parameters, the motion of the system can be significantly enhanced.