Many complex systems exhibit critical transitions. Of considerable interest are bifurcations, small smooth changes in underlying drivers that produce abrupt shifts in system state. Before reaching the bifurcation point, the system gradually loses stability ('critical slowing down'). Signals of critical slowing down may be detected through measurement of summary statistics, but how extrinsic and intrinsic noises influence statistical patterns prior to a transition is unclear. Here, we consider a range of stochastic models that exhibit transcritical, saddle-node and pitchfork bifurcations. Noise was assumed to be either intrinsic or extrinsic. We derived expressions for the stationary variance, autocorrelation and power spectrum for all cases. Trends in summary statistics signaling the approach of each bifurcation depend on the form of noise. For example, models with intrinsic stochasticity may predict an increase in or a decline in variance as the bifurcation parameter changes, whereas models with extrinsic noise applied additively predict an increase in variance. The ability to classify trends of summary statistics for a broad class of models enhances our understanding of how critical slowing down manifests in complex systems approaching a transition.