The application of the spectral representation method in generating Gaussian and non-Gaussian fractal rough surfaces is studied in this work. The characteristics of fractal rough surfaces simulated by the spectral representation method and the conventional Fast Fourier transform filtering method are compared. Furthermore, the fractal rough surfaces simulated by these two methods are compared in the simulation of contact and lubrication problems. Next, the influence of low and high cutoff frequencies on the normality of the simulated Gaussian fractal rough surfaces is investigated with roll-off power spectral density and single power-law power spectral density. Finally, a simple approximation method to generate non-Gaussian fractal rough surfaces is proposed by combining the spectral representation method and the Johnson translator system. Based on the simulation results, the current work gives recommendations on using the spectral representation method and the Fast Fourier transform filtering method to generate fractal surfaces and suggestions on selecting the low cutoff frequency of the power-law power spectral density. Furthermore, the results show that the proposed approximation method can be a choice to generate non-Gaussian fractal surfaces when the accuracy requirements are not high. The MATLAB codes for generating Gaussian and non-Gaussian fractal rough surfaces are provided.