A banded matrix iterative approach is applied to study the scattering of a TM incident wave from a perfectly conducting one-dimensional random rough surface. It is accurate and is much faster than the full matrix inversion approach or the conjugate gradient method. Applications of this method to large-scale rough surface problems are illustrated.