In this paper, a parallel form FIR adaptive filter structure with RLS (Recursive Least Squares) type adaptive algorithm is proposed. The proposed parallel form FIR structure consists of a recursive orthogonal transform stage and sparse FIR sub filters operating in parallel. The adaptive algorithm used to update coefficient vector of the sparse filters is implemented by using modified Hopfield networks. This structure implements the RLS-type adaptive algorithm, without an explicit matrix inversion avoiding numerical instability problems. Simulation results which show the desirable features of proposed structure are given.