In this paper, stable indirect adaptive control with recurrent neural networks (RNN) is presented for square multivariable non-linear plants with unknown dynamics. The control scheme is made of an adaptive instantaneous neural model, a neural controller based on fully connected “Real-Time Recurrent Learning” (RTRL) networks and an online parameters updating law. Closed-loop performances as well as sufficient conditions for asymptotic stability are derived from the Lyapunov approach according to the adaptive updating rate parameter. Robustness is also considered in terms of sensor noise and model uncertainties. This control scheme is applied to the manipulator robot process in order to illustrate the efficiency of the proposed method for real-world control problems.