In closed loop identification of an unknown control system, the stability is a big concern particularly when the system does not proceed with sufficient excitation. In this paper, under insufficient excitation of the system, identification and control are investigated by employing Evolving Linear Models (ELMs). It is explained that under weak stimulation, linear correlations between input and output signals and their derivations are occurred. Removing some correlated variables through the time, an equivalent reduced order model of the original system is appeared, which can be identified as an ELM. Defining control law based on the sliding mode control (SMC) and using appropriate adaptation rules for parameters of the model, the tracking errors converge to zero and the stability of the system is guaranteed. Then, convergence of the parameters to their true values is studied and discussed. Different simulations are given to demonstrate the efficacy of the proposed closed loop identification approach.