Abstract The problem of recursive robust identification of linear discrete-time dynamic stochastic systems is discussed. Supposing approximately Gaussian system disturbance samples, a general form of robustified recursive identification algorithms of stochastic approximation type, characterized by an adequate nonlinear residual transformation, is defined. In order to improve the convergence rate, especially on short data sequences, the weighting matrix of the algorithm is derived by performing step-by-step optimization of a predefined empirical criterion. The convergence of the estimates w.p.l. is established theoretically by using martingale theory. The theoretical results are followed by extensive Monte Carlo simulation results, providing a basis for making a precise judgement of real practical robustness of the algorithms. Important relationships between parameters describing the algorithms are pointed out.