This article discusses the issue of robust stability analysis for a class of Markovian jumping stochastic neural networks (NNs) with probabilistic time‐varying delays. The jumping parameters are represented as a continuous‐time discrete‐state Markov chain. Using the stochastic stability theory, properties of Brownian motion, the information of probabilistic time‐varying delay, the generalized Ito's formula, and linear matrix inequality (LMI) technique, some novel sufficient conditions are obtained to guarantee the stochastical stability of the given NNs. In particular, the activation functions considered in this article are reasonably general in view of the fact that they may depend on Markovian jump parameters and they are more general than those usual Lipschitz conditions. The main features of this article are described in the following: first one is that, based on generalized Finsler lemma, some improved delay‐dependent stability criteria are established and the second one is that the nonlinear stochastic perturbation acting on the system satisfies a class of Lipschitz linear growth conditions. By resorting to the Lyapunov–Krasovskii stability theory and the stochastic analysis tools, sufficient stability conditions are established using an efficient LMI approach. Finally, two numerical examples and its simulations are given to demonstrate the usefulness and effectiveness of the proposed results. © 2014 Wiley Periodicals, Inc. Complexity 21: 59–72, 2016