In this paper, we employ the Lyapunov theory to generalize the finite time stability (FTS) results from general deterministic impulsive systems to impulsive stochastic time-varying systems, which overcomes inherent challenges. Sufficient conditions for the FTS of the system under stabilizing and destabilizing impulses are established by using the method of average dwell interval (ADT). For FTS of stabilizing impulses, we relax the constraint on the differential operator by allowing it to be indefinite rather than strictly negative or semi-negative definite. Furthermore, the theoretical results are applied to impulsive stochastic neural networks. Finally, two numerical examples are given to validate the reliability and practicability of the obtained results.