An analytical method of stochastic seismic response and reliability analysis of hysteretic structures based on the theory of Markov vector process is presented, especially from the methodological aspect. To formulate the above analysis in the form of stochastic differential equations, the differential formulations of general constitutive laws for a class of hysteretic characteristics are derived. The differential forms of the seismic safety measures such as the maximum ductility ratio, cumulative plastic deformation, low-cycle fatigue damage are also derived. The state equation governing the whole nonlinear dynamical system which is composed of the shaping filter generating seismic excitations, hysteretic structural system and safety measures is determined as the Itô stochastic differential equations. By introducing an appropriate non-Gaussian joint probability density function, the statistics and joint probability density function of the state variables can be evaluated numerically under nonstationary state. The merit of the proposed method is in systematically unifying the conventional response and reliability analyses into an analysis which requires knowledge of only first order (single-time) statistics or probability distributions.