An approach was developed to describe the first passage time (FPT) in multistep stochastic processes with discrete states governed by a master equation (ME). The approach is an extension of the totally absorbing boundary approach given for calculation of FPT in one-step processes [N. G. Van Kampen, Stochastic Processes in Physics and Chemistry (Elsevier Science Publishers, North Holland, Amsterdam, 2007)] to include multistep processes where jumps are not restricted to adjacent sites. In addition, a Fokker-Planck equation (FPE) was derived from the multistep ME, assuming the continuity of the state variable. The developed approach and an FPE based approach [C. W. Gardiner, Handbook of Stochastic Methods, 3rd ed. (Springer-Verlag, New York, 2004)] were used to find the mean first passage time (MFPT) of the transition between the negative and positive stable macrostates of dust grain charge when the charging process was bistable. The dust was in a plasma and charged by collecting ions and electrons, and emitting secondary electrons. The MFPTs for the transitioning of grain charge from one macrostate to the other were calculated by the two approaches for a range of grain sizes. Both approaches produced very similar results for the same grain except for when it was very small. The difference between MFPTs of two approaches for very small grains was attributed to the failure of the charge continuity assumption in the FPE description. For a given grain, the MFPT for a transition from the negative macrostate to the positive one was substantially larger than that for a transition in a reverse order. The normalized MFPT for a transition from the positive to the negative macrostate showed little sensitivity to the grain radius. For a reverse transition, with the increase of the grain radius, it dropped first and then increased. The probability density function of FPT was substantially wider for a transition from the positive to the negative macrostate, as compared to a reverse transition.