The flux pinning effect of YBa2Cu3O7-x high temperature superconducting (HTS) bulk can achieve self-stable levitation over a permanent magnet or magnet array. Devices based on this phenomenon have been widely developed. However, the self-stable flux pinning effect is not unconditional, under disturbances, for example. To disclose the roots of this amazing self-stable levitation phenomenon in theory, mathematical and mechanical calculations using Lyapunov's stability theorem and the Hurwitz criterion were performed under the conditions of magnetic levitation and suspension of HTS bulk near permanent magnets in Halbach array. It is found that the whole dynamical system, in the case of levitation, has only one equilibrium solution, and the singular point is a stable focus. In the general case of suspension, the system has two singular points: one is a stable focus, and the other is an unstable saddle. With the variation of suspension force, the two first-order singular points mentioned earlier will get closer and closer, and finally degenerate to a high-order singular point, which means the stable region gets smaller and smaller, and finally vanishes. According to the center manifold theorem, the high-order singular point is unstable. With the interaction force varying, the HTS suspension dynamical system undergoes a saddle-node bifurcation. Moreover, a deficient damping can also decrease the stable region. These findings, together with existing experiments, could enlighten the improvement of HTS devices with strong anti-interference ability.