This paper is a review, which focuses on our work, while including an analysis of many works of other researchers in the field of quaternionic regularization. The regular quaternion models of celestial mechanics and astrodynamics in the Kustaanheimo-Stiefel (KS) variables and Euler (Rodrigues-Hamilton) parameters are analyzed. These models are derived by the quaternion methods of mechanics and are based on the differential equations of the perturbed spatial two-body problem and the perturbed spatial central motion of a point particle. This paper also covers some applications of these models. Stiefel and Scheifele are known to have doubted that quaternions and quaternion matrices can be used efficiently to regularize the equations of celestial mechanics. However, the author of this paper and other researchers refuted this point of view and showed that the quaternion approach actually leads to efficient solutions for regularizing the equations of celestial mechanics and astrodynamics.This paper presents convenient geometric and kinematic interpretations of the KS transformation and the KS bilinear relation proposed by the present author. More general (compared with the KS equations) quaternion regular equations of the perturbed spatial two-body problem in the KS variables are presented. These equations are derived with the assumption that the KS bilinear relation was not satisfied. The main stages of the quaternion theory of regularizing the vector differential equation of the perturbed central motion of a point particle are presented, together with regular equations in the KS variables and Euler parameters, derived by the aforementioned theory. We also present the derivation of regular quaternion equations of the perturbed spatial two-body problem in the Levi-Civita variables and the Euler parameters, developed by the ideal rectangular Hansen coordinates and the orientation quaternion of the ideal coordinate frame.This paper also gives new results using quaternionic methods in the perturbed spatial restricted three-body problem.