The dynamic crystallization during extreme thermomechanical history under producing or service strongly influences the dimensional stability of the semi-crystalline thermoplastic polymers. To produce high-precision structural components, the proper thermomechanical history needs to be carefully designed to eliminate the crystallization-induced shrinkage. On the contrary, the rapidly developed four-dimensional (4D) printing technology tries to amplify the crystallization-induced shrinkage to directly produce the complex curvatures without supporting materials. However, the crystals formed at different deformation states might have different orientations, leading to an anisotropic residual deformation. Therefore, tracing of all crystals formed with different initial configurations is the key issue to ensure the geometric accuracy of both the high-precision and the deformable components. In this study, we developed a continuous phase-evolution model for both the cold and the strain-induced crystallization in semi-crystalline thermoplastics. The irreversible cold crystallization is analogized as the raindrop falling into the pool, and the reversible strain-induced crystallization is analogized as the nonequilibrium liquid-gas phase transformation. Using the continuous phase-evolution concept, the crystal growth is described by a series of continuously formed crystal phases sequentially added into the initial amorphous medium. Each newly formed crystal phase is in a stress-free state at the formation moment, and therefore the crystallization history coupled with the whole deformation history can be memorized. By introducing the oriented growth tensor representing the stress-free state of all formed crystals, the deformation-history dependent anisotropic crystallization and the corresponding residual deformation can be traced. The developed model is validated by comparing with the experimental data of the dynamic crystallization in amorphous poly l-lactide polymers under thermomechanical loading cycles. Finally, the predictive capability of the model is illustrated by several demonstrations, to show the influences of deformation-history dependent crystallization orientations and the corresponding anisotropic residual deformation.