The damage evolution and ignition mechanism of high explosives are of great importance in assessing the safety of munitions and guiding the design of munitions. In this study, the smoothed particle hydrodynamics (SPH) method is combined with a viscoelastic–viscoplastic-damage constitutive model and a hot spot model to explore the damage and ignition responses of high explosives under low-velocity impact. In particular, the sub-particle method is developed in the SPH method to combine the macroscopic constitutive model with the mesoscopic hot spot model. First, the damage evolution of a compressed plate containing a cavity and the ignition response of a single particle at a given pressure and strain rate are studied separately, and the simulation results are validated by experimental results and existing finite element method simulations. Subsequently, the impact shear and crack extrusion tests of high explosives with complex stress states are explored, respectively. For typical pressed PBX under impact-shear loading, a large damage region is formed in the high explosives due to the tensile stress formed by the meeting of rarefaction waves, and the initial ignition region is mainly located in the region where the outer edge of the rod is in contact with the high explosives and extends in a circular shape to the inside of the explosives. For typical pressed PBX under crack extruded loading, the damage region is mainly concentrated in the materials squeezed into the crack, and the initial ignition region is mainly located around the crack and gradually extends above the crack. The results indicate that the proposed SPH method is capable of modeling the damage and ignition responses of high explosives under complex stress states.