This study aimed to determine the dormancy type of Chinese olive seeds and improve their germination rate. The water permeability and germination-inhibiting substances of Chinese olive seeds were assessed. Low-temperature stratification and soaking in a GA3 solution were implemented to measure the time lag, initial time, germination rate, and germination potential of the seeds. The findings revealed that the seed coat exhibited poor water permeability, which negatively influenced the germination rate. Additionally, Chinese olive seeds contained substances that inhibited germination. The duration of low-temperature stratification (at 4 ± 1 °C) gradually diminished the dormancy of Chinese olive seeds, resulting in early and rapid germination. The germination rate significantly increased, with the percentage of seed germination rising from 0% to 42.33% within 60 days of stratification. Furthermore, combining low-temperature stratification with different concentrations of GA3 notably enhanced the germination rate. The optimal concentrations of gibberellins for 40 and 60 days of stratification were determined to be 300 and 100 mg/L, respectively. These results indicate that Chinese olive seeds possess non-deep physiological dormancy.