Semiconductor self-assembled single quantum dots (QDs) provide a promising solid-state light source for single photons and entangled photons. The structural asymmetry in QDs results in fine structure splitting (FSS) of exciton and biexciton emission lines. Here, we propose a method to study QD symmetry by measuring the difference in two different polarized lifetimes of QD excitonic emission lines under applied stress. The method can be reasonably correlated with the direct FSS measurement. Actually, due to the limitation of the resolution of the spectrometer, the zero value of FSS is difficult to measure. Instead, the lifetime measurement is an effective method to judge the symmetry condition of single QDs.