To comprehensively investigate the potential temporal dynamic and static abnormalities of spontaneous brain activity (SBA) in left temporal lobe epilepsy (LTLE) and right temporal lobe epilepsy (RTLE) and to detect whether these alterations correlate with cognition. Twelve SBA metrics, including ALFF, dALFF, fALFF, dfALFF, ReHo, dReHo, DC, dDC, GSCorr, dGSCorr, VMHC, and dVMHC, in 46 LTLE patients, 43 RTLE patients, and 53 healthy volunteers were compared in the voxel-wise analysis. Correlation analyses between metrics in regions showing statistic differences and epilepsy duration, epilepsy severity, and cognition scores were also performed. Compared with the healthy volunteers, the alteration of SBA was identified both in LTLE and RTLE patients. The ALFF, fALFF, and dALFF values in LTLE, as well as the fALFF values in RTLE, increased in the bilateral thalamus, basal ganglia, mesial temporal lobe, cerebellum, and vermis. Increased dfALFF in the bilateral basal ganglia, increased ReHoanddReHo in the bilateral thalamus in the LTLE group, increased ALFF and dALFF in the pons, and increased ReHoanddReHo in the right hippocampus in the RTLE group were also detected. However, the majority of deactivation clusters were in the ipsilateral lateral temporal lobe. For LTLE, the fALFF, DC, dDC, and GSCorr values in the left lateral temporal lobe and the ReHo and VMHC values in the bilateral lateral temporal lobe all decreased. For RTLE, the ALFF, fALFF, dfALFF, ReHo, dReHo, and DC values in the right lateral temporal lobe and the VMHC values in the bilateral lateral temporal lobe all decreased. Moreover, for both the LTLE and RTLE groups, the dVMHC values decreased in the calcarine cortex. The most significant difference between LTLE and RTLE was the higher activation in the cerebellum of the LTLE group. The alterations of many SBA metrics were correlated with cognition and epilepsy duration. The patterns of change in SBA abnormalities in the LTLE and RTLE patients were generally similar. The integrated application of temporal dynamic and static SBA metrics might aid in the investigation of the propagation and suppression pathways of seizure activity as well as the cognitive impairment mechanisms in TLE.