Low-temperature germination (LTG) is an important agronomic trait for rice (Oryza sativa). Japonica rice generally has greater capacity for germination at low temperatures than the indica subpopulation. However, the genetic basis and molecular mechanisms underlying this complex trait are poorly understood. Here, we report that OsUBC12, encoding an E2 ubiquitin-conjugating enzyme, increases low-temperature germinability in japonica, owing to a transposon insertion in its promoter enhancing its expression. Natural variation analysis reveals that transposon insertion in the OsUBC12 promoter mainly occurs in the japonica lineage. The variation detected in eight representative two-line male sterile lines suggests the existence of this allele introgression by indica-japonica hybridization breeding, and varieties carrying the japonica OsUBC12 locus (transposon insertion) have higher low-temperature germinability than varieties without the locus. Further molecular analysis shows that OsUBC12 negatively regulate ABA signaling. OsUBC12-regulated seed germination and ABA signaling mainly depend on a conserved active site required for ubiquitin-conjugating enzyme activity. Furthermore, OsUBC12 directly associates with rice SUCROSE NON-FERMENTING 1-RELATED PROTEIN KINASE 1.1 (OsSnRK1.1), promoting its degradation. OsSnRK1.1 inhibits LTG by enhancing ABA signaling and acts downstream of OsUBC12. These findings shed light on the underlying mechanisms of UBC12 regulating LTG and provide genetic reference points for improving LTG in indica rice.