Aromatic rice (Oryza sativa L.) cultivated in Japan is regionally differentiated by geographical distribution and characteristics. We aimed to characterize the lineage of Japanese aromatic rice using DNA markers. Based on analyses with nuclear SSR markers, we found that Japanese aromatic rice cultivars belong, with one exception, to japonica but showed some differences from authentic japonica and were divided into two clades that were distributed in western and eastern Japan, respectively. Further analyses with organelle markers showed that most of the cultivars in eastern Japan had cytoplasm characterized by tropical japonica, whereas most of those in western Japan had cytoplasm characterized by temperate japonica. We postulate that the ancestor of the cultivars in eastern Japan differs from those of the cultivars in western Japan, and that the two groups may have been separately introduced from Taiwan into Japan. The cytoplasm of aromatic rice cultivars in western Japan may have originated from tropical japonica and been substituted into the cytoplasm of temperate japonica through hybridization between tropical japonica as a male parent and temperate japonica as a female parent.