In citrus breeding programs, male sterility is an important trait for developing seedless varieties. Sterility associated with the male sterile cytoplasm of Kishu mandarin (Kishu-cytoplasm) has been proposed to fit the cytoplasmic male sterility (CMS) model. However, it remains undetermined whether CMS in citrus is controlled by interactions between sterile cytoplasm and nuclear restorer-of-fertility (Rf) genes. Accordingly, mechanisms underlying the control of the wide phenotypic variation in pollen number for breeding germplasm should be elucidated. This study aimed to identify complete linkage DNA markers responsible for male sterility at the MS-P1 region based on fine mapping. Two P-class pentatricopeptide repeat (PPR) family genes were identified as candidates for Rf based on predicted mitochondrial localization and higher expression in a male fertile variety/selected strain than in a male sterile variety. Eleven haplotypes (HT1-HT11) at the MS-P1 region were defined based on genotyping of DNA markers. Association analysis of diplotypes at the MS-P1 region and the number of pollen grains per anther (NPG) in breeding germplasms harboring Kishu-cytoplasm revealed that the diplotypes in this region influenced NPG. Among these haplotypes, HT1 is a non-functional restorer-of-fertility (rf) haplotype; HT2, a less-functional Rf; HT3-HT5 are semi-functional Rfs; and HT6 and HT7 are functional Rfs. However, the rare haplotypes HT8-HT11 could not be characterized. Therefore, P-class PPR family genes in the MS-P1 region may constitute the nuclear Rf genes within the CMS model, and a combination of the seven haplotypes could contribute to phenotypic variation in the NPG of breeding germplasms. These findings reveal the genomic mechanisms of CMS in citrus and will contribute to seedless citrus breeding programs by selecting candidate seedless seedlings using the DNA markers at the MS-P1 region.