The transition from outcrossing to selfing is a common evolutionary trend in flowering plants, and floral traits change significantly with the evolution of selfing. Whether or not plant traits are subjected to selection remains an open question in species with mixed mating systems. We examined phenotypic selection in two populations of Halenia elliptica with different selfing rates. We found that the pollen–ovule ratio, seed size, plant height, spur length, and pollinator visitation rate in the population with the higher selfing rate were lower than those in the population with the lower selfing rate. Selfing provides reproductive assurance for populations when pollinator service is low, and the floral traits that are associated with selfing syndrome are evident in populations with a higher selfing rate but are subjected to weak selection in each of the two populations with different selfing rates. Directional selection for an early flowering time indicated that late blooming flowers could experience a risk of seed development in alpine environments, and for large plants, selection indicated that seed production could be limited by the available resources. The floral traits that are associated with pollinator attraction and specialization could be subjected to weak selection at the plant level as selfing evolves, and the selective pressures that are independent of pollinators might not change significantly; highlighting the selective biotic and abiotic pressures that shape the morphological traits of plant species and their independence from the mating system.