Every menstrual cycle, many follicles begin to develop but only a specific number ovulate. This ovulation number determines how many offspring are produced per litter, and differs between species. The physiological mechanism that controls ovulation number is unknown; a class of mathematical models can explain it, but these models have no physiological basis. Here, we suggest a physiological mechanism for ovulation number control, which enables selection of a specific number of follicles out of many, and analyze it in a mathematical model of follicular growth. The mechanism is based on a signal, intra-follicular androgen concentration, that measures follicle size relative to the other follicles. This signal has a biphasic effect, suppressing follicles that are too large or too small compared to others. The ovulation number is determined by the androgen inhibitory thresholds. The model has a scaling symmetry that explains why the dominant follicles grow linearly with time, as observed in human ultrasound data. This approach also explains how chronic hyperandrogenism disrupts ovulation in polycystic ovary syndrome (PCOS), a leading cause of infertility. We propose specific experiments for testing the proposed mechanism.