Sexual displays are some of the most dramatic and varied behaviors that have been documented. The elaboration of such behaviors often relies on the modification of existing morphology. To understand how display elaboration arises, we analyzed the laryngeal anatomy of three species of mice that vary in the presence and complexity of their vocal displays. Mice and rats have a specialized larynx that enables them to produce both low-frequency "audible" sounds, perhaps using vocal fold vibration, as well as distinct mechanisms that are thought to enable higher frequency sounds, such as vocal membrane vibration and intralaryngeal whistles. These mechanisms rely on different structures within the larynx. Using histology, we characterized laryngeal anatomy in Alston's singing mouse (Scotinomys teguina), the northern pygmy mouse (Baiomys taylori), and the laboratory mouse (Mus musculus), which produce different types of vocalizations. We found evidence of a vocal membrane in all species, as well as species differences in vocal fold and ventral pouch size. Presence of a vocal membrane in these three species, which are not known to use vocal membrane vibration, suggests that this structure may be widespread among muroid rodents. An expanded ventral pouch in singing and pygmy mice suggests that these mice may use an intralaryngeal whistle to produce their advertisement songs, and that an expanded ventral pouch may enable lower frequencies than laboratory mouse whistle-produced sounds. Variation in the laryngeal anatomy of rodents fits into a larger pattern across terrestrial vertebrates, where the development and modification of vocal membranes and pouches, or air sacs, are common mechanisms by which vocalizations diversify. Understanding variation in the functional anatomy of relevant organs is the first step in understanding how morphological changes enable novel displays.