The primary visual cortex (V1) is one of the most studied regions of the brain and is characterized by its specialized and laminated layer 4 in human and non-human primates. However, studies aiming to harmonize the definition of the cortical layers and borders of V1 across rodents and primates are very limited. This article attempts to identify and harmonize the molecular markers and connectional patterns that can consistently link corresponding cortical layers of V1 and borders across mammalian species and ages. V1 in primates has at least two additional and unique layers (L3b2 and L3c) and two sublayers of layer 4 (L4a and L4b) compared to rodent V1. In all species examined, layers 4 and 3b of V1 receive strong inputs from the (dorsal) lateral geniculate nucleus, and V1 is mostly surrounded by the secondary visual cortex except for one location where V1 directly abuts area prostriata. The borders of primate V1 can also be clearly identified at mid-gestational ages using gene markers. In rodents, a novel posteromedial extension of V1 is identified, which expresses V1 marker genes and receives strong inputs from the lateral geniculate nucleus. This V1 extension was labeled as the posterior retrosplenial cortex and medial secondary visual cortex in the literature and brain atlases. Layer 6 of the rodent and primate V1 originates corticothalamic projections to the lateral geniculate, lateral dorsal, and reticular thalamic nuclei and the lateroposterior-pulvinar complex with topographic organization. Finally, the direct geniculo-extrastriate (particularly the strong geniculo-prostriata) projections are probably major contributors to blindsight after V1 lesions. Taken together, compared to rodents, primates, and humans, V1 has at least two unique middle layers, while other layers are comparable across species and display conserved molecular markers and similar connections with the visual thalamus with only subtle differences.