Presently there are two dominant theories for human color vision: Young-Maxwell-Helmholtz's trichromatic theory and Hering's opponent-color theory. It is widely purported that the trichromatic theory holds true for retinal color processing whereas the opponent-color theory works for cortical color processing. My purposes in the present paper are threefold: to demonstrate, based on both empirical and logical grounds, that the opponent-color theory is fundamentally untenable; to extend the trichromatic theory from retinal color processing to the cortical level; and to present a computational model based on neuroanatomical data for human color vision. Empirically, the opponent-color theory is false because it runs against many lines of observational and experimental data. First of all, this theory claims that it is impossible for a human being to perceive red and green colors in the same place at the same time; now there have been several demonstrations (e.g., see [1] and [2]) clearly indicating that this assumption is unwarranted. Second, colors appearing in complementary afterimages and in color contrast conditions are complementary to stimulus colors—rather than opponent colors as the opponent theory supposes. Third, in the so-called flight-of-colors phenomenon, the predominant colors are the complementary colors of three primary colors (red, green, and blue) embraced by the trichromatic theory, not the four unique hues (red, green, yellow, and blue) as assumed by the opponent-color theory. Logically, the opponent-color theory needs to postulate a neural mechanism for mixing colors between red and green colors which in turn needs to turn off neural activities along the red and the green cardinalities—it is simply impossible to realize such a mechanism in any physical system. In contrast to the opponent-color theory, the trichromatic color theory can easily be extended to cortical color processing. In fact, such a theoretical integration had been attempted by Rollett [3] and McDougall [4] more than a century ago—It is very unfortunate that their efforts had largely been forgotten. Here I attempt to use an extended Young-Maxwell-Helmholtz trichromatic theory to explain several color perception phenomena, including co-existence of red and green colors, both positive and negative afterimages, contrast colors, and flight-of-colors. Based on the fact that many color phenomena are monocular, I further propose that, in the primate (including the humankind) visual system, lamina 4C in the primary visual cortex (V1) is the neural substrate for cortical trichromaticity—because this is the only cortical stage where neurons are predominantly monocular. I present a three-layer computational model to simulate the first three stages of human visual processing: the retina, the LGN, and layer 4C. By incorporating anatomical data of cell distributions and a scheme of neuronal population cardinality coding, the model can account for many essential features of trichromaticity: additive and subtractive color mixing, color complementarity in afterimages and in contrast colors, and color transparency. Conclusions In summary, I contend that the trichromatic theory can explain both retinal and cortical color processing and that the opponent-color theory is fundamentally erroneous. Furthermore, I suggest that the neuronal trichromatic stage directly corresponding to human color sensation is layer 4C in V1.