Spatial and spectral information carried by light emitted from visual displays is filtered as it passes through spectacle lenses in front of the eye as well as by filters within the eye. The image forming and the spectral transmittance properties of the elements involved in image formation in the eye cause changes in both the luminance and colour contrast in retinal images. In addition, the amount of light that reaches the retina is always reduced by pre‐receptor filters and this reduction in retinal illuminance can cause diminished retinal sensitivity to both luminance and colour contrast. Of particular interest are the use of coloured lenses in front of the eye to reduce the short‐wavelength content of the light that reaches the retina and the use of ‘notch’ filters to absorb light selectively in certain wavebands, with inevitable consequences on both the luminance and chromatic contrast of retinal images. The presence of variant cone‐pigments in some subjects or the complete absence of one class of cone pigment in others, can also produce large deviations in both luminance and colour contrast signals that can either enhance or diminish the conspicuity of coloured objects (doi: 10.1364/josaa.22.000017).The purpose of this study was to develop and validate a model of red/green (RG) and yellow/blue (YB) colour discrimination that can also predict how chromatic sensitivity is affected by the use of spectrally‐selective, spectacle lenses or by filters internal to the eye, when viewing visual displays. We examined how RG and YB colour thresholds relate to the corresponding cone contrasts needed for detection of colour differences. The results reveal an invariance of cone contrasts at threshold for different states of chromatic adaptation. In other words, colour contrast signals at threshold follow Weber's law (doi: 10.1111/j.1475‐1313.2010.00773.x). A combination of RG and YB colour signals is needed to predict the colour threshold ellipse. The model relies on these findings and predicts how coloured filters external to the eye as well as pre‐receptor filters within the eye alter the measured RG and YB colour thresholds. Model predictions have been compared against measured colour thresholds using the CAD test (doi: 10.1093/bmb/ldx007). A number of experiments were carried out when the visual display was viewed with no lens in front of the eye or through a number of tinted lenses designed to absorb progressively more blue light.The effects of pre‐receptor filters within the eye such as the lens and the macular pigment have also been investigated. The results show that ‘blue‐blocking’ filters employed in typical spectacle lenses used with daylight illumination cause only small shifts, approximately along the daylight locus, without any significant loss of either RG or YB chromatic sensitivity. ‘Orange’ lenses that absorb greater amounts of short‐wavelength light cause a significant increase in YB thresholds, but have little or no effect on RG thresholds. More surprisingly, the model also predicts that the optical density of the macular pigment has little or no effect on the size of the colour threshold ellipse.Keywords: colour, cone contrasts, blue light, CAD test.