The aim of this study was to elucidate the relations between the visual color perception and the instrumental color of dry-cured ham, with a specific focus on determining the Just Noticeable Color Difference (JNCD). Additionally, we studied the influence of consumer involvement and familiarity on color-related associations and JNCD. Slices of ham were examined to determine their instrumental color and photos were taken. Consumers were surveyed about color scoring and matching of the pictures; they were also asked about their involvement in food, familiarity with cured ham, and sociodemographic characteristics. Consumers were clustered according to their level of involvement and the JNCD was calculated for the clusters. An interpretable machine learning algorithm was used to relate the visual appraisal to the instrumental color. A JNCD of ΔEab* = 6.2 was established, although it was lower for younger people. ΔEab* was also influenced by the involvement of consumers. The machine-learning algorithm results were better than those obtained via multiple linear regressions when consumers' psychographic characteristics were included. The most important color variables of the algorithm were L* and hab. The findings of this research underscore the impact of consumers' involvement and familiarity with dry-cured ham on their perception of color.