Color-blind is a generic disability whereby the affected individuals are not given the opportunity to benefit from the various functions provided by color that would impact humans physically and psychologically. Although this disability is not fatal, it brought plenty of turbulence in the affected individuals’ daily activities. This paper aims to develop a system for recognizing and detecting colors of clothes in images, improve accuracy by using advanced algorithms to handle lighting variations, and provide color matching recommendations to assist color-blind individuals in making informed choices when purchasing shirts. The proposed methodology for color recognition involves:•retrieving the RGB values of a given point from the input image and converting them into HSV values.•creating web application integrated with a machine learning model to classify and predict the corresponding color based on the HSV values.•predicting the color name with suggestions of matching colors will be displayed on the interface.