Piper betle L. (betel) is a species that belongs to the genus Piper and is a type of medicinal plant that is quite well known to the general population. The varieties of the leaf color may distinguish are red, green, and black betel. However, consumers still need assistance determining the differences between the many types of betel leaf. Therefore, using image processing techniques, this research contributes to building a classification method for distinguishing betel leaves based on color attributes. This approach anoints for the region of interest detection, feature extraction, and classification. In addition, three different classifiers, naïve Bayes, support vector machine, and k-nearest neighbors (k-NN), were used during the classification process. The evaluation for this study used a percentage split to divide a total of 180 images between the training and testing phases. The method’s performance provided the highest accuracy value possible, 100%, by utilizing the color characteristics with the k-NN classifier.