Chrysanthemums, a significant genus within the Asteraceae, hold a paramount position in the global floricultural industry, second only to roses in market demand. The proliferation of diverse chrysanthemum cultivars presents a formidable challenge for accurate identification, exacerbated by the abundance of varieties, intricate floral structures, diverse floret types, and complex genetic profiles. Precise recognition of chrysanthemum phenotypes is indispensable to navigating these complexities. Traditional methods, including morphology studies, statistical analyses, and molecular markers, have fallen short due to their manual nature and time-intensive processes. This study presents an innovative solution employing deep learning techniques for image-based chrysanthemum phenotype recognition. Leveraging machine learning, our system autonomously extracts key features from chrysanthemum images, converting morphological data into accessible two-dimensional representations. We utilized Support Vector Machine (SVM) and Multilayer Perceptron (MLP) algorithms to construct frameworks for processing image data and classifying chrysanthemum cultivars based on color, shape, and texture. Experimental results, encompassing 10 cultivars, 10 flower colors, and five flower shapes, consistently demonstrated recognition accuracy ranging from 79.29% up to 97.86%. This tool promises streamlined identification of flower traits, and we anticipate its potential for real-time identification enhancements in future iterations, promising advances in chrysanthemum cultivation and exportation processes. Our approach offers a novel and efficient means to address the challenges posed by the vast diversity within chrysanthemum species, facilitating improved management, breeding, and marketing strategies in the floricultural industry.