The application of image processing has been extended to agricultural industries in recent times. As the concept of image processing has vast application in agricultural industries, fruit grading has been focused in this research. There are number of approaches available for the classification and grading of mangoes, they suffer to achieve higher performance in classification. The most approaches uses color features and shape features only. To improve the performance of classification and fruit grading, an efficient GANFIS (Genetic Adaptive Neuro Fuzzy Inference System) is presented in this paper. The GANFIS approach reads the 2D mango images and extract various features like color, shape and texture features from the input image. Over the features extracted, the genetic algorithm has been applied to perform feature selection. With the extracted features, the method applies adaptive neuro fuzzy inference technique to perform classification and grading. The classification algorithm estimates multi feature class similarity MFCS measure towards each class of mangoes to perform classification where the grading is performed based on the same being estimated within the class. The proposed GANFIS approach has achieved sensitivity (98.05%), specificity (97.39%) and Accuracy (99.18%).