AbstractSeveral countries are most reliant on agriculture either in terms of employment opportunities, national income, availability of a raw material, food production, to name but a few. However, it faces a big challenge such as climate changes, diseases, pets, weeds etc. Therefore, last decade has provided a machine learning‐based solution to the agricultural community, which helped farmers to identify the diseases at the early stages. In this article, our focus is on grape diseases, and proposes a novel framework to identify and classify the selected diseases at the early stages. A deep learning‐based solution is embedded into a conventional architecture for optimal performance. Three primary steps are involved; (a) feature extraction after applying transfer learning on pre‐trained deep models, AlexNet and ResNet101, (b) selection of best features using proposed Yager Entropy along with Kurtosis (YEaK) technique, (c) fusion of strong features using proposed parallel approach and later subject to classification step using least squared support vector machine (LS‐SVM). The simulations are performed on infected grape leaves obtained from the plant village dataset to achieving an accuracy of 99%. From the simulation results, we sincerely believe that our proposed approach performed exceptionally compared to several existing methods.