Traditional methods of agricultural disease detection rely primarily on manual observation, which is not only time-consuming and labor-intensive, but also prone to human error. The advent of deep learning has revolutionized plant disease detection by providing more accurate and efficient solutions. The management of potato diseases is critical to the agricultural industry, as these diseases can lead to substantial losses in crop production. The prompt identification and classification of potato leaf diseases are essential to mitigating such losses. In this paper, we present a novel approach that integrates a lightweight convolutional neural network architecture, RegNetY-400MF, with transfer learning techniques to accurately identify seven different types of potato leaf diseases. The proposed method not only enhances the precision of potato leaf disease detection but also reduces the computational and storage demands, with a mere 0.40 GFLOPs and a model size of 16.8 MB. This makes it well-suited for use on edge devices with limited resources, enabling real-time disease detection in agricultural environments. The experimental results demonstrated that the accuracy of the proposed method in identifying seven potato leaf diseases was 90.68%, providing a comprehensive solution for potato crop management.