Deep learning networks, more specifically convolutional neural networks, have shown a notable distinction when it comes to computer vision problems. Their versatility spans various domains, where they are applied for tasks such as classification and regression, contingent primarily on the availability of a representative dataset. This work explores the feasibility of employing this approach in the domain of agriculture, particularly within the context of olive growing. The objective is to enhance and facilitate cultivar identification techniques by using images of olive tree leaves. To achieve this, a comparative analysis involving ten distinct convolutional networks (VGG16, VGG19, ResNet50, ResNet152-V2, Inception V3, Inception ResNetV2, XCeption, MobileNet, MobileNetV2, EfficientNetB7) was conducted, all initiated with transfer learning as a common starting point. Also, the impact of adjusting network hyperparameters and structural elements was explored. For the training and evaluation of the networks, a dedicated dataset was created and made available, consisting of approximately 4200 images from the four most representative categories of the region. The findings of this study provide compelling evidence that the majority of the examined methods offer a robust foundation for cultivar identification, ensuring a high level of accuracy. Notably, the first nine methods consistently attain accuracy rates surpassing 95%, with the top three methods achieving an impressive 98% accuracy (ResNet50, EfficientNetB7). In practical terms, out of approximately 2016 images, 1976 were accurately classified. These results signify a substantial advancement in olive cultivar identification through computer vision techniques.