Deep Learning-Based Cow Tail Detection and Tracking for Precision Livestock Farming

Abstract

Cow tail detection and tracking in videos provide valuable information for individual identification, calving process, behavior analysis, and body condition monitoring. Although deep learning-based detection methods have demonstrated good performance, many of them have high complexity and still require an improvement in video object detection by reducing the computation time and false positives. To fully exploit the interframe information and achieve a real-time online detection, the optimized cow tail detection and tracking method is proposed based on an improved single shot multibox detector (SSD) and Kalman filter. Here, our improved SSD-integrated DenseNet and Inception-v4 reduce detection information loss and network parameters. Then, an improved window function-based Kalman filter and Hungarian are adopted to remove error detections and enhance the cow tail tracking accuracy. Experiments on our acquired rear-view videos show that the proposed approach achieved fast tail detection with an accuracy of 96.97%, a speed of 96 fps, a smaller model size of 25 MB, and higher position accuracy with an average 6.45 pixels deviation. The proposed approach outperformed the region-based R-CNN models and other tracking methods (e.g., particle filter), which provides a new solution to automatic cow detection and tracking in smart livestock farming.