3D pose estimation to detect posture transition in free-stall housed dairy cows

Abstract

Free stall comfort is reflected in various indicators, including the ability for dairy cattle to display unhindered posture transition movements in the cubicles. To ensure farm animal welfare, it is instrumental for the farm management to be able to continuously monitor occurrences of abnormal motions. Advances in computer vision have enabled accurate kinematic measurements in several fields such as human, equine and bovine biomechanics. An important step upstream to measuring displacement during posture transitions is to determine that the behavior is accurately detected. In this study, we propose a framework for detecting lying to standing posture transitions from 3D pose estimation data. A multi-view computer vision system recorded posture transitions between Dec. 2021 and Apr. 2022 in a Swedish stall housing 183 individual cows. The output data consisted of the 3D coordinates of specific anatomical landmarks. Sensitivity of posture transition detection was 88.2% while precision reached 99.5%. Analyzing those transition movements, breakpoints detected the timestamp of onset of the rising motion, which was compared with that annotated by observers. Agreement between observers, measured by intra-class correlation, was 0.85 between 3 human observers and 0.81 when adding the automated detection. The intra-observer mean absolute difference in annotated timestamps ranged from 0.4s to 0.7s. The mean absolute difference between each observer and the automated detection ranged from 1.0s to 1.3s. There was a significant difference in annotated timestamp between all observer pairs but not between the observers and the automated detection, leading to the conclusion that the automated detection does not introduce a distinct bias. We conclude that the model is able to accurately detect the phenomenon of interest and that it is equatable to an observer.