Towards the successful operation of any farm, effective livestock management is necessary. The efficiency, affordability, and scalability of management solutions play a crucial role in modern farming. In this paper, a novel low-cost framework is proposed to recognize for health monitoring of individual cattle based on their sensed behavioral activity data and muzzle (nose) pattern image database using incremental decision tree classification techniques and accelerometer-based activity monitoring method. The proposed system performs image prepossessing on the captured muzzle point images of cattle to mitigate the noise, enhance the contrast, and increase quality. We extract the minutiae features to improve the system’s accuracy for recognizing the cattle for accurate and early classification of behavioral activity for health monitoring. The proposed system uses a support vector machine and incremental decision tree classifiers to classify the extracted feature of cattle’s muzzle images and health database. The server has encrypted databases that consist of captured muzzle images, owner database, health sensor database provided by the owners and systems. We use a similarity score measurement using incremental decision tree classification for matching and classify the muzzle point featutes with the database for cattle identification and health monitoring. We also developed a prototype for evaluating the accuracy of the proposed system with 97.99% accuarcy for unique identification of individual cattle.