Mask R-CNN Model Research Articles

Individual Tree Crown Detection and Classification of Live and Dead Trees Using a Mask Region-Based Convolutional Neural Network (Mask R-CNN)

Mapping the distribution of living and dead trees in forests, particularly in ecologically fragile areas where forests serve as crucial ecological environments, is essential for assessing forest health, carbon storage capacity, and biodiversity. Convolutional neural networks, including Mask R-CNN, can assist in rapid and accurate forest monitoring. In this study, Mask R-CNN was employed to detect the crowns of Casuarina equisetifolia and to distinguish between live and dead trees in the Pingtan Comprehensive Pilot Zone, Fujian, China. High-resolution images of five plots were obtained using a multispectral Unmanned Aerial Vehicle. Six band combinations and derivatives, RGB, RGB-digital surface model (DSM), Multispectral, Multispectral-DSM, Vegetation Index, and Vegetation-Index-DSM, were used for tree crown detection and classification of live and dead trees. Five-fold cross-validation was employed to divide the manually annotated dataset of 21,800 live trees and 7157 dead trees into training and validation sets, which were used for training and validating the Mask R-CNN models. The results demonstrate that the RGB band combination achieved the most effective detection performance for live trees (average F1 score = 74.75%, IoU = 70.85%). The RGB–DSM combination exhibited the highest accuracy for dead trees (average F1 score = 71.16%, IoU = 68.28%). The detection performance for dead trees was lower than for live trees, which may be due to the similar spectral features across the images and the similarity of dead trees to the background, resulting in false identification. For the simultaneous detection of living and dead trees, the RGB combination produced the most promising results (average F1 score = 74.18%, IoU = 69.8%). It demonstrates that the Mask R-CNN model can achieve promising results for the detection of live and dead trees. Our study could provide forest managers with detailed information on the forest condition, which has the potential to improve forest management.

The Development Mask R-CNN Model for Identification of Melon Plant Leaves and Branches

The quality of melons can be enhanced and optimized by pruning melon plants. Pruning is a removal process carried out on specific parts of the plant. Currently, melon plants are still pruned manually by farmers, but there are many drawbacks to this method. In this research, pruning is conducted on the branches and leaves of melon plants. Pruning can be facilitated with the assistance of a robot capable of recognizing leaves and branches. In this study, the method used to detect branches and leaves is the Mask Region-based Convolutional Neural Network (Mask R-CNN). Hyperparameter tuning technique is employed to obtain the best parameter values, including learning rate, weight decay, and learning momentum. Two scenarios are considered in this research, one with 10 epochs and the other with 30 epochs. The obtained Average Precision (AP) values at 10 epochs are 32.2% for leaf objects and 0% for branches. At 30 epochs, the AP values are 56.8% for leaf objects and 4.1% for branches. The mean Average Precision (mAP) is 16.1% for 10 epochs and 28.4% for 30 epochs.

Extracting ductile cast iron microstructure parameters from fracture surfaces: A deep learning based instance segmentation approach

This study investigates the deep-learning based microstructural analysis from SEM images of ductile cast iron fracture surfaces. A Mask R-CNN model was trained, achieving 70% precision and 75% recall in graphite particle detection. Combined with a fracture surface reconstruction using the.4-quadrant backscattered electron signal, key parameters, including the particle size, shape and distance were extracted accurately. Compared to micrograph analysis, following probabilistic simulations showed the impact of the higher microstructural variance for the fracture surfaces on crack initiation, leading to higher scatter and elevated crack resistance curves. This highlights the potential of deep-learning based analysis for comprehensive microstructural characterization.

Individual Tree Crown Delineation Using Airborne LiDAR Data and Aerial Imagery in the Taiga–Tundra Ecotone

The circumpolar Taiga–Tundra Ecotone significantly influences the feedback mechanism of global climate change. Achieving large-scale individual tree crown (ITC) extraction in the transition zone is crucial for estimating vegetation biomass in the transition zone and studying plants’ response to climate change. This study employed aerial images and airborne LiDAR data covering several typical transitional zone regions in northern Finland to explore the ITC delineation method based on deep learning. First, this study developed an improved multi-scale ITC delineation method to enable the semi-automatic assembly of the ITC sample collection. This approach led to the creation of an individual tree dataset containing over 20,000 trees in the transitional zone. Then, this study explored the ITC delineation method using the Mask R-CNN model. The accuracies of the Mask R-CNN model were compared with two traditional ITC delineation methods: the improved multi-scale ITC delineation method and the local maxima clustering method based on point cloud distribution. For trees with a height greater than 1.3 m, the Mask R-CNN model achieved an overall recall rate (Ar) of 96.60%. Compared to the two conventional ITC delineation methods, the Ar of Mask R-CNN showed an increase of 1.99 and 5.52 points in percentage, respectively, indicating that the Mask R-CNN model can significantly improve the accuracy of ITC delineation. These results highlight the potential of Mask R-CNN in extracting low trees with relatively small crowns in transitional zones using high-resolution aerial imagery and low-density airborne point cloud data for the first time.

Defective Pennywort Leaf Detection Using Machine Vision and Mask R-CNN Model

Demand and market value for pennywort largely depend on the quality of the leaves, which can be affected by various ambient environment or fertigation variables during cultivation. Although early detection of defects in pennywort leaves would enable growers to take quick action, conventional manual detection is laborious and time consuming as well as subjective. Therefore, the objective of this study was to develop an automatic leaf defect detection algorithm for pennywort plants grown under controlled environment conditions, using machine vision and deep learning techniques. Leaf images were captured from pennywort plants grown in an ebb-and-flow hydroponic system under fluorescent light conditions in a controlled plant factory environment. Physically or biologically damaged leaves (e.g., curled, creased, discolored, misshapen, or brown spotted) were classified as defective leaves. Images were annotated using an online tool, and Mask R-CNN models were implemented with the integrated attention mechanisms, convolutional block attention module (CBAM) and coordinate attention (CA) and compared for improved image feature extraction. Transfer learning was employed to train the model with a smaller dataset, effectively reducing processing time. The improved models demonstrated significant advancements in accuracy and precision, with the CA-augmented model achieving the highest metrics, including a mean average precision (mAP) of 0.931 and an accuracy of 0.937. These enhancements enabled more precise localization and classification of leaf defects, outperforming the baseline Mask R-CNN model in complex visual recognition tasks. The final model was robust, effectively distinguishing defective leaves in challenging scenarios, making it highly suitable for applications in precision agriculture. Future research can build on this modeling framework, exploring additional variables to identify specific leaf abnormalities at earlier growth stages, which is crucial for production quality assurance.

A Novel Method for Identifying Landslide Surface Deformation via the Integrated YOLOX and Mask R-CNN Model

The detection of landslide areas and surface characteristics is the prerequisite and basis of landslide hazard risk assessment. The traditional method relies mainly on manual field identification, and discrimination is based on the lack of unified quantitative standards. Thus, the use of neural networks for the quantitative identification and prediction of landslide surface deformation is explored. By constructing an integrated model based on YOLO X-CNN and Mask R-CNN, a deep learning-based feature detection method for landslide surface images is proposed. First, the method superimposes Unmanned Aerial Vehicle (UAV) oblique photography data (UOPD) and Internet heterosource image data (IHID) to construct a landslide surface image dataset and landslide surface deformation database. Second, an integrated model suitable for small- and medium-scale target detection and large-scale target edge extraction is constructed to automatically identify and extract landslide surface features and to achieve rapid detection of landslide surface features and accurate segmentation and deformation recognition of landslide areas. The results show that the detection accuracy for small rock targets is greater than 80% and that the speed is 57.04 FPS. The classification and mask segmentation accuracies of large slope targets are approximately 90%. A speed of 7.89 FPS can meet the needs of disaster emergency response; this provides a reference method for the accurate identification of landslide surface features.

MRI-Based Brain Tumor Instance Segmentation Using Mask R-CNN

Brain tumor segmentation is a crucial step in medical image analysis for the accurate diagnosis and treatment of patients. Traditional methods for tumor segmentation often require extensive manual effort and are prone to variability. In this study, we propose an automated approach for brain tumor segmentation using Mask R-CNN, a state-of-the-art deep learning model for instance segmentation. Our method leverages MRI images to identify and delineate brain tumors with high precision. We trained the Mask R-CNN model on a dataset of annotated MRI images and evaluated its performance using the mean Average Precision (mAP) metric. The results demonstrate that our model achieves a high mAP of 90.3%, indicating its effectiveness in accurately segmenting brain tumors. This automated approach not only reduces the manual effort required for tumor segmentation but also provides consistent and reliable results, potentially improving clinical outcomes.

Automated segmentation and source prediction of bone tumors using ConvNeXtv2 Fusion based Mask R-CNN to identify lung cancer metastasis

Lung cancer, which is a leading cause of cancer-related deaths worldwide, frequently metastasizes to the bones, significantly diminishing patients’ quality of life and complicating treatment strategies. This study aims to develop an advanced 3D Mask R-CNN model, enhanced with the ConvNeXt-V2 backbone, for the automatic segmentation of bone tumors and identification of lung cancer metastasis to support personalized treatment planning. Data were collected from two hospitals: Center A (106 patients) and Center B (265 patients). The data from Center B were used for training, while Center A’s dataset served as an independent external validation set. High-resolution CT scans with 1 mm slice thickness and no inter-slice gaps were utilized, and the regions of interest (ROIs) were manually segmented and validated by two experienced radiologists. The 3D Mask R-CNN model achieved a Dice Similarity Coefficient (DSC) of 0.856, a sensitivity of 0.921, and a specificity of 0.961 on the training set. On the test set, it achieved a DSC of 0.849, a sensitivity of 0.911, and a specificity of 0.931. For the classification task, the model attained an AUC of 0.865, an accuracy of 0.866, a sensitivity of 0.875, and a specificity of 0.835 on the training set, while achieving an AUC of 0.842, an accuracy of 0.836, a sensitivity of 0.847, and a specificity of 0.819 on the test set. These results highlight the model’s potential in improving the accuracy of bone tumor segmentation and lung cancer metastasis detection, paving the way for enhanced diagnostic workflows and personalized treatment strategies in clinical oncology.

A deep learning-powered intelligent microdroplet analysis workflow for in-situ monitoring and evaluation of a dynamic emulsion

Accurately determining microdroplet size and uniformity in dispersed phase systems is key for assessing emulsion stability, and essential for quality monitoring and control of emulsion products. Microscopic imaging probes have provided intuitive and advanced insights for characterizing particle microscopic morphology and dispersion in multiphase flows. However, wide size distributions, edge-cutting, overlapping, and high-density target droplets can compromise the image processing accuracy, thereby affecting the precise assessment of emulsion status. In this study, we present a deep learning-based intelligent workflow for microdroplet characterization using an in-situ high-speed particle imaging probe combined with advanced image processing techniques. With the assistance of progressive automatic annotation, a droplet image database was constructed for training the Mask R-CNN model. By incorporating image patching and supervised data augmentation strategies, our well-trained model with accuracy of 95.5% can precisely detect, localize, and segment microscale droplets with various patterns. Additionally, the shape reconstruction module visualizes true shapes of overlapping and edge-cutting droplets, facilitating precise quantification of droplet size information. To validate the feasibility and generalizability of the proposed workflow, we obtained sufficient droplet images through offline sampling during emulsion processes while employing back and front illumination for in-situ monitoring. The automated method achieves precise droplet detection and size measurement, demonstrating its immense potential in online monitoring, evaluation, and control of emulsion quality.

Segmentation Method of Zanthoxylum bungeanum Cluster Based on Improved Mask R-CNN

The precise segmentation of Zanthoxylum bungeanum clusters is crucial for developing picking robots. An improved Mask R-CNN model was proposed in this study for the segmentation of Zanthoxylum bungeanum clusters in natural environments. Firstly, the Swin-Transformer network was introduced into the model’s backbone as the feature extraction network to enhance the model’s feature extraction capabilities. Then, the SK attention mechanism was utilized to fuse the detailed information into the mask branch from the low-level feature map of the feature pyramid network (FPN), aiming to supplement the image detail features. Finally, the distance intersection over union (DIOU) loss function was adopted to replace the original bounding box loss function of Mask R-CNN. The model was trained and tested based on a self-constructed Zanthoxylum bungeanum cluster dataset. Experiments showed that the improved Mask R-CNN model achieved 84.0% and 77.2% in detection mAP50box and segmentation mAP50mask, respectively, representing a 5.8% and 4.6% improvement over the baseline Mask R-CNN model. In comparison to conventional instance segmentation models, such as YOLACT, Mask Scoring R-CNN, and SOLOv2, the improved Mask R-CNN model also exhibited higher segmentation precision. This study can provide valuable technology support for the development of Zanthoxylum bungeanum picking robots.

Graphic association learning: Multimodal feature extraction and fusion of image and text using artificial intelligence techniques

With the advancement of technology in recent years, the application of artificial intelligence in real life has become more extensive. Graphic recognition is a hot spot in the current research of related technologies. It involves machines extracting key information from pictures and combining it with natural language processing for in-depth understanding. Existing methods still have obvious deficiencies in fine-grained recognition and deep understanding of contextual context. Addressing these issues to achieve high-quality image-text recognition is crucial for various application scenarios, such as accessibility technologies, content creation, and virtual assistants. To tackle this challenge, a novel approach is proposed that combines the Mask R-CNN, DCGAN, and ALBERT models. Specifically, the Mask R-CNN specializes in high-precision image recognition and segmentation, the DCGAN captures and generates nuanced features from images, and the ALBERT model is responsible for deep natural language processing and semantic understanding of this visual information. Experimental results clearly validate the superiority of this method. Compared to traditional image-text recognition techniques, the recognition accuracy is improved from 85.3% to 92.5%, and performance in contextual and situational understanding is enhanced. The advancement of this technology has far-reaching implications for research in machine vision and natural language processing and open new possibilities for practical applications.

Developing Machine Vision in Tree-Fruit Applications-Fruit Count, Fruit Size and Branch Avoidance in Automated Harvesting.

Recent developments in affordable depth imaging hardware and the use of 2D Convolutional Neural Networks (CNN) in object detection and segmentation have accelerated the adoption of machine vision in a range of applications, with mainstream models often out-performing previous application-specific architectures. The need for the release of training and test datasets with any work reporting model development is emphasized to enable the re-evaluation of published work. An additional reporting need is the documentation of the performance of the re-training of a given model, quantifying the impact of stochastic processes in training. Three mango orchard applications were considered: the (i) fruit count, (ii) fruit size and (iii) branch avoidance in automated harvesting. All training and test datasets used in this work are available publicly. The mAP 'coefficient of variation' (Standard Deviation, SD, divided by mean of predictions using models of repeated trainings × 100) was approximately 0.2% for the fruit detection model and 1 and 2% for the fruit and branch segmentation models, respectively. A YOLOv8m model achieved a mAP50 of 99.3%, outperforming the previous benchmark, the purpose-designed 'MangoYOLO', for the application of the real-time detection of mango fruit on images of tree canopies using an edge computing device as a viable use case. YOLOv8 and v9 models outperformed the benchmark MaskR-CNN model in terms of their accuracy and inference time, achieving up to a 98.8% mAP50 on fruit predictions and 66.2% on branches in a leafy canopy. For fruit sizing, the accuracy of YOLOv8m-seg was like that achieved using Mask R-CNN, but the inference time was much shorter, again an enabler for the field adoption of this technology. A branch avoidance algorithm was proposed, where the implementation of this algorithm in real-time on an edge computing device was enabled by the short inference time of a YOLOv8-seg model for branches and fruit. This capability contributes to the development of automated fruit harvesting.

Evaluation of tumor budding with virtual panCK stains generated by novel multi-model CNN framework

As the global incidence of cancer continues to rise rapidly, the need for swift and precise diagnoses has become increasingly pressing. Pathologists commonly rely on H&E-panCK stain pairs for various aspects of cancer diagnosis, including the detection of occult tumor cells and the evaluation of tumor budding. Nevertheless, conventional chemical staining methods suffer from notable drawbacks, such as time-intensive processes and irreversible staining outcomes. The virtual stain technique, leveraging generative adversarial network (GAN), has emerged as a promising alternative to chemical stains. This approach aims to transform biopsy scans (often H&E) into other stain types. Despite achieving notable progress in recent years, current state-of-the-art virtual staining models confront challenges that hinder their efficacy, particularly in achieving accurate staining outcomes under specific conditions. These limitations have impeded the practical integration of virtual staining into diagnostic practices. To address the goal of producing virtual panCK stains capable of replacing chemical panCK, we propose an innovative multi-model framework. Our approach involves employing a combination of Mask-RCNN (for cell segmentation) and GAN models to extract cytokeratin distribution from chemical H&E images. Additionally, we introduce a tailored dynamic GAN model to convert H&E images into virtual panCK stains, integrating the derived cytokeratin distribution. Our framework is motivated by the fact that the unique pattern of the panCK is derived from cytokeratin distribution. As a proof of concept, we employ our virtual panCK stains to evaluate tumor budding in 45 H&E whole-slide images taken from breast cancer-invaded lymph nodes . Through thorough validation by both pathologists and the QuPath software, our virtual panCK stains demonstrate a remarkable level of accuracy. In stark contrast, the accuracy of state-of-the-art single cycleGAN virtual panCK stains is negligible. To our best knowledge, this is the first instance of a multi-model virtual panCK framework and the utilization of virtual panCK for tumor budding assessment. Our framework excels in generating dependable virtual panCK stains with significantly improved efficiency, thereby considerably reducing turnaround times in diagnosis. Furthermore, its outcomes are easily comprehensible even to pathologists who may not be well-versed in computer technology. We firmly believe that our framework has the potential to advance the field of virtual stain, thereby making significant strides towards improved cancer diagnosis.

Towards an open pipeline for the detection of critical infrastructure from satellite imagery—a case study on electrical substations in The Netherlands

Abstract Critical infrastructure (CI) are at risk of failure due to the increased frequency and magnitude of climate extremes related to climate change. It is thus essential to include them in a risk management framework to identify risk hotspots, develop risk management policies and support adaptation strategies to enhance their resilience. However, the lack of information on the exposure of CI to natural hazards prevents their incorporation in large-scale risk assessments. This study sets out to improve the representation of CI for risk assessment studies by building a neural network model to detect CI assets from optical remote sensing imagery. We present a pipeline that extracts CI from OpenStreetMap (OSM), processes the imagery and assets’ masks, and trains a Mask R-CNN model that allows for instance segmentation of CI at the asset level. This study provides an overview of the pipeline and tests it with the detection of electrical substations assets in the Netherlands. Several experiments are presented for different under-sampling percentages of the majority class (25 %, 50 % and 100 %) and hyperparameters settings (batch size and learning rate). The highest scoring experiment achieved an Average Precision at an Intersection over Union of 50 % of 30.93 and a tile F-score of 89.88 %. This allows us to confirm the feasibility of the method and invite disaster risk researchers to use this pipeline for other infrastructure types. We conclude by exploring the different avenues to improve the pipeline by addressing the class imbalance, Transfer Learning and Explainable Artificial Intelligence.

Chili Object Detection with Automatic Labeling and Mask R-CNN Model

Chili Object Detection with Automatic Labeling and Mask R-CNN Model

Nutrient Stress Symptom Detection in Cucumber Seedlings Using Segmented Regression and a Mask Region-Based Convolutional Neural Network Model

The health monitoring of vegetable and fruit plants, especially during the critical seedling growth stage, is essential to protect them from various environmental stresses and prevent yield loss. Different environmental stresses may cause similar symptoms, making visual inspection alone unreliable and potentially leading to an incorrect diagnosis and delayed corrective actions. This study aimed to address these challenges by proposing a segmented regression model and a Mask R-CNN model for detecting the initiation time and symptoms of nutrient stress in cucumber seedlings within a controlled environment. Nutrient stress was induced by applying two different treatments: an indicative nutrient deficiency with an electrical conductivity (EC) of 0 dSm−1, and excess nutrients with a high-concentration nutrient solution and an EC of 6 dSm−1. Images of the seedlings were collected using an automatic image acquisition system two weeks after germination. The early initiation of nutrient stress was detected using a segmented regression analysis, which analyzed morphological and textural features extracted from the images. For the Mask R-CNN model, 800 seedling images were annotated based on the segmented regression analysis results. Nutrient-stressed seedlings were identified from the initiation day to 4.2 days after treatment application. The Mask R-CNN model, implemented using ResNet-101 for feature extraction, leveraged transfer learning to train the network with a smaller dataset, thereby reducing the processing time. This study identifies the top projected canopy area (TPCA), energy, entropy, and homogeneity as prospective indicators of nutritional deficits in cucumber seedlings. The results from the Mask R-CNN model are promising, with the best-fit image achieving an F1 score of 93.4%, a precision of 93%, and a recall of 94%. These findings demonstrate the effectiveness of the integrated statistical and machine learning (ML) methods for the early and accurate diagnosis of nutrient stress. The use of segmented regression for initial detection, followed by the Mask R-CNN for precise identification, emphasizes the potential of this approach to enhance agricultural practices. By facilitating the early detection and accurate diagnosis of nutrient stress, this approach allows for quicker and more precise treatments, which improve crop health and productivity. Future research could expand this methodology to other crop types and field conditions to enhance image processing techniques, and researchers may also integrate real-time monitoring systems.

Comparing Mask R-CNN backbone architectures for human detection using thermal imaging

We introduce a method for detecting humans in thermal imaging using an end-to-end deep learning model. Our objective is to optimize the human detection process in thermal imaging by investigating the mask region-based convolutional neural network (Mask R-CNN). The model, an advancement of the faster region-based convolutional neural network (Faster R-CNN), not only captures bounding boxes encompassing human subjects but also delineates segmentation masks around them. Our investigation extends to the evaluation and comparison of various convolutional neural networks for feature learning, like residual network (ResNet) and Inception ResNet, all integrated into the Mask R-CNN framework. Furthermore, the experimental results show that our proposed technique achieves high accuracy. Specifically, the Mask R-CNN model using ResNet50-V1 achieved the best results, with an F-value of 87.85%, a recall of 79.33%, and a precision of 98.41%.

Leaf only SAM: A segment anything pipeline for zero-shot automated leaf segmentation

Segment Anything Model (SAM) is a new “foundation model” that can be used as a zero-shot object segmentation method with the use of either guide prompts such as bounding boxes, polygons, or points. Alternatively, additional post processing steps can be used to identify objects of interest after segmenting everything in an image. Here a method is presented using segment anything together with a series of post processing steps to segment potato leaves, called Leaf Only SAM. The advantage of this proposed method is that it does not require any training data to produce its results so has many applications across the field of plant phenotyping where there is limited high quality annotated data available. The performance of Leaf Only SAM is compared to a Mask R-CNN model which has been fine-tuned on a small novel potato leaf dataset. On the evaluation dataset, Leaf Only SAM finds an average recall of 73.1 and an average precision of 73.9, compared to recall of 87.6 and precision of 84.4 for Mask R-CNN. Leaf Only SAM does not perform better than the fine-tuned Mask R-CNN model on the potato leaf dataset, but the SAM based model does not require any extra training or annotation. This shows there is potential to use SAM as a zero-shot classifier with the addition of post processing steps.

A Method for Extracting Joints on Mountain Tunnel Faces Based on Mask R-CNN Image Segmentation Algorithm

The accurate distribution of joints on the tunnel face is crucial for assessing the stability and safety of surrounding rock during tunnel construction. This paper introduces the Mask R-CNN image segmentation algorithm, a state-of-the-art deep learning model, to achieve efficient and accurate identification and extraction of joints on tunnel face images. First, digital images of tunnel faces were captured and stitched, resulting in 286 complete images suitable for analysis. Then, the joints on the tunnel face were extracted using traditional image processing algorithms, the commonly used U-net image segmentation model, and the Mask R-CNN image segmentation model introduced in this paper to address the lack of recognition accuracy. Finally, the extraction results obtained by the three methods were compared. The comparison results show that the joint extraction method based on the Mask R-CNN image segmentation deep learning model introduced in this paper achieved the best joint extraction effect with a Dice similarity coefficient of 87.48%, outperforming traditional methods and the U-net model, which scored 60.59% and 75.36%, respectively, realizing accurate and efficient acquisition of tunnel face rock joints. These findings suggest that the Mask R-CNN model can be effectively implemented in real-time monitoring systems for tunnel construction projects.

Pig Weight Estimation Method Based on a Framework Combining Mask R-CNN and Ensemble Regression Model.

Using computer vision technology to estimate pig live weight is an important method to realize pig welfare. But there are two key issues that affect pigs' weight estimation: one is the uneven illumination, which leads to unclear contour extraction of pigs, and the other is the bending of the pig body, which leads to incorrect pig body information. For the first one, Mask R-CNN was used to extract the contour of the pig, and the obtained mask image was converted into a binary image from which we were able to obtain a more accurate contour image. For the second one, the body length, hip width and the distance from the camera to the pig back were corrected by XGBoost and actual measured information. Then we analyzed the rationality of the extracted features. Three feature combination strategies were used to predict pig weight. In total, 1505 back images of 39 pigs obtained using Azure kinect DK were used in the numerical experiments. The highest prediction accuracy is XGBoost, with an MAE of 0.389, RMSE of 0.576, MAPE of 0.318% and R2 of 0.995. We also recommend using the Mask R-CNN + RFR method because it has fairly high precision in each strategy. The experimental results show that our proposed method has excellent performance in live weight estimation of pigs.