Segmentation Of Multiple Objects Research Articles

Collaborative Multi-task Learning for Multi-Object Tracking and Segmentation

The advancement of computer vision has pushed visual analysis tasks from still images to the video domain. In recent years, video instance segmentation, which aims at tracking and segment multiple objects in video frames, has drawn much attention for its potential applications in various emerging areas such as autonomous driving, intelligent transportation, and smart retail. In this article, we propose an effective framework for instance-level visual analysis on video frames, which can simultaneously conduct object detection, instance segmentation, and multi-object tracking. The core idea of our method is collaborative multi-task learning which is achieved by a novel structure, named associative connections among detection, segmentation, and tracking task heads in an end-to-end learnable CNN. These additional connections allow information propagation across multiple related tasks, so as to benefit these tasks simultaneously. We evaluate the proposed method extensively on KITTI MOTS and MOTS Challenge datasets and obtain quite encouraging results.

Dynamic Multiple Object Segmentation with Spatio-Temporal Filtering.

This article primarily focuses on the localization and extraction of multiple moving objects in images taken from a moving camera platform, such as image sequences captured by drones. The positions of moving objects in the images are influenced by both the camera's motion and the movement of the objects themselves, while the background position in the images is related to the camera's motion. The main objective of this article was to extract all moving objects from the background in an image. We first constructed a motion feature space containing motion distance and direction, to map the trajectories of feature points. Subsequently, we employed a clustering algorithm based on trajectory distinctiveness to differentiate between moving objects and the background, as well as feature points corresponding to different moving objects. The pixels between the feature points were then designated as source points. Within local regions, complete moving objects were segmented by identifying these pixels. We validated the algorithm on some sequences in the Video Verification of Identity (VIVID) program database and compared it with relevant algorithms. The experimental results demonstrated that, in the test sequences when the feature point trajectories exceed 10 frames, there was a significant difference in the feature space between the feature points on the moving objects and those on the background. Correctly classified frames with feature points accounted for 67% of the total frames.The positions of the moving objects in the images were accurately localized, with an average IOU value of 0.76 and an average contour accuracy of 0.57. This indicated that our algorithm effectively localized and segmented the moving objects in images captured by moving cameras.

Individual honey bee tracking in a beehive environment using deep learning and Kalman filter

The honey bee is the most essential pollinator and a key contributor to the natural ecosystem. There are numerous ways for thousands of bees in a hive to communicate with one another. Individual trajectories and social interactions are thus complex behavioral features that can provide valuable information for an ecological study. To study honey bee behavior, the key challenges that have resulted from unreliable studies include complexity (high density of similar objects, small objects, and occlusion), the variety of background scenes, the dynamism of individual bee movements, and the similarity between the bee body and the background in the beehive. This study investigated the tracking of individual bees in a beehive environment using a deep learning approach and a Kalman filter. Detection of multiple bees and individual object segmentation were performed using Mask R-CNN with a ResNet-101 backbone network. Subsequently, the Kalman filter was employed for tracking multiple bees by tracking the body of each bee across a sequence of image frames. Three metrics were used to assess the proposed framework: mean average precision (mAP) for multiple-object detection and segmentation tasks, CLEAR MOT for multiple object tracking tasks, and MOTS for multiple object tracking and segmentation tasks. For CLEAR MOT and MOTS metrics, accuracy (MOTA and MOTSA) and precision (MOTP and MOTSP) are considered. By employing videos from a custom-designed observation beehive, recorded at a frame rate of 30 frames per second (fps) and utilizing a continuous frame rate of 10 fps as input data, our system displayed impressive performance. It yielded satisfactory outcomes for tasks involving segmentation and tracking of multiple instances of bee behavior. For the multiple-object segmentation task based on Mask R-CNN, we achieved a 0.85 mAP. For the multiple-object-tracking task with the Kalman filter, we achieved 77.48% MOTA, 79.79% MOTSP, and 79.56% recall. For the overall system for multiple-object tracking and segmentation tasks, we achieved 77.00% MOTSA, 75.60% MOTSP, and 80.30% recall.

Segmentation and tracking of vegetable plants by exploiting vegetable shape feature for precision spray of agricultural robots

AbstractFor robotic precision spray application in vegetable farms, simultaneous accurate instance segmentation and robust tracking of plants are of great importance and a prerequisite for the following spray action. With onboard cameras, agricultural robots can apply Multiple Object Tracking and Segmentation (MOTS) methods, for instance, segmentation and tracking of plants. By assigning a unique identification for each vegetable, it ensures the robot to spray each vegetable exactly once, while traversing along the farm rows. Conventional MOTS methods, which are mostly designed for tracking pedestrians or vehicles, usually extract their color and texture features for associating different targets in consecutive images. However, vegetable plants of the same species normally show similar color and texture, which leads to degraded performance when conventional MOTS methods are used. To solve the challenging problem of associating vegetables with similar color and texture in consecutive images, in this paper, a novel MOTS method that exploits contour and blob features is proposed, for instance, segmentation and tracking of multiple vegetable plants. The method takes advantage of the fact that different plants normally possess different shape contours and blob properties. With images captured on top of them, these features of the same plant show little difference in consecutively captured images. Comprehensive experiments including ablation studies are conducted, which prove its superior performance over two state‐of‐the‐art MOTS methods. Compared with the conventional MOTS methods, the proposed method is able to re‐identify objects which have gone out of the camera field of view and re‐appear again using the proposed data association strategy, which is important to ensure each vegetable be sprayed only once when the robot travels back and forth. Although the method is tested on lettuce farm, it can be applied to other similar vegetables, such as broccoli and canola. Both the code and the dataset of this paper are publicly released for the benefit of the community: https://github.com/NanH5837/LettuceMOTS.

ST-ITEF: Spatio-Temporal Intraoperative Task Estimating Framework to recognize surgical phase and predict instrument path based on multi-object tracking in keratoplasty

Computer-assisted cognition guidance for surgical robotics by computer vision is a potential future outcome, which could facilitate the surgery for both operation accuracy and autonomy level. In this paper, multiple-object segmentation and feature extraction from this segmentation are combined to determine and predict surgical manipulation. A novel three-stage Spatio-Temporal Intraoperative Task Estimating Framework is proposed, with a quantitative expression derived from ophthalmologists’ visual information process and also with the multi-object tracking of surgical instruments and human corneas involved in keratoplasty. In the estimation of intraoperative workflow, quantifying the operation parameters is still an open challenge. This problem is tackled by extracting key geometric properties from multi-object segmentation and calculating the relative position among instruments and corneas. A decision framework is further proposed, based on prior geometric properties, to recognize the current surgical phase and predict the instrument path for each phase. Our framework is tested and evaluated by real human keratoplasty videos. The optimized DeepLabV3 with image filtration won the competitive class-IoU in the segmentation task and the mean phase jaccard reached 55.58 % for the phase recognition. Both the qualitative and quantitative results indicate that our framework can achieve accurate segmentation and surgical phase recognition under complex disturbance. The Intraoperative Task Estimating Framework would be highly potential to guide surgical robots in clinical practice.

A deformability-based biochip for precise label-free stratification of metastatic subtypes using deep learning

Cellular deformability is a promising biomarker for evaluating the physiological state of cells in medical applications. Microfluidics has emerged as a powerful technique for measuring cellular deformability. However, existing microfluidic-based assays for measuring cellular deformability rely heavily on image analysis, which can limit their scalability for high-throughput applications. Here, we develop a parallel constriction-based microfluidic flow cytometry device and an integrated computational framework (ATMQcD). The ATMQcD framework includes automatic training set generation, multiple object tracking, segmentation, and cellular deformability quantification. The system was validated using cancer cell lines of varying metastatic potential, achieving a classification accuracy of 92.4% for invasiveness assessment and stratifying cancer cells before and after hypoxia treatment. The ATMQcD system also demonstrated excellent performance in distinguishing cancer cells from leukocytes (accuracy = 89.5%). We developed a mechanical model based on power-law rheology to quantify stiffness, which was fitted with measured data directly. The model evaluated metastatic potentials for multiple cancer types and mixed cell populations, even under real-world clinical conditions. Our study presents a highly robust and transferable computational framework for multiobject tracking and deformation measurement tasks in microfluidics. We believe that this platform has the potential to pave the way for high-throughput analysis in clinical applications, providing a powerful tool for evaluating cellular deformability and assessing the physiological state of cells.

A Technique to Enable Efficient Adaptive Radiation Therapy: Automated Contouring of Prostate and Adjacent Organs

The purpose of this work was to investigate the use of a segmentation approach that could potentially improve the speed and reproducibility of contouring during magnetic resonance-guided adaptive radiation therapy. The segmentation algorithm was based on a hybrid deep neural network and graph optimization approach that also allows rapid user intervention (Deep layered optimal graph image segmentation of multiple objects and surfaces [LOGISMOS]+just enough interaction [JEI]). A total of 115 magnetic resonance-data sets were used for training and quantitative assessment. Expert segmentations were used as the independent standard for the prostate, seminal vesicles, bladder, rectum, and femoral heads for all 115 data sets. In addition, 3 independent radiation oncologists contoured the prostate, seminal vesicles, and rectum for a subset of patients such that the interobserver variability could be quantified. Consensus contours were then generated from these independent contours using a simultaneous truth and performance level estimation approach, and the deviation of Deep LOGISMOS+JEI contours to the consensus contours was evaluated and compared with the interobserver variability. The absolute accuracy of Deep LOGISMOS+JEI generated contours was evaluated using median absolute surface-to-surface distance which ranged from a minimum of 0.20 mm for the bladder to a maximum of 0.93 mm for the prostate compared with the independent standard across all data sets. The median relative surface-to-surface distance was less than 0.17 mm for all organs, indicating that the Deep LOGISMOS+JEI algorithm did not exhibit a systematic under- or oversegmentation. Interobserver variability testing yielded a mean absolute surface-to-surface distance of 0.93, 1.04, and 0.81 mm for the prostate, seminal vesicles, and rectum, respectively. In comparison, the deviation of Deep LOGISMOS+JEI from consensus simultaneous truth and performance level estimation contours was 0.57, 0.64, and 0.55 mm for the same organs. On average, the Deep LOGISMOS algorithm took less than 26 seconds for contour segmentation. Deep LOGISMOS+JEI segmentation efficiently generated clinically acceptable prostate and normal tissue contours, potentially limiting the need for time intensive manual contouring with each fraction.

SiamMask: A Framework for Fast Online Object Tracking and Segmentation.

In this article, we introduce SiamMask, a framework to perform both visual object tracking and video object segmentation, in real-time, with the same simple method. We improve the offline training procedure of popular fully-convolutional Siamese approaches by augmenting their losses with a binary segmentation task. Once the offline training is completed, SiamMask only requires a single bounding box for initialization and can simultaneously carry out visual object tracking and segmentation at high frame-rates. Moreover, we show that it is possible to extend the framework to handle multiple object tracking and segmentation by simply re-using the multi-task model in a cascaded fashion. Experimental results show that our approach has high processing efficiency, at around 55 frames per second. It yields real-time state-of-the art results on visual-object tracking benchmarks, while at the same time demonstrating competitive performance at a high speed for video object segmentation benchmarks.

Assisted annotation in Deep LOGISMOS: Simultaneous multi-compartment 3D MRI segmentation of calf muscles.

Automated segmentation of individual calf muscle compartments in 3D MR images is gaining importance in diagnosing muscle disease, monitoring its progression, and prediction of the disease course. Although deep convolutional neural networks have ushered in a revolution in medical image segmentation, achieving clinically acceptable results is a challenging task and the availability of sufficiently large annotated datasets still limits their applicability. In this paper, we present a novel approach combing deep learning and graph optimization in the paradigm of assisted annotation for solving general segmentation problems in 3D, 4D, and generally n-D with limited annotationcost. Deep LOGISMOS combines deep-learning-based pre-segmentation of objects of interest provided by our convolutional neural network, FilterNet+, and our 3D multi-objects LOGISMOS framework (layered optimal graph image segmentation of multiple objects and surfaces) that uses newly designed trainable machine-learned cost functions. In the paradigm of assisted annotation, multi-object JEI for efficient editing of automated Deep LOGISMOS segmentation was employed to form a new larger training set with significant decrease of manual tracingeffort. We have evaluated our method on 350 lower leg (left/right) T1-weighted MR images from 93 subjects (47 healthy, 46 patients with muscular morbidity) by fourfold cross-validation. Compared with the fully manual annotation approach, the annotation cost with assisted annotation is reduced by 95%, from 8 h to 25 min in this study. The experimental results showed average Dice similarity coefficient (DSC) of and average absolute surface positioning error of 0.63 pixels (0.44mm) for the five 3D muscle compartments for each leg. These results significantly improve our previously reported method and outperform the state-of-the-art nnUNetmethod. Our proposed approach can not only dramatically reduce the expert's annotation efforts but also significantly improve the segmentation performance compared to the state-of-the-art nnUNet method. The notable performance improvements suggest the clinical-use potential of our new fully automated simultaneous segmentation of calf musclecompartments.

The fast image segmentation algorithms using dynamic programming for modals of image histograms

A machine learning method is now considered capable of accurately segmenting images. However, one significant disadvantage of this strategy is that it requires a lengthy training phase and an extensive training dataset. This article uses an image segmentation by histogram thresholding approach that does not require training to overcome this difficulty. This article proposes straightforward and time-optimal algorithms, which are guaranteed by mathematical proofs. Furthermore, we experiment with the proposed algorithms using 100 images from a standard database. The results show that, while their performances are not significantly different, the two proposed methods are roughly 10 and 20 times faster than the most simple and optimal method, Brute Force. They also show that the proposed algorithms can deal with bimodal images and images with various shapes of the image histogram. Because our proposed algorithms are the most efficient and effective. As a result, they can be used for real-time segmentations and as a pre-processing approach for multiple object segmentation.

Multi-Object Tracking and Segmentation Via Neural Message Passing

Graphs offer a natural way to formulate Multiple Object Tracking (MOT) and Multiple Object Tracking and Segmentation (MOTS) within the tracking-by-detection paradigm. However, they also introduce a major challenge for learning methods, as defining a model that can operate on such structured domain is not trivial. In this work, we exploit the classical network flow formulation of MOT to define a fully differentiable framework based on Message Passing Networks. By operating directly on the graph domain, our method can reason globally over an entire set of detections and exploit contextual features. It then jointly predicts both final solutions for the data association problem and segmentation masks for all objects in the scene while exploiting synergies between the two tasks. We achieve state-of-the-art results for both tracking and segmentation in several publicly available datasets. Our code is available at https://github.com/ocetintas/MPNTrackSeg

Multiple-object segmentation by using a destructive 3D digitizer

A destructive 3D digitizer is a practical tool in reverse engineering. It acquires images of the cross-sections of an object layer by layer. Then the desired portions of the images will be segmented to reconstruct a CAD model. While the threshold method was helpful to segment images containing a single object, it led to a substantial error for images containing multiple objects due to the reflection between objects. This study incorporated the least square method into image processing to correct reflection error for multiple-object reconstruction. As illustrated in the case study, we successfully removed the material reflection errors, which ranged from 4.5% to 19% of the total thickness of the reconstructed CAD model.

IoT Enabled Deep Learning Based Framework for Multiple Object Detection in Remote Sensing Images

Advanced collaborative and communication technologies play a significant role in intelligent services and applications, including artificial intelligence, Internet of Things (IoT), remote sensing, robotics, future generation wireless, and aerial access networks. These technologies improve connectivity, energy efficiency, and quality of services of various smart city applications, particularly in transportation, monitoring, healthcare, public services, and surveillance. A large amount of data can be obtained by IoT systems and then examined by deep learning methods for various applications, e.g., object detection or recognition. However, it is a challenging and complex task in smart remote monitoring applications (aerial and drone). Nevertheless, it has gained special consideration in recent years and has performed a pivotal role in different control and monitoring applications. This article presents an IoT-enabled smart surveillance solution for multiple object detection through segmentation. In particular, we aim to provide the concept of collaborative drones, deep learning, and IoT for improving surveillance applications in smart cities. We present an artificial intelligence-based system using the deep learning based segmentation model PSPNet (Pyramid Scene Parsing Network) for segmenting multiple objects. We used an aerial drone data set, implemented data augmentation techniques, and leveraged deep transfer learning to boost the system’s performance. We investigate and analyze the performance of the segmentation paradigm with different CNN (Convolution Neural Network) based architectures. The experimental results illustrate that data augmentation enhances the system’s performance by producing good accuracy results of multiple object segmentation. The accuracy of the developed system is 92% with VGG-16 (Visual Geometry Group), 93% with ResNet-50 (Residual Neural Network), and 95% with MobileNet.

Learning interactive multi‐object segmentation through appearance embedding and spatial attention

Deep learning approaches to interactive image segmentation are typically formulated as a binary labeling problem. A model trained to make predictions within a fixed set of labels (i.e., foreground and background labels) cannot be used to directly predict the binary masks of multiple objects of interest, which greatly limits its flexibility and adaptivity. The use of different classes of clicks as input is opted for and the first end-to-end learning model for multi-object segmentation, based on a new designed neural network, is developed. The network consists of a visual feature extractor, a recurrent attention module and a dynamic segmentation head, extracts user click-adapted appearance embedding features and spatial attention features, and then learns to transform this information into a segmentation of multiple objects. It is also proposed to train the network using a joint loss function, taking the embedding learning into account for segmentation. Comprehensive experiments are conducted on three benchmark datasets to demonstrate the effectiveness of the proposed method. It performs favorably against state-of-the-art approaches on the multiple object segmentation task, for example, with 0.15 s per image, 0.06 s per object and mean IoU & F1 score of 84.90% on Pascal VOC 2012 validation set. It is further shown that the method can be used in numerous vision applications such as image recoloring and colorization.

A Dilated Segmentation Network with the Morphological Correction Method in Farming Area Image Series

Farming areas are made up of diverse land use types, such as arable lands, grasslands, woodlands, water bodies, and other surrounding agricultural architectures. They possess imperative economic value, and are considerably valued in terms of farmers’ livelihoods and society’s flourishment. Meanwhile, detecting crops in farming areas, such as wheat and corn, allows for more direct monitoring of farming area production and is significant for practical production and management. However, existing image segmentation methods are relatively homogeneous, with insufficient ability to segment multiple objects around the agricultural environment and small-scale objects such as corn and wheat. Motivated by these issues, this paper proposed a global-transformer segmentation network based on the morphological correction method. In addition, we applied the dilated convolution technique to the backbone of the model and the transformer technique to the branches. This innovation of integrating the above-mentioned techniques has an active impact on the segmentation of small-scale objects. Subsequently, the backbone improved by this method was applied to an object detection network based on a corn and wheat ears dataset. Experimental results reveal that our model can effectively detect wheat ears in a complicated environment. For two particular segmentation objects in farming areas, namely water bodies and roads, we notably proposed a morphological correction method, which effectively reduces the number of connected domains in the segmentation results with different parameters of dilation and erosion operations. The segmentation results of water bodies and roads were thereby improved. The proposed method achieved 0.903 and 13 for mIoU and continuity. This result reveals a remarkable improvement compared with the comparison model, and the continuity has risen by 408%. These comparative results demonstrate that the proposed method is eminent and robust enough to provide preliminary preparations and viable strategies for managing farming area resources and detecting crops.

Objective Object Segmentation Visual Quality Evaluation: Quality Measure and Pooling Method

Objective object segmentation visual quality evaluation is an emergent member of the visual quality assessment family. It aims to develop an objective measure instead of a subjective survey to evaluate the object segmentation quality in agreement with human visual perception. It is an important benchmark for assessing and comparing the performances of object segmentation methods in terms of visual quality. Despite its essential role, sufficient study compared with other visual quality evaluation studies is still lacking. In this article, we propose a novel full-reference objective measure that includes a two-level single object segmentation visual quality measure and a pooling method for multiple object segmentation overall visual quality. The single object segmentation visual quality measure combines a pixel-level sub-measure and a region-level sub-measure for evaluating the similarity of area, shape, and object completeness between the segmentation result and the ground truth in terms of human visual perception. For the proposed multiple object segmentation overall visual quality pooling method, the rank of each object’s segmentation quality as a novel factor is integrated into the weighted harmonic mean to evaluate the overall quality. To evaluate the performance of our proposed measure, we tested it on an object segmentation subjective visual quality assessment database. The experimental results demonstrate that our proposed two-level measure and pooling method with good robustness perform better in matching subjective assessments compared with other state-of-the-art objective measures.

Enhanced Mask R-CNN for herd segmentation

Livestock image segmentation is an important task in the field of vision and image processing. Since utilizing the concentration of forage in the grazing area with shielding the surrounding farm plants and crops is necessary for making effective cattle ranch arrangements, there is a need for a segmentation method that can handle multiple objects segmentation. Moreover, the indistinct boundaries and irregular shapes of cattle bodies discourage the application of the existing Mask Region-based Convolutional Neural Network (Mask R-CNN) which was primarily modeled for the segmentation of natural images. To address this, an enhanced Mask R-CNN model was proposed for multiple objects instance segmentation to support indistinct boundaries and irregular shapes of cattle bodies for precision livestock farming. The contributions of this method are in multiple folds: 1) optimal filter size smaller than a residual network for extracting smaller and composite features; 2) region proposals for utilizing multiscale semantic features; 3) Mask R-CNN’s fully connected layer integrated with sub-network for an enhanced segmentation. The experiment conducted on pre-processed datasets produced a mean average precision (mAP) of 0.93, which was higher than the results from the existing state-of-the-art models. Keywords: livestock farming, image segmentation, mask R-CNN, herd, enhancement DOI: 10.25165/j.ijabe.20211404.6398 Citation: Bello R W, Mohamed A S A, Talib A Z. Enhanced Mask R-CNN for herd segmentation. Int J Agric & Biol Eng, 2021; 14(4): 238–244.

Pose estimation at night in infrared images using a lightweight multi-stage attention network

Human Keypoints Detection is a relatively basic task in computer vision; it is the pre-task of human action recognition, behavior analysis and human–computer interaction. Since most abnormal actions occur at night, how to effectively extract skeleton sequence data in a low-light or completely dark environment poses a huge challenge for its identification. This paper proposes to use far infrared images to detection key points of the human body, which can solve the problem of human pose estimation under challenging weather conditions such as total darkness, smoke, inclement weather and glare. However, far-infrared images have some shortcomings, such as low resolution, noise and thermal characteristics; the skeleton data need to be provided in real time for the next stage of task. Based on the above reasons, this paper proposes a lightweight multi-stage attention network (LMANet) to detect the key points of human at night. This new network structure adds context information through the large receptive field, which helps to assist the detection of neighboring key points through this information, but for the sake of lightweight consideration, this article only extends the network to two stages. In addition, this article uses the attention module to effectively select channels with a large amount of information and highlight the features of key points, while eliminating background interference. In order to detect key points of the human in various complex environments, we use techniques such as difficult sample mining which improves the accuracy of key points with low confidence. Our network has been verified on two visible light datasets, fully demonstrating excellent performance. This paper successfully introduces far-infrared images into the field of pose estimation, because there is no public dataset for far-infrared pose estimation. In this paper, 700 images are selected for annotation from multiple public far-infrared object detection, segmentation and action recognition datasets; our algorithm is verified on this dataset; the effect is very good. After the paper is published, we will publish our key points of the human body annotated documents.

Active Contour Directed by the Poisson Gradient Vector Field and Edge Tracking

This paper develops a new active contour (AC) model capable of multiple complex objects segmentation in the presence of heavy noise. The model segments images in the framework of two types of partial differential equations (PDEs): the Euler–Lagrange and Poisson PDEs. The former is used to build an evolution algorithm, while the Poisson solution gradient vector field (PGVF) directs the evolution toward the boundaries of all image objects. The AC halts on boundaries and PGVF separatrices, splits on the latter, and leaves at least one segment (called label) on every boundary. Each label tracks its boundary until the corresponding object is enveloped. The advantages of the new method are validated on a number of skin lesions, road, and aircraft images of varying sizes and in the presence of Gaussian noise. The obtained results are compared against results by contemporary and established active contours and neural networks.

Multi-objects Detection and Segmentation for Scene Understanding Based on Texton Forest and Kernel Sliding Perceptron

In the recent days, scene understanding has become hot research topic due to its real usage at perceiving, analyzing and recognizing different dynamic scenes coverage during GPS monitoring system, drone’s targets, auto-driving and tourist guide. The goal of scene understanding is to make machines look at like humans do, which means the accurate recognition of the contents in scenes and during location observations. Then, we perform two operations such as (1) to perfectly describe the whole environment and (2) to describe what action is going on in the environment. Due to complex scene analysis, recognition of multiple objects and the relation between the objects remain as a challenging part of the research. In this paper, we have proposed a novel approach for the scene understanding that integrates multiple objects detection/segmentation and scene labeling using Geometric features, Histogram of oriented gradient and scale invariant feature transform descriptors. The complete procedure of the purposed model includes resizing and noise removing of images from the dataset, multiple object segmentation and detection, feature extraction and multiple object recognition using multi-layer kernel sliding perceptron. After that, scene recognition is achieved by using multi-class logistic regression. Finally, two datasets such as MSRC and UIUC sports are used for the experimental evaluation of our proposed method. Our purposed method accurately handles the complex objects physical exclusion and objects occlusion. Therefore, it outperforms in term of accuracy compared with other state-of-the-art approaches.