Object Detection Approach Research Articles

A novel deep learning based underwater image de-noising and detecting suspicious object

Exploration of underwater resource play a vital role for nation development. Underwater surveillance systems play a crucial role in security applications, requiring accurate detection of suspicious objects in underwater images. However, the presence of noise, poor visibility, and uneven lighting conditions in underwater environments pose significant challenges for reliable object detection. This work proposes an integrated approach for underwater image de-noising, pre-processing, enhancement, and subsequent suspicious object detection by combining the DnCNN (Deep Convolutional Neural Network), CLAHE (Contrast Limited Adaptive Histogram Equalization), and additional image enhancement techniques. In addition to de-noising and pre-processing, it incorporate various image enhancement techniques to further improve object detection performance. These techniques include color correction, contrast adjustment, and edge enhancement, aiming to enhance the visual characteristics and saliency of suspicious objects in underwater images. To evaluate the effectiveness of proposed approach, this work conducted extensive experiments on an underwater image dataset containing diverse scenes and suspicious objects. The work compares proposed method with existing de-noising, preprocessing, and object detection techniques, analyzing the results using quantitative performance metrics, including precision, recall, and F1 score. The experimental results demonstrate that proposed integrated approach outperforms individual methods and achieves superior detection performance by enhancing the quality of underwater images and improving the visibility of suspicious objects.

Saliency-Induced Moving Object Detection for Robust RGB-D Vision Navigation Under Complex Dynamic Environments

Localization in unknown environments is an essential requirement for vision navigation of robotic vehicles in intelligent transportation systems. However, moving objects in dynamic scenarios usually bring about great difficulty for robot localization, because motion estimation of robotic vehicles is disturbed by increasing feature outliers caused by moving objects. In order to improve the accuracy and robustness of robot localization, a novel saliency-induced moving object detection (SMOD) approach is proposed to filter out feature outliers for RGB-D-based simultaneous localization and mapping (SLAM) in complex dynamic workspaces. Firstly, three complementary motion saliency potentials, including motion energy (ME), spatiotemporal objectness (STO), and dynamic superpixels (DS), are modeled by fully analyzing spatial, temporal, appearance and depth cues in RGB-D inputs. They can be used to identify the dynamic objects effectively from diversely changing backgrounds. Then, a superpixel-level graph-based motion saliency (MS) measure is proposed to generate the MS map for reliable localization of the moving objects. The edge weights and background nodes on the graph are determined reasonably by fusing ME, STO, and DS, which is not vulnerable to background interferences. Furthermore, the SMOD approach is embedded into the front-end of ORB-SLAM3 as a pre-processing stage, in order to filter out feature outliers associated with the moving objects. Finally, the extensive experiments are performed to verify the accuracy and robustness of the proposed approach on the public dynamic datasets. The experimental results show that the SMOD method can detect the moving objects effectively in a variety of challenging dynamic environments, and separate the dynamic regions reliably from the irrelevant background. The data comparison demonstrates that the SMOD-SLAM navigation system can outperform other state-of-the-art dynamic visual SLAM (vSLAM) systems.

MR Object Identification and Interaction

The increasing number of objects in ubiquitous computing environments creates a need for effective object detection and identification mechanisms that permit users to intuitively initiate interactions with these objects. While multiple approaches to such object detection -- including through visual object detection, fiducial markers, relative localization, or absolute spatial referencing -- are available, each of these suffers from drawbacks that limit their applicability. In this paper, we propose ODIF, an architecture that permits the fusion of object situation information from such heterogeneous sources and that remains vertically and horizontally modular to allow extending and upgrading systems that are constructed accordingly. We furthermore present BLEARVIS, a prototype system that builds on the proposed architecture and integrates computer-vision (CV) based object detection with radio-frequency (RF) angle of arrival (AoA) estimation to identify BLE-tagged objects. In our system, the front camera of a Mixed Reality (MR) head-mounted display (HMD) provides a live image stream to a vision-based object detection module, while an antenna array that is mounted on the HMD collects AoA information from ambient devices. In this way, BLEARVIS is able to differentiate between visually identical objects in the same environment and can provide an MR overlay of information (data and controls) that relates to them. We include experimental evaluations of both, the CV-based object detection and the RF-based AoA estimation, and discuss the applicability of the combined RF and CV pipelines in different ubiquitous computing scenarios. This research can form a starting point to spawn the integration of diverse object detection, identification, and interaction approaches that function across the electromagnetic spectrum, and beyond.

Comparison of Machine Learning Pixel-Based Classifiers for Detecting Archaeological Ceramics

Recent improvements in low-altitude remote sensors and image processing analysis can be utilised to support archaeological research. Over the last decade, the increased use of remote sensing sensors and their products for archaeological science and cultural heritage studies has been reported in the literature. Therefore, different spatial and spectral analysis datasets have been applied to recognise archaeological remains or map environmental changes over time. Recently, more thorough object detection approaches have been adopted by researchers for the automated detection of surface ceramics. In this study, we applied several supervised machine learning classifiers using red-green-blue (RGB) and multispectral high-resolution drone imageries over a simulated archaeological area to evaluate their performance towards semi-automatic surface ceramic detection. The overall results indicated that low-altitude remote sensing sensors and advanced image processing techniques can be innovative in archaeological research. Nevertheless, the study results also pointed out existing research limitations in the detection of surface ceramics, which affect the detection accuracy. The development of a novel, robust methodology aimed to address the “accuracy paradox” of imbalanced data samples for optimising archaeological surface ceramic detection. At the same time, this study attempted to fill a gap in the literature by blending AI methodologies for non-uniformly distributed classes. Indeed, detecting surface ceramics using RGB or multi-spectral drone imageries should be reconsidered as an ‘imbalanced data distribution’ problem. To address this paradox, novel approaches need to be developed.

A deep reinforcement learning assisted task offloading and resource allocation approach towards self-driving object detection

With the development of communication technology and mobile edge computing (MEC), self-driving has received more and more research interests. However, most object detection tasks for self-driving vehicles are still performed at vehicle terminals, which often requires a trade-off between detection accuracy and speed. To achieve efficient object detection without sacrificing accuracy, we propose an end–edge collaboration object detection approach based on Deep Reinforcement Learning (DRL) with a task prioritization mechanism. We use a time utility function to measure the efficiency of object detection task and aim to provide an online approach to maximize the average sum of the time utilities in all slots. Since this is an NP-hard mixed-integer nonlinear programming (MINLP) problem, we propose an online approach for task offloading and resource allocation based on Deep Reinforcement learning and Piecewise Linearization (DRPL). A deep neural network (DNN) is implemented as a flexible solution for learning offloading strategies based on road traffic conditions and wireless network environment, which can significantly reduce computational complexity. In addition, to accelerate DRPL network convergence, DNN outputs are grouped by in-vehicle cameras to form offloading strategies via permutation. Numerical results show that the DRPL scheme is at least 10% more effective and superior in terms of time utility compared to several representative offloading schemes for various vehicle local computing resource scenarios.

Multi-task Learning with Hierarchical Guidance for Locating and Stratifying Submucosal Tumors.

Locating and stratifying the submucosal tumor of the digestive tract from endoscopy ultrasound (EUS) images are of vital significance to the preliminary diagnosis of tumors. However, the above problems are challenging, due to the poor appearance contrast between different layers of the digestive tract wall (DTW) and the narrowness of each layer. Few of existing deep-learning based diagnosis algorithms are devised to tackle this issue. In this article, we build a multi-task framework for simultaneously locating and stratifying the submucosal tumor. And considering the awareness of the DTW is critical to the localization and stratification of the tumor, we integrate the DTW segmentation task into the proposed multi-task framework. Except for sharing a common backbone model, the three tasks are explicitly directed with a hierarchical guidance module, in which the probability map of DTW itself is used to locally enhance the feature representation for tumor localization, and the probability maps of DTW and tumor are jointly employed to locally enhance the feature representation for tumor stratification. Moreover, by means of the dynamic class activation map, probability maps of DTW and tumor are reused to enforce the stratification inference process to pay more attention to DTW and tumor regions, contributing to a reliable and interpretable submucosal tumor stratification model. Additionally, considering the relation with respect to other structures is beneficial for stratifying tumors, we devise a graph reasoning module to replenish non-local relation knowledge for the stratification branch. Experiments on a Stomach-Esophagus and an Intestinal EUS dataset prove that our method achieves very appealing performance on both tumor localization and stratification, significantly outperforming state-of-the-art object detection approaches.

Real Time Object Detection using Deep Learning and SSD Algorithm

Real time object detection is a complex area of computer vision, vast and vibrant. If there is a single object to be detected in an image, it is known as Image Localization and if there are multiple objects in an image, then it is Object Detection. Real time object identification to find and recognize real objects such as cars, bicycles, TV, flowers and people from pictures or videos. Object identification technique allows you to find out image or video details, as it allows detection, localization and multiple detection Objects in pictures or videos. Identifying objects in a video or image stream can be done through processes such as pre-processing. segmentation, foreground and background extraction, feature extraction. We will try to add new features related to the real world in future versions. In today's scenario, the Single Shot Multi-Box Detector (SSD) algorithm is considered the fastest approach for object detection using a single layer of a convolutional network. In our paper, we have focused on enhancing the classification accuracy of object detection while maintaining the algorithm's speed. Experimental results have confirmed that our proposed improved SSD algorithm achieves high accuracy.

Enhancing Strawberry Harvesting Efficiency through Yolo-v7 Object Detection Assessment

Strawberry fruits which are rich in vitamin A and carotenoids offer benefits for maintaining healthy epithelial tissues and promoting maturity and growth. The intensive cultivation and swift maturation of strawberries make them susceptible to premature harvesting, leading to spoilage and financial losses for farmers. This underscores the need for an automated detection method to monitor strawberry development and accurately identify growth phases of fruits. To address this challenge, a dataset called Strawberry-DS, comprising 247 images captured in a greenhouse at the Agricultural Research Center in Giza, Egypt, is utilized in this research. The images of the dataset encompass various viewpoints, including top and angled perspectives, and illustrate six distinct growth phases: "green", “red”, "white", "turning", "early-turning" and "late-turning". This study employs the Yolo-v7 approach for object detection, enabling the recognition and classification of strawberries in different growth phases. The achieved mAP@.5 values for the growth phases are as follows: 0.37 for "green," 0.335 for "white," 0.505 for "early-turning," 1.0 for "turning," 0.337 for "late-turning," and 0.804 for "red". The comprehensive performance outcomes across all classes are as follows: precision at 0.792, recall at 0.575, mAP@.5 at 0.558, and mAP@.5:.95 at 0.46. Notably, these results show the efficacy of the proposed research, both in terms of performance evaluation and visual assessment, even when dealing with distracting scenarios involving imbalanced label distributions and unclear labeling of developmental phases of the fruits. This research article yields advantages such as achieving reasonable and reliable identification of strawberries, even when operating in real-time scenarios which also leads to a decrease in expenses associated with human labor.

3D detection transformer: Set prediction of objects using point clouds

Object detection in 3D scenes rely on two main methods: detection based on proposals (two-stage detectors) or detections based on anchors (single-stage detectors), similar to approaches for object detection in 2D. In this paper, we propose the 3DeTR framework that produces 3D detections without the use of anchors or proposals, allowing training of the entire neural network in an end-to-end manner. Raw point cloud scenes are augmented and input into distance-and-reflectiveness-based feature extractor to produce representative points. Then, a transformer encoder–decoder module learns the local object relations and global context to generate parallel detections, which are then passed to a set-based loss function to map predictions to the set of ground truth labels uniquely. The model’s architecture produces 3D detections by regressing directly with the set of ground truths without the need for anchors or proposals, which are bottlenecks for object detection performances. We tested the framework on the KITTI Vision Benchmark Suite 3D object detection dataset, achieving results on par with the state-of-the-art: 80.37 AP on Cars (Moderate) class and 47.92 AP on Pedestrians (Moderate) class.

Review of Machine-Learning Approaches for Object and Component Detection in Space Electro-optical Satellites

Review of Machine-Learning Approaches for Object and Component Detection in Space Electro-optical Satellites

SEGANet: 3D object detection with shape-enhancement and geometry-aware network

3D object detection approaches from point clouds develop rapidly. However, the distribution of point clouds is unbalanced in the real scene, and thus the distant or occluded objects suffer from too few points to be perceived. This case damages the overall detection accuracy. Hence, we propose a novel two-stage 3D object detection framework, the Shape-Enhancement and Geometry-Aware Network (SEGANet), which aims to mitigate the negative impact of unbalanced point distribution for boosting detection performance. In stage 1, we first capture fine-grained structural knowledge with the assistance of point-wise features from voxels to generate proposals. And in stage 2, we construct a shape enhancement module to reconstruct complete surface points for objects within proposals, then establish an elaborate geometric relevance-aware Transformer module to aggregate high-correlated feature pairs of reconstructed-known parts and decode vital geometric relations of aggregated features. Thus, critical geometric clues are supplied for objects from the data and feature levels, achieving enhanced features for box refinement. Extensive experiments on KITTI and Waymo datasets show that SEGANet achieves low model complexity and excellent detection accuracy, especially leading the baseline method by 2.18% gain in overall detection accuracy and 1.8% gain in average accuracy of weakly sensing objects. This verifies that SEGANet effectively alleviates the impact of point imbalance to significantly boost detection performance.

SFA-Net: A Selective Features Absorption Network for Object Detection in Rainy Weather Conditions.

In recent years, object detection approaches using deep convolutional neural networks (CNNs) have derived major advances in normal images. However, such success is hardly achieved with rainy images due to lack of visibility. Aiming to bridge this gap, in this article, we present a novel selective features absorption network (SFA-Net) to improve the performance of object detection not only in rainy weather conditions but also in favorable weather conditions. SFA-Net accomplishes this objective by utilizing three subnetworks, where the feature selection subnetwork is concatenated with the object detection subnetwork through the feature absorption subnetwork to form a unified model. To promote further advancement in object detection impaired by rain, we propose a large-scale rainy image dataset, named srRain, which contains both synthetic rainy images and real-world rainy images for training and testing purposes. srRain is comprised of 25 900 rainy images depicting diverse driving scenarios in the presence of rain with a total of 181 164 instances interpreting five common object categories. Experimental results display that our SFA-Net reaches the highest mean average precision (mAP) of 77.53% on a normal image set, 62.52% on a synthetic rainy image set, 37.34% on a collected natural rainy image set, and 32.86% on a published real rainy image set, surpassing current state-of-the-art object detectors and the combination of image deraining and object detection models while retaining a high speed.

Improvement of Vehicle detection and classification performance with Region of Interest

This Abstract-Paper presents an innovative approach to improve the performance of vehicle detection and classification in the context of computer vision. This study proposes the use of Region of Interest (ROI) to identify and process vehicle information in traffic images. The proposed method is based on a combination of deep learning-based object detection algorithms with a more focused ROI-based approach. First, we use state-of-the-art convolution neural networks to perform object detection in traffic images, which involves a visual recognition process to identify vehicle locations. Then, using ROI, we reorder and reduce the dimensions of irrelevant data to remove background areas and increase attention to vehicle objects. This aims to reduce the computational load and speed up the detection and classification processes. We evaluate the proposed approach on a wide traffic dataset and compare the results with conventional object detection approaches without using ROI. The experimental results show that the proposed method outperforms the conventional approach in terms of vehicle detection speed and accuracy. In conclusion, this study succeeded in improving the performance of vehicle detection and classification by leveraging Region of Interest, which allows better focus on relevant regions and reduces computational complexity. These results can make an important contribution to the development of a more efficient and reliable traffic control and transportation system.

A Tiny Object Detection Approach for Maize Cleaning Operations.

Real-time and accurate awareness of the grain situation proves beneficial for making targeted and dynamic adjustments to cleaning parameters and strategies, leading to efficient and effective removal of impurities with minimal losses. In this study, harvested maize was employed as the raw material, and a specialized object detection network focused on impurity-containing maize images was developed to determine the types and distribution of impurities during the cleaning operations. On the basis of the classic contribution Faster Region Convolutional Neural Network, EfficientNetB7 was introduced as the backbone of the feature learning network and a cross-stage feature integration mechanism was embedded to obtain the global features that contained multi-scale mappings. The spatial information and semantic descriptions of feature matrices from different hierarchies could be fused through continuous convolution and upsampling operations. At the same time, taking into account the geometric properties of the objects to be detected and combining the images' resolution, the adaptive region proposal network (ARPN) was designed and utilized to generate candidate boxes with appropriate sizes for the detectors, which was beneficial to the capture and localization of tiny objects. The effectiveness of the proposed tiny object detection model and each improved component were validated through ablation experiments on the constructed RGB impurity-containing image datasets.

Multi-modality 3D object detection in autonomous driving: A review

Autonomous driving perception has made significant strides in recent years, but accurately sensing the environment using a single sensor remains a daunting task. This review offers a comprehensive overview of the current research on LiDAR and camera fusion for 3D object detection in multi-modality domains. The review first identifies the perception task, open public detection dataset, and data representation related to 3D object detection. It then presents an in-depth survey of coarse-grained and fine-grained fusion approaches, reporting their respective performances on the KITTI and nuScenes datasets. The review identifies general trends in multi-modality 3D object detection and provides insights and promising research directions based on these observations. Additionally, the review summarizes the current challenges of fusion strategies for perception problems in autonomous driving. Based on a critical review of existing literature, this paper identifies and discusses key research directions in the field of fusion-based 3D object detection approach for perception problems in autonomous driving, which is instructive for future work.

CAM-YOLO: tomato detection and classification based on improved YOLOv5 using combining attention mechanism.

One of the key elements in maintaining the consistent marketing of tomato fruit is tomato quality. Since ripeness is the most important factor for tomato quality in the viewpoint of consumers, determining the stages of tomato ripeness is a fundamental industrial concern with regard to tomato production to obtain a high quality product. Since tomatoes are one of the most important crops in the world, automatic ripeness evaluation of tomatoes is a significant study topic as it may prove beneficial in ensuring an optimal production of high-quality product, increasing profitability. This article explores and categorises the various maturity/ripeness phases to propose an automated multi-class classification approach for tomato ripeness testing and evaluation. Object detection is the critical component in a wide variety of computer vision problems and applications such as manufacturing, agriculture, medicine, and autonomous driving. Due to the tomato fruits' complex identification background, texture disruption, and partial occlusion, the classic deep learning object detection approach (YOLO) has a poor rate of success in detecting tomato fruits. To figure out these issues, this article proposes an improved YOLOv5 tomato detection algorithm. The proposed algorithm CAM-YOLO uses YOLOv5 for feature extraction, target identification and Convolutional Block Attention Module (CBAM). The CBAM is added to the CAM-YOLO to focus the model on improving accuracy. Finally, non-maximum suppression and distance intersection over union (DIoU) are applied to enhance the identification of overlapping objects in the image. Several images from the dataset were chosen for testing to assess the model's performance, and the detection performance of the CAM-YOLO and standard YOLOv5 models under various conditions was compared. The experimental results affirms that CAM-YOLO algorithm is efficient in detecting the overlapped and small tomatoes with an average precision of 88.1%.

Scalable and effective artificial intelligence for multivariate radar environment

Ground based radar is a key system for aerial defence of any country. Current generations of radar use Moving Target Indicator (MTI) filter, Constant False Alarm Rate (CFAR) and Peak Detection (PD) algorithms for detection of target and rejection of non-target (static clutter, dynamic clutter, interference and noise) objects. These conventional Radar Signal Processing (RSP) techniques find their limitation when either targets are not detected or false alarms are generated due to lack of built-in intelligence. In order to eliminate both the issues, a realistic radar environment has been analyzed using Artificial Intelligence (AI). Special emphasis has been made on invalid detections caused by weather clutter, which was never worked upon previously using AI. A novel deep learning based object detection approach has been devised keeping radar environment, high accuracy requirement and real-time constraint of radar in view. The proposed approach has been validated for its efficacy through standalone testing as well as Poof of Concept (PoC) implementation on a real radar. Integration of AI model in radar platform also involves a novel implementation scheme, whereby results of AI model are augmented by conventional RSP. Inference time of AI models is a bottleneck for their use in radar systems, in this context, new strategies have also been analyzed to achieve a real-time performance for radar application. As the objective of this research is to devise scalable and effective solutions for upcoming generations of radar; therefore, the work is of practical value for realistic deployments.

Feature Deep Learning Extraction Approach for Object Detection in Self-Driving Cars

Self-driving cars are a fundamental research subject in recent years; the ultimate goal is to completely exchange the human driver with automated systems. On the other hand, deep learning techniques have revealed performance and effectiveness in several areas. The strength of self-driving cars has been deeply investigated in many areas including object detection, localization as well, and activity recognition. This paper provides an approach to deep learning; which combines the benefits of both convolutional neural network CNN together with Dense technique. This approach learns based on features extracted from the feature extraction technique which is linear discriminant analysis LDA combined with feature expansion techniques namely: standard deviation, min, max, mod, variance and mean. The presented approach has proven its success in both testing and training data and achieving 100% accuracy in both terms.

Depth cue enhancement and guidance network for RGB-D salient object detection

Depth maps have been proven profitable to provide supplements for salient object detection in recent years. However, most RGB-D salient object detection approaches ignore that there are usually low-quality depth maps, which will inevitably result in unsatisfactory results. In this paper, we propose a depth cue enhancement and guidance network (DEGNet) for RGB-D salient object detection by exploring the depth quality enhancement and utilizing the depth cue guidance to generate predictions with highlighted objects and suppressed backgrounds. Specifically, a depth cue enhancement module is designed to generate high-quality depth maps by enhancing the contrast between the foreground and the background. Then considering the different characteristics of unimodal RGB and depth features, we use different feature enhancement strategies to strengthen the representation capability of side-output unimodal features. Moreover, we propose a depth-guided feature fusion module to excavate depth cues provided by the depth stream to guide the fusion of multi-modal features by fully making use of different modal properties, thus generating discriminative cross-modal features. Besides, we aggregate cross-modal features at different levels to obtain the final prediction by adopting a pyramid feature shrinking structure. Experimental results on six benchmark datasets demonstrate that the proposed network DEGNet outperforms 17 state-of-the-art methods.

Automated LVO detection and collateral scoring on CTA using a 3D self-configuring object detection network: a multi-center study

The use of deep learning (DL) techniques for automated diagnosis of large vessel occlusion (LVO) and collateral scoring on computed tomography angiography (CTA) is gaining attention. In this study, a state-of-the-art self-configuring object detection network called nnDetection was used to detect LVO and assess collateralization on CTA scans using a multi-task 3D object detection approach. The model was trained on single-phase CTA scans of 2425 patients at five centers, and its performance was evaluated on an external test set of 345 patients from another center. Ground-truth labels for the presence of LVO and collateral scores were provided by three radiologists. The nnDetection model achieved a diagnostic accuracy of 98.26% (95% CI 96.25–99.36%) in identifying LVO, correctly classifying 339 out of 345 CTA scans in the external test set. The DL-based collateral scores had a kappa of 0.80, indicating good agreement with the consensus of the radiologists. These results demonstrate that the self-configuring 3D nnDetection model can accurately detect LVO on single-phase CTA scans and provide semi-quantitative collateral scores, offering a comprehensive approach for automated stroke diagnostics in patients with LVO.