Faster R-CNN Research Articles

Corrigendum to: Deep Learning-based Automated Knee Joint Localization in Radiographic Images Using Faster R-CNN.

In the online version of the article, a change was made in the section of author's affiliation. The affiliation of Drs. Sivakumari and Vani in the online version of the article entitled "Deep Learning-based Automated Knee Joint Localization in Radiographic Images Using Faster R-CNN has been updated in "Current Medical Imaging", 2024; 20: e15734056262464 [1]. The original article can be found online at: https:// www.eurekaselect.com/article/135374 Original: T. Sivakumari1 and R. Vani1* 1SRM Institute of Science and Technology, Faculty of Engineering and Technology, Ramapuram, Chennai, Tamil Nadu, India Corrected: T. Sivakumari1 and R. Vani1* 1Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Faculty of Engineering and Technology, Ramapuram, Chennai, Tamil Nadu, India.

RA-Net: reverse attention for generalizing residual learning

Since residual learning was proposed, identity mapping has been widely utilized in various neural networks. The method enables information transfer without any attenuation, which plays a significant role in training deeper networks. However, interference with unhindered transmission also affects the network’s performance. Accordingly, we propose a generalized residual learning architecture called reverse attention (RA), which applies high-level semantic features to supervise low-level information in the identity mapping branch. It means that higher semantic features selectively transmit low-level information to deeper layers. In addition, we propose a Modified Global Response Normalization(M-GRN) to implement reverse attention. RA-Net is derived by embedding M-GRN in the residual learning framework. The experiments show that the RA-Net brings significant improvements over residual networks on typical computer vision tasks. For classification on ImageNet-1K, compared with resnet101, RA-Net improves the Top-1 accuracy by 1.7% with comparable parameters and computational cost. For COCO detection, on Faster R-CNN, reverse attention improves box AP by 1.9%. Meanwhile, reverse attention improves UpperNet’s mIoU by 0.7% on ADE20K segmentation.

Fabric4show: real-time vision system for fabric defect detection and post-processing

The exploration of computer vision applications for fabric defect detection has immense potential value. However, current relevant research in this area has primarily focused on detection models that aim for high detection accuracy and algorithmic efficiency, while neglecting the practical industrial production requirements. Therefore, we propose a fabric defect detection and post-processing system that integrates an optimized region with convolutional neural network (CNN) features (i.e., Faster R-CNN) for defect detection, defect localization and detection model evaluation. In addition, the proposed intelligent system incorporates novel approaches, such as a rearranged fabric dataset, anomaly detection, recommended clipping region division, and a replenishment device. This study illustrates an example of artificial intelligence (AI)-driven automated technology in fabric manufacturing. The accuracy and detection speed of different detection models under identical hardware conditions are evaluated and compared with related work. Experimental results demonstrate that the proposed approach achieves comparable performance to other models, while significantly reducing computational resource requirements. The potential efficiency of using two-stage networks on hardware systems for fabric defect detection tasks is highlighted, which is likely to have relevant implications for the textile industry.

RVDR-YOLOv8: A Weed Target Detection Model Based on Improved YOLOv8

Currently, weed control robots that can accurately identify weeds and carry out removal work are gradually replacing traditional chemical weed control techniques. However, the computational and storage resources of the core processing equipment of weeding robots are limited. Aiming at the current problems of high computation and the high number of model parameters in weeding robots, this paper proposes a lightweight weed target detection model based on the improved YOLOv8 (You Only Look Once Version 8), called RVDR-YOLOv8 (Reversible Column Dilation-wise Residual). First, the backbone network is reconstructed based on RevCol (Reversible Column Networks). The unique reversible columnar structure of the new backbone network not only reduces the computational volume but also improves the model generalisation ability. Second, the C2fDWR module is designed using Dilation-wise Residual and integrated with the reconstructed backbone network, which improves the adaptive ability of the new backbone network RVDR and enhances the model’s recognition accuracy for occluded targets. Again, GSConv is introduced at the neck end instead of traditional convolution to reduce the complexity of computation and network structure while ensuring the model recognition accuracy. Finally, InnerMPDIoU is designed by combining MPDIoU with InnerIoU to improve the prediction accuracy of the model. The experimental results show that the computational complexity of the new model is reduced by 35.8%, the number of parameters is reduced by 35.4% and the model size is reduced by 30.2%, while the mAP50 and mAP50-95 values are improved by 1.7% and 1.1%, respectively, compared to YOLOv8. The overall performance of the new model is improved compared to models such as Faster R-CNN, SSD and RetinaNet. The new model proposed in this paper can achieve the accurate identification of weeds in farmland under the condition of limited hardware resources, which provides theoretical and technical support for the effective control of weeds in farmland.

Improved YOLO v7 for Sustainable Agriculture Significantly Improves Precision Rate for Chinese Cabbage (Brassica pekinensis Rupr.) Seedling Belt (CCSB) Detection

Precise navigation in agricultural applications necessitates accurate guidance from the seedling belt, which the Global Positioning System (GPS) alone cannot provide. The overlapping leaves of Chinese cabbage (Brassica pekinensis Rupr.) present significant challenges for seedling belt fitting due to difficulties in plant identification. This study aims to address these challenges by improving the You Only Look Once (YOLO) v7 model with a novel approach that decouples its network head deriving from the Faster-Regions with Convolutional Neural Network (Faster R-CNN) architecture. Additionally, this study introduced a BiFormer attention mechanism to accurately identify the centers of overlapping Chinese cabbages. Using these identified centers and pixel distance verification, this study achieved precise fitting of the Chinese cabbage seedling belt (CCSB). Our experimental results demonstrated a significant improvement in performance metrics, with our improved model achieving a 2.5% increase in mean average precision compared to the original YOLO v7. Furthermore, our approach attained a 94.2% accuracy in CCSB fitting and a 91.3% Chinese cabbage identification rate. Compared to traditional methods such as the Hough transform and linear regression, our method showed an 18.6% increase in the CCSB identification rate and a 17.6% improvement in angle accuracy. The novelty of this study lies in the innovative combination of the YOLO v7 model with a decoupled head and the BiFormer attention mechanism, which together advance the identification and fitting of overlapping leafy vegetables. This advancement supports intelligent weeding, reduces the reliance on chemical herbicides, and promotes safer, more sustainable agricultural practices. Our research not only improves the accuracy of overlapping vegetable identification, but also provides a robust framework for enhancing precision agriculture.

Dental caries detection using faster region-based convolutional neural network with residual network

Dental caries is the highest prevalent dental disease in the world by 2022. Caries can be stopped by early detection of patients through efficient screening. Previously, there have been several methods used to detect caries such as single shot multibox detector (SSD), faster region-based convolutional neural network (Faster R-CNN) and you only look once (YOLO). This research aims to develop accurate dental caries detection using Faster R-CNN. Using a dataset collected from scraping on the internet, this research is started by creating an original dataset consisting of 81 base images which are then augmented to a total of 486 images and annotated by dental health experts from Jenderal Soedirman University. Transfer learning using pre-trained Faster R-CNN residual network (ResNet)-50 and ResNet-101 model is utilized to detect and localise dental caries. The Faster R-CNN ResNet-50 model trained using the Adam optimizer produces a mean average precision (mAP) of 0.213, and those using the momentum optimizer produce a mAP of 0.177. While the Faster R-CNN ResNet-101 model trained using the Adam optimizer produces a mAP of 0.192, and those using the momentum optimizer produce a mAP of 0.004. The model trained on the dataset showed satisfactory results in detecting dental caries, especially ResNet-50 with Adam optimizer.

Enhanced Tomato Pest Detection via Leaf Imagery with a New Loss Function

Pests have caused significant losses to agriculture, greatly increasing the detection of pests in the planting process and the cost of pest management in the early stages. At this time, advances in computer vision and deep learning for the detection of pests appearing in the crop open the door to the application of target detection algorithms that can greatly improve the efficiency of tomato pest detection and play an important technical role in the realization of the intelligent planting of tomatoes. However, in the natural environment, tomato leaf pests are small in size, large in similarity, and large in environmental variability, and this type of situation can lead to greater detection difficulty. Aiming at the above problems, a network target detection model based on deep learning, YOLONDD, is proposed in this paper. Designing a new loss function, NMIoU (Normalized Wasserstein Distance with Mean Pairwise Distance Intersection over Union), which improves the ability of anomaly processing, improves the model’s ability to detect and identify objects of different scales, and improves the robustness to scale changes; Adding a Dynamic head (DyHead) with an attention mechanism will improve the detection ability of targets at different scales, reduce the number of computations and parameters, improve the accuracy of target detection, enhance the overall performance of the model, and accelerate the training process. Adding decoupled head to Head can effectively reduce the number of parameters and computational complexity and enhance the model’s generalization ability and robustness. The experimental results show that the average accuracy of YOLONDD can reach 90.1%, which is 3.33% higher than the original YOLOv5 algorithm and is better than SSD, Faster R-CNN, YOLOv7, YOLOv8, RetinaNet, and other target detection networks, and it can be more efficiently and accurately utilized in tomato leaf pest detection.

Deep Learning-based Lightweight Models for Bactrocera Oleae Detection

The detection of Bactrocera oleae (BO), an invasive pest that poses a serious threat to olive tree cultivation, is crucial for ensuring the quality and quantity of olive oil production. This study explores the application of deep learning with lightweight models for BO detection in olive trees. The DIRT Dataset, consisting of 841 images obtained from traps, was used for training and evaluation. Different combinations of Faster R-CNN and SSD models with various backbone architectures, including EfficientNet B0, MobileNet v3, ResNet-18, and ResNet-50, were assessed. The combination of Faster R-CNN with ResNet-18 achieves comparable results to Faster R-CNN with ResNet-50 but with lower latency and a reduced parameter count. These findings highlight the potential of deep learning-based object detection models for BO detection in olive trees, offering efficient and accurate identification of infestations.

Implementing Improved YOLOv5s for Immediate Identification of Helmetless Forklift Drivers

Implementing Improved YOLOv5s for Immediate Identification of Helmetless Forklift Drivers

Firefighting Water Jet Trajectory Detection from Unmanned Aerial Vehicle Imagery Using Learnable Prompt Vectors.

This research presents an innovative methodology aimed at monitoring jet trajectory during the jetting process using imagery captured by unmanned aerial vehicles (UAVs). This approach seamlessly integrates UAV imagery with an offline learnable prompt vector module (OPVM) to enhance trajectory monitoring accuracy and stability. By leveraging a high-resolution camera mounted on a UAV, image enhancement is proposed to solve the problem of geometric and photometric distortion in jet trajectory images, and the Faster R-CNN network is deployed to detect objects within the images and precisely identify the jet trajectory within the video stream. Subsequently, the offline learnable prompt vector module is incorporated to further refine trajectory predictions, thereby improving monitoring accuracy and stability. In particular, the offline learnable prompt vector module not only learns the visual characteristics of jet trajectory but also incorporates their textual features, thus adopting a bimodal approach to trajectory analysis. Additionally, OPVM is trained offline, thereby minimizing additional memory and computational resource requirements. Experimental findings underscore the method's remarkable precision of 95.4% and efficiency in monitoring jet trajectory, thereby laying a solid foundation for advancements in trajectory detection and tracking. This methodology holds significant potential for application in firefighting systems and industrial processes, offering a robust framework to address dynamic trajectory monitoring challenges and augment computer vision capabilities in practical scenarios.

Analysis of the performance of Faster R-CNN and YOLOv8 in detecting fishing vessels and fishes in real time

This research conducts a comparative analysis of Faster R-CNN and YOLOv8 for real-time detection of fishing vessels and fish in maritime surveillance. The study underscores the significance of this investigation in advancing fisheries monitoring and object detection using deep learning. With a clear focus on comparing the performance of Faster R-CNN and YOLOv8, the research aims to elucidate their effectiveness in real-time detection, emphasizing the relevance of such capabilities in fisheries management. By conducting a thorough literature review, the study establishes the current state-of-the-art in object detection, particularly within the context of fisheries monitoring, while discussing existing methods, challenges, and limitations. The findings of this study not only shed light on the superiority of YOLOv8 in precise detection but also highlight its potential impact on maritime surveillance and the protection of marine resources.

Developing a Novel Deep Learning Model for Pediatric Chest Radiograph Analysis

Pediatric thoracic diseases pose significant challenges to healthcare systems worldwide, particularly in regions with limited access to specialized medical resources. Lower respiratory infections, in particular, contribute significantly to childhood morbidity and mortality. This research aims to address the diagnostic challenges associated with pediatric thoracic diseases by harnessing the power of artificial intelligence. The study utilizes the PediCXR dataset, composed of pediatric chest radiographs, and employs a Faster R-CNN model pretrained on ImageNet data for lesion detection and classification. The model is trained to identify abnormal lesions indicative of various thoracic diseases, with a focus on achieving high accuracy and minimizing loss. Experimental results demonstrate the model's capability to achieve an accuracy exceeding 90% and a loss under 0.1, meeting predefined objectives.

Comparative analysis of computer vision algorithms for the real-time detection of digital dermatitis in dairy cows

Digital dermatitis (DD) is a bovine claw disease responsible for ulcerative lesions on the planar aspect of the hoof. DD is associated with massive herd outbreaks of lameness and influences cattle welfare and production. Early detection of DD can lead to prompt treatment and decrease lameness. Computer vision (CV) provides a unique opportunity to improve early detection. The study aims to train and compare applications for the real-time detection of DD in dairy cows. Eight CV models were trained for detection and scoring, compared using performance metrics and inference time, and the best model was automated for real-time detection using images and video. Images were collected from commercial dairy farms while facing the interdigital space on the plantar surface of the foot. Images were scored for M-stages of DD by a trained investigator using the M-stage DD classification system with distinct labels for hyperkeratosis (H) and proliferations (P). Two sets of images were compiled: the first dataset (Dataset 1) containing 1,177 M0/M4H and 1,050 M2/M2P images and the second dataset (Dataset 2) containing 240 M0, 17 M2, 51 M2P, 114 M4H, and 108 M4P images. Models were trained to detect and score DD lesions and compared for precision, recall, and mean average precision (mAP) in addition to inference time in frame per second (FPS). Seven of the nine CV models performed well compared to the ground truth of labeled images using Dataset 1. The six models, Faster R-CNN, Cascade R-CNN, YOLOv3, Tiny YOLOv3, YOLOv4, Tiny YOLOv4, and YOLOv5s achieved an mAP between 0.964 and 0.998, whereas the other two models, SSD and SSD Lite, yielded an mAP of 0.371 and 0.387 respectively. Overall, YOLOv4, Tiny YOLOv4, and YOLOv5s outperformed all other models with almost perfect precision, perfect recall, and a higher mAP. Tiny YOLOv4 outperformed all other models with respect to inference time at 333 FPS, followed by YOLOv5s at 133 FPS and YOLOv4 at 65 FPS. YOLOv4 and Tiny YOLOv4 performed better than YOLOv5s compared to the ground truth using Dataset 2. YOLOv4 and Tiny YOLOv4 yielded a similar mAP of 0.896 and 0.895, respectively. However, Tiny YOLOv4 achieved both higher precision and recall compared to YOLOv4. Finally, Tiny YOLOv4 was able to detect DD lesions on a commercial dairy farm with high performance and speed. The proposed CV tool can be used for early detection and prompt treatment of DD in dairy cows. This result is a step towards applying CV algorithms to veterinary medicine and implementing real-time DD detection on dairy farms.

Deep-learning-based sampling position selection on color Doppler sonography images during renal artery ultrasound scanning

Accurate selection of sampling positions is critical in renal artery ultrasound examinations, and the potential of utilizing deep learning (DL) for assisting in this selection has not been previously evaluated. This study aimed to evaluate the effectiveness of DL object detection technology applied to color Doppler sonography (CDS) images in assisting sampling position selection. A total of 2004 patients who underwent renal artery ultrasound examinations were included in the study. CDS images from these patients were categorized into four groups based on the scanning position: abdominal aorta (AO), normal renal artery (NRA), renal artery stenosis (RAS), and intrarenal interlobular artery (IRA). Seven object detection models, including three two-stage models (Faster R-CNN, Cascade R-CNN, and Double Head R-CNN) and four one-stage models (RetinaNet, YOLOv3, FoveaBox, and Deformable DETR), were trained to predict the sampling position, and their predictive accuracies were compared. The Double Head R-CNN model exhibited significantly higher average accuracies on both parameter optimization and validation datasets (89.3 ± 0.6% and 88.5 ± 0.3%, respectively) compared to other methods. On clinical validation data, the predictive accuracies of the Double Head R-CNN model for all four types of images were significantly higher than those of the other methods. The DL object detection model shows promise in assisting inexperienced physicians in improving the accuracy of sampling position selection during renal artery ultrasound examinations.

Vehicle Occupant Detection Based on MM-Wave Radar.

With the continuous development of automotive intelligence, vehicle occupant detection technology has received increasing attention. Despite various types of research in this field, a simple, reliable, and highly private detection method is lacking. This paper proposes a method for vehicle occupant detection using millimeter-wave radar. Specifically, the paper outlines the system design for vehicle occupant detection using millimeter-wave radar. By collecting the raw signals of FMCW radar and applying Range-FFT and DoA estimation algorithms, a range-azimuth heatmap was generated, visually depicting the current status of people inside the vehicle. Furthermore, utilizing the collected range-azimuth heatmap of passengers, this paper integrates the Faster R-CNN deep learning networks with radar signal processing to identify passenger information. Finally, to test the performance of the detection method proposed in this article, an experimental verification was conducted in a car and the results were compared with those of traditional machine learning algorithms. The findings indicated that the method employed in this experiment achieves higher accuracy, reaching approximately 99%.

An object detection method for catenary component images based on improved Faster R-CNN

Catenary components are an important part of electrified railways. Especially for catenary support devices, there are various types of components with significant differences in scale. According to statistical data, there is a high risk of failure for the catenary support device components during the operation of the catenary system. Therefore, in order to ensure the safe operation of the railways, it is critical to accurately locate and recognize the components in the catenary images. In this paper, we propose an improved method based on faster region-based convolutional neural networks (Faster R-CNN) framework to realize the detection and extraction of the components on the catenary support devices. Firstly, the anchor box parameters are reset using the K-means clustering method, which greatly improves the localization precision of the predicted box. Secondly, scaled exponential linear units activation function is introduced to improve the algorithm performance. Moreover, ResNet-34, the backbone of Faster R-CNN, is optimized. We design a transition structure for multi-scale filter combination convolution to avoid missing feature information and eliminate some redundant convolution structures. This modification substantially enhances the capability of the model to recognize a wide variety of component types. Finally, we conduct some control experiments comparing with single shot multibox detector and you only look once (YOLO) series (YOLOv3, YOLOv5 and YOLOv7) models. They are faster but less accurate, especially for small objects. The results show that the proposed method has better detection performance, achieving a mean average precision of 96.50% and running at 17.79 frames per second. In addition, our model has the highest average recall of 69.27%, which is 2.66% higher than the original model.

Camera-Based Crime Behavior Detection and Classification

Increasing numbers of public and private locations now have surveillance cameras installed to make those areas more secure. Even though many organizations still hire someone to monitor the cameras, the person hired is more likely to miss some unexpected events in the video feeds because of human error. Several researchers have worked on surveillance data and have presented a number of approaches for automatically detecting aberrant events. To keep track of all the video data that accumulate, a supervisor is often required. To analyze the video data automatically, we recommend using neural networks to identify the crimes happening in the real world. Through our approach, it will be easier for police agencies to discover and assess criminal activity more quickly using our method, which will reduce the burden on their staff. In this paper, we aim to provide anomaly detection using surveillance videos as input specifically for the crimes of arson, burglary, stealing, and vandalism. It will provide an efficient and adaptable crime-detection system if integrated across the smart city infrastructure. In our project, we trained multiple accurate deep learning models for object detection and crime classification for arson, burglary and vandalism. For arson, the videos were trained using YOLOv5. Similarly for burglary and vandalism, we trained using YOLOv7 and YOLOv6, respectively. When the models were compared, YOLOv7 performed better with the highest mAP of 87. In this, we could not compare the model’s performance based on crime type because all the datasets for each crime type varied. So, for arson YOLOv5 performed well with 80% mAP and for vandalism, YOLOv6 performed well with 86% mAP. This paper designed an automatic identification of crime types based on camera or surveillance video in the absence of a monitoring person, and alerts registered users about crimes such as arson, burglary, and vandalism through an SMS service. To detect the object of the crime in the video, we trained five different machine learning models: Improved YOLOv5 for arson, Faster RCNN and YOLOv7 for burglary, and SSD MobileNet and YOLOv6 for vandalism. Other than improved models, we innovated by building ensemble models of all three crime types. The main aim of the project is to provide security to the society without human involvement and make affordable surveillance cameras to detect and classify crimes. In addition, we implemented the Web system design using the built package in Python, which is Gradio. This helps the registered user of the Twilio communication tool to receive alert messages when any suspicious activity happens around their communities.

Study of a Deep Convolution Network with Enhanced Region Proposal Network in the Detection of Cancerous Lung Tumors.

A deep convolution network that expands on the architecture of the faster R-CNN network is proposed. The expansion includes adapting unsupervised classification with multiple backbone networks to improve the Region Proposal Network in order to improve accuracy and sensitivity in detecting minute changes in images. The efficiency of the proposed architecture is investigated by applying it to the detection of cancerous lung tumors in CT (computed tomography) images. This investigation used a total of 888 images from the LUNA16 dataset, which contains CT images of both cancerous and non-cancerous tumors of various sizes. These images are divided into 80% and 20%, which are used for training and testing, respectively. The result of the investigation through the experiment is that the proposed deep-learning architecture could achieve an accuracy rate of 95.32%, a precision rate of 94.63%, a specificity of 94.84%, and a high sensitivity of 96.23% using the LUNA16 images. The result shows an improvement compared to a reported accuracy of 93.6% from a previous study using the same dataset.

An accurate object detection of wood defects using an improved Faster R-CNN model

ABSTRACT Wood defect classification and location are crucial for automatic repair and reuse in wood product manufacture, which requires high accuracy and efficiency in the engineering practice. In this paper, a novel modeling method is proposed for faster R-CNN to improve the object detection of wood defect. An improved ResNet-50 network, a focal loss function, and a soft non-maximum suppression (soft NMS) were adopted to replace the counterparts of the initial Faster R-CNN. Experiments were conducted on a wood defect dataset with seven types of defects. The experimental results indicate that the using of the improved ResNet-50 network brings a significant increase in mean average precision (mAP) by 4.4% and reduces the detection time by 3.6% than that of the traditional Faster R-CNN on wood defect detection. Besides, mAPs are 3.4% and 2.8% higher than that of the traditional Faster R-CNN as the employment of the focal loss function and soft NMS, respectively. Finally, the proposed model obtains better mAP than the classic target detection networks. Results demonstrate the effectiveness and feasibility of the proposed modeling method in engineering applications.

Vision-based robotic grasping using faster R-CNN–GRCNN dual-layer detection mechanism

Visual grasping technology plays a crucial role in various robotic applications, such as industrial automation, warehousing, and logistics. However, current visual grasping methods face limitations when applied in industrial scenarios. Focusing solely on the workspace where the grasping target is located restricts the camera’s ability to provide additional environmental information. On the other hand, monitoring the entire working area introduces irrelevant data and hinders accurate grasping pose estimation. In this paper, we propose a novel approach that combines a global camera and a depth camera to enable efficient target grasping. Specifically, we introduce a dual-layer detection mechanism based on Faster R-CNN–GRCNN. By enhancing the Faster R-CNN with attention mechanisms, we focus the global camera on the workpiece placement area and detect the target object within that region. When the robot receives the command to grasp the workpiece, the improved Faster R-CNN recognizes the workpiece and guides the robot towards the target location. Subsequently, the depth camera on the robot determines the grasping pose using Generative Residual Convolutional Neural Network and performs the grasping action. We validate the feasibility and effectiveness of our proposed framework through experiments involving collaborative assembly tasks using two robotic arms.