Faster Region-based Convolutional Neural Network Research Articles

Recognizing Indonesian sign language (Bisindo) gesture in complex backgrounds

Sign language, particularly Indonesian sign language (Bisindo), is vital for deaf individuals, but learning it is challenging. This study aims to develop an automated Bisindo recognition system suitable for diverse backgrounds. Previous research focused on greenscreen backgrounds and struggled with natural or complex backgrounds. To address this problem, the study proposes using Faster region-based convolutional neural networks (RCNN) and YOLOv5 for hand and face detection, MobileNetV2 for feature extraction, and long short-term memory (LSTM) for classification. The system is also designed to focus on computational efficiency. YOLOv5 model achieves the best result with a sentence accuracy (SAcc) of 49.29% and a word error rate (WER) of 16.42%, with a computational time of 0.0188 seconds, surpassing the baseline model. Additionally, the system achieved a SacreBLEU score of 67.77%, demonstrating its effectiveness in Bisindo recognition across various backgrounds. This research improves accessibility for deaf individuals by advancing automated sign language recognition technology.

Impact of RAW vs. RGB images on low-light object detection in autonomous driving

Abstract. In the field of autonomous driving, object detection in low-light conditions presents a critical challenge. Traditional detection algorithms, reliant on RGB imagery, often suffer from diminished performance under inadequate illumination. In contrast, RAW images, which retain a higher level of intrinsic image information, have the potential to enhance detection accuracy. Therefore, the paper aims to assess whether models trained on RAW images exhibit enhanced object detection performance in low-light scenarios. To this end, experiments are conducted utilizing the Low-light Object Detection (LOD) dataset, which includes paired RAW and RGB images, with variations in lighting simulated through different exposure times. Two distinct datasets are constructed: one consisting of RAW-normal and RAW-dark images, and another comprising RGB-normal and RGB-dark images. The models evaluated in this research include YOLOv8, Faster R-CNN (Region-based Convolutional Neural Network), and EfficientDet, selected to ensure robustness and generalizability of the findings. The results demonstrate that models trained on RAW images significantly outperform those trained on RGB images, thus exhibiting higher accuracy both in general and under low-light conditions. The preservation of detailed image information in RAW format facilitates enhanced feature extraction, thereby improving detection accuracy and resilience under low-light conditions. These findings provide novel insights into advancing object detection methodologies for autonomous driving systems operating in challenging lighting environments.

Anti-islanding image detection and optimization of distributed power supply using neural network architecture search

Anti-islanding detection (AILD) for distributed power sources plays an important role on the stable operation of power grid systems and the safety of electrical systems. In order to improve the detection accuracy, we propose neural network architecture search (NAS) based approach for anti-islanding image detection and optimization of distributed power sources. It combines the fast region-based convolutional neural network (Faster-R-CNN) with the differentiable architecture search (Darts), utilizing electrical signal image data acquired from cameras or photovoltaic (PV) inverters, thereby enhancing the accuracy and efficiency of detection. We conduct a comparative analysis of two methods for obtaining distributed power supply (DPS) anti-islanding image data: camera-based acquisition and PV inverter-based acquisition. Our observation reveals that the image data acquired through cameras is more conducive for the learning process of DCNN. The proposed algorithm was compared with other convolutional neural network (CNN) models, validating its performance superiority. This provides a novel perspective and methodology for the advancement of AILD for distributed power sources, and enhances the security and stability of DPS.

Comparative Study of Lightweight Target Detection Methods for Unmanned Aerial Vehicle-Based Road Distress Survey.

Unmanned aerial vehicles (UAVs) are effective tools for identifying road anomalies with limited detection coverage due to the discrete spatial distribution of roads. Despite computational, storage, and transmission challenges, existing detection algorithms can be improved to support this task with robustness and efficiency. In this study, the K-means clustering algorithm was used to calculate the best prior anchor boxes; Faster R-CNN (region-based convolutional neural network), YOLOX-s (You Only Look Once version X-small), YOLOv5-s, YOLOv7-tiny, YOLO-MobileNet, and YOLO-RDD models were built based on image data collected by UAVs. YOLO-MobileNet has the most lightweight model but performed worst in accuracy, but greatly reduces detection accuracy. YOLO-RDD (road distress detection) performed best with a mean average precision (mAP) of 0.701 above the Intersection over Union (IoU) value of 0.5 and achieved relatively high accuracy in detecting all four types of distress. The YOLO-RDD model most successfully detected potholes with an AP of 0.790. Significant or severe distresses were better identified, and minor cracks were relatively poorly identified. The YOLO-RDD model achieved an 85% computational reduction compared to YOLOv7-tiny while maintaining high detection accuracy.

Utilization of transformer model in multimodal data fusion learning: Cross-modal knowledge transfer in the new generation learning space

In response to the difficulties in integrating multimodal data and insufficient model generalization ability in traditional cross-modal knowledge transfer, this article used the Transformer model to explore it in the new generation learning space. Firstly, the article analyzed the processing methods of data and models in cross-modal knowledge transfer, and explored the application of Transformer models in the learning space. This model used natural language processing to represent and extract textual features, Mel Frequency Cepstral Coefficients (MFCCs) to represent and extract audio features, and Faster R-CNN (Faster Region-based Convolutional Neural Network) to represent and extract image features. The article also discussed the implementation process of the Transformer model functionality. The experiment used data from four datasets, including Quora Question Pairs, to test the performance of the model’s cross-modal knowledge transfer through intelligent question answering and task analysis. In single type data testing, the accuracy and recall of the model in this article were better than the comparison model in the three types of data. The highest accuracy and recall in the test set were 91% and 93%, respectively. In the most challenging multimodal intelligent question answering test, the speech-image question answering method achieved an accuracy rate of 89% in answering open questions, indicating that the model had good multimodal data fusion ability. In the analysis experiment of 6 homework prone knowledge points on images with text annotations, the induction accuracy reached 85%, indicating that the model had strong generalization ability. The experimental results showed that the Transformer model had good cross-modal knowledge transfer performance, providing a reference for subsequent research on cross-modal knowledge transfer in the new generation learning space.

Application of mask R-CNN for building detection in UAV remote sensing images

This study aims to tackle the challenges of low accuracy in building feature extraction and insufficient details in three-dimensional (3D) modeling faced by traditional methods, particularly in complex backgrounds. To address these issues, a method for building feature extraction based on Mask Region-Convolutional Neural Network (Mask R-CNN) is proposed. This approach combines deep learning techniques with aerial images to ensure precise and efficient automatic detection and feature extraction. Urban building images are captured through aerial photography, and building outlines are annotated to create a comprehensive dataset of building features. The Mask R-CNN-based method efficiently processes and classifies the features of the dataset, generating candidate regions for further analysis. Additionally, this method demonstrates significant advantages in building feature extraction by employing the Mask R-CNN model to generate adaptive features. Comparative analysis with models such as Convolutional Neural Network (CNN), Region-based Convolutional Neural Network (R-CNN), Fast Region-based Convolutional Neural Network (Fast R-CNN), Faster Region-based Convolutional Neural Network (Faster R-CNN), and Generative Adversarial Network (GAN) indicates that Mask R-CNN exhibits superior performance in building feature extraction. The Mask R-CNN-based approach achieved approximately 95 % classification accuracy, while also showcasing strong stability and generalization capabilities. This study provides new methodologies and insights for enhancing feature extraction in aerial building imagery, offering significant reference value for the fields of architectural design and urban planning.

Hybrid convolutional neural network optimized with an artificial algae algorithm for glaucoma screening using fundus images.

We developed an optimized decision support system for retinal fundus image-based glaucoma screening. We combined computer vision algorithms with a convolutional network for fundus images and applied a faster region-based convolutional neural network (FRCNN) and artificial algae algorithm with support vector machine (AAASVM) classifiers. Optic boundary detection, optic cup, and optic disc segmentations were conducted using TernausNet. Glaucoma screening was performed using the optimized FRCNN. The Softmax layer was replaced with an SVM classifier layer and optimized with an AAA to attain enhanced accuracy. Using three retinal fundus image datasets (G1020, digital retinal images vessel extraction, and high-resolution fundus), we obtained accuracy of 95.11%, 92.87%, and 93.7%, respectively. Framework accuracy was amplified with an adaptive gradient algorithm optimizer FRCNN (AFRCNN), which achieved average accuracy 94.06%, sensitivity 93.353%, and specificity 94.706%. AAASVM obtained average accuracy of 96.52%, which was 3% ahead of the FRCNN classifier. These classifiers had areas under the curve of 0.9, 0.85, and 0.87, respectively. Based on statistical Friedman evaluation, AAASVM was the best glaucoma screening model. Segmented and classified images can be directed to the health care system to assess patients' progress. This computer-aided decision support system will be useful for optometrists.

Enhanced marine fish small sample image recognition with RVFL in Faster R-CNN model

Addressing the challenge of insufficient underwater marine life images leading to diminished accuracy in existing target recognition models, this paper introduces Random Vector Functional Link (RVFL), a suitable model for small sample training, to reduce the dependency of traditional visual recognition models on data volume by replacing the Softmax classifier in the Faster Region-Based Convolutional Neural Network (R-CNN) model. The RVFL network assigns random weights to enhance the model's adaptability to diverse data distributions, thereby improving its generalization performance. Furthermore, the RVFL model incorporates multiple nonlinear activation functions, thereby enhancing the neural network's representational capacity for high-dimensional data. The application of the proposed model to the task of marine fish small sample target recognition demonstrates its effectiveness in mitigating the low accuracy issue caused by data scarcity. It significantly improved recognition accuracy and offered new insights into addressing underwater small sample image recognition challenges.

Abnormal Detection of Commutator Surface Defects Based on YOLOv8

The YOLOv8 model has high detection efficiency and classification accuracy in detecting commutator surface defects, aimed at the problem of low working efficiency of a commutator, caused by commutator surface defects. First, the theoretical framework of Region-based Convolutional Neural Networks (R-CNN), spatial pyramid pooling (SPP)-net, Fast R-CNN, and Faster R-CNN is introduced, and the detection principle and process are described in detail. Secondly, the principle of the YOLOv8 network structure, head structure, neck structure, and C2f module are explained, and the loss function is described. The average precision of the proposed algorithm for detecting cracks and small points is more than 98%, and the frames per second (FPS) is 27. The detection results are mapped to the original image, and the visualization of the commutator surface defect detection is obtained, which has a higher robustness, accuracy, and real-time performance than the R-CNN, SPP-net, Fast R-CNN, and Faster R-CNN algorithms.

Camphor tree detection in urban environments using RGB-DSM data fusion

ABSTRACT Individual tree detection in urban areas using unmanned air vehicles (UAVs) RGB imagery poses challenges due to the diverse shapes and structures of urban trees and the complexity of urban forests. The digital surface model (DSM) provides elevation data, and the fusion of UAV RGB imagery with elevation data has emerged as a promising approach for tree detection. Here, we constructed a novel network structure based on the faster region-based convolutional neural network (Faster R-CNN) to detect camphor trees in urban environments using RGB-DSM data. First, an attention fusion module was proposed to effectively fuse the RGB and DSM features by leveraging their complementarity. Second, the bidirectional feature pyramid network (BiFPN) was introduced to enhance the model performance in detecting camphor tree crowns of varying sizes. The results showed that our approach could effectively detect urban camphor trees and achieved an AP of 85.7%. Notably, our approach yielded an AP of 81.3% in urban green spaces. The analysis indicated that our approach was feasible for detecting camphor trees in urban areas and demonstrated its potential to facilitate urban forestry research and applications.

Comparing Mask R-CNN backbone architectures for human detection using thermal imaging

We introduce a method for detecting humans in thermal imaging using an end-to-end deep learning model. Our objective is to optimize the human detection process in thermal imaging by investigating the mask region-based convolutional neural network (Mask R-CNN). The model, an advancement of the faster region-based convolutional neural network (Faster R-CNN), not only captures bounding boxes encompassing human subjects but also delineates segmentation masks around them. Our investigation extends to the evaluation and comparison of various convolutional neural networks for feature learning, like residual network (ResNet) and Inception ResNet, all integrated into the Mask R-CNN framework. Furthermore, the experimental results show that our proposed technique achieves high accuracy. Specifically, the Mask R-CNN model using ResNet50-V1 achieved the best results, with an F-value of 87.85%, a recall of 79.33%, and a precision of 98.41%.

A robust defect detection method with a generalization enhancer and cross-modality aggregator for cylinder bores

High-quality cylinder bores in automobile engines enable drivers to respond quickly to emergencies. Automated detection methods are gradually being adopted across various industries. However, uncontrollable factors and improper preservation methods lead to various types of defects on cylinder bores, thereby causing existing high-performance detectors to exhibit not only undesirable generalizability for unseen defect types but also a certain degree of missed detection for defects of seen types, thereby allowing defective cylinder bores to flow into the market. To address these issues, we propose a foundation-model-based robust defect detection method with high generalizability for cylinder bores (RHG-Detector). Specifically, to address unseen defect categories, we propose a generalization enhancer comprising a box filter, a region extractor and a defect discriminator (DeDi) based on a foundation model to extend defect detection from a closed set to an open set. To reduce missed detections, we adopt a cross-modality aggregator to aggregate the detection results from different modalities. Additionally, we collected and annotated challenging defect classification and detection datasets for cylinder bores, named HIT-EngDC (Harbin Institute of Technology Engine defect classification dataset) and HIT-EngDD2 (Engine defect detection dataset-version 2), which cover nearly all types of cylinder bore defects. Extensive experiments on HIT-EngDC and HIT-EngDD2 demonstrate the state-of-the-art performance of RHG-Detector, with a classification accuracy of 92.0 and a mAP@50 (mean average precision under intersection over union = 0.5) score of 45.2, where the latter is increased by ∼6 and ∼3 compared to the corresponding FasterRCNN (faster region-based convolutional neural networks) and YOLOv7 (you only look once) scores, respectively.

An appearance quality classification method for Auricularia auricula based on deep learning

The intelligent appearance quality classification method for Auricularia auricula is of great significance to promote this industry. This paper proposes an appearance quality classification method for Auricularia auricula based on the improved Faster Region-based Convolutional Neural Networks (improved Faster RCNN) framework. The original Faster RCNN is improved by establishing a multiscale feature fusion detection model to improve the accuracy and real-time performance of the model. The multiscale feature fusion detection model makes full use of shallow feature information to complete target detection. It fuses shallow features with rich detailed information with deep features rich in strong semantic information. Since the fusion algorithm directly uses the existing information of the feature extraction network, there is no additional calculation. The fused features contain more original detailed feature information. Therefore, the improved Faster RCNN can improve the final detection rate without sacrificing speed. By comparing with the original Faster RCNN model, the mean average precision (mAP) of the improved Faster RCNN is increased by 2.13%. The average precision (AP) of the first-level Auricularia auricula is almost unchanged at a high level. The AP of the second-level Auricularia auricula is increased by nearly 5%. And the third-level Auricularia auricula AP is increased by 1%. The improved Faster RCNN improves the frames per second from 6.81 of the original Faster RCNN to 13.5. Meanwhile, the influence of complex environment and image resolution on the Auricularia auricula detection is explored.

Development and Validation of an Artificial Intelligence Model for Detecting Rib Fractures on Chest Radiographs.

Background: Chest radiography is the standard method for detecting rib fractures. Our study aims to develop an artificial intelligence (AI) model that, with only a relatively small amount of training data, can identify rib fractures on chest radiographs and accurately mark their precise locations, thereby achieving a diagnostic accuracy comparable to that of medical professionals. Methods: For this retrospective study, we developed an AI model using 540 chest radiographs (270 normal and 270 with rib fractures) labeled for use with Detectron2 which incorporates a faster region-based convolutional neural network (R-CNN) enhanced with a feature pyramid network (FPN). The model's ability to classify radiographs and detect rib fractures was assessed. Furthermore, we compared the model's performance to that of 12 physicians, including six board-certified anesthesiologists and six residents, through an observer performance test. Results: Regarding the radiographic classification performance of the AI model, the sensitivity, specificity, and area under the receiver operating characteristic curve (AUROC) were 0.87, 0.83, and 0.89, respectively. In terms of rib fracture detection performance, the sensitivity, false-positive rate, and free-response receiver operating characteristic (JAFROC) figure of merit (FOM) were 0.62, 0.3, and 0.76, respectively. The AI model showed no statistically significant difference in the observer performance test compared to 11 of 12 and 10 of 12 physicians, respectively. Conclusions: We developed an AI model trained on a limited dataset that demonstrated a rib fracture classification and detection performance comparable to that of an experienced physician.

3D residual attention hierarchical fusion for real-time detection of the prostate capsule

BackgroundFor prostate electrosurgery, where real-time surveillance screens are relied upon for operations, manual identification of the prostate capsule remains the primary method. With the need for rapid and accurate detection becoming increasingly urgent, we set out to develop a deep learning approach for detecting the prostate capsule using endoscopic optical images.MethodsOur method involves utilizing the Simple, Parameter-Free Attention Module(SimAM) residual attention fusion module to enhance the extraction of texture and detail information, enabling better feature extraction capabilities. This enhanced detail information is then hierarchically transferred from lower to higher levels to aid in the extraction of semantic information. By employing a forward feature-by-feature hierarchical fusion network based on the 3D residual attention mechanism, we have proposed an improved single-shot multibox detector model.ResultsOur proposed model achieves a detection precision of 83.12% and a speed of 0.014 ms on NVIDIA RTX 2060, demonstrating its effectiveness in rapid detection. Furthermore, when compared to various existing methods including Faster Region-based Convolutional Neural Network (Faster R-CNN), Single Shot Multibox Detector (SSD), EfficientDet and others, our method Attention based Feature Fusion Single Shot Multibox Detector (AFFSSD) stands out with the highest mean Average Precision (mAP) and faster speed, ranking only below You Only Look Once version 7 (YOLOv7).ConclusionsThis network excels in extracting regional features from images while retaining the spatial structure, facilitating the rapid detection of medical images.

Deep Learning Approaches for Water-body Detection from Satellite Imagery

Agriculture department of Government of India provides funds for digging wells and making farm ponds for improving farmers livelihood. The proper execution of the policies not been worked out due to the manual process. For the automation of the process, we are using the object detection algorithm Faster Region-based Convolutional Neural Network (F-RCNN) to detect the location of the wells and Farm ponds. The faster RCNN method introduced region of interest to improve the model speed. We have tried to address water body detection on satellite imagery with an AI approach to cross verify the utilization of funds is the challenge. The traditional object detection algorithms are low in accuracy, also uses coco image data set. Detecting water body has not been addressed by anybody. We have extended the algorithms for water bodies detection for the complete geographic region of agricultural land. Improved Faster R-CNN algorithm used in the detection of wells and farm ponds. More than 1000 Satellite imagery are used to train the model to detect the water body. The experimental results demonstrated promising accuracy on well and farm ponds detection. The accuracy of the faster RCNN algorithm is 90%, we have tested the accuracy of the results by GIS locations, and ground-truthing is achieved by our designed Android App.This app gives the latitude and longitude of well or farm ponds entered by the person in Jalgaon. Keywords : About four key words or phrases in alphabetical order, separated by commas.

Disease Detection In Rice And Wheat Leaves: A Comparative Study On Various Deep Learning Techniques

Rice and wheat are considered as the most significant foods in agriculture all over the globe. Around 50% of all calories consumed in the human diet are rendered by both rice and wheat. Rice is a rich source of carbohydrates that is the main energy source of the human body. Wheat, which comprises vitamins and minerals, is a staple food source. Also, wheat is extensively used as flour to make a variety of food products. However, the disease that occurs in the leaves of rice and wheat could decelerate the production of these two food sources. Thus, timely detection of disease that occurs within the rice and wheat leaves is very significant. To detect Rice Leaf Diseases (RLD) and Wheat Leaf Diseases (WLD), numerous conventional methods are established. Specifically, You Only Look Once (YOLO), Faster Regionbased Convolutional Neural Network (FRCNN), and Single Shot Detector (SSD) are extensively implemented in various works to detect diverse leaf diseases in rice and wheat plants. Therefore, in this review, the merits and demerits of the traditional Object Detection (OD) models in RLD and WLD detection are provided systematically. The robustness of the Deep learning (DL) techniques in detecting various kinds of leaf diseases in rice and wheat plants with a classification accuracy of 99% and a precision of 98% is proved by the analysis outcomes.

Dental caries detection using faster region-based convolutional neural network with residual network

Dental caries is the highest prevalent dental disease in the world by 2022. Caries can be stopped by early detection of patients through efficient screening. Previously, there have been several methods used to detect caries such as single shot multibox detector (SSD), faster region-based convolutional neural network (Faster R-CNN) and you only look once (YOLO). This research aims to develop accurate dental caries detection using Faster R-CNN. Using a dataset collected from scraping on the internet, this research is started by creating an original dataset consisting of 81 base images which are then augmented to a total of 486 images and annotated by dental health experts from Jenderal Soedirman University. Transfer learning using pre-trained Faster R-CNN residual network (ResNet)-50 and ResNet-101 model is utilized to detect and localise dental caries. The Faster R-CNN ResNet-50 model trained using the Adam optimizer produces a mean average precision (mAP) of 0.213, and those using the momentum optimizer produce a mAP of 0.177. While the Faster R-CNN ResNet-101 model trained using the Adam optimizer produces a mAP of 0.192, and those using the momentum optimizer produce a mAP of 0.004. The model trained on the dataset showed satisfactory results in detecting dental caries, especially ResNet-50 with Adam optimizer.

Development and validation of a self-attention network-based algorithm to detect mediastinal lesions on computed tomography images.

Diagnosis of mediastinal lesions on computed tomography (CT) images is challenging for radiologists, as numerous conditions can present as mass-like lesions at this site. This study aimed to develop a self-attention network-based algorithm to detect mediastinal lesions on CT images and to evaluate its efficacy in lesion detection. In this study, two separate large-scale open datasets [National Institutes of Health (NIH) DeepLesion and Medical Image Computing and Computer Assisted Intervention (MICCAI) 2022 Mediastinal Lesion Analysis (MELA) Challenge] were collected to develop a self-attention network-based algorithm for mediastinal lesion detection. We enrolled 921 abnormal CT images from the NIH DeepLesion dataset into the pretraining stage and 880 abnormal CT images from the MELA Challenge dataset into the model training and validation stages in a ratio of 8:2 at the patient level. The average precision (AP) and confidence score on lesion detection were evaluated in the validation set. Sensitivity to lesion detection was compared between the faster region-based convolutional neural network (R-CNN) model and the proposed model. The proposed model achieved an 89.3% AP score in mediastinal lesion detection and could identify comparably large lesions with a high confidence score >0.8. Moreover, the proposed model achieved a performance boost of almost 2% in the competition performance metric (CPM) compared to the faster R-CNN model. In addition, the proposed model can ensure an outstanding sensitivity with a relatively low false-positive rate by setting appropriate threshold values. The proposed model showed excellent performance in detecting mediastinal lesions on CT. Thus, it can drastically reduce radiologists' workload, improve their performance, and speed up the reporting time in everyday clinical practice.

An object detection method for catenary component images based on improved Faster R-CNN

Catenary components are an important part of electrified railways. Especially for catenary support devices, there are various types of components with significant differences in scale. According to statistical data, there is a high risk of failure for the catenary support device components during the operation of the catenary system. Therefore, in order to ensure the safe operation of the railways, it is critical to accurately locate and recognize the components in the catenary images. In this paper, we propose an improved method based on faster region-based convolutional neural networks (Faster R-CNN) framework to realize the detection and extraction of the components on the catenary support devices. Firstly, the anchor box parameters are reset using the K-means clustering method, which greatly improves the localization precision of the predicted box. Secondly, scaled exponential linear units activation function is introduced to improve the algorithm performance. Moreover, ResNet-34, the backbone of Faster R-CNN, is optimized. We design a transition structure for multi-scale filter combination convolution to avoid missing feature information and eliminate some redundant convolution structures. This modification substantially enhances the capability of the model to recognize a wide variety of component types. Finally, we conduct some control experiments comparing with single shot multibox detector and you only look once (YOLO) series (YOLOv3, YOLOv5 and YOLOv7) models. They are faster but less accurate, especially for small objects. The results show that the proposed method has better detection performance, achieving a mean average precision of 96.50% and running at 17.79 frames per second. In addition, our model has the highest average recall of 69.27%, which is 2.66% higher than the original model.