Oriented FAST And Rotated BRIEF Research Articles

Leading Edge Erosion Classification in Offshore Wind Turbines Using Feature Extraction and Classical Machine Learning

Leading edge (LE) erosion is a type of damage that inhibits the aerodynamic performance of a wind turbine, resulting in high operation and maintenance (O&M) costs. This paper makes use of a small dataset consisting of 50 images of LE erosion and healthy blades for feature extraction and the training of four types of classifiers, namely, support vector machine (SVM), random forest, K-nearest neighbour (KNN), and multi-layer perceptron (MLP). Six feature extraction methods were used with these classifiers to train 24 models. The dataset has also been used to train a convolutional neural network (CNN) model developed using Keras. The purpose of this work is to determine whether classical machine learning (ML) classifiers trained with extracted features can produce higher-accuracy results, train faster, and classify faster than deep learning (DL) models for the application of LE damage detection of wind turbine blades. The oriented fast and rotated brief (ORB)-trained SVM achieved an accuracy of 90% ± 0.01, took 80.4 s to train, and achieved inference speeds of 63 frames per second (FPS), compared to the CNN model, which achieved an accuracy of 79.4% ± 2.07, took 4667.4 s to train, and achieved an inference speed of 1.3 FPS. These results suggest that classical ML models can be more accurate and efficient than DL models if the appropriate feature extraction method is used.

An Enhanced Multiscale Retinex, Oriented FAST and Rotated BRIEF (ORB), and Scale-Invariant Feature Transform (SIFT) Pipeline for Robust Key Point Matching in 3D Monitoring of Power Transmission Line Icing with Binocular Vision

Power transmission line icing (PTLI) poses significant threats to the reliability and safety of electrical power systems, particularly in cold regions. Accumulation of ice on power lines can lead to severe consequences, such as line breaks, tower collapses, and widespread power outages, resulting in economic losses and infrastructure damage. This study proposes an enhanced image processing pipeline to accurately detect and match key points in PTLI images for 3D monitoring of ice thickness using binocular vision. The pipeline integrates established techniques such as multiscale retinex (MSR), oriented FAST and rotated BRIEF (ORB) and scale-invariant feature transform (SIFT) algorithms, further refined with m-estimator sample consensus (MAGSAC)-based random sampling consensus (RANSAC) optimization. The image processing steps include automatic cropping, image enhancement, feature detection, and robust key point matching, all designed to operate in challenging environments with poor lighting and noise. Experiments demonstrate that the proposed method significantly improves key point matching accuracy and computational efficiency, reducing processing time to make it suitable for real-time applications. The effectiveness of the pipeline is validated through 3D ice thickness measurements, with results showing high precision and low error rates, making it a valuable tool for monitoring power transmission lines in harsh conditions.

Fine-tuning GAN Models with Unpaired Aerial Images for RGB to NDVI Translation in Vegetation Index Estimation

Calculating the Normalized Difference Vegetation Index (NDVI) requires expensive multispectral cameras, posing challenges such as high costs and the need for technical expertise. This research aims to develop a method to transform RGB images obtained from Unmanned Aerial Vehicle (UAV) into NDVI images. Our proposed method leverages the CycleGAN model, an unsupervised image-to-image translation framework, to learn the intricate mapping between RGB values and NDVI. The model was trained on unpaired datasets of RGB and NDVI images, sourced from paddy fields located in Gresik and Yogyakarta, Indonesia. This process successfully encapsulated the complex correlation between these two modalities. Various training strategies were systematically investigated, including weight initialization schemes, fine-tuning procedures, and learning rate policies, to optimize the model's performance. The fine-tuned CycleGAN demonstrated superior performance in creating synthetic NDVI images from unpaired dataset, surpassing other methods in terms of fidelity, quality, and structural coherence. The results were impressive, with a Normalized Root Mean Square Error (NRMSE) of 0.327, a Peak Signal-to-Noise Ratio (PSNR) of 16.330, an Oriented FAST and Rotated BRIEF (ORB) score of 0.859, and a Structural Similarity Index (SSIM) of 0.757. The best performing CycleGAN model was then deployed on a low-spec microcomputer device, specifically the Raspberry Pi 4B with an average computation time of 21.0077 seconds. Raspberry Pi 4B was chosen for its lightweight, compact dimensions, and compatibility with efficient battery power connections, making it suitable for drone deployment.

Visualization Analysis of Integrating College Sports Training and Psychology into Basketball Physical Education Teaching System Based on Image Recognition Algorithm

ABSTRACT On this basis, a basketball movement model based on ORB (Oriented FAST and Rotated BRIEF) local feature extraction has been proposed, and a basketball teaching visualization analysis system has been constructed. By extracting images from athletes’ videos in basketball, and using their training as a standard, tracking the frequency of their various celebration postures appearing and improving their scores in the game, corresponding feature points are extracted, and then the BP (back propagation) neural network algorithm is used to classify feature points. Ten different participants were selected from 10 games. Their movements were tracked, and then the extracted feature actions were imported into the visualization system for visual analysis, comparing the changes before and after psychological intervention. The results showed that there were significant differences in scores, errors, hit rates, steals, and motivation among subjects who received psychological cues and incentives compared to the data before psychological counseling. The scores and positive and negative values increased to 2–4 points, which had a certain positive impact on the competitive results.

Atomic force microscopy wide-field scanning imaging using homography matrix optimization

During the offline combination of multiple atomic force microscopy (AFM) images, changes in probe displacement can be affected by dynamic noise, leading to dislocation and tearing in the stitching. To overcome this, we designed a homography matrix optimization method to describe the relative positional relationship between images by constructing the original image matrix and applying singular value decomposition to denoise the homography matrix. Additionally, we implemented a scale-invariant feature transform (SIFT) to extract feature points. To verify the effectiveness of this method, the SIFT + RANSAC (R), SIFT + affine transformation (AT), and oriented FAST and rotated BRIEF (ORB) algorithms were compared with the proposed algorithm. The experimental results demonstrate that the proposed method precisely computes the transformation matrix, thereby guaranteeing the geometric consistency of mosaic imaging. The proposed method preserves the intricate details of the original image and enhances the stitching quality of wide-field images.

Visual-Inertial RGB-D SLAM with Encoder Integration of ORB Triangulation and Depth Measurement Uncertainties.

In recent years, the accuracy of visual SLAM (Simultaneous Localization and Mapping) technology has seen significant improvements, making it a prominent area of research. However, within the current RGB-D SLAM systems, the estimation of 3D positions of feature points primarily relies on direct measurements from RGB-D depth cameras, which inherently contain measurement errors. Moreover, the potential of triangulation-based estimation for ORB (Oriented FAST and Rotated BRIEF) feature points remains underutilized. To address the singularity of measurement data, this paper proposes the integration of the ORB features, triangulation uncertainty estimation and depth measurements uncertainty estimation, for 3D positions of feature points. This integration is achieved using a CI (Covariance Intersection) filter, referred to as the CI-TEDM (Triangulation Estimates and Depth Measurements) method. Vision-based SLAM systems face significant challenges, particularly in environments, such as long straight corridors, weakly textured scenes, or during rapid motion, where tracking failures are common. To enhance the stability of visual SLAM, this paper introduces an improved CI-TEDM method by incorporating wheel encoder data. The mathematical model of the encoder is proposed, and detailed derivations of the encoder pre-integration model and error model are provided. Building on these improvements, we propose a novel tightly coupled visual-inertial RGB-D SLAM with encoder integration of ORB triangulation and depth measurement uncertainties. Validation on open-source datasets and real-world environments demonstrates that the proposed improvements significantly enhance the robustness of real-time state estimation and localization accuracy for intelligent vehicles in challenging environments.

A robust medical image zero-watermarking algorithm using Collatz and Fresnelet Transforms

Zero-watermarking in medical images is an emerging field that focuses on calculating the invisible data (key) using medical imagery to ensure data integrity and authenticity without compromising diagnostic accuracy. This paper introduces a robust zero-watermarking technique leveraging the Collatz and Fresnelet Transforms. The Forward Collatz Transform (FCT) is initially applied to create a secure and encrypted embedding pattern for medical images. Subsequently, the Fresnelet Transform (FT) is employed, offering superior localization and frequency selectivity. From the fresnelet values, we extract two strongest Oriented FAST and Rotated BRIEF (ORB) points to enhance watermark robustness, resulting in a 64-bit perceptual image hash. Our approach adopts a dual-layer security strategy by combining FCT and Cyclic-Shift-Transformation (CST) methods, significantly fortifying the protection of watermark image data. The watermark can be efficiently extracted using the Inverse Collatz Transform (ICT). A comprehensive performance analysis evaluates our system under single, double, and multiple attacks on medical images. Our experiments clearly show that our system outperforms existing methods in medical image watermarking, demonstrating its resilience against various manipulations. This approach can significantly improve data security and reliability in medical imaging applications.

A Robust AR-DSNet Tracking Registration Method in Complex Scenarios

A robust AR-DSNet (Augmented Reality method based on DSST and SiamFC networks) tracking registration method in complex scenarios is proposed to improve the ability of AR (Augmented Reality) tracking registration to distinguish target foreground and semantic interference background, and to address the issue of registration failure caused by similar target drift when obtaining scale information based on predicted target positions. Firstly, the pre-trained network in SiamFC (Siamese Fully-Convolutional) is utilized to obtain the response map of a larger search area and set a threshold to filter out the initial possible positions of the target; Then, combining the advantage of the DSST (Discriminative Scale Space Tracking) filter tracker to update the template online, a new scale filter is trained after collecting multi-scale images at the initial possible position of target to reason the target scale change. And linear interpolation is used to update the correlation coefficient to determine the final position of target tracking based on the difference between two frames. Finally, ORB (Oriented FAST and Rotated BRIEF) feature detection and matching are performed on the accurate target position image, and the registration matrix is calculated through matching relationships to overlay the virtual model onto the real scene, achieving enhancement of the real world. Simulation experiments show that in complex scenarios such as similar interference, target occlusion, and local deformation, the proposed AR-DSNet method can complete the registration of the target in AR 3D tracking, ensuring real-time performance while improving the robustness of the AR tracking registration algorithm.

Distributed video transmission reduction approach for energy saving in WMSNs

SummaryWireless Multimedia Sensor Networks (WMSNs) are composed of a large number of sensor nodes that are distributed in a region to collect and transmit data. Video transmission is one of the most important applications of WMSNs because it can provide critical information about monitored areas. WMSNs face challenges related to energy consumption, bandwidth usage, and network congestion related to huge amounts of data collected by sensors. To tackle this problem, this paper proposes the Distributed Video Transmission Reduction Approach for Energy Saving in WMSN (DiViTRA). The method involves two phases: sensing and transmission phases. DiViTRA achieves frame rate adaptation to reduce the number of captured video frames and save energy during the sensing phase. In the transmission phase, three effective techniques, ORB (Oriented FAST and Rotated BRIEF), Brute‐Force (BF) Matcher, and Grid‐based Motion Statistics (GMS) are applied to decide whether to transmit the current captured frame or remove it and adjust the frame capturing rate of the video sensor accordingly. In the case of frame transmission, the DiViTRA approach compresses the frame using two data reduction approaches: PCA (Principal Component Analysis) and Huffman encoding. Through simulations, DiViTRA demonstrates a 12% reduction in energy consumption, and 71% is a ratio of reduction in sent frames while preserving stream quality. The approach has been validated in scenarios involving critical events, showcasing its efficacy in maintaining data integrity during transmission.

Grounding rod hanging and removing robot with hand-eye self-calibration capability in substation

In this paper, a robot system for hanging and removing grounding rods is designed by integrating 3D recognition technology, hand-eye self-calibration technology, and automatic operation technology. Specifically, a novel hand-eye self-calibration algorithm is proposed that only uses common objects in the actual scene, which differs from traditional robot hand-eye calibration in that it requires a dedicated calibration board to assist with offline completion. Addressing the problem that existing self-calibration methods cannot be optimized as a whole, resulting in low accuracy and instability of the solution, a multi-stage objective function optimization self-calibration algorithm is proposed. An optimization method based on the minimization of re-projection error is designed to compensate for the results, which uses an efficient Oriented fast and rotated brief (ORB) feature extraction algorithm and introduces a scoring mechanism to retain more correct matching points in the feature matching stage. Experimental verifications are conducted using both public dataset and practical robot system. In the dataset experiment, our method demonstrates superior accuracy and robustness compared to existing self-calibration methods. Furthermore, the practical robot platform experiment confirms the feasibility and efficacy of our approach across various wind speeds and lighting conditions.

Simultaneous Localization and Mapping of a Mobile Robot With Stereo Camera Using ORB Features

Simultaneous Localization and Mapping (SLAM) is applied to robots for accurate navigation. The stereo cameras are suitable for visual SLAM as they can give the depth of the visual landmarks and more precise estimations of the robot’s pose. In this paper, we present a survey of SLAM methods, either Bayesian or bioinspired. Then we present a new method of SLAM, which we call stereo Extended Kalman Filter, improving the matching by computing the innovation matrices from the left and the right images. The landmarks are computed from Oriented FAST and Rotated BRIEF (ORB) features for detecting salient points and their descriptors. The covariance matrices of the state and the robot’s map are reduced during the robot’s motion. Experiments are done on the raw images of the Kitti dataset.

Multi-channel and multi-featured extended orb with gabor filter and non-maximum suppression

This research paper presents an enhanced approach to feature extraction using the Oriented FAST and Rotated BRIEF (ORB) algorithm (Rublee et al., 2014). The proposed method leverages the power of Gabor filters (Mehrotra et al., 1992) in combination with Non-Maximum Suppression (Neuback and Van Gool, 2006) to improve the robustness and efficiency of feature detection in computer vision applications. The process begins with the acquisition of an RGB image, which is then transformed into seven single-channel images representing different color and intensity aspects: red, green, blue, hue, saturation, value, and grayscale. Each single-channel image is independently subjected to Gabor filtering, resulting in seven Gabor-filtered images. These images capture distinct texture and frequency information, enhancing the discriminative power of subsequent feature extraction. Subsequently, the Oriented FAST and Rotated BRIEF (ORB) algorithm is applied to each of the seven Gabor-filtered images to extract key points and descriptors. This step yields a comprehensive set of keypoints (Mallick et al., 2015) and descriptors, capturing rich local feature information across multiple image channels. To further refine the extracted features and eliminate redundant keypoints, Non-Maximum Suppression is employed independently on each single-channel image. This process effectively filters out overlapped and false keypoints, ensuring the selection of only the most salient features for downstream tasks. Experimental results demonstrate the efficacy of the proposed approach in improving feature detection performance compared to traditional methods. The combination of Gabor filtering and Non-Maximum Suppression enhances feature discriminability, robustness to noise, and resistance to image transformations, making it well-suited for various computer vision applications, including object recognition, image matching, and scene understanding.

Matching UAV-Based Simulated High-Resolution SAR and Real SAR Images

Abstract. Our experiment focuses on generating simulated high-resolution (HR) Synthetic Aperture Radar (SAR) images from the photogrammetric 3D model derived from Unmanned Aerial Vehicle (UAV) imagery. The goal is to match these simulated images with real SAR data of complex scenes containing vegetation, buildings, roads, and the construction of receiving antennas. Simulated SAR reflectivity map was based on ray tracing techniques.Two feature matching algorithms, namely Scale-Invariant Feature Transform (SIFT) and Oriented FAST and Rotated BRIEF (ORB) were employed for co-registration of the simulated to the real SAR images. The effectiveness of these algorithms is evaluated by their matching rates. The experiment results of the matching process highlight the superior performance of ORB over SIFT, attributed to its robustness against rotation variations and noise. ORB emerges as a versatile choice for high-resolution real and simulated SAR registration tasks.

Image quality evaluation: evaluation of the image quality of actual images by using machine learning models

Evaluating image features is a significant step in image processing in applications like number plate detection, vehicle tracking and many image processing-based applications. Image processing-based applications need accurate parts to get the best outcomes. Feature detection is done based on various feature detection techniques. The proposed system aims to get the best feature detector based on the input images by evaluating the image features. For assessing the image features, the proposed system worked on various descriptors like oriented FAST and rotated brief (ORB), learned arrangements of three patch codes (LATCH), binary robust independent elementary features (BRIEF), and binary robust invariant scalable keypoints (BRISK) to extract and evaluate the features using K-nearest neighbor (KNN)-matching and retrieve the inliers of the matching. Each descriptor produces different matching features and inliers; with the matchings and inliers, the inlier ratio calculates to show the analysis. To increase performance, we also examine adding depth information to descriptors.

Visual Odometry Based on Improved Oriented Features from Accelerated Segment Test and Rotated Binary Robust Independent Elementary Features

To address the problem of system instability during vehicle low-speed driving, we propose improving the visual odometer using ORB (Oriented FAST and Rotated BRIEF) features. The homogeneity of ORB features leads to poor corner point properties of some feature points. When the environmental texture lacks richness, it leads to poor matching performance and low matching accuracy of the feature points. We solve the problem of the corner point properties of feature points using weight calculation for regions with different textures. When the vehicle speed is too low, the continuous frames captured by the camera will overlap significantly, causing large fluctuations in the system error. We use motion model estimation to solve this problem. Meanwhile, experimental validation using the KITTI dataset achieves good results.

Combining bag of visual words-based features with CNN in image classification

Abstract Although traditional image classification techniques are often used in authentic ways, they have several drawbacks, such as unsatisfactory results, poor classification accuracy, and a lack of flexibility. In this study, we introduce a combination of convolutional neural network (CNN) and support vector machine (SVM), along with a modified bag of visual words (BoVW)-based image classification model. BoVW uses scale-invariant feature transform (SIFT) and Oriented Fast and Rotated BRIEF (ORB) descriptors; as a consequence, the SIFT–ORB–BoVW model developed contains highly discriminating features, which enhance the performance of the classifier. To identify appropriate images and overcome challenges, we have also explored the possibility of utilizing a fuzzy Bag of Visual Words (BoVW) approach. This study also discusses using CNNs/SVM to improve the proposed feature extractor’s ability to learn more relevant visual vocabulary from the image. The proposed technique was compared with classic BoVW. The experimental results proved the significant enhancement of the proposed technique in terms of performance and accuracy over state-of-the-art models of BoVW.

Comparison of feature extraction and auto-preprocessing for chili pepper (Capsicum Frutescens) quality classification using machine learning

The low-cost camera for machine vision, such as a webcam, still has a problem with resolution noise. Therefore, it is important to learn strategies to reduce noise from low-cost camera images so that they can be widely used for grading machines in the future. This paper aims to compare three feature extraction methods with auto-preprocessing to classify chili pepper <em>(Capsicum Frutescens)</em> quality using a machine learning algorithm. Three extraction methods were used, including the color feature, oriented FAST and rotated BRIEF (ORB), and the combination color feature and ORB. A total of 525 image data for quality chili pepper were collected using the webcam. The auto-preprocessing strategy to classify chili peppers can improve the performance of machine-learning algorithms for all data generated by the feature extractor. The performance of the chili paper quality classification model with auto-preprocessing of the variable color feature can improve the performance of machine learning algorithms by up to 64.21%. The performance improvement of the classification model using the ORB feature variable and the auto-preprocessing of up to 4.41%. The performance improvement of the classification model using machine learning algorithms is 11.27% when using the combination color feature and ORB feature and autopreprocessing.

Detection of Coastal Erosion and Progradation in the Colombian ‘Atrato River’ Delta by Using Sentinel-1 Synthetic Aperture Radar Data

This paper presents a methodology to detect the coastal erosion and progradation effects in the ‘Atrato River’ delta, located in the Gulf of Urabá in Colombia, using SAR (Synthetic Aperture Radar) images. Erosion is the physical–mechanical loss of the soil that affects its functions and ecosystem services while producing a reduction in its productive capacity. Progradation is the deposition of layers in the basinward direction while moving coastward. Other studies have investigated these two phenomena using optical images, encountering difficulties due to the persistent presence of clouds in this region. In order to avoid the cloud effects, in this study, we used 16 Sentinel 1 SAR images with two different polarizations between 2016 and 2023. First, each image was rescaled from 0 to 255, then the image was despeckled by a deep learning (DL) model. Afterwards, a single RGB image was composed with the filtered polarizations. Next, a classifier with 99% accuracy based on Otsu’s method was used to determine whether each pixel was water or not. Then, the classified image was registered to a reference one using Oriented FAST and Rotated BRIEF (ORB) descriptor. Finally, a multitemporal analysis was performed by comparing every image to the previous one to identify the studied phenomena, calculating areas. Also, all images were integrated to obtain a heatmap that showed the overall changes across eight years (2016–2023) in a single image. The multitemporal analysis performed found that the newly created mouth is the most active area for these processes, coinciding with other studies. In addition, a comparison of these findings with the Oceanic Niño Index (ONI) showed a relative delayed coupling to the erosion process and a coupling of progradation with dry and wet seasons.

Advanced framework for epilepsy detection through image-based EEG signal analysis.

Recurrent and unpredictable seizures characterize epilepsy, a neurological disorder affecting millions worldwide. Epilepsy diagnosis is crucial for timely treatment and better outcomes. Electroencephalography (EEG) time-series data analysis is essential for epilepsy diagnosis and surveillance. Complex signal processing methods used in traditional EEG analysis are computationally demanding and difficult to generalize across patients. Researchers are using machine learning to improve epilepsy detection, particularly visual feature extraction from EEG time-series data. This study examines the application of a Gramian Angular Summation Field (GASF) approach for the analysis of EEG signals. Additionally, it explores the utilization of image features, specifically the Scale-Invariant Feature Transform (SIFT) and Oriented FAST and Rotated BRIEF (ORB) techniques, for the purpose of epilepsy detection in EEG data. The proposed methodology encompasses the transformation of EEG signals into images based on GASF, followed by the extraction of features utilizing SIFT and ORB techniques, and ultimately, the selection of relevant features. A state-of-the-art machine learning classifier is employed to classify GASF images into two categories: normal EEG patterns and focal EEG patterns. Bern-Barcelona EEG recordings were used to test the proposed method. This method classifies EEG signals with 96% accuracy using SIFT features and 94% using ORB features. The Random Forest (RF) classifier surpasses state-of-the-art approaches in precision, recall, F1-score, specificity, and Area Under Curve (AUC). The Receiver Operating Characteristic (ROC) curve shows that Random Forest outperforms Support Vector Machine (SVM) and k-Nearest Neighbors (k-NN) classifiers. The suggested method has many advantages over time-series EEG data analysis and machine learning classifiers used in epilepsy detection studies. A novel image-based preprocessing pipeline using GASF for robust image synthesis and SIFT and ORB for feature extraction is presented here. The study found that the suggested method can accurately discriminate between normal and focal EEG signals, improving patient outcomes through early and accurate epilepsy diagnosis.

Practical application of interactive AI technology based on visual analysis in professional system of physical education in universities

Currently, physical education teaching in universities tends to adopt the traditional model of one teacher for multiple students, which has high requirements for teachers and is difficult to consider students' strengths. On this basis, an interactive system has been established, including three modules: behavior information, user data collection, and behavior evaluation. Taking the 400 m running physical education teaching as an example, Kinectv2 was used to collect students' movements and contours while running, and ORB (Oriented FAST and Rotated BRIEF) feature extraction algorithm was used to extract students' movement features. After importing the data into the interactive system, students and teachers could view it in the system and provide guidance based on the students’ actions. This article took 10 students as examples to test their performance changes in the 400 m running before and after systematic training. The results showed that the evaluation score after receiving systematic instruction increased by 6–7 s compared to the score without receiving instruction, with a significant change. This indicated that the interactive AI (artificial intelligence) system constructed in this article can play a significant role in sports teaching of 400 m running.