Multi-scale Local Binary Pattern Feature Research Articles

A Hybrid Model for Household Waste Sorting (HWS) Based on an Ensemble of Convolutional Neural Networks

The exponential increase in waste generation is a significant global challenge with serious implications. Addressing this issue necessitates the enhancement of waste management processes. This study introduces a method that improves waste separation by integrating learning models at various levels. The method begins with the creation of image features as a new matrix using the Multi-Scale Local Binary Pattern (MLBP) technique. This technique optimally represents features and patterns across different scales. Following this, an ensemble model at the first level merges two Convolutional Neural Network (CNN) models, with each model performing the detection operation independently. A second-level CNN model is then employed to obtain the final output. This model uses the information from the first-level models and combines these features to perform a more accurate detection. The study’s novelty lies in the use of a second-level CNN model in the proposed ensemble system for fusing the results obtained from the first level, replacing conventional methods such as voting and averaging. Additionally, the study employs an MLBP feature selection approach for a more accurate description of the HW image features. It uses the Simulated Annealing (SA) algorithm for fine-tuning the hyperparameters of the CNN models, thereby optimizing the system’s performance. Based on the accuracy metric, the proposed method achieved an accuracy of 99.01% on the TrashNet dataset and 99.41% on the HGCD dataset. These results indicate a minimum improvement of 0.48% and 0.36%, respectively, compared to the other methods evaluated in this study.

Fault diagnosis of driving gear in rack and pinion drives based on multi-scale local binary pattern extraction and sparse representation

Rack and pinion drives (RPDs) are key components of battery-swapping systems (BSSs) used in electric heavy trucks; the faults occurring in these drives reduce the efficiency, accuracy, quality of battery swapping, and even pose potential safety risks. The operating conditions of RPD driving gear in BSSs are characterized by speed fluctuations, relatively low speeds, and reciprocating motion. To assess the driving gear fault characteristics under these conditions, based on the solution of image recognition under complex and low illumination conditions, this study proposes a fault diagnosis framework that includes adaptive down-sampling, three-dimensional acceleration data fusion, multi-scale local binary pattern (MS-LBP) extraction, and sparse representation. First, adaptive down-sampling is used to smooth out the speed fluctuation. Subsequently, MS-LBP extraction is employed to obtain efficient fault features at low speed. Finally, dictionary learning and sparse representations are conducted on the MS-LBP features. The effectiveness and advantages of the proposed diagnosis approach are demonstrated using monitoring data acquired from a BSS. Moreover, comparative studies demonstrate that the proposed fault diagnosis method yields improved performance.

CamNav: a computer-vision indoor navigation system

We present CamNav, a vision-based navigation system that provides users with indoor navigation services. CamNav captures images in real time while the user is walking to recognize their current location. It does not require any installation of indoor localization devices. In this paper, we describe the techniques of our system that improve the recognition accuracy of an existing system that uses oriented FAST and rotated BRIEF (ORB) as part of its location-matching procedure. We employ multiscale local binary pattern (MSLBP) features to recognize places. We implement CamNav and conduct required experiments to compare the obtained accuracy when using ORB, the scale-invariant feature transform (SIFT), MSLBP features, and the combination of both ORB and SIFT features with MSLBP. A dataset composed of 42 classes was constructed for assessment. Each class contains 100 pictures designed for training one location and 24 pictures dedicated for testing. The evaluation results demonstrate that the place recognition accuracy while using MSLBP features is better than the accuracy when using SIFT features. The accuracy when using SIFT, MSLBP, and ORB features is 88.19%, 91.27%, and 96.33%, respectively. The overall accuracy of recognizing places increased to 93.55% and 97.52% after integrating MSLBP with SIFT with ORB, respectively.

Face Liveness Detection Based on Skin Blood Flow Analysis

Face recognition systems have been widely adopted for user authentication in security systems due to their simplicity and effectiveness. However, spoofing attacks, including printed photos, displayed photos, and replayed video attacks, are critical challenges to authentication, and these spoofing attacks allow malicious invaders to gain access to the system. This paper proposes two novel features for face liveness detection systems to protect against printed photo attacks and replayed attacks for biometric authentication systems. The first feature obtains the texture difference between red and green channels of face images inspired by the observation that skin blood flow in the face has properties that enable distinction between live and spoofing face images. The second feature estimates the color distribution in the local regions of face images, instead of whole images, because image quality might be more discriminative in small areas of face images. These two features are concatenated together, along with a multi-scale local binary pattern feature, and a support vector machine classifier is trained to discriminate between live and spoofing face images. The experimental results show that the performance of the proposed method for face spoof detection is promising when compared with that of previously published methods. Furthermore, the proposed system can be implemented in real time, which is valuable for mobile applications.

Automatic classification of colorectal and prostatic histologic tumor images using multiscale multispectral local binary pattern texture features and stacked generalization

This paper proposes a new multispectral multiscale local binary pattern feature extraction method for automatic classification of colorectal and prostatic tumor biopsies samples. A multilevel stacked generalization classification technique is also proposed and the key idea of the paper considers a grade diagnostic problem rather than a simple malignant versus tumorous tissue problem using the concept of multispectral imagery in both the visible and near infrared spectra. To validate the proposed algorithm performances, a comparative study against related works using multispectral imagery is conducted including an evaluation on three different multiclass datasets of multispectral histology images: two representing images of colorectal biopsies - one dataset was acquired in the visible spectrum while the second captures near-infrared spectra. The proposed algorithm achieves an accuracy of 99.6% on the different datasets. The results obtained demonstrate the advantages of infrared wavelengths to capture more efficiently the most discriminative information. The results obtained show that our proposed algorithm outperforms other similar methods.

LemurFaceID: a face recognition system to facilitate individual identification of lemurs

BackgroundLong-term research of known individuals is critical for understanding the demographic and evolutionary processes that influence natural populations. Current methods for individual identification of many animals include capture and tagging techniques and/or researcher knowledge of natural variation in individual phenotypes. These methods can be costly, time-consuming, and may be impractical for larger-scale, population-level studies. Accordingly, for many animal lineages, long-term research projects are often limited to only a few taxa. Lemurs, a mammalian lineage endemic to Madagascar, are no exception. Long-term data needed to address evolutionary questions are lacking for many species. This is, at least in part, due to difficulties collecting consistent data on known individuals over long periods of time. Here, we present a new method for individual identification of lemurs (LemurFaceID). LemurFaceID is a computer-assisted facial recognition system that can be used to identify individual lemurs based on photographs.ResultsLemurFaceID was developed using patch-wise Multiscale Local Binary Pattern features and modified facial image normalization techniques to reduce the effects of facial hair and variation in ambient lighting on identification. We trained and tested our system using images from wild red-bellied lemurs (Eulemur rubriventer) collected in Ranomafana National Park, Madagascar. Across 100 trials, with different partitions of training and test sets, we demonstrate that the LemurFaceID can achieve 98.7% ± 1.81% accuracy (using 2-query image fusion) in correctly identifying individual lemurs.ConclusionsOur results suggest that human facial recognition techniques can be modified for identification of individual lemurs based on variation in facial patterns. LemurFaceID was able to identify individual lemurs based on photographs of wild individuals with a relatively high degree of accuracy. This technology would remove many limitations of traditional methods for individual identification. Once optimized, our system can facilitate long-term research of known individuals by providing a rapid, cost-effective, and accurate method for individual identification.