Classical Local Binary Pattern Research Articles

A Comprehensive Approach to Brain Tumor Classification in MRI: Unifying Classical Local Binary Patterns and Convolution Neural Networks

Brain tumors, among the most perilous neurological disorders affecting the human nervous system, are categorized into glioma, meningioma, and Pituitary types. The proposed system combines Classical Local Binary Patterns (CLBP), Histogram of Oriented Gradients (HOG), and Convolutional Neural Networks (CNN) to extract texture information from MRI images. The methodology comprises three key steps: image pre-processing, feature extraction, and classification. By evaluating a publicly accessible brain tumor dataset, the proposed approach attains an impressive accuracy of 96%. The findings highlight the potential uses of the CLBP+CNN approach in clinical diagnosis and treatment planning, demonstrating the possibility of accurate and efficient brain tumor classification. The proposal introduces future extension methods like CLBPs (DLBP, ӨLBP), where the DLBP approach incorporates a 'D' parameter specifying the distance between neighboring pixels. The ӨLBP Method evaluates the pixel value by changing the 'Ө' value, i.e., 150, 450, 900 and 1200. The classification of tumors involved the application of various classification methods, namely ANN (Artificial Neural Networks), AlDE (Ant Lion Optimizer Differential Evolution), and LDA (Linear Discriminant Analysis). This classification is executed using feature extractions derived from CLBP (DLBP & ӨLBP) applied to MRI images within the dataset.

Tree log identification using convolutional neural networks

The identification of individual tree logs along the wood procurement chain is a coveted goal within the forest industry. The tracing of logs from the sawmill back to the forest would support the legal and sustainable sourcing of wood, as well as increase the resource efficiency and value of harvested timber. In this work, using a dataset of thousands of Scots pine (Pinus sylvestris L.) log end images displaying varying perspectives, lighting, and aging effects, we develop and assess log identification methods based on deep convolutional neural networks. The estimated rank-1 accuracy of our final model on an independent test set of 99 logs is 84 and 91% when allowing for random rotations of the log ends and when keeping each log at approximately fixed orientation, respectively. We estimate the scaling of these methods up to a template pool size of 493 logs, which reveals a weak dependence of accuracy on pool size for logs at fixed orientation. The deep learning approach gives superior results to a classical local binary pattern method, and appears feasible in practice, assuming that pre-filtering of the log database can be leveraged depending on the use case and properties of the queried log image. We make our dataset publicly available.

A novel image segmentation utilizing FUZZY-based LBP and active contour model

ABSTRACT This work presents an object recognition algorithm that combines local binary pattern (LBP) based on fuzzy logic approach and active contour model for segmenting different images to detect textured objects. Initially, images containing objects are segmented using the fuzzy logic-optimized LBP method. Then, we eliminate the image noise. Finally, utilizing a Chan-Vese active contour method, the target object of the image is highlighted. The segmentation has been compared with the classical LBP technique and the results indicated higher accuracy and quality for highlighting the object from the background. The classification of highlighted objects is performed with a convolution neural network (CNN). To authenticate the proposed approach, 140 images with the classification of 10 different objects were used. The simulation depicted that the proposed method has better results than other methods both in terms of segmentation error and performance. Significantly, CNN classification also showed a classification accuracy of 92.8%.

New local binary pattern approaches based on color channels in texture classification

In this paper, four novel, simple and robust approaches, which are left to right local binary patterns (LBPLL2R), top to down local binary patterns (LBPT2D), cube surface local binary pattern (LBPSurfaces), and cube diagonal local binary pattern (LBPDiagonal), were proposed in order to exact texture features in color images. These approaches were based on the local binary pattern (LBP), which is an effective statistical texture descriptor and can be employed in gray images. Proposed approaches were evaluated and validated in four datasets, which are Outex, KTH_TIPS, KTH_TIPS2, and USPtex datasets. The images in these datasets are in RGB, HSV, YIQ, and YCbCr color formats. Achieved results by these approaches were compared with the obtained results by the classical LBP and literature findings. As a result, the proposed approaches performed better than the traditional LBP method and they found effective in the classification of color texture images, especially in images, which are in RGB and HSV formats. Furthermore, noise robustness and time complexity of the proposed approaches were validated.

Brain tumor classification using modified local binary patterns (LBP) feature extraction methods

Automatic classification of brain tumor types is very important for accelerating the treatment process, planning and increasing the patient’s survival rate. Today, MR images are used to determine the type of brain tumor. Manual diagnosis of brain tumor type depends on the experience and sensitivity of radiologists. Therefore, researchers have developed many brain tumor classification models to minimize the human factor. In this study, two different feature extraction (nLBP and αLBP) approaches were used to classify the most common brain tumor types; Glioma, Meningioma, and Pituitary brain tumors. nLBP is formed based on the relationship for each pixel around the neighbors. The nLBP method has a d parameter that specifies the distance between consecutive neighbors for comparison. Different patterns are obtained for different d parameter values. The αLBP operator calculates the value of each pixel based on an angle value. The angle values used for calculation are 0, 45, 90 and 135. To test the proposed methods, it was applied to images obtained from the brain tumor database collected from Nanfang Hospital, Guangzhou, China, and Tianjin Medical University General Hospital between the years of 2005 and 2010. The classification process was performed by using K-Nearest Neighbor (Knn) and Artificial Neural Networks (ANN), Random Forest (RF), A1DE, Linear Discriminant Analysis (LDA) classification methods, with the feature matrices obtained with nLBP, αLBP and classical LBP from the images in the data set. The highest success rate in brain tumor classification was 95.56% with the nLBPd = 1 feature extraction method and Knn model.

A Multiscale Hierarchical Threshold-Based Completed Local Entropy Binary Pattern for Texture Classification

Over the year, visual texture analysis has come to be recognized as one of the most important methods in the area of medical image analysis and understanding, face description and detection, and so on. The goal of texture descriptors is to capture the general characteristic of textures such as dependency as well as invariance properties. Among all the texture descriptors, the binary pattern family of algorithms achieves a great trade of representation efficiency and complexity. This work introduces an efficient discriminative texture descriptor for visual texture classification. Its main contribution is twofold: a multiscale thresholding framework based on hierarchical adaptive local partition to binary encoding and an efficient completed local entropy binary pattern (CLEBP) descriptor. The basic completed local entropy binary pattern is extended by multiscale thresholding framework with hierarchical thresholding to capture not only microstructure local patterns but also macrostructure texture information. Such extension improves the quality and discriminative factor of texture classification. Extensive experiments on three widely used benchmark texture databases (Outex, UIUC, and KTH-TIPS) proof the efficiency of the proposed visual texture descriptor and hierarchical thresholding strategy. Compared with some classical local binary pattern variants and many state-of-the-art methods, the proposed descriptor achieves competitive and superior texture classification performance. The results prove that the proposed method is a powerful and effective texture descriptor for visual texture classification.

Comparative Study on Local Binary Patterns for Mammographic Density and Risk Scoring.

Breast density is considered to be one of the major risk factors in developing breast cancer. High breast density can also affect the accuracy of mammographic abnormality detection due to the breast tissue characteristics and patterns. We reviewed variants of local binary pattern descriptors to classify breast tissue which are widely used as texture descriptors for local feature extraction. In our study, we compared the classification results for the variants of local binary patterns such as classic LBP (Local Binary Pattern), ELBP (Elliptical Local Binary Pattern), Uniform ELBP, LDP (Local Directional Pattern) and M-ELBP (Mean-ELBP). A wider comparison with alternative texture analysis techniques was studied to investigate the potential of LBP variants in density classification. In addition, we investigated the effect on classification when using descriptors for the fibroglandular disk region and the whole breast region. We also studied the effect of the Region-of-Interest (ROI) size and location, the descriptor size, and the choice of classifier. The classification results were evaluated based on the MIAS database using a ten-run ten-fold cross validation approach. The experimental results showed that the Elliptical Local Binary Pattern descriptors and Local Directional Patterns extracted most relevant features for mammographic tissue classification indicating the relevance of directional filters. Similarly, the study showed that classification of features from ROIs of the fibroglandular disk region performed better than classification based on the whole breast region.

Spatio-spectral binary patterns based on multispectral filter arrays for texture classification.

To discriminate gray-level texture images, spatial texture descriptors can be extracted using the local binary pattern (LBP) operator. This operator has been extended to color images at the expense of increased memory and computation requirements. Some authors propose to compute texture descriptors directly from raw images provided through a Bayer color filter array, which both avoids the demosaicking step and reduces the descriptor size. Recently, multispectral snapshot cameras have emerged to sample more than three wavelength bands using a multispectral filter array. Such cameras provide a raw image in which a single spectral channel value is available at each pixel. In this paper we design a local binary pattern operator that jointly extracts the spatial and spectral texture information directly from a raw image. Extensive experiments on a large dataset show that the proposed descriptor has both reduced computation cost and high discriminative power with regard to classical LBP descriptors applied to demosaicked images.

Integrated local binary pattern texture features for classification of breast tissue imaged by optical coherence microscopy.

This paper proposes a texture analysis technique that can effectively classify different types of human breast tissue imaged by Optical Coherence Microscopy (OCM). OCM is an emerging imaging modality for rapid tissue screening and has the potential to provide high resolution microscopic images that approach those of histology. OCM images, acquired without tissue staining, however, pose unique challenges to image analysis and pattern classification. We examined multiple types of texture features and found Local Binary Pattern (LBP) features to perform better in classifying tissues imaged by OCM. In order to improve classification accuracy, we propose novel variants of LBP features, namely average LBP (ALBP) and block based LBP (BLBP). Compared with the classic LBP feature, ALBP and BLBP features provide an enhanced encoding of the texture structure in a local neighborhood by looking at intensity differences among neighboring pixels and among certain blocks of pixels in the neighborhood. Fourty-six freshly excised human breast tissue samples, including 27 benign (e.g. fibroadenoma, fibrocystic disease and usual ductal hyperplasia) and 19 breast carcinoma (e.g. invasive ductal carcinoma, ductal carcinoma in situ and lobular carcinoma in situ) were imaged with large field OCM with an imaging area of 10 × 10mm2 (10, 000 × 10, 000 pixels) for each sample. Corresponding H&E histology was obtained for each sample and used to provide ground truth diagnosis. 4310 small OCM image blocks (500 × 500 pixels) each paired with corresponding H&E histology was extracted from large-field OCM images and labeled with one of the five different classes: adipose tissue (n = 347), fibrous stroma (n = 2,065), breast lobules (n = 199), carcinomas (pooled from all sub-types, n = 1,127), and background (regions outside of the specimens, n = 572). Our experiments show that by integrating a selected set of LBP and the two new variant (ALBP and BLBP) features at multiple scales, the classification accuracy increased from 81.7% (using LBP features alone) to 93.8% using a neural network classifier. The integrated feature was also used to classify large-field OCM images for tumor detection. A receiver operating characteristic (ROC) curve was obtained with an area under the curve value of 0.959. A sensitivity level of 100% and specificity level of 85.2% was achieved to differentiate benign from malignant samples. Several other experiments also demonstrate the complementary nature of LBP and the two variants (ALBP and BLBP features) and the significance of integrating these texture features for classification. Using features from multiple scales and performing feature selection are also effective mechanisms to improve accuracy while maintaining computational efficiency.

Fingerprint Liveness Detection Using Convolutional Neural Networks

With the growing use of biometric authentication systems in the recent years, spoof fingerprint detection has become increasingly important. In this paper, we use convolutional neural networks (CNNs) for fingerprint liveness detection. Our system is evaluated on the data sets used in the liveness detection competition of the years 2009, 2011, and 2013, which comprises almost 50 000 real and fake fingerprints images. We compare four different models: two CNNs pretrained on natural images and fine-tuned with the fingerprint images, CNN with random weights, and a classical local binary pattern approach. We show that pretrained CNNs can yield the state-of-the-art results with no need for architecture or hyperparameter selection. Data set augmentation is used to increase the classifiers performance, not only for deep architectures but also for shallow ones. We also report good accuracy on very small training sets (400 samples) using these large pretrained networks. Our best model achieves an overall rate of 97.1% of correctly classified samples—a relative improvement of 16% in test error when compared with the best previously published results. This model won the first prize in the fingerprint liveness detection competition 2015 with an overall accuracy of 95.5%.

Robust Texture Classification by Aggregating Pixel-Based LBP Statistics

This letter addresses the texture classification problem through a pixel-based local binary pattern (LBP) statistics aggregation mechanism. Real-world texture images often present challenges for classification algorithms in terms of intra-class variability due, among others, to variable illumination. The LBP operator, a state-of-the-art texture descriptor, possesses key properties for tackling real-world texture images: discriminative power and invariance against monotonic gray level changes. We propose a novel texture classification approach that increases the robustness of LBP-based methods with respect to any type of intra-class variations. The method locally characterizes each pixel with an LBP code histogram and globally computes the label of a textured image by aggregating pixel labels through a voting process. Our approach can be in principle applied to any LBP version, as it focuses on how statistics are computed from LBP codes. We show that the proposed pixel-based approach improves upon traditional LBP block-based approaches in terms of classification accuracy by up to 5.1 p.p. on the public Outex database for the classic LBP with various neighborhoods as well as for various LBP extensions.

Texture descriptors based on adaptive neighborhoods for classification of pigmented skin lesions

Different texture descriptors are proposed for the automatic classification of skin lesions from dermoscopic images. They are based on color texture analysis obtained from (1) color mathematical morphology (MM) and Kohonen self-organizing maps (SOMs) or (2) local binary patterns (LBPs), computed with the use of local adaptive neighborhoods of the image. Neither of these two approaches needs a previous segmentation process. In the first proposed descriptor, the adaptive neighborhoods are used as structuring elements to carry out adaptive MM operations which are further combined by using Kohonen SOM; this has been compared with a nonadaptive version. In the second one, the adaptive neighborhoods enable geometrical feature maps to be defined, from which LBP histograms are computed. This has also been compared with a classical LBP approach. A receiver operating characteristics analysis of the experimental results shows that the adaptive neighborhood-based LBP approach yields the best results. It outperforms the nonadaptive versions of the proposed descriptors and the dermatologists’ visual predictions.

Two novel local binary pattern descriptors for texture analysis

The recent developments in the image quality, storage and data transmission capabilities increase the importance of texture analysis, which plays an important role in computer vision and image processing. Local binary pattern (LBP) is an effective statistical texture descriptor, which has successful applications in texture classification. In this paper, two novel descriptors were proposed to search different patterns in images built on LBP. One of them is based on the relations between the sequential neighbors with a specified distance and the other one is based on determining the neighbors in the same orientation through central pixel parameter. These descriptors are tested with the Brodatz-1, Brodatz-2, Butterfly and Kylberg datasets to show the applicability of the proposed nLBPd and dLBPα descriptors. The proposed methods are also compared with classical LBP. The average accuracies obtained by ANN with 10 fold cross validation, which are 99.26% (LBPu2 and nLBPd), 94.44% (dLBPα), 95.71% (nLBPdu2) and %99.64 (nLBPd), for Brodatz-1, Brodatz-2, Butterfly and Kylberg datasets, respectively, show that the proposed methods outperform significant accuracies.

Evaluation of noise robustness for local binary pattern descriptors in texture classification

Local binary pattern (LBP) operators have become commonly used texture descriptors in recent years. Several new LBP-based descriptors have been proposed, of which some aim at improving robustness to noise. To do this, the thresholding and encoding schemes used in the descriptors are modified. In this article, the robustness to noise for the eight following LBP-based descriptors are evaluated; improved LBP, median binary patterns (MBP), local ternary patterns (LTP), improved LTP (ILTP), local quinary patterns, robust LBP, and fuzzy LBP (FLBP). To put their performance into perspective they are compared to three well-known reference descriptors; the classic LBP, Gabor filter banks (GF), and standard descriptors derived from gray-level co-occurrence matrices. In addition, a roughly five times faster implementation of the FLBP descriptor is presented, and a new descriptor which we call shift LBP is introduced as an even faster approximation to the FLBP. The texture descriptors are compared and evaluated on six texture datasets; Brodatz, KTH-TIPS2b, Kylberg, Mondial Marmi, UIUC, and a Virus texture dataset. After optimizing all parameters for each dataset the descriptors are evaluated under increasing levels of additive Gaussian white noise. The discriminating power of the texture descriptors is assessed using tenfolded cross-validation of a nearest neighbor classifier. The results show that several of the descriptors perform well at low levels of noise while they all suffer, to different degrees, from higher levels of introduced noise. In our tests, ILTP and FLBP show an overall good performance on several datasets. The GF are often very noise robust compared to the LBP-family under moderate to high levels of noise but not necessarily the best descriptor under low levels of added noise. In our tests, MBP is neither a good texture descriptor nor stable to noise.

One dimensional local binary pattern for bone texture characterization

The evaluation of osteoporotic disease from X-ray images presents a major challenge for pattern recognition and medical applications. Textured images from the bone microarchitecture of osteoporotic and healthy subjects show a high degree of similarity, thus drastically increasing the difficulty of classifying such textures. In this paper, we propose a new method to separate osteoporotic cases from healthy controls, using texture analysis. The idea consists in combining global and local information to better capture the image characteristics. Global information is characterized by image projection which conveys information about the global aspect of the texture. Local information is encoded by the local patterns using neighborhood operators. The proposed technique is based on the local binary pattern (LBP) descriptor which has been classically applied on two dimensional (2D) images. Our algorithm is a derived solution for the 1D projected fields of the 2D images. Experiments were conducted on two populations of osteoporotic patients and control subjects. Compared to the classical LBP, the proposed approach yields a better classification rate of the two populations.

Extended local binary patterns for texture classification

This paper presents a novel approach for texture classification, generalizing the well-known local binary pattern (LBP) approach. In the proposed approach, two different and complementary types of features (pixel intensities and differences) are extracted from local patches. The intensity-based features consider the intensity of the central pixel (CI) and those of its neighbors (NI); while for the difference-based feature, two components are computed: the radial-difference (RD) and the angular-difference (AD). Inspired by the LBP approach, two intensity-based descriptors CI-LBP and NI-LBP, and two difference-based descriptors RD-LBP and AD-LBP are developed. All four descriptors are in the same form as conventional LBP codes, so they can be readily combined to form joint histograms to represent textured images. The proposed approach is computationally very simple: it is totally training-free, there is no need to learn a texton dictionary, and no tuning of parameters. We have conducted extensive experiments on three challenging texture databases (Outex, CUReT and KTHTIPS2b). Outex results show significant improvements over the classical LBP approach, which clearly demonstrates the great power of the joint distributions of these proposed descriptors for gray-scale and rotation invariant texture classification. The proposed method produces the best classification results on KTHTIPS2b, and results comparable to the state-of-the-art on CUReT.

Texture Classification by Modeling Joint Distributions of Local Patterns With Gaussian Mixtures

Texture classification generally requires the analysis of patterns in local pixel neighborhoods. Statistically, the underlying processes are comprehensively described by their joint probability density functions (jPDFs). Even for small neighborhoods, however, stable estimation of jPDFs by joint histograms (jHSTs) is often infeasible, since the number of entries in the jHST exceeds by far the number of pixels in a typical texture region. Moreover, evaluation of distance functions between jHSTs is often computationally prohibitive. Practically, the number of entries in a jHST is therefore reduced by considering only two-pixel patterns, leading to 2D-jHSTs known as cooccurrence matrices, or by quantization of the gray levels in local patterns to only two gray levels, yielding local binary patterns (LBPs). Both approaches result in a loss of information. We introduce here a framework for supervised texture classification which reduces or avoids this information loss. Local texture neighborhoods are first filtered by a filter bank. Without further quantization, the jPDF of the filter responses is then described parametrically by gaussian mixture models (GMMs). We show that the parameters of the GMMs can be reliably estimated from small image regions. Moreover, distances between the thus modelled jPDFs of different texture patterns can be computed efficiently in closed form from their model parameters. We furthermore extend this texture descriptor to achieve full invariance to rotation. We evaluate the framework for different filter banks on the Brodatz texture set. We first show that combining the LBP difference filters with the GMM-based density estimator outperforms the classical LBP approach and its codebook extensions. When replacing these-rather elementary-difference filters by the wavelet frame transform (WFT), the performance of the framework on all 111 Brodatz textures exceeds the one obtained more recently by spin image and RIFT descriptors by Lazebnik et al.

A novel extended local-binary-pattern operator for texture analysis

The local-binary-pattern (LBP) operator has been proved to be a theoretically simple yet very effective multiresolution statistical texture descriptor in terms of the characteristics of the local structure, and has been applied in many areas. However, the extension to the LBP operator based on “uniform” patterns still has some shortcomings: it discards some important texture information and is sensitive to noise. A novel extended LBP operator for texture analysis is proposed in this paper. The new LBP operator classifies and combines the “nonuniform” local patterns based on analyzing their structure and occurrence probability. The new operator fully uses the texture information contained in the “nonuniform” local patterns, which is discarded by the classical LBP operators, and then becomes more robust against noise. Three experiments on the Brodatz texture database show the performance improvement of this novel extended LBP operator.