Local Binary Pattern Features Research Articles

Performance Analysis of Child Emotion Detection using Haar Cascade and CNN

A method for identifying human emotions from facial expressions is called facial emotion detection. This essay focuses on analyzing youngsters with autism's facial expressions to determine their feelings. In this research, five emotions are examined. These feelings include anger, surprise, sadness, happiness, and neutrality. Image processing and machine learning techniques are used to identify the emotions of autistic youngsters. The local binary pattern features are taken from the faces of youngsters with autism. Emotions are categorized using machine learning algorithms. Neural networks and support vector machines are two types of machine learning classifiers used in the classification process. Child age detection in film shots plays a vital role in ensuring compliance with age-restricted content regulations and safeguarding the well-being of underage actors. This abstract presents an overview of recent advancements, methodologies, and applications in using machine learning (ML) for child age detection.

SADCNN-ORBM: a hybrid deep learning model based citrus disease detection and classification

Citrus disease has a significant influence on agricultural productivity these days, so technology based on artificial intelligence has been developed for creating computer vision (CV) models. By spotting disease in its early stages and enabling necessary productivity actions, CV in agriculture improves the production of agricultural goods. In this paper, we developed a CV-based citrus disease detection model called the self-attention dilated convolutional neural network optimized restricted Boltzmann machine (SADCNN-ORBM) model, which consists of two crucial parts: a SADCNN for disease segmentation and an ORBM optimized by the self-adaptive coati optimization (SACO) algorithm to improve the classification performance of diseases, which successfully divides the disease type into three groups: anthracnose, melanose, and brown spot. Numerous feature sets, such as texture features, three-channel red, green, blue (RGB) features, local binary pattern (LBP) features, and speeded-up robust features (SURF) features, are combined and given as input into the classification layer in the proposed model. We compare our proposed model's performance with existing methods by using several evaluation metrics. The findings demonstrate the SADCNN-ORBM model's superiority in precisely recognizing and classifying citrus illnesses, outperforming all available techniques.

Enhancing fall prediction in the elderly people using LBP features and transfer learning model

In an era where the detection and prevention of falls are crucial for the well-being of elderly and vulnerable individuals, achieving high accuracy in identifying such incidents is of utmost importance. This study introduces a modified NASNet, a novel transformer learning model designed for the classification of fall and not fall people based on local binary patterns (LBP) features. The modified NASNet model demonstrates high performance, achieving an accuracy, precision, recall, and F1 score of 99% with LBP features in differentiating fall from not fall. To assess the performance of NASNet, this research work conducted a comparative analysis with other prominent deep learning, and transfer learning models, as well as state-of-the-art machine learning frameworks. The findings indicate NASNet's enhanced performance in fall detection, highlighting its potential for application in real-time fall detection systems, contributing to a safer environment for individuals at risk. This research sets the stage for enhanced healthcare and assistance for vulnerable populations, addressing a critical concern in the healthcare sector.

Subcutaneous fat predicts bone metastasis in breast cancer: A novel multimodality-based deep learning model.

This study explores a deep learning (DL) approach to predicting bone metastases in breast cancer (BC) patients using clinical information, such as the fat index, and features like Computed Tomography (CT) images. CT imaging data and clinical information were collected from 431 BC patients who underwent radical surgical resection at Harbin Medical University Cancer Hospital. The area of muscle and adipose tissue was obtained from CT images at the level of the eleventh thoracic vertebra. The corresponding histograms of oriented gradients (HOG) and local binary pattern (LBP) features were extracted from the CT images, and the network features were derived from the LBP and HOG features as well as the CT images through deep learning (DL). The combination of network features with clinical information was utilized to predict bone metastases in BC patients using the Gradient Boosting Decision Tree (GBDT) algorithm. Regularized Cox regression models were employed to identify independent prognostic factors for bone metastasis. The combination of clinical information and network features extracted from LBP features, HOG features, and CT images using a convolutional neural network (CNN) yielded the best performance, achieving an AUC of 0.922 (95% confidence interval [CI]: 0.843-0.964, P< 0.01). Regularized Cox regression results indicated that the subcutaneous fat index was an independent prognostic factor for bone metastasis in breast cancer (BC). Subcutaneous fat index could predict bone metastasis in BC patients. Deep learning multimodal algorithm demonstrates superior performance in assessing bone metastases in BC patients.

Effective Facial Expression Recognition System Using Machine Learning

The co Facial expression recognition (FER) is a topic that has seen a lot of study in computer vision and machine learning. In recent years, deep learning techniques have shown remarkable progress on FER tasks. With this abstract, A Novel Is Advised By Us FER method that combines combined use of k-nearest neighbours and long short-term memory algorithms better efficiency and accurate facial expression recognition. The proposed system features two primary steps—feature extraction and classification—to get results. When extracting features, we extract features from the facial images using the Local Binary Patterns (LBP) algorithm. LBP is a simple yet powerful feature extraction technique that captures texture information from the image. In the classification stage, we use the KNN and LSTM algorithms for facial expression recognition. KNN is a simple and effective classification algorithm that finds the k closest to the given value neighbours to the test training-set-sample and assigning it to the class that is most frequent among its neighbours. However, KNN has limitations in handling temporal information. To address this limitation, we propose to use LSTM, which is a subclass of RNNs capable of capturing temporal relationships in time series data. The LSTM network takes as input the LBP features of a sequence of facial images and processes them through a series of LSTM cells to estimate the ultimate coding of the phrase. We examine the planned and system on two publicly available records: the CK+ and the Oulu-CASIA datasets. According on the experimental findings, the proposed system achieves performance at the cutting edge on both datasets. The proposed system performs better than other state-of-the-art methods, including those that use deep learning systems, quantitatively, in terms of F1-score and precision.In conclusion, the proposed FER system that combines KNN and LSTM algorithms achieves high accuracy and an F1 score in recognising facial expressions from sequences of images. This system can be used in many contexts, including human-computer interaction, emotion detection, and behaviour analysis.

A multiscale carotid plaque detection method based on two-stage analysis

To develop a method for accurate identification of multiscale carotid plaques in ultrasound images. We proposed a two-stage carotid plaque detection method based on deep convolutional neural network (SM-YOLO).A series of algorithms such as median filtering, histogram equalization, and Gamma transformation were used to preprocess the dataset to improve image quality. In the first stage of the model construction, a candidate plaque set was built based on the YOLOX_l target detection network, using multiscale image training and multiscale image prediction strategies to accommodate carotid artery plaques of different shapes and sizes. In the second stage, the Histogram of Oriented Gradient (HOG) features and Local Binary Pattern (LBP) features were extracted and fused, and a Support Vector Machine (SVM) classifier was used to screen the candidate plaque set to obtain the final detection results. This model was compared quantitatively and visually with several target detection models (YOLOX_l, SSD, EfficientDet, YOLOV5_l, Faster R-CNN). SM-YOLO achieved a recall of 89.44%, an accuracy of 90.96%, a F1-Score of 90.19%, and an AP of 92.70% on the test set, outperforming other models in all performance indicators and visual effects. The constructed model had a much shorter detection time than the Faster R-CNN model (only one third of that of the latter), thus meeting the requirements of real-time detection. The proposed carotid artery plaque detection method has good performance for accurate identification of carotid plaques in ultrasound images.

FACIAL EXPRESSION EMOTION RECOGNITION USING LOCAL BINARY PATTERNS HISTOGRAMS

Local Binary Patterns (LBP) histograms are used as texture descriptors by the proposed facial expression emotion detection system to identify various face expressions in photos. Localized facial patterns are represented by histograms formed by the extraction of LBP features based on pixel intensity comparisons after pre-processing operations such as picture normalization and scaling. Using a labeled emotion dataset, these histograms are used as feature vectors to train a machine learning model. The model's performance is evaluated using evaluation measures, such as accuracy, precision, recall, and F1 score. The system, which was developed with OpenCV and scikit-learn, shows a reliable and useful method for recognizing facial expressions that can be used in practical settings. Key Words: Facial Recognition, Deep Learning, Image Recognition

Brain tumor classification: a novel approach integrating GLCM, LBP and composite features.

Identifying and classifying tumors are critical in-patient care and treatment planning within the medical domain. Nevertheless, the conventional approach of manually examining tumor images is characterized by its lengthy duration and subjective nature. In response to this challenge, a novel method is proposed that integrates the capabilities of Gray-Level Co-Occurrence Matrix (GLCM) features and Local Binary Pattern (LBP) features to conduct a quantitative analysis of tumor images (Glioma, Meningioma, Pituitary Tumor). The key contribution of this study pertains to the development of interaction features, which are obtained through the outer product of the GLCM and LBP feature vectors. The utilization of this approach greatly enhances the discriminative capability of the extracted features. Furthermore, the methodology incorporates aggregated, statistical, and non-linear features in addition to the interaction features. The GLCM feature vectors are utilized to compute these values, encompassing a range of statistical characteristics and effectively modifying the feature space. The effectiveness of this methodology has been demonstrated on image datasets that include tumors. Integrating GLCM (Gray-Level Co-occurrence Matrix) and LBP (Local Binary Patterns) features offers a comprehensive representation of texture characteristics, enhancing tumor detection and classification precision. The introduced interaction features, a distinctive element of this methodology, provide enhanced discriminative capability, resulting in improved performance. Incorporating aggregated, statistical, and non-linear features enables a more precise representation of crucial tumor image characteristics. When utilized with a linear support vector machine classifier, the approach showcases a better accuracy rate of 99.84%, highlighting its efficacy and promising prospects. The proposed improvement in feature extraction techniques for brain tumor classification has the potential to enhance the precision of medical image processing significantly. The methodology exhibits substantial potential in facilitating clinicians to provide more accurate diagnoses and treatments for brain tumors in forthcoming times.

Klasifikasi Penyakit Daun Tomat Menggunakan Algoritma K-NN Berdasarkan Ekstraksi Fitur GLCM dan LBP

Tomatoes are widely cultivated in Indonesia and are one of the crops with high economic value. According to the Central Bureau of Statistics, the Indonesian nation has the capacity to produce up to 1. 17 million tons of tomatoes in 2020. Tomatoes contain ingredients that the body needs. Additionally, grapes can also be consumed in different forms. However, tomato production in Indonesia decreased from 2013 to 2015 due to the spread of pests. Therefore, we conducted a study to classify tomato leaf diseases using the K-nearest neighbor method based on the grayscale coexistence matrix and the extraction of local binary pattern features. The data used was 9157 data obtained from the Plant Village database and classified into 6 classes (healthy, spot fungus, late blight, leaf mold, mosaic virus, spider mite, and target spot). The testing process was performed using the K-fold cross-validation technique, followed by performance calculations using the confusion matrix method. The highest accuracy was obtained at 86.8% when classifying using K9 and K10 with a precision value 40.6% and recall 49.2% when classifying using a value of K = 9, and precision 49.7% and recall of 49.3% when classifying using a value of K = 10.

An automated cervical cancer diagnosis using genetic algorithm and CANFIS approaches.

Cervical malignancy is considered among the most perilous cancers affecting women in numerous East African and South Asian nations, both in terms of its prevalence and fatality rates. This research aims to propose an efficient automated system for the segmentation of cancerous regions in cervical images. The proposed techniques encompass preprocessing, feature extraction with an optimized feature set, classification, and segmentation. The original cervical image undergoes smoothing using the Gaussian Filter technique, followed by the extraction of Local Binary Pattern (LBP) and Grey Level Co-occurrence Matrix (GLCM) features from the enhanced cervical images. LBP features capture pixel relationships within a mask window, while GLCM features quantify energy metrics across all pixels in the images. These features serve to distinguish normal cervical images from abnormal ones. The extracted features are optimized using Genetic Algorithm (GA) as an optimization method, and the optimized sets of features are classified using the Co-Active Adaptive Neuro-Fuzzy Inference System (CANFIS) classification method. Subsequently, a morphological segmentation technique is employed to categorize irregular cervical images, identifying and segmenting malignant regions within them. The proposed approach achieved a sensitivity of 99.09%, specificity of 99.39%, and accuracy of 99.36%. The proposed approach demonstrated superior performance compared to state-of-the-art techniques, and the results have been validated by expert radiologists.

Transfer learning based approach for lung and colon cancer detection using local binary pattern features and explainable artificial intelligence (AI) techniques.

Cancer, a life-threatening disorder caused by genetic abnormalities and metabolic irregularities, is a substantial health danger, with lung and colon cancer being major contributors to death. Histopathological identification is critical in directing effective treatment regimens for these cancers. The earlier these disorders are identified, the lesser the risk of death. The use of machine learning and deep learning approaches has the potential to speed up cancer diagnosis processes by allowing researchers to analyse large patient databases quickly and affordably. This study introduces the Inception-ResNetV2 model with strategically incorporated local binary patterns (LBP) features to improve diagnostic accuracy for lung and colon cancer identification. The model is trained on histopathological images, and the integration of deep learning and texture-based features has demonstrated its exceptional performance with 99.98% accuracy. Importantly, the study employs explainable artificial intelligence (AI) through SHapley Additive exPlanations (SHAP) to unravel the complex inner workings of deep learning models, providing transparency in decision-making processes. This study highlights the potential to revolutionize cancer diagnosis in an era of more accurate and reliable medical assessments.

Comparative analysis of mature tomato detection by feature extraction and machine learning for autonomous greenhouse robots

Accurate detection of tomatoes grown in greenhouses is important for timely harvesting. In this way, it is ensured that mature tomatoes are collected by distinguishing them from the unripe ones. Insufficient light, occlusion, and overlapping adversely affect the detection of mature tomatoes. In addition, it is time consuming for people to detect mature tomatoes at certain periods in large greenhouses. For these reasons, high-performance automatic detection of tomatoes by greenhouse robots has become an increasingly studied area today. In this paper, two feature extraction methods, histogram of oriented gradients (HOG) and local binary patterns (LBP), which are effective in object recognition, and two important and commonly used classifiers of machine learning, support vector machines (SVM) and k-nearest neighbor (kNN), are comparatively used to detect and count tomatoes. The HOG and LBP features are classified separately and together by SVM or kNN, and the success of each case are compared. Performance of the detection is improved by eliminating false positive results at the postprocessing stage using color information.

Verifiable Privacy-Enhanced Rotation Invariant LBP Feature Extraction in Fog Computing

Rotation invariant local binary pattern (RI-LBP) features have been applied in diverse scenarios with the advantages of gray-scale and rotation invariance. Secure fog computing has become an emerging paradigm for enterprises or individuals with a huge volume of private data but limited computing power for feature extraction. Prior secure outsourcing protocols based on LBP and RI-LBP simply focus on local data privacy, which can only resist ciphertext-only attack, and also make extracted features exposed to the cloud. This work focuses on how to effectively ensure data confidentiality and feature integrity. We propose a verifiable privacy-enhanced protocol for RI-LBP feature extraction (VRLBP) based on the fog computing paradigm, which mitigates the aforementioned challenges by involving the proposed symmetric cryptographic scheme where local data and extracted features are proven secure against chosen plaintext attack. Meanwhile, the stage of verification can check the correctness of outsourced features with an overwhelming probability and constant computational complexity. The security analysis and computational costs demonstrate that VRLBP can reduce the computation overhead to around 30% of original feature extraction in a privacy-preserving manner. To exhibit the practical utility, VRLBP is implemented for deepfake detection on five public datasets. Extensive evaluations indicate that VRLBP achieves almost the same accuracy as the original RI-LBP algorithm and outperforms the state-of-the-art protocols.

Artificial intelligent identification of apatite fission tracks based on machine learning

Over the past half century, apatite fission track (AFT) thermochronometry has been widely used in the studies of thermal histories of Earth’s uppermost crust. The acquired thermal histories in turn can be used to quantify many geologic processes such as erosion, sedimentary burial, and tectonic deformation. However, the current practice of acquiring AFT data has major limitations due to the use of traditional microscopes by human operators, which is slow and error-prone. This study uses the local binary pattern feature based on the OpenCV cascade classifier and the faster region-based convolutional neural network model based on the TensorFlow Object Detection API, these two methods offer a means for the rapid identification and measurement of apatite fission tracks, leading to significant improvements in the efficiency and accuracy of track counting. We employed a training dataset consisting of 50 spontaneous fission track images and 65 Durango standard samples as training data for both techniques. Subsequently, the performance of these methods was evaluated using additional 10 spontaneous fission track images and 15 Durango standard samples, which resulted in higher Precision, Recall, and F1-Score values. Through these illustrative examples, we have effectively demonstrated the higher accuracy of these newly developed methods in identifying apatite fission tracks. This suggests their potential for widespread applications in future apatite fission track research.

Comparing Local Binary Pattern and Gray Level Co-occurrence Matrix for Feature Extraction in Diabetic Retinopathy Classification

Diabetic retinopathy, a condition characterized by retinal damage and vision loss, is a prevalent complication of diabetes arising from elevated blood sugar levels. With a growing number of individuals affected, efficient and accurate diagnosis is crucial. This study aims to implement and compare the Local Binary Pattern (LBP) and Gray Level Co-occurrence Matrix (GLCM) feature extraction techniques, which have demonstrated success in prior research. The comparison will provide a comprehensive under- standing of the image features, extract relevant data, and improve the performance of the image analysis pipeline for diabetic retinopathy classification. The result showed that from three scenarios the best accuracy provided by Support Vector Machine with the accuracy score between 73% until 74%, however, other algorithm have little difference which the result on 73%.

Recent Advancement in Prediction and Analyzation of Brain Tumour using the Artificial Intelligence Method

Brain tumour identification and categorization are critical for diagnosis and treatment. This work uses preprocessing and classification algorithms to discover and categories brain tumours. Gaussian smoothing reduces noise and improves image quality, Genetic Algorithms select and optimize features, Deep Learning-Based Segmentation accurately segments tumours, Local Binary Patterns (LBP) extract texture features, and K-Nearest Neighbors classify tumours. Gaussian smoothing reduces noise and improves brain imaging data. Genetic Algorithms extract the most relevant and discriminative features from preprocessed photos. A Deep Learning-Based Segmentation model accurately segments brain tumour regions using these features. After segmentation, Local Binary Patterns (LBP) extract tumour texture features. The K-Nearest Neighbors (KNN) method classifies tumours using these texture features to capture tumour spatial patterns. Our suggested brain tumour detection and classification method combines several techniques to increase accuracy and reliability. Gaussian smoothing and LBP feature extraction improve feature discrimination. Deep Learning-Based Segmentation and the KNN classifier ensure precise tumour location and robust classification. The proposed method will be tested on brain scans including tumour areas. Classification performance measures include accuracy, sensitivity, specificity, and AUC. This work will improve brain tumour detection and classification methods for more accurate diagnoses and treatment planning. The primary goal of the work is to enhance brain tumour identification and categorization using pre processing, classification algorithms, and advanced techniques, ultimately improving diagnosis and treatment outcomes.

Multi-Method Analysis of Histopathological Image for Early Diagnosis of Oral Squamous Cell Carcinoma Using Deep Learning and Hybrid Techniques.

Oral cancer is a fatal disease and ranks seventh among the most common cancers throughout the whole globe. Oral cancer is a type of cancer that usually affects the head and neck. The current gold standard for diagnosis is histopathological investigation, however, the conventional approach is time-consuming and requires professional interpretation. Therefore, early diagnosis of Oral Squamous Cell Carcinoma (OSCC) is crucial for successful therapy, reducing the risk of mortality and morbidity, while improving the patient's chances of survival. Thus, we employed several artificial intelligence techniques to aid clinicians or physicians, thereby significantly reducing the workload of pathologists. This study aimed to develop hybrid methodologies based on fused features to generate better results for early diagnosis of OSCC. This study employed three different strategies, each using five distinct models. The first strategy is transfer learning using the Xception, Inceptionv3, InceptionResNetV2, NASNetLarge, and DenseNet201 models. The second strategy involves using a pre-trained art of CNN for feature extraction coupled with a Support Vector Machine (SVM) for classification. In particular, features were extracted using various pre-trained models, namely Xception, Inceptionv3, InceptionResNetV2, NASNetLarge, and DenseNet201, and were subsequently applied to the SVM algorithm to evaluate the classification accuracy. The final strategy employs a cutting-edge hybrid feature fusion technique, utilizing an art-of-CNN model to extract the deep features of the aforementioned models. These deep features underwent dimensionality reduction through principal component analysis (PCA). Subsequently, low-dimensionality features are combined with shape, color, and texture features extracted using a gray-level co-occurrence matrix (GLCM), Histogram of Oriented Gradient (HOG), and Local Binary Pattern (LBP) methods. Hybrid feature fusion was incorporated into the SVM to enhance the classification performance. The proposed system achieved promising results for rapid diagnosis of OSCC using histological images. The accuracy, precision, sensitivity, specificity, F-1 score, and area under the curve (AUC) of the support vector machine (SVM) algorithm based on the hybrid feature fusion of DenseNet201 with GLCM, HOG, and LBP features were 97.00%, 96.77%, 90.90%, 98.92%, 93.74%, and 96.80%, respectively.

Multi-scale LBP fusion with the contours from deep CellNNs for texture classification

In texture classification, local binary pattern (LBP) is currently one of the most widely-concerned feature encoding models. Most existing LBP-based texture classification methods are usually limited to single-kind texture features. In fact, an across-domain fusion of LBP features with other features, such as image contours, could be another potential path to promote texture classification. To enhance the feature modeling ability of LBP-based methods, this paper firstly designs a Cellular Neural Network (CellNN) with recurrent convolutions, initially trained by a simplified simulated-annealing algorithm, to extract informative image contours. For better reliability, a new three-channel contour extractor of deep CellNNs (i.e., dCellNNs) is proposed. This extractor contains the initially-trained CellNNs of more than three layers, and it is further optimized by fine-tuning parameters. Moreover, a new weighted-base algorithm is designed to fulfill the fusion of the multi-scale texture features by LBPs and the contour features by dCellNNs to enhance feature representation. Finally, these enhanced features are concatenated together to generate the final multi-scale features of given texture image. On texture datasets KTH, Brodatz, OTC12 and UIUC, experiment results verify that the across-domain fusion of multi-scale LBPs and dCellNNs is efficient in capturing & enhancing texture features. With moderate feature dimensionality and computational costs, it could improve texture classification, acquiring an obvious accuracy increase on previous state-of-the-art ones, e.g., a rise of 2.58% on KTH-TIPS2b, a rise of 3.11% on Brodatz, a rise of 0.71% on OTC12 and a rise of 0.42% on UIUC.

Leukemia Blood Cells Detection using Neural Network Classifier

Image segmentation is an image processing operation performed on the image in order to partition the image into some images based on the information contained in the original image. Image segmentation plays an important role in many medical imaging applications, image segmentation facilitates the anatomy process in a particular body of human body. Classification and clustering are the methods used un data mining for analyzing the data sets and divide them on the basis of some particular classification rules. There are many image segmentation tools that used for medical purpose, so it is necessary to define and/or to improve the image segmentation methods in order to get the best method. In this study, the image of leukemia and red blood cells will be used as samples to determine the best algorithm in image segmentation. The procedure for doing segmentation itself is clustering image, edge detection on image, and image classification. The clustering is to extract important information from an image. The edge detection is to determine the existence of edges of lines in image in order to investigate and localize the desired edge features. Moreover, the classification analyzes the properties of some images and organizes the information into certain categories. In this study, the Neural Network and K-Nearest Neighbor are used for image classification by paired with Local Binary Pattern and Principal Component Analysis. The results revealed that the best method of proven in classifying images is from Local Binary Pattern feature extraction with the average accuracy of 94%.

LBP feature and hash function based dual watermarking algorithm for database

In this paper, we propose a local binary pattern (LBP) feature and hash function based dual watermarking algorithm for database. Attribute feature columns are selected to generate zero watermarks using the Pearson correlation method. The zero watermarks are generated by the LBP. The attribute values of the selected feature columns are divided into two parts for embedding and extracting the watermark. Zero watermark feature code is embedded into the lowest significant bit of the selected attribute column by using the database watermarking algorithm with hash function for copyright authentication. The proposed method uses two-layer hashing method to improve the robustness. In the watermark extraction, a method of combining majority voting and Hamming error correction code is used to control the watermark error to ensure the correct extraction rate of the watermark. Experimental results show that the algorithm not only provides good availability of the database after embedding the watermark, but also ensures the correct extraction of the watermark after various attacks.