Local Ternary Pattern Research Articles

1D Multi-Point Local Ternary Pattern: A Novel Feature Extraction Method for Analyzing Cognitive Engagement of students in Flipped Learning Pedagogy.

Flipped learning is a blended learning method based on academic engagement of students online (outside class) and offline (inside class). In this learning pedagogy, students receive lesson any time from lecture videos pre-loaded on digital platform at their convenience places and it is followed by in-classroom activities such as doubt clearing, problem solving, etc. However, students are constantly exposed to high levels of distraction in this age of the Internet. Therefore, it is hard for an instructor to know whether a student has paid attention while watching pre-loaded lecture video. In order to analyze attention level of individual students, captured brain signal or electroencephalogram (EEG) of students can be utilized. In this study, we utilize a popular feature extraction technique called Local Binary Pattern (LBP) and improvise it to develop an enhanced feature selection method. The adapted feature selection method termed as 1D Multi-Point Local Ternary Pattern (1D MP-LTP) is used to extract unique features from collected electroencephalogram (EEG) signals. Standard classification techniques are exploited to classify the attention level of students. Experiments are conducted with the data captured at Intelligent Data Analysis Lab, NIT Rourkela, to show effectiveness of the proposed feature extraction technique. The proposed 1D Multi-Point Local Ternary Pattern (1D MP-LTP)-based classification techniques outperform traditional and state-of-the-art classification techniques using LBP. This research can be helpful for instructors to identify students who need special care for improving their learning ability. Researchers in educational technology can extend this work by adopting this methodology in other online teaching pedagogy such as Massive Open Online Courses (MOOC).

A New Design of Occlusion-Invariant Face Recognition Using Optimal Pattern Extraction and CNN with GRU-Based Architecture

Face detection is a computer technology being used in a variety of applications that identify human faces in digital images. In many face recognition challenges, Convolutional Neural Networks (CNNs) are regarded as a problem solver. Occlusion is determined as the most common challenge of face recognition in realistic applications. Several studies are undergoing to obtain face recognition without any challenges. However, the occurrence of noise and occlusion in the image reduces the achievement of face recognition. Hence, various researches and studies are carried out to solve the challenges involved with the occurrence of occlusion and noise in the image, and more clarification is needed to acquire high accuracy. Hence, a deep learning model is intended to be developed in this paper using the meta-heuristic approach. The proposed model covers four main steps: (a) data acquisition, (b) pre-processing, (c) pattern extraction and (d) classification. The benchmark datasets regarding the face image with occlusion are gathered from a public source. Further, the pre-processing of the images is performed by contrast enhancement and Gabor filtering. With these pre-processed images, pattern extraction is done by the optimal local mesh ternary pattern. Here, the hybrid Whale–Galactic Swarm Optimization (WGSO) algorithm is used for developing the optimal local mesh ternary pattern extraction. By inputting the pattern-extracted image, the new deep learning model namely “CNN with Gated Recurrent Unit (GRU)” network performs the recognition process to maximize the accuracy, and also it is used to enhance the face recognition model. From the results, in terms of accuracy, the proposed WGSO-[Formula: see text] model is better by 4.02%, 3.76% and 2.17% than the CNN, SVM and SRC, respectively. The experimental results are presented by performing their comparative analysis on a standard dataset, and they assure the efficiency of the proposed model. However, many challenging problems related to face recognition still exist, which offer excellent opportunities to face recognition researchers in the future.

Salient Object Detection by LTP Texture Characterization on Opposing Color Pairs under SLICO Superpixel Constraint.

The effortless detection of salient objects by humans has been the subject of research in several fields, including computer vision, as it has many applications. However, salient object detection remains a challenge for many computer models dealing with color and textured images. Most of them process color and texture separately and therefore implicitly consider them as independent features which is not the case in reality. Herein, we propose a novel and efficient strategy, through a simple model, almost without internal parameters, which generates a robust saliency map for a natural image. This strategy consists of integrating color information into local textural patterns to characterize a color micro-texture. It is the simple, yet powerful LTP (Local Ternary Patterns) texture descriptor applied to opposing color pairs of a color space that allows us to achieve this end. Each color micro-texture is represented by a vector whose components are from a superpixel obtained by the SLICO (Simple Linear Iterative Clustering with zero parameter) algorithm, which is simple, fast and exhibits state-of-the-art boundary adherence. The degree of dissimilarity between each pair of color micro-textures is computed by the FastMap method, a fast version of MDS (Multi-dimensional Scaling) that considers the color micro-textures’ non-linearity while preserving their distances. These degrees of dissimilarity give us an intermediate saliency map for each RGB (Red–Green–Blue), HSL (Hue–Saturation–Luminance), LUV (L for luminance, U and V represent chromaticity values) and CMY (Cyan–Magenta–Yellow) color space. The final saliency map is their combination to take advantage of the strength of each of them. The MAE (Mean Absolute Error), MSE (Mean Squared Error) and F measures of our saliency maps, on the five most used datasets show that our model outperformed several state-of-the-art models. Being simple and efficient, our model could be combined with classic models using color contrast for a better performance.

MeQryEP: A Texture Based Descriptor for Biomedical Image Retrieval.

Image texture analysis is a dynamic area of research in computer vision and image processing, with applications ranging from medical image analysis to image segmentation to content-based image retrieval and beyond. “Quinary encoding on mesh patterns (MeQryEP)” is a new approach to extracting texture features for indexing and retrieval of biomedical images, which is implemented in this work. An extension of the previous study, this research investigates the use of local quinary patterns (LQP) on mesh patterns in three different orientations. To encode the gray scale relationship between the central pixel and its surrounding neighbors in a two-dimensional (2D) local region of an image, binary and nonbinary coding, such as local binary patterns (LBP), local ternary patterns (LTP), and LQP, are used, while the proposed strategy uses three selected directions of mesh patterns to encode the gray scale relationship between the surrounding neighbors for a given center pixel in a 2D image. An innovative aspect of the proposed method is that it makes use of mesh image structure quinary pattern features to encode additional spatial structure information, resulting in better retrieval. On three different kinds of benchmark biomedical data sets, analyses have been completed to assess the viability of MeQryEP. LIDC-IDRI-CT and VIA/I–ELCAP-CT are the lung image databases based on computed tomography (CT), while OASIS-MRI is a brain database based on magnetic resonance imaging (MRI). This method outperforms state-of-the-art texture extraction methods, such as LBP, LQEP, LTP, LMeP, LMeTerP, DLTerQEP, LQEQryP, and so on in terms of average retrieval precision (ARP) and average retrieval rate (ARR).

An Efficient Defocus Blur Segmentation Scheme Based on Hybrid LTP and PCNN.

The defocus or motion effect in images is one of the main reasons for the blurry regions in digital images. It can affect the image artifacts up to some extent. However, there is a need for automatic defocus segmentation to separate blurred and sharp regions to extract the information about defocus-blur objects in some specific areas, for example, scene enhancement and object detection or recognition in defocus-blur images. The existence of defocus-blur segmentation algorithms is less prominent in noise and also costly for designing metric maps of local clarity. In this research, the authors propose a novel and robust defocus-blur segmentation scheme consisting of a Local Ternary Pattern (LTP) measured alongside Pulse Coupled Neural Network (PCNN) technique. The proposed scheme segments the blur region from blurred fragments in the image scene to resolve the limitations mentioned above of the existing defocus segmentation methods. It is noticed that the extracted fusion of upper and lower patterns of proposed sharpness-measure yields more noticeable results in terms of regions and edges compared to referenced algorithms. Besides, the suggested parameters in the proposed descriptor can be flexible to modify for performing numerous settings. To test the proposed scheme’s effectiveness, it is experimentally compared with eight referenced techniques along with a defocus-blur dataset of 1000 semi blurred images of numerous categories. The model adopted various evaluation metrics comprised of Precision, recall, and F1-Score, which improved the efficiency and accuracy of the proposed scheme. Moreover, the proposed scheme used some other flavors of evaluation parameters, e.g., Accuracy, Matthews Correlation-Coefficient (MCC), Dice-Similarity-Coefficient (DSC), and Specificity for ensuring provable evaluation results. Furthermore, the fuzzy-logic-based ranking approach of Evaluation Based on Distance from Average Solution (EDAS) module is also observed in the promising integrity analysis of the defocus blur segmentation and also in minimizing the time complexity.

Fall event detection using the mean absolute deviated local ternary patterns and BiLSTM

Fall detection in elder persons may result in long-lasting injury that can have severe consequences for the rest of their lives. Additionally, prolonged delay in emergency treatment after the fall event escalates the chances of mortality. Hence, fall detection at early stage is critical in terms of providing timely aid with little complications and minimize hospitalization expenses. This work aims to provide an effective and efficient healthcare solution to determine the event of fall detection for elderly persons. We aim to address this fall detection problem for elder persons living lonely and encounter issues in case they fall and are unable to call for assistance. In this paper, we present a fall detection framework by proposing a novel feature space mean absolute deviated-local ternary patterns (MAD-LTP) to examine the environmental sounds and used these features to train the BiLSTM for fall events detection. Our proposed MAD-LTP features successfully address the limitations of existing features i.e., non-robust over dynamic pattern detection, brute force optimization, intolerance over non-uniform noise, etc., for fall detection. Performance of our system is evaluated on three diverse datasets i.e., The daily sounds, A3 Fall 2.0, and our in-house developed MSP-UET fall detection dataset. We compared the performance of the proposed framework against the state-of-the-art methods. We obtained an accuracy of 93.5%, 98.29%, and 98% for the daily sounds, A3 Fall 2.0, and our in-house developed MSP-UET fall detection dataset. Experimental findings indicate the reliability of our method for fall event detection.

Study on Identification Method of Pulmonary Nodules: Improved Random Walk Pulmonary Parenchyma Segmentation and Fusion Multi-Feature VGG16 Nodule Classification.

PurposeThe purpose of this study was to realize automatic segmentation of lung parenchyma based on random walk algorithm to ensure the accuracy of lung parenchyma segmentation. The explicable features of pulmonary nodules were added into VGG16 neural network to improve the classification accuracy of pulmonary nodules.Materials and MethodsLIDC-IDRI, a public dataset containing lung Computed Tomography images/pulmonary nodules, was used as experimental data. In lung parenchyma segmentation, the maximum Between-Class Variance method (OTSU), corrosion and expansion methods were used to automatically obtain the foreground and background seed points of random walk algorithm in lung parenchyma region. The shortest distance between point sets was added as one of the criteria of prospect probability in the calculation of random walk weight function to achieve accurate segmentation of pulmonary parenchyma. According to the location of the nodules marked by the doctor, the nodules were extracted. The texture features and grayscale features were extracted by Volume Local Direction Ternary Pattern (VLDTP) method and gray histogram. The explicable features were input into VGG16 network in series mode and fused with depth features to achieve accurate classification of nodules. Intersection of Union (IOU) and false positive rate (FPR) were used to measure the segmentation results. Accuracy, Sensitivity, Specificity, Accuracy and F1 score were used to evaluate the results of nodule classification.ResultsThe automatic random walk algorithm is effective in lung parenchyma segmentation, and its segmentation efficiency is improved obviously. In VGG16 network, the accuracy of nodular classification is 0.045 higher than that of single depth feature classification.ConclusionThe method proposed in this paper can effectively and accurately achieve automatic segmentation of lung parenchyma. In addition, the fusion of multi-feature VGG16 network is effective in the classification of pulmonary nodules, which can improve the accuracy of nodular classification.

Cervical cancer diagnosis based on modified uniform local ternary patterns and feed forward multilayer network optimized by genetic algorithm

Cervical cancer is one of the most common types of cancer for women. Early and accurate diagnosis can save the patient's life. Pap smear testing is nowadays commonly used to diagnose cervical cancer. The type, structure and size of the cervical cells in pap smears images are major factors which are used by specialist doctors to diagnosis abnormality. Various image processing-based approaches have been proposed to acquire pap smear images and diagnose cervical cancer in pap smears images. Accuracy is usually the primary objective in evaluating the performance of these systems. In this paper, a two-stage method for pap smear image classification is presented. The aim of the first stage is to extract texture information of the cytoplasm and nucleolus jointly. For this purpose, the pap smear image is first segmented using the appropriate threshold. Then, a texture descriptor is proposed titled modified uniform local ternary patterns (MULTP), to describe the local textural features. Secondly, an optimized multi-layer feed-forward neural network is used to classify the pap smear images. The proposed deep neural network is optimized using genetic algorithm in terms of number of hidden layers and hidden nodes. In this respect, an innovative chromosome representation and cross-over process is proposed to handle these parameters. The performance of the proposed method is evaluated on the Herlev database and compared with many other efficient methods in this scope under the same validation conditions. The results show that the detection accuracy of the proposed method is higher than the compared methods. Insensitivity to image rotation is one of the major advantages of the proposed method. Results show that the proposed method has the capability to be used in online problems because of low run time. The proposed texture descriptor, MULTP is a general operator which can be used in many computer vision problems to describe texture properties of image. Also, the proposed optimization algorithm can be used in deep-networks to improve performance.

A Modified Extrema Pattern with Multilinear Matrix Decomposition Based RLC Scheme for Efficient Serial Remote Sensing Images Mining

The growth of serial remote sensing images (SRSI) offers abundant information for determining sequential spatial patterns in several fields like vegetation cover, urban development, and agricultural monitoring. Or else, traditional sequential pattern-mining algorithms cannot be applied efficiently or directly to remote sensing images. Here a new technique is proposed for enhancing the mining efficacy of spatial sequential patterns from raster serial remote sensing images (SRSI) based on pixel grouping approach. The modified extrema pattern is employed to offering grey-scale invariant transform of intensity values unlike previously employed local ternary pattern. The pattern features are computed by transformation process from which the multilinear matrix decomposition of the image is made by computing the covariance estimation on recognizing their orthogonal component. The matrix decomposition is then attained based on run length encoding process (RLC). The two rows of RLC vectors are intersected to attain pixel group matrix. Finally, the compressed image is attained in an efficient manner with effective mining time. The performance outcome reveals that the technique offered in this paper is capable of extracting spatial sequential patterns from SRSI effectively. The proposed system ensures that the entire patterns are extracted at a lower time consumption when compared to the state-of-the-art technologies.

Advanced pest detection strategy using hybrid optimization tuned deep convolutional neural network

PurposeAgriculture is the backbone of a country, contributing more than half of the sector of economy throughout the world. The need for precision agriculture is essential in evaluating the conditions of the crops with the aim of determining the proper selection of pesticides. The conventional method of pest detection fails to be stable and provides limited accuracy in the prediction. This paper aims to propose an automatic pest detection module for the accurate detection of pests using the hybrid optimization controlled deep learning model.Design/methodology/approachThe paper proposes an advanced pest detection strategy based on deep learning strategy through wireless sensor network (WSN) in the agricultural fields. Initially, the WSN consisting of number of nodes and a sink are clustered as number of clusters. Each cluster comprises a cluster head (CH) and a number of nodes, where the CH involves in the transfer of data to the sink node of the WSN and the CH is selected using the fractional ant bee colony optimization (FABC) algorithm. The routing process is executed using the protruder optimization algorithm that helps in the transfer of image data to the sink node through the optimal CH. The sink node acts as the data aggregator and the collection of image data thus obtained acts as the input database to be processed to find the type of pest in the agricultural field. The image data is pre-processed to remove the artifacts present in the image and the pre-processed image is then subjected to feature extraction process, through which the significant local directional pattern, local binary pattern, local optimal-oriented pattern (LOOP) and local ternary pattern (LTP) features are extracted. The extracted features are then fed to the deep-convolutional neural network (CNN) in such a way to detect the type of pests in the agricultural field. The weights of the deep-CNN are tuned optimally using the proposed MFGHO optimization algorithm that is developed with the combined characteristics of navigating search agents and the swarming search agents.FindingsThe analysis using insect identification from habitus image Database based on the performance metrics, such as accuracy, specificity and sensitivity, reveals the effectiveness of the proposed MFGHO-based deep-CNN in detecting the pests in crops. The analysis proves that the proposed classifier using the FABC+protruder optimization-based data aggregation strategy obtains an accuracy of 94.3482%, sensitivity of 93.3247% and the specificity of 94.5263%, which is high as compared to the existing methods.Originality/valueThe proposed MFGHO optimization-based deep-CNN is used for the detection of pest in the crop fields to ensure the better selection of proper cost-effective pesticides for the crop fields in such a way to increase the production. The proposed MFGHO algorithm is developed with the integrated characteristic features of navigating search agents and the swarming search agents in such a way to facilitate the optimal tuning of the hyperparameters in the deep-CNN classifier for the detection of pests in the crop fields.

The local ternary pattern encoder–decoder neural network for dental image segmentation

Recent advances in medical imaging analyses, especially the use of deep learning, are helping to identify, detect, classify, and quantify patterns in radiographs. At the centre of these advances is the ability to explore hierarchical feature representations learned from data. Deep learning is invaluably becoming the most sought out technique, leading to enhanced performances in the analysis of medical applications and systems. Deep learning techniques have achieved improved performance results in dental image segmentation. Segmentation of dental radiographs is a crucial step that helps dentists to diagnose dental caries. However, the performance of the deep networks used for these analyses are restrained by various challenging features found in dental carious lesions. Segmentation of dental images is often difficult due to the vast variety of types of topology, intricacies of medical structure and poor image quality caused by conditions such as low contrast, noise, irregular, and fuzzy border edges. These issues are exacerbated by low numbers of data images available for any particular analysis. A robust local ternary pattern encoder–decoder network (LTPEDN) is proposed to overcome dental image segmentation challenges and minimise the computational resources required. This new architecture is a modification of existing methods using an LTP. Images are preprocessed via augmentation and normalisation techniques to increase and prepare the datasets. Thereafter, the dataset input is sent to the LTPEDN for training and testing the model. Segmentation is performed using the non-learnable layers (the LTP layers) and the learnable layers (standard convolution layers), to extract the ROI of the teeth. The method was evaluated on an augmented dataset of 11, 000 dental images. It was trained on 8, 800 training set images and tested on 2, 200 testing set images. The new method is shown to be 94.32% accurate.

PCA-Based Advanced Local Octa-Directional Pattern (ALODP-PCA): A Texture Feature Descriptor for Image Retrieval

This paper presents a novel feature descriptor termed principal component analysis (PCA)-based Advanced Local Octa-Directional Pattern (ALODP-PCA) for content-based image retrieval. The conventional approaches compare each pixel of an image with certain neighboring pixels providing discrete image information. The descriptor proposed in this work utilizes the local intensity of pixels in all eight directions of its neighborhood. The local octa-directional pattern results in two patterns, i.e., magnitude and directional, and each is quantized into a 40-bin histogram. A joint histogram is created by concatenating directional and magnitude histograms. To measure similarities between images, the Manhattan distance is used. Moreover, to maintain the computational cost, PCA is applied, which reduces the dimensionality. The proposed methodology is tested on a subset of a Multi-PIE face dataset. The dataset contains almost 800,000 images of over 300 people. These images carries different poses and have a wide range of facial expressions. Results were compared with state-of-the-art local patterns, namely, the local tri-directional pattern (LTriDP), local tetra directional pattern (LTetDP), and local ternary pattern (LTP). The results of the proposed model supersede the work of previously defined work in terms of precision, accuracy, and recall.

Enhanced Local Ternary Pattern method for Face Recognition

Biometrics is a term used to determine an individual's identification based on physiological or behavioral traits. Such physiological or behavioral characteristics differ from person to person. For this reason, it is more secure and popular to authenticate the person using biological characteristics than other conventional authentication methods. The Local Binary Pattern (LBP) face recognition system is widely used but is noise sensitive. For the purpose of improving the performance, a descriptor of a local texture called Local Ternary Pattern (LTP) is introduced, which is more discriminating in uniform regions and less noise sensitive. The proposed method called Enhanced LTP (ELTP), uses pre-processing technique. Here, the input image is pre-processed using Gamma Correction and Histogram Equalization. The LTP is applied on pre-processed image to get the finalized feature vectors. Experimentation is conducted on the standard datasets ORL, UMIST and VTU (VISA) face datasets. It is proved that ELTP shows better accuracy than other face recognition methods.

Melanoma Skin Cancer Detection Using Wavelet Transform and Local Ternary Pattern

Melanoma is the most serious form of skin cancer that affects millions of people globally. Through image analytics, early identification of skin cancer is enabled, resulting in more effective treatment and a lower mortality rate. The ph2 and human against machine datasets were used to collect images. After preprocessing the image with a weighted median filter, segmentation is investigated using a number of common techniques, with the best result generated by combining watershed transform and maximum similarity region merging. U-net architecture is explored for segmentation. Segmentation efficiency is calculated by dice loss and Jaccard coefficient. Segmentation architecture outperform the conventional method. Additionally, a novel wavelet transform-based approach is used to extract features, followed by local ternary pattern analysis. The intersection of the histograms, the Bhattacharya distance, the Chi-square distance, and the Pearson correlation coefficients are all computed. This inquiry makes use of only the Histogram intersection and Chi-square distance characteristics. Additional categorization is examined through the use of a range of machine learning algorithms, including the k-nearest neighbour approach, Bayesian classification, decision trees, and Support Vector Machines (SVM). When a Radial Basis Function (RBF) kernel based SVM is applied, the classification accuracy is maximised. This work is entirely devoted to binary categorization. As evidenced by the data, they outperform other state-of-the-art approaches reported in the literature. SVM classifies data with an accuracy of 98.6 percent. Weighted median filter, Watershed transform, Merging regions with the highest degree of similarity, Wavelet transform, Local Ternary Pattern, Histogram intersection Pearson correlation coefficient, chi-square distance Distance between Bhattacharya and support vector machine.

Human Face Recognition Based on Local Ternary Pattern and Singular Value Decomposition

There is various human biometrics used nowadays, one of the most important of these biometrics is the face. Many techniques have been suggested for face recognition, but they still face a variety of challenges for recognizing faces in images captured in the uncontrolled environment, and for real-life applications. Some of these challenges are pose variation, occlusion, facial expression, illumination, bad lighting, and image quality. New techniques are updating continuously. In this paper, the singular value decomposition is used to extract the features matrix for face recognition and classification. The input color image is converted into a grayscale image and then transformed into a local ternary pattern before splitting the image into the main sixteen blocks. Each block of these sixteen blocks is divided into more to thirty sub-blocks. For each sub-block, the SVD transformation is applied, and the norm of the diagonal matrix is calculated, which is used to create the 16x30 feature matrix. The sub-blocks of two images, (thirty elements in the main block) are compared with others using the Euclidean distance. The minimum value for each main block is selected to be one feature input to the neural network. Classification is implemented by a backpropagation neural network, where a 16-feature matrix is used as input to the neural network. The performance of the current proposal was up to 97% when using the FEI (Brazilian) database. Moreover, the performance of this study is promised when compared with recent state-of-the-art approaches and it solves some of the challenges such as illumination and facial expression.

Classification of breast cancer images using completed local ternary pattern and support vector machine

Breast cancer is the major cause of deaths in women compared to other cancers. Though early detection of breast cancer reduces cancer deaths, it is a challenging task for physicians. Local binary pattern (LBP) and local ternary pattern (LTP) techniques are widely applied in texture classification applications. Since LBP is more sensitive to noise in texture classification, it needs to be improved for achieving better results. Though LTP is more robust to noise, there are few drawbacks. Completed LBP and completed local binary count techniques achieve good accuracy for texture classification, but they inherit few drawbacks of LBP. In this paper, completed LTP operator is applied on breast cancer images for better classification accuracy than LBP and completed LBP operators, by extracting sign and magnitude components. Experimental results based on breast cancer database show that the proposed technique achieved better classification accuracy than existing similar approaches.

Texture Image Analysis Based on Joint of Multi Directions GLCM and Local Ternary Patterns

Texture Image Analysis Based on Joint of Multi Directions GLCM and Local Ternary Patterns

Circumferential Local Ternary Pattern: New and Efficient Feature Descriptors for Anti-Counterfeiting Pattern Identification

An important aspect of querying whether a product is likely to be forged is to identify its anti-counterfeiting label. However, the use of image processing technology for label-specific texture analysis to quickly and effectively identify the anti-counterfeiting label has been widely studied. Aiming at the defects of the local binary pattern (LBP) and its variants in texture identification, this paper proposes a new texture model for anti-counterfeiting identification, that is, the circular local ternary pattern (CLTP). The highlight of our technology is that it extracts the effective local texture descriptors by using the random features of inkjet printing. This allows for the technology to not only resist the interference of noise and illumination in images of anti-counterfeiting patterns but also to encode and reorganize the fine linear shape structure. Specifically, this paper extracts the CLTP texture feature in the corresponding key areas and forms the final feature histogram vector for comparison through the one-to-one correspondence between the sample image and the inspected image of anti-counterfeiting pattern. Experiments prove that our method not only has high discrimination, stability and effectiveness but also provides a convenient and practical idea for anti-counterfeiting technology.

A concatenation of deep and texture features for medicinal trash image classification using EnSegNet-DNN-based transfer learning

The foremost vital process in clinical trash classification is to classify the medicinal wastes into various categories like contagious, poisonous and normal wastes. For this purpose, several deep learning systems using different structures including ResNext, GoogleNet, etc., are designed. Among those systems, an Enhanced Segmentation Network (EnSegNet) with DNN-TC (EnSegNet-DNN-TC) system has achieved a higher efficiency by segmenting and classifying the trash input images. Although it segments and extracts features effectively, there are very subtle differences between many images because of their highly complex background. This leads to misjudgments of the deep learner system. Therefore in this article, an EnSegNet with Combined Feature Extraction (CFE) and DNN-TC called EnSegNet-CFE-DNN-TC system is proposed to solve misjudgments problem in deep learner classifiers due to high complex background images. First, the input images are segmented by the EnSegNet model. After that, various texture characteristics, namely Gray-Level Co-occurrence Matrix (GLCM), Multi-level Local Binary Pattern (MLBP), Local Derivative Pattern (LDP) and Local Ternary Pattern (LTP) are extracted including the deep features from the segmented images. Then, a new layer called the combination layer is introduced after the Fully Connected (FC) layers to fuse the extracted features and construct a new hybrid feature vector. This hybrid feature vector has a stronger discriminant ability compared to the single feature vector. Further, the softmax is performed to classify the medicinal wastes. Finally, the investigation outcomes reveal that the EnSegNet-CFE-DNN-TC system attains a 93.7% of classification accuracy for 100 trash images compared to the EnSegNet-DNN-TC and DNN-TC.

Local directional double ternary coding pattern for facial expression recognition

Local directional double ternary coding pattern for facial expression recognition