Texture Vector Research Articles

Estimation of video sequence homography based on a first-order estimation method

As it is a pre-processing task, estimation of video-sequence-based homography requires low computational costs and fast evaluation. However, current algorithms for video sequence tasks are commonly based on image-pair homography and do not consider the inner properties of the video sequences. Therefore they take unnecessary computational resources. In this work, we propose a novel algorithm with a first-order estimation method to fill the gap between estimation of image-pairs and video sequence homography. By considering the continuous movement of the camera, the proposed algorithm adopts a first-order estimation to accelerate the estimation process while maintaining its robustness. Instead of extracting many image features from every frame, we demonstrate that estimating a homography matrix with pixel-based texture patterns is effective and sufficient for video sequences. Experiments show that homography estimation with simple one-dimensional texture vectors, as used in our algorithm, can surpass state-of-the-art feature-based algorithms and deep-learning-based methods. This first-order estimation method was more than 40 times faster and real-time estimation used only the CPU.

Dual-modal identification of jadeite based on optical coherence tomography images and Raman spectral features.

Low-quality jadeite is often subjected to bleaching, filling, and dyeing to improve its texture and consequently increase its value. In this study, natural jadeite, bleached and filled jadeite, and dyed jadeite were investigated by combining Raman spectroscopy and optical coherence tomography (OCT). The results show that jadeite composition can be identified from Raman peaks around 205, 377, 700, and 1040c m -1. The presence of epoxy filler can be detected from Raman peaks at 1113, 1187, and 1609c m -1, among which the features of 1113 and 1609c m -1 are particularly significant. Dyed jadeite exhibits a pronounced fluorescence background in its Raman spectrum due to the injected dye. After noise reduction, texture vectors representing the texture of bleached or dyed jadeite can be obtained from OCT images. These vectors differ from the corresponding texture vector of natural jadeite. Most processed jadeites have relatively low texture vector intensities due to particle reduction and texture damage during processing. However, the texture vector strengths of jadeites can be increased through internal silting.

Fractal Feature Based Image Resolution Enhancement Using Wavelet–Fractal Transformation in Gradient Domain

The fractal geometries are applied extensively in many applications like pattern recognition, texture analysis and segmentation. The application of fractal geometry requires estimation of the fractal features. The fractal dimension and fractal length are found effective to analyze and measure image features, such as texture, resolution, etc. This paper proposes a new wavelet–fractal technique for image resolution enhancement. The resolution of the wavelet sub-bands are improved using scaling operator and then it is transformed into texture vector. The proposed method then computes fractal dimension and fractal length in gradient domain which is used for resolution enhancement. It is observed that by using scaling operator in the gradient domain, the fractal dimension and fractal length becomes scale invariant. The major advantage of the proposed wavelet–fractal technique is that the feature vector retains fractal dimension and fractal length both. Thus, the resolution enhanced image restores the texture information well. The texture information has also been observed in terms of fractal dimension with varied sample size. We present qualitative and quantitative analysis of the proposed method with existing state of art methods.

Segmentation and Classification of Stomach Abnormalities Using Deep Learning

An automated system is proposed for the detection and classification of GI abnormalities. The proposed method operates under two pipeline procedures: (a) segmentation of the bleeding infection region and (b) classification of GI abnormalities by deep learning. The first bleeding region is segmented using a hybrid approach. The threshold is applied to each channel extracted from the original RGB image. Later, all channels are merged through mutual information and pixel-based techniques. As a result, the image is segmented. Texture and deep learning features are extracted in the proposed classification task. The transfer learning (TL) approach is used for the extraction of deep features. The Local Binary Pattern (LBP) method is used for texture features. Later, an entropy-based feature selection approach is implemented to select the best features of both deep learning and texture vectors. The selected optimal features are combined with a serial-based technique and the resulting vector is fed to the Ensemble Learning Classifier. The experimental process is evaluated on the basis of two datasets: Private and KVASIR. The accuracy achieved is 99.8 per cent for the private data set and 86.4 percent for the KVASIR data set. It can be confirmed that the proposed method is effective in detecting and classifying GI abnormalities and exceeds other methods of comparison.

Texture collinearity foreground segmentation for night videos

One of the most difficult scenarios for unsupervised segmentation of moving objects is found in nighttime videos where the main challenges are the poor illumination conditions resulting in low-visibility of objects, very strong lights, surface-reflected light, a great variance of light intensity, sudden illumination changes, hard shadows, camouflaged objects, and noise. This paper proposes a novel method, coined COLBMOG (COLlinearity Boosted MOG), devised specifically for the foreground segmentation in nighttime videos, that shows the ability to overcome some of the limitations of state-of-the-art methods and still perform well in daytime scenarios. It is a texture-based classification method, using local texture modeling, complemented by a color-based classification method. The local texture at the pixel neighborhood is modeled as an N-dimensional vector. For a given pixel, the classification is based on the collinearity between this feature in the input frame and the reference background frame. For this purpose, a multimodal temporal model of the collinearity between texture vectors of background pixels is maintained. COLBMOG was objectively evaluated using the ChangeDetection.net (CDnet) 2014, Night Videos category, benchmark. COLBMOG ranks first among all the unsupervised methods. A detailed analysis of the results revealed the superior performance of the proposed method compared to the best performing state-of-the-art methods in this category, particularly evident in the presence of the most complex situations where all the algorithms tend to fail.

Face Recognition based on CNN 2D-3D Reconstruction using Shape and Texture Vectors Combining

This study proposes a face recognition model using a combination of shape and texture vectors that are used to produce new face images on 2D-3D reconstruction images. The reconstruction process to produce 3D face images is carried out using the convolutional neural network (CNN) method on 2D face images. Merging shapes and textures vector is used to produce correlation points on new face images that have similarities to the initial image used. Principal Component Analysis (PCA) is used as a feature extraction method, for the classification method we use the Mahalanobis method. The results of the tests can produce a better recognition rate compared to face recognition testing using 2D images.

Face Recognition based on CNN 2D-3D Reconstruction using Shape and Texture Vectors Combining

This study proposes a face recognition model using a combination of shape and texture vectors that are used to produce new face images on 2D-3D reconstruction images. The reconstruction process to produce 3D face images is carried out using the convolutional neural network (CNN) method on 2D face images. Merging shapes and textures vector is used to produce correlation points on new face images that have similarities to the initial image used. Principal Component Analysis (PCA) is used as a feature extraction method, for the classification method we use the Mahalanobis method. The results of the tests can produce a better recognition rate compared to face recognition testing using 2D images.

Magnetic Resonance Imaging, texture analysis and regression techniques to non-destructively predict the quality characteristics of meat pieces

The quality of meat products is traditionally assessed by chemical or sensorial analysis, which are time consuming, need specialized technicians and destroy the products. The development of new technologies to monitor meat pieces using non-destructive methods in order to establish their quality is earning importance in the last years. An increasing number of studies have been carried out on meat pieces combining Magnetic Resonance Imaging (MRI), texture descriptors and regression techniques to predict several physico-chemical or sensorial attributes of the meat, mainly different types of pig ham and loins. In spite of the importance of the problem, the conclusions of these works are still preliminary because they only use the most classical texture descriptors and regressors instead of stronger methods, and because the methodology used to measure the performance is optimistic. In this work, we test a wide range of texture analysis techniques and regression methods using a realistic methodology to predict several physico-chemical and sensorial attributes of different meat pieces of Iberian pigs. The texture descriptors include statistical techniques, like Haralick descriptors, local binary patterns, fractal features and frequential descriptors, like Gabor or wavelet features. The regression techniques include linear regressors, neural networks, deep learning, support vector machines, regression trees, ensembles, boosting machines and random forests, among others. We developed experiments using 15 texture feature vectors, 28 regressors over 4 datasets of Iberian pig meat pieces to predict 39 physico-chemical and sensorial attributes, summarizing16,380 experiments. There is not any combination of texture vector and regressor which provides the best result for all attributes tested. Nevertheless, all these experiments provided the following conclusions: (1) the regressor performance, measured using the squared correlation (R2), is from good to excellent (above 0.5625) for 29 out of 39 attributes tested; (2) the WAPE (Weighted Absolute Percent Error) is lower than 2% for 32 out of 37 attributes; (3) the dispersion in computer predictions around the true attributes is lower or similar than the dispersion in the labeling expert’s for the majority of attributes (85%); and (4) differences between predicted and true values are not statistically significant for 29 out of 37 attributes using the Wilcoxon ranksum statistical test. We can conclude that these results provide a high reliability for an automatic system to predict the quality of meat pieces, which may operate on-line in the meat industries in the future.

Spatio-Temporal Co-Occurrence Characterizations For Human Action Classification

The human action classification task is a widely researched topic and is still an open problem. Many state-ofthe- arts approaches involve the usage of bag-of-video-words with spatio-temporal local features to construct characterizations for human actions. In order to improve beyond this standard approach, we investigate the usage of co-occurrences between local features. We propose the usage of co-occurrences information to characterize human actions. A trade-off factor is used to define an optimal trade-off between vocabulary size and classification rate. Next, a spatio-temporal co-occurrence technique is applied to extract co-occurrence information between labeled local features. Novel characterizations for human actions are then constructed. These include a vector quantized correlogram-elements vector, a highly discriminative PCA (Principal Components Analysis) co-occurrence vector and a Haralick texture vector. Multi-channel kernel SVM (support vector machine) is utilized for classification. For evaluation, the well known KTH as well as the UCF-Sports action datasets are used. We obtained state-of-the-arts classification performance. We also demonstrated that we are able to fully utilize co-occurrence information, and improve the standard bag-of-video-words approach.

Finger texture biometric verification exploiting Multi-scale Sobel Angles Local Binary Pattern features and score-based fusion

In this paper a new feature extraction method called Multi-scale Sobel Angles Local Binary Pattern (MSALBP) is proposed for application in personal verification using biometric Finger Texture (FT) patterns. This method combines Sobel direction angles with the Multi-Scale Local Binary Pattern (MSLBP). The resulting characteristics are formed into non-overlapping blocks and statistical calculations are implemented to form a texture vector as an input to an Artificial Neural Network (ANN). A Probabilistic Neural Network (PNN) is applied as a multi-classifier to perform the verification. In addition, an innovative method for FT fusion based on individual finger contributions is suggested. This method is considered as a multi-object verification, where a finger fusion method named the Finger Contribution Fusion Neural Network (FCFNN) is employed for the five fingers. Two databases have been employed in this paper: PolyU3D2D and Spectral 460 nm (S460) from CASIA Multi-Spectral (CASIA-MS) images. The MSALBP feature extraction method has been examined and compared with different Local Binary Pattern (LBP) types; in classification it yields the lowest Equal Error Rate (EER) of 0.68% and 2% for PolyU3D2D and CASIA-MS (S460) databases, respectively. Moreover, the experimental results revealed that our proposed finger fusion method achieved superior performance for the PolyU3D2D database with an EER of 0.23% and consistent performance for the CASIA-MS (S460) database with an EER of 2%.

A novel correspondence-based face-hallucination method

This paper addresses the problem of estimating high-resolution (HR) facial images from a single low-resolution (LR) input. We assume that the input LR and estimated HR images are under the same view-point and illumination condition, i.e. the setting of image super-resolution. At the core of our techniques is that the facial images can be decomposed as a texture vector, characterized in terms of the appearance, and a shape vector, characterized in terms of the geometry variations. This enables a two-stage successive estimation framework that is geometry aware and obviates the needs in sophisticated optimizations. In particular, the proposed technique first solves for appearance of the HR faces form the correspondence derived between an interpolated LR face and its corresponding HR face. Given the texture of the HR faces, we incorporate optical flow to solve the local structure at sub-pixel level for the HR faces; here, we use additional geometry inspired priors to further regularize the solution. Experimental results show that our method outperforms other state-of-the-art methods in terms of retaining the facial-feature shape and the estimation of novel features.

Integrating Textural and Spectral Features to Classify Silicate-Bearing Rocks Using Landsat 8 Data

Texture as a measure of spatial features has been useful as supplementary information to improve image classification in many areas of research fields. This study focuses on assessing the ability of different textural vectors and their combinations to aid spectral features in the classification of silicate rocks. Texture images were calculated from Landsat 8 imagery using a fractal dimension method. Different combinations of texture images, fused with all seven spectral bands, were examined using the Jeffries–Matusita (J–M) distance to select the optimal input feature vectors for image classification. Then, a support vector machine (SVM) fusing textural and spectral features was applied for image classification. The results showed that the fused SVM classifier achieved an overall classification accuracy of 83.73%. Compared to the conventional classification method, which is based only on spectral features, the accuracy achieved by the fused SVM classifier is noticeably improved, especially for granite and quartzose rock, which shows an increase of 38.84% and 7.03%, respectively. We conclude that the integration of textural and spectral features is promising for lithological classification when an appropriate method is selected to derive texture images and an effective technique is applied to select the optimal feature vectors for image classification.

SU‐F‐J‐207: Non‐Small Cell Lung Cancer Patient Survival Prediction with Quantitative Tumor Textures Analysis in Baseline CT

Purpose:Chemo‐radiation therapy (CRT) is widely used in treating patients with locally advanced non‐small cell lung cancer (NSCLC). Determination of the likelihood of patient response to treatment and optimization of treatment regime is of clinical significance. Up to date, no imaging biomarker has reliably correlated to NSCLC patient survival rate. This pilot study is to extract CT texture information from tumor regions for patient survival prediction.Methods:Thirteen patients with stage II‐III NSCLC were treated using CRT with a median dose of 6210 cGy. Non‐contrast‐enhanced CT images were acquired for treatment planning and retrospectively collected for this study. Texture analysis was applied in segmented tumor regions using the Local Binary Pattern method (LBP). By comparing its HU with neighboring voxels, the LBPs of a voxel were measured in multiple scales with different group radiuses and numbers of neighbors. The LBP histograms formed a multi‐dimensional texture vector for each patient, which was then used to establish and test a Support Vector Machine (SVM) model to predict patients’ one year survival. The leave‐one‐out cross validation strategy was used recursively to enlarge the training set and derive a reliable predictor. The predictions were compared with the true clinical outcomes.Results:A 10‐dimensional LBP histogram was extracted from 3D segmented tumor region for each of the 13 patients. Using the SVM model with the leave‐one‐out strategy, only 1 out of 13 patients was misclassified. The experiments showed an accuracy of 93%, sensitivity of 100%, and specificity of 86%.Conclusion:Within the framework of a Support Vector Machine based model, the Local Binary Pattern method is able to extract a quantitative imaging biomarker in the prediction of NSCLC patient survival. More patients are to be included in the study.

The Application of Cross-Media Retrieval Technology Based on Ontology

As a large number of the multimedia information emerges, the cross-media retrieval system becomes an important research focus. The cross-media retrieval system is based on the traditional content retrieval, extracting color, texture, and shape features vector of the images. A new method was carried out in this paper. Firstly, the uniform semantic representational framework was built to organize the different mode media heterogeneous characteristics. Secondly, the Ontology database representing each type of media concepts was set up. The Ontology database organizes the low level features of the multimedia objects to associate multimedia files in the semantic level. Thirdly, the cross-media retrieval algorithm based on ontology was introduced. The results of the experiment showed that this cross-media retrieval method based on the Ontology was more effective and accurate.

Content-Based Image Retrieval Using SOM and DWT

Content-Based Image Retrieval (CBIR) from a large database is becoming a necessity for many applications such as medical imaging, Geographic Information Systems (GIS), space search and many others. However, the process of retrieving relevant images is usually preceded by extracting some discriminating features that can best describe the database images. Therefore, the retrieval process is mainly dependent on comparing the captured features which depict the most important characteristics of images instead of comparing the whole images. In this paper, we propose a CBIR method by extracting both color and texture feature vectors using the Discrete Wavelet Transform (DWT) and the Self Organizing Map (SOM) artificial neural networks. At query time texture vectors are compared using a similarity measure which is the Euclidean distance and the most similar image is retrieved. In addition, other relevant images are also retrieved using the neighborhood of the most similar image from the clustered data set via SOM. The proposed method demonstrated promising retrieval results on the Wang Database compared to the existing methods in literature.

Accurate Image Retrieval Algorithm Based on Color and Texture Feature

Content-Based Image Retrieval (CBIR) is one of the most active hot spots in the current research field of multimedia retrieval. According to the description and extraction of visual content (feature) of the image, CBIR aims to find images that contain specified content (feature) in the image database. In this paper, several key technologies of CBIR, e. g. the extraction of the color and texture features of the image, as well as the similarity measures are investigated. On the basis of the theoretical research, an image retrieval system based on color and texture features is designed. In this system, the Weighted Color Feature based on HSV space is adopted as a color feature vector, four features of the Co-occurrence Matrix, saying Energy, Entropy, Inertia Quadrature and Correlation, are used to construct texture vectors, and the Euclidean distance for similarity measure is employed as well. Experimental results show that this CBIR system is efficient in image retrieval.

Texture augmented detection of macrophyte species using decision trees

Image classification using multispectral sensors has shown good performance in detecting macrophytes at the species level. However, species level classification often does not utilize the texture information provided by high resolution images. This study investigated whether image texture provides useful vector(s) for the discrimination of monospecific stands of three floating macrophyte species in Quickbird imagery of the South Nation River. Semivariograms indicated that window sizes of 5×5 and 13×13pixels were the most appropriate spatial scales for calculation of the grey level co-occurrence matrix and subsequent texture attributes from the multispectral and panchromatic bands. Of the 214 investigated vectors (13 Haralick texture attributes*15 bands+9 spectral bands+10 transformations/indices), feature selection determined which combination of spectral and textural vectors had the greatest class separability based on the Mann–Whitney U-test and Jefferies–Matusita distance. While multispectral red and near infrared (NIR) performed satisfactorily, the addition of panchromatic-dissimilarity slightly improved class separability and the accuracy of a decision tree classifier (Kappa: red/NIR/panchromatic-dissimilarity – 93.2% versus red/NIR – 90.4%). Class separability improved by incorporating a second texture attribute, but resulted in a decrease in classification accuracy. The results suggest that incorporating image texture may be beneficial for separating stands with high spatial heterogeneity. However, the benefits may be limited and must be weighed against the increased complexity of the classifier.

Crowd Density Estimation Based on ELM Learning Algorithm

Crowd density estimation in public areas with people gathering and waiting is the important content of intelligent crowd surveillance . A real-time and high accuracy algorithm is necessary to be inputted in the classification and regression of crowd density estimation to improve the speed and increase the efficiency. Extreme Learning Machine (ELM) is a neural network architecture in which hidden layer weights are randomly chosen and output layer weights determined analytically. In this paper, we propose a new method which is based on Haralick’s texture vectors, Gray-level Co-occurrence Matrix and ELM . The datasets are based on PETS2009 and UCSD. The performances are compared among SVM, BP and ELM. The experimental results suggest that the ELM learning algorithm has a good performance of accuracy and a very fast speed than other methods.

Synthesis of a face image at a desired pose from a given pose

This paper proposes an efficient method to synthesize pose of an image. Pose synthesis is used to predict the face image with minimal error at a desired pose from a given pose. It is frequently required in many applications like production of animated movies, in forensic science and generation of 3D face geometry, etc. It uses principal component analysis (PCA) in conjunction with linear object classes (LOC) method (Vetter and Poggio, 1997). The face image of a pose is modelled as shape and texture vectors and the LOC method is applied on these two vectors of training set separately. The principal components of shape vector give a smaller number of significant dimensions along which the best linear approximation using LOC for the shape vector is calculated. Even though the given vector is approximated using only these dimensions, the error in approximation is significantly less compared to approximating pose image using all dimensions of shape vector. The proposed method is tested on CMU PIE face database and it is found to be significant improvement over the well known linear object classes method.

The Brief Analysis of Digital Modeling Techniques in Architecture and Related Fields

According to the article, the various digital modeling techniques in architecture and civil engineering are extensively discussed. 7 main methods for modeling which are geometry, polygons, displacement texture creation, digital sculpture, plug-ins, vector scanning, and GIS are contrasted and analyzed. To provide reference service for digital modeling in architecture and civil engineering, the research includes their working principles, features, running environments and fields of applications.