Texture Information Of Image Research Articles

Image outpainting guided by prior structure information

• The image-level and feature-level global structure information guides image outpainting • The multi-level dilated convolution block markedly expands receptive field of network • The patch-GAN discriminates patches of outpainting images • Both perceptual loss and style loss improve the texture and style of outpainting images Deep learning-based image outpainting infers the missing region by using the known parts of images. However, due to lack of fully exploring the known image structure or texture information, most existing methods always produce blurry contents and distorted structures. To generate more natural outpainting results, we propose a two-stage outpainting method guided by prior structure information. It consists of both structure outpainting and texture outpainting, which allows the model to complete structure outpainting and refines the generated image. In Stage-I, we build the structure outpainting network to infer the structural information of the missing regions by utilizing that of the known structure. This could fully explore the global structure information and produce complete structure images. Stage-II builds upon Stage-I results and utilizes both inferred image-level and aggregated multi-scale feature-level structure information to refine results with more authentic and natural texture. Moreover, a multi-level dilated convolution block is presented to significantly enlarge the receptive field of texture outpainting, promoting it to extract more useful feature information for producing finer texture. Compared with the existing state-of-the-art (SOTA) methods, the experimental results on both Places2 and Paris StreetView datasets illustrate that our method exhibits better in terms of qualitative and quantitative comparisons.

Identification of Burned Areas Based on Texture Features of Different Windows

It is vital to choose appropriate pixel spacing as the window size determines the distribution of texture features in a gray-level co-occurrence matrix (GLCM). The window size ranged from 9×9 to 15×15 to keep the richness of texture image information. In this study, the importance evaluation method based on the Gini index was used to determine the appropriate window for the identification of burned areas, and burned areas were identified with the random forest classification method based on texture features. The results showed that 15×15 was the most appropriate texture window size for the identification of burned areas, and the best texture features for the identification of burned areas were the contrast of the visible blue light band and the texture mean of the near-infrared band; burned areas could be fully identified with the random forest classification method based on texture features, with an overall classification accuracy of 83.87%, but there would be interference pixels in reservoirs, pits, ponds, marshes and irrigated dry fields.

Semi‐supervised learning dehazing algorithm based on the OSV model

Despite the great progress that has been made in the task of single image dehazing, the results of the existing models in restoring image edge and texture information are still challenging. Besides, most dehazing models are trained on synthetic data, resulting in poor generalization ability to real-world images. To address the aforementioned problems, a semi-supervised learning dehazing method based on the decomposition model of Osher, Solé, and Vese(The OSV model) is presented. Specifically, the OSV model is first applied to decompose the hazy image into the structure layer and texture layer, save the texture layer and dehaze for the structure layer to restore images with sharper texture and edge. Furthermore, the network adopts a semi-supervised learning algorithm based on generative adversarial networks (GAN) to generalize better to real-world images, which includes two branches: supervised learning and unsupervised learning. Extensive experiments indicate that the proposed method preserves the texture and edge information of images more accurately while dehazing better, and performs favourably against the advanced dehazing algorithms on both synthetic outdoor datasets and real-world hazy images.

Infrared and visible image fusion based on contrast enhancement guided filter and infrared feature decomposition

Infrared (IR) and visible (VIS) images represent the features of the scene at different wavelengths, and the features they contain have different properties. Therefore, the traditional weighted fusion strategy is challenging to preserve the different types of feature information. In addition, VIS images are highly susceptible to bad weather, which also seriously affects the quality of fused images in complex environments. To solve the above problems, we propose a feature enhancement fusion method. First, a fusion model called contrast enhancement guided filter (CEGF) is proposed. The new model enables the texture information of VIS images to be presented with the intensity of infrared pixels, which solves the problem of combining different attribute features and removes the influence of harsh lighting conditions. To improve the visibility of texture details under different lighting conditions, a contrast modulation factor is added to the cost function design of the filter to enhance the contrast of visible details. Second, we use a dual-scale decomposition strategy to enhance the infrared feature information of the fusion results. Finally, we apply the method of this paper with ten classical image fusion algorithms in two types of datasets. The visual effect and objective evaluation of the fusion results verify that the proposed method preserves the characteristics of the high contrast of IR images and improves the visibility of infrared scenes for subsequent target identification and detection.

Multi-Sensor Image Fusion Method for Defect Detection in Powder Bed Fusion.

Multi-sensor defect detection technology is a research hotspot for monitoring the powder bed fusion (PBF) processes, of which the quality of the captured defect images and the detection capability is the vital issue. Thus, in this study, we utilize visible information as well as infrared imaging to detect the defects in PBF parts that conventional optical inspection technologies cannot easily detect. A multi-source image acquisition system was designed to simultaneously acquire brightness intensity and infrared intensity. Then, a multi-sensor image fusion method based on finite discrete shearlet transform (FDST), multi-scale sequential toggle operator (MSSTO), and an improved pulse-coupled neural networks (PCNN) framework were proposed to fuse information in the visible and infrared spectra to detect defects in challenging conditions. The image fusion performance of the proposed method was evaluated with different indices and compared with other fusion algorithms. The experimental results show that the proposed method achieves satisfactory performance in terms of the averaged information entropy, average gradient, spatial frequency, standard deviation, peak signal-to-noise ratio, and structural similarity, which are 7.979, 0.0405, 29.836, 76.454, 20.078 and 0.748, respectively. Furthermore, the comparison experiments indicate that the proposed method can effectively improve image contrast and richness, enhance the display of image edge contour and texture information, and also retain and fuse the main information in the source image. The research provides a potential solution for defect information fusion and characterization analysis in multi-sensor detection systems in the PBF process.

CAW: A Remote-Sensing Scene Classification Network Aided by Local Window Attention.

Remote-sensing image scene data contain a large number of scene images with different scales. Traditional scene classification algorithms based on convolutional neural networks are difficult to extract complex spatial distribution and texture information in images, resulting in poor classification results. In response to the above problems, we introduce the vision transformer network structure with strong global modeling ability into the remote-sensing image scene classification task. In this paper, the parallel network structure of the local-window self-attention mechanism and the equivalent large convolution kernel is used to realize the spatial-channel modeling of the network so that the network has better local and global feature extraction performance. Experiments on the RSSCN7 dataset and the WHU-RS19 dataset show that the proposed network can improve the accuracy of scene classification. At the same time, the effectiveness of the network structure in remote-sensing image classification tasks is verified through ablation experiments, confusion matrix, and heat map results comparison.

A multimodal molecular image fusion method based on relative total variation and co‐saliency detection

Image fusion can integrate complementary information from multimodal molecular images to provide an informative single result image. In order to obtain a better fusion effect, this article proposes a novel method based on relative total variation and co-saliency detection (RTVCSD). First, only the gray-scale anatomical image is decomposed into a base layer and a texture layer according to the relative total variation; then, the three-channel color functional image is transformed into the luminance and chroma (YUV) color space, and the luminance component Y is directly fused with the base layer of the anatomical image by comparing the co-saliency information; next, the fused base layer is linearly combined with the texture layer, and the obtained fused result is combined with the chroma information U and V of the functional image. Finally, the fused image is obtained by transforming back to the red–green–blue color space. The dataset consists of magnetic resonance imaging (MRI)/positron emission tomography images, MRI/single photon emission computed tomography (SPECT) images, computed tomography/SPECT images, and green fluorescent protein/phase contrast images, each category with 20 image pairs. Experimental results demonstrate that the proposed method RTVCSD outperforms the nine comparison algorithms in terms of visual effects and objective evaluation. RTVCSD well preserves the texture information of the anatomical image and the metabolism or protein distribution information of the functional image.

GSGAN: Learning controllable geospatial images generation

Compared with natural images, geospatial images cover larger area and have more complex image contents. There are few algorithms for generating controllable geospatial images, and their results are of low quality. In response to this problem, this paper proposes Geospatial Style Generative Adversarial Network to generate controllable and high-quality geospatial images. Current conditional generators suffer the mode collapse problem in geospatial field. The problem is addressed via a modified mode seeking regularization term with contrastive learning theory. Besides, the discriminator network architecture is modified to process global feature information and texture information of geospatial images. Feature loss in the generator is introduced to stabilize the training process and improve generated image quality. Comprehensive experiments are conducted on UC Merced Land Use Dataset, NWPU-RESISC45 Dataset, and AID Dataset to evaluate all compared methods. Experiment results show our method outperforms state-of-the-art models. Our method not only generates high-quality and controllable geospatial images, but also enhances the discriminator to learn better representations.

An investigation of woven fabric density measurement using image analysis based on RTV-SFT

To overcome the shortcomings of time-consuming manual measurement methods of fabric density, a novel density measurement method of woven fabrics using image analysis technology via the relative total variation model based on the view of structure extraction from texture (RTV-SFT) is developed. Firstly, a fabric image acquisition system of multi-zoom portable digital microscope is constructed to obtain color dyed fabric images. Secondly, creatively from the perspective of analyzing periodic structure information of image texture information, a new structure extraction from texture algorithm, namely RTV-SFT is proposed to process fabric images to obtain images without non-periodic texture information aiming to achieve accurate yarn segmentation. Finally, the woven fabric density is calculated by effectively adopting the gray level projection method with the improved Gaussian filter algorithm. In the experiment, compared with manual method, the accuracy of the proposed density measurement method is above 93.3%.

Deep learning-based virtual noncalcium imaging in multiple myeloma using dual-energy CT.

Dual-energy CT with virtual noncalcium (VNCa) images allows the evaluation of focal intramedullary bone marrow involvement in patients with multiple myeloma. However, current commercial VNCa techniques suffer from excessive image noise and artifacts due to material decomposition used in synthesizing VNCa images. In this work, we aim to improve VNCa image quality for the assessment of focal multiple myeloma, using an Artificial intelligence based Generalizable Algorithm for mulTi-Energy CT (AGATE) method. AGATE method used a custom dual-task convolutional neural network (CNN) that concurrently carries out material classification and quantification. The material classification task provided an auxiliary regularization to the material quantification task. CNN parameters were optimized using custom loss functions that involved cross-entropy, physics-informed constraints, structural redundancy in spectral and material images, and texture information in spectral images. For training data, CT phantoms (diameters 30 to 45cm)withtissue-mimicking inserts were scanned on a third generation dual-source CT system. Scans were performed at routine dose and half of the routine dose. Small image patches (i.e., 40 × 40 pixels) of tissue-mimicking inserts with known basis material densities were extracted for training samples. Numerically simulated insert materials with various shapes increased diversity of training samples. Generalizability of AGATE was evaluated using CT images from phantoms and patients. In phantoms, material decomposition accuracy was estimated using mean-absolute-percent-error (MAPE), using physical inserts that were not used during the training. Noise power spectrum (NPS) and modulation transfer function (MTF) were compared across phantom sizes and radiation dose levels. Five patients with multiple myeloma underwent dual-energy CT, with VNCa images generated using a commercial method and AGATE. Two fellowship-trained musculoskeletal radiologists reviewed the VNCa images (commercial and AGATE) side-by-side using a dual-monitor display, blinded to VNCa type, rating the image quality for focal multiple myeloma lesion visualization using a 5-level Likert comparison scale (-2=worse visualization and diagnostic confidence, -1=worse visualization but equivalent diagnostic confidence, 0=equivalent visualization and diagnostic confidence, 1=improved visualization but equivalent diagnostic confidence, 2=improved visualization and diagnostic confidence). A post hoc assignment of comparison ratings was performed to rank AGATE images in comparison to commercial ones. AGATE demonstrated consistent material quantification accuracy across phantom sizes and radiation dose levels, with MAPE ranging from 0.7% to 4.4% across all testing materials. Compared to commercial VNCa images, the AGATE-synthesized VNCa images yielded considerably lower image noise (50-77% noise reduction) without compromising noise texture or spatial resolution across different phantom sizes and two radiation doses. AGATE VNCa images had markedly reduced area under NPS curves and maintained NPS peak frequency (0.7 lp/cm to 1.0 lp/cm), with similar MTF curves (50% MTF at 3.0 lp/cm). In patients, AGATE demonstrated reduced image noise and artifacts with improved delineation of focal multiple myeloma lesions (all readers comparison scores indicating improved overall diagnostic image quality [scores 1 or 2]). AGATE demonstrated reduced noise and artifacts in VNCa images and ability to improve visualization of bone marrow lesions for assessing multiple myeloma.

SAR Ship Image Speckle Noise Suppression Algorithm Based on Adaptive Bilateral Filter

Aiming at the shortcomings of traditional bilateral filtering in suppressing speckle noise in SAR ship images, especially strong speckle noise and loss of image edge details, it proposes an improved bilateral filtering algorithm based on fast adaptive threshold and variable window in this paper. The algorithm was used to suppress speckle noise in SAR ship images. The traditional bilateral filtering cannot effectively filter out the strong speckle noise, but the SAR image has strong speckle noise because of the defects of its imaging principle. To solve these problems, an image sample truncation method based on fast adaptive truncation statistical characteristics is designed to adjust the photometric similarity weight characteristics to realize the adaptive adjustment of spatial standard deviation and gray standard deviation. After the local reference window is modified and truncated according to the local characteristics of the image, the adjusted combined similarity weight value greatly reduces the impact of strong speckle noise on the image. It is smoothed into speckle signal with strong impulse noise. In the traditional bilateral filtering, in order to enhance the effect of smoothing noise, it is necessary to specify a large value of geometric diffusion factor and gray similarity diffusion factor, resulting in the loss of image details. Based on the variable window size filtering method, when the extended local reference window is in the case of nonuniform edge, its window can be enlarged to make the speckle noise stronger. When an extended window contains details such as edges and textures, its size is not expanded to maintain image detail. This method can further smooth the speckle noise in the uniform region while preserving the edge details of the image. Finally, the adaptive truncated sample is used as the input of the bilateral filter. The image sample truncation method based on fast adaptive threshold can effectively eliminate the strong speckle noise information that affects the photometric similarity and weight accuracy of the image. The method based on variable window can greatly enhance the smoothness of the edge area of the image. The experimental results show that improved adaptive bilateral filtering algorithm improves the speckle noise removal ability by 16.06% compared with the traditional bilateral filtering algorithm in the speckle noise suppression of the SAR ship image, and the preservation performance of the image edge after filtering is improved by 5.41%. Compared with the original image, the filtered image has a 1.2% improvement in structural similarity. The algorithm can effectively suppress speckle noise and has a good ability to retain edge and texture information of the SAR ship image, which has strong practicability.

A Cascade Defense Method for Multidomain Adversarial Attacks under Remote Sensing Detection

Deep neural networks have been widely used in detection tasks based on optical remote sensing images. However, in recent studies, deep neural networks have been shown to be vulnerable to adversarial examples. Adversarial examples are threatening in both the digital and physical domains. Specifically, they make it possible for adversarial examples to attack aerial remote sensing detection. To defend against adversarial attacks on aerial remote sensing detection, we propose a cascaded adversarial defense framework, which locates the adversarial patch according to its high frequency and saliency information in the gradient domain and removes it directly. The original image semantic and texture information is then restored by the image inpainting method. When combined with the random erasing algorithm, the robustness of detection is further improved. Our method is the first attempt to defend against adversarial examples in remote sensing detection. The experimental results show that our method is very effective in defending against real-world adversarial attacks. In particular, when using the YOLOv3 and YOLOv4 algorithms for robust detection of single-class targets, the AP60 of YOLOv3 and YOLOv4 only drop by 2.11% and 2.17%, respectively, under the adversarial example.

A decision fusion method based on hyperspectral imaging and electronic nose techniques for moisture content prediction in frozen-thawed pork

This paper studies the feasibility of combining hyperspectral imaging (HSI) and electronic nose (E-nose) techniques to improve the prediction performance of moisture content (MC) in frozen-thawed pork. In this experiment, the data of 240 pork samples under different freeze-thaw cycles (0–5 times) were collected using HSI and E-nose technology. Afterward, the spectra and image (color and texture) information were extracted from the HSI sensor, while the odor information was extracted from the E-nose sensor. In this setting, an improved decision fusion method was proposed to fuse this information, thus detecting the MC in pork. Based on single information and its fusion at different fusion levels (pixel, feature, traditional decision fusion, and improved decision fusion), partial least squares regression (PLSR) prediction models were established and compared. The results show that the model of improved decision fusion based on HSI and E-nose fusion technology exhibits the best prediction capability with the determination coefficient of prediction set (R2p) of 0.9533 and root mean square error of prediction set (RMSEP) of 0.3869. This study demonstrates that the proposed method is an effective data fusion method, and the combination of HSI and E-nose technology improves the prediction performance of MC in frozen-thawed pork.

CEFusion: Multi‐Modal medical image fusion via cross encoder

Most existing deep learning-based multi-modal medical image fusion (MMIF) methods utilize single-branch feature extraction strategies to achieve good fusion performance. However, for MMIF tasks, it is thought that this structure cuts off the internal connections between source images, resulting in information redundancy and degradation of fusion performance. To this end, this paper proposes a novel unsupervised network, termed CEFusion. Different from existing architecture, a cross-encoder is designed by exploiting the complementary properties between the original image to refine source features through feature interaction and reuse. Furthermore, to force the network to learn complementary information between source images and generate the fused image with high contrast and rich textures, a hybrid loss is proposed consisting of weighted fidelity and gradient losses. Specifically, the weighted fidelity loss can not only force the fusion results to approximate the source images but also effectively preserve the luminance information of the source image through weight estimation, while the gradient loss preserves the texture information of the source image. Experimental results demonstrate the superiority of the method over the state-of-the-art in terms of subjective visual effect and quantitative metrics in various datasets.

Texture Analysis of Enhanced MRI and Pathological Slides Predicts EGFR Mutation Status in Breast Cancer.

Objective Image texture information was extracted from enhanced magnetic resonance imaging (MRI) and pathological hematoxylin and eosin- (HE-) stained images of female breast cancer patients. We established models individually, and then, we combine the two kinds of data to establish model. Through this method, we verified whether sufficient information could be obtained from enhanced MRI and pathological slides to assist in the determination of epidermal growth factor receptor (EGFR) mutation status in patients. Methods We obtained enhanced MRI data from patients with breast cancer before treatment and selected diffusion-weighted imaging (DWI), T1 fast-spin echo (T1 FSE), and T2 fast-spin echo (T2 FSE) as the data sources for extracting texture information. Imaging physicians manually outlined the 3D regions of interest (ROIs) and extracted texture features according to the gray level cooccurrence matrix (GLCM) of the images. For the HE staining images of the patients, we adopted a specific normalization algorithm to simulate the images dyed with only hematoxylin or eosin and extracted textures. We extracted texture features to predict the expression of EGFR. After evaluating the predictive power of each model, the models from the two data sources were combined for remodeling. Results For enhanced MRI data, the modeling of texture information of T1 FSE had a good predictive effect for EGFR mutation status. For pathological images, eosin-stained images can achieve a better prediction effect. We selected these two classifiers as the weak classifiers of the final model and obtained good results (training group: AUC, 0.983; 95% CI, 0.95-1.00; accuracy, 0.962; specificity, 0.936; and sensitivity, 0.979; test group: AUC, 0.983; 95% CI, 0.94-1.00; accuracy, 0.943; specificity, 1.00; and sensitivity, 0.905). Conclusion The EGFR mutation status of patients with breast cancer can be well predicted based on enhanced MRI data and pathological data. This helps hospitals that do not test the EGFR mutation status of patients with breast cancer. The technology gives clinicians more information about breast cancer, which helps them make accurate diagnoses and select suitable treatments.

Integrating the Textural and Spectral Information of UAV Hyperspectral Images for the Improved Estimation of Rice Aboveground Biomass

The accurate and rapid estimation of the aboveground biomass (AGB) of rice is crucial to food security. Unmanned aerial vehicles (UAVs) mounted with hyperspectral sensors can obtain images of high spectral and spatial resolution in a quick and effective manner. Integrating UAV-based spatial and spectral information has substantial potential for improving crop AGB estimation. Hyperspectral remote-sensing data with more continuous reflectance information on ground objects provide more possibilities for band selection. The use of band selection for the spectral vegetation index (VI) has been discussed in many studies, but few studies have paid attention to the band selection of texture features in rice AGB estimation. In this study, UAV-based hyperspectral images of four rice varieties in five nitrogen treatments (N0, N1, N2, N3, and N4) were obtained. First, multiple spectral bands were used to identify the optimal bands of the spectral vegetation indices, as well as the texture features; next, the vegetation index model (VI model), the vegetation index combined with the corresponding-band textures model (VI+CBT model), and the vegetation index combined with the full-band textures model (VI+FBT model) were established to compare their respective rice AGB estimation abilities. The results showed that the optimal bands of the spectral and textural information for AGB monitoring were inconsistent. The red-edge and near-infrared bands demonstrated a strong correlation with the rice AGB in the spectral dimension, while the green and red bands exhibited a high correlation with the rice AGB in the spatial dimension. The ranking of the monitoring accuracies of the three models, from highest to lowest, was: the VI+FBT model, then the VI+CBT model, and then the VI model. Compared with the VI model, the R2 of the VI+FBT model and the VI+CBT model increased by 1.319% and 9.763%, respectively. The RMSE decreased by 2.070% and 16.718%, respectively, while the rRMSE decreased by 2.166% and 16.606%, respectively. The results indicated that the integration of vegetation indices and textures can significantly improve the accuracy of rice AGB estimation. The full-band textures contained richer information that was highly related to rice AGB. The VI model at the tillering stage presented the greatest sensitivity to the integration of textures, and the models in the N3 treatment (1.5 times the normal nitrogen level) gave the best AGB estimation compared with the other nitrogen treatments. This research proposes a reliable modeling framework for monitoring rice AGB and provides scientific support for rice-field management.

A Multi-Stage Visible and Infrared Image Fusion Network Based on Attention Mechanism.

Pixel-level image fusion is an effective way to fully exploit the rich texture information of visible images and the salient target characteristics of infrared images. With the development of deep learning technology in recent years, the image fusion algorithm based on this method has also achieved great success. However, owing to the lack of sufficient and reliable paired data and a nonexistent ideal fusion result as supervision, it is difficult to design a precise network training mode. Moreover, the manual fusion strategy has difficulty ensuring the full use of information, which easily causes redundancy and omittance. To solve the above problems, this paper proposes a multi-stage visible and infrared image fusion network based on an attention mechanism (MSFAM). Our method stabilizes the training process through multi-stage training and enhances features by the learning attention fusion block. To improve the network effect, we further design a Semantic Constraint module and Push–Pull loss function for the fusion task. Compared with several recently used methods, the qualitative comparison intuitively shows more beautiful and natural fusion results by our model with a stronger applicability. For quantitative experiments, MSFAM achieves the best results in three of the six frequently used metrics in fusion tasks, while other methods only obtain good scores on a single metric or a few metrics. Besides, a commonly used high-level semantic task, i.e., object detection, is used to prove its greater benefits for downstream tasks compared with single-light images and fusion results by existing methods. All these experiments prove the superiority and effectiveness of our algorithm.

Leaf image based plant disease identification using transfer learning and feature fusion

With the continuing changes in the structure of plant and cultivation patterns, new diseases are constantly appearing on the leaves of plant, exacerbating the threat to food security and agricultural production in many areas of the world. Thus, a rapid and accurate recognition of various diseases in plant will not only significantly reduce unnecessary planting costs, but also alleviate the economic losses and environmental pollution caused by incorrect disease diagnosis. Recent advances in deep learning have improved the performance in recognizing plant leaf diseases. In this paper, we present a general framework for recognizing plant diseases. Firstly, we propose a deep feature descriptor based on transfer learning to obtain a high-level latent feature representation. Then, we integrate the deep features with traditional handcrafted features by feature fusion to capture the local texture information in plant leaf images. In addition, centre loss is incorporated to further enhance the discriminative ability of the fused feature. The centre loss simultaneously minimizes intra-class distance and maximizes inter-class distance to learn both compact and separate features. Extensive experiments have been conducted on three publicly available datasets (two Apple Leaf datasets and one Coffee Leaf dataset) to validate the effectiveness of proposed method. The propose method achieves 99.79%, 92.59% and 97.12% classification accuracies on the three datasets, respectively. The experiment results demonstrate that the proposed method effectively captures the discriminative feature representation for distinguishing plant leaf diseases.

Animal Fur Recognition Algorithm Based on Feature Fusion Network

China is a big country in animal fur industry. The total production and consumption of fur are increasing year by year. However, the recognition of fur in the fur production process still mainly relies on the visual identification of skilled workers, and the stability and consistency of products cannot be guaranteed. In response to this problem, this paper proposes a feature fusion-based animal fur recognition network on the basis of typical convolutional neural network structure, relying on rapidly developing deep learning techniques. This network superimposes texture feature - the most prominent feature of fur image - into the channel dimension of input image. The output feature map of the first layer convolution is inverted to obtain the inverted feature map and concat it into the original output feature map, then Leaky ReLU is used for activation, which makes full use of the texture information of fur image and the inverted feature information. Experimental results show that the algorithm improves the recognition accuracy by 9.08% on Fur_Recognition dataset and 6.41% on CIFAR-10 dataset. The algorithm in this paper can change the current situation that fur recognition relies on manual visual method to classify, and can lay foundation for improving the efficiency of fur production technology.

Robust registration of SAR and optical images based on deep learning and improved Harris algorithm

Traditional algorithms can achieve good results when registering homologous images, but it cannot reach satisfying results for registration between synthetic aperture radar (SAR) and optical images. The difficulty is that the image texture information and structures of different modalities is very different which leads to poor registration results. To solve this problem, we present a robust matching framework for registration between SAR and optical images. First, a novel deep learning network is utilized to generate high quality pseudo-optical images from SAR images. Next, feature points are detected and extracted using the multi-scale Harris algorithm. Then the feature points are constructed through the gradient position orientation histogram method. Finally, the actual position of the feature points will be reconstructed through a feedback mechanism for matching. Experimental results demonstrate its superior matching performance with respect to the state-of-the-art methods.