Information Extraction Method Research Articles

Design and simulation of soft decision decoding based on chaotic M-ary spread spectrum system

In this paper, chaos sequence is used to replace the traditional spread spectrum sequence. From the perspective of the communication partner, a new method of generating the initial value of chaotic sequence is proposed, which is more suitable for the multi-base spread spectrum system and easy to extract. In order to further improve the error performance of the system and ensure the integrity of the system, an improved suboptimal soft information extraction method based on log-likelihood ratio (LLR) is proposed in the channel coding module, which can further improve the error performance of the system. On this basis, we choose the synchronization mode of multiple transmission of one reference signal to solve the problem that chaotic sequence is difficult to obtain synchronization because of its aperiodic characteristics. Finally, the system is simulated in the channel with low SNR. The simulation results show that chaotic sequence as spread spectrum code can make the signal transmit accurately in the worse channel environment. The performance gain of applying soft information decoding decision in the multibase spread spectrum system with chaotic sequence as spread spectrum code can reach 5.2 dB compared with the traditional direct spread spectrum system.

Implicit Modality Mining: An End-to-End Method for Multimodal Information Extraction

Multimodal named entity recognition (MNER) and relation extraction (MRE) are key in social media analysisbut face challenges like inefficient visual processing and non-optimal modality interaction. (1) Heavy visual embedding: the process of visual embedding is both time and computationally expensive due to the prerequisite extraction of explicit visual cues from the original image before input into the multimodal model. Consequently, these approaches cannot achieve efficient online reasoning; (2) suboptimal interaction handling: the prevalent method of managing interaction between different modalities typically relies on the alternation of self-attention and cross-attention mechanisms or excessive dependence on the gating mechanism. This explicit modeling method may fail to capture some nuanced relations between image and text, ultimately undermining the model’s capability to extract optimal information. To address these challenges, we introduce Implicit Modality Mining (IMM), a novel end-to-end framework for fine-grained image-text correlation without heavy visual embedders. IMM uses an Implicit Semantic Alignment module with a Transformer for cross-modal clues and an Insert-Activation module to effectively utilize these clues. Our approach achieves state-of-the-artperformance on three datasets.

Water Body Information Extraction from Remote Sensing Images based on PSPNet

Remote sensing image has the characteristics of real-time, periodicity and wide monitoring range. It can quickly and accurately obtain water area, distribution and other information, which is of great significance to the utilization and development of water resources, agricultural irrigation, flood disaster assessment and so on. Since traditional water information extraction methods only use part of image band information, the accuracy of water information extraction is low and has certain limitations. In recent years, convolutional neural network technology has developed rapidly and achieved good results in water information extraction from remote sensing images. Therefore, in this paper, Pyramid Scene Parsing Neural Network (PSPNet) was used to extract water information from Ziyuan-3 multispectral remote sensing images, to make sample sets of water, and train the convolutional neural network model. Compared with the traditional normalized difference water index (NDWI) and support vector machine (SVM), the results show that PSPNet has the highest accuracy and the lowest misclassification rate.

A robust feature wavelength extraction strategy for hyperspectral information:Three cases of potato quality evaluation

Because the existing feature wavelength extraction methods for hyperspectral information are only for some specific property of sample, which has some limitations, a feature wavelength extraction strategy with generalization and robustness is proposed. Namely, a part of the same or similar feature wavelengths are extracted by Wilks Λ statistic coupled with principal component analysis from hyperspectral information of different tested samples, and another part are extracted by partial least squares regression coefficient coupled with texture information. And then the two part of feature wavelengths can be integrated together to form the final feature wavelengths that represent the comprehensive properties of these tested samples. Take potato as the research object, and according to this feature wavelength extraction strategy, 8 feature wavelengths applicable to different potato samples were extracted, and three quality analysis cases were successfully implemented: the variety identification model, quality grade detection model and VC content prediction model. The results show that, based on the 8 feature wavelengths extracted by this strategy, the correction rate of the variety identification is 100 %; and the correction rate of the quality grading is above 92 %; and the R2P of the VC content prediction is 0.9715, which shows that the extracted feature wavelengths can effectively represent the different qualities of potato, and has robustness and generalization. This also provides a reference for the study of feature wavelength extraction methods of other agricultural products.

Text analysis framework for identifying mutations among non-small cell lung cancer patients from laboratory data

BackgroundLaboratory data can provide great value to support research aimed at reducing the incidence, prolonging survival and enhancing outcomes of cancer. Data is characterized by the information it carries and the format it holds. Data captured in Alberta’s biomarker laboratory repository is free text, cluttered and rouge. Such data format limits its utility and prohibits broader adoption and research development. Text analysis for information extraction of unstructured data can change this and lead to more complete analyses. Previous work on extracting relevant information from free text, unstructured data employed Natural Language Processing (NLP), Machine Learning (ML), rule-based Information Extraction (IE) methods, or a hybrid combination between them.MethodsIn our study, text analysis was performed on Alberta Precision Laboratories data which consisted of 95,854 entries from the Southern Alberta Dataset (SAD) and 6944 entries from the Northern Alberta Dataset (NAD). The data covers all of Alberta and is completely population-based. Our proposed framework is built around rule-based IE methods. It incorporates topics such as Syntax and Lexical analyses to achieve deterministic extraction of data from biomarker laboratory data (i.e., Epidermal Growth Factor Receptor (EGFR) test results). Lexical analysis compromises of data cleaning and pre-processing, Rich Text Format text conversion into readable plain text format, and normalization and tokenization of text. The framework then passes the text into the Syntax analysis stage which includes the rule-based method of extracting relevant data. Rule-based patterns of the test result are identified, and a Context Free Grammar then generates the rules of information extraction. Finally, the results are linked with the Alberta Cancer Registry to support real-world cancer research studies.ResultsOf the original 5512 entries in the SAD dataset and 5017 entries in the NAD dataset which were filtered for EGFR, the framework yielded 5129 and 3388 extracted EGFR test results from the SAD and NAD datasets, respectively. An accuracy of 97.5% was achieved on a random sample of 362 tests.ConclusionsWe presented a text analysis framework to extract specific information from unstructured clinical data. Our proposed framework has shown that it can successfully extract relevant information from EGFR test results.

Network_Protocol_Entity_Extraction_Based_on_Few_shot_Learning

Knowledge Graph is a new way of knowledge collections, and building a protocol knowledge graph on RFCs can help us study and analyse network protocol better. Protocol entity extraction is one of the keys to constructing the network protocol knowledge graph.Because RFC (Request For Comments) contains detailed descriptions of basic Internet communication protocols, the protocol entities of the network can be obtained from it. However, the document format and wording are not uniform, which leads to the inability to complete the extraction task of network protocol entities based on traditional rule information extraction methods. Therefore, this paper proposes a network protocol entity extraction method based on Few-Shot Learning. This method can use a very small amount of labeled samples to extract network protocol entities from a large number of unlabeled samples and maintain high recognition accuracy. This method firstly mines as many potential network protocol entities as possible in the RFC document, and secondly performs accurate re-identification of the identified potential network protocol entities. Experiments show that using 5 manually annotated RFC documents to train our model, the accuracy of network protocol entity extraction reaches 88.4%. Compared with the existing methods, this method has higher accuracy and better robustness in terms of network protocol entity extraction, and it also has better identification ability for network protocol entities that have not appeared in the training set.

MSIE-Net: Associative Entity-Based Multi-Stage Network for Structured Information Extraction from Reports

Efficient document recognition and sharing remain challenges in the healthcare, insurance, and finance sectors. One solution to this problem has been the use of deep learning techniques to automatically extract structured information from paper documents. Specifically, the structured extraction of a medical examination report (MER) can enhance medical efficiency, data analysis, and scientific research. While current methods focus on reconstructing table bodies, they often overlook table headers, leading to incomplete information extraction. This paper proposes MSIE-Net (multi-stage-structured information extraction network), a novel structured information extraction method, leveraging refined attention transformers and associated entity detection to enhance comprehensive MER information retrieval. MSIE-Net includes three stages. First, the RVI-LayoutXLM (refined visual-feature independent LayoutXLM) targets key information extraction. In this stage, the refined attention accentuates the interaction between different modalities by adjusting the attention score at the current position using previous position information. This design enables the RVI-LayoutXLM to learn more specific contextual information to improve extraction performance. Next, the associated entity detection module, RIFD-Net (relevant intra-layer fine-tuned detection network), identifies each test item’s location within the MER table body. Significantly, the backbone of RIFD-Net incorporates the intra-layer feature adjustment module (IFAM) to extract global features while homing in on local areas, proving especially sensitive for inspection tasks with dense and long bins. Finally, structured post-processing based on coordinate aggregation links the outputs from the prior stages. For the evaluation, we constructed the Chinese medical examination report dataset (CMERD), based on real medical scenarios. MSIE-Net demonstrated competitive performance in tasks involving key information extraction and associated entity detection. Experimental results validate MSIE-Net’s capability to successfully detect key entities in MER and table images with various complex layouts, perform entity relation extraction, and generate structured labels, laying the groundwork for intelligent medical documentation.

Multi-modality trajectory prediction with the dynamic spatial interaction among vehicles under connected vehicle environment

Compared to non-connected vehicle environments, the connected vehicle environment establishes vehicle interconnection through communication technologies, resulting in more complex interaction, network topologies, and large-scale inputs. This complexity renders traditional trajectory prediction models, which rely primarily on inputting historical information of the target vehicle, inadequate for handling the complex and dynamic interactive lane-changing scenarios in connected vehicle environments. In a connected vehicle environment, it is necessary to propose a more targeted and stable lane-changing behavior prediction method based on vehicle traveling characteristics. Taking into account dynamic spatial interaction among vehicles, this study proposes a multi-modality trajectory prediction model called STA-LSTM to perform analysis on the potential interactive behaviors among vehicles under connected vehicle lane-changing scenarios, and specifically to expand the multi-modality feature input of the vehicle trajectory prediction model. The spatial grid occupancy method is used to model the interactions between vehicles. A space-dimensional attention mechanism is introduced to adaptively match the influencing weights of the surrounding vehicles with the target vehicle and to improve the interactive information extraction method. In addition, the attention module is incorporated into the LSTM decoder from the time dimension so that the established model can identify significant historical hidden features during each trajectory decoding process. To account for the uncertainty of trajectory prediction, the vectors of vehicle interactions are incorporated into contextual information to improve the reliability of prediction results and the robustness of the established model. Compared with conventional baseline models, the proposed model exhibited lower root mean square error (RMSE) and negative log-likelihood (NLL) values, and the RMSE values at different prediction times of 1s, 2s, 3s, 4s, and 5s are 0.46m, 1.15m, 1.89m, 2.84m, and 4.05m, respectively. This indicates that the proposed model can accurately predict the interactions between vehicles and the travel paths of surrounding target vehicles.

Advancements in Document QnA: A Comprehensive Survey

Abstract: The increasing demand for effective document information extraction methods has underscored the necessity of addressing challenges related to semi-structured tables and diverse content formats. This survey extensively explores the intricate task of extracting information from documents with a particular emphasis on the challenges associated with precise Key Information Extraction (KIE) and their broader implications for enhancing document understanding efficiency. The survey delves into recent breakthroughs in this domain, with a special focus on notable approaches such as BROS, BloombergGPT, and the innovative Document Understanding Transformer (DonUT). Additionally, it provides a comprehensive analysis of various studies in Key Information Extraction (KIE) and Visual Document Understanding (VDU), elucidating the strengths and weaknesses of these endeavors. It also provides justification for highlighting DonUT lies in its unique OCR-free VDU model architecture based on Transformers, incorporating a pre-training objective that utilizes cross-entropy loss. The survey not only addresses current challenges but also illuminates promising avenues for advancing document text extraction techniques.

Information Extraction and Three-Dimensional Contour Reconstruction of Vehicle Target Based on Multiple Different Pitch-Angle Observation Circular Synthetic Aperture Radar Data

The circular synthetic aperture radar (CSAR) has the ability of all-round continuous observation and high-resolution imaging detection, and can obtain all-round scattering information and higher-resolution images of the observation scene, so as to realize the target information extraction and three-dimensional (3D) contour reconstruction of the observation targets. However, the existing methods are not accurate enough to extract the information of vehicle targets. Through the analysis of the vehicle target scattering model and CSAR image characteristics, this paper proposes a vehicle target information extraction and 3D contour reconstruction method based on multiple different pitch-angle observation CSAR data. The proposed method creatively utilizes the projection relationship of the vehicle in 2D CSAR imaging to reconstruct the 3D contour of the vehicle, without prior information. Firstly, the CSAR data obtained from multiple different pitch-angle observations are fully utilized, and the scattering points of odd-bounce reflection and even-bounce reflection echoes are extracted from the two-dimensional (2D) coherent CSAR images of the vehicle target. Secondly, the basic contour of the vehicle body is extracted from the scattering points of the even-bounce reflected echoes. Then, the geometric projection relationship of the “top–bottom shifting” effect of odd-bounce reflection is used to calculate the height and position information of the scattering points of odd-bounce reflection, so as to extract the multi-layer 3D contour of the vehicle target. Finally, the basic contour and the multi-layer 3D contour of the vehicle are fused to realize high-precision 3D contour reconstruction of the vehicle target. The correctness and effectiveness of the proposed method are verified by using the CVDomes simulation dataset of the American Air Force Research Laboratory (AFRL), and the experimental results show that the proposed method can achieve high-precision information extraction and realize distinct 3D contour reconstruction of the vehicle target.

Digital Signal Compensation and Sounding Depth Analysis of Portable Frequency-Domain Electromagnetic Exploration System.

Low-resistivity objects produce eddy currents when excited with electromagnetic waves of a certain frequency and then generate an eddy electromagnetic field. A portable frequency-domain electromagnetic exploration system can be used to identify this eddy electromagnetic field, and then the low-resistivity objects can be positioned. At present, portable frequency-domain electromagnetic method (FEM) exploration systems use analog signal compensation, and the sounding depth is generally calculated using empirical formulas. In order to improve the rationality of signal compensation, this paper puts forward a digital signal compensation technology, including a device design, an information extraction method, and a primary field calibration method, and makes an exploration prototype based on the digital signal compensation technology. Using 10 nV as the minimum potential detection capability, the sounding depth of the portable FEM was analyzed, and it was found that when investigating a target with the same depth, a lower frequency required a larger emission current. If this could not be met, the sounding depth became smaller, and a phenomenon appeared in which the lower the operating frequency, the smaller the sounding depth. Through the detection of known underground garages, the apparent conductivity and normalized secondary field anomalies with higher sensitivity were obtained, which indicates that the detection system based on the digital signal compensation technology is effective in practical exploration. Via long-distance detection experiments on cars, it was confirmed that the sounding depth of the portable multi-frequency FEM in practical work indeed decreases with a decrease in the operating frequency.

Extraction of Tobacco Planting Information Based on UAV High-Resolution Remote Sensing Images

Tobacco is a critical cash crop in China, so its growing status has received more and more attention. How to acquire accurate plant area, row spacing, and plant spacing at the same time have been key points for its grow status monitoring and yield prediction. However, accurately detecting small and densely arranged tobacco plants during the rosette stage poses a significant challenge. In Sichuan Province, the contours of scattered tobacco fields with different shapes are not well-extracted. Additionally, there is a lack of simultaneous methods for extracting crucial tobacco planting information, including area, row spacing, and plant spacing. In view of the above scientific problems, we proposed a method to extract the planting information of tobacco at the rosette stage with Unmanned Aerial Vehicle (UAV) remote sensing images. A detection model, YOLOv8s-EFF, was constructed for the small and weak tobacco in the rosette stage. We proposed an extraction algorithm for tobacco field area based on extended contours for different-shaped fields. Meanwhile, a planting distance extraction algorithm based on tobacco coordinates was presented. Further, four experimental areas were selected in Sichuan Province, and image processing and sample label production were carried out. Four isolated tobacco fields with different shapes in four experimental areas were used to preliminarily verify the effectiveness of the model and algorithm proposed. The results show that the precision ranges of tobacco field area, row spacing, and plant spacing were 96.51~99.04%, 90.08~99.74%, and 94.69~99.15%, respectively. And another two experimental areas, Jiange County, Guangyuan, and Dazhai County, Gulin County, and Luzhou, were selected to evaluate the accuracy of the method proposed in the research in practical application. The results indicate that the average accuracy of tobacco field area, row spacing, and plant spacing extracted by this method reached 97.99%, 97.98%, and 98.31%, respectively, which proved the extraction method of plant information is valuable.

A Geoscience-Aware Network (GASlumNet) Combining UNet and ConvNeXt for Slum Mapping

Approximately 1 billion people worldwide currently inhabit slum areas. The UN Sustainable Development Goal (SDG 11.1) underscores the imperative of upgrading all slums by 2030 to ensure adequate housing for everyone. Geo-locations of slums help local governments with upgrading slums and alleviating urban poverty. Remote sensing (RS) technology, with its excellent Earth observation capabilities, can play an important role in slum mapping. Deep learning (DL)-based RS information extraction methods have attracted a lot of attention. Currently, DL-based slum mapping studies typically uses three optical bands to adapt to existing models, neglecting essential geo-scientific information, such as spectral and textural characteristics, which are beneficial for slum mapping. Inspired by the geoscience-aware DL paradigm, we propose the Geoscience-Aware Network for slum mapping (GASlumNet), aiming to improve slum mapping accuracies via incorporating the DL model with geoscientific prior knowledge. GASlumNet employs a two-stream architecture, combining ConvNeXt and UNet. One stream concentrates on optical feature representation, while the other emphasizes geo-scientific features. Further, the feature-level and decision-level fusion mechanisms are applied to optimize deep features and enhance model performance. We used Jilin-1 Spectrum 01 and Sentinel-2 images to perform experiments in Mumbai, India. The results demonstrate that GASlumNet achieves higher slum mapping accuracy than the comparison models, with an intersection over union (IoU) of 58.41%. Specifically, GASlumNet improves the IoU by 4.60~5.97% over the baseline models, i.e., UNet and ConvNeXt-UNet, which exclusively utilize optical bands. Furthermore, GASlumNet enhances the IoU by 10.97% compared to FuseNet, a model that combines optical bands and geo-scientific features. Our method presents a new technical solution to achieve accurate slum mapping, offering potential benefits for regional and global slum mapping and upgrading initiatives.

Three-dimensional reconstruction optimization of tunnel face and intelligent extraction of discontinuity orientation based on binocular stereo vision

In the process of grading and dynamically optimizing the design and construction parameters of the surrounding rock mass of a rock tunnel face, efficiently and accurately acquiring the geometrical parameters of the rock discontinuities is an important basic task. To address the problems of time consuming, low accuracy, and high danger associated with traditional methods of obtaining the structural information of rock mass, this paper proposes a method for three-dimensional reconstruction and intelligent information extraction of tunnel face based on binocular stereo vision (BSV). First, the parallel binocular device with a single camera was improved, calibrated using the checkerboard calibration method. By integrating with the semi-global matching algorithm, the BSV based method for the three-dimensional reconstruction of the rock mass of the tunnel face was optimized. Furthermore, based on the results from on-site engineering applications, this study leveraged two parameters, point cloud density and algorithm runtime, to determine the optimal values for the disparity range and window size parameters within the semi-global stereo matching algorithm. This enhancement improved the performance of the 3D reconstruction method based on binocular stereo vision. Finally, efficient and refined intelligent methods for extracting structural parameters of the rock mass were proposed based on k-nearest neighbor search and kernel density estimation. The research results can provide reliable technical support for the intelligent and efficient acquisition of rock mass structural information in rock tunnel engineering faces.

A Hybrid Model for Long-Term Wind Power Forecasting Utilizing NWP Subsequence Correction and Multi-Scale Deep Learning Regression Methods

The accuracy of long-term wind power forecasting (WPF) is crucial for the efficient operation of grid systems. However, wind power generation is highly stochastic and intermittent due to the influence of weather, which makes long-term WPF less effective. Numerical weather prediction (NWP) data contains valuable weather forecast information, which can mitigate the negative effects of stochastic weather fluctuations on WPF. However, the accuracy of NWP data decreases over time, and multiple NWP data can have redundancy and errors that make it challenging to extract valid information. Reducing the variety and errors in NWP data and using more effective information extraction methods are essential for improving long-term WPF performance. In this article, we propose a novel long-term WPF hybrid model that corrects NWP wind speed and uses multi-scale deep learning regression prediction to exclude excessive NWP data. We use only the corrected NWP wind speed data to establish a nonlinear mapping relationship with actual power data. The validation case study shows that our proposed model reduces the mean squared error (MSE) and mean absolute error (MAE) by 65.0% and 43.8%, respectively, compared to the current state-of-the-art time series forecasting model in a seven-day forecasting scenario.

TaeC: A manually annotated text dataset for trait and phenotype extraction and entity linking in wheat breeding literature.

Wheat varieties show a large diversity of traits and phenotypes. Linking them to genetic variability is essential for shorter and more efficient wheat breeding programs. A growing number of plant molecular information networks provide interlinked interoperable data to support the discovery of gene-phenotype interactions. A large body of scientific literature and observational data obtained in-field and under controlled conditions document wheat breeding experiments. The cross-referencing of this complementary information is essential. Text from databases and scientific publications has been identified early on as a relevant source of information. However, the wide variety of terms used to refer to traits and phenotype values makes it difficult to find and cross-reference the textual information, e.g. simple dictionary lookup methods miss relevant terms. Corpora with manually annotated examples are thus needed to evaluate and train textual information extraction methods. While several corpora contain annotations of human and animal phenotypes, no corpus is available for plant traits. This hinders the evaluation of text mining-based crop knowledge graphs (e.g. AgroLD, KnetMiner, WheatIS-FAIDARE) and limits the ability to train machine learning methods and improve the quality of information. The Triticum aestivum trait Corpus is a new gold standard for traits and phenotypes of wheat. It consists of 528 PubMed references that are fully annotated by trait, phenotype, and species. We address the interoperability challenge of crossing sparse assay data and publications by using the Wheat Trait and Phenotype Ontology to normalize trait mentions and the species taxonomy of the National Center for Biotechnology Information to normalize species. The paper describes the construction of the corpus. A study of the performance of state-of-the-art language models for both named entity recognition and linking tasks trained on the corpus shows that it is suitable for training and evaluation. This corpus is currently the most comprehensive manually annotated corpus for natural language processing studies on crop phenotype information from the literature.

Enterprise hidden financial information extraction method based on data source dependency

Enterprise hidden financial information extraction method based on data source dependency

An Information Extraction Method for Industrial and Commercial Rooftop Photovoltaics Based on GaoFen-7 Remote Sensing Images

With the increasing global focus on renewable energy, distributed rooftop photovoltaics (PVs) are gradually becoming an important form of energy generation. Effective monitoring of rooftop PV information can obtain their spatial distribution and installed capacity, which is the basis used by management departments to formulate regulatory policies. Due to the time-consuming and labor-intensive problems involved in manual monitoring, remote-sensing-based monitoring methods are getting more attention. Currently, remote-sensing-based distributed rooftop PV monitoring methods are mainly used as household rooftop PVs, and most of them use aerial or satellite images with a resolution higher than 0.3 m; there is no research on industrial and commercial rooftop PVs. This study focuses on the distributed industrial and commercial rooftop PV information extraction method based on the Gaofen-7 satellite with a resolution of 0.65 m. First, the distributed industrial and commercial rooftop PV dataset based on Gaofen-7 satellite and the optimized public PV datasets were constructed. Second, an advanced MANet model was proposed. Compared to MANet, the proposed model removed the downsample operation in the first stage of the encoder and added an auxiliary branch containing the Atrous Spatial Pyramid Pooling (ASPP) module in the decoder. Comparative experiments were conducted between the advanced MANet and state-of-the-art semantic segmentation models. In the Gaofen-7 satellite PV dataset, the Intersection over Union (IoU) of the advanced MANet in the test set was improved by 13.5%, 8.96%, 2.67%, 0.63%, and 0.75% over Deeplabv3+, U2net-lite, U2net-full, Unet, and MANet. In order to further verify the performance of the proposed model, experiments were conducted on optimized public PV datasets. The IoU was improved by 3.18%, 3.78%, 3.29%, 4.98%, and 0.42%, demonstrating that it outperformed the other models.

Supervised Manifold Learning Based on Multi-Feature Information Discriminative Fusion within an Adaptive Nearest Neighbor Strategy Applied to Rolling Bearing Fault Diagnosis.

Rolling bearings are a key component for ensuring the safe and smooth operation of rotating machinery and are very prone to failure. Therefore, intelligent fault diagnosis research on rolling bearings has become a crucial task in the field of mechanical fault diagnosis. This paper proposes research on the fault diagnosis of rolling bearings based on an adaptive nearest neighbor strategy and the discriminative fusion of multi-feature information using supervised manifold learning (AN-MFIDFS-Isomap). Firstly, an adaptive nearest neighbor strategy is proposed using the Euclidean distance and cosine similarity to optimize the selection of neighboring points. Secondly, three feature space transformation and feature information extraction methods are proposed, among which an innovative exponential linear kernel function is introduced to provide new feature information descriptions for the data, enhancing feature sensitivity. Finally, under the adaptive nearest neighbor strategy, a novel AN-MFIDFS-Isomap algorithm is proposed for rolling bearing fault diagnosis by fusing various feature information and classifiers through discriminative fusion with label information. The proposed AN-MFIDFS-Isomap algorithm is validated on the CWRU open dataset and our experimental dataset. The experiments show that the proposed method outperforms other traditional manifold learning methods in terms of data clustering and fault diagnosis.

SEMANTIC KNOWLEDGE EMBEDDING DEEP LEARNING NETWORK FOR LAND COVER CLASSIFICATION

Abstract. Land cover classification is essential basic information and key parameters for environmental change research, geographical and national monitoring, and sustainable development planning. Deep learning can automatically and multi-level extract the features of complex features, which has been proven to be an effective method for information extraction. However, one of the major challenges of deep learning is its poor interpret-ability, which makes it difficult to understand and explain the reasoning behind its classification results. This paper proposes a deep cross-modal coupling model (CMCM) for integrating semantic features and visual features. The representation of knowledge map is indicatively introduced into remote sensing image classification. Compared to previous studies, the proposed method provides accurate descriptions of the complex semantic objects within a complex land cover environment. The results showed that the integration of semantic knowledge improved the accuracy and interpret-ability of land cover classification.