Information Extraction Approach Research Articles

STAR: Boosting Low-Resource Information Extraction by Structure-to-Text Data Generation with Large Language Models

Information extraction tasks such as event extraction require an in-depth understanding of the output structure and sub-task dependencies. They heavily rely on task-specific training data in the form of (passage, target structure) pairs to obtain reasonable performance. However, obtaining such data through human annotation is costly, leading to a pressing need for low-resource information extraction approaches that require minimal human labeling for real-world applications. Fine-tuning supervised models with synthesized training data would be a generalizable method, but the existing data generation methods either still rely on large-scale ground-truth data or cannot be applied to complicated IE tasks due to their poor performance. To address these challenges, we propose STAR, a data generation method that leverages Large Language Models (LLMs) to synthesize data instances given limited seed demonstrations, thereby boosting low-resource information extraction performance. Our approach involves generating target structures (Y) followed by generating passages (X), all accomplished with the aid of LLMs. We design fine-grained step-by-step instructions to obtain the initial data instances. We further reduce errors and improve data quality through self-reflection error identification and self-refinement with iterative revision. Our experiments show that the data generated by STAR significantly improve the performance of low-resource event extraction and relation extraction tasks, even surpassing the effectiveness of human-curated data. Human assessment of the data quality shows STAR-generated data exhibit higher passage quality and better align with the task definitions compared with the human-curated data.

A deep learning approach for robust traffic accident information extraction from online chinese news

AbstractRoad traffic accidents are the leading causes of injuries and fatalities. Understanding the traffic accident occurrence pattern and its contributing factors are prerequisites for effective traffic safety management. The paper proposes a deep learning approach for traffic accident recognition and information extraction from online Chinese news to extract and organize traffic accidents automatically. The approach consists of three modules, including automated news collection, news classification, and traffic accident information extraction. The automated news collection module crawls news from online sources, cleans and organizes it into a general news database with different categories of news. The news classification module robustly recognizes the traffic accident news from all types of news by fusing the sentence‐wise and context‐wise semantic news information. The accident information extraction module extracts the key attributes of traffic accidents (e.g. causes, times, locations) from news text using the SoftLexicon‐BiLSTM‐CRF method. The proposed approach is validated by comparing it with state‐of‐the‐art text mining methods using Chinese news data crawled online. The results show that the approach can achieve a high information extraction performance in terms of precision, recall, and F1‐score. It improves the performance of the best benchmark model (BiLSTM‐CRF) by 18.8% in precision and 12.08% in F1‐score. In addition, the potential value of the automatically extracted accident data is illustrated from online news in complementing traditional authority accident data to drive more effective traffic safety management in practice.

MSFANet: multi-scale fusion attention network for mangrove remote sensing lmage segmentation using pattern recognition

Mangroves are ecosystems that grow in the intertidal areas of coastal zones, playing crucial ecological roles and possessing unique economic and social values. They have garnered significant attention and research interest. Semantic segmentation of mangroves is a fundamental step for further investigations. However, mangrove remote sensing images often have large dimensions, with a substantial portion of the image containing mangrove features. Deep learning convolutional kernels may lead to inadequate receptive fields for accurate mangrove recognition. In mangrove remote sensing images, various challenges arise, including the presence of small and intricate details aside from the mangrove regions, which intensify the segmentation complexity. To address these issues, this paper primarily focuses on two key aspects: first, the exploration of methods to achieve a large receptive field, and second, the fusion of multi-scale information. To this end, we propose the Multi-Scale Fusion Attention Network (MSFANet), which incorporates a multi-scale network structure with a large receptive field for feature fusion. We emphasize preserving spatial information by integrating spatial data across different scales, employing separable convolutions to reduce computational complexity. Additionally, we introduce an Attention Fusion Module (AFM). This module helps mitigate the influence of irrelevant information and enhances segmentation quality. To retain more semantic information, this paper introduces a dual channel approach for information extraction through the deep structure of ResNet. We fuse features using the Feature Fusion Module (FFM) to combine both semantic and spatial information for the final output, further enhancing segmentation accuracy. In this study, a total of 230 images with dimensions of 768 pixels in width and height were selected for this experiment, with 184 images used for training and 46 images for validation. Experimental results demonstrate that our proposed method achieves excellent segmentation results on a small sample dataset of remote-sensing images, with significant practical value. This paper primarily focuses on three key aspects: the generation of mangrove datasets, the preprocessing of mangrove data, and the design and training of models. The primary contribution of this paper lies in the development of an effective approach for multi-scale information fusion and advanced feature preservation, providing a novel solution for mangrove remote sensing image segmentation tasks. The best Mean Intersection over Union (MIoU) achieved on the mangrove dataset is 86%, surpassing other existing models by a significant margin.

Estimation of Wheat Crop Production using Multispectral Information Fusion.

The present work estimates the area and the corresponding produce of wheat crop in the study area, which comprises Etah region of Uttar Pradesh, India. For this purpose, multispectral images of multiple sensors, viz., Sentinel-2, Landsat-8, and Landsat-9 during the preharvesting period, i.e., March for the years 2021 and 2022 are used. A multispectral information fusion approach has been proposed which involves image classification as well as vegetation index-based information extraction. For imposing the information fusion, appropriate image bands are identified with the help of separability analysis followed by land cover classification for wheat crop class extraction. Support Vector Machine (SVM), Artificial Neural Network (ANN) and Maximum Likelihood (ML) are used for classification whereas Normalized Difference Vegetation Index (NDVI) and Fractional Vegetation Cover (FVC) are used for index-based crop area extraction. The maximum accuracy of 98.34% is achieved for Sentinel-2 data using ANN whereas minimum accuracy of 80.21% is achieved for Landsat-9 using ML classifier. The estimated area for Sentinel-2 data for the year 2021 is 260540 hectares using ANN and 203240 hectares using ML which is near to the reference data, i.e., 238600 hectares. SVM also shows good performance and calculates least error in estimated crop area for the year 2022 on Sentinel-2 data. It calculates 8408490 tons of wheat for the same year. The proposed method utilizes a single image per year for extraction of information supported by the ground truth data which makes it a novel approach of information extraction for crop produce monitoring. This article is protected by copyright. All rights reserved.

Reliability Evaluation Based on the Colored Petri Net Converted from AADL Models for the Wheel Brake System of Aircraft

Traditional reliability analysis methods such as Reliability Block Diagram, Fault Tree Analysis, and Markov Analysis are all subjective methods whose results significantly depend on the analysts’ skills and experiences. A model-based reliability method is proposed for the wheel brake system by using the architectural analysis and design language (AADL). The wheel brake system is modeled based on the AADL, and the AADL Error Model Annex is applied to describe the fault propagation of the system. An information extraction approach is proposed for the AADL-based model, and rules for transforming AADL-based models to colored Petri nets are given according to the information extracted. The reliability analysis of the wheel brake system is conducted in terms of the Colored Petri Nets. Through Monte Carlo simulation and linear regression, it is inferred that the lifetime of the wheel brake system follows a Weibull distribution with shape parameter 1.303 and scale parameter 9.992 × 103, and the accuracy of the method has been verified. In this study, the reliability analysis results are generated via the system model automatically; they do not depend on the analysts’ experiences and skills, and ambiguity among different analysts can be avoided.

FVI-BD: Multiple File Extraction using Fusion Vector Investigation (FVI) in Big Data Hadoop Environment

— The Information Extraction (IE) approach extracts useful data from unstructured and semi-structured data. Big Data, with its rising volume of multidimensional unstructured data, provides new tools for IE. Traditional Information Extraction (IE) systems are incapable of appropriately handling this massive flood of unstructured data. The processing capability of current IE systems must be enhanced because to the amount and variety of Big Data. Existing IE techniques for data preparation, extraction, and transformation, as well as representations of massive amounts of multidimensional, unstructured data, must be evaluated in terms of their capabilities and limits. The proposed FVI-BD Framework for IOT device Information Extraction in Big Data. The unstructured data has cleaned and integration using POS tagging and similarity finding using LTA method. The features are extracted using TF and IDF. The Information extracted using NLP with WordNet. The classification has done with FVI algorithm. This research paper discovered that vast data analytics may be enhanced by extracting document feature terms with synonymous similarity and increasing IE accuracy.

Toward alert triage: scalable qualitative coding framework for analyzing alert notes from the Telehealth Intervention Program for Seniors (TIPS).

Combined with mobile monitoring devices, telehealth generates overwhelming data, which could cause clinician burnout and overlooking critical patient status. Developing novel and efficient ways to correctly triage such data will be critical to a successful telehealth adoption. We aim to develop an automated classification framework of existing nurses' notes for each alert that will serve as a training dataset for a future alert triage system for telehealth programs. We analyzed and developed a coding framework and a regular expression-based keyword match approach based on the information of 24 931 alert notes from a community-based telehealth program. We evaluated our automated alert triaging model for its scalability on a stratified sampling of 800 alert notes for precision and recall analysis. We found 22 717 out of 24 579 alert notes (92%) belonging to at least one of the 17 codes. The evaluation of the automated alert note analysis using the regular expression-based information extraction approach resulted in an average precision of 0.86 (SD = 0.13) and recall 0.90 (SD = 0.13). The high-performance results show the feasibility and the scalability potential of this approach in community-based, low-income older adult telehealth settings. The resulting coded alert notes can be combined with participants' health monitoring results to generate predictive models and to triage false alerts. The findings build steps toward developing an automated alert triaging model to improve the identification of alert types in remote health monitoring and telehealth systems.

Lane Information Extraction for High Definition Maps Using Crowdsourced Data

Lane information plays an important role in high-definition (HD) maps because it provides invaluable road information for autonomous vehicles. The most widely used lane extraction method for HD maps is based on mobile mapping systems, and it is prohibitively costly and time-consuming. In this study, we propose a novel approach for lane information extraction based on crowdsourcing vehicles equipped with monocular cameras and global navigation satellite system devices for recording road images and position data. First, we propose a lane mask propagation network to detect the lane markings in images, which are then projected from a perspective space into a three-dimensional space in accordance with the position data. Second, we propose a data management method to store lane information in the cloud data center. An improved density-based spatial clustering of applications with noise clustering algorithm and a gradual fitting algorithm are used to remove the outliers and improve the lane data accuracy. The proposed method is quantitatively evaluated against a real-world HD map produced by a mobile mapping vehicle. The experimental results show that more than 80% of the extracted lane markings meet the accuracy requirements of HD maps. In conclusion, our method can be used as a low-cost and efficient approach for updating the lane information in HD maps for autonomous vehicles.

Review of Natural Language Processing in Pharmacology.

Natural language processing (NLP) is an area of artificial intelligence that applies information technologies to process the human language, understand it to a certain degree, and use it in various applications. This area has rapidly developed in the past few years and now employs modern variants of deep neural networks to extract relevant patterns from large text corpora. The main objective of this work is to survey the recent use of NLP in the field of pharmacology. As our work shows, NLP is a highly relevant information extraction and processing approach for pharmacology. It has been used extensively, from intelligent searches through thousands of medical documents to finding traces of adversarial drug interactions in social media. We split our coverage into five categories to survey modern NLP: methodology, commonly addressed tasks, relevant textual data, knowledge bases, and useful programming libraries. We split each of the five categories into appropriate subcategories, describe their main properties and ideas, and summarize them in a tabular form. The resulting survey presents a comprehensive overview of the area, useful to practitioners and interested observers. SIGNIFICANCE STATEMENT: The main objective of this work is to survey the recent use of NLP in the field of pharmacology in order to provide a comprehensive overview of the current state in the area after the rapid developments that occurred in the past few years. The resulting survey will be useful to practitioners and interested observers in the domain.

A Canonical Context-Preserving Representation for Open IE: Extracting Semantically Typed Relational Tuples from Complex Sentences

Modern systems that deal with inference in texts need automatized methods to extract meaning representations (MRs) from texts at scale. Open Information Extraction (IE) is a prominent way of extracting all potential relations from a given text in a comprehensive manner. Previous work in this area has mainly focused on the extraction of isolated relational tuples. Ignoring the cohesive nature of texts where important contextual information is spread across clauses or sentences, state-of-the-art Open IE approaches are thus prone to generating a loose arrangement of tuples that lack the expressiveness needed to infer the true meaning of complex assertions.To overcome this limitation, we present a method that allows existing Open IE systems to enrich their output with additional meta information. By leveraging the semantic hierarchy of minimal propositions generated by the discourse-aware Text Simplification (TS) approach presented in Niklaus et al. (2019), we propose a mechanism to extract semantically typed relational tuples from complex source sentences. Based on this novel type of output, we introduce a lightweight semantic representation for Open IE in the form of normalized and context-preserving relational tuples. It extends the shallow semantic representation of state-of-the-art approaches in the form of predicate-argument structures by capturing intra-sentential rhetorical structures and hierarchical relationships between the relational tuples. In that way, the semantic context of the extracted tuples is preserved, resulting in more informative and coherent predicate-argument structures which are easier to interpret.In addition, in a comparative analysis, we show that the semantic hierarchy of minimal propositions benefits Open IE approaches in a second dimension: the canonical structure of the simplified sentences is easier to process and analyze, and thus facilitates the extraction of relational tuples, resulting in an improved precision (up to 32%) and recall (up to 30%) of the extracted relations on a large benchmark corpus.

Dynamic Editing Distance-based Extracting Relevant Information Approach from Social Networks

Online social networks, such as Facebook, Twitter, LinkedIn, etc., have grown exponentially in recent times with a large amount of information. These social networks have huge volumes of data especially in structured, textual, and unstructured forms which have often led to cyber-crimes like cyber terrorism, cyber bullying, etc., and extracting information from these data has now become a serious challenge in order to ensure the data safety. In this work, we propose a new, supervised approach for Information Extraction (IE) from Web resources based on remote dynamic editing, called EIDED. Our approach is part of the family of IE approaches based on masks extraction and is articulated around three algorithms: (i) a labeling algorithm, (ii) a learning and inference algorithm, and (iii) an extended edit distance algorithm. Our proposed approach is able to work even in the presence of anomalies in the tuples such as missing attributes, multivalued attributes, permutation of attributes, and in the structure of web pages. The experimental study, which we conducted, on a standard database of web pages, shows the performance of our EIDED approach compared to approaches based on the classic edit distance, and this with respect to the standard metrics recall coefficient, precision, and F1-measure.

Neural Semantic Parsing of Building Regulations for Compliance Checking

Computerising building regulations to allow reasoning is one of the main challenges in automated compliance checking in the built environment. While there has been a long history of translating regulations manually, in recent years, natural language processing (NLP) has been used to support or automate this task. While rule- and ontology-based information extraction and transformation approaches have achieved accurate translations for narrow domains and specific regulation types, machine learning (ML) promises increased scalability and adaptability to new regulation styles. Since ML usually requires many annotated examples as training data, we take advantage of the long history of building code computerisation and use a corpus of manually translated regulations to train a transformer-based encoder-decoder model. Given a relatively small corpus, the model learns to predict the logical structure and extracts entities and relations reasonably well. While the translation quality is not adequate to fully automate the process, the model shows the potential to serve as an auto-completion system and to identify manually translated regulations that need to be reviewed.

Seam detection method design and automatic calibration based on an active light coaxial visual sensor

Seam feature detection is one of the critical premises of automatic welding. However, the current seam detection method is vulnerable to complex laser environments, such as illumination interference and material defects, thereby limiting the application of active light coaxial visual sensors in seam tracking. This paper proposes a seam detection and calibration method based on an active light coaxial visual sensor in a laser welding digital twin environment. First, a vision sensor with an 808 nm auxiliary illumination and a customized lens are mounted on the laser welding head to filter out noises and capture the welding image, including the seam and melt pool. Next, a seam information extraction approach based on image processing algorithms is designed to extract seam position and seam width. In addition, an artificial neural network based Kalman filter is proposed to eliminate measurement errors and reduce measurement noise. The calibration of the seam detection parameters is a tedious process. Therefore, the calibration problem is transformed into an optimization problem. A genetic algorithm-based calibration method is proposed to automatically determine the optimum parameters of the seam detection algorithm. Finally, seam detection experiments on laser welding are conducted in both the digital twin environment and the laser welding system. The experimental results show that the proposed method is more efficient than the Hough transfer-based seam detection method. The calibration method can ensure the accuracy of the seam detection method, especially in complex and changeable welding conditions.

NcRNAInter: a novel strategy based on graph neural network to discover interactions between lncRNA and miRNA.

In recent years, many studies have illustrated the significant role that non-coding RNA (ncRNA) plays in biological activities, in which lncRNA, miRNA and especially their interactions have been proved to affect many biological processes. Some in silico methods have been proposed and applied to identify novel lncRNA-miRNA interactions (LMIs), but there are still imperfections in their RNA representation and information extraction approaches, which imply there is still room for further improving their performances. Meanwhile, only a few of them are accessible at present, which limits their practical applications. The construction of a new tool for LMI prediction is thus imperative for the better understanding of their relevant biological mechanisms. This study proposed a novel method, ncRNAInter, for LMI prediction. A comprehensive strategy for RNA representation and an optimized deep learning algorithm of graph neural network were utilized in this study. ncRNAInter was robust and showed better performance of 26.7% higher Matthews correlation coefficient than existing reputable methods for human LMI prediction. In addition, ncRNAInter proved its universal applicability in dealing with LMIs from various species and successfully identified novel LMIs associated with various diseases, which further verified its effectiveness and usability. All source code and datasets are freely available at https://github.com/idrblab/ncRNAInter.

Recent developments in information extraction approaches from Arabic tweets on social networking sites

Information extraction from Arabic tweets has attracted the attention of researchers due to the huge data accessibility for the swift expansion of social media platforms. With the increasing use of social web applications, information extraction from the various platforms has gained importance for understanding the trending post and events predictions based on those sentiments written by the users on certain news feeds. The Arabic Language is mostly used in Middle Eastern and African countries and most users tweet on social media using the Arabic language, therefore Arabic text classification and sentiment analysis aimed to predict information extraction from social media platforms. This research provides a more detailed critical review of the information extraction presented in the literature focused on using different tools, methods, and techniques like k-NN, support vector machines, Naïve Bayes, and other machine learning tools for the data extraction and processing.

The Specimen Data Refinery: Using a scientific workflow approach for information extraction

Over the past three years, we have been developing the Specimen Data Refinery (SDR) to automate the extraction of data from specimen images as part of the SYNTHESYS project (Walton et al. 2020). The SDR provides an easy to deploy, open source, web-based interface to multiple workflows that enable a user to create new or enhance existing natural history specimen records. The SDR uses the Galaxy workflow platform as the basis for managing data analysis, and where possible, using existing Galaxy community tools and approaches (Jalili et al. 2020, Hardisty et al. 2022). We have developed a library of domain-specific tools including semantic segmentation, optical character recognition, hand-written text recognition, barcode reading and natural language processing. These tools have been designed to work on standardised images of specimens, specifically herbarium sheets, pinned insects and microscope slides. In this presentation, we provide our technical approach in developing the SDR, including the Galaxy workflow platform, application deployment, and tool interoperability, using FAIR digital objects (e.g., RO-Crates and openDigital Specimen objects (Soiland-Reyes et al. 2022, Addink and Hardisty 2020)). We present an evaluation of the tools, including segmentation, text recognition, and others, and the new challenges in using the resulting data from both a technical and social perspective.

Assessment of Information Extraction Techniques, Models and Systems

The present article aims to review and evaluate the practiced and classical techniques, tools, models, and systems concerning automatic information extraction (IE) from published scientific documents like research articles, patents, theses, technical reports, and case studies etc. IE is performed for various reasons such as better indexing, archiving, searching, and retrieving. That is mainly used by the search engines and the indexing services as well the digital libraries and semantic web. In this regard, several studies have been conducted targeting various nature of documents. The study pays special consideration to the successful IE models, algorithms and approaches applied to structural IE from published documents. To grasp this, the paper is classified into several segments and each segment covers a significant aspect of IE. Furthermore, to validate their benefits and drawbacks, a comparative study of all the approaches have been conducted in terms of various performance factors like precision, accuracy, recall and F-score. Potential areas of improvement have been emphasized as research gap for the scholars in the closely related areas. Ultimately, a comprehensive summary of the evaluation is presented in tabular form and review is concluded. It was observed that the hybrid methods outperform the other methods due to their versatile nature to address various document formats.

A research on the effect of geostatistical texture analysis on image classification accuracy

In order to increase the accuracy results in various remote sensing applications, some additional parameters of texture information, which can provide information about the spatial relationship of a pixel in the image with other pixels, must be obtained. In addition to standard texture information extraction approaches, there is a need for approaches that take into account the spatial relationships of pixels in a certain neighborhood. In this study, it is aimed to reveal to what extent the use of characteristic information that can determine the texture properties of the image will affect the performance of the classification of satellite images by using the spatial dependency information obtained by geostatistical methods in satellite images. The data sets were classified with the Support Vector Machines (SVM) method, and according to pixel-based classification, an increase of 10% in agricultural area data and a 3% increase in urban area image was observed.

X-ray diffraction of photovoltaic perovskites: Principles and applications

Solar cells based on organic–inorganic hybrid perovskite materials have emerged as the most efficient next-generation thin-film solar cells within just a decade of research and show great promise for commercialization. As control of the thin-film microstructure of the perovskite layer is a key factor enabling high photovoltaic efficiency, good stability, and successful up-scaling of high-quality perovskite thin films for commercialization, a reliable and accurate characterization of the thin-film microstructure is paramount. X-ray diffraction (XRD)-based techniques, including conventional laboratory-based XRD and synchrotron-based grazing-incidence wide-angle x-ray scattering, are widely used to probe the microstructure of photovoltaic perovskite thin films. Nevertheless, it is common for these XRD experiments to be poorly executed and diffraction data to be improperly interpreted. This review focuses on principles of XRD techniques and their application for the characterization of the perovskite thin-film microstructure. Fundamentals of XRD techniques are presented with a strong emphasis on best practices in data collection and analysis. Approaches for the reliable and accurate extraction of microstructural information from diffraction data are discussed, including the need for simulating diffraction patterns. Applications of XRD techniques in characterizing perovskite thin films are demonstrated for both three-dimensional and layered hybrid perovskites, covering various microstructural aspects including phase identification and quantification, texture analysis, microstrain, and macrostrain as well as in situ and operando characterization. The additional subtleties and complexities associated with the XRD characterization of layered hybrid perovskites due to a more complex thin-film microstructure are discussed. Common mistakes and pitfalls that lead to misinterpretation of diffraction data are also highlighted.

Revealing the presence of tryptamine new psychoactive substances using fused “neutral loss” spectra derived from DART high-resolution mass spectra

A data fusion approach for the rapid extraction of core scaffold information that can be used to facilitate structure determination for new psychoactive substance (NPS) tryptamines is described. The method involves the screening of DART-HRMS data of new tryptamines against a partial least squares-discriminant analysis (PLS-DA) model that predicts the core tryptamine structure class into which the compound can be grouped. The PLS-DA prediction model was created and trained using neutral loss spectra derived from collision-induced dissociation (CID) DART mass spectral analysis of 50 tryptamine structures acquired at 60 V and 90 V, in which the sample groups were revealed by hierarchical clustering analysis (HCA). HCA of the fused neutral loss data clustered the 50 tryptamines into 10 groups based on the identities of the neutral fragments lost during fragmentation. “Leave-one-structure-out” validation of the PLS-DA model gave 100% accuracy, precision, sensitivity, and specificity. For external validation, the ability of the model to classify four compounds that were unfamiliar to it was tested, and the model was found to correctly predict the skeletal framework in each case. The results show proof of concept for how this approach can aide in the identification of new emerging psychoactive compounds.