Text Information Extraction Research Articles

The American Joint Committee on Cancer (AJCC) Breast Cancer Staging, Eighth Edition, is more Reflective of Cancer Biology than the Seventh Edition.

The American Joint Committee on Cancer (AJCC) eighth-edition breast cancer staging system incorporating tumor grade, hormone/human epidermal growth factor receptor 2 (HER2) receptor status, and genomic assays has demonstrated better prognostic value than the seventh edition. Given the crucial role of cancer biology in prognosis, the authors hypothesized that the AJCC eighth-edition criteria offer better biologic differentiation between stages than the seventh edition. This study analyzed 696 breast cancer patients from The Cancer Genome Atlas (TCGA) and Text Information Extraction System (TIES) database, with complete information available for staging according to both the AJCC seventh- and eighth-edition criteria. The study indicated an increase in the number of patients classified as stage I in the eighth edition compared with the seventh edition, particularly in hormone-positive breast cancers. Furthermore, the eighth edition demonstrated improved discrimination in overall survival between stages I and II cancers. The eighth edition was able to distinguish significant differences in cell proliferation, intratumor heterogeneity, homologous recombination deficiency, and neoantigen load between stages I and II cancers. Moreover, the eighth edition more clearly differentiated immune cell infiltration between stages II and I cancer than the seventh edition. Finally, immune activity and gene expression of immune checkpoints such as PDCD1, PDL1, CTLA4, LAG3, TIGIT, and IDO1 and 2 showed a more pronounced difference between stages I and II cancers in the eighth edition than in the seventh edition. The AJCC eighth edition breast cancer staging system better distinguishes cancers with more aggressive biology than the seventh edition.

Извлечение информации из текстов на основе онтологии и больших языковых моделей

The article examines the extraction of information from texts using the ontology of a subject area combined with neu-ral network-based text analysis methods, including the use of large language models. It discusses the expert's role in developing and maintaining systems, illustrated through the task of extracting information from analytical articles and constructing ontologies in computational linguistics to represent key concepts relevant to the system's user or customer. The process of ontology creation is accompanied by the development of a dictionary that forms the ontology's termi-nological core, followed by methods for extracting new terms within the specified subject area. This task is considered as a named entity recognition problem, traditionally addressed by training a neural network model on a representative dataset. The study compares this approach with a methodology leveraging large language models. For this, lexical and syntactic patterns, as well as instruction patterns for hypothesis testing regarding new term-phrases and result verifica-tion, were developed. The developed instructions for solving the problem of relation extraction also include the auto-mated generation of natural language competency assessment questions for each ontology relation. The novelty of the proposed approach lies in the integration of ontological, linguistic and neural network approaches to extract infor-mation from texts. The study demonstrates the possibility of solving tasks of text analysis and information extraction problems through a chain of large language models, with dynamically generated instructions based on the outcomes of prior analysis stages. The following F1-measure scores were achieved in the experiments: F1=0.8 for term extraction and classification and F1=0.87 for relation extraction.

Multiscale Residual Weighted Classification Network for Human Activity Recognition in Microwave Radar.

Human activity recognition by radar sensors plays an important role in healthcare and smart homes. However, labeling a large number of radar datasets is difficult and time-consuming, and it is difficult for models trained on insufficient labeled data to obtain exact classification results. In this paper, we propose a multiscale residual weighted classification network with large-scale, medium-scale, and small-scale residual networks. Firstly, an MRW image encoder is used to extract salient feature representations from all time-Doppler images through contrastive learning. This can extract the representative vector of each image and also obtain the pre-training parameters of the MRW image encoder. During the pre-training process, large-scale residual networks, medium-scale residual networks, and small-scale residual networks are used to extract global information, texture information, and semantic information, respectively. Moreover, the time-channel weighting mechanism can allocate weights to important time and channel dimensions to achieve more effective extraction of feature information. The model parameters obtained from pre-training are frozen, and the classifier is added to the backend. Finally, the classifier is fine-tuned using a small amount of labeled data. In addition, we constructed a new dataset with eight dangerous activities. The proposed MRW-CN model was trained on this dataset and achieved a classification accuracy of 96.9%. We demonstrated that our method achieves state-of-the-art performance. The ablation analysis also demonstrated the role of multi-scale convolutional kernels and time-channel weighting mechanisms in classification.

HDCTfusion: Hybrid Dual-Branch Network Based on CNN and Transformer for Infrared and Visible Image Fusion.

The purpose of infrared and visible image fusion is to combine the advantages of both and generate a fused image that contains target information and has rich details and contrast. However, existing fusion algorithms often overlook the importance of incorporating both local and global feature extraction, leading to missing key information in the fused image. To address these challenges, this paper proposes a dual-branch fusion network combining convolutional neural network (CNN) and Transformer, which enhances the feature extraction capability and motivates the fused image to contain more information. Firstly, a local feature extraction module with CNN as the core is constructed. Specifically, the residual gradient module is used to enhance the ability of the network to extract texture information. Also, jump links and coordinate attention are used in order to relate shallow features to deeper ones. In addition, a global feature extraction module based on Transformer is constructed. Through the powerful ability of Transformer, the global context information of the image can be captured and the global features are fully extracted. The effectiveness of the proposed method in this paper is verified on different experimental datasets, and it is better than most of the current advanced fusion algorithms.

Enhanced scene text recognition using deep learning based hybrid attention recognition network

<span lang="EN-US">The technique of automatically recognizing and transforming text that is present in pictures or scenes into machine-readable text is known as scene text recognition. It facilitates applications like content extraction, translation, and text analysis in real-world visual data by enabling computers to comprehend and extract textual information from images, videos, or documents. Scene text recognition is essential for many applications, such as language translation and content extraction from photographs. The hybrid attention recognition network (HARN), unique technology presented in this research, is intended to greatly improve efficiency and accuracy of text recognition in complicated scene situations. HARN makes use of cutting-edge elements including alignment-free sequence-to-sequence (AFS) module, creative attention mechanisms, and hybrid architecture that blends attention models with convolutional neural networks (CNNs). Thanks to its novel attention processes, HARN is capable of comprehending wide range of scene text components by capturing both local and global context information. Through faster network convergence, shorter training times, and better utilization of computing resources, the suggested technique raises bar for state-of-the-art. HARN’s versatility makes it a good choice for range of scene text recognition applications, including multilingual text analysis and data extraction. Extensive tests are conducted to assess the effectiveness of HARN approach and demonstrate it is ability to greatly influence real-world applications where accurate and efficient text recognition is essential.</span>

Power text information extraction based on multi-task learning

In order to improve the analysis and processing speed of power system fault text in actual business scenarios, a power fault text information automatic extraction model based on pre-training and multi-task learning is proposed. The pre-training model is used to learn the context information of power text words, and the first-order and second-order fusion features of words are mined to enhance the representation ability of features. The multi-task learning framework is used to combine the learning of named entity recognition and relationship extraction tasks to achieve mutual complementation and mutual promotion between entity recognition and relationship extraction, thereby improving the performance of power fault text information extraction. Finally, the model is verified by the daily business data of a power grid data center. Compared with other models, the accuracy and recall rate of power fault text entity recognition and relationship extraction are improved.

Three-stage binarization of color document images based on discrete wavelet transform and generative adversarial networks

Three-stage binarization of color document images based on discrete wavelet transform and generative adversarial networks

Handwritten text recognition and information extraction from ancient manuscripts using deep convolutional and recurrent neural network

Handwritten text recognition and information extraction from ancient manuscripts using deep convolutional and recurrent neural network

Review of machine learning with sentimental analysis method for cross-model stock price prediction

Stock market prediction has been a popular area of research for years. Machine learning, as a fast-developing popular algorithm, is applied to stock market prediction by many previous researchers to better solve the time series involving problems over the changing prices. Different from traditional machine learning algorithms that focus on stock prices only, this paper gives a brief description and review of stock price predictions models that contain sentimental analysis over the recent paper works. Different from the prices in number format, sentimental analysis is more based on textual information extraction and mining, converting them into usable input to pass to a prediction model. This extends the prediction model's takeable input domain and strengthens the accuracy. To better classify the differences between the models, discussion and introduction are given based on different model types about whether they are traditional type or deep neural network embedded. Even though traditional types of models are more popular for sentimental analysis and neural networks perform better in prediction tasks, traditional methods are relatively easy to build or train with more explainability, compared to deep learning models suitable for larger data sets.

Semantic Labeling of High-Resolution Images Combining a Self-Cascaded Multimodal Fully Convolution Neural Network with Fully Conditional Random Field

Semantic labeling of very high-resolution remote sensing images (VHRRSI) has emerged as a crucial research area in remote sensing image interpretation. However, challenges arise due to significant variations in target orientation and scale, particularly for small targets that are more prone to obscuration and misidentification. The high interclass similarity and low intraclass similarity further exacerbate difficulties in distinguishing objects with similar color and geographic location. To address this concern, we introduce a self-cascading multiscale network (ScasMNet) based on a fully convolutional network, aimed at enhancing the segmentation precision for each category in remote sensing images (RSIs). In ScasMNet, cropped Digital Surface Model (DSM) data and corresponding RGB data are fed into the network via two distinct paths. In the encoder stage, one branch utilizes convolution to extract height information from DSM images layer by layer, enabling better differentiation of trees and low vegetation with similar color and geographic location. A parallel branch extracts spatial, color, and texture information from the RGB data. By cascading the features of different layers, the heterogeneous data are fused to generate complementary discriminative characteristics. Lastly, to refine segmented edges, fully conditional random fields (DenseCRFs) are employed for postprocessing presegmented images. Experimental findings showcase that ScasMNet achieves an overall accuracy (OA) of 92.74% on two challenging benchmarks, demonstrating its outstanding performance, particularly for small-scale objects. This demonstrates that ScasMNet ranks among the state-of-the-art methods in addressing challenges related to semantic segmentation in RSIs.

Estimating Leaf Area Index in Apple Orchard by UAV Multispectral Images with Spectral and Texture Information

The Leaf Area Index (LAI) strongly influences vegetation evapotranspiration and photosynthesis rates. Timely and accurately estimating the LAI is crucial for monitoring vegetation growth. The unmanned aerial vehicle (UAV) multispectral digital camera platform has been proven to be an effective tool for this purpose. Currently, most remote sensing estimations of LAIs focus on cereal crops, with limited research on economic crops such as apples. In this study, a method for estimating the LAI of an apple orchard by extracting spectral and texture information from UAV multispectral images was proposed. Specifically, field measurements were conducted to collect LAI data for 108 sample points during the final flowering (FF), fruit setting (FS), and fruit expansion (FE) stages of apple growth in 2023. Concurrently, UAV multispectral images were obtained to extract spectral and texture information (Gabor transform). The Support Vector Regression Recursive Feature Elimination (SVR-REF) was employed to select optimal features as inputs for constructing models to estimate the LAI. Finally, the optimal model was used for LAI mapping. The results indicate that integrating spectral and texture information effectively enhances the accuracy of LAI estimation, with the relative prediction deviation (RPD) for all models being greater than 2. The Categorical Boosting (CatBoost) model established for FF exhibits the highest accuracy, with a validation set R2, root mean square error (RMSE), and RPD of 0.867, 0.203, and 2.482, respectively. UAV multispectral imagery proves to be valuable in estimating apple orchard LAIs, offering real-time monitoring of apple growth and providing a scientific basis for orchard management.

AI-powered dining: text information extraction and machine learning for personalized menu recommendations and food allergy management

AI-powered dining: text information extraction and machine learning for personalized menu recommendations and food allergy management

Infrared Image Enhancement Method of Substation Equipment Based on Self-Attention Cycle Generative Adversarial Network (SA-CycleGAN)

During the acquisition of infrared images in substations, low-quality images with poor contrast, blurred details, and missing texture information frequently appear, which adversely affects subsequent advanced visual tasks. To address this issue, this paper proposes an infrared image enhancement algorithm for substation equipment based on a self-attention cycle generative adversarial network (SA-CycleGAN). The proposed algorithm incorporates a self-attention mechanism into the CycleGAN model’s transcoding network to improve the mapping ability of infrared image information, enhance image contrast, and reducing the number of model parameters. The addition of an efficient local attention mechanism (EAL) and a feature pyramid structure within the encoding network enhances the generator’s ability to extract features and texture information from small targets in infrared substation equipment images, effectively improving image details. In the discriminator part, the model’s performance is further enhanced by constructing a two-channel feature network. To accelerate the model’s convergence, the loss function of the original CycleGAN is optimized. Compared to several mainstream image enhancement algorithms, the proposed algorithm improves the quality of low-quality infrared images by an average of 10.91% in color degree, 18.89% in saturation, and 29.82% in feature similarity indices. Additionally, the number of parameters in the proposed algorithm is reduced by 37.89% compared to the original model. Finally, the effectiveness of the proposed method in improving recognition accuracy is validated by the Centernet target recognition algorithm.

Mechanobiological factors in fermentation: Understanding the impact on food texture and nutrient release

Evaluating people’s food intake is crucial for establishing the link between diet and disease. Deprivation of vital nutrients causes the body to deteriorate organs and increases the risk of severe diseases that manifest in maturity. Making healthy food choices is one of the best ways to avoid developing chronic diseases, such as diabetes, heart disease, stroke, and even certain types of cancer. Hence, this paper proposes a deep learning-based automated nutrition classification system (DL-ANCS) for predicting food ingredients and nutrition. The DL-ANCS with Internet of Things (IoT) sensors to quantify food nutrition and a smartphone app to compile ingredient nutritional information. It is possible to take pictures of food eaten using the camera that comes with most mobile phones. It is possible to automatically identify the food items for record keeping using image processing. The effectiveness of the proposed DL-ANCS relies on its ability to accurately classify food items in these photos utilizing meal prediction algorithms and DL-ANCS. This research introduces a novel approach to extracting texture information from food photos to show how these features improve the accuracy of a nutritional assessment system that runs on mobile phones. The proposed method improvesthe food texture ratio of 98.7%, effectiveness ratio of 99.2%, accuracy ratio of 95.89%, food ingredient predictionsand their nutritional compatibility ratio of 96.8%, and food component classifications ratio of 97.29%.

Introducing MagBERT: A language model for magnesium textual data mining and analysis

Introducing MagBERT: A language model for magnesium textual data mining and analysis

Ancient paintings inpainting based on dual encoders and contextual information

Deep learning-based inpainting models have achieved success in restoring natural images, yet their application to ancient paintings encounters challenges due to the loss of texture, lines, and color. To address these issues, we introduce an ancient painting inpainting model based on dual encoders and contextual information to overcome the lack of feature extraction and detail texture recovery when restoring ancient paintings. Specifically, the proposed model employs a gated encoding branch that aims to minimize information loss and effectively capture semantic information from ancient paintings. A dense multi-scale feature fusion module is designed to extract texture and detail information at various scales, while dilated depthwise separable convolutions are utilized to reduce parameters and enhance computational efficiency. Furthermore, a contextual feature aggregation module is incorporated to extract contextual features, enhancing the overall consistency of the inpainting results. Finally, a color loss function is introduced to ensure color consistency in the restored area, harmonizing it with the surrounding region. The experimental results indicate that the proposed model effectively restores the texture details of ancient paintings, outperforming other methods both qualitatively and quantitatively. Additionally, the model is tested on real damaged ancient paintings to validate its practicality and efficacy.

Kinship verification in childhood images using curvelet transformed features

Kinship verification in childhood images using curvelet transformed features

Vocabulary Matters: An Annotation Pipeline and Four Deep Learning Algorithms for Enzyme Named Entity Recognition.

Enzymes are indispensable in many biological processes, and with biomedical literature growing exponentially, effective literature review becomes increasingly challenging. Natural language processing methods offer solutions to streamline this process. This study aims to develop an annotated enzyme corpus for training and evaluating enzyme named entity recognition (NER) models. A novel pipeline, combining dictionary matching and rule-based keyword searching, automatically annotated enzyme entities in >4800 full-text publications. Four deep learning NER models were created with different vocabularies (BioBERT/SciBERT) and architectures (BiLSTM/transformer) and evaluated on 526 manually annotated full-text publications. The annotation pipeline achieved an F1-score of 0.86 (precision = 1.00, recall = 0.76), surpassed by fine-tuned transformers for F1-score (BioBERT: 0.89, SciBERT: 0.88) and recall (0.86) with BiLSTM models having higher precision (0.94) than transformers (0.92). The annotation pipeline runs in seconds on standard laptops with almost perfect precision, but was outperformed by fine-tuned transformers in terms of F1-score and recall, demonstrating generalizability beyond the training data. In comparison, SciBERT-based models exhibited higher precision, and BioBERT-based models exhibited higher recall, highlighting the importance of vocabulary and architecture. These models, representing the first enzyme NER algorithms, enable more effective enzyme text mining and information extraction. Codes for automated annotation and model generation are available from https://github.com/omicsNLP/enzymeNER and https://zenodo.org/doi/10.5281/zenodo.10581586.

A Comprehensive Approach to Brain Tumor Classification in MRI: Unifying Classical Local Binary Patterns and Convolution Neural Networks

Brain tumors, among the most perilous neurological disorders affecting the human nervous system, are categorized into glioma, meningioma, and Pituitary types. The proposed system combines Classical Local Binary Patterns (CLBP), Histogram of Oriented Gradients (HOG), and Convolutional Neural Networks (CNN) to extract texture information from MRI images. The methodology comprises three key steps: image pre-processing, feature extraction, and classification. By evaluating a publicly accessible brain tumor dataset, the proposed approach attains an impressive accuracy of 96%. The findings highlight the potential uses of the CLBP+CNN approach in clinical diagnosis and treatment planning, demonstrating the possibility of accurate and efficient brain tumor classification. The proposal introduces future extension methods like CLBPs (DLBP, ӨLBP), where the DLBP approach incorporates a 'D' parameter specifying the distance between neighboring pixels. The ӨLBP Method evaluates the pixel value by changing the 'Ө' value, i.e., 150, 450, 900 and 1200. The classification of tumors involved the application of various classification methods, namely ANN (Artificial Neural Networks), AlDE (Ant Lion Optimizer Differential Evolution), and LDA (Linear Discriminant Analysis). This classification is executed using feature extractions derived from CLBP (DLBP & ӨLBP) applied to MRI images within the dataset.

PGCL: Prompt guidance and self-supervised contrastive learning-based method for Visual Question Answering

PGCL: Prompt guidance and self-supervised contrastive learning-based method for Visual Question Answering