Natural Language Research Articles

SIFG: an ensemble model for sieving fake news from genuine without metadata by combining syntactic and semantic features

ABSTRACT With the emergence of the Internet, social media, and smartphones, almost everyone can now claim that they have news in their pockets. This phenomenon makes people aware of their surroundings and knowledgeable of current events. But, it also presents new challenges, such as automatic detection, machine/bot-generated fake news, limited or no metadata, etc. In this paper, we mitigate some of these challenges by taking a step toward SIeving Fake News from Genuine (SIFG) and presenting a system named SIFG. In SIFG we have used basic and advanced Natural Language Processing techniques to detect online fake news automatically. This makes SIFG independent of the metadata, such as the source, network structure and behavior, temporal propagation, and responses, about the news. We also introduce specific Parts of Speech patterns, utilize Generalized Relevance Learning Vector Quantization for feature selection, and employ ensemble learning to improve the performance of SIFG. When tested with a publicly available online fake news dataset of 10,000 fake and 10,000 genuine news, SIFG shows promising results and achieves an accuracy in the range of 89.85% − 95%.

Leveraging AI and Machine Learning in Six-Sigma Documentation for Pharmaceutical Quality Assurance.

The pharmaceutical industry must maintain stringent quality assurance standards to ensure product safety and regulatory compliance. A key component of the well-known Six Sigma methodology for process improvement and quality control is precise and comprehensive documentation. However, there are a number of significant issues with traditional documentation procedures, including as slowness, human error, and difficulties with regulatory standards. This review research looks at innovative ways to employ machine learning (ML) and artificial intelligence (AI) to enhance Six Sigma documentation processes in the pharmaceutical sector. AI and ML provide cutting-edge technologies that have the potential to drastically alter documentation processes by automating data entry, collection, and analysis. Natural language processing (NLP) and computer vision technologies have the potential to significantly reduce human error rates and increase the efficacy of documentation processes. By applying machine learning algorithms to support real-time data analysis, predictive analytics, and proactive quality management, pharmaceutical organizations may be able to identify potential quality issues early on and take proactive efforts to address them. Combining AI and ML improves documentation accuracy and reliability while also strengthening compliance with stringent regulatory criteria. The primary barriers and limitations to the current state of Six Sigma documentation in the pharmaceutical industry are identified in this study. It examines the fundamentals of AI and ML with an emphasis on their specific applications in quality assurance and potential benefits for Six Sigma processes. The report includes extensive case studies that highlight notable developments and explain how AI/ML enhanced documentation is used in the real world.

A dynamic graph structural framework for implicit sentiment identification based on complementary semantic and structural information

Implicit sentiment identification has become the classic challenge in text mining due to its lack of sentiment words. Recently, graph neural network (GNN) has made great progress in natural language processing (NLP) because of its powerful feature capture ability, but there are still two problems with the current method. On the one hand, the graph structure constructed for implicit sentiment text is relatively single, without comprehensively considering the information of the text, and it is more difficult to understand the semantics. On the other hand, the constructed initial static graph structure is more dependent on human labor and domain expertise, and the introduced errors cannot be corrected. To solve these problems, we introduce a dynamic graph structure framework (SIF) based on the complementarity of semantic and structural information. Specifically, for the first problem, SIF integrates the semantic and structural information of the text, and constructs two graph structures, structural information graph and semantic information graph, respectively, based on specialized knowledge, which complements the information between the two graph structures, provides rich semantic features for the downstream identification task, and helps to understanding of the contextual information between implicit sentiment semantics. To deal with the second issue, SIF dynamically learns the initial static graph structure to eliminate the noise information in the graph structure, preventing noise accumulation that affects the performance of the downstream identification task. We compare SIF with mainstream natural language processing methods in three publicly available datasets, all of which outperform the benchmark model. The accuracy on the Puns of day dataset, SemEval-2021 task 7 dataset, and Reddit dataset reaches 95.73%, 85.37%, and 65.36%, respectively. The experimental results demonstrate a good application scenario for our proposed method on implicit sentiment identification tasks.

Applying natural language processing to patient messages to identify depression concerns in cancer patients.

This study aims to explore and develop tools for early identification of depression concerns among cancer patients by leveraging the novel data source of messages sent through a secure patient portal. We developed classifiers based on logistic regression (LR), support vector machines (SVMs), and 2 Bidirectional Encoder Representations from Transformers (BERT) models (original and Reddit-pretrained) on 6600 patient messages from a cancer center (2009-2022), annotated by a panel of healthcare professionals. Performance was compared using AUROC scores, and model fairness and explainability were examined. We also examined correlations between model predictions and depression diagnosis and treatment. BERT and RedditBERT attained AUROC scores of 0.88 and 0.86, respectively, compared to 0.79 for LR and 0.83 for SVM. BERT showed bigger differences in performance across sex, race, and ethnicity than RedditBERT. Patients who sent messages classified as concerning had a higher chance of receiving a depression diagnosis, a prescription for antidepressants, or a referral to the psycho-oncologist. Explanations from BERT and RedditBERT differed, with no clear preference from annotators. We show the potential of BERT and RedditBERT in identifying depression concerns in messages from cancer patients. Performance disparities across demographic groups highlight the need for careful consideration of potential biases. Further research is needed to address biases, evaluate real-world impacts, and ensure responsible integration into clinical settings. This work represents a significant methodological advancement in the early identification of depression concerns among cancer patients. Our work contributes to a route to reduce clinical burden while enhancing overall patient care, leveraging BERT-based models.

SYNERGIZING ACADEMIC ANIMATION AND AI INTEGRATION FOR ENRICHED LIBRARY EXPERIENCE

Libraries must maintain a harmonic balance between technology and the human aspect to ensure patrons receive the best possible service. This conceptual paper combines academic animation and artificial intelligence to create a library experience. This study proposes using animation to enhance patrons' library experience. Using artificial intelligence and machine learning in a natural language can enrich the library experience.

Identifying Person-Specific Drivers of Depression in Adolescents: Protocol for a Smartphone-Based Ecological Momentary Assessment and Passive Sensing Study.

Adolescence is marked by an increasing risk of depression and is an optimal window for prevention and early intervention. Personalizing interventions may be one way to maximize therapeutic benefit, especially given the marked heterogeneity in depressive presentations. However, empirical evidence that can guide personalized intervention for youth is lacking. Identifying person-specific symptom drivers during adolescence could improve outcomes by accounting for both developmental and individual differences. This study leverages adolescents' everyday smartphone use to investigate person-specific drivers of depression and validate smartphone-based mobile sensing data against established ambulatory methods. We describe the methods of this study and provide an update on its status. After data collection is completed, we will address three specific aims: (1) identify idiographic drivers of dynamic variability in depressive symptoms, (2) test the validity of mobile sensing against ecological momentary assessment (EMA) and actigraphy for identifying these drivers, and (3) explore adolescent baseline characteristics as predictors of these drivers. A total of 50 adolescents with elevated symptoms of depression will participate in 28 days of (1) smartphone-based EMA assessing depressive symptoms, processes, affect, and sleep; (2) mobile sensing of mobility, physical activity, sleep, natural language use in typed interpersonal communication, screen-on time, and call frequency and duration using the Effortless Assessment of Risk States smartphone app; and (3) wrist actigraphy of physical activity and sleep. Adolescents and caregivers will complete developmental and clinical measures at baseline, as well as user feedback interviews at follow-up. Idiographic, within-subject networks of EMA symptoms will be modeled to identify each adolescent's person-specific drivers of depression. Correlations among EMA, mobile sensor, and actigraph measures of sleep, physical, and social activity will be used to assess the validity of mobile sensing for identifying person-specific drivers. Data-driven analyses of mobile sensor variables predicting core depressive symptoms (self-reported mood and anhedonia) will also be used to assess the validity of mobile sensing for identifying drivers. Finally, between-subject baseline characteristics will be explored as predictors of person-specific drivers. As of October 2023, 84 families were screened as eligible, of whom 70% (n=59) provided informed consent and 46% (n=39) met all inclusion criteria after completing baseline assessment. Of the 39 included families, 85% (n=33) completed the 28-day smartphone and actigraph data collection period and follow-up study visit. This study leverages depressed adolescents' everyday smartphone use to identify person-specific drivers of adolescent depression and to assess the validity of mobile sensing for identifying these drivers. The findings are expected to offer novel insights into the structure and dynamics of depressive symptomatology during a sensitive period of development and to inform future development of a scalable, low-burden smartphone-based tool that can guide personalized treatment decisions for depressed adolescents. DERR1-10.2196/43931.

Analyzing the impact of financial news on the stock market using Natural Language Processing techniques

In the current financial domain, the impact of financial news on the stock market has become increasingly significant. Its rapid dissemination speed and wide coverage have made it a key factor in influencing investor sentiment and decision-making. Therefore, this study aims to explore how to utilize Natural Language Processing (NLP) technologies to analyze the impact of financial news on the stock market. The research involves collecting multiple sources of financial news and corresponding stock market data, and employs methods such as text preprocessing, sentiment analysis, and event extraction to process and analyze the news content. By constructing machine learning models, this study attempts to quantify the sentiment orientation of financial news and the impact of specific events on stock market volatility. The research questions focus on how to effectively extract valuable information from financial news and predict its specific impact on the stock market. The results indicate that sentiment orientation and key events in financial news are significantly correlated with short-term fluctuations in the stock market, especially for news reports on specific industries or companies. Moreover, the application of deep learning models further enhances the accuracy of predicting stock market reactions. This study not only provides financial market analysts with a new analytical tool but also offers a new perspective on understanding how financial news affects the stock market.

Large Language Model-Based Natural Language Encoding Could Be All You Need for Drug Biomedical Association Prediction.

Analyzing drug-related interactions in the field of biomedicine has been a critical aspect of drug discovery and development. While various artificial intelligence (AI)-based tools have been proposed to analyze drug biomedical associations (DBAs), their feature encoding did not adequately account for crucial biomedical functions and semantic concepts, thereby still hindering their progress. Since the advent of ChatGPT by OpenAI in 2022, large language models (LLMs) have demonstrated rapid growth and significant success across various applications. Herein, LEDAP was introduced, which uniquely leveraged LLM-based biotext feature encoding for predicting drug-disease associations, drug-drug interactions, and drug-side effect associations. Benefiting from the large-scale knowledgebase pre-training, LLMs had great potential in drug development analysis owing to their holistic understanding of natural language and human topics. LEDAP illustrated its notable competitiveness in comparison with other popular DBA analysis tools. Specifically, even in simple conjunction with classical machine learning methods, LLM-based feature representations consistently enabled satisfactory performance across diverse DBA tasks like binary classification, multiclass classification, and regression. Our findings underpinned the considerable potential of LLMs in drug development research, indicating a catalyst for further progress in related fields.

Exploring the fusion of natural language processing and information retrieval

The ongoing progress of technology has led to a strong focus on the merging of Natural Language Processing (NLP) and Information Retrieval (IR) in current research. This paper provides a comprehensive analysis of the fundamental concepts, importance, and difficulties encountered in the domains of NLP and IR, examining their effects on real-world applications. By examining the present state of NLP technology in information retrieval, it is evident that the advancement of NLP technology has introduced fresh opportunities for information retrieval, such as the NLPIR model. However, it also encounters problems in terms of adaptability and generalization capacity. Future study should prioritize enhancing the precision and efficiency of NLP technology, as well as investigating its suitability and adaptability in dealing with certain domains or languages. By consistently striving and introducing new ideas, the fields of NLP and information retrieval will have a promising future, offering individuals more convenient and precise information retrieval services.

Analysis of neural networks in text sentiment

The proliferation of digital media and online platforms has led to a significant increase in the production and distribution of textual data. Consequently, the study of text sentiment analysis has emerged as a crucial area of research within the domain of natural language processing. The objective of sentiment analysis is to detect and categorize emotional inclinations in text, which has substantial practical importance in comprehending public sentiment, monitoring brand reputation, and other related areas. This research does a comprehensive investigation of the utilization of neural network models in text sentiment analysis using literature review methods. It examines the difficulties encountered and the approaches employed to overcome these difficulties. The research encompasses the fundamental principles and techniques of text sentiment analysis utilizing neural networks, as well as the utilization of convolutional neural networks (CNN), recurrent neural networks (RNN)/long short-term memory networks (LSTM), attention mechanisms, and pre-trained models in the field of sentiment analysis. Furthermore, this study delves into the complexities associated with data noise, the interpretability of models, the analysis of long text and multimodal sentiment, as well as the utilization of transfer learning and domain adaptation techniques. The study's importance is in establishing a theoretical basis and practical recommendations for the advancement of sentiment analysis technology, particularly in enhancing model precision, comprehensibility, and range of applications, thereby delivering useful insights.

Using Social Media to Understand Primary Discussions in Gastrointestinal Cancers: Machine Learning Approach.

The incidence and mortality rates of gastrointestinal (GI) cancers are high in the United States as well as worldwide. The widespread use of social media provides unique opportunities to facilitate the dissemination of information, especially in the context of health. We aim to characterize the public's primary discussions, including perceptions, concerns, and interests toward GI cancers, from prevention, diagnosis, and treatment to survivorship care through the social media platform Twitter, using tweets posted by Twitter users. We analyzed 87 860 Twitter posts related to GI cancers. We used machine learning with natural language processing to identify salient topics and themes in the collected tweets. The most common themes across all GI cancer types included cancer risk prevention and awareness outreach programs, risk factors including lifestyles (primarily diet), and cancer survivorship-related discussions (primarily GI symptoms and quality of life). GI symptom-related tweets were prevalent in patients with colorectal and stomach cancers, whereas themes of newer clinical trials, end-of-life trials, palliative care trials, and disease prognosis were common in tweets related to liver/biliary and pancreatic cancers. Our research emphasizes the importance of individualized approaches in managing GI cancers, considering lifestyle and diet, the need for comprehensive survivorship care, raising awareness, delivering information, and improving targeted interventions related to GI cancers. Our study suggests utilizing Twitter data to better understand the real-world interest and concerns about GI cancers among the public, which can guide future patient-centered research in this field.

Gender-based linguistic differences in letters of recommendation for rhinology fellowship over time: A dual-institutional follow-up study using natural language processing and deep learning.

This follow-up dual-institutional and longitudinal study further evaluated for underlying gender biases in LORs for rhinology fellowship. Explicit and implicit linguistic gender bias was found, heavily favoring male applicants.

Brief Review and Primer of Key Terminology for Artificial Intelligence and Machine Learning in Hypertension.

Recent breakthroughs in artificial intelligence (AI) have caught the attention of many fields, including health care. The vision for AI is that a computer model can process information and provide output that is indistinguishable from that of a human and, in specific repetitive tasks, outperform a human's capability. The 2 critical underlying technologies in AI are used for supervised and unsupervised machine learning. Machine learning uses neural networks and deep learning modeled after the human brain from structured or unstructured data sets to learn, make decisions, and continuously improve the model. Natural language processing, used for supervised learning, is understanding, interpreting, and generating information using human language in chatbots and generative and conversational AI. These breakthroughs result from increased computing power and access to large data sets, setting the stage for releasing large language models, such as ChatGPT and others, and new imaging models using computer vision. Hypertension management involves using blood pressure and other biometric data from connected devices and generative AI to communicate with patients and health care professionals. AI can potentially improve hypertension diagnosis and treatment through remote patient monitoring and digital therapeutics.

Exploring graph learning techniques for enhancing cross-domain applications in computer vision and natural language processing

With the rapid development of artificial intelligence, graph learning technology has become a research hotspot because of its unique data processing ability. This paper discusses the application of graph learning technology in computer vision (CV) and natural language processing (NLP), especially, it is applied to image segmentation and recognition, visual relationship detection, dynamic scene understanding, semantic role labeling and knowledge map enhancement. The graph neural network (GNN) can effectively learn the deep features of image or text data by defining pixels or hyperpixels as nodes and constructing the edges between nodes according to the spatial proximity or similarity between pixels. This paper also discusses the application of graph learning technology in improving model interpretability, including feature relation visualization, error analysis and diagnosis, and model decision path interpretation. By comparing the application effects of different graph learning models and algorithms, this paper aims to provide reference and inspiration for the follow-up research and application.

Corporate culture and tax planning

AbstractIn this paper, we study the relationship between corporate culture and tax planning. Using the competing values framework and natural language processing techniques, we document that firms with collaboration-oriented (control-oriented) corporate cultures are associated with lower (higher) effective tax rates. We further find that firms with collaboration-oriented corporate cultures achieve these tax savings by engaging in tax-sheltering activities and that such savings positively affect firm value. While firms with salient control-oriented characteristics have previously been recognized to benefit from small tax burdens, we contribute with new evidence suggesting that intra-organizational reciprocity also promote tax savings that ultimately benefit shareholders.

Overview of the problem and possibilities of improving information literacy

This article analyzes in detail the actual problem of the spread of disinformation through various media resources and their impact on society. The main aspects of information consumption by Ukrainian society, in particular on the Internet, are highlighted, and the potential target audience is determined. Based on the analysis, a new intelligent system based on Natural Language Processing technology is proposed, which provides users with a comprehensive overview of the activity of each media resource. Available analogues with their advantages and limitations are examined in detail, emphasizing the significant advantages of the proposed intelligent system for increasing information literacy and countering disinformation. Figs.: 3. Refs.: 9 titles

Text sentiment analysis and classification based on bidirectional Gated Recurrent Units (GRUs) model

This paper explores the importance of text sentiment analysis and classification in the field of natural language processing, and proposes a new approach to sentiment analysis and classification based on the bidirectional gated recurrent units (GRUs) model. The study firstly analyses the word cloud model of the text with six sentiment labels, and then carries out data preprocessing, including the steps of removing special symbols, punctuation marks, numbers, stop words and non-alphabetic parts. Subsequently, the data set is divided into training set and test set, and through model training and testing, it is found that the accuracy of the validation set is increased from 85% to 93% with training, which is an increase of 8%; at the same time, the loss value of the validation set decreases from 0.7 to 0.1 and tends to be stable, and the model is gradually close to the actual value, which can effectively classify the text emotions. The confusion matrix shows that the accuracy of the model on the test set reaches 94.8%, the precision is 95.9%, the recall is 99.1%, and the F1 score is 97.4%, which proves that the model has good generalisation ability and classification effect. Overall, the study demonstrated an effective method for text sentiment analysis and classification with satisfactory results.

Identification of the coefficient in the diffusion model of hydrodynamic flow in a chemical reactor

This article analyzes in detail the actual problem of the spread of disinformation through various media resources and their impact on society. The main aspects of information consumption by Ukrainian society, in particular on the Internet, are highlighted, and the potential target audience is determined. Based on the analysis, a new intelligent system based on Natural Language Processing technology is proposed, which provides users with a comprehensive overview of the activity of each media resource. Available analogues with their advantages and limitations are examined in detail, emphasizing the significant advantages of the proposed intelligent system for increasing information literacy and countering disinformation. Refs.: 19 titles.

Developing and testing a framework for coding general practitioners’ free-text diagnoses in electronic medical records - a reliability study for generating training data in natural language processing

BackgroundDiagnoses entered by general practitioners into electronic medical records have great potential for research and practice, but unfortunately, diagnoses are often in uncoded format, making them of little use. Natural language processing (NLP) could assist in coding free-text diagnoses, but NLP models require local training data to unlock their potential. The aim of this study was to develop a framework of research-relevant diagnostic codes, to test the framework using free-text diagnoses from a Swiss primary care database and to generate training data for NLP modelling.MethodsThe framework of diagnostic codes was developed based on input from local stakeholders and consideration of epidemiological data. After pre-testing, the framework contained 105 diagnostic codes, which were then applied by two raters who independently coded randomly drawn lines of free text (LoFT) from diagnosis lists extracted from the electronic medical records of 3000 patients of 27 general practitioners. Coding frequency and mean occurrence rates (n and %) and inter-rater reliability (IRR) of coding were calculated using Cohen’s kappa (Κ).ResultsThe sample consisted of 26,980 LoFT and in 56.3% no code could be assigned because it was not a specific diagnosis. The most common diagnostic codes were, ‘dorsopathies’ (3.9%, a code covering all types of back problems, including non-specific lower back pain, scoliosis, and others) and ‘other diseases of the circulatory system’ (3.1%). Raters were in almost perfect agreement (Κ ≥ 0.81) for 69 of the 105 diagnostic codes, and 28 codes showed a substantial agreement (K between 0.61 and 0.80). Both high coding frequency and almost perfect agreement were found in 37 codes, including codes that are particularly difficult to identify from components of the electronic medical record, such as musculoskeletal conditions, cancer or tobacco use.ConclusionThe coding framework was characterised by a subset of very frequent and highly reliable diagnostic codes, which will be the most valuable targets for training NLP models for automated disease classification based on free-text diagnoses from Swiss general practice.

The eye of artificial intelligence - Convolutional Neural Networks

Inspired by the biological visual system, the convolutional neural network has been widely studied and invented in the field of artificial intelligence. As one of the important algorithms in artificial neural networks, convolutional neural networks have shown outstanding application potential in fields such as image recognition, computer vision, and natural language processing. This article will focus on exploring the powerful capabilities of convolutional neural networks in image processing. By delving into the implementation process of a convolutional neural network, readers will gain a deeper understanding of its working principles. In addition, this article will briefly introduce three classic models of convolutional neural networks, providing readers with more background knowledge. Next, this paper will analyze in detail two typical application cases of convolutional neural networks in the field of image processing: intelligent transportation systems and dental imaging technology. These cases demonstrate the successful application of convolutional neural networks in practical scenarios, pointing the way for their future development. In the future, convolutional neural networks will be more widely used in fields such as image and video processing as data scale increases and computing power improves. By using techniques such as model compression and hardware optimization, it is made more suitable for low-power and high-efficiency environments, and its interpretability and applicability are enhanced through data augmentation and model interpretation techniques.