Models Of Language Processing Research Articles

Mapping the Green Urban: A Comprehensive Review of Materials and Learning Methods for Green Infrastructure Mapping

Green infrastructure (GI) plays a crucial role in sustainable urban development, but effective mapping and analysis of such features requires a detailed understanding of the materials and state-of-the-art methods. This review presents the current landscape of green infrastructure mapping, focusing on the various sensors and image data, as well as the application of machine learning and deep learning techniques for classification or segmentation tasks. After finding articles with relevant keywords, the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyzes) method was used as a general workflow, but some parts were automated (e.g., screening) by using natural language processing and large language models. In total, this review analyzed 55 papers that included keywords related to GI mapping and provided materials and learning methods (i.e., machine or deep learning) essential for effective green infrastructure mapping. A shift towards deep learning methods can be observed in the mapping of GIs as 33 articles use various deep learning methods, while 22 articles use machine learning methods. In addition, this article presents a novel methodology for automated verification methods, demonstrating their potential effectiveness and highlighting areas for improvement.

Cultural Sensitivity in AI Language Learning: Using NLP to Enhance Language Understanding Across Cultural Contexts

The aim of this paper is to demonstrate the integration of cultural awareness into AI language learning systems using Natural Language Processing (NLP) models. Recognising that the traditional methods of language learning tend not to capture cultural variations, the studies focus on how culturally relevant NLP models (GPT-3, BERT, RNNs) promote language acquisition and cross-cultural integration. Data preprocessing, cultural data augmentation and model training was used to encode cultural variables such as greetings, politeness, and contextually relevant expressions into training datasets. Experimental results suggest that culturally sensitive models outperform the generic model on tasks that involve cultural awareness, such as politeness detection, cultural phrase recognition, and tone sensitivity. GPT-3 for example improved the accuracy of politeness detection tasks from 72.4% to 85.7%. These results highlight the need to bring cultural awareness into AI to develop engaging, context-sensitive language learning. It concludes that culturally based NLP models enhance learner capacity for real-world communication and foster global cultural awareness. Future work should focus on expanding culturally diverse datasets and refining AI models to address subtle cultural complexities

Natural Language Processing for Dialects of a Language: A Survey

State-of-the-art natural language processing (NLP) models are trained on massive training corpora, and report a superlative performance on evaluation datasets. This survey delves into an important attribute of these datasets: the dialect of a language. Motivated by the performance degradation of NLP models for dialectal datasets and its implications for the equity of language technologies, we survey past research in NLP for dialects in terms of datasets, and approaches. We describe a wide range of NLP tasks in terms of two categories: natural language understanding (NLU) (for tasks such as dialect classification, sentiment analysis, parsing, and NLU benchmarks) and natural language generation (NLG) (for summarisation, machine translation, and dialogue systems). The survey is also broad in its coverage of languages which include English, Arabic, German, among others. We observe that past work in NLP concerning dialects goes deeper than mere dialect classification, and extends to several NLU and NLG tasks. For these tasks, we describe classical machine learning using statistical models, along with the recent deep learning-based approaches based on pre-trained language models. We expect that this survey will be useful to NLP researchers interested in building equitable language technologies by rethinking LLM benchmarks and model architectures.

Using a machine learning framework for natural language processing to create a high-resolution carbon emission map for urban manufacturing

Managing carbon emissions from the manufacturing sector is crucial for sustainable development, and effective identification of manufacturing land is key to achieving this goal. However, current methods for identifying urban manufacturing land remain inadequate. In this study, we employ a fine-tuned, pre-trained natural language processing model based on Bidirectional Encoder Representations from Transformers to classify points of interest data into manufacturing industry categories. This approach enables us to identify manufacturing land and allocate corresponding carbon emissions data to specific parcels. The global Moran’s Index and local Moran’s Index are applied to analyze the relationship between manufacturing concentration and carbon emission intensity. The results demonstrate that the fine-tuned model achieved an accuracy rate of 91.6% on the test set, successfully identifying 98.72% of the manufacturing land in the study area. The intensity of carbon emissions from manufacturing exhibits a significant positive spatial correlation, with urban areas characterized by high-high and low-low clustering of emissions. In rural areas, high-emission manufacturers tend to be co-located with low-emission enterprises. Within individual manufacturing sectors, most exhibit low-low clustering, suggesting a potential relationship between such clustering and lower carbon emissions. This study provides detailed spatial data for the management of carbon emissions in the manufacturing sector and addresses the gap in micro-scale research on the correlation between manufacturing concentration and carbon emissions.

The role of chromatin state in intron retention: A case study in leveraging large scale deep learning models.

Complex deep learning models trained on very large datasets have become key enabling tools for current research in natural language processing and computer vision. By providing pre-trained models that can be fine-tuned for specific applications, they enable researchers to create accurate models with minimal effort and computational resources. Large scale genomics deep learning models come in two flavors: the first are large language models of DNA sequences trained in a self-supervised fashion, similar to the corresponding natural language models; the second are supervised learning models that leverage large scale genomics datasets from ENCODE and other sources. We argue that these models are the equivalent of foundation models in natural language processing in their utility, as they encode within them chromatin state in its different aspects, providing useful representations that allow quick deployment of accurate models of gene regulation. We demonstrate this premise by leveraging the recently created Sei model to develop simple, interpretable models of intron retention, and demonstrate their advantage over models based on the DNA language model DNABERT-2. Our work also demonstrates the impact of chromatin state on the regulation of intron retention. Using representations learned by Sei, our model is able to discover the involvement of transcription factors and chromatin marks in regulating intron retention, providing better accuracy than a recently published custom model developed for this purpose.

Fake News Detection and Classification: A Comparative Study of Convolutional Neural Networks, Large Language Models, and Natural Language Processing Models

In an era where fake news detection has become a pressing issue due to its profound impacts on public opinion, democracy, and social trust, accurately identifying and classifying false information is a critical challenge. In this study, the effectiveness is investigated of advanced machine learning models—convolutional neural networks (CNNs), bidirectional encoder representations from transformers (BERT), and generative pre-trained transformers (GPTs)—for robust fake news classification. Each model brings unique strengths to the task, from CNNs’ pattern recognition capabilities to BERT and GPTs’ contextual understanding in the embedding space. Our results demonstrate that the fine-tuned GPT-4 Omni models achieve 98.6% accuracy, significantly outperforming traditional models like CNNs, which achieved only 58.6%. Notably, the smaller GPT-4o mini model performed comparably to its larger counterpart, highlighting the cost-effectiveness of smaller models for specialized tasks. These findings emphasize the importance of fine-tuning large language models (LLMs) to optimize the performance for complex tasks such as fake news classifier development, where capturing subtle contextual relationships in text is crucial. However, challenges such as computational costs and suboptimal outcomes in zero-shot classification persist, particularly when distinguishing fake content from legitimate information. By highlighting the practical application of fine-tuned LLMs and exploring the potential of few-shot learning for fake news detection, this research provides valuable insights for news organizations seeking to implement scalable and accurate solutions. Ultimately, this work contributes to fostering transparency and integrity in journalism through innovative AI-driven methods for fake news classification and automated fake news classifier systems.

Text Categorization for Information Retrieval Using NLP Models

The paper presents the state-of-the-art natural language processing (NLP) models and methods, such as BERT and DistilBERT, to evaluate textual data and extract noteworthy insights. Preprocessing textual input, tokenization, and the implementation of deep learning architectures such as bidirectional LSTMs for classification tasks are all components of the approach that has been presented. To achieve the goal of producing accurate prediction models with the least amount of validation loss possible. Natural language processing (NLP) is a major focus of the manuscript in multiple areas such as sentiment analysis, language understanding, and text classification. The results show that our proposed NLP models perform exceptionally well. Long-term memory and natural language processing (NLP) go hand in hand. Therefore, these results demonstrate the value and relevance of our natural language processing approach to obtaining unstructured text data to improve and develop a variety of applications, such as chatbots, virtual assistants, and information retrieval systems, as well as to gain insights and help make better decisions, and the flexibility and generalizability of the models, while confirming their ability to handle a range of activities and textual materials. Excellent and accurate results were obtained in terms of validation, with the experimental models often exceeding the 99.85% accuracy benchmark. Another crucial factor to consider is that the average validation loss metrics for all tests remained remarkably low at 0.0058.

Schizophrenia more employable than depression? Language-based artificial intelligence model ratings for employability of psychiatric diagnoses and somatic and healthy controls.

Artificial Intelligence (AI) assists recruiting and job searching. Such systems can be biased against certain characteristics. This results in potential misrepresentations and consequent inequalities related to people with mental health disorders. Hence occupational and mental health bias in existing Natural Language Processing (NLP) models used in recruiting and job hunting must be assessed. We examined occupational bias against mental health disorders in NLP models through relationships between occupations, employability, and psychiatric diagnoses. We investigated Word2Vec and GloVe embedding algorithms through analogy questions and graphical representation of cosine similarities. Word2Vec embeddings exhibit minor bias against mental health disorders when asked analogies regarding employability attributes and no evidence of bias when asked analogies regarding high earning jobs. GloVe embeddings view common mental health disorders such as depression less healthy and less employable than severe mental health disorders and most physical health conditions. Overall, physical, and psychiatric disorders are seen as similarly healthy and employable. Both algorithms appear to be safe for use in downstream task without major repercussions. Further research is needed to confirm this. This project was funded by the London Interdisciplinary Social Science Doctoral Training Programme (LISS-DTP). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Why do consumers purchase energy-efficient kitchen appliance? An analysis based on online review comments.

Kitchen appliances constitute a significant portion of residential energy consumption. Promoting consumer purchases of high-energy-efficient kitchen appliances can effectively facilitate the transition to a low-carbon society. However, the role of energy saving in the current purchasing behavior of Chinese consumers regarding kitchen appliances remains unclear. Based on user-generated content from online e-commerce platforms (N=59,908), this study investigates whether Chinese consumers consider energy efficiency and its influencing factors when purchasing kitchen appliances through natural language processing and structural equation modeling techniques. The study findings reveal that: (1): Perceived energy saving is an important consideration for consumers to adopt kitchen appliances. (2): Prices benefits increase consumers' willingness to purchase energy-efficient appliances. (3): Consumers prioritize energy saving in the purchase of large kitchen appliances. (4): the effect of perceived energy saving on intention to purchase kitchen appliances is much stronger among high energy-efficient appliances. The results of this study propose specific policy recommendations to ensure the continuity of current demand-side energy efficiency policies related to kitchen appliances, utilize pricing mechanisms to incentivize consumers to purchase high-energy-efficient appliances, emphasize the importance of energy consumption of different types of kitchen appliance in environmental education, and establish stricter energy efficiency standards for kitchen appliances.

Widespread use of ChatGPT and other Artificial Intelligence tools among medical students in Uganda: A cross-sectional study.

Chat Generative Pre-trained Transformer (ChatGPT) is a 175-billion-parameter natural language processing model that uses deep learning algorithms trained on vast amounts of data to generate human-like texts such as essays. Consequently, it has introduced new challenges and threats to medical education. We assessed the use of ChatGPT and other AI tools among medical students in Uganda. We conducted a descriptive cross-sectional study among medical students at four public universities in Uganda from 1st November 2023 to 20th December 2023. Participants were recruited by stratified random sampling. We used a semi-structured questionnaire to collect data on participants' socio-demographics and use of AI tools such as ChatGPT. Our outcome variable was use of AI tools. Data were analyzed descriptively in Stata version 17.0. We conducted a modified Poisson regression to explore the association between use of AI tools and various exposures. A total of 564 students participated. Almost all (93%) had heard about AI tools and more than two-thirds (75.7%) had ever used AI tools. Regarding the AI tools used, majority (72.2%) had ever used ChatGPT, followed by SnapChat AI (14.9%), Bing AI (11.5%), and Bard AI (6.9%). Most students use AI tools to complete assignments (55.5%), preparing for tutorials (39.9%), preparing for exams (34.8%) and research writing (24.8%). Students also reported the use of AI tools for nonacademic purposes including emotional support, recreation, and spiritual growth. Older students were 31% less likely to use AI tools compared to younger ones (Adjusted Prevalence Ratio (aPR):0.69; 95% CI: [0.62, 0.76]). Students at Makerere University were 66% more likely to use AI tools compared to students in Gulu University (aPR:1.66; 95% CI:[1.64, 1.69]). The use of ChatGPT and other AI tools was widespread among medical students in Uganda. AI tools were used for both academic and non-academic purposes. Younger students were more likely to use AI tools compared to older students. There is a need to promote AI literacy in institutions to empower older students with essential skills for the digital age. Further, educators should assume students are using AI and adjust their way of teaching and setting exams to suit this new reality. Our research adds further evidence to existing voices calling for regulatory frameworks for AI in medical education.

NaturePred: A Tool for Revolutionizing Natural Product Classification with Artificial Intelligence

Background: The identification and classification of natural products are vital in drug discovery and bioactive compound exploration. Traditional methods are laborious and timeconsuming, necessitating innovative tools for accurate predictions using advanced AI techniques. Objectives: This paper presents NaturePred, a user-friendly tool designed to predict the class of natural products and calculate eight physicochemical properties of protein sequences. It aims to accurately predict five distinct classes of natural product biosynthetic gene clusters (BGCs): Polyketide Synthases (PKS), Non-ribosomal Peptide Synthetases (NRPS), Ribosomally Synthesized and Post- Translationally Modified Peptides (RiPPs), Terpenes, and PKS-NRPS Hybrids. It also addresses reliability in multi-class classification with a 90% confidence score threshold. Method: NaturePred offers three input options: single protein sequence, CSV file, or GenBank (.gbk) file. It uses a pipeline with a Natural Language Processing model based on TF-IDF (Term Frequency- Inverse Document Frequency) and a Logistic Regression classifier. Predictions are made if the confidence score exceeds 90%; otherwise, "None of the above class" is predicted. Evaluation with unseen data from the MiBIG database shows high accuracy (~96%) in assigning BGCs. Results: NaturePred provides accurate predictions with high confidence scores, demonstrating reliability across different datasets. It calculates eight physicochemical properties of protein sequences, offering valuable insights for further analysis. Conclusion: NaturePred's integrated features, including versatile input options, accurate predictions, and physicochemical property calculations, make it an indispensable tool in natural product research. By addressing classification challenges, NaturePred facilitates drug discovery and bioactive compound exploration, advancing the field. Tool available: (http://login1.cabgrid.res.in:5101/).

SOCIAL DETERMINANTS OF HEALTH ASSOCIATED WITH 30-DAY REHOSPITALIZATION BY USING DISCHARGE SUMMARIES

Abstract Background There has been increasing interest in the use of Social Determinants of Health (SDOH) in cardiovascular disease outcomes by reducing health disparities. For example, Centers for Medicare and Medicaid Services will require the hospitals reporting five SDOH components (housing, intimate partner violence, utilities, food insecurity and transportation insecurity) in 2025. There is limited evidence which SDOH components are associated with 30-day rehospitalization in HF patients who were in the ICU. Objective: To assess associations between the SDOH and 30-day rehospitalization in HF patients who were in the ICU by using the Medical Information Mart for Intensive Care III (MIMIC-III) data. Methods We identified HF patients by using ICD-9 codes related to HF from the MIMIC-III data that is de-identified and is publicly available. We used python to extract SDOH features from discharge summaries and used Chi-square statistical test (whether or not keyword is contained in discharge summaries vs whether or not HF patients have 30-day hospital rehospitalization). Results Mean age was 71 (± 14.2), 53% were male, and 73% were white. In particular, keyword “daughter” contributes to the 30-day rehospsitalization. It is unclear how daughter contributes 30-day rehospitalization but “daughter can be one of the SDOH components as social support. Conclusion It is difficult to identify how “daughter” is related to 30-day rehospitalization. We will utilize natural language processing models to analyzing the real-world social meaning of SDOH keywords to understand the correlation (e.g. the “daughter” reflecting patients have daughter accompany or other status).

ChatGPT 기능이 대학생의 학습성과와 학업성취도를 매개로 지속이용의도에 미치는 영향

With the change of the 4th Industrial Revolution era and the radical development of computing technology, the importance of software is increasing and software technology is being used in all industries throughout life. In addition, chatGPT, a GPT-based interactive artificial intelligence service developed by Open AI, is also showing rapid development. Based on a vast knowledge database, chatGPT provides sophisticated answers in a variety of knowledge areas. As chatGPT gradually develops, it is being used to perform tasks that require human intelligence, especially its impact on education is increasing. chatGPT, based on artificial intelligence (AI), is a natural language processing model that allows users to understand and solve programming concepts and problems in natural language, analyzes learners' questions and answers, and provides an optimized learning path to individual learners, thereby improving learning efficiency or learning outcomes. This paper focuses on the effect of chatGPT on college students' learning outcomes, achievements, and continuous use intention. Therefore, in this study, the concept of chatGPT and the user's intention to continue using it were clarified by classifying it into five functions: efficiency, convenience, problem-solving ability, usefulness, and interaction. In addition, in this study, two parameters, learning outcomes and academic achievement, were presented, and a corresponding research model was presented. Samples were collected using questionnaires and the hypothesis was verified by questionnaire analysis using SPSS 23.0 and Smart PLS 4.0. The following conclusions were drawn. First, H1 was partially accepted. Second, because the convenience of chatGPT did not have a positive effect on academic performance and academic achievement, H1-2 and H2-2 were rejected. chatGPT was adopted because its efficiency, usefulness, and interactivity had a significant impact on learning outcomes and academic achievement. Therefore, H2 is partially accepted. Third, because learning outcomes have a significant impact on the intention to continue using chatGPT, H3 was adopted. Fourth, because academic achievement had a significant effect on the intention to continue using chatGPT, H4 was adopted.

Electronic Health Records (EHR) Extraction Using Various NLP Models

Information recorded in electronic medical health records, clinical reports, and summaries has the possibility of revolutionizing health-related research and its corresponding industry. EMR data can be used for epidemiological studies, disease registries, data banks, drug safety surveillance, clinical trials, and healthcare audits. With the rapid adoption of electronic health records (EHRs), it is desirable to harvest information and knowledge from EHRs to support automated systems and to enable secondary use of EHRs for clinical and translational research; thereby increasing efficiency. One critical component which is predominantly used to facilitate the secondary use of EHR data is information extraction (IE) task, which automatically extracts and encodes clinical information from a given text. Now, a natural language processing model (NLP) focuses on “developing computational models for understanding the interaction between data science and language”. In the clinical domain, researchers have often used NLP systems to identify clinical syndromes and common biomedical concepts from imaging data, radiology reports, discharge summaries, problem lists, nursing documentation, drug reviews, and medical education documents. These data can help doctors determine patients' health condition(s) including diagnostic information, procedures and tests performed, treatment results, drugs administered, and more. Therefore, we hope to gain some insights and develop strategies to improve the utilization of these NLP systems in the clinical domain. We hope to provide a vision for addressing the existing data challenge(s) in this domain. For this, we would look at the various models that have been used/published over the years and test them for their attributes including effectiveness, accuracy, precision, etc. We believe that adding a probabilistic graphical model framework for structured output prediction would further improve the performance of our system. This experiment remains our future work.

Information extraction from green channel textual records on expressways using hybrid deep learning

The expressway green channel is an essential transportation policy for moving fresh agricultural products in China. In order to extract knowledge from various records, this study presents a cutting-edge approach to extract information from textual records of failure cases in the vertical field of expressway green channel. We proposed a hybrid approach based on BIO labeling, pre-trained model, deep learning and CRF to build a named entity recognition (NER) model with the optimal prediction performance. Eight entities are designed and proposed in the NER processing for the expressway green channel. three typical pre-trained natural language processing models are utilized and compared to recognize entities and obtain feature vectors, including bidirectional encoder representations from transformer (BERT), ALBERT, and RoBERTa. An ablation experiment is performed to analyze the influence of each factor on the proposed models. Used the survey data from the expressway green channel management system in Shaanxi Province of China, the experimental results show that the precision, recall, and F1-score of the RoBERTa-BiGRU-CRF model are 93.04%, 92.99%, and 92.99%, respectively. As the results, it is discovered that the text features extracted from pre-training substantially enhance the prediction accuracy of deep learning algorithms. Surprisingly, the RoBERTa model is highly effective in the task for the expressway green channel NER. This study provides a timely and necessary knowledge extraction on the Expressway Green Channel in terms of textual data, offering a systematical explanation of failure cases and valuable insights for future research.

Efficient analysis of drug interactions in liver injury: a retrospective study leveraging natural language processing and machine learning

BackgroundLiver injury from drug-drug interactions (DDIs), notably with anti-tuberculosis drugs such as isoniazid, poses a significant safety concern. Electronic medical records contain comprehensive clinical information and have gained increasing attention as a potential resource for DDI detection. However, a substantial portion of adverse drug reaction (ADR) information is hidden in unstructured narrative text, which has yet to be efficiently harnessed, thereby introducing bias into the research. There is a significant need for an efficient framework for the DDI assessment.MethodsUsing a Chinese natural language processing (NLP) model, we extracted 25,130 adverse drug reaction (ADR) records, dividing them into sets for training an automated normalization model. The trained models, in conjunction with liver function laboratory tests, were used to thoroughly and efficiently identify liver injury cases. Ultimately, we applied a case-control study design to detect DDI signals increasing isoniazid’s liver injury risk.ResultsThe Logistic Regression model demonstrated stable and superior performance in classification task. Based on laboratory criteria and NLP, we identified 128 liver injury cases among a cohort of 3,209 patients treated with isoniazid. Preliminary screening of 113 drug combinations with isoniazid highlighted 20 potential signal drugs, with antibacterials constituting 25%. Sensitivity analysis confirmed the robustness of signal drugs, especially in cardiac therapy and antibacterials.ConclusionOur NLP and machine learning approach effectively identifies isoniazid-related DDIs that increase the risk of liver injury, identifying 20 signal drugs, mainly antibacterials. Further research is required to validate these DDI signals.

Engineering of Generative Artificial Intelligence and Natural Language Processing Models to Accurately Identify Arrhythmia Recurrence.

Large language models (LLMs), such as ChatGPT, excel at interpreting unstructured data from public sources, yet are limited when responding to queries on private repositories, such as electronic health records (EHRs). We hypothesized that prompt engineering could enhance the accuracy of LLMs for interpreting EHR data without requiring domain knowledge, thus expanding their utility for patients and personalized diagnostics. We designed and systematically tested prompt engineering techniques to improve the ability of LLMs to interpret EHRs for nuanced diagnostic questions, referenced to a panel of medical experts. In 490 full-text EHR notes from 125 patients with prior life-threatening heart rhythm disorders, we asked GPT-4-turbo to identify recurrent arrhythmias distinct from prior events and tested 220 563 queries. To provide context, results were compared with rule-based natural language processing and BERT-based language models. Experiments were repeated for 2 additional LLMs. In an independent hold-out set of 389 notes, GPT-4-turbo had a balanced accuracy of 64.3%±4.7% out-of-the-box at baseline. This increased when asking GPT-4-turbo to provide a rationale for its answers, requiring a structured data output, and providing in-context exemplars, rose to a balanced accuracy of 91.4%±3.8% (P<0.05). This surpassed the traditional logic-based natural language processing and BERT-based models (P<0.05). Results were consistent for GPT-3.5-turbo and Jurassic-2 LLMs. The use of prompt engineering strategies enables LLMs to identify clinical end points from EHRs with an accuracy that surpassed natural language processing and approximated experts, yet without the need for expert knowledge. These approaches could be applied to LLM queries for other domains, to facilitate automated analysis of nuanced data sets with high accuracy by nonexperts.

GPT-4 shows potential for identifying social anxiety from clinical interview data

While the potential of Artificial Intelligence (AI)—particularly Natural Language Processing (NLP) models—for detecting symptoms of depression from text has been vastly researched, only a few studies examine such potential for the detection of social anxiety symptoms. We investigated the ability of the large language model (LLM) GPT-4 to correctly infer social anxiety symptom strength from transcripts obtained from semi-structured interviews. N = 51 adult participants were recruited from a convenience sample of the German population. Participants filled in a self-report questionnaire on social anxiety symptoms (SPIN) prior to being interviewed on a secure online teleconference platform. Transcripts from these interviews were then evaluated by GPT-4. GPT-4 predictions were highly correlated (r = 0.79) with scores obtained on the social anxiety self-report measure. Following the cut-off conventions for this population, an F1 accuracy score of 0.84 could be obtained. Future research should examine whether these findings hold true in larger and more diverse datasets.

The Force of Popularity: A Study on Audience Metrics and News Placement with NLP Models

ABSTRACT Amidst the widespread adoption of audience metrics in newsrooms, editors were found to make news decisions based on clicks alongside traditional journalistic standards such as news values and news types. It raised concerns about editorial independence. The study relied on extensive content analysis of news stories from six US newspapers, supported by the Natural Language Processing model, to investigate the possible impacts of story popularity on news placement. The results revealed strong and consistent relationships between popularity and story placement, overriding the effects of news types and news values.

Leveraging Large Language Models in Tourism: A Comparative Study of the Latest GPT Omni Models and BERT NLP for Customer Review Classification and Sentiment Analysis

In today’s rapidly evolving digital landscape, customer reviews play a crucial role in shaping the reputation and success of hotels. Accurately analyzing and classifying the sentiment of these reviews offers valuable insights into customer satisfaction, enabling businesses to gain a competitive edge. This study undertakes a comparative analysis of traditional natural language processing (NLP) models, such as BERT and advanced large language models (LLMs), specifically GPT-4 omni and GPT-4o mini, both pre- and post-fine-tuning with few-shot learning. By leveraging an extensive dataset of hotel reviews, we evaluate the effectiveness of these models in predicting star ratings based on review content. The findings demonstrate that the GPT-4 omni family significantly outperforms the BERT model, achieving an accuracy of 67%, compared to BERT’s 60.6%. GPT-4o, in particular, excelled in accuracy and contextual understanding, showcasing the superiority of advanced LLMs over traditional NLP methods. This research underscores the potential of using sophisticated review evaluation systems in the hospitality industry and positions GPT-4o as a transformative tool for sentiment analysis. It marks a new era in automating and interpreting customer feedback with unprecedented precision.