Speech Tagging Research Articles

COVID-19 INFODEMIC – UNDERSTANDING CONTENT FEATURES IN DETECTING FAKE NEWS USING A MACHINE LEARNING APPROACH

The use of content features, particularly textual and linguistic for fake news detection is under-researched, despite empirical evidence showing the features could contribute to differentiating real and fake news. To this end, this study investigates a selection of content features such as word bigrams, part of speech distribution etc. to improve fake news detection. We performed a series of experiments on a new dataset gathered during the COVID-19 pandemic using Decision Tree, K-Nearest Neighbor, Logistic Regression, Support Vector Machine and Random Forest. Random Forest yielded the best results, followed closely by Support Vector Machine, across all setups. In general, both the textual and linguistic features were found to improve fake news detection when used separately, however, combining them into a single model did not improve the detection significantly. Differences were also noted between the use of bigrams and part of speech tags. The study shows that textual and linguistic features can be used successfully in detecting fake news using the traditional machine learning approach as opposed to deep learning.

Product review opinion based on sentiment analysis

Sentiment analysis is a natural language processing (NLP) technique for determining emotional tone in a body of text. Using product reviews in sentiment analysis and opinion mining various methods have been developed previously. Although, existing product review analyzing techniques could not accurately detect the product aspect and non-aspect. Hence a novel Detach Frequency Assort is proposed to detect the product aspect term using TF-ISF (Term frequency-inverse sentence frequency) with Part of Speech (POS) tags for sentence segmentation and additionally using Feedback Neural Network to combine product aspect feedback loop. Furthermore, decision-making problem occurs during classification of sentiments. Hence, to solve this problem a novel technique named, Systemize Polarity Shift is proposed in which flow search based Support Vector Machine (SVM) with Bag of Words model classifies pre-trained review comments as positive, negative, and neutral sentiments. Moreover, the identification of specific products is not focused in sentiment analysis. Hence, a novel Revival Extraction is proposed in which a specific product is extracted based on thematic analysis method to obtain accurate data. Thus, the proposed Product Review Opinion framework gives effective optimized results in sentiment analysis with high accuracy, specificity, recall, sensitivity, F1-Score, and precision.

A deep learning approach to building a framework for Urdu POS and NER

The study examines various studies on Named Entity Recognition (NER) and Part of Speech (POS) tagging for the Urdu language conducted by academics and researchers. POS and NER tagging for Urdu still faces obstacles in terms of increasing accuracy while lowering false-positive rates and labelling unknown terms, despite the efforts of numerous researchers. In addition, ambiguity exists when tagging terms with different contextual meanings within a sentence. Due to the fact that Urdu is an inflectional, derivational, morphologically rich, and context-sensitive language, the existing models, such as Linguistic rule application, N-gram Markov model, Tree Tagger, random forest (RF) tagger, etc., were unable to produce accurate experimental results on Urdu language data. The significance of this study is that it fills a gap in the literature concerning the lack of POS and NER tagging for the Urdu language. For Urdu POS and NER tagging, we propose a deep learning model with a well-balanced set of language-independent features as well as a survey of important Urdu POS/NER techniques. In addition, this is the first study to use residual biDirectional residual Long short-term memory (residual biLSTM) architecture trained on the Urmono dataset in conjunction with the randomly initialised word2vec, fastText and mBERT embeddings are utilised to generate word or character vectors.For each experiment, the paper also employs the evaluation methods of Macro-F1, precision, precision, and recall. The proposed method with mbert embedding as word vectors provides best results of F1 score for POS and NER at 91.11% and 99.11% respectively. Also, the accuracy, precision and recall for POS are reported at 94.85%, 91.79% and 90.77%. Similarly, the accuracy, precision and recall for NER of the proposed model are reported at 99.77%, 98.78% and 99.45% respectively, which are higher than baseline models.

Tagging Efficiency Analysis of Part of Speech Taggers on Indonesian News

Tagging Efficiency Analysis of Part of Speech Taggers on Indonesian News

An Emotion-Based Rating System for Books Using Sentiment Analysis and Machine Learning in the Cloud

Sentiment analysis (SA), and emotion detection and recognition from text (EDRT) are recent areas of study that are closely related to each other. Sentiment analysis strives to identify and detect neutral, positive, or negative feelings from text. On the other hand, emotion analysis seeks to identify and distinguish types of feelings such as happiness, surprise, grief, disgust, fear, and anger through the expression of texts. We suggest a four-level strategy in this paper for recommending the best book to users. The levels include semantic network grouping of comparable sentences, sentiment analysis, reviewer clustering, and recommendation system. The semantic network groups comparable sentences at the first level utilizing pre-processed data from reviewer and book datasets using the parts of speech (POS) tagger. In order to extract keywords from the pre-processed data, feature extraction uses the bag of words (BOW) and term frequency-inverse document frequency (TF-IDF) approaches. SA is performed at the second level in two phases: training and testing, employing deep learning methodologies such as convolutional neural networks (CNN)-long short-term memory (LSTM). The results of this level are sent into the third level (clustering), which uses the clustering method to group the reviewers by age, location, and gender. In the last level, the model assessment is carried out with accuracy, precision, recall, sensitivity, specificity, G-mean, and F1-measure. The book suggestion system is designed to provide the highest level of accuracy within a minimum number of epochs when compared to the state-of-the methods, SVM, CNN, ANN, LSTM, and Bi-directional (BI)-LSTM.

Exploring the Performance of Farasa and CAMeL Taggers for Arabic Dialect Tweets

In Natural Language Processing (NLP), Part Of Speech (POS) tagging is an important step; it is a fundamental requirement for many applications, such as information extraction, machine translation, and grammar checking. Successful POS taggers have been developed for many languages, including Arabic. Currently, the spread of social media has increased the diversity of dialects as people use them in their online communications. Therefore, it has become more difficult for researchers to classify some words that are understood by humans but not computers. In addition, most Arabic POS research focuses on Modern Standard Arabic (MSA), while Dialect Arabic (DA) receives less attention. This paper aims to evaluate the performance of two Arabic taggers when used on dialect Arabic tweets and determine which tagger is the appropriate one, which will accordingly help to improve the existent taggers for dialect Arabic tweets. We used the Farasa and CAMeL taggers, which are commonly used to analyze Arabic texts and are considered the best taggers for Arabic. The results indicate that CAMeL tagger performed better than Farasa tagger, with accuracies of 92% and 83% respectively. In other words, a hybrid POS tagger trained with MSA and DA returns better results than the one trained on MSA.

Intelligent Part of Speech tagger for Hindi

English Part of Speech like noun, verb, adverb, adjective, pronoun, preposition, interjection, conjunction is somewhat similar in Hindi but not exactly the same. Hindi grammar has different Part of Speech (POS) based on its morphological features and the occurrence of a word/lexeme in a sentence. The existing techniques used in English language for POS tagging may not work properly for Indian language like Hindi. It is because the grammatical structure of the relatively free word order language like Hindi differs from English. Stochastic taggers may not give good performance as morphological information is not taken into account. The available Hindi word corpora usually have less frequency for individual tags. As a result, a larger size corpus having diversity in the type of sentences can provide better results. But, even after using smoothing techniques most these taggers fail to provide correct results in the presence of unknown words. Considering these aspects, this paper proposes an Intelligent POS tagger for Hindi language based on VITERBI and K-Nearest Neighbour, capable of providing more accurate results than VITERBI in the presence of unknown words.

Aspect-Based Sentiment Analysis for Social Multimedia: A Hybrid Computational Framework

People utilize microblogs and other social media platforms to express their thoughts and feelings regarding current events, public products and the latest affairs. People share their thoughts and feelings about various topics, including products, news, blogs, etc. In user reviews and tweets, sentiment analysis is used to discover opinions and feelings. Sentiment polarity is a term used to describe how sentiment is represented. Positive, neutral and negative are all examples of it. This area is still in its infancy and needs several critical upgrades. Slang and hidden emotions can detract from the accuracy of traditional techniques. Existing methods only evaluate the polarity strength of the sentiment words when dividing them into positive and negative categories. Some existing strategies are domain-specific. The proposed model incorporates aspect extraction, association rule mining and the deep learning technique Bidirectional Encoder Representations from Transformers (BERT). Aspects are extracted using Part of Speech Tagger and association rule mining is used to associate aspects with opinion words. Later, classification was performed using BER. The proposed approach attained an average of 89.45% accuracy, 88.45% precision and 85.98% recall on different datasets of products and Twitter. The results showed that the proposed technique achieved better than state-of-the-art sentiment analysis techniques.

Neural Attention Model for Abstractive Text Summarization Using Linguistic Feature Space

Summarization generates a brief and concise summary which portrays the main idea of the source text. There are two forms of summarization: abstractive and extractive. Extractive summarization chooses important sentences from the text to form a summary whereas abstractive summarization paraphrase using advanced and nearer-to human explanation by adding novel words or phrases. For a human annotator, producing summary of a document is time consuming and expensive because it requires going through the long document and composing a short summary. An automatic feature-rich model for text summarization is proposed that can reduce the amount of labor and produce a quick summary by using both extractive and abstractive approach. A feature-rich extractor highlights the important sentences in the text and linguistic characteristics are used to enhance results. The extracted summary is then fed to an abstracter to further provide information using features such as named entity tags, part of speech tags and term weights. Furthermore, a loss function is introduced to normalize the inconsistency between word-level and sentence-level attentions. The proposed two-staged network achieved a ROUGE score of 37.76% on the benchmark CNN/DailyMail dataset, outperforming the earlier work. Human evaluation is also conducted to measure the comprehensiveness, conciseness and informativeness of the generated summary.

An Hybrid Part of Speech Tagger for Setswana Language using a Voting Method

Part-of Speech (PoS) tagging is a corpus linguistics that deals with assigning appropriate lexical categories to each word in a sentence. To effectively address challenges associated with PoS tagging, several Natural Language Processing (NLP) tasks modelling techniques have been employed, including Conditional Random Fields (CRF), Support Vector Machines (SVM), and Decision Trees in diverse languages. These PoS taggers implement the process of associating the correct PoS (nouns, verbs, adjectives, adverbs, etc.) with each word in a sentence. However, creating language resources is an expensive process for many languages, including the indigenous languages of South Africa that are classified as resource-scarce. Therefore, using Setswana as a language with limited resources, this study explores and applies methods to increase the utilization of existing resources and tagger accuracy. This is done using Setswana's two PoS taggers: a Maximum Entropy (MaxEnt) and an SVM, which achieved an accurateness of 94.4 per cent and 95.59 per cent respectively. To find errors in the taggers, an error analysis is carried out. The Setswana PoS Tagger was then built using a voting algorithm to improve results and attain 97.06 per cent accuracy. The combination of taggers reduces the error rate by up to 2.01 per cent.

Neural POS tagging of shahmukhi by using contextualized word representations

Part of Speech (POS) tagging has a preliminary role in building natural language processing applications. This paper presents the development and evaluation of the first POS tagged corpus along with a Bi-directional long-short memory (BiLSTM) network based POS tagger for Shahmukhi (Western Punjabi) at this scale. A balanced corpus of 0.13 million words has been annotated which contains text from 14 different text domains. A Shahmukhi POS tagset has been devised by studying the applicability of the CLE Urdu POS tagset and tagging guidelines have also been designed for annotation. A multi-step corpus evaluation process has been employed for tagged corpus including grammar-based and n-gram based consistency evaluations. The average inter-annotator agreement for all domains is 95.35% along with an average Kappa coefficient of 0.94. The performance of the BiLSTM POS tagger has been compared with the well-known language independent TreeTagger and the Stanford POS tagger. The accuracy of the tagger has been further improved by employing transfer learning by training context-free (Word2Vec) and contextualized (ELMo) word representations on a corpus of 14.9 Shahmukhi words which has been collected from World Wide Web. The tagger performed with an f-score of 96.11 and the accuracy of 96.12%. For a morphologically-rich and low-resourced language, these POS tagging results are quite promising.

A Grammatically and Structurally Based Part of Speech (POS) Tagger for Arabic Language

In this paper we report on an experimental syntactically and morphologically driven rule-based Arabic tagger. The tagger is developed using Arabic language grammatical rules and regulations. The tagger requires no pre-tagged text and is developed using a primitive set of lexicon items along with extensive grammatical and structural rules. It is tested and compared to Stanford tagger both in terms of accuracy and performance (speed). Obtained results are quite comparable to Stanford tagger performance with marginal difference favoring the developed tagger in accuracy with huge difference in terms of speed of execution. The newly developed tagger named MTE Tagger has been tested and evaluated. For the evaluation of its accuracy of tagging, a set of Arabic text was manually prepared and annotated. Compared to Stanford tagger, the MTE tagger performance was quite comparable. The developed tagger makes use of no pre-annotated datasets, except of some simple lexicon consisting of list of words representing closed word types like demonstrative nouns or pronouns or some particles. For the purpose of evaluation of the new tagger, it was run on multiple datasets and results were compared to those of Stanford tagger. In particular, both taggers (the MTE and the Stanford) were run on a set of 1226 sentences with close to 20,000 tokens that was human annotated and verified to serve as testbed. The results were very encouraging where in both test runs, the MTE tagger outperformed the Stanford tagger in terms of accuracy of 87.88% versus 86.67% for the Stanford tagger. In terms of speed of tagging and in comparison Stanford tagger, MTE Taggers’ performance was on average 1:50. More improved accuracy is possible in future work as the set of rules are further optimized, integrated and more of Arabic language properties such as end of word discretization are used.

Model Based Approach to Extract Health Information from Textual Data

In current nuclear power plants (NPPs) a large amount of condition-based data is being generated and stored to assess and monitor component health and performance. The format of this data can be either numeric (e.g., pump vibration data) or textual (e.g., condition report which assess component health). While assessing component health from numeric data can be performed with a large variety of methods, the extraction of information from textual data still remains a challenge. Natural language processing (NLP) methods are starting to be deployed in current NPPs mainly to filter out incident reports (IRs) that are not safety related by employing supervised machine learning methods. However, these methods do not really provide the quantitative information that might be contained in IRs. This paper presents an approach to extract information from textual data (e.g., from IRs, maintenance reports) that is based on NLP data analytics methods coupled with model based system engineer (MBSE) models. NLP methods are employed to perform syntactic and semantic analyses. Syntactic analysis analyzes the grammatical structure of a sentence; such analysis includes: part of speech (POS) tagging (i.e., identification of grammatic elements of each string - e.g., nouns, verbs), named entity recognition (i.e., identification of text entities - e.g., names, dates, events), and relation extraction (e.g., coreference resolution). On the other hand, semantic analysis is designed to analyze the logic structure of a sentence. Through a specific set of rules, our methods can identify whether a sentence contains health information of a component (e.g., degraded performance, anomaly behavior) or the causal relationship between two events (i.e., a cause-effect pair). An innovative element of our approach is that semantic analysis relies on MBSE models to identify links between textual elements. MBSE are diagrams designed to represent system and component dependencies (from both a form and functional point of view). In our approach, MBSE models emulate system engineer knowledge about component/system architecture. This paper presents in detail how the integration of NLP methods and MBSE models is performed. Few analysis examples focusing on centrifugal pumps will be presented.

Analysis of Telkom University News Subjects on Popular Indonesian News Portals Using a Combination of Hidden Markov Model (HMM) and Rule Based Methods

News media are often found in everyday life as a means of information for the public about something that is happening. In news articles, it is common to see several sentences that support the object to increase its popularity by being promoted by the subject. Part of Speech Tagging can determine the class of words in the sentence according to Tagsets provided by the corpus. That way, the search for the subject in the news article can be found from the word class obtained from a corpus. This research was focused on finding the subject "who" repeatedly spreading the news about Telkom University by using Part of Speech Tagging with the Hidden Markov Model and Rule Based on a news dataset from popular news portals about Telkom University. The process is taking all news about Telkom University on popular news portals and classifying it using the Hidden Markov Model and Rule-Based. We conducted to enhance the research results by changing the probability estimator on Hidden Markov Model. After running some scenarios, the best results obtained by the Hidden Markov Model and Rule-Based are the Accuracy of 94.96%, the Precision of 94.99%, the Recall of 94.96%, and the F1-Score of 94.95%.

Sentiment analysis on social media tweets using dimensionality reduction and natural language processing

AbstractSocial media has been embraced by different people as a convenient and official medium of communication. People write or share messages and attach images and videos on Twitter, Facebook and other social media platforms. It therefore generates a lot of data that is rich in sentiments. Sentiment analysis has been used to determine the opinions of clients, for instance, relating to a particular product or company. Lexicon and machine learning approaches are the strategies that have been used to analyze these sentiments. The performance of sentiment analysis is, however, distorted by noise, the curse of dimensionality, the data domains and the size of data used for training and testing. This article aims at developing a model for sentiment analysis of social media data in which dimensionality reduction and natural language processing with part of speech tagging are incorporated. The model is tested using Naïve Bayes, support vector machine, and K‐nearest neighbor algorithms, and its performance compared with that of two other sentiment analysis models. Experimental results show that the model improves sentiment analysis performance using machine learning techniques.

What we talk about when we talk about EEMs: using text mining and topic modeling to understand building energy efficiency measures (1836-RP)

Energy Efficiency Measures (EEMs) play a central role throughout the building energy efficiency industry, and lists of EEMs therefore exist in a variety of resources. However, each of these use different conventions for describing and organizing measures, which presents a major challenge for aggregating information across these resources. The goal of this study is to discover trends in how existing resources describe and organize EEMs using topic modeling and other text mining methods. A unique dataset of 3,490 EEMs from 16 different documents was compiled and analyzed using frequency analysis, part of speech tagging, and topic modeling. The results showed three major trends. First, a typical EEM contains six words and is phrased in verb-noun format, although these characteristics varied widely. Second, there are words and bigrams commonly used across many EEMs, and these include action words, specific building components, broader building systems, and descriptor terms. Third, there are thematic similarities between the EEM lists, which in some cases highlight the ways in which these lists are derived from one another. These findings provide insight into the nature of EEMs and can be used as the basis for developing a standardized system for organizing and describing EEMs.

A scoping review of preprocessing methods for unstructured text data to assess data quality

Introduction Unstructured text data (UTD) are increasingly found in many databases that were never intended to be used for research, including electronic medical record (EMR) databases. Data quality can impact the usefulness of UTD for research. UTD are typically prepared for analysis (i.e., preprocessed) and analyzed using natural language processing (NLP) techniques. Different NLP methods are used to preprocess UTD and may affect data quality. Objective Our objective was to systematically document current research and practices about NLP preprocessing methods to describe or improve the quality of UTD, including UTD found in EMR databases. Methods A scoping review was undertaken of peer-reviewed studies published between December 2002 and January 2021. Scopus, Web of Science, ProQuest, and EBSCOhost were searched for literature relevant to the study objective. Information extracted from the studies included article characteristics (i.e., year of publication, journal discipline), data characteristics, types of preprocessing methods, and data quality topics. Study data were presented using a narrative synthesis. Results A total of 41 articles were included in the scoping review; over 50% were published between 2016 and 2021. Almost 20% of the articles were published in health science journals. Common preprocessing methods included removal of extraneous text elements such as stop words, punctuation, and numbers, word tokenization, and parts of speech tagging. Data quality topics for articles about EMR data included misspelled words, security (i.e., de-identification), word variability, sources of noise, quality of annotations, and ambiguity of abbreviations. Conclusions Multiple NLP techniques have been proposed to preprocess UTD, with some differences in techniques applied to EMR data. There are similarities in the data quality dimensions used to characterize structured data and UTD. While a few general-purpose measures of data quality that do not require external data; most of these focus on the measurement of noise.

Analyzing Moravian Feelings Using Computational Methods to Ask Questions about Norms and Sentiments in Eighteenth-Century Moravian Lebensläufe

ABSTRACT This article introduces a computational methodology of analysis to enhance and assist in understanding the occurrences of sentiment in a sample eighteenth-century corpus of German and English Moravian memoirs (Lebensläufe). The computational methods used include sentiment tagging and scoring to derive sentiment trendlines, part of speech (POS) tagging with lemmatization (grouping inflected forms together as a single base form), word frequency analysis, semantic tagging in XML-compliant TEI, and “key word” analysis. This analysis using DH (Digital Humanities) methods, sentiment trendlines, and contextual word usage can give a more complete picture of how sentiment is used in Moravian memoirs. The corpus of forty-eight transcribed German and English memoirs from the Moravian Lives transcription desk on the project website (https://moravian.bucknell.edu) is originally from both the Moravian Archives in Bethlehem, Pennsylvania, and the former Fetter Lane Archive, now kept at Church House Archives in Muswell Hill, London, UK.

POS Tagger Improvisation with the Addition of Foreign Word Labels on Telkom University News

News is a medium of daily information usually obtained by the public. The news consists of a lot of information in it and is composed of sentence structures. Each language is unique with its own sentence structure, like Indonesian and other foreign languages. But nowadays, many media mix Indonesian with foreign languages, making the sentence structure different from Bahasa Indonesia. To classify these words, Part Of Speech Tagging needed to determine the class of words composed of sentences by learning from the Corpus of each language. With the new sentence structure, POS Tagger requires a larger Corpus to learn. The language structure can determine the results of tagging from the POS Tagger. If there are words that are not in the Corpus, it can reduce the accuracy of the POS Tagger. We conducted to enhance the research results by adding data with a different sentence structure from the Indonesian Language Corpus using sentences from online media. Added about 242 sentences with 7,043 tokens on Corpus focused on Foreign Word tags, which total 3819 tags. After doing some testing and scenarios, the results of the accuracy of POS Tagger show an accuracy of 94.7% using the Hidden Markov Model method with the F1-Score tag FW 78%.

Advanced Intelligent English Translation Based on Multisensor Data Fusion Optimization

English translation activity course is of great significance to cultivate students’ English translation level. In the context of multisensor data fusion, how to effectively carry out English translation activity course in colleges and universities has become an important topic. The educational value and intellectual property of advanced Intelligent English translation activity course are analyzed. From multisensor data fusion and the improvement of translation, translators psychological changes of the boot and prominent features, English translation activity and translation, the generality of the multisensor data fusion of multisensor data fusion personalization features this four aspects, which is under the background of the sensor data fusion of the practice for college English translation activity. Firstly, the theory of data fusion estimation is elaborated, and various data fusion structures in multisensor systems are summarized. Then, the data fusion estimation model based on Kalman filter is established, and the Kalman filtering algorithms of centralized, sequential, parallel, and joint structures are given, respectively. Simulation experiments are carried out on the algorithms. Experimental results show that the estimation accuracy of the system can be improved by multisensor data fusion. Then a rule-based lexical analyzer is designed. Combined with the system model, a rule-based lexical analyzer and a comprehensive dictionary, the linguistic knowledge source throughout the whole machine translation process, are researched and designed. A hashing algorithm for lexical retrieval is designed, and various rules and data structures related to the lexical analyzer are described in formal language. The analysis algorithms of morphological preprocessing, morphological analysis, unincluded word processing, phrase analysis, and part of speech tagging are introduced.