A decision-making framework utilizing machine learning techniques, based on analysing the sentiment of tweets

Abstract

Before making any decision, especially a financial one, people use social media to chat to, learn about, and obtain advice from others. How can social media opinions be relied on and utilised economically? Due to social media sites like Facebook and Twitter, where millions of individuals offer real-time thoughts on anything using slang and emoticons, data science researchers have access to more unstructured yet useful information. Social media includes Twitter. 326 million active social media users sent 500 million tweets daily in July 2018, indicating the sector's rapid expansion. Tweets can be viewed, edited, and sent. Knowing how to interpret tweets, which might be facts or views, is helpful. Such a study may predict the stock market, election, response event, news, and subjectivity scales. Tweets are analysed using Sentiment Analysis (SA). On the other hand, Sentiment analysis provides a broad overview of tweet polarity and is not beneficial for decision-making. In this research, we design a natural language processing (NLP) Twitter SA model to overcome the challenges of tweet sentiment recognition and build a hybrid system that can recognise and classify sentiment in Twitter's real-time reactions to any topic. We use a three-classifier machine learning method to analyse tweets from the Sentiment140 dataset (Logistic Regression, Bernoulli Naive Bayes, and SVM). Our findings are supported by the Term Frequency-Inverse Document Frequency analysis (TF-IDF). After that, accuracy and F1 Scores are used to evaluate these classifiers.