International Journal of Application or Innovation in Engineering & Management (IJAIEM)

Web Site: www.ijaiem.org Email: editor@ijaiem.org

Volume 8, Issue 7, July 2019 ISSN 2319 - 4847

Sentiment Analysis of tweets using bag of

words
1
Pooja Pande, 2Prachi Thakar and3Yash Raut
1
U.G. Student, Department of Computer Science &Engineering,Prof. Ram Meghe College of Engineering& Management,
Badnera, Maharashtra, India
2
Assistant Professor, Department of Computer Science &Engineering,Prof. Ram Meghe College of Engineering&
Management, Badnera, Maharashtra, India
3
U.G. Student, Department of Computer Science &Engineering,Prof. Ram Meghe College of Engineering& Management,
Badnera, Maharashtra, India

ABSTRACT
Internet based life investigation is the way toward gathering information from prevalent person to person communication
benefits and anticipating the general visibility on some random area dependent on the examination of the gathered
information. This is accomplished utilizing AI and normal language handling strategies, alongside different python libraries,
for example, matplotlib, tweepy and textblob. The slant examination device has a basic UI, which requests a catchphrase
dependent on which investigations of the tweets containing the watchword are isolated and measurably spoke to as far as the
suppositions being communicated as positive, negative or nonpartisan. The initial move towards preparing the AI model starts
with gathering the datasets that are made accessible utilizing the Twitter API, which is accomplished utilizing the Tweepy
library.
It offers named datasets that can be utilized to effectively prepare the AI model. The tweet handling and arrangement is
finished utilizing the textblob library, which offers a straightforward API for characteristic language preparing undertakings,
for example, assessment investigation and order. With this content classifier, we can mark each Tweet as positive, negative or
unbiased of the wistful incentive in no time flat. Be that as it may, human language is perplexing. Showing a machine to
dissect the different linguistic subtleties alongside assorted social varieties, slang and incorrect spellings that happen in web
based life make the procedure complex and showing a machine to see how the setting influences the tone demonstrates to be
very testing. Assessment investigation has its own restrictions like some other ML prescient and isn't utilized as a 100% precise
marker however with a little supervision it very well may be an incredible resource.
Keywords:Sentiment analysis, Tweepy, TextBlob, Twitter.

1.INTRODUCTION
Twitter is a well known microblogging administration where clients make status messages (called "tweets"). These
tweets at times express assessments about various subjects. Assumption examination is the forecast of feelings in a
word, sentences or corpus of archives. It is planned to fill in as an application to comprehend the frames of mind,
conclusions and feelings communicated inside an online notice. Correctly, it is a worldview of classifying discussions
into positive, negative or unbiased names.
The reason for this venture is to assemble a calculation that can precisely order Twitter messages as positive or
negative, as for a question term. Our theory is that we can get high precision on characterizing notion in Twitter
messages utilizing AI techniques. Generally, this sort of assessment investigation is helpful for customers who are
attempting to look into an item or administration, or advertisers examining general feeling of their organization.
Nonetheless, doing the investigation of tweets that express human feelings isn't a simple occupation. A ton of
difficulties are engaged with terms of tonality, extremity, vocabulary and syntax of the tweets. They will in general
exceedingly unstructured and non-linguistic and thusly it get's hard to decipher their significance.

Volume 8, Issue 7, July 2019 Page 51

International Journal of Application or Innovation in Engineering & Management (IJAIEM)
Web Site: www.ijaiem.org Email: editor@ijaiem.org
Volume 8, Issue 7, July 2019 ISSN 2319 - 4847

2. PROCEDURE
2.1 Introduction to the problem
Consistently monstrous measure of information is created by online networking clients which can be utilized to dissect
their sentiment about any occasion, motion picture, item or governmental issues. Conclusion investigation, additionally
alludes as feeling mining, is a sub AI task where we need to figure out which is the general supposition of a given
record.
Utilizing AI procedures and common language handling we can separate the abstract data of a report and attempt to
characterize it as indicated by its extremity, for example, positive, impartial or negative.

In this task we are attempting to arrange tweets from Twitter into 'positive', 'negative' or 'nonpartisan' conclusion by
structure a model dependent on probabilities. Twitter is a microblogging site where individuals can share their
sentiments rapidly and unexpectedly by sending tweets that are constrained by 140 characters. You can
straightforwardly deliver a tweet to somebody by including the objective sign '@' or partake in a theme by including a
hashtag '#' to your tweet. In view of the present use of Twitter in each field, it is the ideal wellspring of information to
decide the general feeling about anything.

2.2 Libraries and Technologies

Tweepy: It is the python client for the official twitter API. When we invoke an API method most of the time returned
back to us will be a Tweepy model class instance. This will contain the data returned from Twitter which we can then
use inside our application.
TextBlob: It is a high level library built on top of the NLTK library. First, the clean_tweet method is called to remove
links, special characters etc. from tweet using some simple Regex. Then, we pass tweet to create a TextBlobobject.

Csv: The Comma Separated Values format is a common import and export format for spreadsheet and databases. There
exists no standards for csv operations, it is defined by many applications which read and write it. It implements classes
to read and write tabular data in csv format.

Re: Python supports regular expressions by the library called ‘re’(though it’s not fully Perl-compatible). ‘Regular
Expressions (RegEx)’ is one of the ‘rules’ based pattern search method. Instead of regular strings, search patterns are
specified using raw strings “r”, so that backslashes and meta characters are not interpreted by python but sent to RegEx
directly.
sys: System-specific parameters and functions. This module provides access to some variables used or maintained by
the interpreter and to functions that interact strongly with the interpreter. It is always available. The list of command
line arguments passed to a Python script.

Pandas: Pandas is an open-source Python Library providing high- performance data manipulation and analysis tool
using its powerful data structures.Python with Pandas is used in a wide range of fields including academic and
commercial domains including finance, economics, Statistics, analytics, etc.

Matplotlib: It is used to 2D plot the arrays. It is a multi-platform data visualisation library built on NumPyarrays and
designed to work with the broader SciPystack. It allows us to visually access huge amount of data in some easy
digestible visuals.

3.Classifier
The rundown of word highlights should be separated from the tweets. It is a rundown with each particular words
requested by recurrence of appearance. We utilize the accompanying capacity to get the rundown in addition to the two
aide functions. To make a classifier, we have to choose what highlights are important. To do that, we first need an
element extractor. The one we are going to utilize restores a lexicon showing what words are contained in the
information passed.

Here, the info is the tweet. We utilize the word highlights rundown characterized above alongside the contribution to
make the lexicon. With our component extractor, we can apply the highlights to our classifier utilizing the strategy
apply features. We pass the element extractor alongside the tweets list.

Volume 8, Issue 7, July 2019 Page 52

International Journal of Application or Innovation in Engineering & Management (IJAIEM)
Web Site: www.ijaiem.org Email: editor@ijaiem.org
Volume 8, Issue 7, July 2019 ISSN 2319 - 4847

Figure:1 The above illustration depicts the flow of the analysis process.
4. Literature Review
A PappuRajan and S.P Victor [2014] presented a paper for web sentiment analysis for scoring positive or negative
words using twitter data. Here, they are using the concept of Opinion Mining.
Elena Rudkowsky, Martin Haselmayer, Matthias Wastian, Marcelo Jenny, Stefan Emrich and MichealSedlmair [2017]
presented a paper in which they have moved beyond the dominant approach of bag-of-words for sentiment analysis and
introduced an alternative procedure based on distributed word embeddings.
Alec Go, Lei Huang, RichaBhayani [2009] presented a paper for sentiment analysis where they have used the litmus
test which is if the tweet could appear as a newspaper headline or as a sentence in Wikipedia, then it belongs in the
neutral class.
Amandeep Kaur, DeepeshKhaneja, Khushboo Vyas, Ranjit Singh Saini [2016] presented a paper on Sentiment analysis
on twitter using Apache Spark. Here, they are using Apache Spark to analyse real time tweets and their objective is to
find the polarity of words in tweets as they are retrieved.
Marc Lamberti [2015] presented a paper on Twitter Emotion analysis where he builds a model based on probabilities
by analysing the tweets into ‘positive’ or ‘negative’.

5. Social Application
The uses of conclusion investigation are wide and ground-breaking. The capacity to extricate bits of knowledge from
social information is a training that is as a rule broadly received by associations over the world. Notion examination is
amazingly valuable in online life checking as it enables us to pick up a diagram of the more extensive popular
supposition behind specific subjects. Moves in supposition via web-based networking media have been appeared
connect with movements in the securities exchange.
The Obama administration used sentiment analysis to gauge public opinion to policy announcements and campaign
messages ahead of 2012 presidential election. Being able to quickly see the sentiment behind everything from forum
posts to news articles means being better able to strategise and plan for the future. It can likewise be a fundamental
piece of your statistical surveying and client administration approach. Not exclusively would you be able to perceive
what individuals think about your own items or administrations, you can perceive what they make of your rivals as
well.
The general client experience of your clients can be uncovered rapidly with assumption examination, however it can get
unquestionably increasingly granular as well.The capacity to rapidly comprehend customer frames of mind and respond
appropriately is something that Expedia Canada exploited when they saw that there was a relentless increment in
negative criticism to the music utilized in one of their TV adverts

Figure 2 Pie chart of the twitter sentiment analysis of the keywords ‘Rahul Gandhi’

Volume 8, Issue 7, July 2019 Page 53

International Journal of Application or Innovation in Engineering & Management (IJAIEM)
Web Site: www.ijaiem.org Email: editor@ijaiem.org
Volume 8, Issue 7, July 2019 ISSN 2319 - 4847

6. CONCLUSION
Twitter is a wellspring of immense unstructured and uproarious informational collections that can be prepared to find
intriguing examples and patterns. AI methods perform sensibly well for grouping assessment in tweets. This
exploration presents the hypothetical fundamental of supposition mining. The proposed methodology decides the slant
of the content, regardless of whether it is sure or negative, which is stretched out to quality of extremity and
furthermore which was acquire the noteworthy highlights and to Analyzing the general slant for each item by
registering the weighted normal for every one of the estimations in the printed information

References
[1] Amandeep Kaur, DeepeshKhaneja, Khusbhoo Vyas, Ranjit Singh Saini, October’ 2017 | Carlton University |
Paper on Sentiment
[2] Dr David Rossiter, Marc Lamberti, 21 July 2015 | Paper on Twitter Emotion Analysis
[3] A PappuRajan, S.P.Victor, St.Xavier’s College, 6 June 2014 | Web Sentiment Analysis for Scoring Positive or
Negative Words using Twitter Data
[4] Elena Rudkowsky, Martin Haselmayer, Matthias Wastian, Marcelo Jenny, ŠtefanEmrich, and Michael Sedlmair,
University of Vienna, 2015 | More than Bags of Words: Sentiment Analysis with Word Embeddings
[5] National Daily, Economic Times: articles.economictimes.indiatimes.com › Collections › Facebook
[6] K. Dave, S. Lawrence, and D.M. Pennock. “Mining the peanut gallery: Opinion extraction and semantic
classification of product reviews”. In Proceedings of the 12th International Conference on World Wide Web
(WWW), 2003, pp. 519–528.
[7] A. Go, R. Bhayani, L.Huang. “Twitter Sentiment Classification Using Distant Supervision”. Stanford University,
Technical Paper ,2009
[8] L. Barbosa, J. Feng. “Robust Sentiment Detection on Twitter from Biased and Noisy Data”. COLING 2010:
Poster Volume, pp. 36-44.
[9] L. Colazzo, A. Molinari and N. Villa. “Collaboration vs. Participation: the Role of Virtual Communities in a Web
2.0 world”, International Conference on Education Technology and Computer, 2009, pp.321-325.
[10] S. Batra and D. Rao, ”Entity Based Sentiment Analysis on Twitter”, Stanford University,2010
[11] R. Parikh and M. Movassate, “Sentiment Analysis of UserGenerated Twitter Updates using Various Classification
Techniques”, CS224N Final Report, 2009
[12] A. Kumar and T. M. Sebastian, “Machine learning assisted Sentiment Analysis”. Proceedings of International
Conference on Computer Science & Engineering (ICCSE’2012), 2012, pp. 123-130.
[13] A. Agarwal, B. Xie, I. Vovsha, O. Rambow, R. Passonneau, “Sentiment Analysis of Twitter Data”, In Proceedings
of the ACL 2011 Workshop on Languages in Social Media,2011 , pp. 30–38

AUTHORS
Pooja Pande Pursuing B.E (Computer Science & Engineering) from Prof. Ram Meghe College of Engineering &
Management, Badnera. Area of interest Artificial Intelligence, Big data & Deep learning.

Prachi DThakarreceived B.E(Computer Science & Engineering) from SGB Amravati University in 2010 and
Completed M.E (Computer Engineering) from SGB Amravati University in 2015. Doing PHD from SGB Amravati
University. Right Now working as Assistant Professor in Computer Science & Engineering at Prof. Ram Meghe
College of Engineering & Management, Badnera.Area of interest Big data & Cloud Computing.

YashRautPursuing B.E (Computer Science & Engineering) from Prof. Ram Meghe College of Engineering &
Management, Badnera. Area of interest Artificial Intelligence, Ethical hacking & Deep learning.

Volume 8, Issue 7, July 2019 Page 54