Twitter sentiment analysis using Python | Machine Learning Project 8

[@TheAIandDSChannel]

Dear Viewers, a lot of time and effort goes into making these videos. So, all I ask of you is to subscribe to my channel (this would be at no extra cost to you!) and hit the like button if you find the video useful. This would really help my channel. Thanks in advance! - RCM.

[@SIUUfansz]

which algo is used in this project

[@13_kajalgangele32]

@@SIUUfansz logistics Regression and Support Vector Classifier

[@trimmmm11]

Can you please how to execute twitter sentiment analysis based on ordinal regression project...

[@Ajaykumar-ml2us]

Can u let me know the references u took for this

[@ricardotalavera8227]

I am suscribed good video

[@TheAIandDSChannel]

Thank you 😊

[@mohammednayyarsiddiqui5005]

hello sir, there is a doubt am getting somewhat different please help. When i try to implement it the spaces between each word in a sentence is getting removed automatically. i don't know what am doingg wrong please help.(example: Explanation is good ---> Explanationisgood) this is happening need help. Thank you

[@ajinkyadhotre3502]

hey in line 11 , have you mistaken anything ? you have written text_df.text = text_df.apply()... is it corrext ? or should it had been text_df = text_df.apply() ?

[@TheAIandDSChannel]

text_df is the name of the dataframe. I'm writing text_df.text to apply the function on that particular column.

[@jeevanasenthilkumar]

Hi sir glad to visit your channel. Nice content and i tried your code and it worked as you have shown in the vedio but last some of the codes you are not used in the vedio whats the purpose of the code?? Can you explain me that pls.

[@TheAIandDSChannel]

Thank you so much. Glad to hear that. Can you specify which part of the code you are referring to?

[@jeevanasenthilkumar]

@@TheAIandDSChannel You showed that codes first in the vedio in that you said for live ones try the same code and what is that u can't understand that one ❤️

[@TheAIandDSChannel]

@@jeevanasenthilkumar 0:29 shows how to work with live data from Twitter. In order to work with the live data, you need to have a Twitter developer account which gives access to Twitter API from where you can pull the live data. This is a bit time consuming process and hence was avoided in this video.

[@madhulikaw2198]

​@@TheAIandDSChannelcan you tell me how to use Twitter api in this

[@RashaKhalil-kq3it]

مرحبا ..كيف يمكنني الحصول على قاعدة البيانات التي تم استخدامها في هذا الفيديو؟

[@Jhedataprofesorjr]

I tthim=nk they are aavailable in kaggle: /pfizer-vaccine-tweets/vaccination_tweets.csv

[@praghapraghi4560]

can you please do sentiment analysis using Tensorflow.

[@trimmmm11]

Can you please how to execute twitter sentiment analysis based on ordinal regression project...

[@maloriegutierrez1443]

Hi, I can't fix overfitting for Twitter sentiment analysis. I tried many methods but it didn't work. can you just help? And can you share the code please? Thank you.

[@TheAIandDSChannel]

Hi, I've updated the link to the code in the video description. github.com/roshancyriacmathew/Twitter-sentiment-analysis-using-Python-Machine-Learning-Project-8 What is the issue with overfitting ?

[@rakeshjilthe]

I want to ask you keyboard shortcut, the way you change the pos_tweets to neg_tweets by selecting only 'pos' word and replacing it with 'neg' word from 16:10 to 16:14 of the video.

[@TheAIandDSChannel]

You can check out this video where I explain this keyboard shortcut. kzbin.info/www/bejne/enmxXmOqpd2MoZI

[@zahraaalmhana9157]

Can you help me a project that graduated from Sentiment Analysis using Word Sense Disambiguation of word sense disambiguation using Methods (NB, MaxEnt, SVM) and Sentiment Analysis using Deep Learning (CNN, RNN, LSTM) and it doesn't have much information about Python language and project duration It's going to end, please help😭😭😭

[@adittiaagustian47]

thank you for the knowledge

[@TheAIandDSChannel]

Your welcome

[@artfromtheheart9545]

Can You Please Make video for this? "Automated Classification of Societal Sentiments on Twitter With Machine Learning"

[@rashibhardwaj506]

Very informative and Amazing video. Thanks for your efforts and time.

[@TheAIandDSChannel]

Happy to hear that. 😊

[@nithindarshan8382]

can plz tell me how may classifier using this project bro

[@kirtipawar1764]

Which language used in backend database in this project

[@bugfamous7264]

Great video. Thank you sir !

[@TheAIandDSChannel]

You're Welcome. Glad you found it helpful.

[@praveeng.m66]

Can anyone please tell what is the logistic regression prediction of the above dataset

[@praveeng.m66]

Plz requesting to reply to the above question

[@vaishnavimanthalkar2158]

Hi, I'm using same code still gaetting different accuracy score then yours why is it so???

[@TheAIandDSChannel]

The accuracy of the model may vary depending on many factors some of which include, preprocessing steps, number of iterations, system architecture, data used, etc..

[@bot-hn4ud]

Can u snd the code

[@TheAIandDSChannel]

You can find the code to all my tutorial videos in the description box. github.com/roshancyriacmathew/Twitter-sentiment-analysis-using-Python-Machine-Learning-Project-8

[@13_kajalgangele32]

Hello sir i m facing problem in line tweet_df['tweet']=tweet_df['tweet']. apply (lambda x: lemmatizing(x))

[@13_kajalgangele32]

Pls sir it's imp 🙏

[@TheAIandDSChannel]

Hi, if there is an issue with this section of the code, it might be mainly because of the lemmatizing function that you have defined somewhere earlier in the code. So do check if the lemmatizing function is working. This should solve the issue.

[@bot-hn4ud]

Can I get the project with naive Bayes algorithm

[@TheAIandDSChannel]

Here is another project that I've done using the Naive Bayes algorithm. kzbin.info/www/bejne/pHTVqZpoe7yYirs

[@gnaneshp3916]

Getting an error in .fit(x_train,y_train)

[@yccdavis]

Thx for the detailed demonstration! I do feel curious though if you already have a way to generate sentiment score why bother running machine learning on it?

[@TheAIandDSChannel]

You're Welcome!. We are generating sentiment scores to get labels for the text data. Sometimes this label is provided in the dataset. We then use this text data, and sentiment polarities to train the machine learning model so that we can use the machine learning model to predict the sentiments for text data that does not have a label, without manually assigning polarities to it.

[@abdulwaseemshaik3069]

Could please tell the inner functionality of textblob and it's calculations

[@TheAIandDSChannel]

I think you would find this article helpful. textblob.readthedocs.io/en/dev/quickstart.html

[@Ajaykumar-ml2us]

Can u let me know the references u took for this

[@TheAIandDSChannel]

I'm not sure if I have the reference links for the concepts used in this video as I've built the code on top of a base code that was developed while doing my Master's program.

[@jatinjindal9656]

Sir, I did import lib textblob, instead I get error as module not found

[@TheAIandDSChannel]

This might be occurring due to an error while importing the package

[@jatinjindal9656]

@@TheAIandDSChannel Thanks

[@Saboor-Hamedi]

How do you get user_verified bro?

[@TheAIandDSChannel]

It depends on the dataset, for this dataset, this information was already there.

[@Saboor-Hamedi]

@@TheAIandDSChannel it means it was inserted manually? Because I cannot get from Twitter on my dataset

[@nikhileligar3318]

how to create web site for this project

[@TheAIandDSChannel]

I'm sorry, I don't have much experience with front end (UI) development.

[@NisargaK-vs8ps]

Can u send the CSV file

[@TheAIandDSChannel]

You can get the link for the CSV file form the following link, www.kaggle.com/datasets/gpreda/pfizer-vaccine-tweets

[@ruchitare4016]

hello which algorithm is used in this?

[@TheAIandDSChannel]

Hi, The classification algorithms used in this video are, logistic regression and support vector classifier.

[@gnaneshp3916]

Bro u have the python code that can be executed in the pycharm

[@TheAIandDSChannel]

Hi, I have given the python code in different formats *(.py and .ipynb)* in my github link which you can find in the video description box.

[@gnaneshp3916]

@@TheAIandDSChannel ya but .py has no file in it

[@gnaneshp3916]

Bro can u send that .py file

[@TheAIandDSChannel]

Please check your inbox. I've shared a screenshot of the .py content

[@gnaneshp3916]

Can I get the csv file

[@TheAIandDSChannel]

The csv file is avilable on kaggle and I've added the link to the csv file in the video description. www.kaggle.com/datasets/gpreda/pfizer-vaccine-tweets

[@gnaneshp3916]

@@TheAIandDSChannel tq bro

[@vaishnavimanthalkar2158]

Can someone help me to solve this Having error in data perprocessing filtered_text = [w for w in text_tokens is not w in stop_words] NameError: name 'w' is not defined

[@anaumsharif6380]

us 🤝🤝

[@chiomaanyiam1138]

Hi... After using your code for stemming, I observed that it wasn't applied as the output showed that the tweets were not stemmed. I would expect that after stemming, the word "bringing" will become "bring". Also how can I remove @mentions with profile names in tweets?

[@TheAIandDSChannel]

You can try and change the stemmer used in this case to give the required result. For more detailed information regarding the different types of stemmers, you can check out my video on stemming where I explain the other techniques. kzbin.info/www/bejne/i3PbfmWFrqyHjsk text = re.sub(r'\@w+|\#','',text) This line of code in the data preprocessing block will help to remove the @ symbols from the data. Hope that helps.

[@chiomaanyiam1138]

Thanks for responding. Did you implement tokenization and part of speech tagging during the pre-processing phase? That's not exactly clear to me.

[@TheAIandDSChannel]

@@chiomaanyiam1138 Welcome. Tokenization, yes, POS tagging, no. Tokenization was done during the preprocessing step.

[@chiomaanyiam1138]

Noted, thank you.

[@chiomaanyiam1138]

Hi... I'm back again! 😊 My model majorly misclassified the negative class. I realised it's because Logistic regression performs well in binary classifications whereas most sentiment analysis task are multi-class tasks. Will you say the choice of the model is wrong? Does that show wrong judgement in model selection if one was being assessed?

[@mulyaalfan2354]

hello, what if i want to use Naive bayes Algorithm how do i do that? thank you so much for your tutorial btw

[@TheAIandDSChannel]

You can use Navie Bayes algorithm for this project. However I have used Logistic Regression and SVC as it best suits the given problem. Instead of using Logistic regression classifier, you can add the code for Naive Bayes (import required libraries) in the same place. I'll be using Navie Bayes classifier in one of my upcoming videos. Thanks - RCM