Big thank you Ashwin, it helped me do a project overnight.
@HackersRealm3 жыл бұрын
Glad it was helpful!!!
@kkamit01062 жыл бұрын
Same here !!
@saviovnn3 жыл бұрын
Thanks for the caption it helps a lot !!! Send hi it to Brazil.
@rohanpatel81063 жыл бұрын
Sir please make some more advanced project like this for cse students
@HackersRealm3 жыл бұрын
yeah sure, I will be making more projects!!!
@pavansai52392 жыл бұрын
did u know how to download the dataset ? help me out of this
@BEESaiShivam Жыл бұрын
Are these too basic to put on cv?
@dataanalyticsfun98833 жыл бұрын
Thanks you very much sir for making amazing video .sir I have request to you to make a video regarding future engineering and feature selection . thanks
@HackersRealm3 жыл бұрын
Noted, I will create seperate video for feature engineering
@parthshingari60823 жыл бұрын
+1
@nasreenbanu22452 жыл бұрын
Thank you so much.You made me understand complex problem to simple.Hats off..keep going.Can u make video on choosing statistical test.
@HackersRealm2 жыл бұрын
sure, I will make separate videos for the concepts!!!
@purvikabajaj83833 жыл бұрын
thank you for a clear explanation
@HackersRealm3 жыл бұрын
Happy to Help!!!
@mwanza826 Жыл бұрын
Hello sir, i have an issue downloading wordcloud even after installing c++ build tools , what could the issue be
@HackersRealm Жыл бұрын
what error you're facing while installing?
@mouskey2 жыл бұрын
Tq sir its more helpuful for my project
@HackersRealm2 жыл бұрын
glad it was helpful!!!
@mouskey2 жыл бұрын
Yes sir its reallyhelpful, one week i stuck in this program but i got a solution now do more like this sir if you don't mine post tutorial video of adv python its more helpful for beginners lyk me once again tq sir.
@HackersRealm2 жыл бұрын
@@mouskey advanced in python or data science?
@mouskey2 жыл бұрын
@@HackersRealm both
@HackersRealm2 жыл бұрын
@@mouskey sure, planning to do that!!!
@nugrahaputra36323 жыл бұрын
thanks very much brother, good luck
@HackersRealm3 жыл бұрын
Always happy to help!!!
@kajalsoni7721 Жыл бұрын
great tutorial!! can you tell me how would we go about making a gui for this model? using gradio maybe?
@HackersRealm Жыл бұрын
You can use any gui module like tkinter or others to create it. Backend functions will be same. You can check how to deploy ml project for more information
@kajalsoni7721 Жыл бұрын
@@HackersRealm thanks for the reply! i'm trying to deploy the model,running into a lot of errors.do i need to set up twitter api for real time tweet collection?
@razibdebnath53863 жыл бұрын
can i use the same pre-processing procedure for SVM,naive bayes and random forest model?
@HackersRealm3 жыл бұрын
yes you can
@palakparmar96746 ай бұрын
i have to do research paper , where can i find whole code. because it was not there on github
@HackersRealm6 ай бұрын
it's available in github... go to machine learning project repository and find the folder with title
@djadeja47093 жыл бұрын
First of all thanks for such amazing explaination, But I want to ask you that from feature extraction step you didn't use datavisualization or list of hashtags you created. I have done the same whole code as well as second time after preprocessing I jumped on feature extraction and both gave the same output in f1_score and accuracy_score!!! So can you explain how bag of word has helped in classification??? In which step they classified positive and negative tweets?
@HackersRealm3 жыл бұрын
Glad you liked the video!!! hashtag won't give us meaning results as it doesn't contain the actual tweet, so i didn't use that. bag of words are used to identify the set of words that considers positive or negative. Initially it's available in dataset, after that it will try to predict it.
@djadeja47093 жыл бұрын
@@HackersRealm Got it!!! Thanks you so much!!!
@خلیلشاھ-ش9ع2 жыл бұрын
how can we get confusion matrix eg precision, recall, f1 scores?
@HackersRealm2 жыл бұрын
you can use classification report module to get that
@viraj99542 жыл бұрын
hey!! great work....just wanted to know which algorithm did you actually use in above video
@HackersRealm2 жыл бұрын
It's logistic regression
@ephrembekele52413 жыл бұрын
Sir you said the objective was to detect hate speech in tweets. so what can we conclude from the results? I am a little confused.
@HackersRealm3 жыл бұрын
the negative reviews we are classified are hate speech, using this model, we can able to identify that
@ephrembekele52413 жыл бұрын
@@HackersRealm what does the accuracy scored show us in this case?
@HackersRealm3 жыл бұрын
@@ephrembekele5241 how many tweets we predicted correctly using the model
@flouwer66693 жыл бұрын
How can I classify it as neutral as well? and How can we integrate the model into a web app?
@HackersRealm3 жыл бұрын
you have to use the dataset that has neutral class and use flask to integrate in web app
@RashmiTigadi5 ай бұрын
Which algorithm is used in this process which u have explained
@AIResearchTechniques2 жыл бұрын
Sir on df['clean_tweet'] = np.vectorize(remove_pattern)(df['tweet'],"@[\w]*") when I run this code the output for clean tweet shows none
@AIResearchTechniques2 жыл бұрын
How to rectify this error
@HackersRealm2 жыл бұрын
please check whether the data is loaded
@AIResearchTechniques2 жыл бұрын
Thank you sir ..When I remove the '\w' the output run without error and showed all cleaned tweets
@HackersRealm2 жыл бұрын
@@AIResearchTechniques Glad to hear that
@payalkasera45962 жыл бұрын
@@AIResearchTechniques i am facing same issue can u help me
@harshi_vlogs07 Жыл бұрын
Thank you 😊
@HackersRealm Жыл бұрын
Happy to help!!!
@aritrochakraborty81222 жыл бұрын
Facing issue regarding installing the wordcloud.... " ERROR: wordcloud-1.5.0-cp34-cp34m-win_amd64.whl is not a supported wheel on this platform. " how to fixed it?
@HackersRealm2 жыл бұрын
try install visual c++ build tools and retry the command
@himanshurathod1178 Жыл бұрын
could you please tell me how did you load the dataset i am getting no such file error
@HackersRealm Жыл бұрын
please check whether the file is in the same directory or not
@rapidknowledge34833 жыл бұрын
Please make video on live tweets analysis using machine learning
@HackersRealm3 жыл бұрын
Yeah, will do that soon
@mouskey2 жыл бұрын
Hlo sir, sorry for disturbing you i have one doubt if the letter is not happy which kind of senmential the code will take positive or negative?
@HackersRealm2 жыл бұрын
i didn't get you, can you rephrase it!!!
@mouskey2 жыл бұрын
Sir, in sentimental analysis positive words are happy like that and negative words are sad like that what we consider if the word is not happy .it's a positive side or negative side sir
@HackersRealm2 жыл бұрын
@@mouskey it may consider positive, to overcome these limitations, we may go for lstm models
@mouskey2 жыл бұрын
@@HackersRealm okay sir tq for ur valuable reply, Sir in this video you use lstm?
@HackersRealm2 жыл бұрын
@@mouskey No, I have used a machine learning algorithm, check fake news detection project, I have used lstm in that
@himanshunagapure98832 жыл бұрын
Your data has label for 1 as racist(negative) and 0 denotes tweets as not racist(positive) .So what did you consider for neutral tweets??
@HackersRealm2 жыл бұрын
This dataset doesn't have neutral, you can use other tweets dataset for 3 classes!!!
@user-gl2nv3fy7w Жыл бұрын
Hello sir..i got an error while visualisation the frequent words..it says that only supported for Truetype fonts..plz help me
@HackersRealm Жыл бұрын
are you using different dataset?
@user-gl2nv3fy7w Жыл бұрын
@@HackersRealm yess
@HackersRealm Жыл бұрын
@@user-gl2nv3fy7w the please check the type of the column and may be change to strings
@user-gl2nv3fy7w Жыл бұрын
My dataset has all objects.. so i need to convert them in string? Then this problem will get resolve?
@HackersRealm Жыл бұрын
@@user-gl2nv3fy7w yes most likely!!!
@viane1234562 жыл бұрын
Sir I am a btech first year student. can you tell me how can we get current tweets from twitter in csv file using python?
@HackersRealm2 жыл бұрын
You can use tweepy to get current tweets; You can also check realtime twitter sentiment analysis in the playlist
@Moviesslider2 жыл бұрын
How do you get that dataset? How do I get data directly from the Twitter tweets? Please suggest way for that.
@HackersRealm2 жыл бұрын
the dataset can be downloaded from the links in the description. For real time, twitter analysis, I will make a video in the upcoming weeks
@artfromtheheart9545 Жыл бұрын
Can You Please Make video for this? "Automated Classification of Societal Sentiments on Twitter With Machine Learning"
@HackersRealm Жыл бұрын
I have done a video on real time twitter sentiment analysis. you can check if that's the case
@ترافهعشق-غ2ظ7 ай бұрын
كيف يمكن الحصول على جدوله البيانات من النص الكلمات ام من اين ومن لا يدخلنا csv
@landaalhanshaly7989 Жыл бұрын
Can you recommend a book for python and machine learning?
@ARkhan-xw8ud Жыл бұрын
Since the data was imbalanced, you should use oversampling technique
@floweraddictxx62383 жыл бұрын
Bro why i can't use PorterStemmer? Is there any that i need to install?? Please help
@HackersRealm3 жыл бұрын
you can use that if you installed nltk package
@floweraddictxx62383 жыл бұрын
@@HackersRealm but already installed bro
@HackersRealm3 жыл бұрын
@@floweraddictxx6238 then it will work, it has all the modules
@mukeshrajpurohit55932 жыл бұрын
It will create data leakage problem if we get BOW before splitting the data into train & test.
@hrittickdebnath353 жыл бұрын
Thanks buddy
@HackersRealm3 жыл бұрын
Glad it was helpful!!!
@yasamvarnika7998 Жыл бұрын
Hello Sir, Please help me to download the dataset its not downloading
@HackersRealm Жыл бұрын
You can get it from the github repo as well!!!
@mouskey2 жыл бұрын
Sir , could you please tell me the code of movie review in twitter sentimental analysis and the project uses also.
@HackersRealm2 жыл бұрын
the process remains the same for any kind of sentiment analysis
@mouskey2 жыл бұрын
@@HackersRealm tq sir
@parth1211 Жыл бұрын
hello sir , why cant we do logistic regression directly ? why we using nlp ?
@HackersRealm Жыл бұрын
we cannot give text data as it is, as the model can't understand. It can only get information through numbers.
@himanshupandey1167 Жыл бұрын
sir not able to get the dataset from the provided link
@HackersRealm Жыл бұрын
you can get it from github repo also
@skeler44302 жыл бұрын
Sir how to use SVM instead of logistic regression do you have code or can you please explain
@HackersRealm2 жыл бұрын
replace the model name with svm model, that's it
@AnuragKumar-ij7rl2 жыл бұрын
There is error while creating graph unable to create graph by this process
@HackersRealm2 жыл бұрын
which part you're getting error?
@ghosthanded2 жыл бұрын
Sir I am getting an empty array for the function of extracting hashtags how to resolve this
@HackersRealm2 жыл бұрын
are you using different data or same?
@ghosthanded2 жыл бұрын
@@HackersRealm a different one I have scarped the data myself
@HackersRealm2 жыл бұрын
@@ghosthanded then you may need to change the processing steps accordingly
@ghosthanded2 жыл бұрын
@@HackersRealm can you give me a reference for it?
@pratikshapatil7413 Жыл бұрын
Can you please tell me from where I can Download the Dataset
@HackersRealm Жыл бұрын
you can get it from link provided in description or github
@kavya.r83853 жыл бұрын
hey, i am getting error in the 6th step (remove @user)
@HackersRealm3 жыл бұрын
what error it is showing?
@user-ls4mx2tw1l2 жыл бұрын
Can you help me , i have assignment I have to convert before August 20 😭 about nlp sentiment analysis Tweet
@HackersRealm2 жыл бұрын
Which part you need help?
@user-ls4mx2tw1l2 жыл бұрын
@@HackersRealm about sentiment analysis with naive Bayes
@HackersRealm2 жыл бұрын
@@user-ls4mx2tw1l you can use the same flow and change the model for this
@priyachimanchode6483 жыл бұрын
Can't find the CSV file in any links, it would be convenient if just put the link in the description directly.
@HackersRealm3 жыл бұрын
The dataset link is in the description, you can get it from analytics vidhya or you can get it from github repo too, Please check and let me know
@priyachimanchode6483 жыл бұрын
Found them, thank you.
@ashutoshbansal82543 жыл бұрын
i don't find CSV file
@HackersRealm3 жыл бұрын
please check the github link or dataset link
@pavansai52392 жыл бұрын
please help me out from this i cant download the dataset , please help me .........
@HackersRealm2 жыл бұрын
you can download the data from github too, try it
@pavansai52392 жыл бұрын
@@HackersRealm got it thanks
@VijayKumar-ck7ww3 жыл бұрын
Can we apply naive Bayes ?
@HackersRealm3 жыл бұрын
yes we can apply
@masternik61262 жыл бұрын
I want to make a project on detection of self harming or Sucidial tweets
@umamahaswarikarre80623 жыл бұрын
Sir is this a project for CSE or ECE
@HackersRealm3 жыл бұрын
we can't specify any department for the projects, anyone can use based on the applications
@roshnimustafa80512 жыл бұрын
how to download dataset?
@HackersRealm2 жыл бұрын
link is in the description
@roshnimustafa80512 жыл бұрын
but i didnt found dataset there
@HackersRealm2 жыл бұрын
@@roshnimustafa8051 you have to register in that website to get it or you can get it from github repo link too
@aquillinantony27703 жыл бұрын
Why we use "np.vectorize" in twitter handle removing
@HackersRealm3 жыл бұрын
i just showed different ways to pass values to the functions. It's not compulsory to use this
@RevatiVardekar Жыл бұрын
where can i get the dataset
@HackersRealm Жыл бұрын
you can get it from the link in the description!!!
@خلیلشاھ-ش9ع2 жыл бұрын
sir can we bert model ?
@HackersRealm2 жыл бұрын
Yes but you have to use corresponding preprocessing methods for it
@خلیلشاھ-ش9ع2 жыл бұрын
@@HackersRealm thank you
@srishtimishra51012 жыл бұрын
can't find dataset sir ..It's redirecting to some site.
@HackersRealm2 жыл бұрын
you can find it in the github repo
@srishtimishra51012 жыл бұрын
@@HackersRealm It's redirecting to analytics vidya and when I go to github and try to access dataset its telling can't open....It says can't show files that are this big right now ..and open raw data like that
@HackersRealm2 жыл бұрын
@@srishtimishra5101 In github, you can download the file and use it. or reach me over insta or linkedin, I will share the data
@theghost_162 жыл бұрын
@Srishti Mishra if made the project can you plss share the link of datasets .
@samreenshamim81612 жыл бұрын
Hello Sir! I hope you're doing well, Sir I got an error when I typed this command: df1['clean_tweet'] = df1['clean_tweet'].apply(lambda x: " ".join([w for w in x.split() if len(w)>3])) AttributeError: 'float' object has no attribute 'split' I would be grateful if you would help me out a little :)!
@HackersRealm2 жыл бұрын
can you rerun the code from the start? or you're using different dataset for this project?
@samreenshamim81612 жыл бұрын
@@HackersRealm I am working with a different dataset indeed but I've checked the datatype of the column using the info() command and it shows object datatype. So I think this shouldn't come up with an attribute error but it still shows that error.
@HackersRealm2 жыл бұрын
@@samreenshamim8161 I think the column may have null values, try to remove null values and proceed
@samreenshamim81612 жыл бұрын
@@HackersRealm okay Sir I'll try 😊
@samreenshamim81612 жыл бұрын
@@HackersRealm Sir my problem got solved! I did a small conversion of x.split() into str(x).split(). It gave me tweets without short words successfully :).
@meghaagarwal99072 жыл бұрын
Please provide the dataset file, it can't be found!
@HackersRealm2 жыл бұрын
Please check the description or download it from github repo
@machinelearning35182 жыл бұрын
did u made the regex tutorial?
@HackersRealm2 жыл бұрын
No Not anything specifically yet!!!
@Saboor-Hamedi2 жыл бұрын
How to get a label on our individual dataset from Twitter?
@HackersRealm2 жыл бұрын
You can use pretrained model or you have to manually label them by yourself, if you want to create a complete dataset
@Saboor-Hamedi2 жыл бұрын
@@HackersRealm Thank you, but what that label mean? Is it important for research, because I am using my data for thesis
@HackersRealm2 жыл бұрын
@@Saboor-Hamedi label is the output column which will be used as result
@Saboor-Hamedi2 жыл бұрын
@@HackersRealm How to get that results? I was asking about that
@shivanitufchi9682 жыл бұрын
Can you pls share this code here
@HackersRealm2 жыл бұрын
Please check the github repo for the code, link in the description
@oreoluwaadeyegbe46702 жыл бұрын
Hey I would love to get in contact with you as I need just a bit of help in my dissertation for my Masters, if you won’t mind of you of course. Thank you in advance
@HackersRealm2 жыл бұрын
you can book a consultation using the link in the description or reach me via insta or linkedin, Thanks!!
@AmirSohel-iz9kz3 жыл бұрын
Dataset?
@HackersRealm2 жыл бұрын
you can check the github repo!!!
@afridmohammed67112 жыл бұрын
@@HackersRealm It is showing that " we can't show the files that are this big right now"
@HackersRealm2 жыл бұрын
@@afridmohammed6711 You can download the file and view it or you can use other link to download the file