Get UNLIMITED Tweets by Python Without Twitter API

[@sarahmuller8893]

You literally saved my thesis with this! Thank you so so much, I could understand everything you did even with just some basic knowledge in python :) Thank you so much for this vid and your help! 🙏

[@ardahiz2003]

haha mine too

[@raminsepehrirad7758]

Hah... same thing here :D

[@anirudhsrivastava3530]

mine too

[@xtxpxhx]

i think you might saved mine as well

[@manitashrestha3951]

hi! whats thesis topic. well i have only a month left for the master deadline but i have not started due to mental health issues. i am thinking of doing sentiment analysis on twitter data.

[@cryptosmartguy4203]

Cool library! Awesome you've listened to your subscribers and explained everything precisely. I'm excited what you'll come up with next!

[@aispectrum]

Thanks for the support and nice comment! I'm happy that the video was clear.

[@Mauntium]

Thanks to you I just cobbled together a twitter scraper that downloads all images that a user tweeted, with next to no Python experience, in more-or-less one afternoon. It's scary how little it takes to make a scraper. Thanks for the video! Edit: I just noticed that some tweets are missing. Actually, if you go to someone's home page and compare that to the advanced search results, you'll see that twitter's own search is missing some posts. Since snscrape uses that search, it's results will be just as incomprehensive as twitter's own search. (note: this isn't a disaster scenario, the vast majority of tweets are found)

[@aispectrum]

Thanks for watching! Check out this video for tweet sentiment analysis kzbin.info/www/bejne/q4Gun4ana7mUd80 P.S.: If you saw the error that "Tweet object hand attribute 'user'", try changing tweet.user.username to tweet.username

[@ker-balkanrider]

Unfortunately, as of July 2023, this library no longer works because Twitter implemented a login wall for the public website.

[@OlivierNayraguet]

Thank you. They all fell apart.

[@locuratalleres]

Hey, this is amazing! I've been wasting a lot of time trying tutorials that were outdated or didn't work anymore. This works and is a solid foundation for a proper Twitter analysis. Thanks!

[@girmayohannis4659]

But it says blocked.What is the wrong with mine?

[@wazclayjubuzz80]

This is massive! Just saw this recently. I just scrapped off 5000 tweets. Please could you do more videos around web scraping and sentiment analysis 🙏 you're the best! 🙌🏿

[@kojoarhin3481]

hi

[@LOLezzet]

Hello, probably a stupid question, but where can I find all tweets after I generate them? How can I view them in something like an excel file? Thank you

[@papo123994]

@@LOLezzet don't worry, now you have them saved in an array, you may just store them in a pandas DataFrame and save them as a CSV or as an Excel!

[@susmithanimushakavi6426]

hey can you share the code asap

[@skilltwins1145]

@@susmithanimushakavi6426 you can do it like this : df.to_csv('path/yourFileName.csv', index=false)

[@softsubhra]

This is not working now do you have any other idea please share

[@neroonose4585]

Wow, a week of my life narrowed to a 7mins video. Thanks

[@philipomelo]

I’m happy this video is back. Expecting more contents from you

[@aispectrum]

Thanks for the support :)

[@philipomelo]

@@aispectrum one more thing😁, could you please go a little bit deep when explaining stuffs in your videos. Helps beginners like me. Thanks. You the best👌🏽

[@PsikoStars]

Really usefull video !! I hope this channel will stay active for a long time !! love the way u show/explain things !!!

[@yasirabdulkareem9844]

Amazing job . easy to understand , clear talking , thank you so much Sir.

[@aispectrum]

Thank you for your feedback and nice words! I'm happy that it was useful 🙂

[@Ozygny]

currently not working we want another one for Twitter X

[@jonatapaulino]

Congratulations on the video. I think many were in need of this video. I usually used the twint library, but I was having some problems. Thanks for sharing.

[@nikhilkumargupta7359]

is this still working as showing error in my system

[@greatname6651]

@@nikhilkumargupta7359 I'm also getting error. Errors: blocked (404), blocked (404), blocked (404), blocked (404). Twitter blocked it?

[@mohsinparmar6943]

It shows the same error to me as well.

[@obiradaniel]

OMG, you have no idea how helpful this is, saved me days of being limited by the API. Thank thank you very much. Just got 80,000 tweets for a project I will work on later.

[@LOLezzet]

Hello, probably a stupid question, but where can I find all tweets after I generate them? Thank you

[@obiradaniel]

@@LOLezzet In the Dataframe, you can export to Excel or Sqlite.

[@april147]

Thank you so much! You just saved my life! I already subscribed. Keep making quality and precise content like this 💕

[@aispectrum]

Thank you! Glad that it helped!

[@LOLezzet]

Hello, probably a stupid question, but where can I find all tweets after I generate them? How can I view them in something like an excel file? Thank you

[@veronicanatividade]

OMG!!!! Thank you so much!!! You literally saved my thesis!

[@akhilpadmanaban3242]

Hey Is it working, Im getting an error raise ScraperException(msg) snscrape.base.ScraperException: 4 requests to

[@LuanSantos-oz2tb]

Man, thank you so much! I was having dificult to do this and you made this so simple, thank you again! You're the best, just continue doin web scraping and sentiment analysis videos!

[@khedekarnishantaniruddhaan463]

This is huuuge! I just found a gem of a channel!!!

[@otaviocoutinho2855]

Hey man you had definently impact on thousants of projetcs now on. Thank you for your service

[@udhayas2932]

for scraping tweets in this way is we have to use any pyrox server? it always throws error to me

[@laxmishshetty9486]

Bro, snscrape uses TwitterAPI under the hood.. please don't misinform people

[@alisonliu5186]

This is a life-changing video! I am waiting for my application for a Twitter developer account to be passed, and I found this video. Now I can start doing my project! Thank you sooooooo much! 💯

[@AminuteCrafts]

Bro I am getting an error at line 6 “block 403 “ request failed giving up What I do?

[@shivanipendela]

i got the same error bro do you have any solution ?

[@aananasjuice]

thank you so much for this video, you literally saved my group project that's due in a week!!

[@abdulshaikh2401]

As Twitter has stopped the elevated access from being free and started a paid basic service therefore this library has also stopped working

[@omidtaghipour5303]

After searching for a solution for a week. Finally I found your video and worked for me. Thanks a lot for sharing this.

[@marcoschmid1410]

You are my hero! After so many days ... you just serve us the solution for our problem ^^ THX!

[@mr_mnc8533]

This isn't working anymore. Can you provide the updated method. Thank you

[@seyyidefendi3535]

Did you find the working model?

[@raminsepehrirad7758]

Liked it very much. Thanks, Mehran!

[@atanasdobrikov5836]

I do not usually write comments, but you man just saved my thesis. Thank you so much! This was extremely helpful, not all heroes wear capes! 🙌

[@faiqmadani1498]

nice video bro, you save my master degree task about data mining

[@mysecretYOUTUBE]

for you guys if you want this guide video, it works but you must use the latest version

[@danielrojaspena3751]

Hello, the latest version of what? I updated snscrape and it didn't work.

[@sebastianvanhemert]

Can you do a 2023 version?

[@ExploreLahore123]

@AI Spectrum sn scrape is not working now as twitter is blocking it kindly tell the solution

[@lebensmu_ude]

Your videos are great! I hope you keep posting more videos :D

[@aispectrum]

Thank you very much! I will do! 🙂

[@pierremazzotti186]

Great video. Keep pushing bro

[@DomenicoLorenzoAltieri]

love you, I will acknowledge you in my thesis

[@anubhavsarkar7220]

was just about to give up on a project saved my hard work

[@aispectrum]

Glad to hear that!

[@mandidmalai]

Perfect explantations. Thanks so much! (:

[@murniit1328]

You save my thesis, thank you so much, you're the best sir

[@gianthog8346]

thank you sir, your video really helped me in learning as a school kid, it seems your explanation is clearer than my teacher, don't forget to upload videos often

[@aispectrum]

Thanks! Glad to hear that!

[@zainch217]

Wow wow wow Thnks a lot bro its amazing video I ever watched Great work bro

[@sharmapn]

Dear Mehran, I really found this tool very helpful. I am grateful to you. Just wondering if for the tweets that contain a query term, - is there a way to get all the replies to those tweets, and - if the tweet is a reply to a tweet, get the original post. Thank you so much.

[@yasminemohamedabdelhamid6876]

Did you find the dataset?

[@bobiastongartz803]

Amazing content - Thank you so much! One question: Is it also possible to collect all replies to a certain tweet using e.g the tweet ID? Because I need not only the tweets with certain key words, but also the replies to the respective tweets. Would be much appreciated!

[@yasminemohamedabdelhamid6876]

Did you find the dataset?

[@xiaoyunai6295]

Thank you so much! You have saved my cs project !!

[@aispectrum]

Glad it helped!

[@rajafawad8118]

Appreciated! very helpful for me. Thank you for your video

[@aispectrum]

Glad it was helpful!

[@LOLezzet]

Hello, probably a stupid question, but where can I find all tweets after I generate them? Thank you

[@jorgebernardofloressullon6841]

Your content makes me happy. I have a doubt, all the tweets appear with "..." at the end. Is there any way to get the full text of each tweet. Please

[@samuraiblack]

Did you ever figure this out? Trying to fix this as well

[@techsupercharged]

Hey, thanks for this amazing tutorial. Much needed :) I have one question where would the CSV file have been saved on mac?

[@jonathanmiguelcomasgarcera148]

In the same folder where you have created the .py file

[@caseygoldstein9833]

Great video. I'm having hard time running this code, and am wondering if it's because Twitter's new policies with their API. It looks like my code attempts to make requests to Twitter four times before giving up. Thank you!

[@debbiereynolds8510]

I think I am having the same issue -- I copied and pasted the code directly from the github and got a 403 error 😭

[@yoqueopino]

Same here...Errors: blocked (404), blocked (404), blocked (404), blocked (404). Something about the Guest User o something like that... it's broken right now

[@nathaliamello5277]

Great video, helped me a lot! Thank you so so much, sir

[@manitashrestha3951]

hi. this code was working fine. but today its not and saying .errors retrieving blocked. could u please check?

[@manitashrestha3951]

fyi i also update snscrape . now there is scraper exception failed giving up

[@informalibre8403]

Very cool, thank, but now, that doesn’t work anymore.

[@instasol2453]

Love you Man! You are truly a life saver! God bless you!!

[@roberttyler2861]

Great tutorial - thank you!

[@aispectrum]

Happy that it was useful!

[@vrijeuniversiteitresearchd933]

Great video. Many thanks for such a great solution

[@Haim0s]

Thanks for this guide! There is a way for search by location?

[@jaynastics2]

Thank you so much for this video - super helpful! Do you have any resources on how to scrape the replies to these tweets?

[@tinadao3921]

Thank you so much! Your videos are great!

[@aispectrum]

I’m happy that they are helpful!

[@NoéIshara]

Thanks for such an amazing and helpful video. I would like to learn how to save the twitter data as CSV for further analysis. Thanks once again.

[@linli8710]

Thank you so much!!! It's really helpful for me ~!!!

[@Acidseaforce]

Thank you. It really works!

[@LOLezzet]

Hello, probably a stupid question, but where can I find all tweets after I generate them? Thank you

[@Acidseaforce]

@@LOLezzet In your folder where you create tweets.py. You should convert to CSV too btw.

[@DavidWangstoryteller]

That is amazing! I need to learn Python.

[@sohamgotmare2837]

Getting error ' blocked (404)' what to do?

[@shrehansrai5673]

do you got anything i need help

[@sohamgotmare2837]

No, As Elon musk has blocked web scraping X / Twitter

[@shrehansrai5673]

@@sohamgotmare2837 did you find anything

[@liorlidogoster6574]

great video! in which environment he work?

[@sabsela2863]

Awesome video! Thank you! Do you have a suggestion, how I can get the comments under one tweet? And do you know a solution to get all tweets, because I just get a quarter of all tweets...That would be super helpful!

[@yasminemohamedabdelhamid6876]

Did you find the dataset?

[@riccardoandreoni_]

Great video, I was struggling with the Twitter API limit. Just one question, I want to perform sentiment analysis on a topic and to study the evolution of the sentiment over time. When I scrape the tweets I get only the one that are near the upper bound of the specified period. A solution will be to execute many queries specifying a narrow period. But, is there an automated way in snscrape to retrieve equally spread tweets?

[@shh3356]

have you found an answer for this hahah looking to do the same

[@viral_videos124]

Hello have u completed your project in Sentiment Analysis please reply

[@naifalkhunaizi7847]

This is blocked now, can't be used. Thanks for the video anyway!

[@kenechukwuifeakandu362]

Great Video. how can I get the tweets from a list of hashtags and specific locations

[@giuseppemontefrancesco7192]

Thank you! It works great! How can I delete retweets? I see the same tweet more times from different users

[@nurulhanisahmuhammadhaasin885]

Hi, thanks you so much for the tutorial . It really helping me. Btw, do you know how to set the query to specified the location of the tweet

[@kalaipradeep2753]

Twitter scraping are filling : blocked (404)

[@busracelik1165]

It doesnt work please what is other preferences to get twitter data

[@Birdie518]

I have a questeion! I tried to do the code at 2:34, but I got thrown this error: TypeError: vars() argument must have __dict__ attribute What should I do?

[@mohdmohtashim3572]

I am also getting the same error, Is there any solution available?

[@ahmed1180]

Great video, thank you for your time ! I still have a question: I scrapped few hundreds tweets from a user and when I double checked manually I realized that some tweets were missing (not talking about retweets). I reran the line of codes several times and everytime it is the same tweets missing. Is there a reason why some tweets could be missing + is there a way to avoid that? Thanks a lot !!!

[@aispectrum]

This library searches for the query and scrape the results to get the tweets. I think the issue is that twitter doesn't return all the tweets of the specified users in search results. Maybe you could try the TwitterUserScraper method to see if it solves the issue.

[@ahmednawaz7295]

Hey great video! Can you tell me how to know the type of tweet (retweet, reply or tweet)?

[@okxakt9]

Great video. Very precise. I managed to do all the tasks from the video. I have one query - how to save the results to csv/excel file?

[@techsupercharged]

+1

[@LOLezzet]

Hello, I have the same question where can I find all tweets after I generate them? Did you manage to save the results to csv/excel file? Please help

[@sarawutkankham7630]

try this: df.to_csv('data.csv')

[@njbotor]

Hi, does this still work with the new twitter? I'm not sure why I am having error. Thanks a lot for this video.

[@wenzeln.8949]

great video man. is it possible to „download“ all videos from a certain user and uploade the videos on my own

[@dineshparwani9979]

Thanks a lot, this was very helpful

[@kyriakospelekanos6355]

Cool video. Can we also grab the replies of a specific tweet with this library?

[@aispectrum]

I'm not sure if that's possible since this package is getting the tweets by scraping the website.

[@yasminemohamedabdelhamid6876]

Did you find how to get the replies of a specific tweet?

[@gustavoviana1178]

Thanks! It helped me a lot!

[@LOLezzet]

Hello, probably a stupid question, but where can I find all tweets after I generate them? Thank you

[@nipunathalpage5673]

Hello, I am getting errors when using snscrape library. I tried Vscode, Google Colab and Spyder but neither worked, please help me fix it

[@andreasmykland9515]

Hey! When i run the script, I get a non-200 status code in return where I cannot retrieve data from the twitter api. A link related to the twitter api is presented to me, where i find a error message code "2015" for bad authentication. Do you or anyone have some experience with this, and how to work around it? Thank you :)

[@danielrojaspena3751]

pip install --upgrade snscrape

[@andreasmykland9515]

@@danielrojaspena3751 That works - thank you !!

[@moontraveler2940]

Is it possible to get realtime tweets like in your other tutorial, but this time without API? Thanks!

[@Juan-Hdez]

Very useful. Thank you!

[@mindlessbrowse]

Hi I was wondering if you know whether the selection of tweets is random or not. (I specified my query on a specific date range, for 5000 tweets for example. How are these 5000 tweets chosen?)

[@sanahnahk7312]

Thanks a loooot for this code, It saved my life. QUESTION: Can i download facebook comments from public page with this library ?

[@learntocode_nithin]

It was not working,it was giving many errors

[@vtulin3097]

Hello,Would you mind if ask if you can demonstrate how to use a crawler to capture twitter space cations. If the audio file is very long (more than ten or twenty hours), how to quickly capture it?

[@kaicyrus0]

GOOD JOB BUDDY

[@bart8596]

You're the best!

[@aispectrum]

Thank you!

[@francescopalmisano4336]

Thank you so much! Is it possible to search by Geolocation?

[@aispectrum]

It may not be possible since there is no Geolocation filed in the advanced search.

[@manishabheemanpelly3580]

Hello AI Spectrum, sir i really wanna know that as per you have shown in previous videos that we can scrap the tweets in real time but their is an certain limit for it, but i wanna know is it posible to scrape unlimited realtime tweets using snscrape or any other library. Regards Manisha

[@patrickbateman7665]

0:11 You did not cut your hair. Your barber did XD

[@JiechaoQUAN]

hello, thanks a lot for your solution!! if I only want the english posts, how can I set this parameter such that I can get the targeted posts?

[@LukasCocinero]

Errors: blocked (404), blocked (404), blocked (404), blocked (404) anyone else get blocked ? new API conditions (thanks elon)? any solutions?

[@tomasmontiel5888]

Nice tutorial! is it possible to replicate the tweet count functionality as well (for more than 7 days)? Also, when would you recommend Tweepy over snscrape or viceversa? Thanks!

[@aispectrum]

I would use snscrape for getting tweets older than 30days since it's using web scraping. So no need to use the API or request elevated access. Tweepy uses the official API, so you can even make bots, but that's not possible with sncrape.

[@tomasmontiel5888]

@@aispectrum Thanks! By the way, does Twitter allows web scraping? Like, is it legal? Genuinely curious :)

[@edwinosayukiigbinosun6442]

@@aispectrum so true. I used snscrape to scrape data from the beginning of the year to present day (7 months) from twitter.

[@chaymabarkaoui6506]

@@edwinosayukiigbinosun6442 how do you get a specific number each day without getting only the tweets of 1st hour

[@stevex213]

I applied for elevated status just o do simple experiments with raspberry pi like turn on an led whenever someone tweets, but there was never an answer.. Does this code doe all that? Also, is this a general approach to twitter social media independent of platform general tutorial set? This library looks awesome!

[@LOLezzet]

Hello, probably a stupid question, but where can I find all 5000 tweets after I generate them? Thank you

[@anggun3045]

Hey, thanks for the video! I have a question, can we add more filters in the query? i.e only apply English, remove link, and retweets. Many thanks!

[@aispectrum]

Yes, absolutely. You can just modify the attributes of "advanced search" on the Twitter website, and then use the generated text for your query.

[@theepika1911]

@@aispectrum is the output in this video includes retweets?

[@theepika1911]

if so how to filter the retweets