Learn how to scrap TWITTER data in python - 2024

[@sarvarbekfozilov9829]

hello bro can u send source code pls

[@KDcodeyt]

Here is the git hub link : github.com/KDcodeyt/Twitter_scraping Please Subscribe if it's helpful.

[@sarvarbekfozilov9829]

bro how can i also get comments any post@@KDcodeyt

[@KDcodeyt]

This package is still in developing the feature to retrive comments for the tweets, so we need to use API to retrive them

[@damilolasunday7119]

Is there a way I can use the twitter API to generate that ?

[@KaitoEasyApi]

Great tutorial! For those who want to skip the complexity of building scrapers, I've created a ready-to-use API that handles rate limits and authentication.

[@KaitoEasyApi]

Great tutorial! For those who want to skip the complexity of building scrapers,

[@gauravkumarjaiswal1912]

hi there, does this code still work?

[@ВладПылаев-ж4р]

@@gauravkumarjaiswal1912 no

[@suigetsuh17]

Does Nitter still work now? I read that it's discontinued.

[@自在独行-x2n]

Hi,bro. How can I solve"Empty page problem"? I really need your help!

[@AmanKumar-xw5bs]

U got any solution for empty page problem?

[@KDcodeyt]

please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets. i have also explained how to get tweets for specific date range please subscribe for more videos 🙂

[@damilolasunday7119]

In scraping dataset for sentiment analysis for business, do i need be specific on the username to scrap? Thanks for this video

[@KDcodeyt]

Hi, For sentiment analysis we are not restricted to specific username, we can randomly scrape the tweets as per term Subscribe for more videos🙂

[@damilolasunday7119]

Please I would love your guidelines or is the any video on it so I can watch

[@KDcodeyt]

@@damilolasunday7119 will do sentiment analysis with Twitter data project soon☺

[@damilolasunday7119]

Alright, I will appreciate that BCOS I'm working on a project related to it . Thanks

[@harish77720]

@@KDcodeyt If you find it interesting, maybe a sentiment analysis on the US rental markets? I'm currently in the middle of this project too!

[@ksrao1us]

awesome tutorial. Thanks for the explanation and sharing the code and notebook.with your explanation and including troubleshooting issues with tqdm ,I could finish the whole tutorial in less than 30 minutes !! Please keep up the good work.

[@JuanSosa-gd8uy]

hello when I run the Code does not return any data, why is that? {'threads': [], 'tweets': []}

[@KDcodeyt]

you can try running again because some times the instances might not be available please subscribe for more videos

[@ks-xh4fq]

when using mode as term I ain't getting tweets. working only on user mode

[@ab8950]

wait, i thought they already banned scraping method? cuz the tools i usually use to scrap called twint still unusable

[@GibaPSP]

and he uses Elon tweets in the demonstration. What a flex haha

[@GloryBenedict-qs5sf]

Please what’s the limit on the tweet you can get

[@hanshernandez5513]

Is it possible to scrape based on geolocation?

[@KDcodeyt]

Hi , Using ntscraper, we can't do that, but we are in progress of making one more video and we also cover this part, please subscribe and stay tuned, we will release the video soon

[@KDcodeyt]

Hey, Explained about Geolocation and retrieving comments in this video : kzbin.info/www/bejne/d4HEn42erMl4pMk please check it out

[@erniwidyawati6254]

is it possible to scrape for some keywords?

[@KDcodeyt]

Yes, it is possible you can use scraper.get_tweets("any keyword") to scrape the tweets, please subscribe for more videos

[@vittorialuna-h7h]

Is it possible to scrape hashtags?

[@AmanKumar-xw5bs]

Got any idea?

[@laidkahloul322]

Amazing video. I was looking for this. Thanks a lot.

[@JHAANESHV]

Hi, I tried this code, I am constantly receiving an output as "empty page". How do I rectify this? Same case for profile scrapping and tweet scrapping

[@自在独行-x2n]

Only the user mode works..

[@KDcodeyt]

Do watch this video for alternate method : kzbin.info/www/bejne/d4HEn42erMl4pMk

[@LondonD]

Greetings, excellent video. Is it possible to obtain comments on publications?

[@KDcodeyt]

This package is still in developing the feature to retrive comments for the tweets, Subscribe for more videos and feel free to explore other videos in channel

[@KDcodeyt]

Hey, Explained about retrieving comments in this video : kzbin.info/www/bejne/d4HEn42erMl4pMk please check it out

[@Mr-Arslan]

the api is great but when I'm changing mode to hashtags or terms It doesn't give me result.

[@ParthviGohil-be9fb]

hi, there is a fetching error: instance has been rate limited. what can be done?

[@KDcodeyt]

Hi, Those instances might be busy sometimes please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets. Please subscribe if it's helpful :)

[@ParthviGohil-be9fb]

@@KDcodeyt hi, thanks so much for your response! actually i want to extract tweets on my web app to perform sentiment analysis. i don't think apify can work for this?

[@KDcodeyt]

You can integrate your web app with the apify actors

[@ParthviGohil-be9fb]

I see. I am looking into it right now - can you please make a small video regarding it if possible? How to integrate apify on python code to extract like 10 tweets for example

[@KDcodeyt]

Hi our team noted it on Queue, will make it happen soon.

[@amalmk1995]

But how about data info for the tweets?

[@okanaltunbascom]

This library does not take mentions as data. How do we get them?

[@KDcodeyt]

Hi, please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets.

[@inno4reel]

Wow😮😮. Brilliantly done👍

[@KDcodeyt]

Thanks a lot 😊

[@idk-si4fl]

Hi, do you know if I can get trending tweets using this library? Thank you for the tutorial

[@KDcodeyt]

Hi, using hashtag mode and search term as trending, you can get #trending tweets. Also get more insight on twitter data scraping in this video : kzbin.info/www/bejne/d4HEn42erMl4pMk please subscribe if it's helpful :)

[@idk-si4fl]

Thank you so much

[@bourkebnajiba7890]

@KDcodeyt please i want to scrape images from twitter, can you help me get the necessary code?

[@aimeenatya]

why mine show name “Nitter” is not defined when it runs??

[@KDcodeyt]

Hi, Give it a try to install and run it again, please do watch this video for alternative method - kzbin.info/www/bejne/d4HEn42erMl4pMk

[@stanleychukwuemeka8841]

Is scraping millions of tweets still possible because i would like to build an AI model using the text data. Please if it's possible how can I go about it?

[@KDcodeyt]

please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets. i have also explained how to get tweets for specific date range please subscribe for more videos 🙂

[@burakoglakc1286]

Thanks for this explanatory and instructive video. I remember that Nitter has recently over, can you still import data from Nitter?

[@KDcodeyt]

Hi, please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets. please subscribe for more videos 🙂

[@ParisaEmk]

Can i retriet data of past January 2024 based on this code?

[@KDcodeyt]

Hi, please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets. please subscribe for more videos 🙂

[@muhammadulinnuha4628]

What about using keywords? Without using a Twitter user ID?

[@KDcodeyt]

Hi, please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets

[@shrehansrai5673]

We can do it with browser based tools. But it can be helpful if it can do the the billow requirment In twitter profile we have to section post and replies and i believe it is giving post not replies please confirm

[@KDcodeyt]

Yes, using this ntscraper we can retrieve all the post, but getting comments is still under development, please subscribe if it's helpful

[@sharayu3913]

Hi Can you please explain how can we apply start date and end date method?

[@KDcodeyt]

Hi, you can follow this video : kzbin.info/www/bejne/d4HEn42erMl4pMk, this will be helpful.

[@parisaemkani5730]

can I retrieve data from Twitter by basic developer account? I need data from 01/01/2024 until 31/01/2024. I would be grateful if someone could help me with this issue. I am very new to twitter developer and do not know how to scrape data from twitter for 30 days in January.

[@KDcodeyt]

Hi, we cannot scrape data from twitter using basic developer account, it can only be used to post data as per documentation, So, please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets. i have also explained how to get tweets for specific date range please subscribe for more videos 🙂

[@RadicalRed0]

Very Nice Video

[@droptimistic7419]

Hi can I collect the tweets using free account of API?

[@KDcodeyt]

please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets. i have also explained how to get tweets for specific date range please subscribe for more videos 🙂

[@wiliz3d945]

Make more videos on this please 🙏 I need it

[@KDcodeyt]

Yeah, we planned it already, will be releasing the video soon, please subscribe, it will keep us motivated

[@KDcodeyt]

Hi, One more video about Twitter Scraping is out now : kzbin.info/www/bejne/d4HEn42erMl4pMk please check it once

[@girmayohannis4659]

Nice explanation, Thanks! But how to scrap data in particular topic like 'sarcasm' from all tweets to do research?

[@KDcodeyt]

Hi, you can follow this video : kzbin.info/www/bejne/d4HEn42erMl4pMk, this will be helpful.

[@okanaltunbascom]

Hi! Can i get follower list or following list ?

[@KDcodeyt]

Hi, please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets. please subscribe for more videos 🙂

[@yiqingchen6160]

Sorry I am new to Python. Could you teach me how to scrape the comments/replies on Twitter? Thank you so much!

[@KDcodeyt]

Hi, please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets.

[@harshwardhankadam5598]

Plz send me the documentation link...

[@vrushaliphadtare184]

Great Video ...please share video about get data from twitter with specific keywords by search

[@KDcodeyt]

Hi, please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets

[@kragondraken5352]

thanks bro nice tutorial

[@KDcodeyt]

Subscribe if it's helpful

[@snehaprasad1755]

why I'm getting {'threads': [], 'tweets': []} this ???

[@MaytheLordbewithyou2]

I'm having the same issue

[@KDcodeyt]

please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets. i have also explained how to get tweets for specific date range please subscribe for more videos 🙂

[@prithvipk6328]

But ntscrapper was returning empty array many times how to fix??

[@KDcodeyt]

It might be due to heavy traffic, and instances may not be available, so try to run it again, they will get the data for sure, 🙂subscribe us for more videos

[@akindefisayo3267]

Hello bro. This is awesome. very helpful in my research. please, how do i access geotagged tweets, i mean tweets from certain regions within a country, maybe a state or county in USA for example, can you please make a tutorial on how to achieve this???? Thank you for the great content.

[@KDcodeyt]

Hi, please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets based on Geolocation too.

[@Marie-PearlAkoto]

thank you so much for this!

[@chimmuanyaijezie4049]

Hello, how can i get the code

[@KDcodeyt]

Hi, Here is the github link : github.com/KDcodeyt/Twitter_scraping please subscribe for more videos :)

[@DuneeshaSuloshini]

not working for me

[@KDcodeyt]

Hi, please watch this video : kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method here.

[@RadicalRed0]

After using it a few times I am getting this error, WARNING:root:Fetching error: Instance has been rate limited.Use another instance or try again later.

[@KDcodeyt]

please do watch this video - kzbin.info/www/bejne/d4HEn42erMl4pMk I have explained an alternative method to scrape tweets. i have also explained how to get tweets for specific date range please subscribe for more videos 🙂

[@hejrey6228]

If anyone gets it to work, please create a requirements file with the packages needed

[@codingboy8665]

thank you bro

[@busracelik1165]

As far as i know extracting data from the twitter has not been permitted so far

[@fkaraal]

It returns empty

[@KDcodeyt]

you can try using "random_instance = scraper.get_random_instance()" to get the random instance of nitter because some times the instance might not be working, if it is still not working you can also try creating a object like this "scraper = Nitter(log_level=1, skip_instance_check=False)" please Subscribe if it's helpful

[@zenzatoichi1]

bro didnt drop the code

[@KDcodeyt]

Hi, please check the description stay tuned for more videos :)

[@kiralim2836]

i tot nitter is dead

[@souvikkarmakar9646]

thank you broo...