Scrape Tweets with No Limitation and No API Key with Twint

  Рет қаралды 50,166

Ahmed Besbes

Ahmed Besbes

Күн бұрын

Пікірлер: 181
@mohamedberrimi4850
@mohamedberrimi4850 3 жыл бұрын
Very Nice Ahmed, Just it is worth mentioning that is way is somehow illegal according to Twitter guidelines, for researchers who aims to mention data collection from Twitter, their papers could get Ethical comments if they reported not using the official Twitter API. Keep posting such amazing things, Ahmed!
@laythabdulkareem1887
@laythabdulkareem1887 2 жыл бұрын
I managed to scrape tweets after solving some issues But the question here, how can I set a limit of retrieved tweets?
@sreshtarikka3896
@sreshtarikka3896 3 жыл бұрын
Unable to extract data using Twint. Error: No data expecting value. Could you please help
@chaitalichoughule13
@chaitalichoughule13 2 жыл бұрын
did you figure it out?
@mohammadismaylalmasud5399
@mohammadismaylalmasud5399 2 жыл бұрын
Thanks for the tutorial. Is it possible to gather all the tweets on a certain hashtag instead of setting n=1000 or a certain number? For example, If I want to collect all the historical tweets on a hashtag like ''climate change'', where should I make a change in the script?
@prasadnimantha
@prasadnimantha 3 жыл бұрын
getting this error when trying to install as instructed "ERROR: Directory '.' is not installable. Neither 'setup.py' nor 'pyproject.toml' found" both in Jupyter notebooks and Colab
@BillAugersdca
@BillAugersdca 3 жыл бұрын
Thanks for the A++ tutorial. I can execute a search via colab, the python shell, and vs code, but don't know how you ran it directly from the terminal. How did you do that?
@zacharycohen183
@zacharycohen183 3 жыл бұрын
Instablaster.
@colemanvollrath7180
@colemanvollrath7180 3 жыл бұрын
Thanks so much for posting this video Ahmed! Great job and very helpful!
@vtulin3097
@vtulin3097 Жыл бұрын
Hello,Would you mind if ask if you can demonstrate how to use a crawler to capture twitter space cations. If the audio file is very long (more than ten or twenty hours), how to quickly capture it?
@senghonglim9236
@senghonglim9236 2 жыл бұрын
Thank you very much Ahmed. May I ask a question? How to identify the date or time frame that I want to scrape? maybe 5-10 years period back.
@henrihelvetica5835
@henrihelvetica5835 2 жыл бұрын
Bien fait! C'est pas mon domaine mais j'avais une idée! Will have to come back to this but this is great!
@sriharshgottipati4894
@sriharshgottipati4894 2 жыл бұрын
Its working really good, thank you. How can we extract data from perticular region. Is the below correct ? "c.g="48.880048,2.385939,1km" ?
@mahmudhussinmohamed6455
@mahmudhussinmohamed6455 2 жыл бұрын
i think this is imposable
@mayabreslauer9979
@mayabreslauer9979 Жыл бұрын
i got this error: CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs do you know how can i fix it?
@MahaSaeed
@MahaSaeed 7 ай бұрын
i want to confirm that i can safely collect data per month around 3200 tweets only right?
@JM-INT
@JM-INT 3 жыл бұрын
Merci bcp pour cet outils performant j avais un grand soucis pour collecter un dataset relatif à une thematique bien precise pour un cas d étude pour mon PFE. J essaie de remplacer tweepy avec cet API. Si j px vous contacter en cas de souci c est sur quel plateforme.
@ЕгорТкачев-н7я
@ЕгорТкачев-н7я 3 жыл бұрын
Why do i have an error? AttributeError: module 'twint' has no attribute 'Config'
@lorenavalencia3431
@lorenavalencia3431 3 жыл бұрын
I had the same Error, could you solve it?
@ЕгорТкачев-н7я
@ЕгорТкачев-н7я 3 жыл бұрын
@@lorenavalencia3431 Yes, I just used command string. Check special command to use it
@ЕгорТкачев-н7я
@ЕгорТкачев-н7я 3 жыл бұрын
@@lorenavalencia3431 Check this video out. It helped me: Mine Twitter for Targeted Information Using Twint [Tutorial]
@irmanwafi
@irmanwafi 2 жыл бұрын
@@ЕгорТкачев-н7я i still cant solve it, can you help me?
@lamyasameh9704
@lamyasameh9704 3 жыл бұрын
got this error ..need ur help module 'twint' has no attribute 'Config'
@harshparekh3605
@harshparekh3605 3 жыл бұрын
Thank you for the video. I seem to have limitation with the tweets extracted. I seem to get only 3000 tweets for #WFH. Can you help with what might be wrong?
@RizkyHannaEkaputri
@RizkyHannaEkaputri 4 жыл бұрын
Hello, Ahmed! First of all, I will tell you that your video tutorial is amazingly easy, but as person who is not from IT industry, I'm in big trouble on following the guide. I already downloaded jupyterlab notebook and tried to copy the repo, but still didn't work at all. Can you point out which things I did it wrong? Hope you reply this soon since my final project is soon ended next week and I'm still in difficult on scrapping the Twitter data.
@AhmedBesbes
@AhmedBesbes 4 жыл бұрын
Hello Have you installed twint as well? if not, here are the commands: git clone --depth=1 github.com/twintproject/twint.git cd twint pip3 install . -r requirements.txt
@djoj20
@djoj20 3 жыл бұрын
Fantastic package! I've noticed though that when I want to scrape tweets starting from, say, 1 month ago, it finds much fewer tweets the farther back you go. For example, I searched for "covid" tweets around NYC in the past month and from the 35000 tweets it found, 30000 were for the past week and only 5000 where from earlier, which shouldn't be the case. Have you noticed a similar issue with finding old tweets?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
Interesting. I ve not noticed this issue to be honest. don’t hesitate to submit an issue on github
@keerthysureshoffical
@keerthysureshoffical 2 ай бұрын
Hello, friend How to Determine Whether Two Different People's Tweet Reactions Persons Match or not
@prigelpriyoutomo6206
@prigelpriyoutomo6206 3 жыл бұрын
can the scraping results from github twin in excel form be used? Or need dor permission first?
@satarupadeb1111
@satarupadeb1111 Жыл бұрын
I am getting the following error [!] No more data! Scraping will stop now. Can you please suggest how to resolve this
@dr.anujashukla1516
@dr.anujashukla1516 3 жыл бұрын
Hi, I get error ModuleNotFoundError Traceback (most recent call last) in ----> 1 import twint ModuleNotFoundError: No module named 'twint'
@studentinusa7117
@studentinusa7117 3 жыл бұрын
Thanks mate ..You have helped me in my project
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
You’re welcome!
@explorenations892
@explorenations892 3 жыл бұрын
can you take tweets from certain date in twinch ?
@choowie92
@choowie92 2 жыл бұрын
Very good library. I was using the Twitter API but the 250 request/month killed me. I can't believe Twitter charges $150 for 500 search per month.
@aquawo2359
@aquawo2359 3 жыл бұрын
is twint allow historical data to be scraped?
@belxym
@belxym 3 жыл бұрын
thanks for this video , i would like to ask you if it is possible with Twint to get Tweets from users who are between 16 and 26 years old and in a specific month for example in April 2021? if not is there any solution?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
I don’t think this is possible : twitter will most likely don’t give access to such personal data
@leosnotstudying3143
@leosnotstudying3143 3 жыл бұрын
Hi Ahmed, i try it and it works! but i think that the q of tweets that we are able to extract is capped. How can we loop it by date?
@timoimot
@timoimot 3 жыл бұрын
Great input, thanks! Would like to ask, whether you get blocked using it too often/intense? Do you know how a proxy rotation would work?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
from my experience, I did not face any blocking. I've used proxies so far.
@hasmetmeap2636
@hasmetmeap2636 3 жыл бұрын
@@AhmedBesbes how do you use the proxies? I don't get any response
@nwh9926
@nwh9926 3 жыл бұрын
hi, i have question, im using python 3.6 but im not allow to install jupyter notebook :/ do you know why? can u suggest me the solution ? thank you.
@lungelongiba6293
@lungelongiba6293 2 жыл бұрын
when installing twint should i use command prompt
@emirjibran2284
@emirjibran2284 3 жыл бұрын
Hi im still new with github, how do i clone the repo and install it locally?
@KhalilYasser
@KhalilYasser 4 жыл бұрын
Thanks a lot Ahmed. I am using Windows so I have installed Git Bash and could git clone the twint using Git-Bash. But when trying the code on jupyter, I got error `AttributeError: module 'twint' has no attribute 'Config' . Although I tried these three lines with no problem at all : import twint import nest_asyncio nest_asyncio.apply() `
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
Strange. I reinstalled Twint on my machine and could call the Config attribute without any issue. Did you make sur the kernel that's running your jupyter notebook has the same version of Twint you installed?
@cocodiasz5560
@cocodiasz5560 3 жыл бұрын
Update Tornado to latest version
@Coolhalo
@Coolhalo 3 жыл бұрын
Bonne vidéo, Je cherche à faire un bot qui est capable de trier des news/tweets importants en temps réel. Est-ce que je dois forcément passer par un bot twitter ou puis-je le faire avec cette méthode?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
Vous pouvez collecter les tweets avec cette méthode
@Leocarted
@Leocarted 3 жыл бұрын
Can I scrape Twitter data of a specific user profile using Twint?
@olyalya275
@olyalya275 3 жыл бұрын
does anybody have CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 125.0 secs?
@lubna.youdhister
@lubna.youdhister 3 жыл бұрын
Same problem here
@lubna.youdhister
@lubna.youdhister 3 жыл бұрын
Value error
@scofieldbtrd2424
@scofieldbtrd2424 3 жыл бұрын
Same error
@pankajuprety9216
@pankajuprety9216 3 жыл бұрын
same error
@anabeatrizb.tenorio5108
@anabeatrizb.tenorio5108 3 жыл бұрын
Same
@mirzaabdulrehman428
@mirzaabdulrehman428 3 жыл бұрын
Getting this error any idea to fix? CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs
@jagupatigolguri1875
@jagupatigolguri1875 Жыл бұрын
Same error I am also getting
@jagupatigolguri1875
@jagupatigolguri1875 Жыл бұрын
Plz help some one
@turikmmm5069
@turikmmm5069 3 жыл бұрын
Thank You So Much for the tutorial !
@ramdanirizkipratama3385
@ramdanirizkipratama3385 3 жыл бұрын
I have installed twint but the results when I run it it like this AttributeError Traceback (most recent call last) Can you help me with it?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
can you print the full error message?
@adityar6511
@adityar6511 3 жыл бұрын
How can I do boolean filter here Just like in tweeter search bar "Nigeria" ("music" OR "musician" ) this will give all the values includes nigeria with music or nigeria with musician
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
I don't think that's possible. what you can do, however, is search tweets containing all these terms and then do additional post processing
@adityar6511
@adityar6511 3 жыл бұрын
@@AhmedBesbes I want to create an web application which daily refreshes whenever we make request and it gets the latest data containing nigeria and music and returns sentimental analysis in the visualization form. Any tips and hints
@chrnsingh35
@chrnsingh35 3 жыл бұрын
Hi Is it possible to get the notification of some keywords matching ?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
hello! I'm afraid no. you have to implement such a system yourself by designing a notification server.
@robinmasawi
@robinmasawi 3 жыл бұрын
Thank you for the tutorial. I wanted to ask, is there a way to automate the process of extracting tweets with TWINT?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
yes absolutely. you'll have to schedule your scraper with a scheduler. if you're using a linux server, you have to look at crontab.
@giacomocamba2860
@giacomocamba2860 3 жыл бұрын
Really great, Thanks a lot Ahmed. I just have a question. Can this tool also be used with Stocktwits?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
Sorry I'm not familiar with Stockwits
@kivanch3785
@kivanch3785 3 жыл бұрын
can we see private account's tweets also?
@noviceplayah
@noviceplayah 3 жыл бұрын
Hello ,i want to ask, in this case we got all data, how to get tweet data,username and created_at tweet only ?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
all this data is available for each tweet once you load the output file in either csv or json. Plase have a look at the way I read the exported data in Jupyter
@tesfaadam2001
@tesfaadam2001 2 жыл бұрын
how can i use location and keywords togather ????
@sookarlok3260
@sookarlok3260 4 жыл бұрын
im facing a issue CRITICAL:root:twint.get:User:Cannot connect to host twitter.com:443 ssl:True [Connect call failed ('104.244.42.65', 443)] can you help on this?
@parulsingla3783
@parulsingla3783 3 жыл бұрын
hey! I faced this error while importing nest_asyncio. ModuleNotFoundError Traceback (most recent call last) in 1 import twint ----> 2 import nest_asyncio 3 nest_asyncio.apply() ModuleNotFoundError: No module named 'nest_asyncio' can you please tell what is the issue?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
you'll have to install it : pip install nest-asyncio
@lulual-kulaib9408
@lulual-kulaib9408 3 жыл бұрын
Thank you so much for the informative video! Is there any way to use Twint with the user id instead of username? I can't figure it out for some reason. Getting errors like URL, or empty even though the user exists.
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
I don't think it's possible to search tweets by user id.
@joaopauloalvesdasilva9888
@joaopauloalvesdasilva9888 3 жыл бұрын
how do I get tweets that must have two words in the same tweet?
@ahmadhanif1481
@ahmadhanif1481 3 жыл бұрын
config.search='first_word and second_word'
@vvalk2vvalk
@vvalk2vvalk 3 жыл бұрын
Great Video. It was helpful, thanks.
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
You're welcome
@sanakousar2487
@sanakousar2487 3 жыл бұрын
i need tweets between 2019 to 2021 but " since and until" didnt work. kindly guide me or provide me code to scrape those tweets
@sisteminformasifaridmuhamm4374
@sisteminformasifaridmuhamm4374 3 жыл бұрын
me too
@nourakazemi2713
@nourakazemi2713 3 жыл бұрын
What if we need gender and age of each ID?
@SantiNico96
@SantiNico96 3 жыл бұрын
I have problems to use Twint with R R reticulate package :( do you know what is happening?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
I have no experience using R, sorry :/
@aymenkhaled4263
@aymenkhaled4263 3 жыл бұрын
Very useful tutorial ! Keep going
@brittj8630
@brittj8630 3 жыл бұрын
Hey Ahmed, very helpful video. I am able to load all the tweets I want. However, when I want to see the head of the dataframe all the output is ‘NaN’ - not an number. I tried changing it to a string but it doesn’t work. Do you have any idea how I can solve this?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
can execute this command from the terminal and tell what you get? head -n 3 ** this prints the three first rows. maybe there's something corrupt in the data.
@amins6695
@amins6695 3 жыл бұрын
That is amazing. Really really appreciate
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
Thanks !
@grazianodicapua7380
@grazianodicapua7380 4 жыл бұрын
I am having problems as well. I don't get any tweet. Is it possible to provide a step by step video including the proper installation?
@AhmedBesbes
@AhmedBesbes 4 жыл бұрын
it's working for me on Mac OS. I installed twint by cloning the repo, not using pip.
@grazianodicapua7380
@grazianodicapua7380 4 жыл бұрын
@@AhmedBesbes git clone --depth=1 github.com/twintproject/twint.git cd twint pip3 install . -r requirements.txt I am installing it by using this code by after the first line Python returns me an error in particular below "clone" I get "syntax error". How can I fix it? I am using Visual Studio Code with Python 3.9.0, but I have tried to use as well as the Jupiter online platform.
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
@@grazianodicapua7380 Can you please print the full error message?
@sunzalea3257
@sunzalea3257 2 жыл бұрын
will it let me download over 27K tweets?
@realjohnhoward
@realjohnhoward 4 жыл бұрын
Great tutorial. Thanks much!
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
you're welcome!
@felixkrell890
@felixkrell890 3 жыл бұрын
`AttributeError: module 'twint' has no attribute 'Config' --> I have no Idea what I am doing wrong I followed all of your steps. Deleted and desinatlled everything, installed anaconda from scratch, opened Juypter for the first time again, same problem
@elmareao
@elmareao 3 жыл бұрын
it seems its not working anymore in a consistent manner. idk if that's because a block from twitter but there are a lot of comments at twint project with the same issue.
@devinaarnachellum
@devinaarnachellum 3 жыл бұрын
hello have you been able to resolve the issue?
@felixkrell890
@felixkrell890 3 жыл бұрын
@@devinaarnachellum yes actually, here: github.com/twintproject/twint/issues/1229
@ХасановРамзиль
@ХасановРамзиль 4 жыл бұрын
Tell me please, is this library working now? I get an error like: CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
@AhmedBesbes
@AhmedBesbes 4 жыл бұрын
Make sur to install it using git. Clone the repo, then do pip install -r requirements.
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
I've just retried it now. it's still working. (MacOS)
@raheemnasirudeen6394
@raheemnasirudeen6394 2 жыл бұрын
Thanks for the excellent presentation, you are life safer.
@mr_nb
@mr_nb 3 жыл бұрын
Awesome man, you saved my life but i have a question. Is it allowed yo do it according to twitter policies???? I hope you understand my question...
@trevormachimbidza8394
@trevormachimbidza8394 3 жыл бұрын
Thanks. However, l am getting this Error RuntimeError: This event loop is already running Expecting value: line 1 column 1 (char 0) [x] run.Feed [!] if get this error but you know for sure that more tweets exist, please open an issue and we will investigate it! Kindly assist
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
It’s frowned upon :)
@bdooali8287
@bdooali8287 3 жыл бұрын
It is amazing tools but could you please upload video how to install the required because I tried but still there’s error
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
What's the error you're facing?
@bdooali8287
@bdooali8287 3 жыл бұрын
@@AhmedBesbes twint critical:root:twint.run:twint:feed:nodataexpecting value: line 1 column 1 (char 0) It is working with me last year but now the msg above appears. So, I think maybe I change something. Because I tried to install it on another computer
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
@@bdooali8287 ok. I tried installing it today. works fine
@walangurban4796
@walangurban4796 3 жыл бұрын
Honestly i'm noob for this thing, but I've got the data cause your tutorial 😁, it's very helpfull👍 , but i can't move any further, i got some problem with the output script (c.Output =) . Could you tell me what is going on, please? i do exactly with what you do, but its doesn't work. What i miss? I'm running in jupyter with powershell prompt . Or is it just open with anaconda?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
could you give more details about your error?
@walangurban4796
@walangurban4796 3 жыл бұрын
@@AhmedBesbes hy, thanks for the respond. i got more progress today actually. Now the problem is when i start run data = pd.read_json(. In the end output says the value eror: expected object or value.
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
@@walangurban4796 try adding orient='records' in pd.read_json : --> data = pd.read_json(, orient="records")
@walangurban4796
@walangurban4796 3 жыл бұрын
@@AhmedBesbes i was do your suggest. But the output still came up with the same error
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
@@walangurban4796 can you open the file with json instead of pandas ?
@homerianreyes8688
@homerianreyes8688 4 жыл бұрын
Is it possible to scrape a tweet by location?
4 жыл бұрын
Yes, you can. By terminal something like: twint -g="48.880048,2.385939,1km". And on Python with .Geo or with .Near. Take a look at the wiki page: github.com/twintproject/twint/wiki/Configuration
@soheilaahmadi4807
@soheilaahmadi4807 3 жыл бұрын
Thank you so much for the video. I had a question if I can extract data between two given dates with this method?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
yes - you can specify the date range within the arguments of the script. You'll have to play with the *year* and *since* arguments
@soheilaahmadi4807
@soheilaahmadi4807 3 жыл бұрын
@@AhmedBesbes Thank you so much for the response. I appreciate that. yes I am playing with them. I have a few questions. May I contact you in faster way? regards
@ai.201
@ai.201 3 жыл бұрын
Hi Is it possible to check how many of the followers are having less then 5 followers using twint? Because ij twitter api i always exceed rate limit. Thanks. Edit: suppose an account has 100k followers so it it possible for me to do it? I'm waiting for your reply thanks. Great video and subscribed.
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
yes , for each of the followers you have to run the following command based on their usernames twint -u username --followers then you do a count and filter
@ai.201
@ai.201 3 жыл бұрын
@@AhmedBesbes wow Ahmed, this is super awesome. I'm glad i found your video. So one more question suppose a person has 15 million followers and I want to check how many of the followers are having less then 5 followers. Do you think will there be any limitations of doing this big amount of scrapping?
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
@@ai.201 I can't really tell you . I haven't scraped that amount of followers
@ai.201
@ai.201 3 жыл бұрын
@@AhmedBesbes ok, still thanks man.
@ai.201
@ai.201 3 жыл бұрын
@@AhmedBesbes ok bro twint follower method is not working. Is there any alternative to extract thousands of followers because twitter api sucks and I'm working on my final year project in university.
@the3dplanet893
@the3dplanet893 3 жыл бұрын
can i scrape emails from tweets with this method ??
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
you can apply a regex on top of the tweets you collect
@charlesgross4893
@charlesgross4893 4 жыл бұрын
Is Twint blocked by Twitter now? That's what i am hearing
@AhmedBesbes
@AhmedBesbes 4 жыл бұрын
it's working for me on Mac OS. I installed twint by cloning the repo, not using pip.
@charlesgross4893
@charlesgross4893 4 жыл бұрын
@@AhmedBesbes i have WIn 10. Do you think it will work?
@AhmedBesbes
@AhmedBesbes 4 жыл бұрын
@@charlesgross4893 it should normally work. try installing by cloning the repo (as explained in the readme)
4 жыл бұрын
@@charlesgross4893 i have Win 10 Pro and it was work. First of all, you must install twint on BASH.
@soheilaahmadi4807
@soheilaahmadi4807 3 жыл бұрын
@ Hello Huseyin. Can I contact you? If so, would you please give me your email address?
@aryanrasaily8252
@aryanrasaily8252 3 жыл бұрын
Hi nice video, I am getting this problem while trying to save the data in json file "[Errno 2] No such file or directory: '../data/covid_demo_1.jason'" though i have typed all the commands as shown in the tutorial, if someone can help me it would be really greatful.
@nishadseeraj7034
@nishadseeraj7034 3 жыл бұрын
Question: I installed twint by cloning the repo into my command prompt and everything installed ( after using pip list i see twint on my list of packages) however when i try to import it into my jupyter notebook , I'm seeing an error saying no "module named twint." Do i still need to install using pip on the jupyter notebook? Great tutorial btw!
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
I'd say that your jupyter notebook is not using the same environment where you installed Twint.
@shadowhawk5511
@shadowhawk5511 3 жыл бұрын
hi, not sure if you are still facing this issue now since this is an old comment. but in case it helps anyone: i used the line below to directly install twint to my notebook, and it worked :) !pip install git+github.com/twintproject/twint.git
@Technomic-o
@Technomic-o 2 жыл бұрын
@@shadowhawk5511 thanks that works!
@AnkurGoyal-rx3ol
@AnkurGoyal-rx3ol 2 жыл бұрын
donnt what u re doing at 1:47
@amitchandnia
@amitchandnia 3 жыл бұрын
Yesterday It was working fine but today facing the following issue: CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 8.0 secs
@amitchandnia
@amitchandnia 3 жыл бұрын
Please give the solution
@elmareao
@elmareao 3 жыл бұрын
im getting the same error as many many other users as well.
@veronicanatividade
@veronicanatividade 3 жыл бұрын
Thank you so so much!!
@marcogelsomini7655
@marcogelsomini7655 3 жыл бұрын
woow you are the best!
@patrickasis3360
@patrickasis3360 4 жыл бұрын
everything works fine form ne but i got problem when i read the json file. i also write the parameter lines=true yet I'm still getting error. the tweets are there but error says," ValueError: Expected object or value" hope you could help me. thanks
@AhmedBesbes
@AhmedBesbes 3 жыл бұрын
What I usually do when the file seems corrupted, is opening it (if possible) with vscode and cleaning some trailings commas or brackets
@patrickasis3360
@patrickasis3360 3 жыл бұрын
@@AhmedBesbes thanks ^_^
@tebogoselepe969
@tebogoselepe969 2 жыл бұрын
Twint is so powerful... it almost feels like an illegal script😂😂
@hanniedeneus9118
@hanniedeneus9118 Жыл бұрын
Hi Ahmed, thank you for the clear presentation of this code! I am wondering whether it is possible to only scrape tweets by location and for a specific time period, for example tweets about 'covid' in the United States from July, 2021 until August, 2021. Do you have a solution for this? Thanks in advance.
@pythonically
@pythonically Жыл бұрын
yes, it is possible , see the documentation of the twint
@xer2964
@xer2964 2 жыл бұрын
Twint required python version 3.6
@sdhilip
@sdhilip 4 жыл бұрын
Nice explanation. Sometime Twint is not working
@AhmedBesbes
@AhmedBesbes 4 жыл бұрын
Make sure to install it properly by cloning the repo, not using pip install :)
@alanferrari7843
@alanferrari7843 3 жыл бұрын
How can I install twint in anaconda?? Thanks!!!
@ilhamakhyar4849
@ilhamakhyar4849 3 жыл бұрын
U can use anaconda prompt
@sanjanabharambe3558
@sanjanabharambe3558 4 жыл бұрын
I used the following command: git clone --depth=1 github.com/twintproject/twint.git cd twint pip3 install . -r requirements.txt But it shows me this error: Usage: pip install [options] [package-index-options] ... pip install [options] -r [package-index-options] ... pip install [options] [-e] ... pip install [options] [-e] ... pip install [options] ... no such option: --depth And if I still continue with #configue and #run, I get this error: CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 8.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 27.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 64.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 125.0 secs Please help me to solve it
@FRANKWHITE1996
@FRANKWHITE1996 3 жыл бұрын
nice!
@foredee8496
@foredee8496 3 жыл бұрын
Noice, can't wait to cancel more people using this tool!!!!!1!!! sksksksksk and i oop-
@lemonchicken507
@lemonchicken507 3 жыл бұрын
Shit. You didn't even show us how to install it.
@samarthparikh142
@samarthparikh142 3 жыл бұрын
i love trump cause i am gay!!!!
@dhanushvasa9346
@dhanushvasa9346 3 жыл бұрын
Hey i have been trying to extract 5 years of data on BSE500 but when i run the code it is only extracting data from past 10day and no more. any advice please.
@hibaqomar4656
@hibaqomar4656 3 жыл бұрын
I get the error Could not find the Guest token in HTML, how can I solve this?
@hibaqomar4656
@hibaqomar4656 3 жыл бұрын
and [!] No more data! Scraping will stop now. found 0 deleted tweets in this search.
@amittabibi1433
@amittabibi1433 3 жыл бұрын
@@hibaqomar4656 same!! did you manage to get along?
How I get Tweet data for FREE in 2024 as a data scientist
19:28
AI Spectrum
Рет қаралды 22 М.
How to get TWEETS by Python | Twitter API 2022
17:04
AI Spectrum
Рет қаралды 147 М.
Cat mode and a glass of water #family #humor #fun
00:22
Kotiki_Z
Рет қаралды 42 МЛН
1% vs 100% #beatbox #tiktok
01:10
BeatboxJCOP
Рет қаралды 67 МЛН
人是不能做到吗?#火影忍者 #家人  #佐助
00:20
火影忍者一家
Рет қаралды 20 МЛН
Industrial-scale Web Scraping with AI & Proxy Networks
6:17
Beyond Fireship
Рет қаралды 782 М.
Get UNLIMITED Tweets by Python Without Twitter API
7:13
AI Spectrum
Рет қаралды 107 М.
Something is wrong with ISPs in India 🇮🇳
13:17
Mehul - Codedamn
Рет қаралды 77 М.
Scrape Twitter with 5 Lines of Code
6:36
Rob Mulla
Рет қаралды 76 М.
Cat mode and a glass of water #family #humor #fun
00:22
Kotiki_Z
Рет қаралды 42 МЛН