How To Scrape Reddit & Automatically Label Data For NLP Projects | Reddit API Tutorial

[@bthapa94]

Great video and well explained! How do you scrape ALL the posts for a certain time period? I am looking a small subreddit and require a lot of data.

[@dabunnisher29]

You are certainly one of my favorite Python Masters. I really needed to learn how to do this for stocks. Thank you sooooooo much! You are AWESOME!!!!!

[@patloeber]

Glad you like it :)

[@dabunnisher29]

I looked all around today and I couldn't find how to search a subreddit by a key word like "PLTR", get the results and use the NLTK library. If anyone can help, I would appreciate it.

[@dodgewagen]

Thanks! Definitely, do more of these API consumption/analysis videos.

[@patloeber]

Ok :)

[@carfromcars3679]

wowwww easiest tutorial to follow by FAR. thank you!!!!

[@NoIntroTutorials]

MAGNIFICENT! I just needed the first part, getting the post titles!, thank you man!

[@moy92]

Thanks for doing this! I have been wanting to scrape reddit for a while as exploratory analysis

[@patloeber]

hope you like it :)

[@paulsastre9833]

thank you for this wonderful video. but how did you get the url used in the beginning

[@Asianyoungman22]

thank you very much, you save my life, my dissertation for my master degree.

[@catalina5382]

This is exactly what I wanted. I would like to know what modifications do I have to make in order to get the headlines with the flair as well

[@chasengonzales85]

This is really awsome thank you for taking the time to put this together.

[@anny23108]

Could you do a tutorial for mining historical data as well? thank you

[@fernandosantos3576]

Yes, I woul love if you publish a video on a complete project. Thank you.

[@patloeber]

Ok 👌🏻

[@ElectroCoderEC]

woooow amazing. You save my life. very useful. Thanks a lot! :)

[@mealone007]

Great video! Quick question, how to scrape the historical headlines with date stamp?

[@bitsinbytes9002]

The UTC attribute will give you the Unix Timestamp, then you just have to convert it. Getting historical headlines may be a little trickier, as the PRAW API allows you to iterate through the following "submission" types: controversial, gilded, hot, new, rising, top.

[@miaoinperth680]

Thanks so much for your video. Will you share the codes in github or somewhere?

[@JackFrost1206]

Maybe you can scrape the subreddit wallstreetbets :D

[@patloeber]

Good idea

[@nathanielpetruska1305]

@@patloeber Scrape to see the stocks that are rising in popularity! haha

[@tazrinkhan1297]

Thank you for this video. This is really helpful. I am trying to get data for a particular time period (March 2020- November 2020). Can you please tell me how to write the code for this?

[@varinderjitkaur3656]

great video, i am trying to get the historical daily number of members on a subreddit. Is it possible using praw?

[@prod.kashkari3075]

Wow push and praw!

[@wasgeht2409]

Hey, danke für das Video :) Habe unten lesen können, dass du aus Deutschland bist. Ich hätte da mal eine Frage und zwar ist es auch möglich über LDA kommende Textnachrichten in Themengebiete zuzuordnen ?

[@basemgoueli]

I have a project I could use the help of someone of your caliber with. I want to determine the five stocks mentioned most frequently on Reddit's WallStreetBets page on a given day. from January 2022-August 2022 (I have the CSV file for this). After that I want to take the five most commonly mentioned stocks based on number of days in the top 5 from the aforementioned analysis. I would like to plot the number of mentions of the given stock per day against its stock price for the designated time frame. Any help you can offer would be greatly apprecaited.

[@prajjwalsinha1187]

How do I scrape comments from reddit posts?

[@Probly]

Do you know how to scrape in a specified time period so I can compare sentiment towards a stock within r/wallstreetbets or r/investments against the historical stock price of the same period

[@gsom2000]

great tutorial! Thanks a lot! is there any opportunity to do the same with twiiter data?

[@patloeber]

I already have 2 tutorials using the twitter API (tensorflow NLP and flask Twitter bot). Maybe you can apply the knowledge from these videos here

[@gsom2000]

@@patloeber nice! apparently i just missed them! Danke!

[@blancaherrerosdetejada7160]

Is it a way to automatically scrape any new posts in a subreddit? (without having to re-run program)

[@limjuroy7078]

Why the user_agent is not "Example"?

[@selcukturk3550]

how can i get this code?

[@samarendrapradhan5067]

I"m using python 3.9,so older vesion may differ for my below comment.Thanks

[@fintech1378]

why is it always 401?

[@gardnmi]

Just went to that politics subreddit. It's laughably bias. Thanks for the tutorial.

[@patloeber]

Haha yeah

[@knowledgeshack5040]

First!

[@JackFrost1206]

Are you german?

[@patloeber]

Yes I am

[@samarendrapradhan5067]

Please import followings import matplotlib.pyplot as plt import seaborn as sns nltk.download('vader_lexicon') Use from vaderSentiment.vaderSentiment import SentimentIntensityAnalyzer as SIA in place of from nltk.sentiment.vader import SentimentIntensityAnalyser as SIA Please suggest witdth =100 is showig error as "width' is an invalid keyword argument for print()"