Python Project to Scrape YouTube using YouTube Data API | Analyze and Visualize YouTube data

[@mhapich]

This is the first video that I've watched on scraping ANYTHING that I was able to follow from beginning to end, understand, and be able to apply to my own channels and project...without running into problems that couldn't be easily fixed! I could fix my own mistakes because you explained each step so thoroughly. Thank you!!

[@ashkraze]

hi i was scrapping vids from pewdiepie,mrbeast channel and i encountered an error i am able to fetch title and published date of all video_ids but in fetching likes it is showing "" 'KeyError' : 'lkeCount "" and same for viewcount, comment count.. Did you face the same issue and if yes how did youresolve it??

[@mhapich]

@@ashkraze I did run into that! What I did was use a nested try except block. I put the code from this video on creating the dictionary in try, then, under except, I put the same code, but I commented out the line that was giving me the error. Does that make sense? I needed to nest three more blocks depending on the error that was getting thrown. In each except block, I commented out a different statistic in the dictionary.

[@ashkraze]

@@mhapich yes that MAKES SENSE, fixed it and its running absolutely fine, Thanks mate!

[@d4lm0]

I'm having a error (even after closing the execute wit () ). Help plz

[@kalyanijog]

@@ashkraze only title,published_at and views work well for me, for like and comment I got keyError

[@AlexandreDias18]

Wow, as a fellow data scientist, I am truly amazed by the incredible work you've done! Your expertise in data analysis and modeling is truly inspiring. Your ability to harness the power of data to uncover insights and make informed decisions is truly invaluable. Your work has helped businesses optimize their operations, improve customer experiences, and drive innovation. Thank you for your hard work and dedication in making the world a better place through data-driven insights. Keep up the amazing work!

[@maulairfani9474]

WOWWW

[@urvindarkaur0278]

I haven't found anything better on youtube than your videos for data analysis. Only request I have is for you to make as many projects as you can from easiest to most difficult projects so that we can be thorough in this field. Even if I have to pay for it, I'd be more than happy. BUT , please don't stop here especially for projects...learning languages is slightly different than when we have to put together all of the learned tings in the project

[@techTFQ]

Noted and will come up with more projects in the near future

[@manickmax6818]

@@techTFQ I'm also waiting bro do more projects bro for beginners it's very helpful

[@SMajid--SMajid]

Here's how to get channel ID in 2023: 1. Go to the desired channel and right click on the channel page 2. Go to 'View Page Source' 3. On the source page, top left will have 'Line wrap' with a check box, check that box 4. Press ctrl+F on your keyboard to open search tab 5. Type '?channel_id', it will highlight channel ID for you 6. Copy and use it

[@cherry_Pinkish]

O man thanku so mch😊

[@digdra]

Best tutorial about getting KZbin data I found here! Your code is cleaner than the one proposed in other tutorials. Thank you!

[@khanofficial5370]

Assalamualaikum Toufiq , It's really a best ever vedio which i look in KZbin for web scrapping.

[@techTFQ]

Walaikum salaam and thank you 🙏🏼

[@mayankjacky]

A great video which covers all aspects of creating a project in Python for Data Science. Thank you for your service to the community at large. Regards.

[@techTFQ]

Your welcome, glad it helps

[@PhamHuy-j4e]

for a non-tech background like me, your tutorial is super easy to follow.

[@KingofZamunda.]

This is impresive and easy to follow,👌🏻 however KZbin disabled the dislike count( The statistics.dislikeCount property was made private as of December 13, 2021. This means that the property is included in an API response only if the API request was authenticated by the video owner.) and this will affect the function to get video details.

[@hoekbrwr]

I am happy I struggled over this. I was googling for a Google Apps script and ended in Python. It is a very clear explanation and I am so happy about your English pronounciation. Lot of your country men(or women) have a strong accent i get very very tired of, so I give up or miss too much. So I subscribed to your channel!

[@MichaelThompson-pe1wi]

I had to do a project like this for my internship. You are a lifesaver!

[@PhamHuy-j4e]

did you get internship?

[@kiruthickagp]

Thanks a loy techTFQ. I was struggling a lot to do the initial steps of this project . Please do lot of videos like this !!!!!!!

[@Anonymous-le2zr]

One of the best Analysis video I have seen so far Amazing Content , Expecting videos on some more projects . Appreciate your hard work !!

[@techTFQ]

Thank you 🙏🏼 Glad you liked it 🙂

[@soumilyade1057]

30:52 well, now you have 215K subscribers xD Congrats on that, and thanks for the video....!

[@Sakshi-u1v4i]

I have to say that you are very great...I am following your channel.Your projects are just amazing for getting job.

[@fathimafarahna2633]

Fab as always... concise and on fleek. Keep up👌🏻👌🏻🙏

[@techTFQ]

Thank you ❤️😘

[@sultankhatri7230]

Thanks a lot for this video!!! 😊😊 Btw liked and ofc already subscribed. Please upload more videos of projects

[@techTFQ]

Thank you Sultan 🙏🏼 Really happy to know you liked this video.. 🙂 Yeah I plan to upload more project videos..

[@sultankhatri7230]

@@techTFQ thanks a lot brother 😊😊

[@techTFQ]

Your welcome bro 🙏🏼

[@fortunusmedia]

Hi Thoufiq, this is a very impressive tutorial. I followed this and managed to create my own visualizations for my Master of Arts project, which analyzes several political KZbinrs' video output. Very helpful!

[@techTFQ]

Thanks and glad it helped:)

[@justiconblack]

​@@techTFQ Hello Thoufiq, I'm trying this exact same thing except I'm using username instead of channel Id, But the response only displays pageInfo : total results: 0 Any idea on what is wrong?

[@laurak5196]

Hi Thoufiq, this is very impressive! I’m watching this purely out of curiosity bc I’ve not started my python class yet; however, I would love to see SQL project ideas, maybe for data cleaning and/or analysis. Thanks as always for your clear explanations and guidance 👍🏻 Also very glad to see you’re closing in on 15K, friend!! Congratulations in advance 😀👌🏻🙏🏻

[@techTFQ]

☺️😃 thanks Laura Yeah I’ll make some SQL projects for Data analysis in the near future.. Yeah feels great to see the channel growing 😍 Grateful for all your well wishes 🙏🏼

[@wingdigitalmarketing]

That was wonderfully helpful, Thoufiq. I am a complete novice and while elemets of the coding, such as programs you used, where to find them, how to intergrate are aspects I need to further study, the process you took was clear and inciteful. I paid attention throughout and flatter myself that I saw a few of your return errors before you did 😉 Now to study some more and see where this takes me. Thanks again. David

[@sethpai]

Brilliant tutorial. Appreciated the pace and detail. With this tutorial, I can focus my time on exploring KZbin data and not worrying about how to get it!

[@AK-Star007]

This was exactly what i was looking for, to the point explanation. Thanx

[@mohammedshahil4898]

Was waiting for this😃Thanks a lot brother for this very helpful video👌🏻 Way to go🙌🏻

[@techTFQ]

Thank you hero 🙏🏼 Glad you are finding these videos useful 😍❤️

[@kancherlavenumadhav9360]

Really interested in this stuff and fabulous explanation ...Also please do videos on Data science how to begin from scratch ......🙌🙌

[@techTFQ]

Thank you Kancherla 🙏🏼 Glad you liked it.. Yes will cover videos on data science soon..

[@dakshbhatnagar]

Thanks, Brother. This was a bit intricate for me as I have just started out learning Python for Data Analysis but the tricks you have used are new and I am eager to learn and use them and create a new project based off of this information. Don't worry, keep at it, you will be bigger than Ken Jee one day, just stay consistent.

[@techTFQ]

Thank you Daksh 🙏🏼 I am glad you found this useful 🙂 And there is no competition with any other KZbinrs, everyone is amazing at what they do .. I chose this example as I felt anyone and everyone could relate to this example and easily understand the concepts.. But thank you for your kind words 🙂

[@ExcelNWithInisa]

I'm only 25 minutes in and I've learned sooooooooo much already!! Thank you :)

[@swarnimsrijan7470]

what a brilliant lecture! Really impressed by you sir, thanks for helping out I the journey

[@pzuazu8636]

Wow, I love how you bring it all together. Thank you again.

[@bobbymcclane2639]

your coding skills are very good

[@samsonkiflom5954]

Thanks for creating this project. I watched it like an action movie :) and going to learn bit by bit again by creating the same project again.

[@zechariaparas9885]

Awesome Video! Subscribed because of this! Keep up the good work! Godsent

[@savyhash1855]

I have never seen such a detailed ml video..great

[@d4lm0]

To those who had problems installing google-api-python-client try these: To install this package run one of the following: conda install -c conda-forge google-api-python-client conda install -c "conda-forge/label/cf201901" google-api-python-client conda install -c "conda-forge/label/cf202003" google-api-python-client conda install -c "conda-forge/label/gcc7" google-api-python-client

[@thetruth4461]

For those of you who are seeing this project in 2023, in the function to get video ids remove the dislike code as now youtube api does not give information on dislikes.

[@varalakshmidanda2684]

Excellent work and great explanation sir.. waiting for more of challenging videos

[@techTFQ]

Thank you 🙏🏼 Glad you liked it …

[@sameermehdi3143]

Thankyou so much for this wonderful tutorial and from my anlysis you posted most video on Jan and feb :-p

[@techTFQ]

Haha that’s pretty right 👍

[@sameermehdi3143]

Sir waiting for SQL project

[@sameermehdi3143]

One more question do we need to create another API key for another youtuber analysis?

[@ChristinaK-r6n]

Thank you for putting this together! It was super helpful for me

[@tmh3929]

Thanks a lot techTFQ! It's a great project indeed.

[@techTFQ]

Thank you :)

[@ImranAhmed-vl5po]

good work taufiq thanks for sharing

[@techTFQ]

Your welcome Imran Glad you liked it

[@jeeyuuni]

thank you so much for this ! it was super easy to follow along you are a great teacher!

[@techTFQ]

Thank you very much 🙏🏼 Glad it helped

[@yichienchong7474]

Thank you Thoufiq, this is a great project.

[@techTFQ]

Glad you like it

[@kamalverma6064]

You are so brilliant 🥳🥳🥳🙏🙏💐

[@techTFQ]

Thank you Kamal 🙏🏼 Glad you liked it 🙂

[@fbalseiro]

Hi, great tutorial! Congratulations for your work! It really helped me a lot to know how to work with KZbin API.

[@techTFQ]

I am glad to read this Filipe 🙏🏼

[@mayankjacky]

Thanks

[@techTFQ]

Thanks Mayank! Very kind of you 🙏

[@annarocha9769]

OMG, this is awesome, thanks a lot!👏👏👏👏👏

[@sabaamanollahi5901]

Thank you Thoufiq for this incredible video

[@rajeshjakkawar3338]

project is done...........thank you

[@techTFQ]

cool 🙏

[@ayuuniyal5657]

HI, ModuleNotFoundError: No module named 'googleapiclient' I am geting this error can you help me?

[@muhammaddanialtanoli]

Nicely explained each and every detail thank you so much

[@jarosawszyc8287]

Absolutely amazing video!

[@kowsergazi]

Great video. Looking for more like this.

[@Empeiro]

Brother what a nice video, thanks for the time and sharing!

[@angelgabrielgonzalezlerma3972]

great vid, you saved my proyect

[@fahnub]

this is such a good practice project. definitely going on my github.

[@solkarim2950]

You are a great teacher!

[@hassansemlali7450]

Nice content brother, you help me a lot, i really appreciate your efforts

[@kalheer]

Love this easy to follow 👍🏻👍🏻

[@66.divyajaiswal13]

I liked the video but from college prospective: 1)how this project will be helpful 2) why should we develop this project Please answer me....

[@FrankT860]

Practice / learn to use a new tool

[@gopi_gin]

Clear explanation ❤

[@dataneeds2266]

Wow. Amazing

[@techTFQ]

Glad you liked it ☺️

[@shubhangikalambe3435]

Thanks for valuable information

[@techTFQ]

Glad you liked it

[@adrianafressato8489]

Great class!

[@techTFQ]

Thank you Adriana 🙏🏼 Glad this helped ..

[@Wexler111]

Great Tutorial! Thanks a lot!

[@imransdatalab]

Thank you soo much sir again ,

[@190HITMAN]

Hi Thoufiq, excellent video absolutely loved it please keep creating many more project videos. Can you make a short video on how to visualize data using python as Dynamic Radar Charts (i.e Player vs player comparision/company vs company - you can filter which two competitors to compare)

[@techTFQ]

Thank you Abhishek 🙏🏼 I’ll consider your suggestion for a future video

[@Rapha_Carpio]

[@rahulrajeev9763]

Thank you so much for this stuff.

[@brainstalk4577]

Very useful ! Thank u

[@techTFQ]

Your welcome 🙏🏼

[@arpittrivedi6636]

super duper boss

[@techTFQ]

Thank you

[@bose19942]

Thank you for this video

[@VictoireRey-pr7qh]

Hello, I'm trying to run your code to get video details from a list of video_ids but I have a SSL error when running video_details=get_video_details(youtube, video_ids) and don't know how to fix it... Error is the following : "SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:1129)" do you know how I can fix this? Thanksssss

[@Thilina_madushan]

Hey most of usefull tutorial, Please say how to input youtube channel ids in google sheet.

[@ronaldchrishton7969]

Tnq .its usefull for me

[@Toast_d3u]

the install for the google api package has changged to " conda install conda-forge::google-api-python-client "

[@IJH-Music]

Thank you!

[@IndhuV-z8g]

Thanks!

[@machineUnlearner]

Now the youtube Channel ID cannot be extracted from the process you mentioned. Please let me know the alternate.

[@ruksharalam173]

I am facing the same issues.

[@ryang8192]

Hello. i want to ask, how to receive video data (mp4) from youtube?

[@haileeyuuno6233]

I am stuck.. I wanted to do a live view counter display but the viewCount does not return live data. Is there anyway to do this? Please help

[@ShrutiKhandelwal007]

Can we also extract random channel names/IDs using python code for the data analysis to know who's at the top in any field? We have to search the channel name to find its id as of now. I had to search google for the top subscribers and then analyzed it. Can't we just randomly sample this whole youtube dataset to get the channel and do the analysis?

[@hoperight5280]

Amazing!

[@shraddhashrivastava2480]

26:30 output me func me channel ids ki list aani chaiye..par ek hi channel ka name aa rha h. how to solve this issue?

[@HarperWolf]

hi, i am about 22:00 minutes into the tutorial, and i am getting an error that says "Redefining name ''youtube' from outer scope (line 8)", and i am getting Syntax Errors, do you know why this is or how to resolve the issue?

[@samueljudephilips137]

Hey Thoufiq , I'm stuck at 16:45 , the part where I executed the code..........I don't see any output or errors , it just takes me to another line or box to type code..............also the jupyter notebook didn't open in my created environment but I anyways continued in the python ipykernel. Please help me

[@srvos]

Hi Thoufiq, great tutorial! Just getting started here with Python. One quick question. I don't see the YT-env in my jupyter notebook, but did start jupyter from the YT-env in my terminal. Any idea on where this went wrong? Kind regards! Stephan

[@techTFQ]

Hi Stephan, Thank you! The list of environments you see in jupyter notebook is actually the kernel and not your virtual environment. You can use the default "Python 3 (ipykernel)" from any virtual environment to run your code. But in case you want to create a kernel by the name of your virtual environment then you can do that as well using the below command. You can run it in terminal from the desired virtual environment. ipython kernel install --user --name=YT-env

[@attaullaharif4371]

I followed step by step instructions , but found 'pageInfo': {'totalResults': 0, 'resultsPerPage': 5}}.How to fix it?

[@martinbenum5653]

Hi Thoufiq. I am trying to follow your process on this and have hit a snag trying to get a channelid for any one using your hack of double clicking as found around 12:30 of your video. Seems KZbin may have locked that functionality.

[@andersonfernandes6998]

Thank you very much for this tutorial. I am starting my studies in data analytics, and this video has helped me a lot in understanding ETL. After seeing the results, I had a question: is it possible to achieve a similar result by extracting comments from each video?

[@pranayjain._]

Thanks a lot❤

[@ExiledGypsy]

I used to be a C and SQL programmer but now I am retired. I want to download all my comments I have made over the years on different KZbin into a table or database I can store locally. You seem to have done exactly what I need to do. Can I access all the necessary codes that I can just copy and paste? I will be most grateful.

[@vaibhavshah8384]

Hi Thoufiq, Thanks for sharing this informative & interesting video. I was wondering can we extract the actual comments with replies instead of comment count in this example. Thanks in advance.

[@techTFQ]

I think we can do it but I haven’t tried yet

[@sandyputrautama9279]

Thank you, very awesome tutorial 🔥😎

[@shivamdubey4783]

sir extremly great tutorial just one question how do we use this in django and make our own videostreming website

[@maryamazam402]

Amazing video.. thank you so much. I would like to know how to get video details of multiple channels at a time. Can you please suggest how to do it.

[@houses_namibia]

Great video! One thing? Can you write this project in another editor. Pycharm?

[@fahnub]

thank you for this

[@skipa9906]

Hi Im new to Data Analysis and I wanna know, the first part you are doing by scrapping or collected data is that Data Engineering?

[@techTFQ]

Different companies would expect different activities to be done by data engineer and data analyst.. This data extraction would be expected to be done by DA in most cases

[@skipa9906]

@@techTFQ what kind of engineering would be done by the D.E, that a D.A is not likely to do?

[@saimahmad1445]

It was the best video on this topic... I have a question can you please tell me how to use filter on tags while retrieving videos data

[@praveennavin8342]

great video....just a small doubt...can we present this into Excel using CSV module?

[@dodgewagen]

Thank you!

[@vamseesworld1035]

Thank you Brother, Great tutorial, good explanation. it worked for me. can you please make a video on how to extract all the comments, likes and dislikes for each comment, user name, comment date. it will help me a lot. thank you for your great explanation.

[@techTFQ]

Your welcome buddy. glad you liked it. and noted on the suggestion, will do it

[@jdhaus1]

​@@techTFQ kzbin.info/www/bejne/hF6QYaWjpJWWqqM - an excellent video and code to extract comments - I am still working on my own version but thought you might find this useful. Thank you for all of your excellent content. Just subscribed and well wishes as you approach 100K!

[@riteshsharma3627]

Hey taufiq, how to prepare/ask these questions while practicing SQL with datasets? Elaborate in detail in upcoming videos.

[@techTFQ]

Sure ritesh .. noted

[@nikethdonthula2123]

Can I put this project in my resume !!

[@ferdinandosomma8885]

It was very useful and easy to understand! Just subscribed. Anyway, I'd like to ask you a question: I have to do a project for my master course, using youtube api, but I need a large amount of datas, basically a lot of channel id of my country (Italy). Is there any method or code that I can use in ordet to fetch all the Ids? Because to me It's impossible to insert them manually one by one. Appreciate any help!