Youtube API for Python: How to Create a Unique Data Portfolio Project

[@k_celebs__]

For anyone that got an error at the 11:30 mark, this is the solution i used The issue in the code is that the while loop that is intended to fetch additional pages of playlist items is not using the next_page_token to request the next page. Instead, it is making the same request repeatedly without updating the pageToken parameter. This leads to an infinite loop, as it keeps fetching the same page repeatedly. Here's the corrected version of the code: playlist_id = 'UUMki_UkHb4qSc0qyEcOHHJw' def get_video_ids(youtube, playlist_id): video_ids = [] request = youtube.playlistItems().list( part="snippet, contentDetails", playlistId=playlist_id, maxResults=50 ) response = request.execute() for item in response['items']: video_ids.append(item['contentDetails']['videoId']) next_page_token = response.get('nextPageToken') while next_page_token is not None: request = youtube.playlistItems().list( part="snippet, contentDetails", playlistId=playlist_id, maxResults=50, pageToken=next_page_token # Add pageToken to request the next page ) response = request.execute() for item in response['items']: video_ids.append(item['contentDetails']['videoId']) next_page_token = response.get('nextPageToken') return video_ids In this corrected version, the pageToken=next_page_token parameter is added to the subsequent requests inside the while loop. This ensures that each iteration of the loop fetches the next page of playlist items instead of repeating the same request.

[@PatricioNeriGarcia]

Thas why I love fkin programming community. Thanks !

[@moonrisementality]

Wow, I have been stuck on this part for like 2 days. I don't know why I didn't come to the comments sooner. Thanks so much!

[@Thuvu5]

Hope you enjoyed this video! I forgot to mention one thing important, please remove your API key in the notebook before you post your project to Github. This is to prevent other people from using your API keys without your consent 🙂

[@rarescrunchie]

Please I can't find the Items when I run the JSON response , It only shows kind , etag and pageInfo

[@nickclinton8845]

Hi , I want to know how to scrape video ids using multiple playlist ids as a code coz you showed only for one id

[@jeevankumarthadikonda7151]

Please add more of this kind of projects, your way of explanation, information gathering is simply superb where we won't be able to find from others instructors and KZbin videos

[@k_celebs__]

For anyone that got an error at the 15:58 mark, this is the solution I used The apply function in the second line is correctly using the isodate.parse_duration function to convert the duration string to a timedelta object. However, when you try to convert the resulting timedelta object to seconds using astype('timedelta64[s]'), it won't work as expected. You should modify the code as follows: # convert duration to seconds import isodate video_df['durationSecs'] = video_df['duration'].apply(lambda x: isodate.parse_duration(x).total_seconds()) In this modification, the total_seconds() method is used to convert the timedelta object to the total duration in seconds. This should give you the correct result for the video durations in seconds.

[@KaraboMoremi]

Finally done with my project. I learned so much. Rewatched this video many times. It's true that you learn by doing and not just by watching. Thank you so much.

[@Thuvu5]

Aww well done! Congratulations! 🎉 I’m happy to hear you learned a thing or two from this project 😀

[@simu6315]

hey !can u help me out I don't know y but the code is not showing output when i wrote the first def function also json to beautify it is also not working

[@dannychang2100]

This channel is an absolute gem!

[@Thuvu5]

Aw that's so kind of you to say! 😇 I really appreciate it!

[@jeeyuuni]

this video helped so much! honestly the analytic skills i learned through this video is way more helpful than a whole semester of my python course at uni. thanks a lot!!

[@B1GODE10]

Your channel is obviously going to be big, only 800+ subscribers right now but the quality is clear. Thanks for the video.

[@Thuvu5]

Aww thank you for such an encouraging comment!! I’m so happy to hear that 🥲💛

[@HappyPurpleFella]

Haha you were right

[@edudc6261]

i've just started work on my github profile to be a data scientist, this project gonna be a great project idea

[@kylajuett-she-ella3291]

Thanks for this video! Your content is well-explained & I like that you talk through your process as you go along. I haven’t worked with API keys yet, but look forward to doing a project similar to this one some time.

[@jeo2222]

This video was recommend to me out of the blue, and I am really glad it did! Really enjoyed it, thank you!

[@Thuvu5]

I’m so glad to hear that! Thanks for watching 😀

[@sahanaramachandran4007]

This was my first proper data science project, and I absolutely loved every minute of making this! Thank you so much!

[@mahmoudkhattab111]

WooooW , great effort, Thank you so much, All the best and waiting for more videos

[@have2148]

Thanks for this incredible video, I have learned a lot while following these steps. Hope you all well and look forward for upcoming videos, cheers!

[@Thuvu5]

Thank you so much for watching, Robert! 🙌

[@SwaraNaidu1333]

Wow!! well explained

[@Rama_Guru]

That's great, your style and speed is perfect for me. I will be looking at more. And I did sub.

[@konradnoises]

I've been having an issue with this video. Because I'm trying to give millions of likes, but it allows me one like (that's absurd)!!!! It's a shame because your content deserves a lot of love. Thank you for your dedication!

[@Thuvu5]

Aw thank you for being so kind!!! 💜

[@datboi1861]

Your video was the perfect introduction to KZbin's API. Thank you for this.

[@Thuvu5]

Glad you enjoyed it!

[@annette4718]

Awesome video and awesome content. Definitely deserves way more views. Thank you for sharing this with us!!

[@abdelrhmanhamdy2370]

fantastic explanation, precise and to the point, I'm happy that I found this channel

[@Thuvu5]

Glad to hear it! 🙌

[@baophuctran4878]

I’d say that this is the first Python project video I watched til the end, also my first comment for a DA content on YT:)) Though there are ton lines of code that look intimidating to me (as a intermediate Python learner), I finally got the idea of how a real analytic project was made from scratch. Can’t believe that! From Git to API request to EDA to visualization, everything I’d learnt or heard about before is now brought together in this high-level tutorial, so inspiring! Shout out to you ThuVu! Keep up your good work! I hope to see many more contents like this on your channel!

[@Thuvu5]

Thank you BaoPhuc! I’m so glad you liked the video and found it useful 🔥🙌

[@zahraBatenin]

Great repository you made. Excellent job.💫

[@MM-jr5sr]

This is exactly how this kind videos are supposed to be.🎉

[@plor1261]

okay, fine. You've earned my like and subscribed lol This was excellent. Perfect flow, descriptions, and all meat. Thank you

[@andreyseas]

Great video! Love your authenticity. :) Keep it up!

[@Thuvu5]

Hey Andrey, thank you for the compliment! Haha I’m trying to be more authentic in the videos and that’s great to hear!

[@nannapatjochmann]

Thanks

[@TheMISBlog]

Love the details in the video Thu, Thanks

[@deepasarojam1433]

Great video again Thu Vu! I'm going to do this in coming week. Thank you for such quality content.

[@Thuvu5]

Thank you Deepa! I'm glad it was helpful 🤩

[@kevinanggito31]

This is very good quality content! the project is very interesting! thanks for sharing with us here! good luck with your channel. Already subscribed to this channel!

[@Thuvu5]

Aw that's so kind of you 😇. Really glad you liked the video and thanks for subscribing! 👋

[@deepaksaldanha]

Thank you for this video, very well explained. All the best for your channel.

[@Thuvu5]

Thank you for leaving these kind words Deepak! 🙌

[@oyvindknustad]

Fantastic video. I'm just starting to look into API's and this was very helpful. I thought I'd do a project that might benefit my girlfriend's KZbin channel. It's a small channel with a big heart and deserve more eyes. Wish me luck

[@Thuvu5]

Aw that’s awesome! Good luck 🍀

[@chamdarigdall273]

You are the best! 🔥

[@raffymcfee9846]

Thank you Thu Vu for the project I can add this to my own data portfolio and resume show off! New Subscriber here!

[@Thuvu5]

That’s awesome to hear! Good job 🎉

[@priyankagaikwad60]

I like your new unique and intresting content , very helpful for me learning data science

[@durkcarter]

Thank you, really learning from this, especially when making mistakes!

[@oilgas1016]

If u could demonstrate cloud environment that data scientist to deploy project, that would be wonderful. Great content! Thanks.

[@Thuvu5]

Hey, that’s a good idea! Thank you for the suggestion, I’ll keep it in mind for future videos!

[@馬正軒-i5y]

I am from Taiwan. Thank you so much🙏

[@pikineestest7362]

Very really work. I like this challenge. Thanks for sharing.

[@Thuvu5]

Glad to hear you liked it!! 🙌

[@edilsonsousa3743]

Great project, thank you so much!

[@patrickp2195]

Awesome video thank you! I loved learning about this library through your video. If possible, please make another video on how to deploy this dashboard so we can share it. I tried following the user guide but i got stuck, so it would be awesome if you could do a walk through. thanks again!

[@Thuvu5]

Thanks Patrick for the suggestion! Deploying and sharing dashboard is definitely high on my list for upcoming videos 🙌

[@akhila9413]

This channel is goin to get big

[@Thuvu5]

Thank you so much Akhil! 😇

[@akhila9413]

@@Thuvu5 I told you your channel is going to get big and I am glad it did get big

[@KaraboMoremi]

This video was sooo good. I really learned a lot. I will go over it a couple more times just to see it in more detail.

[@Thuvu5]

So great to hear Karabo! That really warmed my heart 😄. Have fun with the project!!

[@Ayoubased]

such an interesting video. So many concept covered. I will be sure to apply this project on another youtuber and get some cool insights but I'm sure I will stumble across to many error and hope you will be here to help haha. Thank you sm

[@Thuvu5]

Hey, thanks for commenting! Hope you’ll have a lot of fun applying this project to your favorite KZbinr!! Of course you can always reach out to me if there are problems, I love solving errors 😉

[@Ayoubased]

@@Thuvu5 thank you so much, thats so motivating for me.

[@bangsaenAI]

This is what I am looking for

[@thomasantony3381]

Sending a lot of love ❤️

[@Actanonverba01]

Very clear code and well explained, Great job! 😎

[@desafiodatascience]

Wow super interesting Thu Vu! I might and try to replicate it to my own little channel! Thanks for sharing the project with us! Carlos.- on

[@annarocha9769]

Thank you soooooooooo much this is awesome!!! 💕💕💕💕

[@iCodeCode]

Thank you so much for this awesome video! Even tho I use JavaScript, your explanation was fairly simple and easy to understand.

[@Thuvu5]

Glad it helped!

[@shanthankasula5503]

If you get an error at 15:20...that's because we need to import parse library.. here is the code: from dateutil import parser

[@jek1308]

Eye opener...You are pro

[@lelumpolelum2888]

you are a lifesaver!! thank you

[@lengleng4043]

First one here 😃! Greetings from Slovakia.

[@Thuvu5]

Haha you were the one who unboxed this video 🤩

[@lengleng4043]

@@Thuvu5 yay 😊!

[@medlapino]

Great video again , thank you thu vu

[@Thuvu5]

Thank you Amine for always supporting me! 🤗

[@medlapino]

@@Thuvu5 you deserve all support for your all efforts to help us

[@konstangu8681]

Great, more reviews like this. Greetings from Russia!!!

[@vishalnaik5453]

If you are using Jupyter Notebook and getting output as : "" instead of importing JSON from IPython.display Use this import json ... .. formatted_response = json.dumps(response, indent=2) print(formatted_response)

[@workorion1473]

Thanks for this video.

[@meomeoww.w]

So clear, thank you chị ❤❤

[@eshaanghoshfushtukli]

quality content, thank you so much

[@Thuvu5]

Thank you for commenting! Glad to hear you enjoyed it 😄

[@souhamahmoudi7745]

Thank u ! Thats awesome

[@iJavaScript]

I really like this video, and the way you made it look easy! Heres an idea, I wonder if you can ceate.. Explain how to download video captions and store them in a dictionary, where the key is the a word and the value is an array that contains the video ID and the time in that video!

[@CaribouDataScience]

Thanks , that was helpful.

[@AngelFelizF]

This was a great video. I enjoyed it even though I just know R

[@Thuvu5]

Haha nice!! Thanks so much Angel 😁

[@loudarakotondrafara]

If some of you are getting this kind of ugly output () when running JSON(response), use Jupyter lab instead of notebook as she advised 🙂

[@zahir4215]

content you provided are just awesome, Thank you Thu vu, I thought of storing the data to azure cloud and build a data pipeline to further present my data in tabluae, I have no experience with data pipelines, Would you please provide your review on how this can be accomplished... Thanks Again

[@dana_knows]

Great video, thanks! I try to repeat your project for crochet channels and I have an error on the counting number of tags. type object 'str' has no attribute 'len'.

[@궁금궁금-j3k]

This is the best video ever. Thanks to that, I was able to try the KZbin API with Python. But I have a question. How do I get traffic sources? Should I use the KZbin Reporting API at this time?

[@Thuvu5]

Hey, I’m not sure about how to get the traffic sources.. so I can’t helpmuch with this one..

[@궁금궁금-j3k]

@@Thuvu5 Thank you for your reply. It's all right. Still, the video helped me a lot. I appreciate it!

[@OriginalAfricanTales]

weldone and thank you!

[@tate_0137]

Thanks so much for your guidelines! As an absolute beginner in Python (and just get to know API from codecamp), your instruction is so easy to follow, yet it covers different perspectives and layers when it comes to analyze data. I just stood in awe watching your inspiring video!! I'm trying to practice following your github code and I have a question. If I analyze 10 channels at a time, then I have to repeat the "get videos IDs from upload playlist IDs" 10 times, am I right? I see you used the variable -playlist_id- in your codes. I tried to make use of the -join- command to see if it can retrieve all upload videos ID from 10 channels but it didn't seem to work :( For now I just repeat the codes and I already had my first ever data project! Thank you so so much!

[@fromsunshinetomoonshine]

Love this video, it was very helpful! My only thing is I'm stuck in an infinite loop and can't get out in terms of video IDs :( My code looks exactly like yours

[@lavenderscent2334]

What are some concepts we should learn abt so we can do this project?

[@rhemzyputramaulana7025]

hey thu i really enjoy with ur vides thank u so much, i wanna ask something after we got this channel's data how to make this dataset into csv? thanks before!

[@MostafaHafez25]

Hello, great video. I have a problem with the playlist id. I tried making a list of different playlist ids and using them in the code, but the code crashed. Although when i tried each code separately they all worked?

[@shanthankasula5503]

How did you get the id in video statistics? @11:39

[@KaraboMoremi]

I got stuck in my project at the next page token park. The channel I'm analyzing has 86 total videos. By default I get 50 video_ids but I need all 86. The while loop with "is not None" loops Infinitely 😭😭

[@Thuvu5]

Hi Karabo, I think I know what caused it to go into infinite loop, I had it once 😅. Please make sure you include ‘page_token = next_page_token’ in the request within the is not None loop.

[@KaraboMoremi]

IT WOOORRRKKKEEED🏅🏅🏅😭😭😭🤝🏽🤝🏽🤝🏽

[@Thuvu5]

@@KaraboMoremi Yay!!!!

[@manuelespitia10]

@@Thuvu5 @Karabo Moremi Guys I'm having the same problem, but when I include 'page_token = next_page_token' in the request list within the is not None loop I got an error 'got an unexpected argument 'page token''. Also, great video, thanks for sharing all this!!!

[@KirillP-b1v]

nice) more videos on how to retrieve data from the API please)

[@Thuvu5]

Yes! That sounds like a great idea 😊. Thank you for commenting!

[@krishkathuria3719]

Hi! thank you for this video its really helpful. Can you plz provide the code for fetching comments, your repo doesn't have that

[@theawesomeharris]

I was playing with the notebook and ended up with almost 10k video ids then I realize how the api request did not run fully to grab all the ids that I had to run a few times to get it right. 😂😂

[@oraciobarbosa2843]

Great video!!! How many time did it take you to program it?

[@Thuvu5]

Hi Oracio, thanks! 👋 It took me about 15 hours for data extraction and about 3 hours for data preprocessing and EDA

[@naresh6961]

Hi Madam, Your explanation is awesome. I need full Road map and guidance to become data analyst in 30 days. Could you please provide learning content, where can I get all the details. Thanks in advance.

[@fiestaamigos3084]

Hi , It is really usefull, I am new to DS & I want help on KZbin Data Harvesting and Warehousing using SQL, MongoDB and Streamlit by creating a Streamlit application. Can you help on the details on how should I start as it is my first project.

[@stevensalazar6296]

@Thu Vu FYI Luke Barousse mentioned you in his latest video about SQL.

[@Thuvu5]

Thanks Steven for letting me know! I just saw his video, I’m so flattered 😂

[@stevensalazar6296]

@@Thuvu5 I actually found your channel a few days ago through the algorithm and then I saw your name on Luke's channel today. You have great high quality content and your channel will grow a lot, wish you the best!

[@Thuvu5]

Aw I’m glad you found my channel! 👋 Thank you so much for your kind words, I really appreciated it 😃

[@DataQuestLive]

So I know I am about a mont late but I essentially copied exactly what you did up until the the retreiving the number of videos and even copied and pasted your number of videos ID function from your github and its not counting all the videos there are like close to 100 missing what could be the reason?

[@alexdin1565]

please can you make a video about google keyword planner API using python?

[@vuquano4961]

very good video

[@geekymahi3896]

Hey you've done a great job making this video, but is there any other way to get channel id, since this method doesn't work any more.Please help

[@Thuvu5]

Hi Mahesh, thanks for watching! Good to know that this method no longer applies. But it's actually quite simple to obtain channel id otherwise. On any video of a channel you want to get channel ID, open developer console (Ctrl+Shft+I on Windows or Command+Option+I on Mac). Then go to the Element tab and search (Ctrl+F) for "/channel/", then you should find some results of the href of the channel link. Then the long weird string after "/channel/" in the href should be the channel ID. Hope this helps. Good luck!

[@Rapha_Carpio]

I need this, I got a code that works a bit =) but I don't like how the outcome looks like; I will look at this video to learn more

[@Thuvu5]

Hey Rapha! Thanks for commenting 👋 Hope you’ll get some nice outcome from the video!

[@Rapha_Carpio]

@@Thuvu5 To be honest I dont understand much, I just run the code and change the API to use mine, I would love to connect with you to show you my work on KZbin API if you-re into that

[@MasdarulRizqi]

please provide the full code in the comments or duration 13:26

[@sikandar08]

for some reason when I get all the video stats with video_df I only get 250 results (250 X 13 columns). I'm using the same code as you but you get thousands so I'm confused. (there are definitely more than a thousand videos) I think the next page thing isn't working for me...

[@Karma-e7b]

If I create a project using youtube api and in my project I show youtube videos and put ads or subscription on website. Or will some copyright come.What if I don't want copyright issue to appear on my website?

[@siramar2453]

Pls Suggest such Job Oriented & Good Quality Projects on Power BI Data Analyst which are Highly Relevant For Getting a Job Immidiately

[@meriod]

Hello! Thank you so much for this video! It is really helpful! I tried running the code for a channel that I’m interested in but I’m running into some trouble getting my dataframe populated. It’s always returning as empty. Would you know what’s causing this? 🙂

[@Thuvu5]

Hey, I’m not sure which function you were having this issue, but I’ve fixed some things in the functions (eg missing return statement ) and pushed them on Git. Please pull those changes and try it again :)

[@meriod]

@@Thuvu5 Thank you so much! Yeah, putting in some missing return function fixed the program! 😀

[@gopalreddy9392]

Just love lovee

[@prasunnundi7456]

Hi, i tried to get the id for other channels just the way you did for your example, it didn't worked , plz help!!!!

[@naveethsuraj6214]

is it ok to push our code with our API key to GIT?? or we need to make some change.

[@DuyTran-xd4qb]

chị giỏi quá

[@rafaeldesantis4259]

what is the command you use to order the code you are writing? I think it is really important right here. can you share that, please?

[@Thuvu5]

Hi Rafael, I'm not sure what you meant with "order the code"? Thanks for watching :)

[@luiscarlospallaresascanio2374]

I'm trying to move videos from one playlist to another but it says I don't have permissions.

[@sehaj9035]

can I run code this project in pychram or VS code?

[@lilshaunpicanto]

How do we hide our API keys from our GitHub repo