How to build YouTube like website with AWS?

[@codedamn]

Start Learning Full Stack Development on codedamn: cdm.sh/fullstack

[@sammas533]

Do you know when the DevOps path will be available on your site pls?

[@coderxchris5099]

I love how you explained the AWS tools. A further training on this from you would be amazing! Thank you for your wonderful teachings!

[@KDCloudy]

Great video - so much to learn from this than regular system design videos haha. I got some front-end questions: which player are you using? Custom built or open source like Shaka/Videojs? Also any plans to shift to HLS/DASH in future?

[@JenilCalcuttawala]

+1

[@arpanghoshal2579]

This was awesome one question why not cut down the complexity related to maintaining SQS, launching EC2s and downscaling them, etc by using aws lambda instead. The flow would be like this: Content uploaded to source bucket -> triggers lambda -> lambda spins up ffmpeg does the conversion and copies to destination s3 bucket -> users request videos from destination bucket. With lambda, you have to pay only for what you use, so I think it's cheap and scales very well. The only possible issue might be aws lambda can run for max 15min, so converting big video files might be problematic but even for that, we can use "AWS batch" which is similar to lambda but does not have this 15min limitation. In any case, I think it would cut down the complexity of the current architecture.

[@dcolum23]

This video was fantastic for understanding the entire workflow. Extremely well explained.

[@parinav10]

This is something exquisite, love the fact that you've tried out the Whiteboard approach. Would certainly be looking forward to more videos from you.

[@Ayush1397]

super knowledgeable video! Hoping to see more underlying infra related video soon like this one!

[@JenilCalcuttawala]

Damn good.! Keep this architecture series alive... I am really curious about one particular thing where you chose EC2 and not Fargate? According to some rough calculation, Fargate seems to be a better option for this scenario.

[@aashishpaudyal5306]

is it as cost effective as spot instances? really want to know.

[@jasper5016]

Very nice video. Thanks. Please bring more such content.

[@saurabhshukla2605]

Great video, learnt allot, a code implementation means everything in action will be great to watch 😁😁😁

[@JohnWeland]

I would love to see this expanded or "split" to show handling a live stream as well. This would be great for VODs but thinking about it there would (have to) be differences in a live stream as the file would be constantly in transit (RTSP?), but then you would almost need live transcoding for your viewers sake. Finally after the stream the same process would happen as above for storing the VODs

[@binihalex8097]

Thanks man. Very informative

[@abhishekvishwakarma9045]

Oh, really Nice and detailed HLD explanation of an application like YT 🔥seems like it is more complex than we think but you made it very crystal clear for a newbie in HLD like me. One video on what design patterns should a react developer (or full-stack moving to NextJS) should know to be a better developer. 👍

[@geekthegeek730]

Man man man! i really liked this video. I am building one with the same architecture. 🔥

[@VinothKumar15]

Can you tell. How the video resume or continue watching capture with timestamp saved with user profile and again start with what reaming left to watch...

[@sachin_dev]

What about the serverless architecture with aws ECS. Is that still relevant? which one is more preferred EC2 or ECS ? And why? Thanks

[@codetech6099]

Do more videos like this about backend and architecture ... ❤️❤️

[@d33p4k5]

Learned a lot

[@leanprogrammer]

More videos like these please!!! 😎

[@aashishpaudyal5306]

can you suggest which instance type would be most suitable for this. Please.

[@YatheeshRaju]

curious to know how much is your aws bill ? can you share the approximate value of running your full infra

[@codetech6099]

Can you share some resources about architecture , so we can also learn ..more on these types of topics. Like scalability , availability etc

[@ijpterror77]

Hi mehul thanks for the video amazing explanation !! Can you just make a practical video on how this works from front to back with MERN application cuz ter r no such videos out there which in terms of scalable apps , it will be much more helpful !

[@leebarnard3898]

Hi, how could you adapt this to work with audio instead, or in addition to video? Thanks

[@okeyshourovroy2769]

Please make a course on this topic. It will help a lot.

[@shramlearn]

Great video

[@suryakantasahoo9935]

Great video !!

[@kunalsanjaybutiya5944]

Please make a series of video on this topic

[@manan5]

Hey, So I had a doubt. Why do u use the first s3 bucket. Like u could do something like have a proxy server setup and while its uploaded, The video can be sent as a passthrough stream to backend server. And When one server maxes out, it can spin up another one. And add it to the proxy via runtime api and when the processing is finished it can directly upload it to the production s3 bucket.

[@aashishpaudyal5306]

to do that you it should be able to transcode in realtime and cannot be interrupted so you cannot use spot instances where you can save money.

[@KrishnenduKDG]

Thanks a lot for this informative video... But I have one question... As You said that anybody can upload a .txt instead of a video and then the thing which happens is that it keeps on failing multiple times until it is shifted to DLQ... Now as fro every processing,we need an EC2 Bucket to be created... So Failing multiple times causes multiple EC2 Buckets to be created... Now to avoid this, can't we check it beforehand before uploading it in the first S3 Container.. Like what I try to convey is that, what if we try to setup an error and exception check before even uploading the video in the S3 Container... maybe that could be setup using an EC2 Server as well before the S3 Containers........

[@amanagarwal2022]

For the development purposes are the aws services available on local dev machine??

[@evitimirp]

good video,i'm trying to gather info to understand what i need to know to make my first project which is a fake money poker site, something similar needs to happen since everytime a table is created there probably needs to be an es2 instance that runs the table or something.

[@OnlyJavascript]

finally, youtube got some really useful videos. ty for the content. can u make one for payment gateways too?

[@TheRn35]

Just wanted to understand. Why not use lambdas instead of EC2?

[@akashrajpurohit97]

Thanks for sharing this mehul. I'm curious about one thing, you use ASG to start/stop EC2 instances for processing as you mentioned, Did you consider using docker + kube to do this task? If yes then what was the factor to go ahead with this architecture over the docker + kube one.

[@codedamn]

For starters I didn’t know how to work with kubernetes. I’ve tried to understand kubernetes but find another simpler solution in most cases

[@Venkatesh-vm4ll]

What is the difference between your architecture and media convertor

[@aashishpaudyal5306]

cheaper

[@chinmoykr]

You forgot to add the storage fees for s3 buckets. Basically in this structure you are paying twice on storage . Although it is quite low but you are paying twice, one to store raw videos on s3 bucket no 1 and another is to store processed videos...

[@sheeraz1022]

Can we use Lambda function instead of launching Ec2 machine for every video, wouldn't it be more efficient or cost effective?

[@codedamn]

Lambda has hard limits on storage and 15 minute execution time

[@souravdas423]

what is the work of ffmpeg & ec2 there. When uploading we directly upload in s3 with suppose multer. Store the link in mongodb and when the user wants we can just send the link in front=end and show the video with a video tag. Can anyone please explain why it won't work?

[@codedamn]

It would work but raw video files are rarely something you want to ship to the user directly. For instance, a 4K60FPS video shot on iPhone would be 4GB for only 10 minutes of video. When you upload it on KZbin, youtube would process it in the same resolution with same FPS but at a much much smaller file size so that everyone could watch it

[@souravdas423]

@@codedamn Ok got it. Thanks man. I really love your videos and recommend all my friends to your channel

[@venkatesh2788]

Will u make this into a code

[@Sonu-tg6tg]

Thanks for such awesome videos, always waiting for your new videos, will be glad to get t-shirt giveaway

[@tejasnikam3287]

Very helpful

[@goodstuff2read]

Is this channel still active? Have you ever deployed this with any DRM so that users cannot download the videos?

[@avegeta1]

How do you put the msg back into queue when spot instances are taken down by AWS?

[@codedamn]

You don’t. Instead, on the EC2 while you’re processing the video you set a timer to keep the message in queue “invisible”. If your EC2 crashes or dies for some reason sqs will stop receiving the visibility message and would automatically make the message visible in a few minutes

[@tora3492]

actually, 1080p is good. 4K is not required.

[@Tarunyadav976]

why not?

[@tora3492]

@@Tarunyadav976Everything is perfectly visible in 1080p. Also the render time is less, computing power required is less. Occupies less storage.

[@ExpoDev_Dash]

Love it

[@shastri3303]

Damn Good

[@sreekumarmenon]

why did you prefer ec2 instead of lambdas?

[@codedamn]

Lambdas have a hard 15 minute timeout limit and very limited (512MB) disk space available

[@sreekumarmenon]

@@codedamn Thanks, clear presentation

[@t-rex4040]

grt tutorial

[@realcirno1750]

why is cloudfront so expensive? T_T

[@mdjahidulislam9205]

thanks.

[@omlondhe]

Noice vedio 😁

[@arpandas461]

Can we use FIREBASE instead of AWS.... ????

[@VijayKumar-pd7vv]

Finally I can stream my game's to my friends and show them whose fault was.. To lose the game lol 😆

[@lakshman587]

COMMENTED FOR T SHIRT GIVEAWAY!! :)

[@mysoregopinathshantanu8800]

May the like be on this comment.

[@RahulKumar-eq3ev]

Show ads in your codedamn website videos in your platform after every 30 sec or 1 min duration this way you can make the video for free or make some courses free through ads implementation and users get the some courses for free and there be chances the user subscribe because of ads to pro membership. Profit from both side from user and from you also.

[@hammad8965]

💚

[@aadarshktofficial]

11 9 after point

[@gm_youtube7]

🧐🧐🧐

[@videocorner2498]

Make some video on hacking

[@linccodes]

A programmer who uses a whiteboard to teacher, my lecturer... Nice hair style btw ❤️

[@officialnizam]

random comment XD