Building Large Scale Microservice Applications

[@alaazamel8176]

Man, Absolutely brillaint. really looking for more videos like this. also. if you can create a project starting from this high level system design until deployment it would be massive

[@voydesvelado]

that would be so valuable

[@tonskreee6213]

I would definitely buy it

[@dagogouranta5583]

for sure, i'd buy it too@@tonskreee6213

[@Kxneki2433]

At this point you should have a separate playlist on system design, great content man!

[@zaouiamine6475]

I went in blind into microservices and i learned alot I used docker and kubernetes and nginx for routing and loadbalancing

[@chinmayanand896]

Why don't we have full-fledge microservices course for building a real life microserivces using NestJS / Nodejs, Kafka, SQL databases and all other required tech stuff. I am sure this will rock. You can consider this as a request from my side.

[@uchchhash-dev]

Found what I was looking for in this video after going through a lot of videos. Thanks man! you earned my subscription

[@Jezzabeanz]

Thanks Tom! Could I ask what software you're using to map all of this out? Looks handy for planning.

[@TomDoesTech]

eraser.io

[@Jezzabeanz]

@@TomDoesTech Thank you!

[@PattySpicy]

This is what I am looking for thanks alot !

[@abhijeetkumar8044]

Great video, please create more videos like this.

[@andrewcathcart]

Probably would have been worth going over data exchange between services a bit more - yes it is guaranteed delivery but, most likely, it's at least once delivery, so the services need to be able to handle duplicate events. Also probably worth discussing the web server and e.g. loadbalancing

[@TomDoesTech]

I think that's a whole other video tbh. I just wanted to mention that the component would exist in the architecture

[@bilkisuismail6096]

Tim is a veteran in passing knowledge. Thank you for your service. It would be great if you do a playlist or course on how these tools work together.

[@TomDoesTech]

Who's Tim?

[@bilkisuismail6096]

@@TomDoesTech sorry typo error, Tom

[@jonathankewe9415]

Hey Tom, thanks, really appreciate. Cheers!

[@hosseinnajafi2181]

It was soooooooooooooo good, thank you so much, please make more contents about this kind of things (System Design, Infrastructure, etc)

[@grrlgd3835]

more, more, more ! this is really cool. can you recommend any good resources for exactly this ?

[@MUcciMax]

Thanks, Tom

[@anvui95]

best youtube channel to learn

[@zameerahmed1775]

ur too very awesome .......... in 10 minutes u made ms design simple

[@alexenax1109]

Great video! Please add more!

[@rodolphobravo298]

What's your opinion on microservices vs. the modular monolithic architecture?

[@shivamvijaywargi]

This was awesome, if it is not too much to ask would it be possible to create a small application where you show us how we can configure all these together? Thank you

[@TomDoesTech]

Yeah, that would be cool. Could also include Terraform and Docker

[@shivamvijaywargi]

Thank you

[@inuoshios]

@@TomDoesTech That would be great, Tom! Thank you.

[@belkocik]

Would love to see this, man! :)

[@fernandovideira7655]

Sorry for the stupid question but, in this case the VPC would be a docker swarm cluster or a kubernetes cluster, or am I misunderstanding it? (keep in mind I'm going kinda blind into this and have been working with monolithic apps for 2y in school without putting much in practice)

[@tlourammala]

Massive thanks for sharing your knowledge and delivering it in your beautifully unique way! Quick question: What drawing tool are you using in this video? Anyone who knows is welcome to answer incase I missed it somewhere.

[@TomDoesTech]

app.eraser.io

[@harshayyy9]

this is from the starting or it is just casual project not us to build??

[@TeezyTiddo9245]

I like the video but i dont see can we do one including load balancing , as well as gateway usage

[@vukasinigic7949]

Are you not essentially enhancing coupling and fault tolerance with BFF interface servers?

[@thudsondev5635]

Nice video Tom! I did have some questions: You mention having a single load balancer for all services but I have usually seen it done with multiple load balancers allowing for ssl termination at each and thus zero trust. Is there a reason to go with a single LB other then reduced complexity? Also, why not use a daemon to export metrics and logs such as a data dog agent? I feel like having to setup metrics endpoints itsa lot of work, what are the benefits over the daemon?

[@TomDoesTech]

I've never seen it done with a daemon, but the endpoint are super simple to setup. You install a module and expose it's data to an endpoint.

[@CricketDilseHitWicket]

Nice explanation,Are you from Australia??

[@TomDoesTech]

Yes

[@CricketDilseHitWicket]

@@TomDoesTech Thanks mate!!! ,finally I am getting to know English accents of different regions. :)

[@kennethcarvalho3684]

Hey Tom was looking for much more... Very short video

[@babacarkane1027]

Awesome video

[@andrewcathcart]

Why wouldn't you just log (info, err, debug etc) in the services, and hook up something like prometheus to cloudwatch logs? Feels weird having a /metrics endpoint in each service?

[@TomDoesTech]

You're also logging a bunch of other stuff, so would be difficult for prometheus to know what it should ingest and what to ignore. The metrics endpoint is much easier and cheaper.

[@manee427]

Nice video. what did you use for diagram? ?

[@TomDoesTech]

Eraser.io

[@manee427]

@@TomDoesTech thanks

[@RyanJones26]

any chance you can resurrect your expressjs tutorial from a couple of years ago and apply it to this? also what diagramming app is that? it's super cool

[@mrrajib]

would love to see actual implementation

[@tonskreee6213]

Im a little bit confuse on the connection between the BFF and the Webserver. When request comes in does the BFF calls the Web Server and for the response I assume the services like Product service will directly call the BFF for the response?

[@TomDoesTech]

The BFF will make requests to the downstream services. All requests to those services go through the web server. All requests from the UI to the BFF also go through the web server because it's just a service like the others and it's the only way you can reach it from the internet

[@marcunnocello3092]

I have a question: How would authentication and authorization work here? Would this be the job of the BFF? And also how do you test the Microservices/ How can you run them locally, if the have dependencies of let's say to an Auth and Permission Service and also to Kafka for sending and receiving events?

[@TomDoesTech]

Auth would be handled by one of the microservices, in this case, probably the user api. There's different strategies for developing locally and testing. Mostly you develop on one service at a time and connect to the other services that are running in a staging/dev environment. You can also run services like Kafka locally, it's easy with Docker.

[@marcunnocello3092]

@@TomDoesTech That makes so much sense, thank you

[@somaticHuman]

why user service should send message to products service? if application must get information about products of the user, where and how this relationsheep will be processed? where the user-products many to many relationsheeps is being?

[@Sammysapphira]

What is that website you use for making these charts?

[@TomDoesTech]

eraser.io

[@vidalalvarez]

Excellent!!!!

[@Resonanc3]

A caching layer is missing (Maybe more import than a BFF?) and from the scheme it's really hard to understand how horizontal scaling comes into play, but I love the video

[@TomDoesTech]

I didn't add a caching layer because caches should only be used to solve a specific problem. I don't think it's a good idea to be shoving caches in just because they exist. But yeh, most implementations would have a cache somewhere

[@Resonanc3]

@@TomDoesTech I see your point but I have a hard time to share it, caching, in a way or another (it can happen on so many levels of your infrastructure sometimes you don’t even know it’s there), is always required in ‘Large Scale Applications’: it brings down costs so badly you can’t afford not to have it

[@Resonanc3]

Either way, we both know there is no right or wrong way of doing things here, so take it with a pinch of salt :)

[@rvitorgomes]

which draw tool are you using? I need to document my microservices but never find with nice icons like these

[@TomDoesTech]

eraser.io

[@ahasibrifat7568]

Do you have any plan to implement the architecture, at least in a bare minimum level? Please do plan. Would be very helpful.

[@stepanzavadil]

Why does the BFF communicate directly with the services and not via web server?

[@TomDoesTech]

Yeah, it would go through the web server. I was just showing where the request would end up

[@danielayota26]

what is the softwere use to design this large microservice

[@nickxox2257]

what is that website your using to draw this out? how were you able to search for ec2 img

[@TomDoesTech]

eraser.io

[@nickxox2257]

@@TomDoesTech ty sir

[@VLADICA94KG]

I don't understand why you didn't go over, the so-called , which servers a for all requests coming from to -service? Thanks

[@TomDoesTech]

Sorry I don't understand your question

[@VLADICA94KG]

@@TomDoesTech Why isn't BFF service hidden behind gateway/load balancer (you named it webserver)?

[@TomDoesTech]

@@VLADICA94KG It would be behind the web server, I was just explaining the flow between the UI and the BFF

[@VLADICA94KG]

@@TomDoesTech To be honest, it was a bit hard to predict that as you didn't mention it at all. I do really appreciate your work, but those missing points can lead to someone implementing architecture in the wrong way. Thanks for your great work!

[@codewithnws3544]

is this the short video or we do game the implementation code as well or video?

[@TomDoesTech]

huh?

[@codewithnws3544]

​​@@TomDoesTech i got the typo, I mean do you have long practical examples of this architecture or github repo for the code?

[@akash-kumar737]

BFF part was a bit over the top. It make sense but find it hard to understand probably need a working example to understand it.

[@AdeyinkaAdegbenro]

Better terminology for the BFF is API Gateway, "API Gateway" will be aware of where each service is located and automatically route requests to the service/server and back to the User Interface. I hope this is clear.

[@abhirb12]

What's the tool you are using?

[@TomDoesTech]

Erasor.io

[@abhirb12]

@@TomDoesTech : In the interviews i attend, I often get questions like, what are the tools you have used for HLD & LLD. Can you please help me with the answer for this?

[@opentech1252]

good content

[@hellodun]

Hey Tom and everyone, I'm new to microservice system design, and I'm wondering, we've accounted for a request which will hit our web server and will load balance/route our traffic to the necessary service, So, why do we need BFFs and why do they go from the user interfaces direct to the services and not as requests or considered requests? Also, if possible, recommend for me a resource i can use to understand this concepts better. Thanks

[@TomDoesTech]

The BFF makes the UI simpler to develop. The BFF request do go through the web server, all requests going to the services, including the BFF go through the web server

[@hellodun]

@@TomDoesTech alright, thank you for the clarification

[@ozgurNY]

This design requires lots of CPUs and RAMs. It will cost a lot of money. This is a nice summary of microservices but most of them can be handled without any of this. Nevertheless, I liked your content. Thanks.

[@amansagar4948]

What architecture would you recommend in this case?

[@judevector]

You just make a lot of noise without telling us which one people should go for

[@subhransudas890]

Create full practical videos on large scale system micro-services using python would be better.

[@TomDoesTech]

I've written about 4 lines of python in my life so I can guarantee it wouldn't be better

[@anandhukraju9382]

Separate databases?👀

[@TomDoesTech]

yes

[@AmansLab]

if all frontend is handled by BFF then who is calling the APIs. given that each interface have their own BFF

[@TomDoesTech]

The BFF calls the APIs

[@AmansLab]

@@TomDoesTech are they calling directly or through web server ?

[@TomDoesTech]

@@AmansLab through the web server

[@AmansLab]

@@TomDoesTech oh thanks i was confused

[@paulreilly5987]

yes, products service goes down and you can still have orders 😂 … and whats this “go down” issue? … what junk hardware and o/s is this running on 😂😂

[@palyanytsia]

Tom knows how to build large scale application, but doesn't know how to use button delete instead of backspace 😂 (editing "products API" label)

[@TomDoesTech]

lol

[@petherpettersson6152]

You could shorted these videos by 90% if you just used the final pic from the start. The thumbnail already says everything.

[@TomDoesTech]

Right, but then people would be complaining that I should have started from the beginning.