How To Build an API Gateway for Microservices with YARP

[@MilanJovanovicTech]

Want to master Clean Architecture? Go here: bit.ly/3PupkOJ Want to unlock Modular Monoliths? Go here: bit.ly/3SXlzSt

[@sekarcse]

We can use Ocelot package for the same, Is it Yarp has more features than Ocelot? Which one is better?

[@qaweeysoetan7794]

i have done that already i also follow you on LInkdin

[@mostafachronic1874]

Hello, explain validation and authentication in microservices using JWT.

[@evgeniilewicki5874]

How nice it is to watch when a person has good diction and understanding of the issue. He speaks competently. Thank you very much for your work.

[@MilanJovanovicTech]

Thanks a lot, I appreciate that! :)

[@sekarcse]

Hi Milan, Would you be able to include a video featuring Ocelot and Yarp? Both are useful tools, with Yarp being more lightweight and Ocelot offering more features. I would recommend using them for a small project that involves handling authentication and authorization in a Gateway and passing headers to the downstream API.

[@MilanJovanovicTech]

Planning on it!

[@allwinantofranklin895]

@@MilanJovanovicTech Waiting for it for a long time........!!!!!!!!!

[@RicusNortje]

I did this at my previous company as well. What I love is that if you add auth middleware before you add the proxy it then authenticates the request before it passes it downstream. You can alos add minimal API endpoints and again map them before the proxy then that allows you to override specific endpoints if you need to (for example to map the model to a new contract) and then any other endpoints on that path you did not override gets proxied.

[@MilanJovanovicTech]

Might make another video for Auth, could be useful

[@PelFox]

How do you secure downstream APIs in that case, private networks? What if underlaying services also need details about the user's claims?

[@RicusNortje]

​@PelFox We used service accounts so the gateway (YARP minimal API) would do a token exchange for delegated access and then use that JWT. That might not be the best for each use case but it suited us well. Otherwise, you can just proxy the JWT to the downstream then the downstream will also validate the token.

[@yardeZ93]

Hi Milan thanks for the video, Can you talk about authentication and authorization options and implementations with reverse proxy? What are the best practices?

[@sekarcse]

Add middleware to handle authentication and pass the necessary headers to the Service (Actual API).

[@MilanJovanovicTech]

Sure, that can be one of the next videos! 😁

[@jameshancock]

Would be awesome to see how this can integrate with kubernetes and also certificates including cert manager in kubernetes.

[@MilanJovanovicTech]

Found this for the time being: github.com/microsoft/reverse-proxy/blob/main/docs/docfx/articles/kubernetes-ingress.md

[@antonmartyniuk]

I've successfully used Yarp in some of my smaller projects. On a bigger projects or projects with high traffic I've used Traefik and Envoy. They seem to work faster and can process pretty highload

[@MilanJovanovicTech]

Did you not try YARP on those bigger projects?

[@antonmartyniuk]

@@MilanJovanovicTech no. Traefik and Envoy are much more feature rich that we used. And we compared benchmarks of other people comparing these reverse proxies

[@MirrorBoySkr]

8:12 Transforms followed by {}. 8:29 - [] are used. Thats important!!!

[@MilanJovanovicTech]

I make a typo here and there

[@mad_t]

Interesting library. But I would like to see benchmarks YARP vs Nginx, because I don't want to reinvent the wheel

[@MilanJovanovicTech]

Microsoft replaced Nginx on Azure App Service for a +80% throughput, I'll see what I can do for the benchmarks

[@codeme8016]

This was an easy to follow tutorial which is pretty rare on KZbin. Thank you very much. Would you also please mention what the use is?

[@MilanJovanovicTech]

The use of YARP? Load balancing, gateways, reverse proxying. Here are the docs: microsoft.github.io/reverse-proxy/

[@MilanJovanovicTech]

I also wrote an article: www.milanjovanovic.tech/blog/implementing-an-api-gateway-for-microservices-with-yarp

[@stonefish76]

Great video Milan! I've wanted to play with yarp a while now but was intimidated by the time it would take to learn it. You make it seem easy here.

[@MilanJovanovicTech]

Nope, YARP is too easy to use. Don't waste time and just start building something 😁

[@JesperPDk]

Have u make a video about docker-compse, how i will add this? - I have try to follow u video but i cant found out how i add docker compose?

[@MilanJovanovicTech]

Yes: kzbin.info/www/bejne/jYKpqWWjarqVb68

[@JesperPDk]

@@MilanJovanovicTech Thanks for link.

[@sauravbhatta5303]

Great video on reverse proxy. When u scale an application to multiple instances, how does Yarp manages db call? There will be still one db for all instances of application.

[@MilanJovanovicTech]

YARP doesn't call the DB at all, it just proxies the requests to the other services - which talk to the DB

[@asdasdaa7063]

Milan, can you make a video covering how to use azure cosmos db sql api, with multiple cosmos db accounts/cosmosclient instances? Been something I've been trying to learn.

[@MilanJovanovicTech]

I doubt it, since I don't work on Cosmos DB

[@arghakhanra204]

Great❤, looking for more Microservices related videos Milan 👌

[@MilanJovanovicTech]

More to come!

[@arghakhanra204]

@@MilanJovanovicTech could you cover more Microservices topic from Scratch? Like building a distributive application using Microservices? Would be looking for the same. 🙂

[@MilanJovanovicTech]

@@arghakhanra204 Planning to. This year is for distributed systems :)

[@arghakhanra204]

@@MilanJovanovicTech Great, looking for it soon 👌🙂

[@alijamal7893]

great content as always Milan 👏👏👏

[@MilanJovanovicTech]

Thanks a lot! :)

[@Sara-po1jd]

nice video man! I wonder is it possible to configure Swagger on this api gateway (Yarp)

[@MilanJovanovicTech]

That'd be tricky. Let me look into if there's a good solution these days. I didn't find one a few years ago.

[@hernanar3647]

The api gateway can redirect to the generated Swagger UI If you want to "merge" those files, by knowing the address of the API and the path of swagger.json (or yaml) file, you can show them in the api gateway as documents of the swagger UI if you configure a swagger endpoint :)

[@IvanRicardoLopes]

Nice tutorial,.Can We have a video about How to build an API Gateway for Microservices with Ocelot?

[@MilanJovanovicTech]

Great suggestion!

[@jefffiegel1758]

I know we can have Active health checks for the downstream endpoints... How can we get the output/status of those checks by querying YARP itself???

[@MilanJovanovicTech]

Need to check, I'd start with YARP docs in the meantime

[@sinanoral19]

There are 3 terms reverse proxy, api gateway and load balancer. I am confused. Can you explain the differences each of that three

[@MilanJovanovicTech]

- Proxy - server that hides internal servers from outside world - Gateway - basically the same as proxy, and you will usually see additional features added - LB - a proxy/gateway routing traffic between multiple API instances

[@sinanoral19]

@@MilanJovanovicTech thank you so much

[@user-bp4cw4qh8h]

is yarp suitable for large request per second for example 3000 reques per second?or we use from ocelot without it

[@MilanJovanovicTech]

Microsoft is doing 1.9M RPS with YARP. I think it can handle that load :)

[@antonmartyniuk]

Milan, what's your PC configuration and what's your monitors' sizes?

[@MilanJovanovicTech]

24" monitors x2 AMD Ryzen 7 7700X NVidia GeForce RTX 3060 32GB RAM (DDR5)

[@JustCode512]

Thank you again.. 10/10

[@MilanJovanovicTech]

You're very welcome!

[@mostafachronic1874]

Hello, explain validation and authentication in microservices using JWT.

[@MilanJovanovicTech]

Will do

[@PelFox]

When would you want this over something like Azure Apim?

[@MilanJovanovicTech]

Out of cloud, for example

[@sinthonseng8981]

Does .NET Aspire provide any native support for API gateway functionalities?

[@MilanJovanovicTech]

I think they will probably add support for YARP

[@regestea]

so when we use api gateway we loose swagger document , is that ok ?

[@MilanJovanovicTech]

You still have Swagger on the APIs

[@vadimr5847]

Thank you, It works!

[@MilanJovanovicTech]

You're welcome!

[@garyfirzon]

Thanks!

[@MilanJovanovicTech]

Thank you very much for the support! 😊

[@eugene5096]

Hey Milan, are you posting some sample projects to your github ? As it contains a bit obsolete samples now.

[@MilanJovanovicTech]

Planning to post a Clean Architecture and Modular monolith template soon. Will be .NET 8, all the best practices, etc.

[@eugene5096]

​@@MilanJovanovicTechwow can't wait

[@yugo6243]

Thank you for great tutorial. Looking forward for an enhanced tutorial with Yarp as reverse proxy with authentication.

[@MilanJovanovicTech]

Great suggestion 👌

[@Sara-po1jd]

I have a question regarding the authentication and authorization in the yarp, should it be at the gateway level or the microservices? I mean can we secure only the yarp requests without taking care of secuing the microservices since they are not exposed publically? if it is enough to do it on the Yarp level any idea on how we can do this on specific request and not the entire route?

[@MilanJovanovicTech]

Typically Gateway will also handle authentication. The services could be left out, if you keep them in a private (closed) network. But in most cases, you need to know who the current user is even in the microservices. So you'll still have some form of authentication, if only verifying the access token.

[@Sara-po1jd]

@@MilanJovanovicTech yeah in our case we dont need to trace the user in the microservice. we only need to authenticate some CUD operations, do you have an idea on how can i secure some endpoints and not the entire route using Yarp? I cant find it in the Yarp documentation.

[@maverickiy9366]

That is great. But let's consider I want to deploy my services on AWS ECS, or Azure Container Apps, then how this YARP will function ? How Load balancing and high availability will work with ECS or Azure Container Apps with YARP?

[@MilanJovanovicTech]

- YARP supports load balancing www.milanjovanovic.tech/blog/implementing-an-api-gateway-for-microservices-with-yarp - As for running in a HA setup, you can do a primary-secondary setup

[@PelFox]

@@MilanJovanovicTech Link returns 404

[@MilanJovanovicTech]

@@PelFox YT picked up the ) in the end 😅

[@JanKowalski-ld4ec]

Hello, Just wondering if you could publish some good advices about working with Excel || Word objects in c#. Would be great! Regards! JK

[@MilanJovanovicTech]

I doubt it (at least in the short term)

[@JanKowalski-ld4ec]

@@MilanJovanovicTech For sure there are more hot topics ;) Just thought about it and yourself while working on current project. Best regards!

[@ewgenbi]

What about websocket?

[@MilanJovanovicTech]

microsoft.github.io/reverse-proxy/articles/websockets.html

[@OldShoolGames]

Does this work with signalr/blazor server in case of a high availability/replicated backend ?

[@MilanJovanovicTech]

microsoft.github.io/reverse-proxy/articles/websockets.html

[@OldShoolGames]

@@MilanJovanovicTech Thank you Milan

[@Cesar-qi2jb]

Is YARP just a reverse proxy? Can it be used as a Gateway too? I need to create a Backend For Front-end (BFF) and I need to combine data from different microservices.

[@MilanJovanovicTech]

Did I not use it as a Gateway in this video? I also covered load balancing: kzbin.info/www/bejne/ZoPEeWyenbR5ask

[@Cesar-qi2jb]

@@MilanJovanovicTech Yes, you did. But how would you map (transform) two differentl endpoints into one?

[@roberteru25]

​@@Cesar-qi2jb Create an orchestrator service, then expose the service with grpc, then you can build response from the different APIs

[@Cesar-qi2jb]

@@roberteru25 Thanks for the advise. We prefer sticking with REST (Swagger) for our microservices as these are also publicly exposed to partners. We just have the need to build more BFFs. We already have one for the main website but we are willing to build more for other use cases. I don't really know what would be the best approach for building a Back End For Front-end in .NET.

[@qaweeysoetan7794]

Please can i get the github repo for dis to study more

[@MilanJovanovicTech]

github.com/m-jovanovic/yarp-api-gateway-sample

[@Foodies-pv7ih]

What about authentication?

[@MilanJovanovicTech]

Works with built-in Auth in ASP.NET Core

[@user-bx2er2zx5u]

How to forbid users to call your api's directly instead of using proxy?

[@ByronScottJones]

Generally you would only give the proxy an external IP and DNS record.

[@MilanJovanovicTech]

Network rules, you can close your APIs to the outside world, and only let them talk to the Proxy

[@allannielsen4752]

Hi at kzbin.info/www/bejne/i5rHhWqPjtpsbdUsi=cyo8An6JY--Z_h3H&t=659 you show the create (POST) however you don't show the CreatedAtUrl that is meant to be returned. Since the api doesn't know about the proxy it sets the api url not the proxy's public url. can you comment on that?

[@MilanJovanovicTech]

You'd need to use the Forwarded URI to make it all work. Might cover that in a future video.

[@marcobaccaro]

Kids, please don't use this. API Management products exist for a reason (Azure APIM, AWS API Gateway, MuleSoft, Kong, Gravitee, Apigee...)

[@MilanJovanovicTech]

If anything, it's good to understand the concepts behind these cloud services

[@pigrebanto]

Nice but you speak at speed of light.

[@MilanJovanovicTech]

🤷‍♂️

[@antonmartyniuk]

Turn the x2 speed off, lol

[@Yago4341]

I’m brazilian, not fluent in English, and i can understand his speak very well

[@user-xm7sh3vw8o]

I've posted it before

[@MilanJovanovicTech]

Where?