Consul Service Mesh Tutorial for Beginners [Crash Course]

Complete Service Mesh and HashiCorp Consul tutorial - Real life demo of setting up Consul in Kubernetes multi cluster, multi cloud with failover 🚀
💜 Complete DevSecOps Bootcamp: bit.ly/3tToJxt
💙 Complete DevOps Bootcamp: bit.ly/471xVhQ
🧡 GitLab Course with K8s, Microservices, Multi-Stage: bit.ly/3QwWRbi
#servicemesh #hashicorp #techworldwithnana
HashiCorp Consul is a service mesh solution. A service mesh is a dedicated infrastructure layer that controls service-to-service communication in a microservices architecture. It manages the routing of service requests to other services, performs load balancing, encrypts data, and discovers other services.
▬▬▬▬▬▬ R E F E R E N C E S 🔗▬▬▬▬▬▬
► Git repo: gitlab.com/twn-youtube/consul...
► Helm Chart Reference: developer.hashicorp.com/consu...
► Required Ports for Consul: developer.hashicorp.com/consu...
▬▬▬▬▬▬ Course Pre-Requisites ▬▬▬▬▬▬
💡 Kubernetes, Terraform, AWS
👉 Microservices explained: • Microservices explaine...
👉 Service Mesh explained: • Istio & Service Mesh -...
👉 Istio Setup Demo: • Istio Setup in Kuberne...
👉 Kubernetes Crash Course: • Kubernetes Crash Cours...
▬▬▬▬▬▬ What you’ll learn in 2 Hours ✅ ▬▬▬▬▬▬
► What service mesh is, what problems it solves in microservices architecture
► How service mesh and Consul specifically works
► How Consul works in Kubernetes multi-cluster, hybrid environments with VMs
► Consul Architecture (Control Plane and Data Plane)
► Learn about
- Proxy containers
- Dynamic Service Discovery
- Health Checks and Fault Tolerance
► Learn about secure networking - creating a zero-trust network:
- Mutual TLS - mTLS
- Authenticated Communication
- Control Traffic with Service Intentions
► Hands-on demo 🧑🏽‍💻
- create 2 K8s clusters on 2 different cloud platforms
- deploy microservices application and Consul on it
- configure failover, so in case one service is unhealthy or unreachable it routes the traffic to the healthy service instance on the other cloud platform
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
00:00 - Intro and Course Overview
01:24 - Why we need a service mesh?
08:49 - What is a Service Mesh? What is Consul?
09:52 - How it works without Consul - a K8s city
13:42 - How it works with Consul Service Mesh
20:12 - Secure Networking - How mTLS works
24:10 - Zero-Trust Network - Authentication and Communication Rules
26:29 - Observability
28:16 - Consul Architecture - Consul Servers
29:51 - Consul Architecture - Control Plane and Data Plane
31:06 - Consul in multi-cluster environment
33:47 - Consul in hybrid environment
37:46 - Consul Multi-Cluster Multi-Cloud DEMO
37:48 - Demo Overview
40:15 - Create K8s cluster on AWS EKS
52:14 - Deploy Microservices App on EKS
1:00:54 - Deploy Consul on EKS
1:23:50 - Configure Access Rules
1:28:16 - Create on connect to 2nd K8s cluster
1:32:28 - Deploy Consul and Microservices on LKE
1:36:28 - Connect the clusters - Add peer connection
1:42:18 - Configure failover to other cluster 🎉
▬▬▬▬▬▬ Connect with me 👋 ▬▬▬▬▬▬
INSTAGRAM ► bit.ly/2F3LXYJ
TWITTER ► bit.ly/3i54PUB
LINKEDIN ► bit.ly/3hWOLVT
Facebook group ► bit.ly/32UVSZP

[@TechWorldwithNana]

If this course was helpful for you, please like and share it with others, highly appreciate it😊💙 ▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬ 00:00 - Intro and Course Overview 01:24 - Why we need a service mesh? 08:49 - What is a Service Mesh? What is Consul? 09:52 - How it works without Consul - a K8s city 13:42 - How it works with Consul Service Mesh 20:12 - Secure Networking - How mTLS works 24:10 - Zero-Trust Network - Authentication and Communication Rules 26:29 - Observability 28:16 - Consul Architecture - Consul Servers 29:51 - Consul Architecture - Control Plane and Data Plane 31:06 - Consul in multi-cluster environment 33:47 - Consul in hybrid environment 37:46 - Consul Multi-Cluster Multi-Cloud DEMO 37:48 - Demo Overview 40:15 - Create K8s cluster on AWS EKS 52:14 - Deploy Microservices App on EKS 1:00:54 - Deploy Consul on EKS 1:23:50 - Configure Access Rules 1:28:16 - Create on connect to 2nd K8s cluster 1:32:28 - Deploy Consul and Microservices on LKE 1:36:28 - Connect the clusters - Add peer connection 1:42:18 - Configure failover to other cluster 🎉

[@kodjoviamedimele3066]

Hi Nana. Thanks for the course. I would like to know if you plan on doing the end to end GitHub actions to deploy to k8s cluster ?

[@raohammadraza7056]

Yeah sure why not ,you are a great Teacher 🤲❤️

[@TechWorldwithNana]

@@kodjoviamedimele3066 Yes I want to create a complete GitHub actions course, but we don't have a fixed deadline for it yet :) Thanks for your suggestion though

[@kodjoviamedimele3066]

@@TechWorldwithNana ok thank you for the reply. I am looking forward to it

[@matze3123]

Awesome thy

[@dipaksawle4207]

Thank you Nana for the most comprehensive course on Consul service mesh. You explain each and every concept in the simplest possible way. Looking forward to more such courses. Great job.

[@sagarahire-ys3uj]

learning curve and curiosity all of a sudden goes high when u comes up with new video...Devops comm is blessed to have u as a mentor

[@TechWorldwithNana]

That's great to hear, appreciate your comment 💙

[@acodersjourney]

I appreciate your dedication to making complex coding concepts easy to understand. Thanks for being a fantastic teacher!

[@zoey-hy1rl]

This was beautiful and easy to understand. Thank you Nana

[@radeksendecki9922]

Your work is absolutely great! You are bringing huge value to DevOps comminity. I love your explanations where you use the real life example to present the technology concept. Also love your 'first conxeption, then technology' approach.

[@olorundareagnes934]

Thanks a lot, Nana. You just have a way of simplifying complex concepts. I'm deeply grateful.

[@TechWorldwithNana]

Thank you! Amazing to hear that! 🙏

[@andriiguselietov8833]

Fantastic explanation and a practical demo. Thank you!

[@chandurdissanayake9544]

Absolutely love this! Let's do more HashiCorp-related videos :) ❤♾

[@michaele.2591]

Thanks!

[@user-qn6wz4bm7s]

Awesome, understood service mesh in one go.😍

[@stephanemoreau846]

This is an Amazing tutorial , the best in this world that I have seen 👍👏

[@paulja]

Thank you, deposition is one thing, but seeing it all in action is priceless. Great work 👏

[@MP07_World_Traveler]

Thanks a lot, simplify the complex concept

[@mehdimj_ir]

Great job on explaining Consul and how it works. I look forward to Hashicorp Nomad as k8s competitor.

Thank you for the wonderful and extremely informative video :)

[@thomash.8297]

Nice video Nana, thanks!

[@siarheikalashynski265]

Awesome demo, awesome video. Thank you for your work!

[@user-em7ws2ns9i]

Thanks a lot nana, I really love your work!!!

[@maleekeasedevopsec]

This is a great video and well explained. I could understand every aspect and got an insight on how to apply in production environment. You are one the best DevOps Tutor out there. Great Work @TechWorldwithNana 👍

[@TechWorldwithNana]

Thank you for your amazing feedback! Appreciate your comment! 😊

[@alifiroozizamani7782]

What an Awesome tutorial Thanks, dear Nana

[@ousmanesoumailayaye8618]

Excellent course, thank you! Champion!!!

[@aaviko]

Thanks a lot, Nana.

[@durgeshkshirsagar116]

Great content Nana 👍🏻👍🏻

[@traxex1975]

Great video 🎉 Thank you so much Nana, for this live and valuable example ❤

[@thush1990]

Nicely and clearly explained as you always do. Thank you.

[@meenasumit]

Thank you for this awesome course. 👍

[@TornikeRazmadze]

ძააალიან კარგად ხსნი, თან საინტერესო თემებს. მადლობა ❤

[@TechWorldwithNana]

Madloba! 🙏

[@AlexanderGross]

Excellent course, thank you!

[@TechWorldwithNana]

Thank you!

[@mo.dia97]

Thank you very much for your hard work Nana! Amazing explanation

[@TechWorldwithNana]

You're very welcome! thank you :)

[@maxmetalm4108]

Thanks. It would be great to see the ways to set up failovers for statefullsets between different clusters)

[@narendrakaduru2603]

Thankyou Nana ❤

[@abdoulhamidcoulibaly2385]

Thanks for this great material. I've learned a bunch of things

[@TechWorldwithNana]

Happy to hear!

[@sighupcmd]

Super informative, thanks! Would be just amazing to see practical integration of consul with others Hashi tools: nomad and vault (probably using same google’s demo services). Oh, and something about self-hosted distributed storage in clusters please (nomad/k8) :)

[@vijayraghv2208]

You are a great teacher!. Liked your way of teaching with concepts first. Just short of words for this funtastic video. Any plans to come up with video for K8s new Gateway API

[@rsavko]

Thanks a lot!

[@abessesmahi4888]

@TechWorldwithNana Could you cover Hashicorp Nomad? Thank you so much for your efforts

[@vladf7180]

Great! Thanks for your content! It's pretty easy to understand all of service mesh concepts although english is not my native language

[@TechWorldwithNana]

I'm glad to hear that! Appreciate your comment!

[@nitinmore7686]

Nana, Great insites.... Your explanation and Animation mach, make me understood this Topic... Its great efforts! I appreciate on the behalf of all learners❤

[@kaushikmitra8889]

Excellent 👌. Keep give us updated on ISTIO. 🎉

[@maidul13]

great video!

[@saadullahkhanwarsi5853]

Amazing, great work

[@TechWorldwithNana]

Thank you, happy to hear! :)

[@kodjoviamedimele3066]

@@TechWorldwithNana thanks for this course. Please could you create a complete end to end GitHub actions course to deploy microservices into kubernetes as you mentioned in the GitHub actions crash course?

[@hprangana]

thanks, a really good one

[@TechWorldwithNana]

Thanks for the feedback! :)

[@Anshulmishra160]

As Nana knows every tool in a few days she will become a Goddess

[@shreeji_]

how about we extend this crash course videos to be a hashicorp stack series, where we get crash courses on all hashicorp products. (nomad, waypoint, ...)

[@mikedqin]

This was an Excellent course on learning Service Mesh, Terraform, EKS and Consul. One of the feedback was the terraform destroy did not delete subnets due to the fact that Elastic Load Balancers was not deleted, which prevented the subnets from being deleted. I have to manually delete ELB to remove the subnets. It's weird. It's quite possible because these 3 ELB are not declared resources in terraform, and it's automatically created for managed node groups. Another question is why you created public subnets and what is the purpose? Is it for IGW only? EKS are in private subnets. Consul is deployed in EKS. Maybe I missed something. Again, thank you so much, Nana.

[@Shiki229]

Thanks

[@TechWorldwithNana]

Appreciate your support, thank you! :)

[@musicthreads]

I ❤ Nana!

[@gansgimmler3684]

спасибо

[@RafaelDurelli]

Please show us how to connect to an vm :) thanks for all your vids

[@Fayaz-Rehman]

Thank you - Excellent - I love to know the matrix data before and after implementing the consul on a kubernetes cluster - like " kubectl top nodes " - Just to see, how much resources in terms of CPU and memory does consul consume . also can we live implement consul on a production kubernetes cluster ? with out deleting pods.

[@TechWorldwithNana]

in production, you can do it by increasing the number of replicas of the services and removing the instances without proxies. This way you won't have a down-time.

[@Fayaz-Rehman]

@@TechWorldwithNana Great - much appreciated.

[@wanyuclementclearance3125]

Hello Nana please what is the recommended order of deploying consul? Do you deploy the application manefest files first before the consul helm chats or vice versa? Thanks so much for your efforts and may you find the energy to continue doing what you are doing for the tech world

[@TechWorldwithNana]

You can deploy in any order you want. You can deploy the service mesh in the cluster even after you have deployed all your applications and services without any issue.

[@joshwolfer]

If you deploy Consul after your application pods, you just need to destroy the application pods and let them restart. They'll come back up with the Consul components. You'd need to restart them anyway for annotation changes to take effect.

[@zinternetguy9678]

Hello @TechWorldwithNana could you do the same concept with istio please ? thanks in advance

[@Giga4G]

Welcome back

[@user-kr3yz4vz4r]

can you please make a video on collecting infra level metrics & logs from kubernetes cluster using opentelemetry using deamonset mode (without doing instrumentation to application/microservices). And View those metrics & logs in grafana and store those metrics & logs in Storage Accounts &/ Database. Is it possible?

[@trancongminh2628]

is that also way for multi region deployment?

[@TZAK4u]

Any playground interactive realtimr projects labs available ??

[@farhansabbirsiddique8693]

I came across a problem, I am not sure how to address this. 18 VMs running applications and databases. 3 separate VMs (with bit higher capacity for now) are hosting docker swarm ready to host those applications from the VMs; but none of the apps in either platforms are mesh aware; I am trying to use consul's DNS service and custom python background service to listen to docker events and call consul API to [de]register services. Its a mess and very errorprone; I want to simplify this deployment of apps in docker (we're using private registry and its an airgapped system). Also we're running debian 12. No enterprise support. How do I also ensure proper service discovery to-from the legacy platform into the new environment? and the sysadmins are inclined towards swarm only, no kubernetes; please help!

[@user-fo5zn9vu2s]

Hi Nana, are you offering this course in detail in TWN page? I need detailed course on service mesh. Thanks

[@TechWorldwithNana]

Yes, service mesh will be included in the DevSecOps bootcamp in part 2. Scheduled to release start of next year. But I don't have a separate deep dive course only on service mesh.

[@maxmetalm4108]

Hi. How peers' endpoints were specified? lke was a valid dns name? I don't think so

[@maxmetalm4108]

I mean, in order to connect two clusters using consul or whatever, don't we need to specify somewhere a valid lb ip or dns name of proxy service of counterpart on every peers?

[@raohammadraza7056]

#TeachworldwithNana Hello teacher, I'm a big fan you, teacher only one request create Java script complete course

[@TechWorldwithNana]

Thank you happy to hear! Was thinking to create a JavaScript crash course for beginners. What would you like to see in such a tutorial? Basics of variables, data types, functions etc?

[@raohammadraza7056]

@@TechWorldwithNana I want to learn from beginner to advanced I have to learn everything about it, I am very fond of coding, Please Teacher create complete course beginer to advance. I'm glad you replied, I hope to come up with a complete course javascript on this soon

[@TechWorldwithNana]

@@raohammadraza7056 You can learn the web development basics as well as cloud and infrastructure basics in our IT beginner's course. IT's perfect for people who want an easy way to get into IT and are starting with 0 pre-knowledge. You can check it on our techworld-with-nana.com website.

[@shivendraaditya45]

Please do a course for Jenkins

[@TechWorldwithNana]

Complete Jenkins is in our DevOps bootcamp :)

[@calpaycetin]

Thank you for the great video first. To simulate failover, you delete the deployment. Is there no K8 object in this setup ? I would think of deleting the service object instead. And then the service disappears from EKS Consul GUI. If there is a K8 service object, I'd expect the service appear as failed. Thank you.

[@tshepontsiu824]

I was waiting for this what took you so long

[@bedrilmoussakat210]

Merci !

[@TechWorldwithNana]

Thank you for your support! :)

[@amittangale1317]

How to make life complicated when you can just use a single AWS

[@Bis_panda]

U need more exposure to the world of DevOps.

[@joshwolfer]

Enterprise application networking with redundancy is rather complicated.

[@itmemo8617]

Thank you nana , but too much abalogy makes me feel sleepy, we can understand better if you just avoid too much analogy, like ... apartment ..building...etc , good job !

[@3004atul]

why u r not showing your face , if u show your beautiful face it will be more easy to understand the concept

[@AleksFirst]