RabbitMQ : Message Queues for beginners

Subscribe to show your support! goo.gl/1Ty1Q2 .
Patreon 👉🏽 / marceldempers
Folks! Today we'll be taking a look at Message Queues, what they are, why you may want to use a message queue, and how RabbitMQ helps offer message broker functionality.
In this video, we take a look at the basics, how to run RabbitMQ, some of the features.
We will also build and application that produces messages in a queue, and another that consumes the messages.
Checkout the source code below and follow along :)
In an upcoming video, we'll cover HA and replication so be sure to stay tuned for that!
We'll also learn how to run all of this on Kubernetes.
Also if you want to support the channel further, become a member 😎
marceldempers....
Checkout "That DevOps Community" too
marceldempers....
Source Code
--------------------------------------------------------------
github.com/mar...
If you are new to Kubernetes, check out my getting started playlist on Kubernetes below :)
Kubernetes Guide for Beginners:
---------------------------------------------------
• Kubernetes development...
Kubernetes Monitoring Guide:
-----------------------------------------------
• Kubernetes Monitoring ...
Kubernetes Secret Management Guide:
--------------------------------------------------------------
• Kubernetes Secret Mana...
Like and Subscribe for more :)
Follow me on socials!
marceldempers.dev
Twitter | / marceldempers
GitHub | github.com/mar...
Facebook | thatdevop...
LinkedIn | / marceldempers
Instagram | / thatdevopsguy
Music:
Track: INOSSI - Sunset Eyes (Free download) | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / sunset-eyes-free-download
Track: LiQWYD - Bridges (Free download) | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / bridges-free-download
Track: Amine Maxwell - Le Soir | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / le-soir
Track: souKo - souKo - Parallel | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / parallel

[@MarcelDempers]

Rabbit MQ : High Availability and Replication 👉🏽kzbin.info/www/bejne/fKvUm6eLZ91pj6M

[@Techtips200]

Very nice video...small Query wrt Rabbitmq Linux vulnerability on default port 5672..how to remove this vulnerability...change the port or firewalld rules?

[@crimzin2180]

Hi Bud, Thank you for the great videos. I need to set up a high availability RabbitMQ with 3 nodes and then need to have a load balancer like nginx or haproxy for it. I am trying nginx but I don't know how to make the connections persistent. Do you have any info or exaples for that?

[@MarcelDempers]

@@crimzin2180 I dont have much experience in that area especially the persistence. I would think that your client would establish a connection which would remain open whilst subscribing to the queue. HA or NGINX would have that connection open to an upstream until the client closes the connection. Here is an example book showing a basic HA proxy config with Rabbit livebook.manning.com/book/rabbitmq-in-action/chapter-6/35

[@gosnooky]

Love your tutorials! You also look like you could bench press a node_modules folder.

[@dadurex]

XDDDDDD

[@hiwijaya]

LoL

[@smooth8580]

lmaoo

[@DigsWigs2022]

Lol

[@robbiealixsantos]

Very cool, thank you for this!! Your video was very easy to understand and follow BTW if anyone is running into the message "Stats in management UI are disabled on this node" when accessing the Management dashboard, use the following command when starting up the RabbitMQ container: docker run -d --rm --net rabbits -p 8080:15672 --hostname rabbit-1 --name rabbit-1 rabbitmq:3-management The reason is that the default image disables metrics collector in the management_agent plugin

[@sm5172]

Excellent video, thank you for going straight to the point and even editing out all the pauses! I came for RabbitMQ but I'm staying for more Go and Kubernetes.

[@jerweiyeoh7096]

Just wanna thank you for the great videos and content! Trying to get into DevOps myself and it has been a struggle, and your videos has always been helpful in understanding some concepts I struggle with. Always excited for your content as it explains modern tech in an understandable format. Appreciate it and keep up the good work!

[@MarcelDempers]

Thanks so much 💪🏽Good luck out there. My advice: Build up a good understanding of using Linux, learn docker, use docker to run everything (like i do in all my videos) It will powerlevel and fast track your learning especially when running open source stuff locally. Learn the basics of Kubernetes. Try apply your docker learning, to K8s. Then learn how to run it locally on Kubernetes. Create trial AWS\Azure account, try running kubernetes in the cloud. This will give you a good foothold and foundation to build on.

[@lashlarue7924]

Bro, I subscribed within the first 2 minutes, never having seen or heard of you before, you're the man.

[@willypi3641]

I was some troubles understanding the message queue logic until I watched this video. Thanks a lot man, greeting from Mexico.

[@divanselev4413]

No only squat, deadlift too) thank you for your work!

[@briantoner2215]

That's probably one of the best and most coherent technical presentations I have seen on youtube!

[@supernerd6983]

This camera format always has me expecting him to drop a freestyle

[@nicknick65]

wow man, very nicely done. Ive just finished learning Go and now getting into RabbitMQ and Kafka. Your docker stuff was brilliant. Learnt heaps. Just subscribed.

[@MarcelDempers]

🙏🏽

[@PrakashReddyK]

Marcel , Good Morning :) ( for me ). Thanks Very much for wonderful content. I am more visible kind of guy , cant thank you enough for explaining clearly about architecture on a white board. I have learned a lot from your videos.

[@1piece_forever]

I think you should definitely know that, you are doing a great great work for the community. Thank you. And please keep doing.

[@MarcelDempers]

Thanks so much! this means a lot 💪🏽

[@НиколайСладкий-н4к]

The best video about RabbitMQ ever! Thank's a lot!

[@decepticoon]

Truly love your channel. You're a great teacher and I love the way you present information! Keep making great videos please :)

[@KahaniyonKK]

You are really doing great work man for everyone. Great stuff, easy explanation, demos are always awesome. Thanks and keep doing great work.

[@TheAfreitag]

You saved my bacon here, need to set up a rabbitmq cluster so this in combination with your next video are really helping me out!

[@OddBallTrails]

Hey man, I love you. Thanks for all your videos. ❤️💙💜

[@buckfush187]

Yes man your channel is really underrated

[@manpt123]

One of the best youtuber for Golang community

[@kenchang3456]

I agree with @Ray Statham, very nice easy intro to Rabbit MQ. Thank you very much.

[@phils8215]

Very concise, very well explained. Your pace is excellent to follow!

[@cheunhong9769]

Love you work, would like to see you cover about Apache Kafka next time.

[@torbendury4374]

Absolutely underrated channel. Besides beginner videos, are you also planning some deep dives?

[@BennyWalnuts]

The arms on this guy. I feel compelled to trust his instruction.

[@RayStatham]

Really nice walk through there Marcel :)

[@DavidChandra]

I love your tutorial. Subscribed.

[@tangseakmeng599]

This is a brilliant tutorial.

[@deanprickle5394]

It was kinda hard to keep my eyes off your triceps XD...Excellent Video btw...cleared my doubts 🧡

[@itier]

Maybe an refresh of the series rabbit on kubernetes with rabbitmq/cluster-operator? It's an game changer on how things (could) work ...

[@devopssimon]

Hi Marcel. When I run the rabbitmq docker container and look at the logs it seems to start in maintenance mode and when I look at the web management I see the node name, but I don't see any of the node status information, like file descriptors, memory or disk space etc. I used the following command to start the container docker run -d --rm --net rabbits -p 8090:15672 --hostname rabbit-1 --name rabbit-1 rabbitmq:3.8 Here are the end of the logs 2021-05-23 11:14:30.499 [info] Running boot step direct_client defined by app rabbit 2021-05-23 11:14:30.500 [info] Resetting node maintenance status 2021-05-23 11:14:30.502 [info] Application rabbit started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.502 [info] Application cowlib started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.504 [info] Application cowboy started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.515 [info] Application rabbitmq_management_agent started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.566 [info] Application prometheus started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.568 [info] Application rabbitmq_web_dispatch started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.586 [info] Prometheus metrics: HTTP (non-TLS) listener started on port 15692 2021-05-23 11:14:30.586 [info] Application rabbitmq_prometheus started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.586 [info] Ready to start client connection listeners 2021-05-23 11:14:30.598 [info] started TCP listener on [::]:5672 completed with 3 plugins. 2021-05-23 11:14:31.784 [info] Server startup complete; 3 plugins started. * rabbitmq_prometheus * rabbitmq_web_dispatch * rabbitmq_management_agent 2021-05-23 11:14:31.787 [info] Resetting node maintenance status

[@anarmammadovn]

really great tutorial that I looking for. thanks best grads.

[@hzrq]

Many thanks for the video! Worth the 22 minutes!

[@MrVnelis]

Your videos are awesome and really useful! Thanks so much for this excellent work!

[@SodiqOlaniyi]

Respect 🖖.

[@bharatsinghtanwar5963]

Hey man, you are the best.

[@cloudbrothers]

This is a great video. It's inspiring. Thanks for the content!

[@esc-sh]

This is a great intro to RabbitMQ

[@Su2509]

Thank you so much

[@zakariabouataya7248]

Super interesting content, Thank you

[@davidecortese8276]

Thank you!!! Great video and amazing explanation!

[@rololop34]

great video

[@rogerthat_shorts]

Failed to establish message queue error I m getting....Any suggestions 🙏

[@datwilliama2]

thank you so much :3

[@mohammadkhazaee9818]

thank you explain it very well

[@alexdan3457]

Awesome video! Very helpful. Thanks

[@mariorios8827]

Thank you, clear and concise

[@jekabskarklins]

07:00 I think you can still run rabbitMQ as deployment just create a service with the specified name and dirrect traffic to the pods in the deployment

[@MarcelDempers]

If you need replication setup, each pod needs to be individually addressable, so load balancing between multiple pods wont be sufficient for that need. This is why a headless service with a statefulset is used instead.

[@ashrafbaig697]

Can you create queue type as Quorum and publish the image ? this is creating classic queue

[@МаксимСлободянюк-н9о]

Thank you SO MUCH!!!

[@MrPro1004fun]

Thanks a lot for this fantastic video!!!

[@mzw8374]

Hello, What if we setup the rabbitmq on EC2 instance not with containerization (k8s) for serving all the microservices on kubernetes cluster, is it possible?

[@gogle-zero]

very clear thanks !

[@WomboBraker]

Man you are an absolute chad

[@TheRishith]

Great job, have gone through most of the videos, all are fantastic. Can you make a series of Tekton and Integare with argo CD

[@MarkDeibert]

What is the VS Code theme you're using? I wish VS Code would implement a feature that shows the theme name small at the bottom somewhere. Also, really great content my friend. Very clear and easy to follow instruction.

[@MarcelDempers]

Thanks for the kind words 🙏 I used to use "Amethyst Dark", Now I use "Reloaded Dark [Darker]"

[@giancarlotupacgutierrez6210]

Excellent vídeo folk!

[@rohitsolanki667]

I have two broker from different device and create queue when publish msg , So I want if i publish msg it will be retain and show in both broker subscribe . it will manage only configuration no use predefined queue because my msg will be published by device . so how can i achieve this replication of msg . i use client tool for subscribe is mqttbox . please give me solution 🙏

[@shraddhapriya2395]

How can I connect to my organization rabbitmq ? In other words, How can I connect to a host other than localhost? Thanks in advance!

[@OddBallTrails]

Good one. Thanks.

[@danielzarzeczny2800]

1:10 I believe that you mean HTTP not TCP, when you say about synchronous calls between services. TCP itself is asynchronous. Some higher-level protocols like HTTP, that rely on TCP make commnication synchronous, but not TCP itself. I just discovered your channel and I love it. You're doing a great work! Keep going :)

[@mangeshgupta5677]

More power to you 💪

[@amine250]

Very interesting, thanks marcel

[@zxc11118]

Awesome video! I copied the code, but had to rework the dockerfile and add the go.mod and go.sum files, and add the installation of the modules command (go mod download), because running like it was there, didn't work for me.

[@MarcelDempers]

Great stuff 💪🏽 Some of my guides are still using older versions of Go Do you mind submitting a PR?

[@zxc11118]

@@MarcelDempers Not all! 👍

[@rakeshmali1727]

nice video.. one question though: at 7:00 you said hostname is required for `rabbitmq` instances to find and talk to each other. Why do multiple rabbitmq instances need to communicate? Isn't it that the other application services (producer and consumers) require communication with each other?

[@MarcelDempers]

In most software, to achieve high availability, the software runs multiple copies and forms a leader\worker topology, traditionally known as master/slave. They need to communicate in order to up hold high availability. Producers and consumers in message broker technology dont communicate with one another and talk to the queue itself, in this case, they talk to RabbitMQ

[@13Macke37]

This is sooo great content. You have way too few subscribers.

[@leafaravlis7361]

thanks again!

[@somebodyyouusedtoknow8600]

he is the buffed programmer

[@hn3m3s1s]

thank you! random question: would you mind sharing how you make your commandline arguments/options in grey? that's pretty nice!

[@MarcelDempers]

I have no idea to be honest 😀 I believe this may just be a VSCode theme that does it

[@hn3m3s1s]

@@MarcelDempers You don't have this in your normal terminal? only in VSCode? That's pretty nite tho!

[@DatNguyen-ry1vr]

great work. Thank you!

[@nickwoodward819]

Harry Enfield running out of ideas XD Nice video

[@kevintarango3736]

Hi bro, First of all thanks for making this helpful video, I have a problem, when I get in to the local host my dashboard is so different in front of the dashboard you get in the video, I have been reading about it and I have found that I could be something about the node configuration but I did everything as you did, can you give an advice? And thanks again bro

[@MarcelDempers]

Not quite sure about this one. The configuration is pretty lean so unsure if its config related. Wondering if the management plugin on that container image has changed perhaps ?

[@mohamedhabas7391]

good work ma man

[@carlotuazon6783]

what is the name of your text editor?

[@ruixue6955]

7:43 RabbitMQ CLI 8:31 plugins 11:03 producer 14:05 put message into a queue

[@suhasadduri1691]

why you stopped doing vedios ??

[@kcinosdev6642]

Very good and knowledgeable video, thanks but TOO MUCH ADS : four (4) so for.

[@NiteshKumar-do4en]

Great fan again good video please argo as ci or workflows

[@OseremeOkojie]

Not Cbum "what is up youtube"

[@mateuszobrzut3788]

Great!

[@adriancor1344]

you live in Australia or Spain?

[@MarcelDempers]

Aussie Aussie Aussie 🦘💪🏽

[@quanchi88]

Do you even lift bro? :) I'm just kidding. Great video, thanks for it

[@openyard]

This business off chopping of pause intervals in video or audio clips makes the listening stressful after a few seconds and sounds argumentative. The brain needs time to process the information in a calm fashion.

[@elcapitan6126]

slightly off topic but it's good to see other devs keeping themselves in shape (I assume you lift regularly). I can't stand the physically-unhealthy culture typically associated with software development. healthy body healthy mind.

[@MarcelDempers]

I am literally reading this from the gym 🤣 💪🏽👍🏼

[@mohammadkhazaee9818]

damm.. you look like Boris Johnson

[@Naton]

Too much zoom make it nauseating

[@BigFattyNat]

My boy got a flex camera angle 😆

[@ezrichie2006]

I came here for more understanding for rabbit, and ended up seeing a GO app in action :D very nice!

[@danielarledge7017]

I'm transitioning from a senior system admin position to a devops position in my company and I can't tell you how valuable your content is to me. Best Devops channel on youtube.

[@bebebewin]

go heels

[@DigsWigs2022]

Best. Thank you

[@eclipsetutorialvideo]

Great intro to using RabbitMQ in Docker, it is a bit confusing the consumer part with loops consuming but you need to learn Go language. Otherwise it was easy to follow. Thanks, could you show us the RPC pattern :)

[@nathiToto22]

I’m here for this topic 😃, really looking forward to more thank you for this.

[@elissar4158]

Thanks 🙏🏻🙏🏻🙏🏻 How can publish message to rabbitmq using django without celery can you help me please?

[@MohammadSikt]

How one can consume some messages, not acknowledge them immediately, close the channel/connection, and later on, in a new process acknowledge a few selected consumed message? The selection is based on some side processes on the consumed messages.

[@RakshithSShellikeri]

hey hi can anyone help me i am working on project for rabbitmq to develop an messaging app pls kindly anyone revert if u got any idea on this

[@DharmicYoddha]

I didn’t know Arnold was a Dev Ops guy in parallel universe!

[@dufferzzzzz]

Helped me so much! Thank you :) All the content on your channel is fantastic. Thanks for the great work

[@Aryeh-o]

If He Man made devops tutorials

[@RouhollahNaby]

Where is your github repo link?

[@Mustafa-099]

Bulging Biceps 🗿