RabbitMQ : Message Queues for beginners

Subscribe to show your support! goo.gl/1Ty1Q2 .
Patreon 👉🏽 / marceldempers
Folks! Today we'll be taking a look at Message Queues, what they are, why you may want to use a message queue, and how RabbitMQ helps offer message broker functionality.
In this video, we take a look at the basics, how to run RabbitMQ, some of the features.
We will also build and application that produces messages in a queue, and another that consumes the messages.
Checkout the source code below and follow along :)
In an upcoming video, we'll cover HA and replication so be sure to stay tuned for that!
We'll also learn how to run all of this on Kubernetes.
Also if you want to support the channel further, become a member 😎
marceldempers.dev/join
Checkout "That DevOps Community" too
marceldempers.dev/community
Source Code
--------------------------------------------------------------
github.com/marcel-dempers/doc...
If you are new to Kubernetes, check out my getting started playlist on Kubernetes below :)
Kubernetes Guide for Beginners:
---------------------------------------------------
• Kubernetes development...
Kubernetes Monitoring Guide:
-----------------------------------------------
• Kubernetes Monitoring ...
Kubernetes Secret Management Guide:
--------------------------------------------------------------
• Kubernetes Secret Mana...
Like and Subscribe for more :)
Follow me on socials!
marceldempers.dev
Twitter | / marceldempers
GitHub | github.com/marcel-dempers
Facebook | thatdevopsguy
LinkedIn | / marceldempers
Instagram | / thatdevopsguy
Music:
Track: INOSSI - Sunset Eyes (Free download) | is licensed under a Creative Commons Attribution licence (creativecommons.org/licenses/...)
Listen: / sunset-eyes-free-download
Track: LiQWYD - Bridges (Free download) | is licensed under a Creative Commons Attribution licence (creativecommons.org/licenses/...)
Listen: / bridges-free-download
Track: Amine Maxwell - Le Soir | is licensed under a Creative Commons Attribution licence (creativecommons.org/licenses/...)
Listen: / le-soir
Track: souKo - souKo - Parallel | is licensed under a Creative Commons Attribution licence (creativecommons.org/licenses/...)
Listen: / parallel

[@MarcelDempers]

Rabbit MQ : High Availability and Replication 👉🏽kzbin.info/www/bejne/fKvUm6eLZ91pj6M

[@Techtips200]

Very nice video...small Query wrt Rabbitmq Linux vulnerability on default port 5672..how to remove this vulnerability...change the port or firewalld rules?

[@crimzin2180]

Hi Bud, Thank you for the great videos. I need to set up a high availability RabbitMQ with 3 nodes and then need to have a load balancer like nginx or haproxy for it. I am trying nginx but I don't know how to make the connections persistent. Do you have any info or exaples for that?

[@MarcelDempers]

@@crimzin2180 I dont have much experience in that area especially the persistence. I would think that your client would establish a connection which would remain open whilst subscribing to the queue. HA or NGINX would have that connection open to an upstream until the client closes the connection. Here is an example book showing a basic HA proxy config with Rabbit livebook.manning.com/book/rabbitmq-in-action/chapter-6/35

[@gosnooky]

Love your tutorials! You also look like you could bench press a node_modules folder.

[@dadurex]

XDDDDDD

[@hiwijaya]

LoL

[@smooth8580]

lmaoo

[@DigsWigs2022]

Lol

[@lashlarue7924]

Bro, I subscribed within the first 2 minutes, never having seen or heard of you before, you're the man.

[@danielarledge7017]

I'm transitioning from a senior system admin position to a devops position in my company and I can't tell you how valuable your content is to me. Best Devops channel on youtube.

[@bebebewin]

go heels

[@supernerd6983]

This camera format always has me expecting him to drop a freestyle

[@willypi3641]

I was some troubles understanding the message queue logic until I watched this video. Thanks a lot man, greeting from Mexico.

[@sm5172]

Excellent video, thank you for going straight to the point and even editing out all the pauses! I came for RabbitMQ but I'm staying for more Go and Kubernetes.

[@robbiealixsantos]

Very cool, thank you for this!! Your video was very easy to understand and follow BTW if anyone is running into the message "Stats in management UI are disabled on this node" when accessing the Management dashboard, use the following command when starting up the RabbitMQ container: docker run -d --rm --net rabbits -p 8080:15672 --hostname rabbit-1 --name rabbit-1 rabbitmq:3-management The reason is that the default image disables metrics collector in the management_agent plugin

[@briantoner2215]

That's probably one of the best and most coherent technical presentations I have seen on youtube!

[@OddBallTrails]

Hey man, I love you. Thanks for all your videos. ❤️💙💜

[@PrakashReddyK]

Marcel , Good Morning :) ( for me ). Thanks Very much for wonderful content. I am more visible kind of guy , cant thank you enough for explaining clearly about architecture on a white board. I have learned a lot from your videos.

[@jerweiyeoh7096]

Just wanna thank you for the great videos and content! Trying to get into DevOps myself and it has been a struggle, and your videos has always been helpful in understanding some concepts I struggle with. Always excited for your content as it explains modern tech in an understandable format. Appreciate it and keep up the good work!

[@MarcelDempers]

Thanks so much 💪🏽Good luck out there. My advice: Build up a good understanding of using Linux, learn docker, use docker to run everything (like i do in all my videos) It will powerlevel and fast track your learning especially when running open source stuff locally. Learn the basics of Kubernetes. Try apply your docker learning, to K8s. Then learn how to run it locally on Kubernetes. Create trial AWS\Azure account, try running kubernetes in the cloud. This will give you a good foothold and foundation to build on.

[@dickson710]

so clear without any single BS, nice work!

[@divanselev4413]

No only squat, deadlift too) thank you for your work!

[@minhthinhhuynhle9103]

I decided to register for membership after watching fewer than 10 of your videos :)) Can't wait until I become a real DevOps Engineer. Imma upgrade my Level then :)))

[@MarcelDempers]

🙏🏽

[@DavidChandra]

I love your tutorial. Subscribed.

[@nicknick65]

wow man, very nicely done. Ive just finished learning Go and now getting into RabbitMQ and Kafka. Your docker stuff was brilliant. Learnt heaps. Just subscribed.

[@MarcelDempers]

🙏🏽

[@watherby29]

Best tutorials I ever watched. Explaining what counts and not going into what does not matter. Also I like that it is a little fast paced (at least for me). Kindly make more of this gold :) Thanks

[@TheAfreitag]

You saved my bacon here, need to set up a rabbitmq cluster so this in combination with your next video are really helping me out!

[@1piece_forever]

I think you should definitely know that, you are doing a great great work for the community. Thank you. And please keep doing.

[@MarcelDempers]

Thanks so much! this means a lot 💪🏽

[@user-kn6vr7el8y]

The best video about RabbitMQ ever! Thank's a lot!

[@dialecticalmonist3405]

I don't understand any of this, but I can tell that if I watch it more carefully and several more times, I would get it eventually. You explained it so thoroughly and clearly that I subscribed to your channel.

[@MarcelDempers]

Glad you enjoyed it. Feel free to checkout my community page for the Discord server. Friendly folks happy to answer questions you may have 💪🏽👊🏽

[@thomasmcewen2840]

SUPER high quality video! Thanks Marcel!

[@KahaniyonKK]

You are really doing great work man for everyone. Great stuff, easy explanation, demos are always awesome. Thanks and keep doing great work.

[@decepticoon]

Truly love your channel. You're a great teacher and I love the way you present information! Keep making great videos please :)

[@BennyWalnuts]

The arms on this guy. I feel compelled to trust his instruction.

[@anarmammadovn]

really great tutorial that I looking for. thanks best grads.

[@dufferzzzzz]

Helped me so much! Thank you :) All the content on your channel is fantastic. Thanks for the great work

[@cheunhong9769]

Love you work, would like to see you cover about Apache Kafka next time.

[@buckfush187]

Yes man your channel is really underrated

[@manpt123]

One of the best youtuber for Golang community

[@kenchang3456]

I agree with @Ray Statham, very nice easy intro to Rabbit MQ. Thank you very much.

[@phils8215]

Very concise, very well explained. Your pace is excellent to follow!

[@nathiToto22]

I’m here for this topic 😃, really looking forward to more thank you for this.

[@tangseakmeng599]

This is a brilliant tutorial.

[@eclipsetutorialvideo]

Great intro to using RabbitMQ in Docker, it is a bit confusing the consumer part with loops consuming but you need to learn Go language. Otherwise it was easy to follow. Thanks, could you show us the RPC pattern :)

[@deanprickle5394]

It was kinda hard to keep my eyes off your triceps XD...Excellent Video btw...cleared my doubts 🧡

[@zakariabouataya7248]

Super interesting content, Thank you

[@zenobikraweznick]

Just discovered your channel, it's amazing, thank you!

[@MarcelDempers]

🙏🏼

[@DigsWigs2022]

Best. Thank you

[@SodiqOlaniyi]

Respect 🖖.

[@RayStatham]

Really nice walk through there Marcel :)

[@user-ej9bv7qf1e]

How one can consume some messages, not acknowledge them immediately, close the channel/connection, and later on, in a new process acknowledge a few selected consumed message? The selection is based on some side processes on the consumed messages.

[@torbendury4374]

Absolutely underrated channel. Besides beginner videos, are you also planning some deep dives?

[@cloudbrothers]

This is a great video. It's inspiring. Thanks for the content!

[@faizanvanekar7882]

Awesome Explanation !!! Looking forward for some administration video on the same. Thanks !! Great work !!

[@Su2509]

Thank you so much

[@hzrq]

Many thanks for the video! Worth the 22 minutes!

[@bharatsinghtanwar5963]

Hey man, you are the best.

[@mohammadkhazaee9818]

thank you explain it very well

[@giancarlotupacgutierrez6210]

Excellent vídeo folk!

[@MrVnelis]

Your videos are awesome and really useful! Thanks so much for this excellent work!

[@rololop34]

great video

[@davidecortese8276]

Thank you!!! Great video and amazing explanation!

[@datwilliama2]

thank you so much :3

[@itier]

Maybe an refresh of the series rabbit on kubernetes with rabbitmq/cluster-operator? It's an game changer on how things (could) work ...

[@MrPro1004fun]

Thanks a lot for this fantastic video!!!

[@gogle-zero]

very clear thanks !

[@alexdan3457]

Awesome video! Very helpful. Thanks

[@BigFattyNat]

My boy got a flex camera angle 😆

[@esc-sh]

This is a great intro to RabbitMQ

[@RaabStephan]

Love that VSCode theme!

[@devopssimon]

Hi Marcel. When I run the rabbitmq docker container and look at the logs it seems to start in maintenance mode and when I look at the web management I see the node name, but I don't see any of the node status information, like file descriptors, memory or disk space etc. I used the following command to start the container docker run -d --rm --net rabbits -p 8090:15672 --hostname rabbit-1 --name rabbit-1 rabbitmq:3.8 Here are the end of the logs 2021-05-23 11:14:30.499 [info] Running boot step direct_client defined by app rabbit 2021-05-23 11:14:30.500 [info] Resetting node maintenance status 2021-05-23 11:14:30.502 [info] Application rabbit started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.502 [info] Application cowlib started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.504 [info] Application cowboy started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.515 [info] Application rabbitmq_management_agent started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.566 [info] Application prometheus started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.568 [info] Application rabbitmq_web_dispatch started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.586 [info] Prometheus metrics: HTTP (non-TLS) listener started on port 15692 2021-05-23 11:14:30.586 [info] Application rabbitmq_prometheus started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.586 [info] Ready to start client connection listeners 2021-05-23 11:14:30.598 [info] started TCP listener on [::]:5672 completed with 3 plugins. 2021-05-23 11:14:31.784 [info] Server startup complete; 3 plugins started. * rabbitmq_prometheus * rabbitmq_web_dispatch * rabbitmq_management_agent 2021-05-23 11:14:31.787 [info] Resetting node maintenance status

[@OddBallTrails]

Good one. Thanks.

[@jekabskarklins]

07:00 I think you can still run rabbitMQ as deployment just create a service with the specified name and dirrect traffic to the pods in the deployment

[@MarcelDempers]

If you need replication setup, each pod needs to be individually addressable, so load balancing between multiple pods wont be sufficient for that need. This is why a headless service with a statefulset is used instead.

[@mariorios8827]

Thank you, clear and concise

[@hitkumar3748]

Very useful video,Thank you!!

[@rajendragosavi2233]

Subscribed.. amazing work

[@user-bf5sb1fs1w]

Thank you SO MUCH!!!

[@DharmicYoddha]

I didn’t know Arnold was a Dev Ops guy in parallel universe!

[@orestborovets2140]

Tapped like on 0:05 second durring intro. Great) Bro, the way that you provide the content is awesome and make me laugh. thousand likes please)

[@eliassal1]

Nice, useful and easy to understand video. I have a question, once consumer recieves a message from queue, queue is empty, so lets say during the day there were 1000 messages sent/received, how, from admin perspective I can see the history of messages and their details? Thanks in advance

[@TheRishith]

Great job, have gone through most of the videos, all are fantastic. Can you make a series of Tekton and Integare with argo CD

[@Hackenbaker]

Very cleary. Thank so mucho.

[@WomboBraker]

Man you are an absolute chad

[@mangeshgupta5677]

More power to you 💪

[@casquee]

Thanks a lot for sharing this!

[@leafaravlis7361]

thanks again!

[@phillip0renner]

Thank you. Great video.

[@amine250]

Very interesting, thanks marcel

[@ruixue6955]

7:43 RabbitMQ CLI 8:31 plugins 11:03 producer 14:05 put message into a queue

[@mzw8374]

Hello, What if we setup the rabbitmq on EC2 instance not with containerization (k8s) for serving all the microservices on kubernetes cluster, is it possible?

[@danielzarzeczny2800]

1:10 I believe that you mean HTTP not TCP, when you say about synchronous calls between services. TCP itself is asynchronous. Some higher-level protocols like HTTP, that rely on TCP make commnication synchronous, but not TCP itself. I just discovered your channel and I love it. You're doing a great work! Keep going :)

[@rogerthat_shorts]

Failed to establish message queue error I m getting....Any suggestions 🙏

[@ashrafbaig697]

Can you create queue type as Quorum and publish the image ? this is creating classic queue

[@rohitsolanki667]

I have two broker from different device and create queue when publish msg , So I want if i publish msg it will be retain and show in both broker subscribe . it will manage only configuration no use predefined queue because my msg will be published by device . so how can i achieve this replication of msg . i use client tool for subscribe is mqttbox . please give me solution 🙏

[@DatNguyen-ry1vr]

great work. Thank you!

[@zxc11118]

Awesome video! I copied the code, but had to rework the dockerfile and add the go.mod and go.sum files, and add the installation of the modules command (go mod download), because running like it was there, didn't work for me.

[@MarcelDempers]

Great stuff 💪🏽 Some of my guides are still using older versions of Go Do you mind submitting a PR?

[@zxc11118]

@@MarcelDempers Not all! 👍

[@elissar4158]

Thanks 🙏🏻🙏🏻🙏🏻 How can publish message to rabbitmq using django without celery can you help me please?

[@MarkDeibert]

What is the VS Code theme you're using? I wish VS Code would implement a feature that shows the theme name small at the bottom somewhere. Also, really great content my friend. Very clear and easy to follow instruction.

[@MarcelDempers]

Thanks for the kind words 🙏 I used to use "Amethyst Dark", Now I use "Reloaded Dark [Darker]"

[@shraddhapriya2395]

How can I connect to my organization rabbitmq ? In other words, How can I connect to a host other than localhost? Thanks in advance!

[@Chutchais]

Love it , thanks

[@somebodyyouusedtoknow8600]

he is the buffed programmer

[@nickwoodward819]

Harry Enfield running out of ideas XD Nice video

[@rakeshmali1727]

nice video.. one question though: at 7:00 you said hostname is required for `rabbitmq` instances to find and talk to each other. Why do multiple rabbitmq instances need to communicate? Isn't it that the other application services (producer and consumers) require communication with each other?

[@MarcelDempers]

In most software, to achieve high availability, the software runs multiple copies and forms a leader\worker topology, traditionally known as master/slave. They need to communicate in order to up hold high availability. Producers and consumers in message broker technology dont communicate with one another and talk to the queue itself, in this case, they talk to RabbitMQ

[@kcinosdev6642]

Very good and knowledgeable video, thanks but TOO MUCH ADS : four (4) so for.

[@amirshahidi2973]

excellent

[@mohamedhabas7391]

good work ma man

[@NiteshKumar-do4en]

Great fan again good video please argo as ci or workflows

[@13Macke37]

This is sooo great content. You have way too few subscribers.