RabbitMQ : Message Queues for beginners

Subscribe to show your support! goo.gl/1Ty1Q2 .
Patreon 👉🏽 / marceldempers
Folks! Today we'll be taking a look at Message Queues, what they are, why you may want to use a message queue, and how RabbitMQ helps offer message broker functionality.
In this video, we take a look at the basics, how to run RabbitMQ, some of the features.
We will also build and application that produces messages in a queue, and another that consumes the messages.
Checkout the source code below and follow along :)
In an upcoming video, we'll cover HA and replication so be sure to stay tuned for that!
We'll also learn how to run all of this on Kubernetes.
Also if you want to support the channel further, become a member 😎
marceldempers....
Checkout "That DevOps Community" too
marceldempers....
Source Code
--------------------------------------------------------------
github.com/mar...
If you are new to Kubernetes, check out my getting started playlist on Kubernetes below :)
Kubernetes Guide for Beginners:
---------------------------------------------------
• Kubernetes development...
Kubernetes Monitoring Guide:
-----------------------------------------------
• Kubernetes Monitoring ...
Kubernetes Secret Management Guide:
--------------------------------------------------------------
• Kubernetes Secret Mana...
Like and Subscribe for more :)
Follow me on socials!
marceldempers.dev
Twitter | / marceldempers
GitHub | github.com/mar...
Facebook | thatdevop...
LinkedIn | / marceldempers
Instagram | / thatdevopsguy
Music:
Track: INOSSI - Sunset Eyes (Free download) | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / sunset-eyes-free-download
Track: LiQWYD - Bridges (Free download) | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / bridges-free-download
Track: Amine Maxwell - Le Soir | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / le-soir
Track: souKo - souKo - Parallel | is licensed under a Creative Commons Attribution licence (creativecommon...)
Listen: / parallel

[@MarcelDempers]

Rabbit MQ : High Availability and Replication 👉🏽kzbin.info/www/bejne/fKvUm6eLZ91pj6M

[@Techtips200]

Very nice video...small Query wrt Rabbitmq Linux vulnerability on default port 5672..how to remove this vulnerability...change the port or firewalld rules?

[@crimzin2180]

Hi Bud, Thank you for the great videos. I need to set up a high availability RabbitMQ with 3 nodes and then need to have a load balancer like nginx or haproxy for it. I am trying nginx but I don't know how to make the connections persistent. Do you have any info or exaples for that?

[@MarcelDempers]

@@crimzin2180 I dont have much experience in that area especially the persistence. I would think that your client would establish a connection which would remain open whilst subscribing to the queue. HA or NGINX would have that connection open to an upstream until the client closes the connection. Here is an example book showing a basic HA proxy config with Rabbit livebook.manning.com/book/rabbitmq-in-action/chapter-6/35

[@gosnooky]

Love your tutorials! You also look like you could bench press a node_modules folder.

[@dadurex]

XDDDDDD

[@hiwijaya]

LoL

[@smooth8580]

lmaoo

[@DigsWigs2022]

Lol

[@danielarledge7017]

I'm transitioning from a senior system admin position to a devops position in my company and I can't tell you how valuable your content is to me. Best Devops channel on youtube.

[@bebebewin]

go heels

[@lashlarue7924]

Bro, I subscribed within the first 2 minutes, never having seen or heard of you before, you're the man.

[@robbiealixsantos]

Very cool, thank you for this!! Your video was very easy to understand and follow BTW if anyone is running into the message "Stats in management UI are disabled on this node" when accessing the Management dashboard, use the following command when starting up the RabbitMQ container: docker run -d --rm --net rabbits -p 8080:15672 --hostname rabbit-1 --name rabbit-1 rabbitmq:3-management The reason is that the default image disables metrics collector in the management_agent plugin

[@willypi3641]

I was some troubles understanding the message queue logic until I watched this video. Thanks a lot man, greeting from Mexico.

[@ezrichie2006]

I came here for more understanding for rabbit, and ended up seeing a GO app in action :D very nice!

[@dialecticalmonist3405]

I don't understand any of this, but I can tell that if I watch it more carefully and several more times, I would get it eventually. You explained it so thoroughly and clearly that I subscribed to your channel.

[@MarcelDempers]

Glad you enjoyed it. Feel free to checkout my community page for the Discord server. Friendly folks happy to answer questions you may have 💪🏽👊🏽

[@sm5172]

Excellent video, thank you for going straight to the point and even editing out all the pauses! I came for RabbitMQ but I'm staying for more Go and Kubernetes.

[@jerweiyeoh7096]

Just wanna thank you for the great videos and content! Trying to get into DevOps myself and it has been a struggle, and your videos has always been helpful in understanding some concepts I struggle with. Always excited for your content as it explains modern tech in an understandable format. Appreciate it and keep up the good work!

[@MarcelDempers]

Thanks so much 💪🏽Good luck out there. My advice: Build up a good understanding of using Linux, learn docker, use docker to run everything (like i do in all my videos) It will powerlevel and fast track your learning especially when running open source stuff locally. Learn the basics of Kubernetes. Try apply your docker learning, to K8s. Then learn how to run it locally on Kubernetes. Create trial AWS\Azure account, try running kubernetes in the cloud. This will give you a good foothold and foundation to build on.

[@briantoner2215]

That's probably one of the best and most coherent technical presentations I have seen on youtube!

[@nicknick65]

wow man, very nicely done. Ive just finished learning Go and now getting into RabbitMQ and Kafka. Your docker stuff was brilliant. Learnt heaps. Just subscribed.

[@MarcelDempers]

🙏🏽

[@watherby29]

Best tutorials I ever watched. Explaining what counts and not going into what does not matter. Also I like that it is a little fast paced (at least for me). Kindly make more of this gold :) Thanks

[@Faustetheus]

This camera format always has me expecting him to drop a freestyle

[@TheAfreitag]

You saved my bacon here, need to set up a rabbitmq cluster so this in combination with your next video are really helping me out!

[@divanselev4413]

No only squat, deadlift too) thank you for your work!

[@PrakashReddyK]

Marcel , Good Morning :) ( for me ). Thanks Very much for wonderful content. I am more visible kind of guy , cant thank you enough for explaining clearly about architecture on a white board. I have learned a lot from your videos.

[@1piece_forever]

I think you should definitely know that, you are doing a great great work for the community. Thank you. And please keep doing.

[@MarcelDempers]

Thanks so much! this means a lot 💪🏽

[@BennyWalnuts]

The arms on this guy. I feel compelled to trust his instruction.

[@minhthinhhuynhle9103]

I decided to register for membership after watching fewer than 10 of your videos :)) Can't wait until I become a real DevOps Engineer. Imma upgrade my Level then :)))

[@MarcelDempers]

🙏🏽

[@НиколайСладкий-н4к]

The best video about RabbitMQ ever! Thank's a lot!

[@manpt123]

One of the best youtuber for Golang community

[@thomasmcewen2840]

SUPER high quality video! Thanks Marcel!

[@decepticoon]

Truly love your channel. You're a great teacher and I love the way you present information! Keep making great videos please :)

[@OddBallTrails]

Hey man, I love you. Thanks for all your videos. ❤️💙💜

[@buckfush187]

Yes man your channel is really underrated

[@Easyjeevan]

You are really doing great work man for everyone. Great stuff, easy explanation, demos are always awesome. Thanks and keep doing great work.

[@g3ar75]

Great video Marcel, one thing I didn't understand was how you passed the Ack false as the consumer, also isn't the queue supposed to retain a message when it doesn't receive an Ack?

[@phils8215]

Very concise, very well explained. Your pace is excellent to follow!

[@devopssimon]

Hi Marcel. When I run the rabbitmq docker container and look at the logs it seems to start in maintenance mode and when I look at the web management I see the node name, but I don't see any of the node status information, like file descriptors, memory or disk space etc. I used the following command to start the container docker run -d --rm --net rabbits -p 8090:15672 --hostname rabbit-1 --name rabbit-1 rabbitmq:3.8 Here are the end of the logs 2021-05-23 11:14:30.499 [info] Running boot step direct_client defined by app rabbit 2021-05-23 11:14:30.500 [info] Resetting node maintenance status 2021-05-23 11:14:30.502 [info] Application rabbit started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.502 [info] Application cowlib started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.504 [info] Application cowboy started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.515 [info] Application rabbitmq_management_agent started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.566 [info] Application prometheus started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.568 [info] Application rabbitmq_web_dispatch started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.586 [info] Prometheus metrics: HTTP (non-TLS) listener started on port 15692 2021-05-23 11:14:30.586 [info] Application rabbitmq_prometheus started on node 'rabbit@rabbit-1' 2021-05-23 11:14:30.586 [info] Ready to start client connection listeners 2021-05-23 11:14:30.598 [info] started TCP listener on [::]:5672 completed with 3 plugins. 2021-05-23 11:14:31.784 [info] Server startup complete; 3 plugins started. * rabbitmq_prometheus * rabbitmq_web_dispatch * rabbitmq_management_agent 2021-05-23 11:14:31.787 [info] Resetting node maintenance status

[@dufferzzzzz]

Helped me so much! Thank you :) All the content on your channel is fantastic. Thanks for the great work

[@DavidChandra]

I love your tutorial. Subscribed.

[@kenchang3456]

I agree with @Ray Statham, very nice easy intro to Rabbit MQ. Thank you very much.

[@cheunhong9769]

Love you work, would like to see you cover about Apache Kafka next time.

[@nathiToto22]

I’m here for this topic 😃, really looking forward to more thank you for this.

[@torbendury4374]

Absolutely underrated channel. Besides beginner videos, are you also planning some deep dives?

[@tangseakmeng599]

This is a brilliant tutorial.

[@zenobikraweznick]

Just discovered your channel, it's amazing, thank you!

[@MarcelDempers]

🙏🏼

[@deanprickle5394]

It was kinda hard to keep my eyes off your triceps XD...Excellent Video btw...cleared my doubts 🧡

[@MohammadSikt]

How one can consume some messages, not acknowledge them immediately, close the channel/connection, and later on, in a new process acknowledge a few selected consumed message? The selection is based on some side processes on the consumed messages.

[@orestborovets2140]

Tapped like on 0:05 second durring intro. Great) Bro, the way that you provide the content is awesome and make me laugh. thousand likes please)

[@eclipsetutorialvideo]

Great intro to using RabbitMQ in Docker, it is a bit confusing the consumer part with loops consuming but you need to learn Go language. Otherwise it was easy to follow. Thanks, could you show us the RPC pattern :)

[@youtubechanel-l1q]

really great tutorial that I looking for. thanks best grads.

[@esc-sh]

This is a great intro to RabbitMQ

[@RayStatham]

Really nice walk through there Marcel :)

[@eliassal1]

Nice, useful and easy to understand video. I have a question, once consumer recieves a message from queue, queue is empty, so lets say during the day there were 1000 messages sent/received, how, from admin perspective I can see the history of messages and their details? Thanks in advance

[@hzrq]

Many thanks for the video! Worth the 22 minutes!

[@RaabStephan]

Love that VSCode theme!

[@bharatsinghtanwar5963]

Hey man, you are the best.

[@cloudbrothers]

This is a great video. It's inspiring. Thanks for the content!

[@giancarlotupacgutierrez6210]

Excellent vídeo folk!

[@faizanvanekar7882]

Awesome Explanation !!! Looking forward for some administration video on the same. Thanks !! Great work !!

[@zakariabouataya7248]

Super interesting content, Thank you

[@SodiqOlaniyi]

Respect 🖖.

[@itier]

Maybe an refresh of the series rabbit on kubernetes with rabbitmq/cluster-operator? It's an game changer on how things (could) work ...

[@davidecortese8276]

Thank you!!! Great video and amazing explanation!

[@mzw8374]

Hello, What if we setup the rabbitmq on EC2 instance not with containerization (k8s) for serving all the microservices on kubernetes cluster, is it possible?

[@MrVnelis]

Your videos are awesome and really useful! Thanks so much for this excellent work!

[@jekabskarklins]

07:00 I think you can still run rabbitMQ as deployment just create a service with the specified name and dirrect traffic to the pods in the deployment

[@MarcelDempers]

If you need replication setup, each pod needs to be individually addressable, so load balancing between multiple pods wont be sufficient for that need. This is why a headless service with a statefulset is used instead.

[@mangeshgupta5677]

More power to you 💪

[@MrPro1004fun]

Thanks a lot for this fantastic video!!!

[@MarkDeibert]

What is the VS Code theme you're using? I wish VS Code would implement a feature that shows the theme name small at the bottom somewhere. Also, really great content my friend. Very clear and easy to follow instruction.

[@MarcelDempers]

Thanks for the kind words 🙏 I used to use "Amethyst Dark", Now I use "Reloaded Dark [Darker]"

[@rololop34]

great video

[@WomboBraker]

Man you are an absolute chad

[@DigsWigs2022]

Best. Thank you

[@elissar4158]

Thanks 🙏🏻🙏🏻🙏🏻 How can publish message to rabbitmq using django without celery can you help me please?

[@Su2509]

Thank you so much

[@alexdan3457]

Awesome video! Very helpful. Thanks

[@danielzarzeczny2800]

1:10 I believe that you mean HTTP not TCP, when you say about synchronous calls between services. TCP itself is asynchronous. Some higher-level protocols like HTTP, that rely on TCP make commnication synchronous, but not TCP itself. I just discovered your channel and I love it. You're doing a great work! Keep going :)

[@zxc11118]

Awesome video! I copied the code, but had to rework the dockerfile and add the go.mod and go.sum files, and add the installation of the modules command (go mod download), because running like it was there, didn't work for me.

[@MarcelDempers]

Great stuff 💪🏽 Some of my guides are still using older versions of Go Do you mind submitting a PR?

[@zxc11118]

@@MarcelDempers Not all! 👍

[@TheRishith]

Great job, have gone through most of the videos, all are fantastic. Can you make a series of Tekton and Integare with argo CD

[@rogerthat_shorts]

Failed to establish message queue error I m getting....Any suggestions 🙏

[@ashrafbaig697]

Can you create queue type as Quorum and publish the image ? this is creating classic queue

[@rajendragosavi2233]

Subscribed.. amazing work

[@rohitsolanki667]

I have two broker from different device and create queue when publish msg , So I want if i publish msg it will be retain and show in both broker subscribe . it will manage only configuration no use predefined queue because my msg will be published by device . so how can i achieve this replication of msg . i use client tool for subscribe is mqttbox . please give me solution 🙏

[@mohammadkhazaei_y]

thank you explain it very well

[@mariorios8827]

Thank you, clear and concise

[@МаксимСлободянюк-н9о]

Thank you SO MUCH!!!

[@shraddhapriya2395]

How can I connect to my organization rabbitmq ? In other words, How can I connect to a host other than localhost? Thanks in advance!

[@gogle-zero]

very clear thanks !

[@rakeshmali1727]

nice video.. one question though: at 7:00 you said hostname is required for `rabbitmq` instances to find and talk to each other. Why do multiple rabbitmq instances need to communicate? Isn't it that the other application services (producer and consumers) require communication with each other?

[@MarcelDempers]

In most software, to achieve high availability, the software runs multiple copies and forms a leader\worker topology, traditionally known as master/slave. They need to communicate in order to up hold high availability. Producers and consumers in message broker technology dont communicate with one another and talk to the queue itself, in this case, they talk to RabbitMQ

[@hitkumar3748]

Very useful video,Thank you!!

[@ruixue6955]

7:43 RabbitMQ CLI 8:31 plugins 11:03 producer 14:05 put message into a queue

[@OddBallTrails]

Good one. Thanks.

[@DharmicYoddha]

I didn’t know Arnold was a Dev Ops guy in parallel universe!

[@Hackenbaker]

Very cleary. Thank so mucho.

[@mohamedhabas7391]

good work ma man

[@casquee]

Thanks a lot for sharing this!

[@hn3m3s1s]

thank you! random question: would you mind sharing how you make your commandline arguments/options in grey? that's pretty nice!

[@MarcelDempers]

I have no idea to be honest 😀 I believe this may just be a VSCode theme that does it

[@hn3m3s1s]

@@MarcelDempers You don't have this in your normal terminal? only in VSCode? That's pretty nite tho!

[@amine250]

Very interesting, thanks marcel

[@leafaravlis7361]

thanks again!

[@13Macke37]

This is sooo great content. You have way too few subscribers.

[@nickwoodward819]

Harry Enfield running out of ideas XD Nice video

[@somebodyyouusedtoknow8600]

he is the buffed programmer

[@kevintarango3736]

Hi bro, First of all thanks for making this helpful video, I have a problem, when I get in to the local host my dashboard is so different in front of the dashboard you get in the video, I have been reading about it and I have found that I could be something about the node configuration but I did everything as you did, can you give an advice? And thanks again bro

[@MarcelDempers]

Not quite sure about this one. The configuration is pretty lean so unsure if its config related. Wondering if the management plugin on that container image has changed perhaps ?

[@phillip0renner]

Thank you. Great video.

[@Chutchais]

Love it , thanks

[@benripka6977]

Maaan so good

[@DatNguyen-ry1vr]

great work. Thank you!

[@NiteshKumar-do4en]

Great fan again good video please argo as ci or workflows