RabbitMQ : How to setup a RabbitMQ cluster - for beginners

[@bass9454]

Bro your channel is a revolution in tech youtubing!

[@arthuravila8489]

The content and the way that you explain is just amazing, mate! Keep doing the awesome job and help everyone around the world! Best Regards from Brazil!

[@Sylvadorr]

Came for rabbit, stayed for biceps. You are jacked af lol

[@easzyprogramming]

The beautiful part of your channel , the quality, the conciseness and the practicality to ones daily, task, You are truly a gift to the community, thank you so much

[@brainless3651]

Best video on the topic on youtube. Love from India

[@elva136]

Very detailed. I have a customer call tomorrow and this really helped!!

[@jocketf3083]

Thanks! Excellent introduction!

[@MohammedAbuObaid]

Excellent video! One of the most explanatory videos on RabbitMQ Clustering out there Thank you very much for the quality work

[@marloncastro3566]

hi. tomorrow, i will configurate a rabbitmq cluster with 4 nodes following your video.. great tutorial. awesome job. you are the best. i'm from Brazil too. kkkk

[@kamoliddinxojiyev3500]

I had never seen such an excellent tutorial before.

[@mariocortes2670]

This is the best RabbitMQ Clustering tutorial that I've seen. Thanks, great job.

[@michelvosje]

Very nice videos. I like the speed of explanation. It's all very clear.

[@rookie7413]

Thanks for doing these videos. These are fun to follow along with.

[@baselalyafi4022]

Congrats on this awesome video!

[@rahul170890]

Exactly what I was looking to understand RabbitMQ, waiting for more videos on RabbitMQ , Nice Triceps :D

[@generaljdripper]

Bro the rabbitmqctl reset was the missing piece for me. Thank you so much!

[@aravindraj8893]

Well this video does not feels like a beginners guide, rather it looks like a master guide. Great explanation and demo in every topic. Good work keep rocking….

[@arpanbanejee5143]

Simply awesome!! Very informative video, has explained each and every line of code he has written...

[@faizanvanekar7882]

The best explanation so far I have seen for RabbitMQ. If possible can u also explain the basics on how to install and configure the application as well as cover some admin topics like creating a queue, importing and exporting a queue, setting up a dead letter queue, how to republish a queue etc... Thanks in advance !!

[@godisren]

This is a such wonderful tutorial and let me understand how RabbitMQ cluster works in a very short time Thank you so much

[@alegon2007]

Hi, great content and great explenations. I have a question: in the video you showed what happend if rabbit1 goes down, but considering the sample app is pointing to rabbit1, then I supose that if app tries to publish a message after rabbit1 is down, it would have an error, so is it possible to have some type of loadbalancer/reverse proxy so that the app points to the LB to routes TCP connections to any available instance, instead of a specific rabbit node, so that any node failure would be transparent to the client app?

[@MarcelDempers]

Thanks for the kind words 💪🏽 Correct, for the clients you either need to use load balancing to enable clients to write to a single endpoint or have a client library capable of trying connections with a list of masters before sending requests and rotating them in case of failure

[@kausaralam2605]

Nicely explained and demonstrated, Thank You

[@w32crazydev]

You Sir saved me some precious time.. awesome work

[@jorgedutton8507]

Loads of thanks. Awesome explanation. Keep on with your good work. Cheers from Spain.

[@moongloomable]

Super helpful video series thank you!

[@amitkumdixit]

timeline 13:55, The message still persists. lets say we have 3 container cluster and if we push messages on Rabbit-3 we can see the messages in all the 3 RabbitMq wiz (1,2,3)also I can consume from any one of them without mirroring. Lets say I delete Rabbit-3. But I am able to consume the messages from Rabbit-1 or Rabbit-2. (RabbitMq 3.11) . Note Its without Mirroring

[@evans8245]

Thanks for the videos, they've been helpful. Please show us how to deploy these cloud toys in the future

[@maxinitin]

Why we need mirrored queue and queue federation ? Is mirrored queue not good enough?

[@fabrizziocht]

Great explanation thank you!

[@taraspelenio8259]

fine informative video published in the dramatic day

[@jamesward2946]

Brilliant video dude!! Quick question, if I have a producer and a consumer, can I connect them to any node in the cluster to produce and consume messages with mirroring set up? It doesn't have to be the master node?

[@gracehe9792]

Love this video, compact and informatic, and magically not biring at all. Hope I can get a project dev environ setup sorted soon.

[@bodrul52]

This video helped me a lot

[@FelipeRodrigues-lj1el]

Congratulations, thank you 😊 Best Regards from Brazil! [2]

[@kallikantzaros]

That ARM IS A UNIT!

[@eslammahfouz]

Amazing video, thank you.

[@kamoliddinxojiyev3500]

wow wow wow. it's amazing and very clear. this tutorial relly helps me. WOW

[@unitedKR]

Any detailed guides videos on Rabbitmq-cluster-operator using Helm Chart to AKS for internal services and getting UI portal access for admin management?

[@МаксимСлободянюк-н9о]

Thank you SO MUCH!!!

[@esaruhan]

Really great and applicable is so eazy, Thanks man! you are really do great job!

[@dm99a]

Brilliant video

[@XpLoeRe]

It seems like no container is listening on Port 5672 even though everything is set up correctly, only if I add another -p 5672:5672 on one of the containers im able to listen on it but the other two are not...any idea?

[@PP82]

Is this still applicable to the new Quorum Queues type that will replace the classic ones?

[@SudheerkumarK]

Thanks for the clustering information. I have a requirement where my consumer cannot accept list of IP addresses. So what should I do to always have a single cluster IP and to have a mechanism of identifying failover ? All my 3 nodes are running on RHEL

[@McKisiek]

Great video! Just wanted to ask why do you use federation plugin and "federation-upstream-set" policy? It seems to be working without this.

[@budi0580]

Very very helpful ❤️... Your demo using 1 docker instance, so all 3 rabbit instance in single machine. Can we have docker cluster of 3 nodes, and have rabbit instance in each docker node ?🙄

[@sunnykhetan]

Amazing content☮

[@antonyjohnsoni5483]

I have rabbitmq 3.7.28 erlang(22.3.4.1) and I try to setup a rabbitmq auto clustering add/remove AWS peer discovery plugin on AWS autoscaling groups and it's not working I can't able to find the solution do you have any video for that? If yes please share

[@satyaprakashchiramchetty6824]

Hi, If we are having 3 nodes, For example, Rabbitmq-1 Rabbitmq-2 Rabbitmq-3 So for clustering concept we are executing the below commands for joining the clusters in only 2 servers (Rabbitmq-2 and Rabbitmq-3), My question is why we are not executing this steps in Rabbitmq-1 server. Commands: rabbitmqctl stop_app rabbitmqctl reset rabbitmqctl join_cluster rabbitmq-1 rabbitmqctl start_app

[@JucianoC]

Your tutorials are the best. Could you do a tutorial like this for Cassandra clustering?

[@Sn-ik1qx]

Great explanation.

[@satriaadhikharisma4733]

Just saw your video and i learn much from this one about Clustering in RabbitMQ. I want to ask, is federation really needed for mirroring? in my case i setup the mirroring policy without federation, and message on a queue are still distributed on all nodes. Why use federation in the same cluster?

[@LAKSHMINARAYANA-qy2gr]

Hi Sir Have you done clustering on windows server or if you info related to clustering on windows servers please provide detailed clustering steps Thanks

[@eslamadel2291]

Amazing ,, many thanks ❤❤

[@77jaykb]

You are a legend mate. Love how clear and to the point this was ❤ PS: do you have the consumer app explained too somewhere?

[@vagifgafar2946]

many thanks for this excellent video !

[@rakeshmali1727]

AT 21:47 you enabled federation plugin for `rabbit-2` after running it again. but didn't do the same for `rabbit-1`. Is there something we missed? Also, should the fed. policy be set to `master` node only?

[@MarcelDempers]

I believe I may have already enabled the plugin in the configuration of all instances. So it may be unnecessary to enable it using the CLI. Id recommend enabling it in configuration so it persists restarts. I believe policies can be set on any instance as well and would propogate to others, would have to try it

[@rakeshmali1727]

@@MarcelDempers thanks.. I thought config file only contained details on peer discovery and node infos. thanks a lot.. learning a great deal from you!

[@Stanoweb]

As always your your videos are great :). thanks for your time. Just a question about the HA. Currently your Application (Producer as well as the consumer) use one endpoint, let's say rabbit-1. How do you manage/handle the "redirection" to the new master node if rabbit-1 gets down?

[@MarcelDempers]

Don't quote me on this, but I believe there are two ways. 1) use a client library in your app that handles this automatically provided you give all three endpoints. 2) some client libraries use broadcast to send to all three, the one that accepts it caches as the master. next failure it rebroadcasts to the next that accepts and uses that etc

[@ptireland]

I am able to join the 2nd node to the cluster, but the 3rd node crashes every single time. I am stuck and need help

[@kevintarango3736]

Is this currently applicable to use it whit MQTT on a windows OS I have tried MQTT mosquitto broker but I did not support my 25k devices network,could this clustering thing be an option for my network?

[@andrewp7497]

Thanks, nice video. Is this known as a quorum cluster then?

[@leafaravlis7361]

thanks dude!

[@zeinabghaffarnasab8157]

Hi... Thanks for the great tutorial.. I have a problem with clustering 3 nodes... I have three machines that are connected this way: 123 I mean in my network I have node1 connected to node2 and node2 connected to node3. And node1 and node3 are connected only through node2 to each other. If I try to cluster them I connect node1 to node2 and node3 to node2 they are connected but I cannot start all of them at the same time. If I start node3, the node1 will not start and if I start the node1 the node3 will not start.. What should I do to solve this issue?

[@MarcelDempers]

I would recommend to ensure all nodes can resolve each other and connect to each other as per clustering requirement doc. It does not seem feasible to have two nodes connected by a single point of failure. www.rabbitmq.com/clustering.html#cluster-formation-requirements

[@Jakub1989YTb]

How would I run these nodes on a different hardware in a different locations (same network)? To be more safe in case of blackout in one location? But I guess that is more of a docker question. I'm planning to use the rabbit in our company and I would like to have at least 3 nodes running, each on a server in a different office.

[@joeabala2037]

I have two droplets each running rmq on docker but i cannot seem to connect to either - Could not auto-cluster with node rabbit@rabbit2: {badrpc,nodedown}. I have included rabbit2 privateip in /etc/hosts file i.e 10.10.10.10 rabbit2. Kindly assist.

[@OguzhanlaAlmanya]

Hi! Thanks for the video. I have a question. What is RabbitMQ throughput limitation to Elasticsearch Server? for example, number and/or size of messages for in a second. thx!

[@MarcelDempers]

I don't believe there is a limitation, this depends how many consumers you run and how much CPU you allocate to each consumer

[@OguzhanlaAlmanya]

@@MarcelDempers thx

[@vtvvnha2230]

awesome video

[@vagifgafar2946]

Are the messages distributed equally among cluster instances? Will they disappear if one of the instances dies?

[@dunk14me]

If your rabbit-1 instance dies and rabbit-2 gets promoted to master, what will happen to your publisher app that is writing to rabbit-1?

[@ahmadooof]

That's super greate keep going

[@BeaulieuTodd]

Excellent

[@Yessenai]

Thank u for you videos. You rock

[@LindaLawton]

I have a rabbit queue which could potentially contain more than 50k am I correct in assuming that I should be using clusters?

[@pedro-br1mo]

When I run the auto clustering commands the nodes are not joining the cluster, I'm only able to do this with the manual instructions. Any help? :/

[@pedro-br1mo]

Fixed it, for some reason nodes were stopping after running the commands also be careful in which dir you run the commands :) (i'm talking about the config files of course)

[@itmemo8617]

I'm the 299 liker , amazing video ! thank you for sharing those tones on info ! really appreciate it

[@DeveloperTharun]

Thank you.. Amazing content.. Keep going!

[@jeremybalagtas3817]

This is great man! In this video you showed how clustering was done via rabbitmqctl. In my case, I have a cluster deployed in EC2 instances all of which are under an AutoScaling Group. My struggle is that, if the ASG added a new instance, it doesn't automatically join the cluster. We have to basically, ssh to the instance -> stop rabbitmq -> join cluster -> start rabbitmq. I do have the plugin enabled (rabbit_peer_discovery_aws) and set the config (rabbitmq.conf). Am I missing something?

[@MarcelDempers]

I believe you might either be missing something small or there may be an error somewhere when its trying to establish connection. I'd suggest to carefully run through those docs and see if you've missed anything. Also try to dig deeper and see if there are any logs that may point to something like invalid cred\firewall rule blocking a port etc. All else fails, maybe checkout existing closed issues here to get more clues github.com/rabbitmq/rabbitmq-peer-discovery-aws

[@guyweatherall232]

Really useful but could do with a refresh eg Quorum Queues

[@tittukurikesu55]

Can you do a video on how to setup rabbitmq cluster in azure windows vm. I tried but the host name resolution is not working

[@satyamchauhan1428]

Hello sir need a video to setup a 3node of vernemq cluster.

[@hcgaron]

Freakin amazing!

[@andreano81]

Why do you specify federation policy for mirrored queue within one cluster? Federation plugin is not intended for such usecase.

[@angelakarapetyan586]

amazing

[@endpsbr]

great content!

[@ralphverboekendify]

Great video, but how does this work using Windows machines (not running in a container), i mean how do you use the same cookie on multiple machines? Simply edit the cookie or copy doesn't work. Thnx!

[@ralphverboekendify]

Found it: .erlang.cookie file is found in two directories; %homedir% and %systemprofile% directory. Both cookie files must be replaced by cookie file from the first server in cluster. Then you can succesfully join the cluster.

[@LAKSHMINARAYANA-qy2gr]

Hi Sir@@ralphverboekendify I am new to this , have requirement of clustering on windows os , can you please help in detailed clustering steps. installed the rabbit mq on all nodes but having confusion on further steps Thanks

[@TheBRYANT32]

Nice tutorial! tnahq

[@Icecrax]

Having a strange problem currently: Running this command: docker run -d --rm --net rabbits -v ${pwd}/config/rabbit-1/:/config/ -e RABBITMQ_CONFIG_FILE=/config/rabbitmq -e RABBIT MQ_ERLANG_COOKIE=WIWVHCDTCIUAWANLMQAW --hostname rabbit-1 --name rabbit-1 -p 8081:15672 rabbitmq:3.8-management returns an image hash but does not start a container! Any idea why? I think it has to do with the RABBITMQ_CONFIG_FILE

[@martonlorand]

did you solve this ? I a have the same problem and I see in the logs that somehow config file(s) : /config/rabbitmq.config (not found)

[@Icecrax]

@@martonlorand Hi, unfortunately it was an year ago and I don’t remember any more how I solved it. Maybe try chatGPT for an answer :P

[@PavanAndhukuri]

Amazing..

[@程舟-s7x]

It is the best video for know rabbitmq ，could you pls slow the words speed, a little fast 😂

[@marttiinnanen4911]

All the most important steps were skipped like how to configure TLS for management, AMQP, CLI and inter-node traffic.

[@RajeshGoyalg]

Thanks for amazing video on RMQ. I am getting following error on setting policy root@rabbit-1:/# rabbitmqctl set_policy ha-fed ".*" '{"federation-upstream-set":"all", "ha-mode":"nodes", "ha-params":["rabbit@rabbit-1","rabbit@rabbit-2","rabbit@rabbit-3"]}' --priority 1 --apply-to queues Error: Validation failed [{,}] are not recognised policy settings

[@RajeshGoyalg]

Ah, I forgot to enable federation docker exec -it rabbit-1 rabbitmq-plugins enable rabbitmq_federation

[@hippolyteasah4341]

I am getting same error. Have you been able to fix it?

[@hippolyteasah4341]

Error: Validation failed [{,}] are not recognised policy settings

[@hippolyteasah4341]

enable federation and this will go away. rabbitmq-plugins enable rabbitmq_federation

[@JeromyDankerS]

Thompson Daniel Hall Lisa Rodriguez Joseph

[@KofikaJahan]

Clark Sharon Lopez Donald Jackson Margaret

[@synnnx]

outdated

[@fadygamilmahrousmasoud5863]

why you just give us a course on microservices in go and kubernetes, you are so gifted i really want to learn microservices from you in a comprehensive course

[@VannaraLoch]

Super clear explanation. Thank you 🙏