Spin up Kafka Broker and Zookeeper on Docker

[@anl6777]

I'm saying it after a lot of try: It's still the easist way to spin up a healthy kafka server in 2023!

[@worldwide6626]

Is plaintext enough?

[@rsantamaria2309]

Thanks for all those explanations. You are excellent. And I like when you talk about « Listeners » that is also the way I prononce it in my head when I am writing. Thanks again.

[@erwinrommel5593]

How do you configure the topic inside your kafka could you show that

[@thedrunkencatlady]

Thank you so much for the simple tutorial!! ☺☺

[@hnasr]

🙏🙏

[@meliscolak1303]

thank you so much!

[@seriouslycurious]

My Kafka instance is unable to connect with zookeeper. tried machine name as well as localhost. Any other options ? Here is the error - [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) [main-SendThread(localhost:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket error occurred: localhost/127.0.0.1:2181: Connection refused

[@seriouslycurious]

adding --net host resolved the issue, was able to pass the IP from zookeeper's startup log

[@WMay116]

@@seriouslycurious I am having the same issue. can you post your full docker command please?

[@divyanshagarwal993]

I used the following commands: 1. For running zookeeper: docker run --net host --name zookeeper -p 2181:2181 zookeeper 2. For running kafka broker: docker run --net host --name kafka -p 9092:9092 -e KAFKA_ZOOKEEPER_CONNECT=localhost:2181 -e KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://localhost:9092 -e KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR=1 confluentinc/cp-kafka I don't get any errors when running the 2 containers and I used brokers: ['localhost:9092'] in my code. But still it doesn't work. It shows an error: "ERR refused connection to broker" something like that Can someone help?

[@lillllliiill-r3e]

@@divyanshagarwal993 change KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://localhost:9092 to. KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://YOUR_IP_ADDRESS:9092 because localhost refers to your host machine but since you are using docker, now it means localhost refers to your kafka container. Change localhost to your host machine's IP

[@leniedor733]

@@lillllliiill-r3e Nasty solution but works,it happened a few years to me xD An alternative for your ip (which is equivalent at your network context) --network="host"

[@onhazrat]

🎯 Key Takeaways for quick navigation: 00:01 🐘 To set up Zookeeper and Kafka in Docker, ensure you have Docker installed. 00:30 🚀 Use `docker run` to spin up a Zookeeper instance, provide a container name, and expose port 2181. 01:10 📡 For Kafka, expose port 9092, set environment variables for Zookeeper connection, and advertised listener. 03:25 💡 Kafka broker requires environment variables for Zookeeper connection and advertised listener. 07:48 🔄 Configure Kafka replication factor if running a single broker to avoid confusion. Made with HARPA AI

[@abusufiyanathani2393]

I am getting an error saying zookeeper audit is disabled, can anyone help me..

[@weitanglau162]

Great video! Can you also make a video on deployment on kubernetes as well?

[@PiyushKumar-od6ei]

Can one video happen using Docker Swarm?

[@tSobota]

Hi Hussein, thanks for your video :) How about one RPC stack video? Thrift or gRPC. How the hell it works internally? :D

[@hnasr]

Love it! gRPC is one of the most requested videos in the channel. Its coming

[@rahulkumarsingh1716]

I am getting an error while connecting kafka to zookeeper, it says connection refused.. What to do?

[@The-Cat]

me too it's frustrating.... have you found the solution after 4 months ?

[@jannielouwrens1210]

@@The-Cat Try starting both the zookeeper and the kafka containers with the --net=host switch, e.g. docker run --name zookeeper -p 2181:2181 --net=host zookeeper

[@faisalaleissa2012]

. Will not attempt to authenticate using SASL (unknown error)

[@oluwaseyisoremekun5729]

Add -net=host to the docker command that runs kafka

[@AhmadEzzeir]

Can we find web ui admin for it Thanks

[@AhmadEzzeir]

Basil S thanks