What is Kafka | Tutorial | Beginners Guide

  Рет қаралды 21,223

That DevOps Guy

That DevOps Guy

Күн бұрын

Пікірлер: 78
@vatsalbalde
@vatsalbalde 3 жыл бұрын
On my weekends i keep on binge watching your videos.They are so well constructed and informative
@pallavkanaujiya
@pallavkanaujiya 3 жыл бұрын
You are putting best effort to explain and provide us the clean and working code. Thanks a lot for all your help and explanations.
@manedurphy
@manedurphy 3 жыл бұрын
I just hopped on to youtube to learn about Kafka and this was in my notifications. Perfect timing!
@georgelza
@georgelza 3 жыл бұрын
Non the less... one of the best examples of how to stand up a Kafka cluster on a laptop that I've seen, thanks Marcel.
@nikhildogra7706
@nikhildogra7706 3 жыл бұрын
Following all your tutorials thanks so much,waiting for video on keycloak
@nicotarquini
@nicotarquini Ай бұрын
Thank you Marcel for all explications!! Excellent tutorial I'm going to test it! Greeting from Argentina
@kenchang3456
@kenchang3456 3 жыл бұрын
I recall you've talked about docker and I think kafka before but I'm so glad you've decided to revisit these two great tools. Thank you very much!
@gompro
@gompro 3 жыл бұрын
Kind of video I’ve been waiting for. Great!
@georgelza
@georgelza 3 жыл бұрын
... would be great if at the 15:52 mark you included the -v to mount a volume on host into the container to store the kafka data files, aka making them persistent. easy enough to do... but all might not know how.
@rakavana8383
@rakavana8383 3 жыл бұрын
Hi, 14:14 , i am facing issue with starting a zookeeper instance. It is not showed up when i run docker ps command. Follwed the same instruction set as specified your get repo. Please help. thanks.
@MarcelDempers
@MarcelDempers 3 жыл бұрын
Instead of docker run -d , use -it for an interactive terminal which will display a log with the reason for failure
@deepakdagar_change_is_in
@deepakdagar_change_is_in 3 жыл бұрын
@@MarcelDempers yes me too... it gives :invalid option github.com/overhangio/tutor/issues/31
@deepakdagar_change_is_in
@deepakdagar_change_is_in 3 жыл бұрын
Please suggest, if you resolved it. Seems like something to do with mounting of volumes in docker
@pereirabrian
@pereirabrian 2 жыл бұрын
@@deepakdagar_change_is_inI also got : invalid option. This is a Windows problem. The To fix it, use Notepad++ to open the dockerfile. In the Notepad++ menu do this. Edit -> EOL conversion -> Unix LF. Then run all the commands. This solves it. Repeat for script files and property files if required.
@pedro-br1mo
@pedro-br1mo 2 жыл бұрын
@@pereirabrian Thanks!! That solved it!
@mohammadtalep9913
@mohammadtalep9913 2 жыл бұрын
Great work. Thanks for the sharing
@RenierBotha-nl1kv
@RenierBotha-nl1kv Жыл бұрын
This was an excellent intro to Kafka! Well done and keep it up
@diljithm.d234
@diljithm.d234 3 жыл бұрын
Been waiting for an easy Kafka tutorial for understanding. Thank you!! Please do a video on how to setup Apacha Solr and Zookeeper.
@bimasion6750
@bimasion6750 2 жыл бұрын
I found u very informative sir, thank you so much
@karlovasiradio
@karlovasiradio 3 жыл бұрын
I'd like to watch a video about Zookeeper explanation.
@georgelza
@georgelza 3 жыл бұрын
ditto... even though confluent is working on getting rid of Zookeeper, there is still loads of other technologies thats dependant on it. G
@costa2016
@costa2016 3 жыл бұрын
That was pure gold! Thanks for sharing your knowledge!
@Series0Tubes
@Series0Tubes Жыл бұрын
Thank you good sir. Very nice work.
@Fayaz-Rehman
@Fayaz-Rehman 3 жыл бұрын
Great - Could you also make a video - how to run kafka on kubernetes. Thanks
@Aju-G
@Aju-G 3 жыл бұрын
Waiting over❤
@musclecode
@musclecode 3 жыл бұрын
Awesome as always 💪
@atulchahande4966
@atulchahande4966 3 жыл бұрын
waiting for next video
@benalexander9583
@benalexander9583 3 жыл бұрын
Just wanted to say keep up the great work man. Your videos have been a great help in my education/career
@kevinyu9934
@kevinyu9934 3 жыл бұрын
Very helpful. I'd like to see more videos about more real-life application built with Kafka! Keep going man!!!
@s3999
@s3999 2 жыл бұрын
Top quality content... as always!
@daesvideo
@daesvideo 2 жыл бұрын
Hi, excelent tutorial, but I get an error when tring to run docker and can not run the container, the error is: invalid option | /bin/bash: - . Help me please, Thank you very much!.
@SaiPravesh
@SaiPravesh 3 жыл бұрын
Great video, your channel is really under rated your work is amazing...
@TheAll-AroundAficionado
@TheAll-AroundAficionado 3 жыл бұрын
I'd like to see a future video on Zookeeper please.
@azamatabdullaev4580
@azamatabdullaev4580 3 жыл бұрын
Very useful!
@assaduzzaman_dsi
@assaduzzaman_dsi 3 жыл бұрын
Nice and excellent video. It is my humble request if you add a video for multiple zookeeper instances and a question do you have any plans for do the same on kubernetes?
@MarcelDempers
@MarcelDempers 3 жыл бұрын
This is the first level 💪🏽 The final boss is Kubernetes 🤓
@ganpatraoapte9034
@ganpatraoapte9034 3 жыл бұрын
Great video Would like one on zookeeper, thanks
@rksingh4965
@rksingh4965 2 жыл бұрын
Your videos are awesome👍👍👍....which tool do you use as editor for creation dockerfile
@MarcelDempers
@MarcelDempers 2 жыл бұрын
vscode 😎💪🏽
@CeezGeez
@CeezGeez 3 жыл бұрын
11:50 - I wouldn't actually mind a follow-up video with a deep dive on Zoo Keeper
@christianherrera9524
@christianherrera9524 3 жыл бұрын
Great video 👍
@georgelza
@georgelza 3 жыл бұрын
love it... but would have been great if you rather used confluent kafka, as there is loads of extra capability that people want... eventually, instead of the bare bones public drop.
@a_k__
@a_k__ 3 жыл бұрын
This is great! Keep up the good work!
@exit-zero
@exit-zero 3 жыл бұрын
Great stuff!
@rogerkaskar5399
@rogerkaskar5399 3 жыл бұрын
This is great thank you! Would you be able to do a HA Kafka with 3 Kafka nodes and 3 Zookeeper nodes in a Kubernetes cluster?
@MarcelDempers
@MarcelDempers 3 жыл бұрын
Of course 💪🏽 That is the final boss. This is level 1. We'll get there 😎
@nathan_falkon36
@nathan_falkon36 Жыл бұрын
you are the real mvp
@Gigabyteserviceofficial
@Gigabyteserviceofficial 3 жыл бұрын
Please create a video about HAproxy & sticky session
@leniedor733
@leniedor733 2 жыл бұрын
Would you upload a video with kafka 3.x version? The reason is just because Zookeeper is no longer in use and is set depricated in this new version. Thanks
@manishalankala1622
@manishalankala1622 3 жыл бұрын
Great work , i would also like if this can be achieved via (aks,gke,eks) via terraform
@marklong6572
@marklong6572 3 жыл бұрын
It will be nice to see how we can deploy Kafka on a k8s cluster.
@AshishKumar-ft6wv
@AshishKumar-ft6wv 2 жыл бұрын
your are G.O.A.T.
@shyiramberejoseph9406
@shyiramberejoseph9406 3 жыл бұрын
Hello, Could you work on file management in kubernetes such as uploaded files and database?
@weitanglau162
@weitanglau162 3 жыл бұрын
Will you be making a video with KIP500 (v2.8) features in the future? This removes the need for zookeeper! I think it will be interesting!
@anton20002
@anton20002 Жыл бұрын
Respect 💪
@rajdeeppal2375
@rajdeeppal2375 Жыл бұрын
Hi @devopsguy . Your videos are awesome . Just a request could you make videos on cloud functions ( lambda / azure functions / Google cloud functions ) . Like with the entire folder structure and the use cases . It will be really helpful bro
3 жыл бұрын
You rock!
@a_k__
@a_k__ 3 жыл бұрын
Can you make a video about elasticsearch?
@banul1449
@banul1449 2 жыл бұрын
I'm sorry but i dont understand something. When i stopped the broker container witch stored the topic's message, after launching it back up, the message was still there. I thought that after stopping container this data would be lost, so where it is preserved?
@banul1449
@banul1449 2 жыл бұрын
oh, its all stored in data folder, logs also so that's the answer, so we didnt need to search for topics messages inside the containsers, we could also look in our 'local' data folder
@evans8245
@evans8245 3 жыл бұрын
skip to 0:00, that's where the GNAWWWLIDGE starts
@GerhardGrasberger
@GerhardGrasberger 3 жыл бұрын
very helpful video, thank you so much! where can i get this ultra cool t-shirt? ;-)
@MarcelDempers
@MarcelDempers 3 жыл бұрын
Merch soon 💪🏽
@juniordevmedia
@juniordevmedia 3 жыл бұрын
Doesn't Kafka work without ZooKeeper now? or maybe i am mistaken. Thanks for the tutorial ❤️
@MarcelDempers
@MarcelDempers 3 жыл бұрын
I've seen an article about it but I believe it's still on the roadmap 💪🏽
@vladoportos
@vladoportos 3 жыл бұрын
Looks like MQTT, but its a java application ? Not to keen on Java apps ( personal experience in corp tought me that java is like Unity engine in game world, easy to start with but tends to die under heavy utilization )
@MarcelDempers
@MarcelDempers 3 жыл бұрын
Kafka is a beast under heavy utilization :) 💪🏽
@yasirkaram
@yasirkaram 3 жыл бұрын
How does Kafka messaging different from Axon or RabbitMQ in the CQRS world?
@MarcelDempers
@MarcelDempers 3 жыл бұрын
Kafka is more of an event streaming system where Rabbit is a pure message queue. With Rabbit, 1 consumer gets the message, with Kafka, all consumers get a copy of the message. Messages can also be re-consumed\streamed with Kafka. With Rabbit once a message is consumed, its gone.
@napstablook25
@napstablook25 2 жыл бұрын
Followed the tutorial. I got Timed-out error while creating the topic. Used kafka version 3.1.0
@napstablook25
@napstablook25 2 жыл бұрын
the issue is the create topic command. the option "zookeeper" is deprecated. You need to use --bootstrap-server and point it to "kafka-1:9092,kafka-2:9092,kafka-3:9092"
@diegrootam
@diegrootam 3 жыл бұрын
Esse homi tá pegando quanto no supino? A cada vídeo, +5cm de braço. Hurra, conta o segredo aí. By the way, excellent video. Congrats
@plopp.
@plopp. 3 жыл бұрын
💪👍
@KrachaborasJB
@KrachaborasJB 3 жыл бұрын
Give me Zookeeper !!! :)
@kurapatikumar2296
@kurapatikumar2296 Жыл бұрын
Zookeeper videos
Understanding StatefulSets in Kubernetes
28:44
That DevOps Guy
Рет қаралды 49 М.
Running Kafka on Docker with Compose
19:24
That DevOps Guy
Рет қаралды 26 М.
When Rosé has a fake Fun Bot music box 😁
00:23
BigSchool
Рет қаралды 5 МЛН
UFC 310 : Рахмонов VS Мачадо Гэрри
05:00
Setanta Sports UFC
Рет қаралды 1,2 МЛН
3. Apache Kafka Fundamentals | Apache Kafka Fundamentals
24:14
Confluent
Рет қаралды 491 М.
Simplify Kubernetes YAML with Kustomize
20:37
That DevOps Guy
Рет қаралды 77 М.
A Simple Kafka and Python Walkthrough
11:34
Quix
Рет қаралды 25 М.
Service Mesh: What & Why ? - a new series
13:38
That DevOps Guy
Рет қаралды 37 М.
Apache Kafka Architecture
11:19
Anton Putra
Рет қаралды 42 М.
What is Kafka?
9:17
IBM Technology
Рет қаралды 475 М.
Kafka Tutorial - Core Concepts
13:04
Learning Journal
Рет қаралды 942 М.
What is Kubernetes AFFINITY ?
17:28
That DevOps Guy
Рет қаралды 7 М.
Introduction to Strimzi: Apache Kafka on Kubernetes - Jakub Scholz & Paolo Patierno, Red Hat
34:54
CNCF [Cloud Native Computing Foundation]
Рет қаралды 16 М.
What is Apache Kafka®?
11:42
Confluent
Рет қаралды 373 М.
When Rosé has a fake Fun Bot music box 😁
00:23
BigSchool
Рет қаралды 5 МЛН