Apache Kafka Explained (Comprehensive Overview)

  Рет қаралды 211,827

Finematics

Finematics

Күн бұрын

Пікірлер
@jimmortenson9383
@jimmortenson9383 5 жыл бұрын
This video does what 2 hour conference talks wish they could. Thank you!
@Finematics
@Finematics 5 жыл бұрын
thanks Jim!
@kenchang3456
@kenchang3456 4 жыл бұрын
I agree with @Jim Mortenson, great video. I'm subscribed. Thank you very much.
@Marius5404
@Marius5404 4 жыл бұрын
Honestly one of the best introductions into a technology I have ever seen. Everything is so clear and it has great examples. Thank you!
@osallllllll
@osallllllll 4 жыл бұрын
This video proves that teaching is not for everybody. 20 minutes straight to the point.
@andrewhting
@andrewhting 2 жыл бұрын
Wow, the first 1:30 and things have become way more clear to me than the last 3 hours of kafka videos combined from multiple other content creators. Thank you for breaking it down from a high level like that. Bravo!
@cheatman05
@cheatman05 4 жыл бұрын
This is the most comprehensible presentation I've seen in a long time!
@Finematics
@Finematics 4 жыл бұрын
Thanks!
@oswaldumeh
@oswaldumeh 4 жыл бұрын
This video has totally lifted me from a zero in terms of my understanding of Kafka. The explanations are concise and clear, shows a firm understanding of the topic from the creator. Thanks for this. Well done!
@Finematics
@Finematics 4 жыл бұрын
Thanks Oswald! I'm happy it was helpful
@StyleTrick
@StyleTrick 4 жыл бұрын
This is one of the best videos on Kafka I've seen, thorough and straight to the point!
@alexkumpula
@alexkumpula 3 жыл бұрын
This really answered all the nitty-gritty architectural questions I was puzzling over while watching through other videos. Thanks for the video!
@ardsandlived
@ardsandlived 4 жыл бұрын
This is an excellent presentation on Kafka. As a solution architect with 20+ years experience in messaging middleware, I will recommend it to anyone who is starting to look at using Kafka (as I am).
@victorgomez335
@victorgomez335 2 жыл бұрын
Great video, everything was explained clearly and concisely. One of the best introductions to a topic that I have ever seen in my life. Continue like that
@Finematics
@Finematics 5 жыл бұрын
If you want to learn even more about Kafka you can check out Kafka The Definitive Guide ► amzn.to/2Ra68Yn
@axelhuachacona6227
@axelhuachacona6227 4 жыл бұрын
Thanks for your work man! This is so far the best video talking about Kafka
@narsiktube
@narsiktube 4 жыл бұрын
One of the best conceptual introductions to Apache Kafka. Thank you and keep up the great work !
@Finematics
@Finematics 4 жыл бұрын
Thanks a lot!
@laxmigo
@laxmigo 3 жыл бұрын
One of the best Kafka video, i came across. Thanks you !
@evisionwithjps602
@evisionwithjps602 3 жыл бұрын
New kafka practical tutorial ..kzbin.info/www/bejne/o52rYaxte7Soobc
@AllenLVW
@AllenLVW 3 жыл бұрын
The best video to begin understanding Kafka!
@irekd.4077
@irekd.4077 4 жыл бұрын
Please keep up the good work. Great explanation of complicated matter. If we had academic teachers like you, we would be in a better place. Thank you!
@evisionwithjps602
@evisionwithjps602 3 жыл бұрын
New kafka practical tutorial ..kzbin.info/www/bejne/o52rYaxte7Soobc
@sgwong513
@sgwong513 3 жыл бұрын
This is a video to make me subscribe. short video but a lot of contents. much better than some 2 or 3 hours video. Thanks for the awesome video, i think the creator did spend a lot of time to come out this video.
@ritviksharmacooldude
@ritviksharmacooldude 3 жыл бұрын
Every time i “replay” this video to understand kafka 😎
@mahenrathod5285
@mahenrathod5285 2 жыл бұрын
Very informative and easy to follow. One of the best refresher videos I found on the internet. Thanks for this amazing video 👍
@imyashdeepsharma
@imyashdeepsharma 5 жыл бұрын
Loved it, Great Explanation to the each component of the architecture.
@ckhare11
@ckhare11 4 жыл бұрын
Great to get a quick overview of Kafka. Nicely explained.
@deepsikhakar9166
@deepsikhakar9166 2 жыл бұрын
one of the best deep dive in kafka great work
@aycanayhan3680
@aycanayhan3680 4 жыл бұрын
Wonderful explanation, thanks a lot!
@parkavimani3995
@parkavimani3995 3 жыл бұрын
Such a refresher this video is!
@VictorRomanC
@VictorRomanC 5 жыл бұрын
Great video! I would love to see a Finematics on Spark, Micro-services or Functional Programming
@evisionwithjps602
@evisionwithjps602 3 жыл бұрын
New kafka practical tutorial ..kzbin.info/www/bejne/o52rYaxte7Soobc
@BrankaSando-l3b
@BrankaSando-l3b Жыл бұрын
Thank you for this video!!! One of the best on this topic!
@satyanarayanapeteti2690
@satyanarayanapeteti2690 4 жыл бұрын
Nice explanation with in depth analysis of architecture
@moianemario
@moianemario Жыл бұрын
Thank you for such short and comprehensive explanation... THANK YOU!
@juanpabloaguirre5837
@juanpabloaguirre5837 4 жыл бұрын
Extremely useful. Is like 4 months of traditional University courses
@Finematics
@Finematics 4 жыл бұрын
Thanks Juan!
@robertfowler2811
@robertfowler2811 11 ай бұрын
fantastic explanation one the best explanations I have ever read
@pailacognizant
@pailacognizant 2 жыл бұрын
Fantastic Video.. Great demonstration skills in action and easy to understand
@demidevil666
@demidevil666 4 жыл бұрын
Thanks a lot for this comprehensive overview. I recently started a new job and we use Kafka in our team, yet I still have a lot of questions about it. Your video helped a lot! :)
@mnfchen
@mnfchen 2 жыл бұрын
12:32 Note that consumers no longer have to connect to the leader partition. They can now listen on a replica (for committed offsets).
@filipeschenkel
@filipeschenkel 4 жыл бұрын
Amazing video, you summarize a really great amount of information very well... Thank you :)
@davidfang2725
@davidfang2725 4 жыл бұрын
Quick, meaningful, and useful overview of Kafka. Thank you!
@Finematics
@Finematics 4 жыл бұрын
Thanks David!
@funkiekeda
@funkiekeda 4 жыл бұрын
Superb content, sir. Please do continue.
@SharpKnife523
@SharpKnife523 4 жыл бұрын
great tutorial in such a short time. excellent work!!
@mmomeni91
@mmomeni91 7 ай бұрын
Clean and concise! Niiice work...
@1982jayanth
@1982jayanth 4 жыл бұрын
I am new to kafka, and this gives a great idea about the topic. Thanks Finematics.
@Finematics
@Finematics 4 жыл бұрын
Thanks Jayanth!
@lakshay510
@lakshay510 3 жыл бұрын
Wow, What an amazing video. Subscribed!
@Finematics
@Finematics 3 жыл бұрын
Awesome, thank you!
@micha6568
@micha6568 Жыл бұрын
Great Kafka tutorial. Thanks a much👍
@nandrajmeshram8755
@nandrajmeshram8755 4 жыл бұрын
great video thanks for share such worthful information.
@nditahsamweld346
@nditahsamweld346 4 жыл бұрын
An amazing video. Well done!
@evisionwithjps602
@evisionwithjps602 3 жыл бұрын
New kafka practical tutorial ..kzbin.info/www/bejne/o52rYaxte7Soobc
@niharikapatil902
@niharikapatil902 4 жыл бұрын
THIS IS A BRILLIANT VIDEOOOO!!!
@Finematics
@Finematics 4 жыл бұрын
Thanks!
@thewisearchitect
@thewisearchitect 4 жыл бұрын
Beautifully explained. Well done.
@AbdulMannan-rv5yx
@AbdulMannan-rv5yx 4 жыл бұрын
Really nicely explained. I loved it
@evisionwithjps602
@evisionwithjps602 3 жыл бұрын
New kafka practical tutorial ..kzbin.info/www/bejne/o52rYaxte7Soobc
@acupsf
@acupsf Жыл бұрын
Greatly explained!
@9998872108
@9998872108 4 жыл бұрын
Very good explanation.
@jonathanmeyer4842
@jonathanmeyer4842 5 жыл бұрын
Amazing detailed presentation ! Keep it up :)
@海璃-m2u
@海璃-m2u 4 жыл бұрын
A good overview, thank you!
@Finematics
@Finematics 4 жыл бұрын
Thanks!
@CraigStrachanZA
@CraigStrachanZA 4 жыл бұрын
Brilliant overview. Very well done.
@evisionwithjps602
@evisionwithjps602 3 жыл бұрын
New kafka practical tutorial ..kzbin.info/www/bejne/o52rYaxte7Soobc
@rajkrishna5439
@rajkrishna5439 2 жыл бұрын
great intro well summarized
@havefuntrading6263
@havefuntrading6263 4 жыл бұрын
Great stuff, very well explained
@anaschtourou288
@anaschtourou288 3 жыл бұрын
excellent video, thank you.
@大盗江南
@大盗江南 4 жыл бұрын
super clear video... thank you...amazing....seriously...man
@Finematics
@Finematics 4 жыл бұрын
thanks!
@rajkkorrapati
@rajkkorrapati 4 жыл бұрын
Great Explanation ! I'm new to this but after the video now I can go back and talk , trigger my solutions around it.
@Finematics
@Finematics 4 жыл бұрын
Thanks Rajesh!
@marcosferreira220863
@marcosferreira220863 Жыл бұрын
Very good introduction
@surajmali3885
@surajmali3885 4 жыл бұрын
Excellent explanation.. Thank you
@juliahuanlingtong6757
@juliahuanlingtong6757 3 жыл бұрын
Really compreheasive with a compact of gold!!~ If given some examples, it would make 10/10!
@qmar1980
@qmar1980 Жыл бұрын
Thank you for the content. I am totally beginner in Kafka - so I have question related to the distributing messages into the Kafka for specific Topic. In the beginning part of the presentation it was said that if the message will be written in the Round Robin fasion (6:48). I understood that the message will be written only in one specific partition (not all of them). Than starting from (9:21) it is said that if the topic has multiple partitions, than messages would be written into multiple partitions evenly. Can someone please explain the concept in order to be sure how it would be really done ?
@alrighttheresham
@alrighttheresham 5 жыл бұрын
@Finematics Fantastic video, would love to see similar sized overview for streams and connect
@Hraffnir
@Hraffnir 4 жыл бұрын
Very well explained, well done.
@Finematics
@Finematics 4 жыл бұрын
Thanks
@meee3107
@meee3107 4 жыл бұрын
Thank you so much for the great video, so informative in few minutes. I have a question that is a little off topic, what software do you use to create your videos ? Thank you.
@carapungo
@carapungo 4 жыл бұрын
Excellent presentation bro!!
@evisionwithjps602
@evisionwithjps602 3 жыл бұрын
New kafka practical tutorial ..kzbin.info/www/bejne/o52rYaxte7Soobc
@morvenhuang1499
@morvenhuang1499 4 жыл бұрын
Great and neat video.
@suckyboy
@suckyboy 4 жыл бұрын
Tanks for explaining
@rishisaireddysudireddy5437
@rishisaireddysudireddy5437 4 жыл бұрын
Great video , keep doing more
@Finematics
@Finematics 4 жыл бұрын
Thanks Rishi!
@miguelangelojeda8382
@miguelangelojeda8382 3 жыл бұрын
really nice video!
@郑鹤-s1s
@郑鹤-s1s 4 жыл бұрын
Great presentation and explanation. Thank you!
@dozedyolk
@dozedyolk 4 жыл бұрын
Great explanation of a complex topic.
@rosewinjr
@rosewinjr 2 жыл бұрын
Nice explanation
@srik006
@srik006 3 жыл бұрын
Very nice explanation. Why was connectors and streaming not explained ?
@chartShooter
@chartShooter 4 жыл бұрын
Such a clear explanation. Do you have a video like this for each Apache technology ? (Spark, airflow, flume etc)
@Finematics
@Finematics 4 жыл бұрын
Not yet, but there will be more videos coming up on different topics including Apache tech. You can subscribe to the channel to stay in the loop.
@sahillamba3879
@sahillamba3879 4 жыл бұрын
Thanks for sharing knowledge. Video is good
@Finematics
@Finematics 4 жыл бұрын
Thanks!
@MartynInEurope
@MartynInEurope 4 жыл бұрын
Great job! Thanks!
@unknown_device687
@unknown_device687 5 жыл бұрын
Good video but there are some misconceptions. There is no backpressure in kafka only throttling which implemented with so-named quotas on the producer side. And it is also possible to implement exactly once using low-level producer/consumer api.
@jamesburke7033
@jamesburke7033 4 жыл бұрын
Great video and gave me a great understanding at a high level. It seems like Kafka can be a great solution in so many way, but I'm a little confused where and how. If I wanted to build Kafka into a web site (i.e. shopping car, a cloud based accounting system) as a broker and controller of a web site currently built on a LAMP stack would that be possible. How and why would I do this? Can somebody please point me into the right direction to find some answers?
@Finematics
@Finematics 4 жыл бұрын
Thanks James. In the systems I built so far Kafka was used to deliver messages between internal services. As an example you can imagine a website that allows you to register a new user. A request to create a new user would go to a backend service usually via REST or Websocket. After that the backend endpoint would construct a message with the newly registered user and send it to Kafka so other services could pick it up and do something with it (for example another service could read it from Kafka to add it to the database).
@geolee76
@geolee76 4 жыл бұрын
What about the reply response to user. User would be waiting for consumer to add into db and how it response back to user once done
@sergey-kotov-uk
@sergey-kotov-uk 4 жыл бұрын
It would be nice to hear when RabbitMQ is preferable to Kafka, in what use cases Kafka is not the best option as a message system.
@justinnguyen3845
@justinnguyen3845 3 жыл бұрын
hi, what tools did you use to create these doodle videos?
@authhwang8774
@authhwang8774 5 жыл бұрын
good video for knowing kafka
@Finematics
@Finematics 5 жыл бұрын
thanks!
@saravanprathi6956
@saravanprathi6956 4 жыл бұрын
Thank you, very nice video! I hope you use a black screen with white pen for your future videos. It would be easy on our eyes!
@rohitsinha3876
@rohitsinha3876 4 жыл бұрын
Amazing and well explained. Precise and to the point. @Finematics Can you also please explain the part if exactly once delivery and at least once delivery issue in kafka. Btw thanks for this video
@小号-m2y
@小号-m2y 5 жыл бұрын
nice video!
@Finematics
@Finematics 5 жыл бұрын
Thanks!
@floidcosta
@floidcosta 3 жыл бұрын
good stuff.
@DontTakeCrack
@DontTakeCrack 3 жыл бұрын
Thanks, i find this summary pretty useful. Not sure about that ending though, things like JMS + backpressure seemed pretty tacked on and im pretty sure JMS is not directly related to rabbitmq.
@lindilebangose7667
@lindilebangose7667 4 жыл бұрын
Can you please guys do zookeeper as well
@ssingh2k8
@ssingh2k8 3 жыл бұрын
Beautiful.
@nashram344
@nashram344 4 жыл бұрын
DAM !!! excellent video
@Finematics
@Finematics 4 жыл бұрын
Thanks!!
@neyudn7896
@neyudn7896 4 жыл бұрын
I'm wondering which tool did you use to make a full map of slides???
@Finematics
@Finematics 4 жыл бұрын
I'm using Videoscribe
@mqtt07
@mqtt07 3 жыл бұрын
How seriously should one consider the "deliver at least once" limitation of Kafka in a solutioning design. In other words how often messages are delivered more than once to become a problem in a solution?
@borisdavidov5
@borisdavidov5 4 жыл бұрын
good stuff!
@mariosergiosilva8820
@mariosergiosilva8820 2 жыл бұрын
Amazing 😁
@roberts1782
@roberts1782 4 жыл бұрын
Thank you
@bp8730
@bp8730 3 жыл бұрын
fantastic
@windowcrystal4012
@windowcrystal4012 4 жыл бұрын
Could you please share the slides? It is very good
@Snorlite
@Snorlite 5 жыл бұрын
6:42 here, you say that if the partition is not specified, the partition will be chosen following a round-robin scheduling 9:14 here, you say that if the partition is not specified, the producer will write the same message to every partition of the topic What's the truth? Or am I missing something?
@Finematics
@Finematics 5 жыл бұрын
Hi Snorlite. What I meant there is that messages (multiple) will be written to each of the partitions evenly, so let's say we have 3 partitions and message 1 will go to partition 1, message 2 to partition 2, message 3 to partition 3, message 4 to partition 1 etc. After 99 messages each partition would have 33 messages each. Sorry if the explanation was not clear enough.
@Snorlite
@Snorlite 5 жыл бұрын
@@Finematics Got it! Thank you for the reply. By the way, great video, it's very helpful.
@Manolete919
@Manolete919 4 жыл бұрын
Excellent
@Finematics
@Finematics 4 жыл бұрын
Thank you!
@arj123sub
@arj123sub 5 жыл бұрын
Super ,
@rahulbsadyanth8745
@rahulbsadyanth8745 4 жыл бұрын
Does Kafka require coding?
@danielsonski
@danielsonski 4 жыл бұрын
Nice... Nothings seems to be simplified. I, sometimes, felt a little backpressure myself :-p. (no worries, I can revisit this later on :-) )
Introduction to Apache Kafka by James Ward
49:48
Devoxx
Рет қаралды 280 М.
3. Apache Kafka Fundamentals | Apache Kafka Fundamentals
24:14
Confluent
Рет қаралды 494 М.
Wednesday VS Enid: Who is The Best Mommy? #shorts
0:14
Troom Oki Toki
Рет қаралды 50 МЛН
Война Семей - ВСЕ СЕРИИ, 1 сезон (серии 1-20)
7:40:31
Семейные Сериалы
Рет қаралды 1,6 МЛН
SLIDE #shortssprintbrasil
0:31
Natan por Aí
Рет қаралды 49 МЛН
System Design: Why is Kafka fast?
5:02
ByteByteGo
Рет қаралды 1,1 МЛН
Apache Kafka Vs. Apache Flink
12:22
The Data Guy
Рет қаралды 11 М.
What is Apache Kafka®?
11:42
Confluent
Рет қаралды 375 М.
Apache Kafka in 6 minutes
6:48
James Cutajar
Рет қаралды 1 МЛН
Top Kafka Use Cases You Should Know
5:56
ByteByteGo
Рет қаралды 79 М.
What is Kafka?
9:17
IBM Technology
Рет қаралды 476 М.
Apache Kafka Crash Course
1:18:06
Hussein Nasser
Рет қаралды 442 М.
Kafka vs. RabbitMQ vs. Messaging Middleware vs. Pulsar
4:31
ByteByteGo
Рет қаралды 134 М.
Developing Real-Time Data Pipelines with Apache Kafka
1:30:40
SpringDeveloper
Рет қаралды 157 М.
Apache Kafka Architecture
11:19
Anton Putra
Рет қаралды 44 М.
Wednesday VS Enid: Who is The Best Mommy? #shorts
0:14
Troom Oki Toki
Рет қаралды 50 МЛН