Kafka Topics, Partitions and Offsets Explained

  Рет қаралды 155,853

Stephane Maarek

Stephane Maarek

Күн бұрын

Пікірлер: 43
@StephaneMaarek
@StephaneMaarek 4 жыл бұрын
If you want to learn more, check out my Apache Kafka Series - Learn Apache Kafka for Beginners v2 course : links.datacumulus.com/apache-kafka-coupon
@irajonah3108
@irajonah3108 3 жыл бұрын
I guess I'm kind of off topic but do anybody know of a good website to stream newly released tv shows online ?
@roydouglas7264
@roydouglas7264 3 жыл бұрын
@Ira Jonah try FlixZone. Just search on google for it :)
@marcelokairo9092
@marcelokairo9092 3 жыл бұрын
@Roy Douglas definitely, have been using flixzone for since march myself =)
@irajonah3108
@irajonah3108 3 жыл бұрын
@Roy Douglas thanks, I went there and it seems to work =) I appreciate it!!
@roydouglas7264
@roydouglas7264 3 жыл бұрын
@Ira Jonah Glad I could help :D
@777megapixel
@777megapixel 2 жыл бұрын
That's a kind of a lecture people are usually dreaming of! I'm just getting started with Kafka and your lessons have made my day: thank you
@aaandrade5
@aaandrade5 5 жыл бұрын
honestly this is much better than linuxacademy
@MrBdoleagle
@MrBdoleagle 2 жыл бұрын
your videos are the best in explaining how kakfa works, clear and neat.
@cvarun9221
@cvarun9221 11 ай бұрын
The most simplest explanation.
@satyaprakashparida5507
@satyaprakashparida5507 3 жыл бұрын
Thanks a lot. I am thinking that I got the best Kafka materials.
@luigitorchia7294
@luigitorchia7294 5 жыл бұрын
Brilliant lecture!!! thank you!
@pawegrzesik4449
@pawegrzesik4449 4 жыл бұрын
How make partition we need to create? How to calculate the proper number of it? What if I will have just 1 partition?
@maddymaddy5832
@maddymaddy5832 7 ай бұрын
Best kafka video.. thank you
@Gamer_with_knowledge
@Gamer_with_knowledge Жыл бұрын
Thanks a lot for these excellent lectures ❣
@roliagrawal3124
@roliagrawal3124 Жыл бұрын
So as u said once it’s written at offset we can not update it that means the same data we can not update it?
@dhruvildoshi2368
@dhruvildoshi2368 4 жыл бұрын
Where does kafka stores offsets of all partitions?
@andrewkondrashov6485
@andrewkondrashov6485 3 жыл бұрын
What for i have to use partitions?
@padmanathanramasamy8354
@padmanathanramasamy8354 Жыл бұрын
In your truck_gps example, you have created 10 partition and created truckId as a key. In this case the first 10 unique truck id will stored on each partition. what happen when we get the 11th truckId to which partition it will go?
@roliagrawal3124
@roliagrawal3124 Жыл бұрын
Yeah same question?
@andreisv
@andreisv Жыл бұрын
Modulo 10 maybe 🤔
@sreenivasamadenahall
@sreenivasamadenahall 4 жыл бұрын
Thank you, very well explained.
@aleman7
@aleman7 8 ай бұрын
hi, great video. i'm trying to find a strategy to resolvé transaction for microservicios comunicated each others by Kafka. Do you think that is posible? thanks for your help.
@yunlin3980
@yunlin3980 3 жыл бұрын
When a consumer is to consume N records from Partition 0, 1, 2 of a topic, what does it mean? Is it reading N records from each partition? That would make it 3N records in total. Is it reading in round-robin fashion from partition 0, 1, 2, until the total read records is N?
@sushmakl4392
@sushmakl4392 2 жыл бұрын
how do I collect data from Kafka topic as batches and then use poll to send data to Redshift in intervals of time
@meghanapulavarthy4036
@meghanapulavarthy4036 3 жыл бұрын
How to fetch offset for particular events in the consumer??
@swapnila202
@swapnila202 4 жыл бұрын
Owsomely explained 👍
@ValmikKalathia
@ValmikKalathia 3 жыл бұрын
Thank you. It was a really nice explanation.
@pradeepb355
@pradeepb355 3 жыл бұрын
How create dynamic topics
@prasadpsp
@prasadpsp 4 жыл бұрын
A very good tutorial. thank you.
@essskkk
@essskkk 4 жыл бұрын
Great Lecture , Thanks a lot !!!
@adamnhas7547
@adamnhas7547 3 жыл бұрын
Merci beaucoup. Very clear.
@Pavan-MGM-IT-Training
@Pavan-MGM-IT-Training 3 жыл бұрын
can some one who is good in PPTs explain how those Message boxes are designed in power point?
@DevWonYoung
@DevWonYoung 5 жыл бұрын
Thank you sir
@masonlu100
@masonlu100 3 жыл бұрын
thanks, very helpful
@ranjulahettiarachchi8525
@ranjulahettiarachchi8525 4 жыл бұрын
Thanks you!
@markmariq
@markmariq 2 ай бұрын
You have conflicting information on data retention, another slide says 2 weeks and this one says 1 week.
@PONSONT
@PONSONT 5 жыл бұрын
Thank you...
@DragonKlavier
@DragonKlavier 4 жыл бұрын
Thank you so much!
@chinmayshetye3
@chinmayshetye3 2 жыл бұрын
nicee
@ethanquenum4778
@ethanquenum4778 2 жыл бұрын
You must be french.
@pierresun3660
@pierresun3660 10 ай бұрын
no his English is too good for a French
Console Consumer in Groups on Kafka CLI Tutorial
6:36
Stephane Maarek
Рет қаралды 11 М.
Topics, Partitions and Offsets:  Apache Kafka Tutorial #2
6:41
Anton Putra
Рет қаралды 26 М.
How Many Balloons To Make A Store Fly?
00:22
MrBeast
Рет қаралды 191 МЛН
Farmer narrowly escapes tiger attack
00:20
CTV News
Рет қаралды 15 МЛН
Kafka Consumer Offsets Explained
15:01
Tech With Aman
Рет қаралды 19 М.
3. Apache Kafka Fundamentals | Apache Kafka Fundamentals
24:14
Confluent
Рет қаралды 491 М.
What is Kafka and How does it work?
15:04
Hussein Nasser
Рет қаралды 147 М.
When to Use Kafka or RabbitMQ | System Design
8:16
Interview Pen
Рет қаралды 144 М.
Avro Introduction
8:20
Stephane Maarek
Рет қаралды 162 М.
Top Kafka Use Cases You Should Know
5:56
ByteByteGo
Рет қаралды 74 М.
Kafka Producers Explained
4:44
Stephane Maarek
Рет қаралды 80 М.
Apache Kafka 101: Partitioning (2023)
4:23
Confluent
Рет қаралды 137 М.
Apache Kafka in 6 minutes
6:48
James Cutajar
Рет қаралды 1 МЛН
How Many Balloons To Make A Store Fly?
00:22
MrBeast
Рет қаралды 191 МЛН