Apache Kafka® Transactions: Message Delivery and Exactly-Once Semantics

  Рет қаралды 25,315

Confluent

Confluent

Күн бұрын

Пікірлер: 9
@rajsaraogi
@rajsaraogi Жыл бұрын
Abort marker, fence off, honestly so much jargans to make understand things, kafka teams should come with simple explainations
@HanWang-m9l
@HanWang-m9l 7 ай бұрын
Clear introduction, thank you !
@samwei51
@samwei51 3 ай бұрын
Thanks for the explanation. I would like to point out a few points where it sounded vague and unclear to me. 1. The arrows at 3:09 are intertwined and are hard to comprehend easily. 2. 8:12, it sounds like the P0 P1 P7 messages are enqueued into the coordinator queue all at once. But I wonder if they are progressively enqueued as the transaction process steps forward. 3. 10:21, "the broker also returns a little bit metadata (for message #57) so the consumer can ignore the aborted record". But the Abort message (#61) has not been read yet. It's kind of unclear to me how Kafka includes the info "message #57 has been aborted" in the metadata. Maybe I'm just being ignorant as I'm not experienced with Kafka. Any illuminations would be appreciated.
@mehrdadk.6816
@mehrdadk.6816 2 жыл бұрын
If one using low-level one way to avoid to disable auto-commit feature in topic, and once write to debit balance topic is done we manually increase the offset. This way we ensure of app crashed, we didn't commit log, so we can restart. Nevertheless this feature of having transaction in stream is really cool.
@davidebelvedere2564
@davidebelvedere2564 6 ай бұрын
how can it guarantee that the committed marker is pushed on coordinator and on all destination partitions? it doesn't seem much atomic as an operation
@paulpasquel
@paulpasquel 2 жыл бұрын
New "revolutionary application" using standards mechanisms, that we have saw in Database and MQ for more than 40 years ... but not 2pc Surely Kafka will implement that in future ...
@kovalevvvvv
@kovalevvvvv Жыл бұрын
Lol, alot of words about "modern mq", but kafka doesn't support xa-protocol - you can't use kafka transactions with database transactions.
@sandymenon84
@sandymenon84 3 ай бұрын
I would say a good start at transactions....but the explanation could have been a bit crisper.
Рассказ про exactly once в kafka
49:28
Сергей Петрелевич
Рет қаралды 1,5 М.
Officer Rabbit is so bad. He made Luffy deaf. #funny #supersiblings #comedy
00:18
Funny superhero siblings
Рет қаралды 18 МЛН
когда не обедаешь в школе // EVA mash
00:51
EVA mash
Рет қаралды 4,3 МЛН
«Кім тапқыр?» бағдарламасы
00:16
Balapan TV
Рет қаралды 173 М.
Apache Kafka® Consumers and Consumer Group Protocol
15:08
Confluent
Рет қаралды 22 М.
When to Use Kafka or RabbitMQ | System Design
8:16
Interview Pen
Рет қаралды 93 М.
The Apache Kafka® Control Plane - ZooKeeper vs. KRaft
12:03
Confluent
Рет қаралды 19 М.
Kafka - Exactly once semantics with Matthias J. Sax
1:25:58
The Geek Narrator
Рет қаралды 4,7 М.
System Design: Why is Kafka fast?
5:02
ByteByteGo
Рет қаралды 1,1 МЛН
Транзакции в Kafka // Демо-занятие курса «Java Developer. Professional»
1:42:13
OTUS IT Онлайн - образование
Рет қаралды 1,2 М.
Apache Kafka Architecture
11:19
Anton Putra
Рет қаралды 31 М.
Officer Rabbit is so bad. He made Luffy deaf. #funny #supersiblings #comedy
00:18
Funny superhero siblings
Рет қаралды 18 МЛН