How to choose the No. of Partitions for a Kafka Topic? Horizontal Scaling for Kafka Consumer

[@READBOOKIQBAL]

Good Stuff, Keep ti up.

[@KnowledgeAmplifier1]

Thank you @READBOOKIQBAL! Happy Learning

[@navaneethbusha5134]

great knowledge sharing. If possible, please share your about, how to work over one producer to multiple consumer.

[@KnowledgeAmplifier1]

Hello Navaneeth Busha, Thank you for your kind words .. Regarding your request , you can refer below videos -- Multiple Producer & Multiple Consumer in a Kafka Topic --kzbin.info/www/bejne/Z3nRaGeqmZapq5o Kafka Consumer Groups CLI Demo | Kafka-Python-- kzbin.info/www/bejne/r3zdlaijlNuLbc0 Manual Offset Commits & Exactly-Once Once Processing in Kafka Consumer using Python--kzbin.info/www/bejne/joO1qoJsl56Kp8k These videos have some prerequisites which you can find in this playlist where all Kafka Concepts are explained in systematic order -- kzbin.info/aero/PLjfRmoYoxpNrs0VmIq6mOTqXP52RfZdRf Hope this will be helpful! Happy Learning

[@randomstuffsofdayandnight]

Is there any default size(in kb/mb/gb) that a consumer can process per second in Kafka ?

[@akbarmunwar5435]

Great,. Thanks

[@KnowledgeAmplifier1]

You are welcome Akbar Munwar! Happy Learning

[@ramagaur8413]

Nice explanation, I have one question let's suppose we have 200 partition where producer is producing records but at consumer side we can't scale 200 consumers in a consumer group will in that case order of message be maintained?

[@MrMadmaggot]

One thing is important hre, shouldnt it be automatic?

[@aviiiiiiiiiiiiiiiiiiii]

late to this reply, but I think in most cases the amount of resource consumption is always left to the user/business to decide, especially with cloud servers where these factors would lead to heavy billing.

[@anthonya880]

If possible plz make Kafka videos for Java devs also. We could also benefit from ur knowledge.

[@KnowledgeAmplifier1]

Hello Anthony A, actually, I am from Python background , you can get the theoretical understanding from my videos , and for practical implementation using Java, you can refer Stephane Maarek's lectures or Prashant Kumar Pandey's lectures ....