Streaming Stock Market Data with Apache Spark and Kafka

[@mwandulu]

Probably the best talk about Kafka and use cases. Amazing..!

[@usafa2000]

this talk was AMAZING!!

[@Bonero7]

Great talk. Thank you

[@swayam.]

Why don't you store the offsets in a write optimized store that is indexed on timestamps? Then all you have to do is two read queries: start and end while searching for your offsets.

[@SalilPitkar]

If inbound data is parallelized across nodes, how is the original sequence per symbol maintained? e.g. If there are 2 parallel nodes processing the inbound messages and two AAPL trades get split across nodes, but the one with later timestamp reaches the "AAPL" topic first, the consumer will receive the more recent trade first and then the older trade. AFAIK, Kafka maintains the sequence within a topic partition.

[@patrickbike7908]

Thanks for sharing

[@Justicewarrior795]

wuhan?

[@pajeetsingh]

You don't have rice grain of information about what goes in the underworld.

[@Justicewarrior795]

@@pajeetsingh 👻👻😱😱😱

[@pajeetsingh]

Italian accent.