All about stream processing

  Рет қаралды 1,586

BigData Thoughts

BigData Thoughts

Күн бұрын

Пікірлер: 6
@infiniteseries948
@infiniteseries948 2 жыл бұрын
@Shreya, I like your other videos on data format. But this particular one is at very high level with having some discrepencies. Amazon Kinesis Data Firehorse Amazon Kinesis Data Streams Amazon MSK These are not streaming solutions for unbounded data processing. They are helping for storing data like kafka. Apache Flink, Apache Beam - are two major Streaming Solution available today. I work in streaming. Amazon Kinesis Data Analytics is the streaming solution - where underlying product is Flink. Google has Google Dataflow which is Google's solution. Kafka streaming is stream processing. Sparking streaming is stream processing. Time, watermark and state are important concepts. Stateful computation is critical to achive low latency. Hope this helps. Please keep Sharing your knowledge. (I am a bengali too)
@samk_jg
@samk_jg Жыл бұрын
Hi, I really like your content , do you have some training program or is there any possibility to have one to one training with you , thanks!
@kumarvummadi3772
@kumarvummadi3772 2 жыл бұрын
Hi Madam please do a video on sparkcontext , spark session configuration with clear explanation of that syntaxes please mam 🙏
@BigDataThoughts
@BigDataThoughts 2 жыл бұрын
Sure
@kumarvummadi3772
@kumarvummadi3772 2 жыл бұрын
@@BigDataThoughts can you please do the video quickly mam.
@kumarvummadi3772
@kumarvummadi3772 2 жыл бұрын
@@BigDataThoughts Val conf = new sparkconf().setmaster(local).setappname(appname) Val sc = new sparkcontext(conf) Please do video explanation for this syntaxes mam. Requesting you mam
All about Debugging Spark
18:29
BigData Thoughts
Рет қаралды 4,5 М.
Structured Streaming in spark
18:56
BigData Thoughts
Рет қаралды 1,2 М.
Don’t Choose The Wrong Box 😱
00:41
Topper Guild
Рет қаралды 62 МЛН
Spark Architecture in Depth Part1
13:02
BigData Thoughts
Рет қаралды 5 М.
Stream Processing System Design Architecture
11:24
ByteMonk
Рет қаралды 14 М.
Speculative Execution In Spark - Most common Spark Interview Question
4:31
Spark structured API - Dataframe and Datasets
17:05
BigData Thoughts
Рет қаралды 1 М.
System design basics: Real-time data processing
11:57
Tech Dummies Narendra L
Рет қаралды 85 М.
Understanding Spark Execution
15:33
BigData Thoughts
Рет қаралды 2,5 М.
Stream Processing Fundamentals
19:05
BigData Thoughts
Рет қаралды 313
Top 3 file formats frequently used in bigdata world
13:51
BigData Thoughts
Рет қаралды 737
Don’t Choose The Wrong Box 😱
00:41
Topper Guild
Рет қаралды 62 МЛН