Keynote: Flink Unveiled - Journeying from DataStream to Streamhouse

Keynote: Flink Unveiled - Journeying from DataStream to Streamhouse
In this presentation, Jing Ge, Head of Engineering at Ververica and Apache Flink® Committer, announces Streamhouse. Learn how Streamhouse significantly improves latency and allows for flexibility and real-time streaming while minimizing the costs usually associated with real-time streaming.
Learn more about Streamhouse on the Ververica blog. www.ververica....
Get all the recordings from Flink Forward Seattle 2023 free on-demand at Ververica Academy. www.ververica....
Ververica is proud to host Flink Forward! Curious about Sponsoring future Flink Forward events? Subscribe for updates. www.flink-forw...
CHAPTERS
00:00: Introduction Do you know what data streaming is?
00:50: Streamhouse
1:20 2023 SIGMOD Systems Award
1:42 Apache Flink
4:20 Lakehouse: Data Warehouse, Data Lakehouse, Data Stream
5:30 Data Processing Triangle: Cost, Latency and Data
7:48 Data Processing Architecture Evolution
8:40 Streamhouse
9:45 Streamhouse: Flink CDC, Flink, Paimon
10:16 Flink CDC for Streamhouse Data Ingestion
10:55 Flink for Streamhouse Data Computation
11:45 Flink - Checkpoint Duration Improvement
13:23 Flink - Adaptive Hybrid Shuffle
14:38 Flink 2.0 - Cloud Native Disaggregated State Management
15:50 Flink 2.0 - API Evolution
17:25 Flink - SQL
19:37 Streaming Data Lake Platform - Apache Paimon
21:30 Streamhouse - The Flexible FFP Architecture
23:32 Big Picture - LSR Data Processing Architecture
25:15 Ververica Cloud: Fully managed, flexible solution
28:04 Conclusion: Why Ververica Cloud?
About Ververica
Proud hosts of Flink Forward events, Ververica is the company founded by the original creators of the open source stream processing framework Apache Flink®. Ververica's mission is to power the core business of every company with cutting-edge real-time stream processing technology. In order to do that, the team at Ververica focuses on building the best technology available for stream processing, while at the same time creating a global and open community
around this technology.
We build and develop Ververica Platform, a stream processing platform that enables every enterprise to power their real-time business and use a production-grade streaming infrastructure while at the same time we actively contribute and participate in the open source Apache Flink community, the underlying technology framework of Ververica Platform itself.
www.ververica....
Follow Ververica on LinkedIn: / 5385380
Follow Ververica on X: / ververicadata
Learn more about Flink Forward: www.flink-forw...