transactional layer iceberg - update is delete +insert iceberg - mark the del records , create file of new inserts hudi - mor hudi - streaming workloads liquid clustering table metadata formats hudi, delta - more writes iceberg - more read - warehouse read, write, table management read optimised write optimised hudi lakehouse data rewriting 3 tables formats table metadata formats iceberg - snapshot delta, hudi - log bassd write, read, table management hudi - built in table mgmt metadata cor ; mow cow; mor interoperability uniform read compatibility write compatibility manifest file delta log xtable and uniform foundational db in sf access control + technical metadata polaris - sf unity catalog - open source iceberg rest api catalog metastore - read and write plans data not tied to one engine data catalog being interoperable bw engines lake view - ingestion, transformation, orchestration- observability
@PeterNolan-00910 күн бұрын
Hi Sanjeev, good to be linked here too.
@jimmyhuang741911 күн бұрын
Although I wish to know who has better position to win in the future (I am a investor not data guy and still hard to dive deeply after reading bunches of their document), it is so appreciated.
@SanjeevMohan11 күн бұрын
Hi Jimmy, this is the question I get asked every day. Opinions are divided and it is hard to say.
@jimmyhuang741911 күн бұрын
@@SanjeevMohan Yes, we are all excited about the future of AI and cloud data because AI is so amazing after using it. Snowflake is especially in good position but also getting in mixed bag situation. Thanks your sharing here and in the cube channel, it is so helpful.
@GirishBhat-t3z11 күн бұрын
Quite comprehensive Sanjeev. Thank you.
@SanjeevMohan11 күн бұрын
Thanks, Girish. Much appreciated.
@arthun25513 ай бұрын
💖 promo sm
@SanjeevMohan3 ай бұрын
I don’t understand
@MIKEESSOR3 ай бұрын
Good content Sanjeev!
@purohitsp3 ай бұрын
Very good and timely initiative from Prophecy. This is the need of the hour in this dynamic data world. I strongly believe that this tool can become an independent visual data processing tool enabling both visual IDE lovers and coders. Good Luck.
@SanjeevMohan3 ай бұрын
Thank you for your comments. Very true.
@dedyfang3 ай бұрын
extremely insightful from Florian, thank you Sanjeev!
@SanjeevMohan3 ай бұрын
Glad you liked it!. Much appreciated. Thanks.
@brunoaziza3 ай бұрын
Looking good Sanjeev and Florian!
@SanjeevMohan3 ай бұрын
Thanks, Bruno. Much appreciated.
@sachitsharma6 ай бұрын
Has any company already implemented this Intelligent Data Platform architecture? Additionally, could you elaborate on the potential opportunities within this sector? Your insights into the practical applications and industry uptake would be highly valuable.
@SanjeevMohan6 ай бұрын
If you do a search for intelligent data platform many vendors show up - Databricks, Microsoft, Wipro, Collibra, Alation, BigID etc. They use some combination of the terms. So, the first problem is a lack of common definition. If we look past, at how we defined IDP in spirit, we feel that thus far no vendor has a strong offering but many of them are moving in this direction. It is only a matter of time before the end-user organizations start their adoption.
@sachitsharma6 ай бұрын
@@SanjeevMohan Is this the playground for incumbents then? Are there any opportunities for startups?
@ibains6 ай бұрын
Inevitable decline of modern data stack - still nice how polite people are, calling these point solutions best of breed
@dataheroes74646 ай бұрын
Loved it @Sanjeev & @Rajesh! Will call it an Overall package!!!
@SanjeevMohan6 ай бұрын
Thanks and much appreciated.
@brunoaziza7 ай бұрын
Great to see the 3 of you again!
@anilmanickath36427 ай бұрын
Best articulation about data as a product!
@skpadgett10010 ай бұрын
Thank you!!
@skpadgett10010 ай бұрын
Thank you, well done!
@ibains11 ай бұрын
Existing ETL tools required Java 😂 - this guy is such a tool
@DrJoePerezData11 ай бұрын
EXCELLENT debrief, gentlemen!
@photohawker11 ай бұрын
Such a great conversation! Thank you Sanjeev!
@theravitshow11 ай бұрын
I love it! All three friends :)
@vivekverma6584 Жыл бұрын
Superb 😊
@rpaulsingh1 Жыл бұрын
Great interview
@human_devops Жыл бұрын
Great interview. Thanks for sharing
@human_devops Жыл бұрын
Also I just realised I was at the same DoK talk as Gabriele in Amsterdam on Tuesday night!
@jankarremans3798 Жыл бұрын
I love Sanjeev and I love Gabriele. This is fundamental knowledge is you are serious about Data on Kubernetes!!
@SanjeevMohan Жыл бұрын
Thanks, Jan. I feel we are the tipping point for Data on Kubernetes. Thanks for your message. The feeling is mutual.
@user-jx9ip6ew3m Жыл бұрын
Interesting! I have learn a lot. I recommend it.
@SanjeevMohan Жыл бұрын
Thanks, Sergio. Really appreciate the feedback.
@aasthajha8505 Жыл бұрын
Learned a lot from this session!
@Skullsader Жыл бұрын
Very insightful Thank you for sharing the video👏
@Alation Жыл бұрын
Thanks for having Satyen Sangani on "It Depends!" We know he enjoyed connecting with you 😃
@96merluzzo Жыл бұрын
noiceeee
@brunoaziza Жыл бұрын
Nicely done. Liked the debate on the data catalog!
@SarkieU Жыл бұрын
Such a pleasure to have a thoughtful person, leading an impactful change, not jumping on the cert bandwagon.
@peterhopfgartner5180 Жыл бұрын
Good luck, Zhamak Dehghani, for your new adventure!
@abhisheksingh-ck1nl Жыл бұрын
I always thought Data Mesh was a Gartner term. Good to know this
@Sachkisaza Жыл бұрын
Bob Muglia is one of those rare leaders who has what I think of as the magic triad: Profound domain knowledge, deep empathy for people, courageous vision and execution. Having him as a leader of the org (he was my manager's manager) was a great experience.
@SanjeevMohan Жыл бұрын
What an amazing note. Thanks for taking the time, Khaja. Really appreciate it.
@zilliard1352 Жыл бұрын
great conversation!
@SanjeevMohan Жыл бұрын
Thank you
@rourkecu Жыл бұрын
Great session
@SanjeevMohan Жыл бұрын
Appreciate it
@jithupaulose2705 Жыл бұрын
Great Session by Sanjeev Ji 👌👌👌👌
@SanjeevMohan Жыл бұрын
Thanks, Jithu. Appreciate the feedback.
@photohawker Жыл бұрын
ETL and stored procs functioning essentially as ledgers... I love it. Very thought provoking discussion here. Not all data sharing use cases are a perfect fit here - but many, many are. Thanks Sanjeev and Dr. Wagner for the great discussion.
@photohawker Жыл бұрын
Great episode Sanjeev, and always great to see my good friend Scott!
@brunoaziza2 жыл бұрын
Thanks for having me on Sanjeev! I'll drop the links to the customer examples we discussed today below Snap: kzbin.info/www/bejne/pJC9paCthLSth9k Deutsche Bank: kzbin.info/www/bejne/hGa2g36ciqx3qas Delivery Hero: medium.com/be-data-driven/how-to-make-the-data-mesh-real-dae3848de8c4 And for more stories like that, check out the "Data Journeys" program at g.co/cloud/datajourneys
@jdevaris2 жыл бұрын
As someone who works for government in an older legacy system, something that has been missed, or at least misaddressed, is keyboard friendly migration/modernization! Is this due to the modernization process itself or the way these systems are built? I can't tell you how much quicker I work just by using my keys vs when I have to click through to navigate, but the more we modernize, the longer it takes to so the same tasks. I really hope AlloyDB provides the flexibility to users to be able to still create options for keyboard reliant users and still be able to have a more complex database that allows for analytics and statistics. How exciting!