Congratulations

I got lost at the very beginning, from the "print(os.listdir())" what i got as my output is very different from what you got

confusing

Thanks for the video Soumil. Nice video. I have a similar requirement of reading from Kafka but in my case I processing using Glue Streaming with few transformations. I could not find any transformation your code. Can I assume that Hudi Streamer is kind of Low/Code feature. What is to be done if I have some transformations?

Very bad explain

Very great explanation, thanks for Sharing. Quick question: Can a single Kinesis Data Stream ingest multiple Atlas Triggers (Being each trigger configured for 1 collection ), Or for each collection I need create 1 Kinesis Data Stream. Thanks in advance!

hi bro been watching a few of your videos,very enlightening..im just confused on integrating mongo db with python could i contact you somehow to understand it better

awesomeness

How to upgrade ELK without data loss

reading other peoples questions is such a smart way of learning, thanks for sharing your journey

wow LSM trees on parquet base... Hudi is going to run circles around the other meta tables.

Great video Soumil

You're very talented in explaining. Easy to understand.

What is the use of ACL here?

For MoR, in commit time 2, where is F file registered if not in parquet or log?

thanks

Simply Awesome. Thanks man!

Nice video , learnt a lot

You are a real gem on KZbin. Your content is rare. I learned so from your videos which can only be found on official documents.

Can we run this code using PySpark?

Nice video, thanks. I tried this on AWS Glue. It is working but it is not able to generate Glue catalog based table + It generated many many small files (It is not automatically compacting)? Have you tried running this on AWS Glue?

Congratulations Soumil and Thank you for excellent content.

HI Soumil, Perfect solution Soumil. So my case, I have some streaming tables same like your demo, and after landing on S3, how can I do join them for further real time analytics ? Can Flink do it by select data from Sink table and join each other for further analytics ?

nope doesn't work, don't waste your time

You will reach more heights soumil… will be there to watch ❤

Sir you are amazing. Thanks for the content...

You deserve it bro

Amazing, I have good experience in Python but no video gave me the right insight or interest to understand these patterns thank you Soumil because of you I have learnt these things otherwise I was running away here and there.....

gtihub link not working

essentially enjoyed

Hi Soumil, I am unable to access the pdf can you help me with that. Thanks

good

what a legend!

can you please put a video on iceberg DR?

very annoying to watch. frequent switching between windows very stressing

Do you bowl as fast as you talk?

Thanks for posting this ❤ it

Hi Soumil, Thank you for your detailed videos. Could you point to any resource that can help setup the IntelliJ for pyspark?

Hey bro I cloned a website and now I am opening that website code in vs code editor but after doing the necessary editing only text is changing not the images. Like I am putting my image URL on the place of website image URL but after saving it and opening it with live server the preview is showing me the images of cloned website not mine and in inspect element it is showing the image code of cloned website not mine why. I am trying from 6 hours and nothing is works for me. Will you plz tell me how can I change the images and edit it.

After installing, when I try to run elasticsearch.bat file it is showing error like \Java\jdk-21.0.1 was unexpected at this time. But my jdk and java bin folder paths setted correctly in environment variables

yes, please slow down yourself in every respect pls

Thanks for the video. It's a good one. Do you have any samples related to the scenario where we have to read the Avro data from a Kafka topic and upsert into the Hudi tables?

amazing work @soumil. Thanks

Hi Soumil, thanks for the video. Using openjdk 11 and Python 3.8. I can't see the table printed when run 'Creating Dataframe from List of Tuples'. Used Jupyter notebook as well as VS code Editor. Any idea.

Hello, I was looking at your video channel. We may be helping a company that uses secure images to increase supply chain security and help cloud native development. Would you be willing to help try their software, make a video, and help show devs how to use their tools? This is not an offer, but just to start a conversation about your willingness to take on sponsorship. Please provide me with your email if you are interested. You'd have a chance to look at their technology and decide if it's the type of software that you'd be interested in covering in your channel.