Hi Sir, I have configured all those things you shown in this video. The pipe is in running status but the data was not loaded into the table.

Thank you so much Sanjay for this awesome video

Do we have any snowflake whatsapp group?

Can you send the WhatsApp group link?

What if there's a requirement to archive files after they've been processed.

Hey Can you please guide how to SQL server to Snowflake using Matillion

I’m getting error below: [ODBC Source [2]] Error: SQLSTATE: HY000, Message: [Cloudera][Hardy] (35) Error from server: error code: '1' error message: 'Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask'.;

Hi Sanjay - why storage integration is not done ? is it already done before ?

Nice 👍 video !!

Hi Sanjay, Nice demonstration. I am facing issue, files are getting load when I am manually refreshing pipe. Seems auto ingest not working. Please suggest

Thank you for the video. If I have an on prem oracle database as the source and the frequency with which the data changes is quite high (insert, update and delete) and the current requirement from the client is near real time data insights. so do you recommend using snowpipe to ingest data from azure(adls in this case) into snowflake tables. but what should be the load mechanism or tool or technology used for data ingestion into azure from the source database? Thanks in advance :)

what if the file size is greater than 50 MB? will the pipeline run?

Hey Sanjay, really great video, well explained. Thank you.

Thank you. Very useful

hi, how can we know the name of the snowpipe while loading

Sir snowflake learn enough SQL or python

Hi Sir I cannot join whatsapp group. Please assist 🙏.

I am from NON IT background .. planning to move to IT INDUSTRY. which is the best technology to be choosed.. 1) Snowflakes, SQL 2) power bi, power apps, power automate,SQL 3) POWER BI, (SSIS/ ADF),SQL I am confused to those.. please guide me...

un Structured data should be uploaded to Snowflake and that's it .. using Pyspark

Many tables are needed, and Snowflake Destination Tables should be made separately again.

your video is no longer reflecting the latest changes and cannot be used to establish snowpipe, you should create a new one

how can i configure a snowpipe to grab the same filename from an s3 bucket when the file is refreshed and re-uploaded?

Materialized views are faster than normal views.

hello sir, can you please tell me HOW TO CREATE CONNECT TO DATABRICKS WITH SNOWFLAKE

Hi Sanjay, I have a small question, I am trying to build a dwh pipeline, I got 2 json source files in on an s3 bucket, I created a pipe from s3 to my staging schema but I am not sure how do I continue from here, is there a way to create a pipline between two schemas\ tables or should I create a task + procedure to refresh every few minutes to load the data into prod? Thanks Alex

i have a scenario where two accounts are in same region but diff provider .if we are sharing tables and in consumer account we want to do dml on tables after creating database on share would it be possible?

Hi..so this is for migrating an on premise db to snowflake.. we can use talent job to load daily S3 files to SF right? Donu have any videos on that

So informative

i have tried as per the steps mentioned.but still data is not loading into table

i could'nt get the files from s3 to snowflake inspite of following your process of configs

can anyone help me out? please

can I get these codes? Please

I did the same but unfortunately, my data is not coming in the table. can you help me out?

Sanjay i want sf notes pls give the link

Hi Sanjay ur videos excellent

wouldn't it be faster and more efficient to cut the lambda in the middle, and stream directly from api gateway to kinesis? or what about using a lambda to directly put record onto firehose?

super sir.. very informative.. may be you can slow a bit when explaining things...it helps beginners understand better

Excellent

how to convert sql query to snowsql query with out error?

Very good, Sanjay. 🙏

Your video was informative. Thank you!

for those following along don't forget to include skip_header=1

Do we have to build data model within Power BI if our source for reporting is Snowflake warehouse?

good demo from end to end details. thanks for your efforts

Thank you sir

Nice comprehensive video

Where are the previous videos? I am new to Talend and this is too advance for me. I can't find this "code" thing in the component. More than this I need to incorporate in the email's text the content of some store variable (or the results of running sql server stored procedures). I'd like a video that addresses this. Thanks.

Hi Sanjay can you Connecting SSIS To SNOWFLAKE Using ODBC driver

Great video. Typically in projects we use a Azure SF Storage Integration instead of using a SAS key while creating a Stage.

@Sanjay Kattimani Bro Awesome explanation... 👌 Using this explanation I have created project on my resume using my current ETL project business with additional transformation mapping rules... I can now start marketing my resume for snowflake positions... Thank you so much...