Configuring a Snowflake Storage Integration to Access Amazon S3

[@rameshyatham9695]

Nice its useful and working for me. thanks for the video.

[@KnowledgeAmplifier1]

Glad to hear that Ramesh Yatham! Happy Learning

[@madhubanti123]

Hello...Could you please suggest how to avoid expose of iam arn directly into the snowflake code ?

[@satyajit2007]

you mentioned in first minute, you had a video where you created Snowflake Stage by providing S3 bucket and secret keys . Can you share that video link please

[@KnowledgeAmplifier1]

Hello CrimeMasterGogo , you can check this video , here i have created the stage using access key & secret key-- Generating S3 pre-signed URLs using Snowflake with Indepth Intuition kzbin.info/www/bejne/gJmnm6l3YrB0is0 Hope this will be helpful. Happy Learning :-)

[@srinivasch5661]

Hi, I tried to execute the copy command however it is throwing errors as Number of columns in file (4) does not match that of the corresponding table (3), even tried option "error_on_column_count_mismatch=false" still data is not loading.

[@KnowledgeAmplifier1]

This error is indicating that the file you are trying to load don't have same no, of columns as of destination snowflake table , please make sure no. of columns in source s3 (or any other external stage) is same as of the table structure

[@shilpajaiswal4993]

Very well explained,Thanks

[@KnowledgeAmplifier1]

You are wlecome shilpa jaiswal! Happy Learning

[@deepthichebrolu4803]

you just made my day. thanks for teh solution

[@KnowledgeAmplifier1]

Glad to see such inspiring comment Deepthi Chebrolu! It made my day 😄✌Happy Learning & have a great new year ahead !

[@deepthichebrolu4803]

@@KnowledgeAmplifier1 i tried the same but my external stage is always showing empty

[@deepthichebrolu4803]

@@KnowledgeAmplifier1 don't know where iam making mistake

[@KnowledgeAmplifier1]

@@deepthichebrolu4803 do you really have any file in external stage ?

[@deepthichebrolu4803]

@@KnowledgeAmplifier1 hi, i just figured it out...the policy file had few issues

[@raoazurecloud3775]

How can I connect with you? I need your help

[@KnowledgeAmplifier1]

Hello Rao azurecloud, please check this doc (doc.clickup.com/37466271/d/h/13qc4z-104/d4346819bd8d510) , for any Snowflake related topic explanations , if your require any topic which is not available or doubt not solved , then please post your doubt here , If I know I will surely try my best to help you asap.

[@tej8442]

Snowflake storage integration object for secure access to aws s3 external stage location. getting this error SQL execution error: Error assuming AWS_ROLE. Please verify the role and external Id are configured correctly in your AWS policy. i have updated external id and aws aen of snowflake generated in trusted entity of aws roles

[@tej8442]

@knowledge amplifier looking forward to hear from you little bit urgent

[@KnowledgeAmplifier1]

@@tej8442 if you followed the video properly but still getting error , then please check whether the s3 data is kms encrypted or not , if kms encryption is there , you need to provide kms decryption policy to the created role also ...

[@tej8442]

@@KnowledgeAmplifier1 my S3 bucket doesn't have any data and default encryption was disabled still facing same issue

[@satendra9rathore]

awesome bro

[@KnowledgeAmplifier1]

Thank you Satendra Rathore! Happy Learning

[@abdullahsiddique7787]

Pls give the file git hub path

[@KnowledgeAmplifier1]

Hello Abdullah Siddique , the code is available in the description box of the video , not explicitly uploaded in Github , but sharing the Github link if it helps for other Data Engineering related topics -- github.com/SatadruMukherjee/Data-Preprocessing-Models Happy Learning