Snowflake - Copy Command Options

[@saikrishna-pt6er]

Thankyou very much.I dont think I can get better channel to learn snowflake in youtube.great explanation on each and every concepts in snowflake.

[@maneendrareddy1791]

Superb explation. Please upload more videos related to snowflake.

[@mrjana520]

Complete snowflake videos available in my channel, follow my playlist

[@mohammedvahid5099]

Sir make video full fledged video with copy command With practical we practice it pleas sir it's very confusion 🙏🙏🙏

[@adinarayanakarra]

Valuable information Sir

[@muralikrishna-gk4hx]

Could you please advise How to handle historical tables part of migration

[@mrjana520]

You can do one time history table load using ETL tools, if ETL tools are not available, you have to export the data from on-premice database to files, place those files in cloud storage and load into snowflake tables. There is no other way than these 2 ways.

[@mdcharm]

Thank You Sir. This is helpful

[@muralikrishna-gk4hx]

Thanks sir is there any video snow pipe on internal name stage please provide

[@mrjana520]

I don't have it

[@LakshmanVarshan]

what is the difference between overwrite = true and force = true?

[@mrjana520]

I don't see overwrite option in Snowflake documentation also :( copyOptions ::= ON_ERROR = { CONTINUE | SKIP_FILE | SKIP_FILE_ | 'SKIP_FILE_%' | ABORT_STATEMENT } SIZE_LIMIT = PURGE = TRUE | FALSE RETURN_FAILED_ONLY = TRUE | FALSE MATCH_BY_COLUMN_NAME = CASE_SENSITIVE | CASE_INSENSITIVE | NONE ENFORCE_LENGTH = TRUE | FALSE TRUNCATECOLUMNS = TRUE | FALSE FORCE = TRUE | FALSE LOAD_UNCERTAIN_FILES = TRUE | FALSE

[@muralikrishna-gk4hx]

Hi sir i try to create snow pipe on internal stage but i am getting error 090040 (XX000): Pipe Notifications bind failure "Internal Stage not supported for auto_ingest" if i am coment on autoingest i am able to create but i try to change my file but i am not seen auto loading here.

[@mrjana520]

the auto-ingest feature only works with external stages.

[@jayasimhabobburu6054]

Sir TQ very much. Pls do a video on realtime how we have to write stored procedure in detail.pls sir

[@mrjana520]

there are 2 videos on Stored procs, check in my playlist

[@anupamadixit1138]

how can we get the sample data in s3? please tell

[@mrjana520]

You can use public s3 data or you have to upload files to your AWS s3 account for practice.

[@UPavan07]

Sir what type of errors are there in files

[@mrjana520]

Watch all videos clearly, you will get the answer.

[@lakshmisr5960]

Can we store the result that we get from copy command into some temp table??

[@mrjana520]

Copy command means, you are already storing or loading the data into some table, it can be a permanent table or temporary table or transient table

[@lakshmisr5960]

@@mrjana520 yeah ..but can we store the results like whether the filewise data loaded or errored out to some other table??? When we execute the copy command, we get an output table that says which all the files got loaded/errored out.. can we store that data somewhere??

[@mrjana520]

When ever you run copy command it gives output as list of files that were successfully loaded and errored out, but the data will be loaded to the table that you have mentioned in the copy into tablename...

[@sunilkumarreddyd479]

Hi Janardhan, I have two queries. 1) how to store limited rows in snowflake table using copy command. Ex. If my file has 1000 records but I want to store 200 records 2) how to store source file name along with data

[@mrjana520]

community.snowflake.com/s/article/Inserting-filename-into-target-table

[@mrjana520]

We can't filter the records while loading into snowflake by using copy command

[@sunilkumarreddyd479]

Thank you, janardhan!

[@sunilkumarreddyd479]

As per your COPY command video, we can only give SIZE LIMIT keyword while loading data file?

[@mounikamallikanti9522]

Sir,i have career gap,i have learnt snowflake in an institute recently.now i would like to work with real time projects to improve my skill.so is there any freelancers or internships on the snowflake?

[@mrjana520]

I am not sure on that, I am just posting my knowledge in youtube

[@mounikamallikanti9522]

@@mrjana520 it's ok sir, thank you.

[@kalyankumar7336]

Hi Janardhan, Can you please that PPT about the copy command.

[@mrjana520]

Contact me on [e-mail]

[@sudhakarsiddu3965]

Please explain some realtime scenarios

[@mrjana520]

Will do once all basic content is completed

[@kanthkk1365]

Nice Explanation Sir.. Can I stage the same file again in to the internal stage. Example earlier I have 10 records in the file but now in the same file records updated in to 20.So want to stage the file to load the remaining records in to the table

[@mrjana520]

Yes by using Force=true option

[@kanthkk1365]

@@mrjana520 Thanks Sir

[@sql-world5536]

please explain clustered key concept

[@mrjana520]

Cluster key video is already available, all snowflake material that is required to clear an interview is available in my channel

[@Kumarveeran123]

you could have done it while running those commands with an explanation otherwise theoretical is always boring ..

[@mrjana520]

But this is the only video I have explained only theory, all other videos I have executed and explained. But people see only black dot on the white paper, it is quiet natural.