Snowflake - Data Loading and Transforming while Loading

[@mohammedvahid5099]

🙏ur real man who seen on market and good person sir ❤ ఇంత సబ్జెక్ట్ ఎవరు ఫ్రీ గా చెప్పరు sir meeru always happy ga ఉండాలి ❤ our blessings always with u❤️

[@mrjana520]

Thanks brother for wishes, I wish you all the very best.

[@saicharan8495]

kzbin.info/www/bejne/sHLFgZmmpt6HjNU

[@charlesa9431]

You are very good at what you teach please keep it going.

[@vg.venkataramana2025]

Thank you for your knowledge Share sir.

[@pretty_pets_07]

Excellent ga explain cheysyaru anna everyone will like your presentation. Keep explaining on more topics. God bless you anna🙏🙏🙏

[@saicharan8495]

kzbin.info/www/bejne/sHLFgZmmpt6HjNU

[@Dubai_Cnu]

Sir, i am not able to get the data from s3 bucket how to create s3 bucket?

[@VarunKumar-xt4jq]

Crystal clear explanation

[@jagadeeswarareddynetapalli3662]

Great Effort.Nice explanation

[@saereddy]

Super Anna,,, mind lo dhigindhi.

[@saicharan8495]

kzbin.info/www/bejne/sHLFgZmmpt6HjNU

[@yamunau.yamuna5189]

Crystal clear explination thanks bro

[@azada.k958]

Great Sir,

[@ranganatho707]

Great videos, please share details on snow pro core certification in our country

[@UPavan07]

sir during the time of creation of free trail i have selected Azure instead of AWS is there any way to change it now

[@mrjana520]

Not possible, but you can create another account with AWS

[@UPavan07]

@@mrjana520 ok sir

[@nagaa225]

Who will takecare of archiving file once it is loaded into snowflake table

[@mrjana520]

You can set up auto archive mechanism from cloud side or you can manually do it in regular intervals.

[@SudiptaTripathy]

Nicely explained :). Very helpful

[@RK-wf7re]

Nice content. Is Snowflake can be used as a ETL tool also like informatica, abinitio?

[@mrjana520]

Not completely, but supports most of the extract transform and load operations

[@RK-wf7re]

@@mrjana520 Thank you. So it is mainly used as database only.

[@sudhakarkunchala7928]

What is stage? Onve the schema is created again stage created that means stage is like table?

[@mrjana520]

No, watch full video of external stages and internal stages video for full details on stages.

[@sudhakarkunchala7928]

@@mrjana520 thanks nenu chusathanu,if I want to became the data enginer,what skill need to learn?

[@Satyanandan_D]

If I want to load data every day without my intervention, Can I run this copy command everyday using any scheduling tool? or Do we need to keep this command in script?

[@mrjana520]

You can use tasks for scheduling queries, tasks is an inbuilt feature of Snowflake

[@krishanajangid1763]

Can you see publicly S3 bucket files ?

[@mrjana520]

No

[@ranjith335]

While creating external storage, facing below error: Failure using stage area. Cause: [Access Denied (Status Code: 403; Error Code: AccessDenied)]

[@mrjana520]

Send the queries you are using to my mail id - [e-mail]

[@atlasrinu2215]

Nice Video. Please make a demo on how to migrate database/schema/tables from Dev to Test environments.

[@mrjana520]

Will try

[@ashokrajann9351]

Hi sir My understanding is Bulk load can be done using an external stage and we need VW for that Continuous load can be done using internal stage by using snowpipe feature Snowflake itself offer/support snowpipe Please correct me if am wrong

[@mrjana520]

That is not correct, watch external stages and internal stages videos as well, you will get answers

[@ashokrajann9351]

@@mrjana520 sir Bulk load can be done either by external or internal stage. Bulk load needs VW and no snowpipe to process huge data Continuous load processes small amount of data and does not need VW It requires a snowpipe which is a serverless feature (it has a separate cost) Now my understanding is correct sir?

[@mrjana520]

Yup

[@sivakeshavvardhan]

good morning sir u r classes superb explanation but i have one doubt miru code running chesthunnaru kada a code ekada nundi techi akada petti run chesthunaru , akada memu stop ayyi unamu code ela techi run cheyaali ani pls help me sir

[@mrjana520]

Video cheyyadaniki mundu nenu ppt and code(queries) prepare chesukuntanu kada. Based on requirement nenu queries rasi proper ga run ayyela chusukovali kada

[@mrjana520]

Queries ekkadanunchi ravu, maname prepare chesukovali, video live lo queries type chese time vundadu kada anduke munde raaukuntamu

[@sivakeshavvardhan]

i am sorry sir i can't see the Description queries there thank you sooo much sir giving u r knowledge ,lots of helpfull for snowflake students thanks a lot good job sir😍

[@Buddy14143]

Bro I have a doubt in this video regarding 5 th case ,in SQL we have set identity insert on/off option .In snowflake also is it working or not?

[@mrjana520]

AUTOINCREMENT and IDENTITY are synonyms in Snowflake, you can use either of these.

[@Buddy14143]

@@mrjana520 Thanks for replying janardhan garu Thank you so much

[@praveen5281]

in case2 and case3 copy command you used s.$1,s.$2. what 's' refers to. can we use $1,$2 directly

[@mrjana520]

You can use directly, s is just alias name

[@mayanknema3007]

Can ypu please tell me if there is an issue with data loading because of size & many users? How we can deal with this situation?

[@mrjana520]

There is no limit on file sizes, but Snowflake recommends to split and process the larger files. and coming to many users there will be no issue if you are using a multi clustered warehouse.

[@mayanknema3007]

@@mrjana520 ..but what to do when there is a performance issue with Snowflake?

[@Nenuhappy]

Hi sir Can we directly load the data from S3 to Snowflake with out creating the External stage and Storage integration?In your example you have directly loaded the data

[@mrjana520]

Yes, pls watch the video fully, you will get answer for your question..

[@ATIFKHAN-mz4fp]

thanks sir can you able to post snowflake vacancy videos its more help full

[@mrjana520]

I am not aware of vacancies

[@divityvali8454]

Can you paste this workshets in description

[@mrjana520]

there is a limitation on Description, can't paste entire PPT or code. You can get all snowflake Videos, PPTs, Queries, Interview questions and Practice files in my Udemy course for 499 rupees.. I will be updating this content and will be uploading all new videos in this course. And you will have lifelong access to these videos and materials. My Snowflake Udemy Course: www.udemy.com/course/snowflake-complete-course-for-clearing-interviews/?couponCode=0C8E557D4EB94D407F5A Use the coupon below to get it for 499 rupees. Coupon: 0C8E557D4EB94D407F5A

[@skdonsingh]

Thanks Janardhan for your videos. Its very helpful and your knowlege and teching skill is excellent. I have already subsribed your channel. Apart from subsribed ,there is option of Join . I want to know how can I join and what would be its benefits.

[@mrjana520]

Hi currently there are no benefits of joining the channel as I am providing videos publicly, not only to members

[@NitinKumar_up_se]

how to create url like s3://

[@mrjana520]

Watch AWS integration video for details

[@mohammedvahid5099]

Bro CSV files ఇవ్వండి practice కోసం మరియు ఎలా s3 bucket లో csv files load చేసి roles మరియు policies create చేసి arn attach చెయ్యాలి చూపించండి 🙏

[@mrjana520]

That part was explained in AWS-Snowflake integration, please watch that video. I have uploaded videos on all concepts, follow snowflake playlist in the order.

[@mohammedvahid5099]

Thnk u❤ sir

[@m.s.krishnamurthykitta]

TQ....ANNA

[@mohammedvahid5099]

Sir please give me the CSV files to practice 🙏

[@mrjana520]

I can be reachable on [e-mail]

[@vinodbarma2858]

please upload videos in sequence, its hard to understand for new learners

[@mrjana520]

All videos are in order in my Snowflake playlist..