Snowflake - External Stages - Working Session

  Рет қаралды 18,596

Janardhan Reddy Bandi

Janardhan Reddy Bandi

Күн бұрын

Пікірлер: 40
@devinanda4136
@devinanda4136 Жыл бұрын
Amazing explanation.Thanks
@mayanknema3007
@mayanknema3007 2 жыл бұрын
It woule be really great if you can make one more videos on Stored Procedure & Views. With your style of teaching, this would help many to understand the concept of snowflake in easier way.
@mrjana520
@mrjana520 2 жыл бұрын
Views video is already available, will upload stored procedures and UDFs very soon..
@mayanknema3007
@mayanknema3007 2 жыл бұрын
@@mrjana520 ..Wooorr great. Waiting to get some crucial lessons on stored procedures. Just one request - Please use SQL language to create stored procedure instead of Javascript. So that we can align from our SQL knowledge also
@DHswathi
@DHswathi Жыл бұрын
Brother pls tell me what is the schema....
@yamunau.yamuna5189
@yamunau.yamuna5189 Жыл бұрын
Really all my doubts of stages have cleared with this video thank you so much bro, your videos are very helpful who are searching for job in snowflake technology
@amani8893
@amani8893 Ай бұрын
Thankyou .. it is very informative
@devinanda4136
@devinanda4136 Жыл бұрын
Hi Janardhan, while loading from external file from other source or sample s3 data like we are doing now, how will we know beforehand about column details or field delimeter etc?
@mrjana520
@mrjana520 Жыл бұрын
We have to get from file in s3, there is no option in snowflake
@mrjana520
@mrjana520 Жыл бұрын
docs.snowflake.com/en/user-guide/querying-metadata
@seemanews
@seemanews Жыл бұрын
How to create runtime landing tables / stages depending upon header columns and data in csv from s3
@mrjana520
@mrjana520 Жыл бұрын
We can write a python script or use some ETL tool, there is no direct way in Snowflake
@pratikthole2414
@pratikthole2414 2 жыл бұрын
In Last example we did not mention any FIE_DELIMETER as , then how data loaded successfully ??
@mrjana520
@mrjana520 2 жыл бұрын
Default field delimeter is , no need to mention if your files are comma separated
@rajashekar4882
@rajashekar4882 Жыл бұрын
Number of columns in file (1) does not match that of the corresponding table (6), use file format option error_on_column_count_mismatch=false to ignore this error
@ShobhaPoojariM
@ShobhaPoojariM Жыл бұрын
It's helped me a lot.
@ThirumaleshNiraganti
@ThirumaleshNiraganti 3 ай бұрын
Hi, I tried checking the publicly accessing s3 bucket named as bucketsnowflakes3 in aws s3 bucket but didn't find it also tried directory bucket tab. pls help on this so that it will help us to use all those free files for practice.
@mrjana520
@mrjana520 3 ай бұрын
I am able to access the public S3
@DHswathi
@DHswathi Жыл бұрын
Sir don't mind pls tell me what is cluster and schema .... I want word meaning clearly
@mrjana520
@mrjana520 Жыл бұрын
Schema contains tables, views and other database objects and relationships among those tables. Watch my video Micropartitioning and Clustering to know more about cluster...
@UPavan07
@UPavan07 Жыл бұрын
sir here we dont know what rows are there in Orders table (In stage object) but we simply created a table with headers that we dont know even exists in Orders file what happens if the headers mismatch or Can we access the files in stage object even before creating the tables
@mrjana520
@mrjana520 Жыл бұрын
In general or in real time, you will have access to external locations like s3 buckets, Azure blob, so you can see the file structures, need not to worry
@karth2882
@karth2882 7 ай бұрын
​@@mrjana520, what if there are 50 columns, how to create table of those many columns in snowflake?
@SaiKumarGaddam-g3x
@SaiKumarGaddam-g3x 7 ай бұрын
how to view the tables present in the s3 bucket without loading the data into snowflake How exactly we can know the column present in the tables to create in snowflake
@mrjana520
@mrjana520 7 ай бұрын
You can't view the file content from Snowflake. In real-time you will have access to your cloud and you can see the file content from cloud itself, need not to worry.
@shaikjakeer1347
@shaikjakeer1347 2 жыл бұрын
Sir which snowflake your using while we install snowflake account we are not able to see this formate
@mrjana520
@mrjana520 2 жыл бұрын
Enterprise edition hosted on aws cloud
@mysteriovvn
@mysteriovvn Жыл бұрын
Excellent way of teaching. If possible can you share the excel shown for Snowflake objects parameters?
@mrjana520
@mrjana520 Жыл бұрын
Reach me on jana.snowflake2@gmail.com
@epuriraghavendra3847
@epuriraghavendra3847 Жыл бұрын
What happens if we specify both files and pattern in COPY command
@mrjana520
@mrjana520 Жыл бұрын
It will consider the files you have mentioned, but just think why one will mention both in real-time
@manideepsrirangam
@manideepsrirangam 2 жыл бұрын
How do we move data from Snowflake to External Stage (S3). Is there any other process for that? Also, can we schedule this data transfers? One last question, what will be the cost from snowflake side? Will it be computation, data transfer or anything else?
@mrjana520
@mrjana520 2 жыл бұрын
There is a one video in my channel with name: Unloading data, there I have explained how to unload data from Snowflake to AWS S3. For scheduling you can watch my Tasks video.
@mrjana520
@mrjana520 2 жыл бұрын
You can get all videos, PPTs, queries and files in my Udemy course. I will be updating this content and will be uploading all new videos in this course. My Snowflake Udemy Course: www.udemy.com/course/snowflake-complete-course-for-clearing-interviews/?couponCode=F1C5F3C67C25DFC40841 Use below coupon to get 100 rupees discount on my course. Coupon: F1C5F3C67C25DFC40841
@Jas-ib8dh
@Jas-ib8dh Жыл бұрын
Hi, How to load table from Azure ADW to snowflake using ADF
@mrjana520
@mrjana520 Жыл бұрын
Sorry, i am not sure what is Azure adw, but we can load data from any other database to snowflake by using snowflake connector available in ADF. www.snowflake.com/blog/snowflake-connector-for-azure-data-factory-adf/
@venkatakrishna9333
@venkatakrishna9333 2 жыл бұрын
hi sir where to download these type of files in internet through practice purpose
@mrjana520
@mrjana520 2 жыл бұрын
I can be reachable on jana.snowflake2@gmail.com
@upendravemula7901
@upendravemula7901 Жыл бұрын
Sir... how do we differentiate Named Stage and External Stage?
@mrjana520
@mrjana520 Жыл бұрын
If you watch both videos External stages and Internal stages, you will get the answer for this question
Snowflake  - AWS Integration
40:41
Janardhan Reddy Bandi
Рет қаралды 26 М.
Snowflake - Data Loading and Transforming while Loading
1:00:49
Janardhan Reddy Bandi
Рет қаралды 33 М.
Support each other🤝
00:31
ISSEI / いっせい
Рет қаралды 81 МЛН
Mom Hack for Cooking Solo with a Little One! 🍳👶
00:15
5-Minute Crafts HOUSE
Рет қаралды 23 МЛН
How to Stage Data in Snowflake
16:19
Sean MacKenzie Data Engineering
Рет қаралды 2,3 М.
Snowflake - Internal Stages and Snowsql
59:50
Janardhan Reddy Bandi
Рет қаралды 21 М.
Querying 100 Billion Rows using SQL, 7 TB in a single table
9:07
Arpit Agrawal (Elastiq.AI)
Рет қаралды 58 М.
Snowflake - Unloading Data - Working Session
30:00
Janardhan Reddy Bandi
Рет қаралды 9 М.
Fast Data Loading & Bulk Ingestion in Snowflake | Chapter-9 | Snowflake Hands-on Tutorial
58:23
Snowflake - Caching - Working Session
1:17:00
Janardhan Reddy Bandi
Рет қаралды 11 М.
Support each other🤝
00:31
ISSEI / いっせい
Рет қаралды 81 МЛН