Snowflake Zero Copy Clone | Chapter-15 | Snowflake Hands-on Tutorial

  Рет қаралды 35,128

Data Engineering Simplified

Data Engineering Simplified

Күн бұрын

Пікірлер: 100
@srinadhg8397
@srinadhg8397 2 жыл бұрын
The way you explained with live examples is awesome.
@DataEngineering
@DataEngineering 2 жыл бұрын
Glad you liked it!
@nishavkrishnan4271
@nishavkrishnan4271 2 жыл бұрын
I am just done with Chapter -15 also. Waiting for your remaining videos to continue with my learning. Appreciate all your hard work! Thank you!
@DataEngineering
@DataEngineering 2 жыл бұрын
Will upload soon
@AkmalHussain-fb3dr
@AkmalHussain-fb3dr Жыл бұрын
Great Content, professional delivery and a very effective approach. Great service to the community indeed. Thank you very much for your great work. You are awesome!
@ॐनमःशिवाय-ख9ल
@ॐनमःशिवाय-ख9ल 7 ай бұрын
Same here! Even in udemy and pluralsight we can't find one of such content.. love to have a complete structured tutorial.
@sketchstudios05
@sketchstudios05 7 ай бұрын
Very nice series, I am following whole playlist and this is the best snowflake training I ever came across
@Sweety_24
@Sweety_24 Ай бұрын
Thank you so much for the clear explanation. I have one doubt-could you please tell me what the important topics in Snowflake are for a data engineer role that I should revise or cover?
@justvenkyy...3423
@justvenkyy...3423 7 ай бұрын
great explanation with examples. please create real time projects choosing the right service.issues encountered and performance improvements.
@maniobulreddydumpala9482
@maniobulreddydumpala9482 2 жыл бұрын
Thank you for your efforts sir... Loved the way you're explaining
@DataEngineering
@DataEngineering 2 жыл бұрын
You are most welcome
@vishwasrock4809
@vishwasrock4809 Жыл бұрын
Your videos are amazing. I am having one doubt with cloning, I have updated the cloned tables but still active bytes are 0. I tried many times but result is same. Could you please explain why it is showing 0 active bytes for updated cloned table.
@PriyadharshiniKumarakrishnan
@PriyadharshiniKumarakrishnan Ай бұрын
I have created seq_objects with start=2 and increment=2. While inerting initially 100 records it inserted with the correct sequence order. But after a time period inserted another 2 records the sequence are not order after the last. seq_no, order_status 2,F 4,O 6,P . . . 200,F --after second insert the next record should insert with 202 but snowflake taking 402 402,R Someone say why?
@akhileshprajapati899
@akhileshprajapati899 5 ай бұрын
Awesome Explanation, But SQL Scripts links are not working, it states "You don't have permission to access the resource "
@krishnateja345
@krishnateja345 5 ай бұрын
Hi am learning a lot from your content, Appreciating for your efforts. the way you are providing the content is simply superb and am very happy for that and thank you so much. one thing is like am unable to access the scripts which you have shared in the description getting 401 Error. could you please allow me to access the scripts.
@srikamalit
@srikamalit Жыл бұрын
Nice. Do you have a cheat sheet or matrix that shows what is feasible and not feasible?
@jimitmehta5985
@jimitmehta5985 Жыл бұрын
Excellent explanation... I had a question...Can you list down account level objects and schema level objects?
@haridatta5495
@haridatta5495 Жыл бұрын
perfect explanation, loving the series. have a question on the micro partitions, when we have CDC how will snowflake maintain inactive and active micro partitions?
@mahaprasadmohapatra5208
@mahaprasadmohapatra5208 2 жыл бұрын
Please make a video on optimization methods used in snowflake to handle complex queries.
@DataEngineering
@DataEngineering 2 жыл бұрын
Sure, will do it soon,
@dineshgudla3735
@dineshgudla3735 Жыл бұрын
Well Explained with good examples, you are ankit bansal of Snowflake..
@DataEngineering
@DataEngineering Жыл бұрын
Thanks...
@abdullahsiddique7787
@abdullahsiddique7787 2 жыл бұрын
Thanks buddy for the in depth video , however iam unable to access the sql scripts link you have provided , can you pls help with it?
@DataEngineering
@DataEngineering 2 жыл бұрын
Thank you 🙏 for watching my video and your word of appreciation really means a lot to me. Let me check why the script link is not available in the website. ⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡ I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. 🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI 🌐 SnowPro Guide ➥ bit.ly/35S7Rcb 🌐 Snowflake SQL Series Playlist ➥ bit.ly/3AH6kCq 🌐 SnowPro Question Dump (300 questions) ➥ bit.ly/2ZLQm9E
@abdullahsiddique7787
@abdullahsiddique7787 2 жыл бұрын
@@DataEngineering thanks for reply mate can u pls let me know how’s the snowflake job market now
@DataEngineering
@DataEngineering 2 жыл бұрын
@@abdullahsiddique7787 Snowflake is the future
@mayanknema3007
@mayanknema3007 2 жыл бұрын
Thank you so much for creating this Snowflake tutorial. It's extremely useful and stands out from the rest of the content on KZbin. Could you please advise on how to troubleshoot any errors that arise as a result of a format mismatch while loading data? So, In the case of numeric data types, for example, instead of 98765, we have 987lm. You can also suggest any tutorial videos that have addressed this issue.
@DataEngineering
@DataEngineering 2 жыл бұрын
Thanks for watching my videos.. for such field, you have to first take them as string (varchar) and then apply transformation to convert them. Snowflake does not provide any direct way to convert such text into proper number.
@mayanknema3007
@mayanknema3007 2 жыл бұрын
@@DataEngineering .. Thank you very much for your kind reply..!! By any means can we deal with any other formats mismatch in snowflake ❄️?
@mayanknema3007
@mayanknema3007 2 жыл бұрын
​@@DataEngineering I am facing many doubts in snowflakes while loading data. Can you please share me the contact details of someone with whom i can connect and clear all of my doubts? I'll be so grateful to you and I am ready to pay also
@DataEngineering
@DataEngineering 2 жыл бұрын
@@mayanknema3007 Not sure what is your challenge.. feel free to drop additional note to my insta account (instagram.com/learn_dataengineering/)
@tru3sk1ll
@tru3sk1ll Жыл бұрын
Can a snowflake clone every become the new master? For instance if I drop the source what happens?
@justvenkyy...3423
@justvenkyy...3423 7 ай бұрын
it would be nice if you provide quick summary at the end of video which is like recap.
@michaelcalimag9688
@michaelcalimag9688 2 жыл бұрын
cool snowflake learning. do you have other videos for the advance data engineer and architecture?
@DataEngineering
@DataEngineering 2 жыл бұрын
Thanks Michael... I am yet to think about advance courses for architect...
@RohitKumar-tq3ts
@RohitKumar-tq3ts 2 жыл бұрын
Hi....do u also have a video/upcoming video on Account and Security topic as well?
@DataEngineering
@DataEngineering 2 жыл бұрын
Not sure what do you mean by account, however I reqeust you to watch ch-7 (kzbin.info/www/bejne/hpqWq2SErqeXY7s) and ch-3 (kzbin.info/www/bejne/f6DGlZqLd55ngbM). Security is advance topic and I am planning to make a dedicated video around it in future and security is not part of this playlist bit.ly/3iNTVGI
@RaulMuciño
@RaulMuciño 10 ай бұрын
Greate course work! I have a question: Is any compute cost associated with cloning?
@DataEngineering
@DataEngineering 10 ай бұрын
No.. closing is metadata level operation..
@subbareddyreddy2427
@subbareddyreddy2427 2 жыл бұрын
Can you please make videos on stored procedure
@DataEngineering
@DataEngineering 2 жыл бұрын
Sure @Subba, planning to make it soon.
@subbareddyreddy2427
@subbareddyreddy2427 2 жыл бұрын
Can u also explain a real time project
@JKTathe
@JKTathe Жыл бұрын
How to create procedure to clone db objects between two snowflake environment to keep data synchronised?
@DataEngineering
@DataEngineering Жыл бұрын
Cloning object cross account is not possible, so it will not be possible via stored procedure. Have you tried it via manually? or I misunderstood the question here, please correct me if that is so....
@kusumamathi9812
@kusumamathi9812 2 жыл бұрын
Your Videos are just awesome..... Can you pls clear my below doubt Can we clone a table after dropping it(we should not use undrop table) , This table has time travel of 3 days for example? Note: I tried to clone above eg table using time travel feature at (statement) with query id referring to active sate of table prior to dropping. It is giving me error as obj doesnot exists.
@DataEngineering
@DataEngineering 2 жыл бұрын
if you drop a table, then it is no more visible in the context (account>>db>>schema) and hence cloning does not work for those objects which are not visible in the context. You have to undrop it and make the object visible and then initiate cloning operation. And you Kusuma, thank you 🙏 for watching my video and your word of appreciation really means a lot to me. ⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡ I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. 🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI 🌐 SnowPro Guide ➥ bit.ly/35S7Rcb 🌐 Snowflake SQL Series Playlist ➥ bit.ly/3AH6kCq 🌐 SnowPro Question Dump (300 questions) ➥ bit.ly/2ZLQm9E ⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡
@kusumamathi9812
@kusumamathi9812 2 жыл бұрын
@@DataEngineering Thanks for your prompt reply, I am following your series and suggested to many of my friends. Learned lot from your videos, Your way of explanation and classification of topics are too good.
@DataEngineering
@DataEngineering 2 жыл бұрын
@@kusumamathi9812 Thanks for sharing my videos with others, this helps a lot.
@sperumalla3288
@sperumalla3288 9 ай бұрын
Hi, I am trying to access the script file and facing an access issue. Can you help share the link for the scripts?
@saileephadtare8043
@saileephadtare8043 2 жыл бұрын
Rollback operation can be performed on clone table and can we capture how many times clone happen if I set a task to clone a table every 1 hr?
@DataEngineering
@DataEngineering 2 жыл бұрын
Never thought of this situation, will experiment and come back to you. There is a field in the information table where you can check the clone and clone-id and you can track it.. but never tried it. But what is your use case.
@sandhyaranipradhan8527
@sandhyaranipradhan8527 Жыл бұрын
Can I get all the sql worksheet you r using while creating these videos
@shubhamjoshi6608
@shubhamjoshi6608 2 жыл бұрын
Please add a video for unstructured data . i.e working with JOSON data. Json data that comes from external stage. and how would clone work with JSON data .
@DataEngineering
@DataEngineering 2 жыл бұрын
Will do in future.. keep watching this space. There are lot of JSON processing content videos and blogs available, do you think they are not good or does not give good view about JSON processing.. pls help me with your understanding.. then I can make some good video around it..
@mazsoum
@mazsoum 2 жыл бұрын
Are Stored proc and UDF also cloned when cloning a database or schema?
@DataEngineering
@DataEngineering 2 жыл бұрын
Yes, these objects are also cloned. You can try it out.
@chaitanyakrishna5873
@chaitanyakrishna5873 2 жыл бұрын
Excellent Bro..Thanks alot!!
@DataEngineering
@DataEngineering 2 жыл бұрын
You're most welcome
@visshalgupta
@visshalgupta 2 жыл бұрын
Hi what is the alternative for like any in snowflake ?
@DataEngineering
@DataEngineering 2 жыл бұрын
There are few like firbolt etc.. but not sure if they are as powerful and feature rich like snowflake.
@thevayusdiary
@thevayusdiary 2 жыл бұрын
SQL scipt link is unsafe. Also I visited your page, this chapter is not present. Please help
@DataEngineering
@DataEngineering 2 жыл бұрын
Let me check and come back to you... thanks for your note.
@sidhharrthajain4216
@sidhharrthajain4216 2 жыл бұрын
Issue with accessing sql script, Giving 401 error. Could you please resolve. or share a git hub link for all the scripts.
@saisumanthnagasuri7741
@saisumanthnagasuri7741 2 жыл бұрын
If the source table get dropped ,still the cloned table exist for quering?
@DataEngineering
@DataEngineering 2 жыл бұрын
Yes, clone table still exist and you can still query it.
@tableaututorialstips71
@tableaututorialstips71 6 ай бұрын
What is table_schema=ch15 ?
@rajeshraxz9571
@rajeshraxz9571 2 жыл бұрын
I could not acess the SQL script It's showing 401 unauthorised Pls send the SQL scripts for our practice..thanks Your videos are awesome We gain good knowledge on your Chanel
@DataEngineering
@DataEngineering 2 жыл бұрын
Let me check and confirm you
@rajeshraxz9571
@rajeshraxz9571 2 жыл бұрын
@@DataEngineering still its showing 401error code ,can you solve asap
@suryag7597
@suryag7597 2 жыл бұрын
information provided is very good and helpful simply 5 rating vedio
@DataEngineering
@DataEngineering 2 жыл бұрын
Thank you 🙏 for watching my video and your word of appreciation really means a lot to me. ⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡ I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. 🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI 🌐 SnowPro Guide ➥ bit.ly/35S7Rcb 🌐 Snowflake SQL Series Playlist ➥ bit.ly/3AH6kCq 🌐 SnowPro Question Dump (300 questions) ➥ bit.ly/2ZLQm9E ⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡
@neerajtiwari1695
@neerajtiwari1695 2 жыл бұрын
as usual .. Good work Gentle man and very deep explanation I have some questions 1. if external stage can cloned , can i create a new external table on cloned external stage 2. if stream got cloned , it will be a new _clone stream object , Now if any changes happens to base table data it stream will capture the same , does _clone stream object will also reflect the same ? 3. same question as above about pipe cloning , new pipe object will created with suspended status , if we enable this it will point to same stage and table ? if yes then enabling the clone pipe may create situation where , pipe and cloned pipe loading data to table 4. same query goes for task also , if we enable the cloned task object ? as both pipe and task is object which point to a object , does not have its own data ins storage , how both behave , if cloned object of task and pipe is enabled ?
@DataEngineering
@DataEngineering 2 жыл бұрын
Here is the answer for your questions 1. Yes, you can create external table using external stage creating via clone. 2. Yes, the cloned stream will just be line normal clone object and it will track as a normal stream object. 3. True, and copying pipe need to be done with keeping that idea in mind, but you are right. 4. Yes, you are true and for pipe/task, they make more sense for db or schema level clone but individual level cloning of pipe or task don't make much sense.. Thanks for these great questions..
@neerajtiwari1695
@neerajtiwari1695 2 жыл бұрын
@@DataEngineering Thanks for your answer , Now next question , when is next video getting release :)
@DataEngineering
@DataEngineering 2 жыл бұрын
@@neerajtiwari1695 it take a week to work on it..
@saisumanthnagasuri7741
@saisumanthnagasuri7741 2 жыл бұрын
Hi, if the source table get dropped,still the cloned table exists for quering?please give the clarification 🤗🤗
@saisumanthnagasuri7741
@saisumanthnagasuri7741 2 жыл бұрын
If the source table is dropped , when we do querying on cloned table from where the data is coming and where it is stored since we dropped source table
@madhusudhanchinnala6352
@madhusudhanchinnala6352 Жыл бұрын
You are Great sir👏🙏
@DataEngineering
@DataEngineering Жыл бұрын
thanks
@sukumarreddy4150
@sukumarreddy4150 2 жыл бұрын
One more 5***** video. thanks a lot for your priceless efforts sir. here I have query can we do clone view/secure view objects
@DataEngineering
@DataEngineering 2 жыл бұрын
Thanks @sukumar. You can not use clone keyword for views. The statement if you run "create or replace view my_view clone source_view; " will end up with error SQL compilation error: syntax error line 1 at position 37 unexpected 'mvw'. syntax error line 1 at position 40 unexpected ';'. Howevever, if you clone a schema or db, it will be cloned and the last section of the video covers it.
@sukumarreddy4150
@sukumarreddy4150 2 жыл бұрын
Thanks a lot for your quick response 🙏🙏🙏.
@lalitdeshawal8097
@lalitdeshawal8097 Жыл бұрын
I am not able to access script link getting 401 error, please check this
@ChandraSekhar-hm9wh
@ChandraSekhar-hm9wh 2 жыл бұрын
what happened if you delete source object. If you write select statement on cloned object how to get data from source object
@DataEngineering
@DataEngineering 2 жыл бұрын
Nothing happen if you delete the source object. the internal reference is not deleted.
@ChandraSekhar-hm9wh
@ChandraSekhar-hm9wh 2 жыл бұрын
where it store internal reference, it will store into cache??
@DataEngineering
@DataEngineering 2 жыл бұрын
@@ChandraSekhar-hm9wh cloud service layer - pls check my ch-3 video - bit.ly/3sk2fB2
@laxmikant97
@laxmikant97 4 ай бұрын
Very nice.
@paknadeemful
@paknadeemful 2 жыл бұрын
AWSOME
@DataEngineering
@DataEngineering 2 жыл бұрын
glad you liked it...
@ketanrehpade9150
@ketanrehpade9150 2 жыл бұрын
hello , can you plz provide the SQL script , it is not accessible . also it is not available on website...please update it....Thanks
@DataEngineering
@DataEngineering 2 жыл бұрын
My site had some issue.. will release it soon (probably later this week) and will let you know the URL
@kirankumar1290
@kirankumar1290 9 ай бұрын
Good presentation
@shubhamjoshi6608
@shubhamjoshi6608 2 жыл бұрын
How clove works with VIEWS . you didn't cover that . please make a video on that too.
@DataEngineering
@DataEngineering 2 жыл бұрын
You can not clone views as views will be build on the top of many data set... and view does not hold any data.... Watch my view chapter - kzbin.info/www/bejne/aKTShayYhL-ejrs
@minanathpagire4687
@minanathpagire4687 2 жыл бұрын
Could you please sed me link for exam question for practice
@DataEngineering
@DataEngineering 2 жыл бұрын
My site had some issue.. will release it soon (probably later this week) and will let you know the URL
@jana5959
@jana5959 4 ай бұрын
Can anyone here give me the link to data in database that is used?
@vikasgadhave5992
@vikasgadhave5992 2 жыл бұрын
can you please provide the access to sql script. to my ID?
@DataEngineering
@DataEngineering 2 жыл бұрын
will share it via my website..
Snowflake Data Sharing | Chapter-16 | Snowflake Hands-on Tutorial
25:02
Data Engineering Simplified
Рет қаралды 41 М.
How To Choose Mac N Cheese Date Night.. 🧀
00:58
Jojo Sim
Рет қаралды 97 МЛН
А я думаю что за звук такой знакомый? 😂😂😂
00:15
Денис Кукояка
Рет қаралды 4,6 МЛН
What is Snowflake Time Travel | Chapter-14 | Snowflake Hands-on Tutorial
31:13
Data Engineering Simplified
Рет қаралды 34 М.
#13 | Micro Partitions & Data Clustering In Snowflake  | Snowflake Hands-on Tutorial
35:50
Snowflake Tasks & Task Tree | Chapter-18 | Snowflake Hands-on Tutorial
28:43
Data Engineering Simplified
Рет қаралды 39 М.
you need to learn SQL RIGHT NOW!! (SQL Tutorial for Beginners)
24:25
NetworkChuck
Рет қаралды 1,6 МЛН
Snowflake Stream & Change Data Capture | Chapter-17 | Snowflake Hands-on Tutorial
27:52
Data Engineering Simplified
Рет қаралды 53 М.
Snowflake Unique Features | Chapter-6 | Snowflake Hands-on Tutorial
25:41
Data Engineering Simplified
Рет қаралды 78 М.
Snowpark for Python | Snowflake Tutorial
28:18
Aimpoint Digital
Рет қаралды 33 М.