Snowflake - Code Deployment/Migration Using GitHub Schema Change

Рет қаралды 5,893

Күн бұрын

You can get all snowflake Videos, PPTs, Queries, Interview questions and Practice files in my Udemy course for 499 rupees.. I will be updating this content and will be uploading all new videos in this course. And you will have lifelong access to these videos and materials.
My Snowflake Udemy Course:
www.udemy.com/...
Use the coupon below to get it for 499 rupees.
Coupon: BD5C217109E85F629675
-----------
Git Commands:
1) To initialize/start git
git init
2) To clone the repository
git clone repo-link
3) To pull only modified files to desktop
git pull repo-link
4) To switch to other branch if needed
git checkout dev
-- Now add/modify the content from any IDE or Desktop
5) To view all the uncommitted changes
git status
6) To add the changes after adding/modifying the content
git add .
7) To commit the changes
git commit -m "Comments"
8) To push the changes to GitHub
git push -- by default it pushes the changes to the branch we are currently in
git push branch-name -- To push the changes to specified branch
9) To merge the changes to main/master branch
git merge main/master
(In general we may not have access to merge to main/master branch directly, so we have to create a pull request and get it approved by the lead or the one who has approval permission and then merge it to main/master branch)

Пікірлер: 37

@nagaa225 10 ай бұрын

Great Janardhan you are really helping people by sharing valueble and useful at work.

@PremKumar-wy3mx 9 ай бұрын

Thank you so much for all the videos sir😊 Finally completed the playlist successfully !

@SaiPhaniRam 9 ай бұрын

Excellent session. Thank you !!

@mohammedvahid5099 6 ай бұрын

Hi Bro can u explain about DBT and how it works?

@manisha4130 10 ай бұрын

Thank you sir. Informative content👏

@vaaradhiind 10 ай бұрын

Please do the video on error handling complete cycle

@special5b8 7 ай бұрын

Very good explanation sir

@Ajjeshh 10 ай бұрын

Thanks for this information. Could you pls demo ELT pipeline. databricks with snowflake integration. EL - databricks Transformation - snowflake

@mrjana520 10 ай бұрын

I never worked on Databricks

@Snowflake_Redefined 6 ай бұрын

Very Good explanation

@dayakarreddy4212 10 ай бұрын

Hi Sir, Your videos are very good and understandable for many people. I want to ask you, sir, how to connect with you.

@sunandakumar9024 5 ай бұрын

Hi Jana, If we need to deploy multiple .sql files at one go then how the versioning to be given?

@mrjana520 4 ай бұрын

This script is for simple deployments. You have to improvise the script to deal with below things, I will explain when I write. 1. To deploy multiple version files at a time 2. To deploy different kind of objects like, tables, views, procs, stream, stages, tasks, dml files etc.

@LaxmanKumar-zf4sc 9 ай бұрын

Informative session. is it possible to share the yaml file?

@dayakarreddy4212 10 ай бұрын

Hi Sir, Please do one complete video on stored procedures and how to handle errors.

@mrjana520 10 ай бұрын

will do

@manaskumar9196 9 ай бұрын

Hello sir, wanted to ask that knowing snowflake / snowpro core certification will be helpful in data analyst role or it is only viable for data engineering roles. Thanks

@mrjana520 9 ай бұрын

Mostly Data engineering projects

@karthickmallan891 10 ай бұрын

Hi Sir, if we move the code using github repository, it would be security. banking domain would be preferring this?

@mrjana520 10 ай бұрын

What kind of security issues, all most all companied maintain their private code repositories and they will have MFA enabled at snowflake side.

@karthickmallan891 10 ай бұрын

@@mrjana520 ok. If they maintain their private code repository it would be fine. In my project we are using the internal stage for deployment purposes. Deployment team will move the.SQL file into stages then they use command like execute immediate from '@stage/script.sql'. whatever object mentioned in SQL file it will be created.

@mrjana520 10 ай бұрын

That means you are not following devops and ci/cd. Whatever you are doing is old way of doing

@ranjitvarikuti 11 күн бұрын

Can you share the YML script?

@mrjana520 10 күн бұрын

name: snowflake-migration-demo # Controls when the action will run. on: push: branches: - main paths: - 'deploy/**' # Allows you to run this workflow manually from the Actions tab workflow_dispatch: jobs: deploy-snowflake-changes-job: runs-on: ubuntu-latest steps: # Checks-out your repository under $GITHUB_WORKSPACE, so your job can access it - name: Checkout repository uses: actions/checkout@v2 - name: Use Python 3.8.x uses: actions/setup-python@v2.2.1 with: python-version: 3.8.x - name: Run schemachange env: SF_ACCOUNT: ${{ secrets.SF_ACCOUNT }} SF_USERNAME: ${{ secrets.SF_USERNAME }} SF_ROLE: ${{ secrets.SF_ROLE }} SF_WAREHOUSE: ${{ secrets.SF_WAREHOUSE }} SF_DATABASE: ${{ secrets.SF_DATABASE }} SNOWFLAKE_PASSWORD: ${{ secrets.SF_PASSWORD }} run: | echo "GITHUB_WORKSPACE: $GITHUB_WORKSPACE" python --version echo "Step 1: Installing schemachange" pip install schemachange echo "Step 2: Running schemachange" schemachange -f $GITHUB_WORKSPACE/deploy -a $SF_ACCOUNT -u $SF_USERNAME -r $SF_ROLE -w $SF_WAREHOUSE -d $SF_DATABASE -c $SF_DATABASE.SCHEMACHANGE.CHANGE_HISTORY --create-change-history-table