How to Build Python Data Engineering Pipelines with Snowpark

[@avitabayansarma1011]

This was very informative!

[@snowflakedevelopers]

Glad it was helpful!

[@jaysonp9426]

This was so good, thank you!

[@kishorekumarkuruguntla8167]

Great Content

[@snowflakedevelopers]

Thank you!

[@sathwikemmadi4428]

I think this video is helpful but appreciate if you can send other videos for detailed explanation or online documentation.I am asking about the architecture it starts from 07:19

[@luvlifk]

Amazing!!

[@joerozario4406]

If the raw files in csv format, is there anyway to infer the schema without explicitly defining the schema StructType.

[@treyhannam3806]

Is there documentation on the toml file?

[@snowflakedevelopers]

Hi @treyhannam3806, check this out: docs.snowflake.com/en/developer-guide/python-connector/python-connector-connect#connecting-using-the-connections-toml-file

[@bharathraj4545]

Do we need an external cloud storage account to implement this project

[@snowflakedevelopers]

No not at all! Try out the lab today and let us know what you think!

[@rogierhelmus3481]

I would appreciate a video on how to set up the environment , since I get stuck on trying to run the python script for loading the raw data. Edit: I found this video very usefull: kzbin.info/www/bejne/bGmsXqKumq9nfqc&ab_channel=NeuralNine

[@snowflakedevelopers]

While not quite a video, you may find Steps 1, 2, and 3 of the associated Quickstart helpful: quickstarts.snowflake.com/guide/data_engineering_pipelines_with_snowpark_python/#0

[@snowflakedevelopers]

Just a follow up to this. The associated GitHub repo for this demo now uses GitHub Codespaces to automatically provision and set up the environment for you. Check out the updated instructions in Step 2 here: quickstarts.snowflake.com/guide/data_engineering_pipelines_with_snowpark_python/#1