Python Fundamentals For Data Engineering: Create your first ETL Pipeline

[@nanayaw7159]

This is really awesome

[@ReadyF0RHeady]

you are a legend sir

[@brookster7772]

Nice video what editor plug-in are you using I love it

[@AnujSyal]

I am using iMovie

[@brookster7772]

@@AnujSyal thanks man I’m new to python and I was talking about your notebook file in visual studio code. Thanks man.

[@AnujSyal]

@@brookster7772 That comes in built with Vscode. Use the following syntax to create a cell # %%

[@LordPyro]

Great work! when I try to run import requests, it says No module named requests - what do I need to import to be able to import requests?

[@savichopra9083]

pip install requests

[@senchallengetv4965]

you need to install requests module by using the following: pip install requests

[@Lerahul]

Great content Anuj!

[@travelingsandy900]

That was a very good explanation

[@snapfade]

Excellent video, very clear

[@jeanfabraruiz7994]

This is cool, only one thing missingg and its how to orchestate this, how to setup automation

[@AnujSyal]

Thanks for the suggestion, I do have a video on docker and airflow, maybe that one can give you some idea in terms of automation

[@PradeepPenn]

Thank you Anuj!

[@kamothibedi7650]

This has helps m a lot. Thank you

[@calvinallen8425]

great video and content!!, i want to ask how to make a two database one is database AdventureWorks database, one for Stagging database, and python code of initial ETL and incremental ETL on the phase of Extraction. thank you

[@AnujSyal]

See what pip packages support these databases. I would start from psycppg2. As a last resort you can also check apis by these databases if any and then connect to these using python

[@_Machiavel_]

excellent video

[@iksukekw]

how did you open dataviewer to see the actual dataframe?

[@AnujSyal]

When you configure running jupyter notebook it comes with that. You can see Variables as part of the jupyter environment, and go into each dataframe to check in the values in memory. It is really similar to spyder

[@wayne_vt]

Very helpful

[@parkerrex]

Super helpful, thanks :-)

[@Rock6350]

Hi Anuj, When I try to code this in google Colab. I'm getting error that "name 'transform' is not defined"

[@nakul--]

make sure you have imported it correctly at the beginning of your code. import via : from sklearn.preprocessing import transform

[@AnujSyal]

Yeah Nakul is right, it looks like an import error

[@nitinmadan4009]

SQL on Steroids is pandas, that was a Good one 😅

[@nakul--]

haha pandas is like excel on steriods! lolllll

[@BeingSam7]

Pandas is Excel on steroids. your intro - Voldemort with Nose and fake accent LOL....

[@manojghuge5916]

All good except the fake accent

[@BeingSam7]

No like from him on your comment tells me it is true Lol.