So You Wanna Be a Pandas Expert? (Tutorial) - James Powell | PyData Global 2021

[@arnoldwolfstein]

I saw James Powell, I clicked. You always learn something from this guy, at least it refreshes your knowledge.

[@DuarteMolha]

James Powell has this uncanny capacity to make me feel like a dummie every time I see this presentations. Half of it just goes right over my head

[@nccamsc]

Now that is a true expert. A breath of fresh air compared to the countless others who only stay at intro level.

[@grigorytrofimov6513]

I watched this video more then 3 times over, every minute of it is valuable :)

[@sahilsharma-hj4gq]

please give a tutorial on how to understand this tutorial

[@cjsveningsson]

Had it playing in the background, and with a complete straight face at 16:00 he accelerates like a bat out of hell, figuratively leaving me in a dust cloud (switching to action replay to eventually catch up). Hilarious and epic! 🤩

[@NormanBaatz]

Two hours worth watching. Twice. The tutorial I needed to finally "get" Pandas.

[@stiankarlsen1409]

Inspiring! Took me two days to watch this, but I've learning so much. Didn't come here to learn about the path and subprocess modules, but I had to learn how you created the dataframe with file paths and line numbers for the pandas module!

[@pedramparsian3945]

God, I love his presentations.

[@djchrisi]

Thank god for the playback speed = 0.75 option! First time it was really useful.

[@mraxilus]

I normally watch things at 2x, this was the first time I had to use 1x in a long time.

[@pedramparsian3945]

@@mraxilus exactly 😂

[@longtailfinancial1282]

Epic presentation!! Looking forward to the follow up, thanks James!

[@dariuszspiewak5624]

With data frames and series it works OK but one has to remember that the operations are respectful of indexes. Yes, indexes are the key to efficient manipulation of data frames and series. It makes perfect sense once you understand this. We do want this to happen in data analysis - aligning data frames by indexes AND COLUMN NAMES. This makes operations predictable without relying on the order of rows/columns. When there are duplicates in indexes, joining takes place between corresponding values and this is why they get cross-joined. It makes perfect sense from the point of view of data analysis. SQL joins work exactly the same. And indexes, even though pandas allows duplicates, should not have duplicates. There are functions and safety vales in pandas that can notify the user automatically that indexes are not unique. Pandas is a very well thought and design API but one has to dedicate some time to understand the underlying principles. As usual :) There are many functions in pondas, like, say, 'transform', 'apply', 'agg', because they are supposed to do DIFFERENT things. For instance, 'transform' will always return the result of the computation with the same shape as the input data (which is very, very useful in so many situations), whereas apply is free to return ANYTHING. There are very good reasons, as I've already pointed out, to have these specialized functions do different things instead of having just one giant function that takes million arguments. Another thing you're missing, James, is that pandas allows for the fluent style of programming. Without these functions and functionalities, you'd be stuck with very ugly code and you'd litter it with variables, myriads of variables... This is what essentially happens with your numpy code :)

[@lbermude]

anyone getting stressed about the tea getting cold?

[@arnoldwolfstein]

lol. definetely.

[@modakad]

Anyone has the code / pdf of this session ?

[@morenoh149]

1:13:30 what is a series and a dataframe

[@pamdemonia]

So much information. Thanks!

[@indrabhushansingh2914]

how you execute the code in just by navigating down under multi line comment?

[@vladimirkraus1438]

How can someone be such a great programmer AND stylish presenter at the same time?

[@andywub]

when that's their job

[@longtailfinancial1282]

Can you explain your IDE? Is that Vim+TMUX?

[@arnoldwolfstein]

yes, as far as I can see, since it's similar to my workflow.

[@ytcdi]

@@arnoldwolfstein Could you tell me more about that setup? It looks great to be able to execute parts of code on demand like this.

[@weavermarquez1271]

@@ytcdi it also looks like emacs with the py-live module

[@AkaExcel]

Dear James, thank you for lesson, it would even greater if you could speak a bit slowly, as many people here from international audience.

[@arnoldwolfstein]

settings->playback speed->0.75

[@jeffrey5602]

The only thing wrong with this presentation is him not using regular jupyter notebooks. Like I get people thinking they need to use vim for fking anything, i tried myself to use it for anything interactive with python but all the options suck in the end. I love vim for anything webdev or developing python, but not for interactive stuff. LIke I dont even care what he uses in his free time, but when you make educational content and there is a tool which more people are familiar with and which might be easier for the viewer to understand then maybe dont use vim. dont get me wrong, i love all of his videos and watched many multiple times, the educational value is gigantic. But in this one maybe just use jupyter :/

[@BingbongRecto]

Dude writes python code like an R user

[@JoshJetson]

I don’t think James likes pandas 😂

[@gardnmi]

Would be a more effective tutorial if it was presented in a notebook.

[@it_is_ni]

Would be slower though. I love the pacing.

[@arnoldwolfstein]

nope, notebook is not as powerful as vim+tmux (+theirs plugins)

[@Jakub1989YTb]

This was mindblowing! Every minute was packed with 1 hour of average youtube tutorial content. Great talk. I recommend a "sibling" talk to this one, "So you wanna be a Python expert" also from d.u.t.c.