Losing your Loops Fast Numerical Computing with NumPy

[@ericmacleod8605]

This guy is python gold.

[@cretinobambino]

+Артемий Артемий пшшш

[@ar..alvida...rahman.....al5311]

@Артемий Артемий ৃৃ

[@NicolasJulioFlores]

The fact that he showed that you can do nearest neighbors without a single loop really shows the power of numpy

[@joelcastellon9129]

Jake is a great speaker. Enjoyed and learned a lot from his talks. Waiting for more

[@juangutierrez7366]

We are using his textbook in our intro to data science class, and his writing is also very informative and accessible at the same time.

[@veganath]

Absolutely brilliant, still being appreciated, thank you Jake

[@23489215]

Thanks, very informative, the tips make my program run lot faster

[@JustinHuangA1]

awesome video. everyone starting out with numpy should watch this video. makes so much more sense now to me.

[@sonersteiner]

That is cool man, fortranmagic in ipython notebooks!!!!

[@danbrown6698]

I'm wondering how I can reduce the for loops in my project. And it happens that I met this video😮thanks a lot😁

[@subhendum]

Great talk . Learned a lot.

[@gholamrezadar]

Amazing video! thank you astronomer.

[@nikolaytodorov9785]

What makes it fast is what makes it slow...Zen. Joke aside, 10x for the vid! Useful info.

[@matti1337]

Really great and enlightening talk.

[@jimmorrisshen]

This is awesome. Thanks.

[@yyf234xcvfqew4]

Great talk.

[@VickiBrownatcfcl]

I like the embedded image of the speaker, but not when it obscures part of the current slide. ;-(

[@JonathanObise]

Amazing insight

[@MarkJay]

awesome video!

[@gmaffy]

Great talk. Since this talk, has there been any other methods developed to make loops faster, other than numpy? Anyone?

[@wowepic2256]

Numba and pypy. Also cython

[@nodavood]

Thanks. Very useful tips. But, the nearest neighbors example shows a fatal flaw to losing loops. The diff matrix that you generated, transforms your 1000*3 input to a 1000*1000*3 one. This leads to MemoryError in cases with larger input data. I am sorry, but having a fast loop is still a must.

[@tejvirjogani418]

Can you not work in batches and minimize the number of single operations

[@sapirAO]

Excellent talk.

[@adamhendry945]

The strategies for fast looping begin at 7:15

[@KirillBezzubkine]

23:45 - KNN worth pure numpy

[@johnstarfire]

10:16 it gives me 5.19 ms in pure python and 47.4 us with numpy, python is speeding up or computers are faster?

[@gabestrenk5471]

Are the slides available anywhere?

[@sachinkaps]

What if the data is dynamic? eg a few data points are added every second. So the process might start with no data at the beginning of the day and end up with millions of rows by the end of the day. This is typical for financial time series. I presume insertion of elements or copying would not be very efficient. Is pandas or any other implementation good enough for such use cases?

[@fachofacho5436]

Correct me if i'm wrong, but couldn't you use array slicing to make operations on the array? That is because editing the sliced array edits the array as a whole.

[@jb6395]

what about recursion?

[@greatbahram]

Thank you, I now it's out of dated. But it was awesome

[@bosk1n]

Why is that outdated? Any more effecient techniques out there to make python faster?

[@ibrahimtouman2279]

Good lecture, but it would have been more interesting if he compared NumPy to other competing numerical computing softwares such as Matlab, for example...!

[@drticktock4011]

OR....just go back to FORTRAN (or C)

[@theamrpi397]

Just a doubt though....even if numpy ufunc does take an array as an element....internally should the elements of an array loop to get the output? So is it right to say looping does not happen in numpy?

[@CristiNeagu]

The problem i have is that i use functions that cannot be trivially simplified to ufuncs. Stuff like detecting a rising edge, for example. How do you speed up those kinds of loops?

[@haakonvt]

Cristi Neagu Check out numba!

[@Psycho4Ever666]

26:02 one could also just use D[D==0] = np.inf

[@ScottTsaiTech]

That'd accidentally change the distance between two distinct points that happen to occupy the same space and not just between a point and itself. I think it depends on whether that's acceptable in your model.

[@Psycho4Ever666]

A bit embarrassing, but I haven't thought about that... it was too obvious xD

[@陆得水]

How does X.reshape(1000, 1, 3) - X end up in a result with shape(1000, 1000, 3)? I can't figure it out. Help!!!

[@陆得水]

Figured it out by myself. haha

[@OlumideOni]

Could you explain please?

[@tabtang]

@@OlumideOni docs.scipy.org/doc/numpy/user/basics.broadcasting.html

[@OlumideOni]

@@tabtang thank you

[@RonJohn63]

11:45 How many of these tasks can also be done using itertools?

[@CristiNeagu]

They will be slower than ufuncs.

[@rohitbhanot7809]

Itertools is mainly built keeping in mind memory efficiency and not really execution speed.

[@annamalainarayanan9310]

almost everyone who did numpy knows this - seemingly very basic and nothing hacky!

[@zachs5231]

you should link us to one of your talks anna

[@tam31433]

But he is right anyway.

[@raphaeldayan]

not everyone