Why neural networks aren't neural networks

There is a better way to understand how AIs sort data, process images, and make decisions!
Made for the 2021 Summer of Math Exposition: www.3blue1brown.com/blog/some1
Source code available here: gitlab.com/samsartor/nn_vis
The background music is an excerpt of the endless ambient generative music system "At Sunrise," available at generative.fm/music/alex-bainter-at-sunrise

[@kaisle8412]

"Let's watch that animation again, since it took me so long to make"

[@pradiptahafid]

as someone who is struggling with math, this is the equivalent of Picasso

[@roseproctor3177]

Lol it was a great animation though

[@tielessin]

Honestly, who can not relate haha

[@mickolesmana5899]

fair enough

[@mxmilkiib]

Yelped, paused, rushed to the comments to thumb up the one about that line.

[@CharlesWeill]

Even after doing ML professionally for 5 years, seeing the transformations in this way taught me something new.

[@revimfadli4666]

You might like reading Chris Olah's blog then

[@roygalaasen]

First video? Off to a VERY promising start. This is just great! Hope low numbers won’t deter you from making more. (Or the amount of work.) Hope to see more from you.

[@samsartorial]

Thanks! I don't think I'm going to do a ton more, since it took me like a week of 14-hour days to make. But I was thinking I might do a video on transformers NNs or something unrelated like reactivity in user interfaces once the semester wraps up. IDK, we'll see.

[@roygalaasen]

@@samsartorial I do understand and appreciate that it is a lot of work. I am glad you took the time for this one video at least! 😃

[@piter239]

Is there a way of increasing the possibility of future videos of this exquisite quality?

[@romanemul1]

@@samsartorial Lemme tell you. Noone wants from you to make a video in a week or a month. Just make them slowly. Otherwise you end up like 3b1b . Looks like he is at the end of ideas.

[@RonWolfHowl]

@@samsartorial Those both sound like very exciting topics 😁

[@patrickinternational]

Oh jeez, this is such a great video, I love how you describe the weighting process in NN to actual weights...brilliant. At the beginning you actually describe linear discriminant analysis as well. This is great because NN is really just a series of transforms and this is the best animation I have ever seen, way better than event Grant Sanderson's video on the topic. I added this to the list of all SoME1 videos that I could find. @

[@patrickinternational]

kzbin.info/www/bejne/g6SxgqegaN-JqZo

[@Walkofsoul]

@@patrickinternational Thanks !

[@vtrandal]

Off

[@alejrandom6592]

Not better, but they complement each other

[@Artaxerxes.]

I don't think there's a better video than 3b1bs linear algebra series to understand linear transformations. This video makes sense only if you've understood that already. And it's perfect to watch once you've done that. I wish he makes more because it was very enjoyable although it lasted only for 10 min

[@Riley.Rumble]

This is a great video. I work with neural nets daily and intellectually knew everything you said in this video, but your presentation and visualizations has completely reframed the way I think about NNs. Thank you!

[@KeirRice]

I've been reading about neural networks for years with limited understanding. In 10mins you have given me an entirely new and easier to understand perspective. Thank you so much! Fantastic work!

[@Geosquare8128]

really great! hope you make some more videos :)

[@matejnovosad9152]

Did not expect to find you here

[@matejnovosad9152]

MC Speedrun mods are truly everywhere

[@junkokonno]

based

[@karolakkolo123]

Geosquare go expose some more speedrunning scammers or something

[@edyt4125]

I have worked extensively with linear and nonlinear transformations of abstract geometries, and this is by far one of the best explanations of their correspondence with “neural networks”!! Great work!

[@kaemmili4590]

hey sam , its marvelously clear , fluid and relevant ,we need more of anything you find interesting sincerly -everyone

[@PaulScotti]

As someone who has used neural networks in a research setting, I never even realized that neural networks are actually just a series of alternating linear and nonlinear transformations. Amazing video, hope you make more :)

[@DeadtomGCthe2nd]

How does that happen? Brilliant teaches this.

[@Finnnicus]

@@fuzzylogicq You're very smart 🌟

[@kevinknutson4596]

Very well done video, definitely feels on par with 3b1b's ability to break up and explain complex phenomenon.

[@xxgn]

As someone who took machine learning in college, I have recollections of being surprised when we covered a bunch of techniques and every single technique boiled down to statistics, not only in how they worked but also in proving why they worked (or didn't) for different scenarios.

[@flochforster22]

I understand more about linear and non-linear transformations, why hyperbolic tangent is useful in NNs, and how NNs really work thanks to this video. Awesome work!

[@piface3016]

Hey, just wanted to let you know this is one of my favorite videos on KZbin, I absolutely fell in love with it. I come from Statistics so when I was first learning about "Neural Networks" and found out that the process of "learning" is literally just minimizing a cost function, that it has no magic going on, my thought was "So it's just MLE? It's just a Math thing?" This video is the best piece I've found so far in demystifying neural networks, plus it gives some insight on what's actually going on, besides the usual neuron-layer analogy. That's all!

[@WelcomeBub]

Well the field of AI has many more characterizing questions for choosing machine learning methods and models for a problem. For example how do you incorporate new knowledge/data for a trained neural network? NNs aren't really fit for this job at the moment and require relearning everything with the new samples.

[@EnergyWell]

This video is wonderful. I am very glad you took the time to visualize these transforms into animations. You are a great teacher!

[@JoshuaCowling]

I love your explanation here. This kind of simplification and visualisation an excellent way to break down some of the barriers around machine learning and expose more people to the processes involved, their limitations and applications. Bravo!

[@RichardAlbertMusic]

Excellent! Especially the part „Let’s play this animation again because it took me so long“ 😂

[@rainzhao2000]

I come back to this video often because your animation of an NN transforming the data is just so satisfying.

[@paolopiaser6904]

How is it possible that I watched so many different videos explaining ML without really grasping it, and now this guys with 9 minutes makes it so clear. Thank you. PS. just a clarification: the use of the analogy with neurons was kinda on point at the time it was created, because they were trying to understand how living organisms were self organising, hence also trying to create a model of the neurons and the brain.

[@amitbar2121]

Fantastic video. I’m extremely impressed, especially with that visualization you worked hard on. Great job, hope to see more videos from you soon!

[@vegetablescankill]

What an underrated gem from KZbin recommended! Please make more on similar topics your style and presentation is very clear and interesting!!! Best of luck hope to see this channel grow👍👍

[@jgcornell]

This is frickin amazing, I just completed a postgrad in which we were just expected to accept the transforming data was viable. Whilst I mathematically understood it, I never intuited why - a few minutes into this video you visually slapped me in the face and showed me how it is obviously the same as transforming your boundary! I feel both foolish not to have seen it before and so elated!

[@houcemfehri155]

I can’t believe that this your first video with how much of a great quality it has. Keep making more, you’re amazing!!

[@salmagamal5676]

THISSSSS!! OMG my mind is blown to pieces even though I sort of already knew the information never have I seen anyone put the pieces together like this. My man thank you so much.

[@switzerland]

Your video made it click in my brain like only 3blue1brown could make when explaining the fouriertransforms. My mind is blown, it makes sense now. Thanks.

[@michealhall7776]

This is one of the best videos I have seen on the topic, please make more

[@kyguypi]

This video was great! I hope you take it as a compliment that for a second, I thought I was watching 3blue1brown. I understood activation functions coming in to this, but I still feel that I have even more clarity after your animation. Thanks!

[@TallSchmuck]

Unbelievably amazing video. I thoroughly enjoyed it and learned to look at some parts of AI in a different way. I seriously hope you continue making videos! Great work!

[@LinesThatConnect]

Thanks for this, it demystified the concept quite a bit for me!

[@pjnidoihwklncxsodias]

Great video man! I like the explanation of the backstory of the name. It helps to give the whole concept some context

[@raghavendranimiwal9264]

Great stuff. More power to you. Looking forward to more such amazing videos.

[@stevenschilizzi4104]

Brilliant exposition. Will certainly help to blow away the fog of confusion that other sources may have, or have, generated. Thanks for your hard work!

[@lb5928]

The single best video ever made on machine/Deep learning. Extremely intuitive and practical explanations and visuals. Well done.

[@osten222312]

Great work! Hope to read more from you

[@k2c027]

Such a great video Sam. Thanks for making this 🙏🏻

[@picumtg5631]

even though I do not know how linear transformations work(but this inspired me to do so soon) and only knowing the relevant calculus of machine learning, this is really mindblowing. I see how much thought was put in there and I thank you for your time and wish you a great life

[@jamesdunbar2386]

Extremely well done video. I hope you make more! I've taken some classes in Machine Learning and use some simple NNs at work so I have some familiarity with the mechanics, but it's nice to see the concepts so neatly spelled out! Very illuminating.

[@jjcadman]

Fantastic explanations and visualizations. Thanks for all the time & effort you put into this.

[@TheRealJavahead]

Great video. Keep them coming. This will significantly aid my ongoing “ML is just statistics” campaign. Thanks. Subscribed.

[@pacukluka]

Amazing ! Please keep it up, we have so much yet to learn.

[@1996Pinocchio]

Great video, I especially liked the transitions from one topic to the next, and the animations.

[@mirllewist3086]

Professional Data Scientist here - very well done. And, a useful clarification - too much magical thinking out there regarding AI at the moment. Vids like this are a big help. Thanks

[@iwasjason]

Fantastic video! I love the 3b1b-esque elegance, emphasis on visual intuition, and the build-up to a worthwhile nugget of insight (neural nets aren't magic, just iterated linear and non-linear transformations). Looking forward to your future videos!

[@hcv1648]

You changed my understanding of how I saw neural nets before. Amazed..🙏 would wait for more videos

[@axelsparr8198]

Amazing! Hope you make more!

[@janstaudacher6793]

How you introduced the scale for classifying the fruits by just one number and therefore introduced logistic regression was just pure genius!

[@Bokbind]

Wow, this is incredibly well made! I'm going to subscribe in the hopes you make more like it!

[@finnaginfrost6297]

Absolutely incredible. I also can't think of any berries with those growth patterns. I love how obvious it became that projecting into a higher dimension was important.

[@jakob3267]

This one of the best videos I have seen in a while. I really hope you will make more 🙏

[@Bluedragon2513]

Great visualization; I had to stop what I was doing and watch because I realized it made so much more sense now

[@Artifactorfiction]

This was superb - at some level this demystified for me how the hidden layers do the work - at least when the dimensions are small - just wonderful clarity in this video

[@ApplepieFTW]

Wow, awesome quality and very clearly explained

[@taggosaurus]

2:07 suggestion - probably more clarification needed on logical regression and linear regression terminologies. The word 'regression' pretty much always is used for prediction, not classification. Logistic Regression is a classification method and not prediction, so it's sort of a misnomer due to historical reasons from what I've heard.

[@HighlyShifty]

Fantastic video, it may have taken you a lot of time but it was absolutely worth it! Subscribed in case you do decide to make more.

[@andrewglick6279]

This video is amazing; I'm sharing it with so many people. I've gotten so tired of seeing the nodes/edges diagrams as an explanations of neural networks--I understood that one layer influenced the next one to get to a final result, but it bothered me that I never understood *how* or *why*. Your explanation in this video is exactly what I was looking for. Thank you!

[@DoYouHaveAName1]

AMAZING! The animations and explanation are perfect! Thank you for your hard work

[@19vangogh94]

The video was awesome! Sam, you have gift for this, I can totally see your videos teaching millions in few years

[@alangustav7100]

this is amazing, very good and intuitive animations, keep up this amazing work

[@Killadog1980]

What a great video! And you only have a single upload! How do you make such an amazing video and explanation without previous uploads

[@BlueAgent]

Love the visualisation and explaination. Thanks for making the video. :)

[@iestynne]

What a *fantastic* video! I've watched a large number of videos on artificial neural networks over the past few years... yet I learned such a lot from this one! Such a (shockingly) clean perspective on how these systems work. The choice of the examples and the clarity of the writing and animation are just superb. If you didn't win, it's a travesty.

[@tielessin]

Amazing Video! I started studying AI recently and this has given me a new perspective on the topic.

[@ZubairKhan-sp8vb]

Just awsome!!! I have been thinking about neural networks this way, and how the key word has stuck with this statistical process. You illustrated beautifully just amazing!!

[@TheSubscriberOne]

Wow this is Gold! Thanks for the video!

[@incredulouschordate]

This is seriously the best NN video I've seen, and yes that's after watching 3B1B's series

[@sarthakkhanal6882]

As a teaching assistant for a deep-learning course, I am definitely referring this video to the students. Gives a very interesting perspective into what NN are, and why we use activation functions.

[@heynowyouarearock]

This is the most intuitive video I have ever seen.

[@danhorus]

Great work! Loved the presentation

[@Ahmed-Hosam-Elrefai]

Man! That video to put it lightly, pure awesomeness!

[@weirdsciencetv4999]

This is top notch! Hope you make more educational videos

[@ShantanuSingh-wc4ou]

Please keep sharing your knowledge with us, you are just awesome, and we love your content.🙏

[@audunlarssonkleveland4789]

Im hoping for more videos, the visuals are great and clean.

[@zeuglcockatrice4633]

fantastic video, keep making them! Especially on the topic of AI

[@tophan5146]

Amazing video. Thank you for making it

[@archenemy49]

This is the most beautiful video I have seen in several years. Thank you so much for sharing this enormous observation and perception! Thank you so much!!! ❤️

[@essendossev362]

absolutely beautiful visualizations

[@multimolti]

This is by far the best and most concise introduction to Machine Learning, Deep Learning and "AI" that I've ever seen. Great job!

[@alejrandom6592]

This is gonna be an amazing channel :)

[@andreheynes4646]

This is beautiful. I understand these things better now. Thank you.

[@deepaks.m.6709]

Wow! This is amazing. Thanks for providing a logical perspective for NN's :)

[@konstantint1588]

That was absolutely fascinating and amazingly well done! I'd pay for course about this!

[@toasteduranium]

I thought this was 3Blue1Brown the whole time! Good job!

[@Sydra.]

You made the world a better place with this video!

[@lephuc7087]

Love this video so much, such a high quality product. Thank you!

[@babachico123]

Wow! Awesome video. So intuitive. Thanks a lot

[@robelbelay4065]

Great explanation, very intuitive. Thanks for the awesome content, I've subscribed so I'm looking forward to more

[@bemep0k]

Very interesting video! Thanks!

[@peteraaser370]

This was so thoughtfully put together. Consider me inspired

[@arpitpatel5814]

Best simplification of this topic. Great.

[@dariuszb.9778]

That's why we have "neural" (built from neurons) and "neuronal" (built from a simplistic models of neurons) networks distinction in some languages.

[@MathForLife]

Amazing video! Thank you.

[@IllyNexus]

Thank you for this amazing piece of knowledge Sam Sartor. Subscribed, maybe you are devoting some time in the future for other projects of this type. See ya!

[@Yerocregnes]

I only just recently realized that neural nets were just transformations between dimensions and it made so much click. The idea that there exists an information space that can encode data about whether an animal is a cat or a dog was crazy to me. Keep up the good work

[@anypuppet]

Fantastic video. Thank you.

[@Mrjarnould]

Incredible. Well done!

[@leonardodavid8749]

Excelent video, the statistical side often overlooked.

[@sgaseretto]

Damn I really loved this video! You summerized everything I always say to people when explaining them what artificial neural networks actually are, how they are really different from biological neural networks and why I don't like the metaphor of "neural networks" to describe them, but with great animations! Now I have this reference video to share when someone else brings the topic. Thanks for this really great video!

[@Speed001]

This is amazing. I don't know anything about neural networks, but these are concepts I can understand, at least partially.

[@weirdsciencetv4999]

Please make more videos. You are good at this.

[@forcanadaru]

Ingenious explanation