Neural Networks from Scratch - P.1 Intro and Neuron Code

Building neural networks from scratch in Python introduction.
Neural Networks from Scratch book: nnfs.io
Playlist for this series: • Neural Networks from S...
Python 3 basics: pythonprogramming.net/introdu...
Intermediate Python (w/ OOP): pythonprogramming.net/introdu...
Mug link for fellow mug aficionados: amzn.to/2xcyfPC
Channel membership: / @sentdex
Discord: / discord
Support the content: pythonprogramming.net/support...
Twitter: / sentdex
Instagram: / sentdex
Facebook: / pythonprogramming.net
Twitch: / sentdex
#nnfs #python #neuralnetworks

[@sentdex]

Errata: ~10:26 - The animation depicting the number of tune-able parameters counts biases as if the input neurons have biases. They do not. For example, the 10x8x8x8x2 neural network has 26 biases (8+8+8+2), not 36.

[@reversev9778]

sentdex makes sense

[@sentdex]

Already did one :p www.kickstarter.com/projects/sentdex/neural-networks-from-scratch-in-python

[@anilsharma-ev2my]

Sheree yantra show similar structure 3+ 3+ 3+ om om om 🙏🙏🙏

[@andrexsintoval3776]

i wanna create a neural network with at least 1000 outputs

[@andrexsintoval3776]

but first i got to build up some money cause i only got a intel i5 6400 cpu then again... i could set my gpu's workload to computing my motherboard has a gpu as well so i shouldnt have a problem doing that

[@jamessmith2288]

“What I cannot create, I do not understand” - Richard Feynman. My motivation for watching this series.

[@aaronsanders6162]

Stfu tool

[@varundivi7383]

@@aaronsanders6162 lmfao imagine getting mad at some one making an effort to learn.

[@donovanvanderlinde3478]

@Aaron Sanders Must be hard to have such a bad case of lil peen syndrome

[@endoflevelboss]

@@aaronsanders6162 well said.. he thinks quoting an intellectual makes him clever

[@overloader7900]

"I created it, but i do not understand it" - programmers

[@arturasdruteika2628]

Dropping this video is such a big news that even if aliens landed today it would be the second most important thing that happened today

[@sentdex]

Only because the aliens are already here, obviously. ;)

[@aaronvr_]

@@sentdex that's something an alien would say

[@AnshulSharma-md5ut]

@@sentdex and nobody cares because this happened

[@Jakub1989YTb]

They did land. In fact, they are watching here with me right now. Were having such a good time. They want to know all about Python.

[@clementsiow176]

@@sentdex I am the alien oh yeah yeah

[@alfredm.s.6396]

We need more people like you. And you know what? You are making them.

[@isaacandrewdixon]

I just wanna say that I love your channel so much and that people involved with deep learning are literally making the world a better place for everyone. I'm excited to see what the future holds.

[@ericmeehan298]

This is one of the highest quality programming tutorials I’ve seen. Even online courses from universities aren’t this well made made. Thank you for putting this together!

[@sentdex]

Thank you, that means a lot

[@kushboi442]

@@sentdex no u

[@michaels8297]

@sentdex much love man!!!

[@acidtears]

Universities typically include scientific papers to read to develop a deeper understanding of why certain things work the way they do. Nevertheless, this is by far the best series on developing fundamental skills in NN programming!

[@ericmeehan298]

@@acidtears you can get all of that for free on the Internet.

[@heyrmi]

Me: opens youtube. KZbin: Sentdex- Neural network from scratch. Me: Opens the link faster than the speed of light.

[@ndn5656]

The problem with being faster than light is that one can only live in darkness.

[@MrBoubource]

@@ndn5656 Best comment of the day award !

[@user-nj4pq1bl2b]

You just time traveled

[@AnshulSharma-md5ut]

@@ndn5656 that's not true if you are traveling at the speed of light . There still will be light reaching your eyeballs but everything will gonna slow down .

[@rohansingh1057]

Well guessing from your profile pic, you indeed seem faster than light.

[@thorvalld]

I'm just 30 seconds into this and paused to tell you how much I appreciate your work, I can't thank you enough or begin to describe how much your content have helped me to better myself as a developer, you're awesome, keep it up! Cheers from the fjords of Norway !

[@ethanmcrae]

Years ago you were the first person to be able to break through that barrier for me and taught me how to code and made it fun. Glad you're still making vids!

[@Daniel-pg3qo]

This looks simply awsome so far, soooo excited to see the series grow

[@refrefwgwgwegew]

The way you structure your videos is so helpful, looking forward to more of your AI/ML content in python. Subbed!

[@lady_bananya]

I found this channel today and I'm actually in love, how simply and swiftly you explain things, also considering all levels of viewers 'expertise'. Thank you so much, gonna impatiently wait for next video! ♥

[@andrewfierce2703]

I’ve been trying to learn Python and ML. Thank you for this. As a visual learner, I really appreciate the walkthrough. It helps so much. Subscribed!

[@farenhite4329]

Can I just say how thankful I am for this? Most tutorials are either very basic and don’t tell much, overload you with all the math upfront, tell you to import tensorflow and not tell you why it works. Thanks for this middle ground tutorial, something that is really needed.

[@shrideepgaddad8721]

This has been something I have been waiting for in a long time. Keep it up my guy

[@ravitejau6691]

Huge respect for you to come up and make people understand everything in bits and pieces. Recently , I have started working on RNN and i feel it is a complex thing. I also believe there could not be any other tutor who can best explain it like the way you do. The animations are lovely. The coding part is explained in as simpler way as it can be done. Its my sincere request for you to make a video about RNN implementation . Love from India.

[@ashutoshmahajan7199]

You've become more interactive and it feels as you are connecting more to us than the previous videos. Obviously, no doubt about your teaching since beginning! You've saved me through a lot of Data Science assignments. Love from India ! Please visit India after the pandemic!

[@caio-jl6qw]

Oh man, this series of videos is going to be such a masterpiece.

[@sahminay4587]

Extremely helpful, I've been finding it frustrating to "just use" certain functions in whatever someone else has already solved without a deep understanding as to why they came to that conclusion of what to use and why. Thank you for taking the time to start this series.

[@HomeBologn]

I love the way that the little vein on your temple bulges out when you give the exact versions of the packages that you're using. Seriously though, love your work. I've watched a ton of your content. You've helped my Python programming immensely.

[@hemanthkotagiri8865]

Finally! Been waiting for this! Thank you so much for releasing this in the quarantine period.

[@TimWebb-discchord]

Your timing on this is fantastic. I've been dissatisfied with High-level super-abstracted ML, so I taught myself Calculus and I've been studying neuroscience. My goal is to design ML "circuits" inside of neural networks, and specialize their design in the same way our own neurons are arranged by speciality. I love all your other videos and can already see how this is going to help me bridge the gap between neuroscience and Python.

[@astrix8812]

I literally got goosebumps when i saw the notification. Thanks man keep rocking!

[@hackercop]

Love how your video and animation quality has improved over the years, it now look really pro. Looking forward to following this series!

[@ikechukwumichael1383]

Most tutors don’t have the patience to make stuffs simple but this right here just affirmed, everything should be made as simple as possible, but no simpler. Thank you

[@sachinsinkar7]

Perfect utilization of LockDown Period, Revise the things from the person who taught you in the past. Thanks, Sir. Love you 3000..!!

[@quantizedmediasystems7701]

I have a solid science background in Physics and mathematics and this is the first time that I came across a lecture which explains why, what , when and how deep learning is from the basics. I am not a fan of memorizing things that I cannot extend in the future. Sentdex, you are on point and these video series have broken the backbone of deep learning for me. Thank you

[@yashkarbhari721]

Wow, a sudden change in the graphics, thats very cool. Keep making videos related to Neural Networks, Pls !! I needed it a lot, all the good courses are paid else where and your channel is like a gem. Thanks

[@tommiewaters]

so happy your doing this man. sound out. going in dept into a topic and asking why is what i do on a daily basic and you have nearly a million like minded people hear. hope you hit 1 million subs

[@tobiaslint8061]

Can't thank you enough for all the stuff you put on. I'm actually working as an Dev for two years now and everything started with your Pygame tutorials. Thanks man!

[@sentdex]

Happy to do it!

[@vympel2732]

I already know I'm gonna love this series

[@danillohenriquedeoliveiram9246]

I am amazed by how simple you made it seem. It shows that you have complete comprehension of the subject!

[@dandeunlimited9663]

Bro I absolutely love your channel. Bumped into it battling with generating tf records due to tensorflow installation for object detection. This is a phenomenal channel, will surely watch a video day from now on. Love from Zimbabwe.

[@ckames22]

Awesome 👍 perfect timing as well as we are all stuck at home

[@OrionAerospace]

this is such a hype! cant wait for the rest of the series

[@leonlysak4927]

Your ability to explain things simply is nothing short of amazing man.

[@navidmohammadzadeh2141]

I am very happy to hear from you after a long time. Since ever, you are the frontier in the way teaching python and machine learning i.e. deep learning included.

[@user-bo5vr1ib6i]

This is definitely one of the best programming tutorials I've ever watched. Instead of bombarding you with complex math, you take a very pragmatic path and expect minimal knowledge beforehand. This is probably the video definition of "you don't know what you're talking about until you can explain it to a five-year-old".

[@prodigy4836]

Can't thank you enough for the great content you are putting out ! I want you to know that you are making a huge difference in people's lives.

[@sentdex]

My pleasure!

[@jeduthunoosthuis5794]

Truly blown away by this channel, thank you for the work you are putting in.

[@hasneetsingh]

I am seriously thankful to you for creating such valuable content, all this time it's been my dream to learn to program deep learning networks. This series is all what I ever wanted. :)

[@CraftingRedstone]

Really love how you’re teaching the mathematics behind deep learning... think this will lead to a lot of innovation

[@sentdex]

Hope so!

[@seno7904]

@@sentdexin been searching for a vid going into the math as I don’t understand it yet(still in high school) so I hope this is as good as the comments say

[@randiaz95]

@@sentdex Bro this could've been the trigger for CHATGPT and other ai explosions in 2020+

[@yesno2696]

​@@randiaz95no they started long before.

[@TheAlternativeDuck]

I hope to be able to make a simple network that can identify colours in the future, nothing else. Thanks so much for the tutorial

[@michaels8297]

You’re a hero...edit: Update: I’ve been hopping on some friends zoom courses on AI for a pretty elite university(won’t say which one) and you absolutely SMOKE the professor with your ability to teach. I don’t know if people wrote you off when you were starting out but you have certainly proven yourself as one of the GOATS

[@imveryhungry112]

agreed

[@gameshark0703]

I am so happy you are explaining the basics of neural networks, I always hated just jumping into tensorflow and not knowing anything about whats going on under the hood. Thanks!!!!

[@stirlingsmith2744]

Found this channel a week ago with the pytorch tutorial. A fair amount went over my head so can't wait for the rest of this series. keep up the great work!

[@sentdex]

Welcome aboard!

[@isuryanarayanan506]

this is what ive been waiting for my man , you made me a full stack developer now make me a machine learning developer

[@sentdex]

Glad I could help :D

[@zareef5583]

The kind of tutorial I've been looking for. Can't wait for more videos in this series.

[@emmacooper9241]

I decided to create a neutral network for image recognition from scratch, for my A-level NEA and I have been trying to find a starting point for it for quite a while now; searching the internet, reading books and looking at past students NEAs. This has helped so much (relieved alot of stress too), definitely going to continue to follow this series for my NEA. Thanks so much!

[@TheOriginalJohnDoe]

No university in the world beats this top quality of knowledge for free. You go man! You don't know how much your time and effort you put into this has been appreciated. Machine learning and neural networks are hard because of the intense logic behind it, even though I've been programming for 5+ years now. This really does the heavy lifting for many people. Thanks!

[@ilikethatboulder.thatisani5496]

almost as if the university and or certs are just for validation

[@FagunRaithatha]

Thank you sir, you are just great. I learned Django from you. I hope this series is as good as that one.

[@gapedbrain7738]

5 years ago, I started programming watching your videos, working a shit job. now I’m a data engineer looking to get into data science. super excited to watch through this series. thanks for what you do.

[@robertkeithbeach]

A friend just introduced me to you. After about 6 minutes , I am inspired. I use python (also self taught) but don't consider myself a great communicator. I believe I can learn to be more like you and then achieve more traction in my pursuits. Thank you for being you!

[@billfujimoto5905]

I like the graphics, reminds me 3Blue1Brown channel! What is the tool that you are using for this?

[@sentdex]

That's because.... it's built on top of manim ;), which is made by 3b1b. Learn more here: github.com/3b1b/manim

[@vijayabhaskarj3095]

@@sentdex You should do a tutorial on Visualization using manim, that would be great!

[@MisraPreetiman]

@@vijayabhaskarj3095 Y E S S S S

[@ramakanthrama8578]

@@vijayabhaskarj3095 Hi Vijay !, are you the same person who wrote the Flow from data frame in Keras ??

[@vijayabhaskarj3095]

@@ramakanthrama8578 Lol, yeah. That was a long time ago.

[@sadhlife]

essence of linear algebra is a pretty epic course here on youtube to clear up your matrix and vector fundamentals

[@rahulkumarjha2404]

After watching this video I am super excited for the second part. You are among the few people (Andrew Ng, 3Blue 1Brown & Jason Brownlee) who have explained neural networks in such an easy way.

[@AM-jx3zf]

Thank you, sentdex. You are a great teacher. I was looking for this for some time, and there's very few teachers that explain the logic behind things

[@harleyspeedthrust4013]

I wrote a Java library for deep ANNs (from scratch) that implemented vectorized forward propagation and backpropagation. It honestly was such a useful thing because I know so much more about neural networks now

[@mwanikimwaniki6801]

Any links to that?

[@vishvambarpanth2888]

"Why would anybody would want to do this to themselves?!!"....lmao,loving this series already!!

[@silenth1806]

I don't know where I would be without this guy. thank you so much for all you do.

[@DecisionForest]

Great video! Loved how you broke down the computation of the loss function and pretty much all the explanations are really easy to follow.

[@lucasfontes7914]

Most of the videos that I've find here use librarys or frameworks, but learning from scratch is the best option in my opinion since we can adapt better to other tools, so I'm really excited to see this series.

[@sentdex]

Totally agree!

[@triducal]

and more fun

[@SaxaphoneMan42]

le me, starting out in python a week ago: "Oh this looks like a cool video, bet I wont understand it." me 6 minutes in: "Ok good he knows I don't understand any of it."

[@sentdex]

...but you will! :)

[@siddhant997]

The little detail of ensuring to provide the versions of libraries used, loved it

[@codebond]

Best series ever saw on KZbin thanks alot man I was searching long time for something like this.

[@damienw4958]

I come from 10 years in the future, we used this tutorial to rebuild society after the Corona Cataclysm!

[@sentdex]

LOL

[@alpman6883]

Not LOL, i think It's True

[@yaron3479]

Yes.

[@christophebeaulieu4916]

I come from the past, what's the Corona Cataclysm? Was beer involved?

[@abhishekgourav6144]

I come from present....and i am sitting on my couch watching you two play past and future shenanigans

[@peeratchaikleebbua7723]

This is exactly what I want. There are a lot of framework in this field. And each framework has its own advantage and disadvantage. I usually think that if I have to create new framework or have an idea, how I can do that. I would like to know the deeper level in this field. Thank you very much for creating this series. I will watch every episode for sure. Hope that you can deploy your own framework too. Hahaha

[@sentdex]

We're not planning to competitively release a framework, but, we ...could... ;)

[@shafayhaseeb5849]

Let's go! I already know there's gonna be so much to learn and enjoy. This dude is amazing ✌️

[@lucasandrescosta391]

Just as i wanted to find some tutorials about this it turns out you started a new series about the topic! What a coincidence!

[@Scottagram]

"Now this is all very simple maths. But I'm gonna explain it anyway" BLESS. I'm a uni dropout who installs safety signage for a living, so it is profoundly and deeply helpful when a tutorial doesn't assume that competent beginner programmers know any maths.

[@EshwarNorthEast]

Omg! The God Of Programming has listened to our requests! Neural Networks from scratch is here! 😍😍

It is a thing for over 3 months now and started as KickStarter campaign and people do already read draft of our book :D

[@EshwarNorthEast]

Kudos!

[@loganbrunner4762]

Very interesting series. I will definitely be watching this series. Very excited to learn new stuff! Thank you!

[@mattjhawken]

My favourite series to this day. Thank you sentdex!

[@Stinosko]

Thank you so much for this! 🤠

[@sentdex]

You're so welcome!

[@AshutoshSingh-nl5pq]

the wait is finally over...

[@sentdex]

Except for ... the wait to part 2 :)

[@marinmiletic5780]

@@sentdex how often do you plan to upload?

[@marinmiletic5780]

@@sentdex did you just like my comment? that is the biggest cock block i have gotten in my life

[@ApplepieFTW]

@@sentdex how long should we expect to wait between parts? I'm excited

[@ahmedhany5037]

This will be BIG, great job sentdex !

[@gabrielgardin2592]

OMG sentedex is even better!!! I started to learn python with him 5 years ago, and now I'm back to find even more great content! Thanks a lot!

[@Mohit-nw5jr]

I really needed this specially in this lockdown! Thanks a lot (: Love from India❤️

[@sentdex]

Happy to share!

[@reimeytal2734]

Thank you for making this series. I have always been hesitant to use the frameworks since they don’t show what’s happening behind the scenes. I just have one question. How often are you going to upload these video? (What is your upload schedule?)

[@sentdex]

No official schedule. Soon as they're ready. Weekly or a few a week is my target, but my main focus is on doing it right rather than adhering to any schedule.

[@Artificial_Intelligence_AI]

- nice tools for visualizing the examples - easy and complete explanations from scratch - an instructor with a decent amount of experience - low requirements to follow the series - a nice yellow box with a question mark in the background After running a simple model with the previous variables, the output told me this was going to be the best tutorial on neural networks ever made.

[@tissuepaper9962]

This is the kind of series I've been looking for for years! Everybody seems to want to make something high-level and abstract, and nobody wants to make anything low-level, it's so infuriating.

[@calebcarr3030]

"This shouldn't really be over your head" Me, a high school student who has never coded before: *sweats profusely*

[@MrWongWey]

Same dude I just a saw this video in my recommendations and now I’m listening to alien languages.

[@GeneralKenobi69420]

>high school student Well there's your problem

[@tornado9560]

I’m in 9th and I code but I still didn’t understand much.

[@ifmondayhadaface9490]

Tornado I’m in 9th and I understood it decently.

[@MrWongWey]

@@ifmondayhadaface9490 Do you code?

[@vyomaudichya]

Need help in my assignment in creating a constituency parser using Recurrent neural networks taking penn tree bank as ground truth. Any advice will be helpful. thankyou

[@go_better]

Thanks for the series! I've been looking for something like that for so long!

[@lukefidalgo8154]

Thank you so much for this! This is a field I recently took interest in and I never really knew where to start, so this series is perfect for me!

[@sentdex]

Great!

[@noneedtoknowthishandle]

God himself teaching us nn. Love from India🇮🇳

[@gazpacho59]

NOTE THIS BEFORE STARTING... although excellent by every measure, the series abruptly stops unfinished. This is a wonderful guided tour out of Hobbiton, but you will have to hike the rest of the way to Mordor alone. The companion book has 666 pages; this video series carries you through to only page 136.

[@oluwoleraimi3931]

Grateful Harrison! Received my book parcel today in South Korea. Thanks for been so reliable and trusted. Your book is indeed a bomb!!!

[@prateeksharma3257]

Quarantined inside my room. This is just what I needed!❤️

[@ulissemini5492]

this is the greatest thing to ever happen to mankind

[@randallwalkerdiaz1002]

For sure lol. I am following along with crystal programming language to learn it too. I already work in python and I wanted to learn a new lang.

[@nexovec]

Sentdex: "I am speed..."

[@max_automation1090]

I love the boring company flamethrower in the backround. So many great things in this video!

[@giovanni_bonso]

Waiting for this in this period. Huge value, thanks from Italy

[@GhizlaneBOUSKRI]

But the ultimate question remains : What shall I do with the time I lost before finding out your channel ?

[@husk160]

“It really shouldn’t be flying over your head” Me who doesn’t understand one bit of it: panik

[@ahmadmaroufmiro]

one of the best playlists coding ever, you clear to many things to me thank you very much man

[@bradley1995]

Wow! Bout a 1/4th the way in. Gotta say, excellent job!! First time viewer, but you have gained a sub!

[@Quantum_Nebula]

If I make a sentient ai (GLaDOS), I'm blaming Sentdex when the feds ask me.

[@gaffclant]

Quantum Nebula Bro. Blame me instead. I wish to have such an honor.

[@Quantum_Nebula]

@@gaffclant ikr! There's gotta be some legal stuff in Sentdex's course material that explicitly states: "Any and all product from my teaching is you or the product of you by law. Sentdex is thereby exempt from any legal prosecution by any independent, self-aware artificial intelligence you construct under Sentdex's instruction, (This includes marginally corrupt rouge AI's bent on a will to test, and compulsively ridicule test subjects.)"

[@phaggott]

@@Quantum_Nebula Sendtex™ is not responsible for all the paperclips

[@whoisabishag3433]

hmmm Citations in Court Count, Right"!"

[@parsafakhar]

i really hope you mean FROM SCRATCH, do build normalization functions and optimizations yourself please

[@sentdex]

That's exactly what we do. We mean it when we say it :)

[@DrewPilant]

Best explanation of neural networks I've seen yet- thank you!

[@luisesparza1105]

even through i may get all i need about nn programming for free, this quality deserves a preorder of ur book, thanks! no udemy, neither other youtubers (perhaps CSV) doing this great. i salute you from Mexico.