10.5: Neural Networks: Multilayer Perceptron Part 2 - The Nature of Code

[@KayYesYouTuber]

This is beautiful. For the first time I got a clear understanding of the basics of Neural network. Thank you very much

[@trickstur5994]

This channel should have a magnitude more subscribers than it does. Truly a great resource.

[@Chuukwudi]

I can't believe I watched this for free!!! Thank you very much!!

[@EntwinedGraces]

Im taking a deep learning course this semester and Im so glad these vids exist lol.

[@zinsy23]

This is really fascinating! I hear about things like this but I was never thinking I was going to have an understanding about how it works in my life! Now I'm starting to see that change way sooner than I would have ever thought it would! I don't really want to learn this from anyone else except you! This is probably one of the best ways to thoroughly teach and learn this!

[@FabianMendez]

Dude, you're amazing as a teacher. First time ever I'd been able to properly understand this. Also super awesome video the one with the Markov Chains. Thank you for your work!!!

[@Qual_]

Amazing how the same topic teached by different persons can be either boring/ultra complicated as hell or can be so inspiring that you want to build something right away after the lesson. This guy falls immediately in the second category. It's like he can unlock something inside you which makes you understand something you never understood before.

[@pchol5972]

Hi Daniel this video blew my mind ! Quick explanation : I'm 19 and I've been spending the last year learning linear algebra in maths lessons (vectorial spaces, matrix...) and for the first time, someone is giving me a practical use for all of this (very) theoric things, and it's furthermore related to my favourite subject ! Thank you a lot for all your work, it's awesome and it's enabling me to improve myself in IT, but also in english as I'm french :P

[@Ben-up4lj]

I want to say there are more common uses for matrix calculation which we (German) got teached in school. Most about equations which are related to real world problems.

[@guilhermetorresj]

Finding solutions for systems of linear equations, doing linear transformations to map between coordinate systems (this very channel has a series of videos where he used some linear algebra to get room scale point cloud data from a kinect sensor that basically outputs a matrix), electrical circuits, and I've even heard about using linear algebra to model real-life traffic flow. The way all this math is taught where I live (Brazil) is not optimal from the perspective of a student who just wants to know how to use it. To be honest, most of them won't anyway. But once you get a glimpse of how versatile this bit of maths is, everything just clicks in your mind and it's wonderful.

[@BajoMundoUnderground]

keep the good work nice... finally someone that can explain this in the right way

[@cameronnichols9905]

I know he later corrects it one way, but at 17:30, if you want to keep the subscript of the weights as (row*col) while also keeping the row index as the input index, and the column index as the hidden layer index, you could do the transpose of the input matrix and multiply that (on the left) of the weight matrix. This would result in a 1 x n matrix for the output, but all the subscripts would work out in a way that's easier to understand

[@alonattar3836]

good work! i'm a beginner programer and you realy help me to be better!! never stop make videos! keep it up

[@elocore1702]

These videos are awesome, Ive watched many other videos and i always ended up getting lost and basically just copying and pasting code and hoping it works right but with your videos I am actually understanding whats going on and am able to troubleshoot on my own if i do something wrong and figure out what i did incorrectly because I actually understand how its supposed to work. Great job!

[@adeelfitness4993]

Honestly speaking. You are the best teacher I have ever had. Love from Pakistan. And keep this great stuff going on 👍

[@shrikanthsingh8243]

Very descriptive explanation. Thank you for making my lectures easier.

[@devinvenable4587]

I really enjoy your teaching style. Quirky, funny and informative.

[@TheCodingTrain]

thank you!

[@VijayChethanSFCD]

Well explained ,after watching many videos I found this is the best video which gave me clear idea about NN

[@DustinTWilliams]

Great video! I hope you spring back quick and well from your incident, my good sir!

[@miteshsharma3106]

Dan I hope you get well soon ....... waiting for your return on the coding train!!!

[@HeduAI]

Awesome explanation! This is how 'teaching' is done! :)

[@hr4735]

Love the energy and excitement, happy to have discovered you!

[@anuragdixit7107]

Hey sir u r the most wonderful teacher I ever got Just Love Ur Classes

[@sanchitverma2892]

chup beti

[@lutzruhmann7162]

Hello, I just would like to say Thank You! After your videos I get it.

[@cristianrgreco]

Thank you for these videos. Genuinely interesting and very well presented.

[@mademensociety5210]

This video is still good learning material today!! Thank you .

[@marianagonzales3201]

Hi! I loved your explanation! It's really clear and easy to understand, great teacher, thank you very much ☺️

[@EscapeMinecraft]

Great explanation of neural networks.Based on your lastly written code and Tariq Rashid code i've written my neural network library in c++ but with customized multi layers. I mean it's not great but it's working. Can't wait to see how the series continues.

[@surobhilahiri]

Thanks so much for explaining the concept so well!

[@zumamusic5246]

Following along and making a library for Java! Nice video!

[@osmanmustafaquddusi318]

Sorry to hear about you arm. I will pray to God for your fast recovery. Get we soon. ☺☺☺ brother.

[@DaleIsWigging]

are you going to eventually move onto evolving the overall topolgy (how the graph is connected) , for example the NEAT algorithim? (note: you used * for scalar multiplication and x for matrix and vector notation, if you are planning to cover the cross product you should probably avoid using x for multidimensional products that are associative...uh I mean use it only for the cross product)

[@pantepember]

Also thank you for your clear pronunciation.

[@alirezanet]

this video is awesome thanks... for the first time I completely understand why we need linear algebra in neural networks xD

[@suvranjansanyal2717]

EXCELLENT .. YOU ARE AWESOME PROFESSOR.. KEEP LOADING YOUR VIDEOS.

[@majdoubwided6666]

You are the best really. You make it easy and i like MLP just because of you !

[@omicron296]

Você é fantástico! Estou aprendendo com suas explicações! Obrigado!!!!!

[@ParitoshBaronVLOGS]

Fall in Love With ML ❤️

[@MarcelRuland]

19:44 I got goosebumps when I heard Dan say 'Python'.

[@armandasbarkauskas4485]

Best tutorials on KZbin!!! Keep going ;p

[@taihatranduc8613]

I love you so much. You are so likable, so funny. You are awesome.

[@mightyleguan1451]

Hi Daniel, get well soon and keep up the amazing work!

[@ajiththiyar7609]

Man you just help a lot of people......Thanks😁

[@gajuahmed4426]

Great Explanation. What about the bias that should be added with weight and input when you do forward propagation but you didn't mention it here.

[@Lionel_Ding]

You are just amazing ! When you explain it, everything seems simple ^^'

[@youssefnim]

great video, very clearly explained, thank you !

[@Gentleman217]

OMG. I thought that I will never understand it. But its was all about the teacher. Neural Networks is so easy. I think I will retake BBM406 Fund. of Mach. Learning lecture.. And I will write down the increase of my grade. When I see 'and or truth table' at first I was like 'Really nigga, wtf Im not gonna watch that', but after I watched, I got the concept. It really helped me thanx a lot.. :P

[@climito]

This man is gold

[@georgechristoforou991]

You talk about the normalisation of inputs that are much larger than other inputs. Could this just be handled by adjustment of the weights to normalise the very large input?

[@raimetm]

Daniel, you are an amazing guy e do an amazing job! Thank you so much!

[@luqmanahmad3153]

very amazing stuff and explanation i want to ask you will you do a list on convocation NN? it will help a lot

[@viktorstrate]

11:46 You say you would need to normalize the inputs, is this really needed, as all the inputs are weighted. If the weight for house area is weighted by a really small number, lets say 0.00001. It would automatically get normalized, right?

[@ilaapattu9845]

This Video Really Has Helped Me! Thumbs Up!

[@Cnys100]

Thank you ! This is really helping me!

[@MorneBooysen]

How would you manage "degrees of freedom" or is there a feasible solution problem; before you dump data into a neural net which will try to fit data regardless? Great vids!

[@smrazaabidi1495]

Excellent !! Keep it up but could you please tell me that how we will come to know to choose how many hidden neurons in hidden layers? I mean is there any formula?

[@grapheggspecies8907]

Hi Daniel Schiffman! I have loads of questions from this video and several others I've watched of yours... I am 14, we were tought all of this linenear algebra last year in school, so i have no problem with that.I want to know why we use perceptrons and neural networks when we can do the same thing with linear and polynomial regression (I've tried it and it took very little time and processing power it also had a lower loss ).Also can we optimize the weights in a neural net using geneticic algorithms you described in a video series you have already made? please whoever can answer these questions...I have no idea who to ask and I dont trust stack exchange (somehow they arent allowing me to post anything there).Thank you for making this video, it really helped me, so did all the others I've watched.They have pulled me out of video game addiction...(I think) *ps (for every one who has had trouble with matrices) these videos on neural nets by you and fastai really help me ace my math tests...

[@TheCodingTrain]

I like to use simple scenarios that don't need neural networks to practice / learn about neural networks. So that's really the main reason here!

[@grapheggspecies8907]

@@TheCodingTrain Hi again! I understood that from the video but I want to know is - in what kind of situation would a neural network work better than polynomial regression ( because in my eyes they seem the same ).I hope I'm not bothering you too much... Also I am not making any reference to the videos content. cheers, -my_youtube_username!

[@MrVildy]

Hey Dan, first of all I love your content and your personal way of engaging with your viewers! You have a very natural and captivating appearance. I would like to ask you and the rest of the audience a question. I'm hopefully starting on software development in august at a university, and I have just been wondering: Could there be any interest for the programming community to follow a fresh programmer, because I have been thinking about starting a Blog or a KZbin channel, where I would talk about the things we learn and some of the challenges. Is it interesting to learn with a new student or should I wait until I get more experienced? If it is in any way interesting, how can I prepare to start?

[@dinoswarleafs]

Hope your arm gets better soon :)

[@mightyleguan1451]

Hi man, nice to see you here! I enjoy your CS:GO videos just as much as Dan's videos

[@CocoChanel1313]

Thank you, I've just started to study machine translation. Your videos help me to understand it more deeply. I haven't seen the next videos yet but I hope you will also make one in which you will use Python3 and that you'll explain more maths like the sigmoid fonction, softmax,.. :).

[@MJ-in9wt]

Hey, is P5 support EcmaScript6? Specifically classes and inheritance. Because those are easier to teach junior students rather than objects in JSON format

[@davederdudigedude]

Hello all, what I don't get is: what's the difference between a feed forward neural network trained with backpropagation and a MLP? Is someone here who can explain the difference?

[@xrayer4412]

what programing environment are you using? why arent you using processing anymore in the series?

[@thevfxwizard7758]

THANK YOU.

[@patrik8641]

Isn't the house prediction linearly separable though?

[@anuragghosh1139]

You are awesome so far!

[@wawied7881]

keep it u

[@marcolinyi]

If I want to schedule the games that language I need to study and schedule I need to download? Ps. I'm Italian boy so my English is bad

[@amc8437]

Can you also create a perceptron using Python and PyTorch

[@ahmedel-asasey1982]

VERY GOOD KEEP GOING

[@xxsunmanxx5430]

hey, i have a question, can you do this in processing?

[@Jabh88073]

Your video helps a lot Thank you >

[@ranjithkumarpranjithkumar]

Bias is not require for Hidden Layers ? if we get all values are zero

[@ItsGlizda]

Typically, a single bias node is added for the input layer and every hidden layer in a feedforward network. You are right, it helps with dealing with zero inputs.

[@tw7522]

I'm not sure if you've ever introduced yourself? Anyway, keep up the good work. Thank you!

[@fvcalderan]

he introduces himself at the beginning of every livestream.

[@georgechristoforou991]

You should have gone for a football formation such as 4-4-2 or a 3-5-2

[@abhishekjadav2371]

when is the next live session for NN??(I think it is today but i m nt sure)

[@marufhasan9365]

I was wondering the same thing. Can anybody clarify the actual schedule ?

[@AHuMycK]

Good video But you did a mistake at 18:22 it has to be h1=w11*x1+w12*x2 h2=w21*x1+w22*x2

[@modernmirza5303]

One genius guy.^

[@inbasasis8221]

great video sir

[@StandardName562]

Thank you so much!

[@OmkaarMuley]

thanks for making this video!

[@peter_dockit]

The best!

[@michaellewis8211]

Can You Tell Us The Process You Use To Make A Project

[@mohan_manju]

Hey Daniel how to modify when require multiple hidden layer . It will it useful if you teach that Thank You :)

[@datdemlomikstik4443]

I have made a version with multiple hidden layers github.com/lomikstik/javascript-p5/blob/master/neuro-evolution-shiffman%2Blib/flappy_for_multi_layer_nn/libraries/nn_multi.js

[@grapheggspecies8907]

yeah! how to modify weights in a neural net...maybe he explains that later on

[@equarbeyra5501]

hello dear how can get this software Neusciences Neuframe v4

[@siddhantkumar7257]

what are you taking.................humphry davy's N2O (Nitrous Oxide). The Laughing Gas.

[@ThomasLe]

Is this a repost? I swear I saw this exact same thing a few days ago when I binged the series. I even called out that you made a mistake when connecting the lines from the hidden layer to the output layer. How are there comments from 3 days ago but it says published June 30 (TODAY) ? Was there a glitch in The Matrix?! :P The reason I am back to this video is because it was in my notifications as a new video in the series, but it, obviously, is not.

[@TheCodingTrain]

It's because you saw this video while it was still unlisted. We make all the videos available as soon as we can to anybody who wants to watch the whole series, but we publish them roughly once a day to keep a steady flow of videos coming out. -MB

[@ThomasLe]

Okay, that makes sense! Thanks!

[@sololife9403]

THEEEE best!

[@chancenigel0186]

Why cant you do this stuff with JAVA??? Please lemme know cause im trying to do NN coding with JAVA

[@TheCodingTrain]

You can find a Java port of this series here! github.com/CodingTrain/Toy-Neural-Network-JS/blob/master/README.md#libraries-built-by-the-community

[@srikanthshankar8871]

Collab with siraj raval waiting to see you both in a video that would be a blast!

[@0xTim]

kzbin.info/www/bejne/l5WahIivg5qJbaM

[@corrompido7680]

Is your Matrix powered by human beeings?

[@Ikpoppy]

0:16:20 you are at 10.5

[@sukanyabasu7090]

It was helpful

[@algeria7527]

wow, u r amazing

[@camjansen5025]

why don't make this course with Python? (Python for AI)!! Nice work

[@pyclassy]

can't you write codes in python ?it will be more helpful if you can do so.

[@arezhomayounnejad8399]

hi there. how's going? thank you for energetic description. Can I have your email for further discussion?

[@seanliu5582]

Nice video! First 750 views :D

[@nkosanamabuza109]

I wish you could do it in python

[@kristianwichmann9996]

w_{12} and w_{21} should be switched. Edit: Ah, it was caught :-)

[@grapheggspecies8907]

I didnt understand...

[@demetriusdemarcusbartholom8063]

ECE 449

[@waleedazam6916]

Too much good, but one thing I must say too much comprehensive, they should be in summarize way so listener can get more in less time.

[@yassine321]

the 17 dislikes are from the "AI takeover" ideology