MIT Introduction to Deep Learning (2022) | 6.S191

MIT Introduction to Deep Learning 6.S191: Lecture 1
Foundations of Deep Learning
Lecturer: Alexander Amini
For all lectures, slides, and lab materials: introtodeeplearning.com/
Lecture Outline
0:00​ - Introduction
6:35 ​ - Course information
9:51​ - Why deep learning?
12:30​ - The perceptron
14:31​ - Activation functions
17:03​ - Perceptron example
20:25​ - From perceptrons to neural networks
26:37​ - Applying neural networks
29:18​ - Loss functions
31:19​ - Training and gradient descent
35:46​ - Backpropagation
38:55​ - Setting the learning rate
41:37​ - Batched gradient descent
43:45​ - Regularization: dropout and early stopping
47:58​ - Summary
Subscribe to stay up to date with new deep learning lectures at MIT, or follow us on @MITDeepLearning on Twitter and Instagram to stay fully-connected!!

[@ashishkumarchoubey2819]

Super Excited to learn! Thank you MIT folks for open sourcing your lectures for lesser fortunate folks like to learn and grow

[@sarthakmohanty6691]

Alexander is a master in presenting super complex things in a simple way, making such lectures public helps a lot . I personally have been benefited a lot .

[@scrap8660]

I’m citing you in my high school project! Thank you for making these lectures public I literally can’t thank you enough

[@deeplypresent]

I studied ML years ago and watched most of the available MOOC content out there. Doing a refresher. This guy is the best teacher I’ve come across!

[@adityachakole755]

Never thought that someday I would be able to learn from a lecture happening at MIT but here you are. Thank you so much

[@VALedu11]

Year number 3 now that I am following 6.S191.... and I am still eagerly awaiting these lecture series. More power to you and Dr Ava..

[@vikrantpradhan9923]

Its really amazing that we have access to such high quality content available for free. Thank you and will be looking forward for the upcoming lectures.

[@hitesh2313]

areee kissan bhai kya haal chaal

[@ajith.giove069]

I have to say, this is one of the best classes. I do have a subject called Deep learning at my Uni which has very good information as well just like this lecture. Thanks for the recap

[@vladflore]

Just watched the lecture and I'm amazed at how "easy" it seems to be, which says a lot about the knowledge and teaching technique of the Professor. It sounds all doable even for people who have no contact with ML and DL, like myself. Well done and a big thank you for making this available worldwide!

[@usrehman5046]

what are pre requisite of this? kindly reply

[@ThriveUp1]

@@usrehman5046 im not sure what will be covered in this course but it wouldnt hurt to get/be familiar with the mathematics required for AI.

[@usrehman5046]

@@ThriveUp1 thanks alot for replying. Will look into it

[@fckj4794]

Gg

[@mishrr]

Thank you Professor! Its really great to watch lectures from class while in WFH.

[@bennerliu6477]

This is one of the best crash courses of deep learning I've ever seen, thanks for the good stuff! Please keep sharing!

[@BJP400Paar12]

An excellent introduction to deep learning. Crisp and clear. Thank You!

[@douglastheartist2765]

A-MA-ZING. Looking forward to the rest of the class. Thank you! :)

[@whattheydoexactly7794]

This is amazing man. Thank you for the lectures. You have no idea how informative these lectures are for me.

[@thedumbkid]

Thanks for making such an awesome series of lecture available for free . Really loving this course and DEEP LEARNING

[@blas.duarte]

It may be the first time that I understand the methods and definitions so easily. Great presentation.

[@christiantutivengalvez9203]

I also teach deep learning and when I see classes like this it teaches me how easy it can be to explain complex things like deep learning. Thanks!!

[@abhinavmishra9323]

Can u explain me something, at 42:38, the alfo shown says pick a single data point I and this step is inside loop. So if we can reach minimum using gradient, why are we taking this step inside loop,.we just need one random point?

[@howardroth7524]

@@abhinavmishra9323 Great question as it may not have been clear in the video. My understanding for stochastic gradient descent is that you randomly pick one data point at each iteration. Each iteration uses a random value pulled from the complete data set. Basically, it's not the same 'i' each time unless the randomness is messed up and randomly chooses the same 'i' over and over or you actually experience achieving a probability that was very very close to 0.

[@ShaidaMuhammad]

Good work Alexander. Keep it up. I'll be watching your whole series this year.

[@tsaatse]

Super excited to be here, and a great opportunity to learn more through open sourcing.

[@TommyEVO3D]

OMFG ! had been waiting for a while and I was thinking should I just take last year's session, but now this is coming!

[@emmajennnings5920]

I appreciate the way you draw the neural network model, it's not cluttered with lines like some people draw, but in the course you haven't explained the topic of hyperparameters. thanks again!

[@nishchalparne3436]

That was the best introductory lecture on neural networks!!! Thanks for open sourcing lectures!!!!

[@venkatswaraj3054]

Finally understood how neural networks work and some basic concepts ooof!!! Thank you.

[@random-ye9hb]

The mathematical explanation is very clear. I've already learned these concepts, but this introduction gave me more deeper understanding of these.

[@user-mn9se4hb7d]

Thanks to your high quality teaching of Deep learning! it really helps a lot to understand it!

[@mrityunjaypathak8792]

Many thanks for breaking down complex subject matter into easily graspable blocks !!!

[@ayushmishra7214]

Thank you Alex!. I had been waiting for this since the new Year

[@nemeziz_prime]

This is unbelievable 🔥 how good could a course ever be!!

[@SHIVAMKUMAR-fw9nf]

1. Dot product 2. add bias 3. apply a non-linearity

[@jaybhati8013]

Hey, thanks Alexander for this, totally worth every minute I watched it.

[@nomaniqbal1467]

thank you so much MIT, just got the mail and dah I am here, I have been waiting for this

[@ptetips-o9027]

This was really really helpful. Thank you MIT team. Keep up your good work.

[@arnavraina2615]

waited for this and now watching this on the night before my undergraduate practicals :)

[@WolfAtlas]

Working with deep learning on my master thesis even though I have no background in computer science😅, this was a fantastic introduction thanks Alexander!!

[@TheVineetpandey]

Hi , Alexander , you just explained deep learning in a very easy and intuitive way .

[@philippmaluta978]

Wow! That was a rollercoaster for mind. Best show ever!

[@sneakyturtle6143]

Love the last course, really excited and thank you :D

[@PrinceYadav-xz2mb]

Thanks , finally wait is over 😊

[@leroywalton4348]

I thank you so much for putting these online.

[@paulmurff3133]

Thanks for open sourcing the course @MIT and @Alexander Amini and @Ava Soleimany

[@ajaytaneja111]

What else could one ask as a weekend treat?!

[@kimmi9697]

thank you for posting this lecture series!

[@mrdbourke]

Wooohooo!!! Let's go for another year!

[@carlobaroni990]

Fantastic 1 lecture intro! Thank you very much!!

[@john-franklinanusiem3304]

Thank you thank you, I’ve been waiting.

[@eduardomatheusfigueira]

thank you guys for open sourcing this treasure!!!

[@lil_ToT-XFZ1]

Very comprehensive and conscisive , thank you very much , excellent explaination

[@princewillinyang5993]

Anticipating!!!!!!!😊😊

[@jakubkahoun8383]

This is actually one of the better videos to understand this.

[@ashirwadcda]

Thank you for this engaging lecture presentation. It helps me a lot.

[@style24_7]

Most awaited video of year

[@fehmidakhan8471]

I'm really excited to learn THANK YOU

[@k-alphatech3442]

Amazing! Thanks from Brazil!

[@aman_singh]

Starting of course amazing

[@NLPEngineer]

Set the reminder on. I'm waiting! 🙂

[@hasijahimanshu]

Awesome content, thanks for creating and keeping it free, unlike others :)

[@dkadayinthailand3082]

Wow.Just awesome. Glad to learn from the nerds at MIT.

[@nguyenvandien8996]

Awesome, I just set the reminder.😋

[@learning6210]

thank you for the series :-)

[@ghadeerelsalhawy]

Thank you so much for the amazing lecture.

[@abolfazlmohammadiseif284]

دمت گرم خیلی دوره ی خوبیه. درود بر تو.

[@054siddarth3]

Thank you for the course :D

[@naughtynecromancer9006]

Super excited to learn.. Luv from INDIA

[@leoyu9606]

​Hi Alexander! I've been fan of you and Ava since this series from 2020! Looking forward to the new updates in this season. Just wondering would AlphaFold get a snippet to be introduced in detail?

[@techsavvy9258]

Special thanks from South Korea 🎉

[@kd4pba]

Absolutely fantastic.

[@howardroth7524]

Good lecture. Enjoyed it immensely.

[@yashrathi6862]

Thanks for providing these great lectures! Are the assignments also available?

[@oimenoiable]

Greatly appreciated

[@researcher7410]

I'm super excited to learn deep learning model ...

[@ashioyajotham]

So excited to be part of this cohort. Am new to Deep Learning looking for fellow enthusiasts and if anyone wishes to collaborate feel free to hit me up.

[@ashioyajotham]

@@mohammadolaimat1063 Sure

[@pursuitofcat]

Just 5 min of this video > whole engineering course I had in college.

[@kabazabo]

such a great lecture. thanks

[@younghope11]

Thanks for the wonderful course

[@rahbar2002]

nice lecture and relatable, cool teaching skills

[@jedidiaholadele2086]

Thanks a bunch !!

[@mddinislam9479]

Thank you professor💙

[@duoduo9058]

I was just wondering when will this be out yesterday!

[@HaiderAli-hp6tl]

what an amazing lecture

[@caiomar]

Let's go baby! (:

[@computerscience8795]

Thank you for your content

[@marioandresheviacavieres1923]

Muchas Gracias!

[@SuperHddf]

Thank you! ♥

[@bartlx]

Bring it on! ;)

[@jimmyandanje6415]

Thanks for the good work

[@BharathKumarThota-eg8jc]

I fell this lectures teaches complex problem in a understandable way with basic knowledge in programming.

[@BraxtonMeyer]

Good morning nerd, pursuing my degree as a computer scientist with interest lying in this sort of things this will be epic

[@ahmedb2559]

Thank you !

[@kollias-liapisspyridon3727]

19:55. At this point it would help if you explain that you've chosen the first activation function which is monotonic and g(0)=0.5.

[@nadirmustafa2956]

Very Informative

[@samalqahtani8264]

Many thanks....

[@manuelruiz7638]

Wonderful

[@rajankumarsharma3809]

Sir great work

[@emmajennnings5920]

Thanks you are good!

[@ArmanKhalatyan]

excellent! me: excited, forwarded to students students: excited 🍻👍

[@mirhosseinseyyednasiri2758]

nice lecture!

[@pratikps4087]

well explained.

[@forheuristiclifeksh7836]

23:00 Dense Layer

[@bencheikhdouaa205]

thank you a lot

[@eee8]

Great contents