MIT Introduction to Deep Learning | 6.S191

MIT Introduction to Deep Learning 6.S191: Lecture 1
New 2024 Edition
Foundations of Deep Learning
Lecturer: Alexander Amini
For all lectures, slides, and lab materials: introtodeeplearning.com/
Lecture Outline
0:00​ - Introduction
7:25​ - Course information
13:37​ - Why deep learning?
17:20​ - The perceptron
24:30​ - Perceptron example
31;16​ - From perceptrons to neural networks
37:51​ - Applying neural networks
41:12​ - Loss functions
44:22​ - Training and gradient descent
49:52​ - Backpropagation
54:57​ - Setting the learning rate
58:54​ - Batched gradient descent
1:02:28​ - Regularization: dropout and early stopping
1:08:47 - Summary
Subscribe to stay up to date with new deep learning lectures at MIT, or follow us on @MITDeepLearning on Twitter and Instagram to stay fully-connected!!

[@ohyeahbabyyy603]

After being in college for 4 years and dealing with loads of professors, I can hands down say this guy is the best lecturer I've ever seen! Explains tough concepts so well.

[@issamsum1441]

I usually find neural networks challenging to grasp until I watched this lecture. I truly appreciate how you simplified the concept for me.

[@lelsewherelelsewhere9435]

Both theory and actual implementation in industry code! Perfect! Also, great pacing and depth! After 5 minutes in one episode, and i can already tell this is the best beginner ai lecture series I have seen!

[@Treegrower]

YahoooOoo!! Another great season ahead!

[@page002]

Finally I can follow live lectures

[@webgpu]

since you strongly pointed that out, what are these big advantages over offline lectures that you're so in favor of?

[@page002]

@@webgpu ofline lectures? I guess you meant to say, "What are the advantages of following live online lectures over recorded online lectures? Did I get the question correctly?

[@webgpu]

@@page002 sorry I most probably was not able to express myself properly. I meant "what are the advantages of the [opposite of live] lectures - so I think that's what you also meant in your past comment 👍

[@page002]

@@webgpu don't worry. So here's my point - I prefer Live Recorded lectures over only recorded lectures because when we follow live I think we can connect more with the instructors. Also it gives us the impression that we are also a part of it which a recorded and already published can never give(at least that's what I think). And last but not the least if we follow the live (recorded) lectures here we will have a clear goal and a Dateline to follow. And I think that's a great thing. So, any day I prefer Live Recorded lectures or Live lectures if possible over recorded lectures specially for technical things and programming. I am a pretty bad communicator so, I hope you got your answer even a little. BTW, if you don't mind, try to follow Live lectures once I think you will be able to see the difference personally. Happy Learning

[@genkideska4486]

This is not for beginners. Having 3+ years of experience in deep learning i found it interesting on how much information is shoved into 1 single video . Note that each concept is very vast if we dig deeper

[@noelvase4867]

could you link some real beginner information so i can understand this course?

[@stom10062]

There is a playlist in KZbin names 100 days of deep learning by campusx. You can find everything in deep

[@ps3301]

U know where we can find some real number training example of using a basic liquid neural network ?

[@adityaverma1298]

this 1 video covered an entire semester worth of deep learning course of my college

[@quishzhu]

@@adityaverma1298 you mean this video series right?

[@ikpesuemmanuel7359]

Thanks for the session, Alex.

[@c-spacetime4684]

Yesterday we started system identification using neural network, I watched your lecture and now I feel quite comfortable using the concept of deep learning. Thank you Sir and love from Pakistan....

[@YZhou-mq1bw]

Always be your big fan, really excellent teachings. These are the ones I'd love to go through again and again!

[@kadbed]

Every year I'm here, you remain the best

[@dr.smahanif8027]

just WOW! You almost summarize my learning of 4 years PhD in 1 hour. Keep it up dear. You have everything to speculate your expertise :)

[@ghaithal-refai4550]

Thanks for the videos and the slides, they are great assets for students and teachers. I wish that you have explained more about back propagation with a numerical example, and the different activation functions we can use in the last layer for the different classification problem, like binary classifications multi-class classification and regression problems

[@keynadaby]

It's wonderful to see universities of the calliber of MIT making education accessible to everyone for free. Thanks MIT!!

[@jazonsamillano]

I've been following these MIT Deep Learning lectures since 2019. I've learned so much. Thank you, Alexander and Ava.

[@lakshyajain6765]

So do I need to watch all previous lectures too? Or are the ones in this 2024 course enough?

[@user-xn5do6xc1u]

@@lakshyajain6765 don't need to since every semester course is self contained unit. This is not created for KZbin, it's for MIT students and every semester there is new batch.

[@user-vf9gz6rm3t]

@@user-xn5do6xc1u Thanks a lot!!! Do you have any other resources on MIT ML lectures for their students? this is my alt acc

[@user-vf9gz6rm3t]

@@user-xn5do6xc1u Thanks a LOT!!! this is my alt. Do you have any idea on some more MIT ML related lectures. I would like to do some research in this field and try to get into a phd program

[@paultvshow]

@@user-xn5do6xc1uWhere can I find the next part?

[@jamesgambrah58]

Great presentation, thanks for always simplifying these concepts to the understanding of all.

[@artreadcode]

Looking forward to this! 🙏🏻

[@webgpu]

what not to love in things that seem good and are about to happen ?

[@abdulbouraa4529]

Thank you for your course !

[@samiragh63]

Absolutely amazing. Great to be here.

[@webgpu]

i am also very happy that i am really right here where i am now.

[@my_sports123]

was waiting from last December. Thnak you

[@omartariqmuhammed]

It's finally out!! 🤗🤗

[@gominboda_go]

This is the amazing work. Thank you for sharing.

[@tanmaysingewar]

I was waiting for this for so long ❤

[@pouyan021]

Amazing lecture. I can't thank you enough!

[@paultvshow]

Hands down, this is the best low level explanation of deep neural networks I have seen so far.

[@HeyMr.OO7]

It's not low level... It's High level like programming languages.

[@paultvshow]

@@HeyMr.OO7 What do you mean by low level in your definition? It is as low level as you can get in this field that you can perform calculations on an entire network by hands without having to rely on computers, not to mention programming languages or libraries. Some data scientists or self-taught professionals I have talked to who are fluent in machine learning tools which are considered high levels do not quite completely understand this low level fundamental and I doubt if they could hand calculate an entire network from scratch.

[@HeyMr.OO7]

@@paultvshow alright man ! Now, Go get some air !

[@paultvshow]

@@HeyMr.OO7Stop it and get some help if you can’t even reason. You don’t even know what level means lol.

[@HeyMr.OO7]

@@paultvshow God bless your brain man ! Now leave 😅😅

[@elaina1002]

I am a high school student and I am currently self-studying deep learning and I find it very helpful. I hope one day I can attend your lectures in person. Thank you very much.

[@koi4004]

Amini genius is back!!

[@vishnuprasadkorada1187]

Awesome course !! Can't wait to complete it 😁

[@samalprasant123]

Looking forward 😃

[@nilb2137]

Hello Alex 😊😊 Thank you so much ❤❤

[@zhedd5954]

A big Thank you to you for this great course

[@SSMDesignsandresearch]

Your way of explaining is like movie screenplay or storytelling we are totally into the world you created.

[@jrchris]

These lectures are goated 🔥

[@kyhines1060]

You make it so understandable

[@wendywu5359]

Love your style!

[@AreshaBasirSpriha]

I loved this, It's my major course......It's extremely helpful...love from Bangladesh

[@aysesalman2024]

Great work thank you❤

[@vrshinde1996]

Finally the wait over 😊

[@arunmishra3691]

WOW!!!!😍My professor is chinese and I know he knows a alot of things but after watching this teacher teachin, I understood the importance of a good presentation and most importantly, what a good presentation look like.

[@arpanpradhan493]

You are a great teacher. I wish my professor explained this way. 🎉

[@maithriashokan]

I loved this session! I am getting interested in it.

[@wqesdc8339]

Amazing for free lectures ❤

[@benjaminy.]

This is one the best lecture series for deep learning out there... keep up the good work!!!! Will there be any lecture on the lab assignment - on how do you configure your tensorflow on Google Colab for the assignement/project? I believe that it would be idea/good if there is some lecture video to show how do you configure the Tensorflow on Google Colab. Thank you.

[@arhabhasankhan8465]

Thank you!

[@dipanshurajput-2023]

You teach fabulous

[@kaustubhmangalam4294]

Thank You Sir

[@Hustler0109]

Sir's explanation is better than any Udemy and Coursera course out there fr😮

[@mohsenmoghimbegloo]

Game changer lecture is stating.

[@mehrzadabdi4194]

Hi dear, Thanks for the course. Like always informative and to the fundamentals of DNN.

[@mohamedbille1067]

good Presentation agood overview about deep learning thanks sir Alexander Amini

[@MBaltz]

Let's gooo!!!

[@lehernandezb]

Genial, saludos desde Chile.

[@liu973]

my favorite youtuber just dropped a new episode!

[@webgpu]

ah that moment when someone who produces good content, produces good content!

[@crazy.vlog369]

Finally i looked your session Next session pls came

[@turhancan97]

If I were just starting to learn deep learning, I would start with this video

[@pedrojesusrangelgil5064]

I'm a beginner in ml and ai fields and it's amazing to have these lectures online and free. I've a doubt: the neural network showed in 33:44 shouldn't be named 'multi' layer rather than 'single' layer neural network since it has an output layer separated of the hidden layer? Thanks!

[@polymath.dodifferent]

Sir you are doing a great job, I am student of BSCS, last year from Pakistan. But being a student to learn Deep Learning from last 2 year, I am still a beginner, as the system is not very modern. This lecture seems like a new start for me, which feels very promising. Can you please share the other lectures, so I (students like me) can really advance in this field, and maybe start working at MIT someday. Thanks for teaching in such a beutifull way.

[@oXRiPerXo]

Awesome!

[@cytroyd]

Every year I look forward to this!

[@webgpu]

i too love to expect things that occur periodically to happen the next time!

[@bilaldendani2259]

I am waiting to know what's next in that amazing field.

[@dhruvpathak1850]

Excellent lecture! Was wondering, when would the next lecture (in the same series of year 2024) be coming out? :D

[@takyon24]

yea buddy!!

[@tommyshelby6277]

sir you don't know how much i needed this! i am begining to start my research very soon, is there anythingyou recommend to get started with dl ?

[@helloworldcsofficial]

Great video! Where can I watch the software lab lessons? And will the first lab Intro to TensorFlow/Music Generation be available this week? Thank you!

[@vaibhavverma6813]

The mathematics which I studied this semester is completely making sense now.

[@oneforallah]

Thanks for the lecture, please please make a video or provide a pdf of MATH too, I wanna know the math behind deep learning, svms, pca, ML in general aka grad descent etc, how then that changes when many layers are involved (as in deep learning) so basically normal ML -> i/p -> mat mul -> o/p deep learning -> i/p -> mat mul = linear x matrix . non linear x matrix . linear or non linear x matrix ..... -> o/p etc etc etc I mean try and simplify what goes on mathematically then also give enough formalization that some of us can begin to understand a few of the key ML papers on Arxiv. This has been our biggest challenge truly.

[@sammanuel1641]

Thanks!

[@AmarVashishth]

Attended Deep Learning lectures at a topmost college of a country, here he clearly explained all that in a single lecture for which the former took 10s of lectures to explain.

[@arfakarim9906]

Wao Amazing And cool live labs

[@hamzawaheed2643]

amazing video

[@martinriveros3470]

Excellent video! just a minor comment: about 27:00 i think you should state clear that (1+3x1-2x2) = z and include the "hat" to y (in the graph)...🖖

[@s8x.]

NEW SEASON BOYS

[@faridsaud6567]

Amazing, top content! Out of curiosity: Why TensorFlow instead of Pytorch?

[@codingWorld709]

I love it

[@yasirfarooq2256]

TOP G

[@rohan2718]

What is the prerequisites one must know before diving into this lecture?

[@zzmaortube]

At 22:45 you mention the ReLU function has a discontinuity at '0', IIUC this is not true, ReLU is a continuous function, even at '0'. It is however not differentiable at '0'.

[@AetherTunes]

As a society we should be open sourcing education it’s a net + no matter what

[@himanigulati6922]

Is there any group to follow with other peers? Has anyone made a link?

[@josephmartin6219]

None yet, but you could start one 😊

[@mihaidanielbeuca1083]

If yiou made one, I'll join, if not, I have a Telegram one.

[@josephmartin6219]

@@mihaidanielbeuca1083 what's the Telegram link?

[@SahibzadaShadabAcademyRealacco]

Please if you send here the Link please

[@TwoMonkeys-im4rm]

28:24 This is a very basic idea of deeplearning. I should have watch these lectures before I started my computer vision courses.

[@rahulprasad6116]

Explained so well, hopefully I will get more video to watch.... Can somebody suggest me to find best free material (video) like this video for AI, I desperately want to make my career in field of data science and AI

[@noadsensehere9195]

Love you

[@avinashvanigalla9998]

In Deep/Multi-layer neural network slide , does non-linearity will be applied on y1^ ?

[@robsoft_gt]

So basically what Meta with Llama 3 has done is give to the community the weights for each perceptron?

[@oppranto]

Can anyone tell me, Are there other videos that are going to be premiered for this 2024 course, or is this the only video we get a chance to watch?

[@noob_coder2612]

will the lab class be available in the youtube too?

[@Basicguy1798]

I am in a bit of a fix, hope someone in the comments or the publishers of the series can shed some light. I am a professional embedded software engineer. I have been fiddling with the idea to develop expertise in embedded AI and thus looking for an inroad, lets call it that. Now i know there are options like TinyML(TF lite) , edge impulse and other frameworks where maybe i could jump in. The question is, is this a good way or is it more suggested to take up an uni/grad level curriculum like this one? I guess something that brings me to hands on implementation at the embedded level relatively quickly will be very enticing.

[@abdullahal7512]

Great lecture, but I wonder why u guys take out the robotic learning from your curriculum ?

[@AbhishekSaini03]

At 46 min. Where does the initial loss landscape came from?

[@shrirangmoghe3784]

1 week course he said ? Then schedule link says - 1 every week. Whats right ?

[@udayagirisuhas2727]

Can general public have access to projects and other course materials.

[@bobo-lc4yi]

I'm confused, is the 2024 version a short form of this course? because you mentioned its just 1 week or am I missing something?

[@CatherineAkanbi]

🎉🎉

[@user-ug4sl4gf2x]

Nice lecture ! How can we access labs

[@hakanakkurt9415]

link in the syllabus

[@THEPAGMAN]

Where can we find the labs? I cant find them on the website

[@devkumar9889]

Is this all free including labs ? Or we are only getting this 1st lecture free ?

[@AAmini]

100% of all content is released online for free :)

[@anotherguycalledsmith]

0:51 How about inventing a microphone that does not suck?

[@muhammadsanialiyu551]

Nigeria on 6S191

[@abdulbasitnisar]

Please can anyone tell me, i am beginner and self learning these, can i do it or its too advance???!

[@shafa-atali7816]

where we can find slides?

[@ItsSoeMyintTun]

Only a few minutes left ;D.