Deep Learning(CS7015): Lec 5.5 Nesterov Accelerated Gradient Descent

  Рет қаралды 43,434

NPTEL-NOC IITM

NPTEL-NOC IITM

Күн бұрын

Пікірлер: 29
@SantoshGupta-jn1wn
@SantoshGupta-jn1wn 5 жыл бұрын
Best explanation I've seen on NAGD
@UtaShirokage
@UtaShirokage 2 жыл бұрын
Bro I'm watching this years after Graduating, props for the excellent explanation
@anuradhadas8795
@anuradhadas8795 4 жыл бұрын
This is pure gold !
@AJ-et3vf
@AJ-et3vf Жыл бұрын
Best explanation indeed for NAGD. I completely understood the derivation especially the look ahead term.
@jatayubaxi4553
@jatayubaxi4553 4 жыл бұрын
Great explanation sir ! especially the last 5 minutes of the explanation.
@ductn9
@ductn9 Жыл бұрын
Excellent explanation! Thank you.
@muratcan__22
@muratcan__22 5 жыл бұрын
man you are really a good teacher thank you
@anubhavgupta8146
@anubhavgupta8146 4 жыл бұрын
Dude it was an excellent explanation, which i was looking for ofcourse.👍
@Ankurkumar14680
@Ankurkumar14680 5 жыл бұрын
Amazing video, nicely explained
@jahanvi9429
@jahanvi9429 Жыл бұрын
You explain things soo clearly
@newbie8051
@newbie8051 Жыл бұрын
Notes to self : Nestorov Momentum is just look ahead GD, we first move by the amount suggested by the history, then calculate the gradient and make the final move.
@aashishmalhotra
@aashishmalhotra 2 жыл бұрын
Wow awesome why to go to Coursera edx and to del with accent when our professors are so good 😂 thank you sir
@GiiWiiDii
@GiiWiiDii 5 жыл бұрын
Very, very good! Thanks:)
@chetankhaire
@chetankhaire 2 жыл бұрын
Very good explanation😀
@AnkitKumar-sz3by
@AnkitKumar-sz3by Жыл бұрын
best explaination
@sumankumarChoudhury
@sumankumarChoudhury 5 жыл бұрын
Awesome lecture
@tanujguhathakurta413
@tanujguhathakurta413 3 жыл бұрын
what and awesome explanation.. now I gotta subscribe to one fourth labs
@김수연-r8c
@김수연-r8c 5 жыл бұрын
Thank you !
@PatatjesDora
@PatatjesDora 2 жыл бұрын
Great vid
@rubenpole1570
@rubenpole1570 4 жыл бұрын
Nice explanation!
@sivabonthada1076
@sivabonthada1076 2 жыл бұрын
Holy smoke!!
@sagaradoshi
@sagaradoshi Жыл бұрын
Excellent explanation . I have one observation with respect to the content in slide and code you shared. From the slide initially wlook_ahead = wt - gamma * update t-1. But in code v_w = gamma * prev_v_w i.e., wlook_ahead = gamma * prevW .. so getting confused here..
@AlejandraRodriguezTi
@AlejandraRodriguezTi 4 жыл бұрын
Such a great video! Thanks a lot!. If you could share a github with the code and the simulation, it would be really nice, to be able to try it faster, without rewriting. I would also appreciate if you guys could show how exactly is "update " vector. formed. And how is the NAG seen in a computer graph within the whole NN.
@vishnudevk3737
@vishnudevk3737 2 жыл бұрын
At 1:11, shouldn't it be w(t-1) = w(t) + gamma*update(t-1) - eta*gradient @NPTEL
@aboudaladdin8604
@aboudaladdin8604 3 жыл бұрын
best
@muhammadiqbalbazmi9275
@muhammadiqbalbazmi9275 4 жыл бұрын
Amazing video first time on NPTEL.
@ankitfparmar
@ankitfparmar 3 жыл бұрын
24k Gold for free.
@Irmbaes
@Irmbaes 4 жыл бұрын
Sorry, this explanation is too vague to make sense: it reveals nothing about how nor why it works. For instance, the method works provably well only for very specific values of gamma and eta, while your explanation would "prove" that the method works for a large range of values of these parameters.
@ajjukutty-c6h
@ajjukutty-c6h Жыл бұрын
worst explanation
Deep Learning(CS7015): Lec 5.4 Momentum based Gradient Descent
18:45
NPTEL-NOC IITM
Рет қаралды 47 М.
Миллионер | 3 - серия
36:09
Million Show
Рет қаралды 2,2 МЛН
Turn Off the Vacum And Sit Back and Laugh 🤣
00:34
SKITSFUL
Рет қаралды 9 МЛН
Nesterov's Accelerated Gradient
4:13
Bhavesh Bhatt
Рет қаралды 12 М.
Accelerate Gradient Descent with Momentum (in 3 minutes)
3:18
Visually Explained
Рет қаралды 37 М.
23. Accelerating Gradient Descent (Use Momentum)
49:02
MIT OpenCourseWare
Рет қаралды 52 М.
Nesterov Accelarated Gradient Descent
14:05
IIT Madras - B.S. Degree Programme
Рет қаралды 4,1 М.
Gradient Descent Explained
7:05
IBM Technology
Рет қаралды 76 М.
Deep Learning(CS7015): Lec 9.5 Batch Normalization
15:44
NPTEL-NOC IITM
Рет қаралды 30 М.
Deep Learning(CS7015): Lec 3.4 Learning Parameters: Gradient Descent
31:21
Gradient Descent With Momentum (C2W2L06)
9:21
DeepLearningAI
Рет қаралды 180 М.