Adam Optimizer Explained in Detail | Deep Learning

[@mariap.9768]

You are much more clear and concise than other similar videos.

[@MarcoHuber-y3w]

Very great explanation! I needed a clear overview which concepts are needed or from where they arise. I need to test different first order optimization methods for my master thesis for a special multidimensional optimization problem for a bioinformatics project. Recent papers are nice, but don´t visualize or explain it short and simple. Thanks alot!

[@MachineLearningWithJay]

Glad to help !

[@nbiresev]

Great explanation, thanks a lot. I watched first your video where you explained all optimization which was a bit confusing, but after watching each of them individually it became clear.

[@pranaysingh3950]

I am done with all the optimizers finally. Thanks a ton.

[@MachineLearningWithJay]

Your welcome!

[@pranaysingh3950]

@@MachineLearningWithJay Yea but bro ? the doubt ... okay that's fine. No problem.

[@MachineLearningWithJay]

Hi @@pranaysingh3950 , I don’t see your doubt posted. Where did you ask? Can you please tag the message/comment ?

[@jordiwang]

good videooooo broooo, straight to the point

[@sannidhyamaheshwari4772]

best + precise + clear = amazing

[@nikithakatta3698]

Good explanation😊

[@GK-jw8bn]

in this video you havent mentioned that adam allows to learn adaptive rates for each individual parameter

[@kumruorkun3947]

there is a one thing i cant get it. İn RMSprop why we divide dw or db to square root of sdw plus epsilon? Can anyone explain?

[@nbiresev]

Epsilon is added in order to avoid dividing by value that is zero (or very close to zero as then the whole term is huge).MY understanding for division by square root of mean square of dW is that it adapts weight update to the most recent training samples.

[@AbhishekVerma-kj9hd]

Kya smjhate ho bhai maza aa gaya

[@mritunjay3723]

Equation is right but how you have written is wrong.Its creating confusion .In RMSProp learning rate gets changed so (new alpha )= ((alpha)/root(exponential weighted avg+ epsilon)).

[@mathid_]

What is the value of Vdw and Sdw?

[@lochuynh6734]

Great explaination, great video

[@MachineLearningWithJay]

Thank you so much! I highly appreciate your support!

[@sirborkington1052]

Thanks mate, helped a lot.

[@niloydey6147]

don’t you have to calculate bias corrected estimates?

[@CrashBandicoot-qp8vq]

can you please reference the values of beta1 and beta2 and epsilon ?

[@shahomaghdid9591]

Thank you so much!

[@ahmadjohara7824]

Nice job! thanks alot.

[@MachineLearningWithJay]

Welcome!

[@tanvirtanvir6435]

0:56 2 algorithm

[@parthpatwari3174]

thank you

[@varkam1523]

Rajesh kanna yaha se photo uthaya

[@brianp9054]

worth noting that you said nothing

[@moonedCake]

Thanks a lot! 🤍

[@MachineLearningWithJay]

Welcome 😇