Illustrated Guide to LSTM's and GRU's: A step by step explanation

LSTM's and GRU's are widely used in state of the art deep learning models. For those just getting into machine learning and deep learning, this is a guide in plain English with helpful visuals to help you grok LSTM's and GRU's.
Subscribe to receive video updates on practical Artificial Intelligence and it's applications.
Also, comment below and let me know what'd you like to see next!
⭐ Play and Experiment With the Latest AI Technologies at grandline.ai ⭐
Sources
www.wildml.com/2015/10/recurre...
colah.github.io/posts/2015-08-...
• Recurrent Neural Netwo...
Catch me on the web for more AI content
www.learnedvector.com

[@theaihacker777]

I create much more contents like this! if you enjoy this, check out my other content at www.michaelphi.com

[@mallarihiteshkumar4584]

Hello sir, Ive understood the concept but I couldnt able to trace it on a paper with an example(bit confusing in tracing how the values changes from one layer to layer and how the updations are occurs ),if u have any simple example with tracing each and every step it will be much helpful for me(just a simple example with minimumal data ,and how to train,how to test) hope u will check this out and reply soon sir, thank you sir

[@mallarihiteshkumar4584]

OR else suggest any blog or book that has step to step explaination.

[@alexmcinteercodegrowloopll6780]

hey, we are neighbors, i was just scrolling across youtube and found this

[@mehmetaliozer2403]

I finally find a nice explanation to understand lstm metworks. thanks a lot. 👍

[@akashchandra2223]

Can you tell me how long it takes

[@bounames]

Finally a very clear explanation of LSTM's. Thank you.

[@JohnDoe-fy5ws]

Great video! A little suggestion: pump up the volume on your output because it was a little quiet. Other than that, your video was great and it was easily the best one on the topic that I could find. I'm a visual learner, so your diagrams really helped when no other videos could. Thanks again.

[@AravindUkrd]

Also remove background noise or try using a better mic :)

[@shubhamk53]

One of the Finest Concept Video and coolest animation I have seen on KZbin. You are awesome Bro.

[@TheRefraX]

This is most intuitive explanation of LSTM's I've come across. Thank you!

[@ashishk81]

cant express my happiness after watching this..finally understand LSTM thanks a lot !!! best animation and explanation method , keep doing this ...

[@layjain9739]

This is clear, comprehensive, and overall amazing. Thanks a lot.

[@sansin-dev]

The best explanation of different RNN operations I have seen so far, and I have seen most of them on KZbin. Those animations really hit home. Keep up the good work, Mikael. I am curious to know what's up with all the thumbs-downers.

[@harsharip]

Give this man a cheer. Finally, I understood what is going on inside that LSTM cell.

[@ntp1235]

This is what ,I was looking for.... Thank you very much,waiting for next video,Subscribed

[@_rohitag]

Explaining it visually along with code did wonders for my understanding. Thanks a lot. Keeping making such gems.

[@MrJerry32323]

Clear explanation, cool animation, awesome presentation... THE BEST TUTORIAL I'VE EVER SEEN!

[@seyedmatintavakoliafshari8272]

It's quite artistic how you can pull off these subjects with minimalistic animations! Really helpful. Thanks.

[@user-nx8ux5ls7q]

I tried to understand this since 2016, gave up so many times. Now finally I understood. Thank you so much! Can't thank you enough!

[@cgmiguel]

This is one of the most clear explanation of a LSTM I’ve seen!

[@ThomasPanji]

Finally i found the explanation of these layers. Thank you!!

[@LopitalBB]

The best explanation of LSTM ever! Thank you!

[@nj8048]

The best RNN explanation i've watched so far. Thank you!

[@lightyagmi4925]

This is the best explanation i ever saw on LSTM

[@munna427]

You were good in explaining the difference between the LSTM and GRU.. Served the purpose I was looking for.. thx

[@sniperzrx]

These visualizations and explanations are just amazing

[@mokshnigamsatsangi1780]

I've been waiting for such animated explanation of LSTMs from a long time. Thanks a billion for this though. Super nice and catchy ! I hope you cover maximum deep learning topics with this approach !!!

[@SuperHddf]

You are the best so far of all I watched about LSTMs on KZbin!

[@mahshida5557]

Fantastic visuals and clear explanation. Thank you!

[@Rahidt100]

This is the best explanation of LSTM !

[@liyuqi3779]

Excellent animated demonstrations! Better than ten Coursera courses combined in explaining LSTM

[@SunilKumar-kt3sc]

Awesome presentation of this complex mechanism!

[@mickiq]

Thanks for creating this illustration - super intuitive and straightforward!

[@mishalubich7141]

Wow, this is a gem in the AI tutorial space!! Thank you so much!

[@beatlekim]

This is the best explanation of LSTM finally

[@borispapic9510]

Hey bud you're making great content, subbed. I'm convinced you'll become huge soon. Good luck!

[@theaihacker777]

Hey Boris Papić! Thank you so much for the kind words :) more content coming soon!

[@orinc370]

Clear explanation- thank you!!

[@jellybella9694]

Thanks for ur explanation, which makes the concept crystal clear!!

[@manueldeodati1728]

finally a clear and detailed explanation.. thank you !

[@datngo2852]

Amazing Job Mikael! Very well done! Thanks for explaining so eloquently!

[@siddharthpal7022]

Excellent job explaining LSTMs!

[@behrouzbeheshti]

Just AMAZING! Many thanks.

[@theaihacker777]

For the readers, the written version can be found here towardsdatascience.com/illustrated-guide-to-lstms-and-gru-s-a-step-by-step-explanation-44e9eb85bf21 Thanks for watching :)

[@zarena50]

Bravo! Thank you for the clear explaination.

[@devanshyadav4851]

Your animation for explaining things in simplest way is awesome

[@143balug]

very very clear explanation of LSTM's. Thank you bro

[@akbarghurbal]

One of the best explanation of LSTM networks!

[@ehsanhonarvar]

Very excellent and useful! Thank you Mr. Phi!

[@K_OAT]

Amazing explanation and visualization! Thank you.

[@mauriciogtec]

Amazingly well-explained and concise!

[@chrisogonas]

Simple and clear. Thanks

[@GauravPadawe]

best video I ever came across. Thanks a lot.

[@thomasdemunck4326]

Complicated concepts explained simply, you won a subscriber.

[@mubarkali3340]

finally, what I been looking for, very clear explanation, thank you so much for posting this video.

[@PierLim]

One of the best explanations on lstm, subbed!

[@bilincinontolojikizdirabi]

OMG this video explains perfect such a complex object! THX

[@LayneSadler]

this was incredible! thank you. very cool that the cell is a NN unto itself. hidden state is the memory and output is the activation value of the cell.

[@ahmedhany5037]

Can't wait for more videos from you ! Keep it up !

[@rahulrai1329]

Very nice and intuitive explanation.Thanks a lot for letting me understand the concepts of LSTM and GRU

[@muhammadshoaibsikander2603]

Excellent illustration and explanation. Thank you!

[@mohammedahmedabdelkaway9805]

Thank you for your perfect explanation and well illustration.

[@peter-holzer-dev]

Your animations help a lot in understanding! Many thanks for doing this! 🙏

[@mwdcodeninja]

An excellent walkthrough! Thank you!

[@kaleabwoldemariam4288]

Excellent, easy to understand, presentation.

[@HybridSyntaX]

Best explanation ever in any topic, ever created.

[@genuineass]

so clearly explained!!

[@cleverclover7]

This is so good and clear. Thank you!

[@satarupapanda7774]

Excellent explanation and visualization ... thank you Micheal...

[@AdityaAbhiram]

Great work! This is the type of video I've been looking for! Thanks!

[@user-td8vz8cn1h]

Thanks for such an amazing animations. They definitely contribute to better understanding of the given concepts.

[@rafibasha1840]

Thank you so much ,clearly explained

[@richsajdak]

Thank you very much for this explanation. I finally understand what's happening in LSTMs

[@serdilanlunlu1419]

Thanks a lot for clear explanation, It is perfect with the use of animation.

[@TheDV1Zone]

Objectively the best video to understand RNN cells.

[@praneethcj6544]

I read your article on towards data science Very intuitive explanation ... You deserve respect sir..!!! Make more videos on deep learning Educate us more sir

[@suparnadutta6914]

Thank you.Your videos are amazing.

[@manumaunman]

Excellent Demonstration

[@peterokonma5741]

Thanks, this video is one of the best I have seen on the subject. Thanks also for follow up link for deeper understanding.

[@ianliu8837]

clear and informative, thank you

[@gajuahmed4426]

Thanks, buddy! You prove me wrong again and what an explanation in a different way.

[@vivianaventura5330]

very clear explanation, thanks a lot

[@derbicalderon6900]

Amazing video, thank you so much. Please keep up the good work.

[@dheerajaryasomayajula7657]

Super helpful video. Really enjoyed it as it provides good basic knowledge to understand LSTMs. Thank you. Keep em coming!

[@shaelanderchauhan1963]

Amazing stuff man please make full series on Deep learning you far better than most of the instructors online.

[@RaghavGuptaBEE]

best video on lstm till now

[@tiarini]

Wow, Amazing video! Congrats!!

[@janosneumann1987]

The best explanation of LSTMs on the web

[@mohamedibrahimbehery3235]

This is gold, man. Thanks!

[@amirabouamrane7151]

thanks I finally understand it ,great and easy explanation all the best

[@vigneshp2608]

That's a great explanation !!!

[@IVLxJAK2]

Very intuitive, thank you!

[@flaminglotus11]

I had a lot fun too. Thank you.

[@akshayagarwal2714]

THIS IS BEST EXPLANATION! DONE RIGHT!!!

[@faithfullady1957]

Great job Michael, an excellent introduction.

[@muskangupta5873]

This is what i was looking for... thanks Michael

[@aniktahabilder2518]

Excellent video. thank you for sharing.

[@deeporblabs9564]

Great overview. Will reference this video in our preparation. Thanks for sharing.

[@perwaaler]

Thank you, this is the clearest explanation of LSTM I've found by far! Perfect mixture of mathematical detail (no math is too little imo) and visualisations and metaphors for a high level conceputal understanding (very hard to find on this subject). LSTMs are hard to understand, at least they have been for me, so I really appreciate this!

[@DanTaninecz]

Brilliant explanation.

[@tooshallpass]

You are amazing. Thanks for this crisp and clear explanation on this!

[@mrobjectoriented]

This was so clear to understand!

[@SoniaMeyer-gx7lj]

Very helpful, thanks!

[@ekleanthony7997]

Great Video. finally I found a video that clears my doubt on LSTM. THANKS for the awesome work!

[@JustinDS]

This video was great! Made LSTMs and GRUs so easy to understand. 🎓

[@RafaelMohedano]

Now I get it. Thanks a lot!