Long Short-Term Memory (LSTM), Clearly Explained

  Рет қаралды 553,029

StatQuest with Josh Starmer

StatQuest with Josh Starmer

Күн бұрын

Пікірлер: 1 200
@statquest
@statquest Жыл бұрын
To learn more about Lightning: lightning.ai/ Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/ NOTE: Since LSTM is a type of neural network, we find the best Weights and Biases using backpropagation, just like for any other neural network. For more details on how backpropagation works, see: kzbin.info/www/bejne/f3-ViaB4na5_qpY kzbin.info/www/bejne/n6rRY62adrGcn5o and kzbin.info/www/bejne/fXy9oIJ-jayWgtE The only difference with LSTMs is that you have to unroll them for all of your data first and then calculate the derivatives. In the example in this video, that means unrolling the LSTM 4 times (as seen at 17:49) and calculate the derivatives for each variable, starting at the output, for each copy and then add them together. ALSO NOTE: A lot of people ask why the predictions the LSTM makes for days other than day 5 are bad. The reason is that in order to illustrate how, exactly, an LSTM works, I had to use a simple example, and this simple example only works if it is trained to predict day 5 and only day 5.
@enggm.alimirzashortclipswh6010
@enggm.alimirzashortclipswh6010 Жыл бұрын
you deserve a a shamless promotion for this lecture dude.
@statquest
@statquest Жыл бұрын
@@enggm.alimirzashortclipswh6010 Thank you! :)
@drranjitha
@drranjitha Жыл бұрын
"At first I was scared of how complicated the LSTM was, but now I understand." "TRIPLE BAM!!!" Thanks Dr. Starmer for teaching in a way I could follow. I am placing an order for your book today.
@statquest
@statquest Жыл бұрын
Hooray!!! Thank you very much! :)
@kylek29
@kylek29 Жыл бұрын
As someone who has watched a ton of videos on these topics, I can say that you probably do the best job of explaining the underlying functionality in a simple to follow way. So many other educators put up the standard flowchart for a model and then talk about it. Having the visual examples of data going in and changing throughout really helps hammer the concept home.
@statquest
@statquest Жыл бұрын
Thank you very much!
@suzhenkang
@suzhenkang Жыл бұрын
great great great great great great great great great great great great great great video!
@statquest
@statquest Жыл бұрын
@@suzhenkang Thank you very much! :)
@johnyeap7133
@johnyeap7133 Жыл бұрын
yes definitely
@chenchen4619
@chenchen4619 Жыл бұрын
@@statquest also cool sound effects
@robertpolevoi8630
@robertpolevoi8630 Жыл бұрын
Some rare teachers have instant cred. The moment they start talking you are convinced they really understand the subject and are qualified to teach it. As an experienced teacher of extremely challenging tech myself, I confess that I've never seen more complete and polished preparation. You are changing people's lives at just the moment when this is so critical. Best of everything to you.
@statquest
@statquest Жыл бұрын
Thank you very much! I really appreciate it.
@muhammadzakiahmad8069
@muhammadzakiahmad8069 Жыл бұрын
2 years into Data science, many paid an unpaid courses, never understood the underlying functionality of LSTM but today, Thank you Mr. Josh Starmer for being in my life.
@statquest
@statquest Жыл бұрын
BAM! :)
@SY-jh3tg
@SY-jh3tg Жыл бұрын
I have been working in ML industry of 5 years now. But I never had this clear understanding. Not only have you explained this clearly but also sparked a curiosity to understand everything with this much clarity. Thanks Josh!!
@statquest
@statquest Жыл бұрын
Thank you! :)
@ranjitgopi7519
@ranjitgopi7519 11 ай бұрын
Thanks StatQuest for everything!
@statquest
@statquest 11 ай бұрын
TRIPLE BAM!!! Thank you so much for supporting StatQuest!!!
@gabrielplzdks3891
@gabrielplzdks3891 Жыл бұрын
The ease with which you explain these topics has inspired me to pursue a masters in data science. Thank you for helping me unveil my passion.
@rathnakumarv3956
@rathnakumarv3956 Жыл бұрын
One can learn any thing for passion. should invest money and time learning in only employable courses.
@statquest
@statquest Жыл бұрын
BAM! :)
@khoile1269
@khoile1269 Жыл бұрын
For a beginner, your videos make me feel easy to follow and understand. I love the way that you use the visual example with different colors so that it easier to follow. And the curiosity to learn more is the thing that makes your videos really impressive to me. Thank you, Josh!
@statquest
@statquest Жыл бұрын
Awesome, thank you!
@PuroCyanHQ
@PuroCyanHQ Жыл бұрын
I have been waiting for your LSTM video for so long! No other videos can explain ML concepts as good as you do, you sir deserve a thousand BAMs!!
@statquest
@statquest Жыл бұрын
Thank you very much! BAM! :)
@hemesh5663
@hemesh5663 Жыл бұрын
Mad respect for putting in the hours to prepare the material for the course. These topics are some of complicated ones and yet your illustration + explanation + awesome songs make it easy and enjoyable.
@statquest
@statquest Жыл бұрын
Thank you very much! :)
@crystalcleargirl07
@crystalcleargirl07 4 ай бұрын
the first stage of LSTM unit determines what percentage of long term memory is remembered ... you are absolutely amazing!
@statquest
@statquest 4 ай бұрын
Bam! :)
@sayakbhattacharya9188
@sayakbhattacharya9188 Жыл бұрын
Man the timing! I just saw your RNN video yesterday and was waiting for your LSTM video. Your timing is just impeccable
@statquest
@statquest Жыл бұрын
Perfect!
@dikshantgupta5539
@dikshantgupta5539 8 ай бұрын
I have never fully understood the working of LSTM and tried many blogs and videos on it until I watched your video. This is by far the best explanation on LSTM I have seen on internet. Thank you so much for putting so much of hard work in creating these types of videos.
@statquest
@statquest 8 ай бұрын
Glad it helped!
@amirrezalotfy
@amirrezalotfy Жыл бұрын
I read and watched various articles and videos about LSTM, but none of them explained as well and simply as you. I learned a lot from your video and I am indebted to you. Thank you for taking the time to make this video. I hope you are always healthy and happy. BAM :)
@statquest
@statquest Жыл бұрын
Thank you!
@be_cracked8212
@be_cracked8212 Жыл бұрын
Damn, these are very well explained. The somewhat silly humor isn't quite for me, but with these high quality explanations I couldn't care less about that. Great job!
@statquest
@statquest Жыл бұрын
Thanks! :)
@deathstalkr_
@deathstalkr_ 3 ай бұрын
Watched a lot of videos on LSTM, but BAM…this was the one. I really liked the part where you put in real numbers and showed the calculations taking place. This really helped me get in the perspective of the inner workings. Kudos for putting in the hard work in making this amazing video.
@statquest
@statquest 3 ай бұрын
Thank you! :)
@saeethegreat1672
@saeethegreat1672 Жыл бұрын
BEST TEACHER EVER! seriously how do you make such complicated matters so simple and easy to understand? You're amazing and even tho I didn't plan on learning Machine learning, I'm soooo gonna watch every last video on this channel! thank you for this!
@statquest
@statquest Жыл бұрын
Thank you very much! :)
@TodoProcesos
@TodoProcesos Ай бұрын
A huge thanks for all the effort that you put on this series of videos. You are changing the course of people’s life.
@statquest
@statquest Ай бұрын
Thanks!
@yyyzzz-k3r
@yyyzzz-k3r Жыл бұрын
This is the best tutorial so far. Thank you for your clearly explanation! I watched every episode of your NN series. I am a CS student and building a voice cloning app for my honour project. Your tutorials are truly helpful!!!
@statquest
@statquest Жыл бұрын
Thanks! I'm really glad my videos are helpful! :)
@animalside999
@animalside999 Ай бұрын
amazing. The best LSTM explanation possible. Period.
@statquest
@statquest Ай бұрын
Thank you!
@aayushjariwala6256
@aayushjariwala6256 Жыл бұрын
Requested a video on NLP some time ago and here StatQuest with a better explanation than I expected! (Other KZbinrs and Courses taught me 'How LSTM works?' but your explanation taught 'Why LSTM works?' The clarification between sigmoid and tanh solved many of my questions)
@statquest
@statquest Жыл бұрын
Hooray! :)
@Lokendrasingh-gq4xp
@Lokendrasingh-gq4xp Ай бұрын
"Simplicity is the ultimate sophistication". Wonder how many hours go in to make the explanation so simple and smooth. Great work!! Thank you!!
@statquest
@statquest Ай бұрын
Thank you very much! I do spend a lot of time on these, but I enjoy it.
@mahu1203
@mahu1203 Жыл бұрын
Thank you you are the best teacher, I have seen. 🎉🎉🎉 Hurray. I learn from you than from my actual teachers who just waste my time and break my nerves down .... Thank you 🙏🙏🙏🙏🙏🙏
@statquest
@statquest Жыл бұрын
I'm glad my videos are helpful! :)
@nicolasfonteyne7367
@nicolasfonteyne7367 Ай бұрын
Your teaching technics are just magical! Keep up with this amazing job! BAM!!!
@statquest
@statquest Ай бұрын
TRIPLE BAM! Thank you so much for supporting StatQuest!
@viveksundaram4420
@viveksundaram4420 Жыл бұрын
How does this channel not have 100 million subscribers already? What a beautiful content. Love the way things are presented.
@statquest
@statquest Жыл бұрын
Thank you! :)
@rishavmishra8110
@rishavmishra8110 2 ай бұрын
Can't find a better explanation than this of LSTMs across KZbin, Thanks Josh !
@statquest
@statquest 2 ай бұрын
Wow, thanks!
@ashfaqueazad3897
@ashfaqueazad3897 Жыл бұрын
Your videos should begin with "universities hate this guy, learn how you increase your knowledge with Josh" 😂
@statquest
@statquest Жыл бұрын
BAM! :)
@computerconcepts3352
@computerconcepts3352 Жыл бұрын
The university I'm in is hiring new professors, I wish Josh Starmer is my statistics professor, lol
@Ragnarok540
@Ragnarok540 Жыл бұрын
Universities actually love they can use these videos as material.
@juanpabloaschieri6336
@juanpabloaschieri6336 Жыл бұрын
Litterally got recomended the channel by my professor, so i would say that necessarilly
@picassoofai4061
@picassoofai4061 Жыл бұрын
@@Ragnarok540 Yes, they can afford giving poor classes because students will study on their own. Essentially making degrees useless.
@xiaoHuanyu1027
@xiaoHuanyu1027 7 ай бұрын
i think this is the most clear explanation of LSTM i've ever seen. i've watched many other videos that teaches LSTM, but none of them made me feel so clear about this thing!
@statquest
@statquest 7 ай бұрын
Thank you!
@gloriasegurini3957
@gloriasegurini3957 7 ай бұрын
I'm currently studying for my NLP exam. Sending all my gratitude from Italy for such a clear and in-depth explanation.
@statquest
@statquest 7 ай бұрын
Good luck! BAM! :)
@dallashutchinson3783
@dallashutchinson3783 Жыл бұрын
Such a wonderful explanation. Have been learning about LSTMs in my course but finally understand how it works now. Looking forward to the next step of the Quest!
@statquest
@statquest Жыл бұрын
Thanks!
@sagartalagatti1594
@sagartalagatti1594 Ай бұрын
This was a GOD level explanation of LSTM!!! Hats off!!!
@statquest
@statquest Ай бұрын
Thanks!
@krapukhin
@krapukhin Жыл бұрын
Josh, your videos and book have been an incredible discovery for me. The visual explanation is much easier to understand. Thank you!
@statquest
@statquest Жыл бұрын
Thank you very much! :)
@shadowlynx2624
@shadowlynx2624 Ай бұрын
THIS IS THE BEST VIDEO TO UNDERSTAND LSTM!! KEEP UP THE GREAT WORK!!!
@statquest
@statquest Ай бұрын
Thanks, will do!
@Rick-Chen
@Rick-Chen Жыл бұрын
This is the best video to clearly explain the concept of LSTM I have ever seen!
@statquest
@statquest Жыл бұрын
BAM!
@javadrahmannezhad9908
@javadrahmannezhad9908 Жыл бұрын
Definitely the best visual explanation of LSTM I have ever seen!! Can't wait for your video for Transformers.
@statquest
@statquest Жыл бұрын
Glad you liked it!
@javadrahmannezhad9908
@javadrahmannezhad9908 Жыл бұрын
@@statquest Do you have any timeline in mind for a video on Transformers?
@RajkumarDarbar
@RajkumarDarbar Жыл бұрын
I can't go to the next video without saying a big thanks to you here !! loved this explanation !! 👏
@statquest
@statquest Жыл бұрын
Thank you! 😃!
@sinaro93
@sinaro93 Жыл бұрын
Just WOW! Can't wait to see the third part of this series (Transformers). Thank you, Josh.
@statquest
@statquest Жыл бұрын
Thanks! :)
@Bramsmelodic
@Bramsmelodic Жыл бұрын
As usual, the best intuitive explanation i have seen for LSTM till now! I have banged my head on this topic in thousands of literature and videos who try to explain the same block diagrams over and over.. I got frustrated beyond a certain point. Thankfully Josh made this.. Atleast from a concept wise I am clear now..What Josh does to the community is commendable..
@statquest
@statquest Жыл бұрын
Thank you very much! :)
@brentcos9370
@brentcos9370 8 ай бұрын
Dr. Starmer, you're a rockstar! Your videos are a life-saver. I use your videos as supplementary training as I go through other ML/DL/AI courses. The visualizations are amazing and your explanations are equally amazing. 😎👊
@statquest
@statquest 8 ай бұрын
Glad to help!
@felipeazank3134
@felipeazank3134 9 ай бұрын
This weekend I'll try going to church to thank god for your existence Josh, seriously
@statquest
@statquest 9 ай бұрын
bam! :)
@snm1278
@snm1278 28 күн бұрын
The best LSTM video I have seen period!!
@statquest
@statquest 28 күн бұрын
Thank you!
@leon9413exe
@leon9413exe Жыл бұрын
Use simple words to help me understand some complex concepts! Really appreciated that! Looking forward to learning Transformers from you soon!
@statquest
@statquest Жыл бұрын
Thanks! :)
@billy.n2813
@billy.n2813 Жыл бұрын
Thank you very much sir. I was hired as an undergraduate research assistant earlier this year, and took this opportunity to discover and learn about Deep Learning. I am currently learning about RNNs, and this video was of great value to me. Thank you very much for this.
@statquest
@statquest Жыл бұрын
Glad it was helpful! :)
@yashsonune4391
@yashsonune4391 9 ай бұрын
Can't thank you enough! the dedication you put in this video is amazing. You are my guru (or shall I call it Yoda).
@statquest
@statquest 9 ай бұрын
Wow, thank you!
@chandrachalla3466
@chandrachalla3466 Жыл бұрын
This is an awesome video to explain LSTM. I have a little knowledge about LSTM (I felt that is required to understand this video) - but you made it really clear and eloquent. Your voice is perfect and clear. Hats off !! Thank you so much
@statquest
@statquest Жыл бұрын
Glad it was helpful!
@DavidWalker-ko6po
@DavidWalker-ko6po 9 ай бұрын
An exceptional explanation! I finally understand LSTMs after 6 months of trying to get my head around them! Thank you so much.
@statquest
@statquest 9 ай бұрын
Glad it was helpful!
@parthmangalkar
@parthmangalkar Жыл бұрын
This tutorial was too good!! Now I clearly know how LSTMs work, and how they are used to solve the Vanishing/Exploding Gradient Descent problem. Thank you StatQuest!!
@statquest
@statquest Жыл бұрын
BAM! :)
@MuddyRavine
@MuddyRavine Жыл бұрын
I'm taking an NLP class, we learned about LSTMs a couple weeks ago. I have already forgotten much. This was a very clear and well illustrated example of how they work. Hopefully the percentage of what I now know about LSTMs that is added to my long term memory is now approaching one. Thank you! I'm waiting, with great attention, for the transformer video!!!
@statquest
@statquest Жыл бұрын
Awesome! I'm glad to hear the video was helpful! :)
@otsogileonalepelo9610
@otsogileonalepelo9610 Жыл бұрын
Attention is all you need 😃😃
@statquest
@statquest Жыл бұрын
@@otsogileonalepelo9610 :)
@manonarasimha3913
@manonarasimha3913 4 ай бұрын
You explain the concepts extremely well and in a simple manner! Thank you very much!
@statquest
@statquest 4 ай бұрын
Thanks! :)
@sidverma1888
@sidverma1888 Жыл бұрын
Thank you professor, you are the best!
@statquest
@statquest Жыл бұрын
Thanks!
@viratzz
@viratzz 6 ай бұрын
Truly a magical way of explaining such complex topics!
@statquest
@statquest 6 ай бұрын
Thank you!
@ttominable
@ttominable Жыл бұрын
Im a native spanish speaker and when this video played speaking spanish my face was genuine horror, mainly because im used to josh’s voice. I’m glad i could switch it back
@statquest
@statquest Жыл бұрын
Ha! That's funny. Well, to be honest, one day my dream is to record my own Spanish overdubs. I'm still very far away from that dream coming true, but maybe one day it will happen.
@clemmensenwilliamson6520
@clemmensenwilliamson6520 5 ай бұрын
Man!.. This video is awesome! .All of your videos are awesome! You are awesome!!!
@statquest
@statquest 5 ай бұрын
Glad you like them!
@shoto6018
@shoto6018 Жыл бұрын
BAAAM, First. Gotta Thank Professor Josh before I even watch the video
@statquest
@statquest Жыл бұрын
bam! :)
@TomM-p3o
@TomM-p3o Жыл бұрын
I clicked like before watching the video but after 5 seconds of scrolling through the visualizations. You have some of the best visualizations on this topic on KZbin. Glad I found your channel.
@plafle-zi7mi
@plafle-zi7mi 7 ай бұрын
Thanks so much! It is really the best tutorial! However, I do have a tiny problem. I really appreciate it if you could give me some help. In 18:00, when using LSTM to predict company A, you said that the final short-term memory represents the predicted price on day 5. So, when you input the price on day 3 (which is 0.25), the short-term memory (which is -0.2) should represent the predicted price on day 4. However, the real price on day 4 is 1. There seems to be some problems.
@statquest
@statquest 7 ай бұрын
In order to keep this example as simple as possible (so I could illustrate it), this model was only trained to predict the value on day 5. It wasn't trained to predict the value on day 3 or any other day.
@plafle-zi7mi
@plafle-zi7mi 7 ай бұрын
Got it. Thanks for the swift and helpful reply! I'm truly grateful for your help and your tutorial!@@statquest
@MCMelonslice
@MCMelonslice Жыл бұрын
Gosh, Josh. You make learning such a breeze. Thank you very much for every single BAM!
@statquest
@statquest Жыл бұрын
BAM! :)
@jinchengliu9586
@jinchengliu9586 Жыл бұрын
Amazingly explained! Can't wait to watch transformer!
@statquest
@statquest Жыл бұрын
Thank you! :)
@drramasubramaniam6724
@drramasubramaniam6724 Жыл бұрын
Excellent introduction to LSTMs. Thank you Josh
@statquest
@statquest Жыл бұрын
Thank you!
@saikrishna-ie1xf
@saikrishna-ie1xf Жыл бұрын
great series of videos, please make some for "transformers" too!! Thanks in advance
@statquest
@statquest Жыл бұрын
I'm working on them.
@SelfBuiltWealth
@SelfBuiltWealth Ай бұрын
Hello Mr.Josh i hope you are reading this. I noticed that year by year as time progresses, the amount of things to learn is exponentially rising, for example if we go back to 1993 there was no such thing as RNNs and machine learning was so small as a domain, in just 2 decades we found these complexe algorithms ; our brains need to keep up down the line our grand grandchildren will have to learn even more to just arrive to the "ok now i know everything that we discovered in this field". So im so worried about the future of humans they will have to learn more than us by so much. Thats why i wrote this comment to thank you from the bottom of my heart and tell you that your work is THE MOST essential to humans progression, with you mr.josh you revolutionazied imo the way of learn Deep learning and ML. We need more people like you to evolve our ways of learning. Thank you soo much and TRIPLE BAM :)❤❤❤❤❤
@statquest
@statquest Ай бұрын
Wow! Thank you very much! I'm really glad you like my videos. :)
@mateuszsmendowski2677
@mateuszsmendowski2677 Жыл бұрын
The best explanation how LSTM cell works.
@statquest
@statquest Жыл бұрын
Thank you!
@FullStackAmigo
@FullStackAmigo Жыл бұрын
This was the best video about LSTMs that I've ever seen! Thanks!
@statquest
@statquest Жыл бұрын
Thank you! :)
@vishnuprasadj6511
@vishnuprasadj6511 Жыл бұрын
Finally, I understood LSTM. Clean and simple explanation. Probably the best one about LSTM.
@statquest
@statquest Жыл бұрын
Thank you! :)
@alexg7082
@alexg7082 9 күн бұрын
The best explanation I have found ever !
@statquest
@statquest 9 күн бұрын
Thank you!
@kc66
@kc66 Жыл бұрын
Hands down the best explanation for LSTM!
@statquest
@statquest Жыл бұрын
Wow, thanks!
@willw4096
@willw4096 Жыл бұрын
Agreed.
@Sukirtha-u7s
@Sukirtha-u7s 7 күн бұрын
This explanation do be giving me so much more insights than mundane class lectures and other yt tutorials. The level of math and logical work behind any Machine Learning or Deep Learning concepts are CRAZY and quite hard to comprehend at times, but after being a regular visitor and enjoyer of StatQuest, I've just gotten myself into deeper understandings about the beauty behind it all, in a simple and easy understandable manner! Thanks Josh for it!! ((: Ps* Love the tiny bams and random yet cute songs in between!
@statquest
@statquest 7 күн бұрын
BAM!!! Thank you very much! :)
@sohamborkar2117
@sohamborkar2117 4 ай бұрын
It was the most easy explaination of LSTM ever, Thank You So Much...
@statquest
@statquest 4 ай бұрын
Thanks!
@Murattheoz
@Murattheoz Жыл бұрын
Your videos always puts a smile on my face, while learning.
@statquest
@statquest Жыл бұрын
Hooray! :)
@vrajmalvi7194
@vrajmalvi7194 11 ай бұрын
best explanation ever, i can't express how glad I am to found this channel. 100% better than the paid course I am doing right now. Thank you :).
@statquest
@statquest 11 ай бұрын
Glad you enjoy it! :)
@adityarajora7219
@adityarajora7219 10 ай бұрын
I have no clue why on earth such content is FREE!
@statquest
@statquest 10 ай бұрын
bam! :)
@ting9252
@ting9252 Жыл бұрын
can't sleep well without your songs 🤪
@statquest
@statquest Жыл бұрын
Ha! :)
@NJCLM
@NJCLM Жыл бұрын
Thank you so much! I became a payed member. I wish you great success in your passion for teaching.
@statquest
@statquest Жыл бұрын
Awesome, thank you!
@PremKumar-ym3vh
@PremKumar-ym3vh Жыл бұрын
This what Teaching should be. I have tried watching a bunch of videos in youtube almost all of them were technical jargon. Didnt understand the why part! Thank you Dr. Starmer for making such videos
@statquest
@statquest Жыл бұрын
Thank you!
@pb9405
@pb9405 Жыл бұрын
Your videos are very accessible, I love them. I'll definitely recommend them when I'm asked for introductions to Machine Learning content.
@statquest
@statquest Жыл бұрын
Awesome! Thank you! :)
@Jjjj24971
@Jjjj24971 Жыл бұрын
I have watched almost all of your videos from the beginning ... I found that your teaching skills and visualization skills become better and better in every single video. This is the best quality of a data scientist, which I do not find in many data scientists.
@statquest
@statquest Жыл бұрын
Wow, thanks!
@marisa4942
@marisa4942 10 ай бұрын
Thank you so much for continuing to upload videos on this machine learning topic!! Your videos has saved my grade a year ago and now it has helped my team members understand the concept very easily!
@statquest
@statquest 10 ай бұрын
Thanks!
@yousufahmed985
@yousufahmed985 5 ай бұрын
HOLY SMOKES the concept is now crystal clear 🔥🔥🔥🔥🔥
@statquest
@statquest 5 ай бұрын
Hooray! :)
@sanasaleh2750
@sanasaleh2750 5 ай бұрын
Really grateful for your dedication..Perfect video like always..Yet I missed the last part in which you revise the whole concept
@statquest
@statquest 5 ай бұрын
I miss those parts too. But very few people watched them. :(
@sanasaleh2750
@sanasaleh2750 5 ай бұрын
@@statquest 😥.. Those 2 mins are really helpfuk in grasping the essence of the complete video. Btw, I am glad I found your channel to make me understand the real stuff without getting confused in complex mathematical notations.
@amitpraseed
@amitpraseed 7 ай бұрын
Are these topics covered in "The StatQuest Illustrated Guide to Machine Learning"? The video is hands down the BEST explanation of LSTM I have seen anywhere!!!
@statquest
@statquest 7 ай бұрын
The chapter on neural networks does not cover LSTMs. Just the basics + backpropagation.
@amitpraseed
@amitpraseed 7 ай бұрын
@@statquest Would you consider a book explaining deep learning concepts? It would be a major life saver for all of us
@statquest
@statquest 7 ай бұрын
@@amitpraseed I'm, slowly, working on one.
@parisahormozzade-r6o
@parisahormozzade-r6o 7 ай бұрын
Wow! These videos are absolutely incredible! What a presentation!
@statquest
@statquest 7 ай бұрын
Thank you!
@shahriyarharis6752
@shahriyarharis6752 7 ай бұрын
I seldom comment on videos, but credit lies where it's due. Hands down the best video on LSTM I have watched
@statquest
@statquest 7 ай бұрын
Thank you!
@StephenSpivack
@StephenSpivack Ай бұрын
dodgerblue and orange has always been my favorite color scheme for 2 colors. well done
@high_fly_bird
@high_fly_bird Жыл бұрын
omg i am so fond of these videos! Thank you so much for doing it!
@statquest
@statquest Жыл бұрын
Thanks!
@DaniilKanaki
@DaniilKanaki 8 ай бұрын
Amazing explanation. It just cannot be better.
@statquest
@statquest 8 ай бұрын
Glad you liked it!
@iamgauravnigam
@iamgauravnigam Жыл бұрын
So far the best explanantion for LSTM. Thanks a lot for this video. EAgerly waiting for the next stage 'Transformer'.
@statquest
@statquest Жыл бұрын
Thanks!
@Thiiilo
@Thiiilo 5 ай бұрын
I am working on my bachelor's thesis, for which I am trying to implement an LSTM model for anomaly detection for an IoT vehicle data project. I wanted to understand more of the math behind it, and the disclaimers about each video you would recommend watching before helped me keep everything in mind, even though most of the code won't be self-developed but merely adjusted for the use case. It's primarily based on previous literature... anyways, this overview certainly helped gain an overview :D
@statquest
@statquest 5 ай бұрын
bam!
@leejo5160
@leejo5160 Жыл бұрын
The best explanation on LSTM ever! Thank you so much!
@statquest
@statquest Жыл бұрын
Glad it was helpful!
@leejo5160
@leejo5160 Жыл бұрын
@@statquest Thank you for your reply, Josh. One thing I am a little confused about is the difference between short term memory and prediction. At around 18:00 when you explain the day 5 prediction, you said that the final short term memory is day 5 prediction. Does that mean the input value is the actual price at a certain date and the short term memory is the price prediction at a certain date. If that's the case, then the short term memories should be very close to the input values but they are not (0, -0.1, -0.1 ,-0.2 vs 0, 0.25, 0.5, 1).
@statquest
@statquest Жыл бұрын
@@leejo5160 The model was only trained to predict the output on day 5. And, as such, only makes good predictions for day 5. However, we could train it to predict every day if we wanted to. We'd probably need more data or a more complicated model (more layers or a fully connected network at the end).
@juliank7408
@juliank7408 7 ай бұрын
Thank you very much! Complex, but clear I think I will need to rewatch your videos to really understand and remember
@statquest
@statquest 7 ай бұрын
Thanks!
@CyberNet_inc
@CyberNet_inc Жыл бұрын
I swear to god I was searching videos about LSTM. I watched yours about Recurrent neural networks a few hours ago, but you didn't have any on LTSM. And now this is here!!! WTF? Time to watch it then.
@statquest
@statquest Жыл бұрын
bam! :)
@lima8919
@lima8919 Жыл бұрын
Excellent! StatQuest has explained XGB and DL mostly clearly I have ever seen. I can't wait for your new videos on attention and transformer.
@statquest
@statquest Жыл бұрын
Thank you!
@lancezhang892
@lancezhang892 9 ай бұрын
Finally, I understand the mechanism. Thanks, Josh!
@statquest
@statquest 9 ай бұрын
bam!
@hey-its-me239
@hey-its-me239 8 ай бұрын
Thank you so much for your videos! I never knew my brain could handle such THE COMPLICATED CONCEPTS! TRIPLE BAM!!!!!!!!! 🥰😍🤩
@statquest
@statquest 8 ай бұрын
Happy to help!
@KloiUA
@KloiUA 4 ай бұрын
Great video! It is super easy to watch and understand! Also, it would be really helpful if you made a video where you clearly explain the backpropagation in LSTM. Because there are almost no reliabile and understandable videos on this topic on youtube... Thank you! Edit: just saw your pinned comment with all the stuff about backpropagation in LSTM, so thanks again :)
@statquest
@statquest 4 ай бұрын
bam! :)
@KloiUA
@KloiUA 3 ай бұрын
@@statquest By the way, I wanted to ask you, regarding backpropagation in LSTM. At first, I wanted to do some math to calculate each weight's/bias derivative (like you said in pinned comment), but then, soon after, found out that it would take a long time, since formulas get more complicated the dipper you go. So, I decided to calculate the derivative of the error of the output of the last LSTM (its STM) with respect to the output of the previous one, so that I get the "gradient" of previous LSTM's STM, and then calculate all the local derivatives for all weights and biases (and repeat this algorithm for each time step). Thus, using those gradients I can just localy calculate all the derivatives without any problem for each previous LSTM block and then finally add them together and adjust the weights and biases. Is it correct to do so?
@statquest
@statquest 3 ай бұрын
@@KloiUA To be honest, I'm having a hard time imagining exactly how your process works. A much easier approach would to just do a proof of concept gradient using a very simple, vanilla RNN like this: kzbin.info/www/bejne/d6SxhYNugNyobpI In that case, it's much easier to calculate everything and you can validate that your method is correct.
@KloiUA
@KloiUA 3 ай бұрын
@@statquest Well, yes, you are right, it would be great to try to prove it with some smaller models. But it seems like this method for LSTM is not really applicable to a vanilla RNN, since while LSTM blocks are fully used in calculation for each time step (each weight and bias is taken into account), in vanilla RNN we skip some of them (like w3 and b2 in that RNN from your example in the video you mentioned) and use only in the last iteration. However, I think there is a method, and the idea is worth a try. I guess I will start from the RNN then, and after that come back to LSTM (hopefully with new ideas and better understanding). :) In general, thank you for your responses. In my opinion the fact that you respond to each comment and help people with their questions is super cool. And you really deserve a huge respect for that. Keep doing the best! :) Edit: I decided to write the LSTM from scratch (on C++) with this method of backpropagation to see how it works, and after some hyperparameters tuning and training it perfermed quite great (92% precision) on simple task (similar to the task in your video). Although I did not manage to find any detailed and accessible sources that explain backpropagation in LSTM, I guess that this method is likely correct, given the fact that the network actually showed the result. :))
@tupaiadhikari
@tupaiadhikari Жыл бұрын
Thank You professor. Now I can proudly say that I understand LSTM and can calculate the output of LSTM using Microsoft Excel
@statquest
@statquest Жыл бұрын
Glad it was helpful!
@emircagr3154
@emircagr3154 Жыл бұрын
I am making a comment on a video after a really really long time. And for me this is the best criteria to show myself how useful this video is. Thanks :)
@statquest
@statquest Жыл бұрын
Thank you very much! :)
@er.shashikantkumar9584
@er.shashikantkumar9584 Жыл бұрын
Sir, this is my extremely awaited topic.A lot of Thanks. i know after watching LSTM my doubt will be clear.
@statquest
@statquest Жыл бұрын
BAM! :)
@SarveshRansubhe
@SarveshRansubhe Жыл бұрын
You are insane!!!!!!!!!!!!!!!!!!!!!!!!! never thought I would understand lstm by looking at diagram but you did.
@statquest
@statquest Жыл бұрын
Hooray! :)
@nischalpatel1583
@nischalpatel1583 Жыл бұрын
I am in Love with your videos!!!! I was going through hell understanding LSTM but now I can say, I have some grasp🙌🙌
@statquest
@statquest Жыл бұрын
Hooray! I'm glad they are helpful.
Word Embedding and Word2Vec, Clearly Explained!!!
16:12
StatQuest with Josh Starmer
Рет қаралды 306 М.
Recurrent Neural Networks (RNNs), Clearly Explained!!!
16:37
StatQuest with Josh Starmer
Рет қаралды 547 М.
Новый уровень твоей сосиски
00:33
Кушать Хочу
Рет қаралды 4,2 МЛН
Je peux le faire
00:13
Daniil le Russe
Рет қаралды 22 МЛН
АЗАРТНИК 4 |СЕЗОН 1 Серия
40:47
Inter Production
Рет қаралды 1,4 МЛН
💩Поу и Поулина ☠️МОЧАТ 😖Хмурых Тварей?!
00:34
Ной Анимация
Рет қаралды 1,6 МЛН
What is LSTM (Long Short Term Memory)?
8:19
IBM Technology
Рет қаралды 200 М.
Long Short-Term Memory with PyTorch + Lightning
33:24
StatQuest with Josh Starmer
Рет қаралды 64 М.
Transformer Neural Networks, ChatGPT's foundation, Clearly Explained!!!
36:15
StatQuest with Josh Starmer
Рет қаралды 684 М.
Has Generative AI Already Peaked? - Computerphile
12:48
Computerphile
Рет қаралды 988 М.
How might LLMs store facts | Chapter 7, Deep Learning
22:43
3Blue1Brown
Рет қаралды 504 М.
Новый уровень твоей сосиски
00:33
Кушать Хочу
Рет қаралды 4,2 МЛН