Long Short-Term Memory (LSTM), Clearly Explained

  Рет қаралды 458,495

StatQuest with Josh Starmer

StatQuest with Josh Starmer

Күн бұрын

Basic recurrent neural networks are great, because they can handle different amounts of sequential data, but even relatively small sequences of data can make them difficult to train. This is where Long Short-Term Memory (LSTM) saves the day. Long Short-Term Memory is a type of recurrent neural network that can handle much larger sequences of data without those pesky exploding/vanishing gradient problems that plague basic recurrent neural networks.
Spanish
Este video ha sido doblado al español con voz artificial con aloud.area120.google.com para aumentar la accesibilidad. Puede cambiar el idioma de la pista de audio en el menú Configuración.
Portuguese
Este vídeo foi dublado para o português usando uma voz artificial via aloud.area120.google.com para melhorar sua acessibilidade. Você pode alterar o idioma do áudio no menu Configurações.
For a complete index of all the StatQuest videos, check out...
app.learney.me/maps/StatQuest
...or...
statquest.org/video-index/
If you'd like to support StatQuest, please consider...
Patreon: / statquest
...or...
KZfaq Membership: / @statquest
...a cool StatQuest t-shirt or sweatshirt:
shop.spreadshirt.com/statques...
...buying one or two of my songs (or go large and get a whole album!)
joshuastarmer.bandcamp.com/
...or just donating to StatQuest!
www.paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
/ joshuastarmer
0:00 Awesome song, introduction and main ideas
4:19 The sigmoid and tanh activation functions
5:58 LSTM Stage 1: The percent to remember
9:25 LSTM Stage 2: Update the long-term memory
12:42 LSTM Stage 3:Update the short-term memory
14:33 LSTM in action with real data
#StatQuest #LSTM #Dubbedwithaloud

Пікірлер: 1 100
@statquest
@statquest Жыл бұрын
To learn more about Lightning: lightning.ai/ Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/ NOTE: Since LSTM is a type of neural network, we find the best Weights and Biases using backpropagation, just like for any other neural network. For more details on how backpropagation works, see: kzfaq.info/get/bejne/f7Rii9Bzza-wpGg.html kzfaq.info/get/bejne/n9-eZd2VprLNmWw.html and kzfaq.info/get/bejne/fbGKorJ5va3HfKM.html The only difference with LSTMs is that you have to unroll them for all of your data first and then calculate the derivatives. In the example in this video, that means unrolling the LSTM 4 times (as seen at 17:49) and calculate the derivatives for each variable, starting at the output, for each copy and then add them together. ALSO NOTE: A lot of people ask why the predictions the LSTM makes for days other than day 5 are bad. The reason is that in order to illustrate how, exactly, an LSTM works, I had to use a simple example, and this simple example only works if it is trained to predict day 5 and only day 5.
@enggm.alimirzashortclipswh6010
@enggm.alimirzashortclipswh6010 8 ай бұрын
you deserve a a shamless promotion for this lecture dude.
@statquest
@statquest 8 ай бұрын
@@enggm.alimirzashortclipswh6010 Thank you! :)
@drranjitha
@drranjitha Жыл бұрын
"At first I was scared of how complicated the LSTM was, but now I understand." "TRIPLE BAM!!!" Thanks Dr. Starmer for teaching in a way I could follow. I am placing an order for your book today.
@statquest
@statquest Жыл бұрын
Hooray!!! Thank you very much! :)
@kylek29
@kylek29 Жыл бұрын
As someone who has watched a ton of videos on these topics, I can say that you probably do the best job of explaining the underlying functionality in a simple to follow way. So many other educators put up the standard flowchart for a model and then talk about it. Having the visual examples of data going in and changing throughout really helps hammer the concept home.
@statquest
@statquest Жыл бұрын
Thank you very much!
@suzhenkang
@suzhenkang Жыл бұрын
great great great great great great great great great great great great great great video!
@statquest
@statquest Жыл бұрын
@@suzhenkang Thank you very much! :)
@johnyeap7133
@johnyeap7133 Жыл бұрын
yes definitely
@chenchen4619
@chenchen4619 Жыл бұрын
@@statquest also cool sound effects
@muhammadzakiahmad8069
@muhammadzakiahmad8069 10 ай бұрын
2 years into Data science, many paid an unpaid courses, never understood the underlying functionality of LSTM but today, Thank you Mr. Josh Starmer for being in my life.
@statquest
@statquest 10 ай бұрын
BAM! :)
@robertpolevoi8630
@robertpolevoi8630 Жыл бұрын
Some rare teachers have instant cred. The moment they start talking you are convinced they really understand the subject and are qualified to teach it. As an experienced teacher of extremely challenging tech myself, I confess that I've never seen more complete and polished preparation. You are changing people's lives at just the moment when this is so critical. Best of everything to you.
@statquest
@statquest Жыл бұрын
Thank you very much! I really appreciate it.
@ranjitgopi7519
@ranjitgopi7519 7 ай бұрын
Thanks StatQuest for everything!
@statquest
@statquest 7 ай бұрын
TRIPLE BAM!!! Thank you so much for supporting StatQuest!!!
@crystalcleargirl07
@crystalcleargirl07 9 күн бұрын
the first stage of LSTM unit determines what percentage of long term memory is remembered ... you are absolutely amazing!
@statquest
@statquest 9 күн бұрын
Bam! :)
@PuroCyanHQ
@PuroCyanHQ Жыл бұрын
I have been waiting for your LSTM video for so long! No other videos can explain ML concepts as good as you do, you sir deserve a thousand BAMs!!
@statquest
@statquest Жыл бұрын
Thank you very much! BAM! :)
@hemesh5663
@hemesh5663 Жыл бұрын
Mad respect for putting in the hours to prepare the material for the course. These topics are some of complicated ones and yet your illustration + explanation + awesome songs make it easy and enjoyable.
@statquest
@statquest Жыл бұрын
Thank you very much! :)
@krapukhin
@krapukhin Жыл бұрын
Josh, your videos and book have been an incredible discovery for me. The visual explanation is much easier to understand. Thank you!
@statquest
@statquest Жыл бұрын
Thank you very much! :)
@user-bd8jb7ln5g
@user-bd8jb7ln5g 9 ай бұрын
I clicked like before watching the video but after 5 seconds of scrolling through the visualizations. You have some of the best visualizations on this topic on KZfaq. Glad I found your channel.
@sayakbhattacharya9188
@sayakbhattacharya9188 Жыл бұрын
Man the timing! I just saw your RNN video yesterday and was waiting for your LSTM video. Your timing is just impeccable
@statquest
@statquest Жыл бұрын
Perfect!
@dallashutchinson3783
@dallashutchinson3783 Жыл бұрын
Such a wonderful explanation. Have been learning about LSTMs in my course but finally understand how it works now. Looking forward to the next step of the Quest!
@statquest
@statquest Жыл бұрын
Thanks!
@khoile1269
@khoile1269 10 ай бұрын
For a beginner, your videos make me feel easy to follow and understand. I love the way that you use the visual example with different colors so that it easier to follow. And the curiosity to learn more is the thing that makes your videos really impressive to me. Thank you, Josh!
@statquest
@statquest 10 ай бұрын
Awesome, thank you!
@be_cracked8212
@be_cracked8212 Жыл бұрын
Damn, these are very well explained. The somewhat silly humor isn't quite for me, but with these high quality explanations I couldn't care less about that. Great job!
@statquest
@statquest Жыл бұрын
Thanks! :)
@SY-jh3tg
@SY-jh3tg Жыл бұрын
I have been working in ML industry of 5 years now. But I never had this clear understanding. Not only have you explained this clearly but also sparked a curiosity to understand everything with this much clarity. Thanks Josh!!
@statquest
@statquest Жыл бұрын
Thank you! :)
@user-bv8jd9xz3s
@user-bv8jd9xz3s 8 ай бұрын
I read and watched various articles and videos about LSTM, but none of them explained as well and simply as you. I learned a lot from your video and I am indebted to you. Thank you for taking the time to make this video. I hope you are always healthy and happy. BAM :)
@statquest
@statquest 8 ай бұрын
Thank you!
@DavidWalker-ko6po
@DavidWalker-ko6po 5 ай бұрын
An exceptional explanation! I finally understand LSTMs after 6 months of trying to get my head around them! Thank you so much.
@statquest
@statquest 5 ай бұрын
Glad it was helpful!
@MCMelonslice
@MCMelonslice Жыл бұрын
Gosh, Josh. You make learning such a breeze. Thank you very much for every single BAM!
@statquest
@statquest Жыл бұрын
BAM! :)
@saeethegreat1672
@saeethegreat1672 11 ай бұрын
BEST TEACHER EVER! seriously how do you make such complicated matters so simple and easy to understand? You're amazing and even tho I didn't plan on learning Machine learning, I'm soooo gonna watch every last video on this channel! thank you for this!
@statquest
@statquest 11 ай бұрын
Thank you very much! :)
@dikshantgupta5539
@dikshantgupta5539 4 ай бұрын
I have never fully understood the working of LSTM and tried many blogs and videos on it until I watched your video. This is by far the best explanation on LSTM I have seen on internet. Thank you so much for putting so much of hard work in creating these types of videos.
@statquest
@statquest 4 ай бұрын
Glad it helped!
@pb9405
@pb9405 Жыл бұрын
Your videos are very accessible, I love them. I'll definitely recommend them when I'm asked for introductions to Machine Learning content.
@statquest
@statquest Жыл бұрын
Awesome! Thank you! :)
@marisa4942
@marisa4942 6 ай бұрын
Thank you so much for continuing to upload videos on this machine learning topic!! Your videos has saved my grade a year ago and now it has helped my team members understand the concept very easily!
@statquest
@statquest 5 ай бұрын
Thanks!
@Rick-Chen
@Rick-Chen Жыл бұрын
This is the best video to clearly explain the concept of LSTM I have ever seen!
@statquest
@statquest Жыл бұрын
BAM!
@gabrielplzdks3891
@gabrielplzdks3891 Жыл бұрын
The ease with which you explain these topics has inspired me to pursue a masters in data science. Thank you for helping me unveil my passion.
@rathnakumarv3956
@rathnakumarv3956 Жыл бұрын
One can learn any thing for passion. should invest money and time learning in only employable courses.
@statquest
@statquest Жыл бұрын
BAM! :)
@chandrachalla3466
@chandrachalla3466 10 ай бұрын
This is an awesome video to explain LSTM. I have a little knowledge about LSTM (I felt that is required to understand this video) - but you made it really clear and eloquent. Your voice is perfect and clear. Hats off !! Thank you so much
@statquest
@statquest 10 ай бұрын
Glad it was helpful!
@wistahjk
@wistahjk Жыл бұрын
I was learning about LSTM for the last two months; still struggled to understand what exactly happening inside until I watched this video. Huge thanks for the content creator. Still, I am struggling about the weights and bias values. Please make your next video on that, if possible. Once again, Thank you so much.
@statquest
@statquest Жыл бұрын
The weights and biases are optimized with backpropagation, which I explain in these videos: kzfaq.info/get/bejne/f7Rii9Bzza-wpGg.html kzfaq.info/get/bejne/n9-eZd2VprLNmWw.html and kzfaq.info/get/bejne/fbGKorJ5va3HfKM.html
@aayushjariwala6256
@aayushjariwala6256 Жыл бұрын
Requested a video on NLP some time ago and here StatQuest with a better explanation than I expected! (Other KZfaqrs and Courses taught me 'How LSTM works?' but your explanation taught 'Why LSTM works?' The clarification between sigmoid and tanh solved many of my questions)
@statquest
@statquest Жыл бұрын
Hooray! :)
@leon9413exe
@leon9413exe Жыл бұрын
Use simple words to help me understand some complex concepts! Really appreciated that! Looking forward to learning Transformers from you soon!
@statquest
@statquest Жыл бұрын
Thanks! :)
@parthmangalkar
@parthmangalkar 11 ай бұрын
This tutorial was too good!! Now I clearly know how LSTMs work, and how they are used to solve the Vanishing/Exploding Gradient Descent problem. Thank you StatQuest!!
@statquest
@statquest 11 ай бұрын
BAM! :)
@xiaoHuanyu1027
@xiaoHuanyu1027 2 ай бұрын
i think this is the most clear explanation of LSTM i've ever seen. i've watched many other videos that teaches LSTM, but none of them made me feel so clear about this thing!
@statquest
@statquest 2 ай бұрын
Thank you!
@viveksundaram4420
@viveksundaram4420 Жыл бұрын
How does this channel not have 100 million subscribers already? What a beautiful content. Love the way things are presented.
@statquest
@statquest Жыл бұрын
Thank you! :)
@RajkumarDarbar
@RajkumarDarbar Жыл бұрын
I can't go to the next video without saying a big thanks to you here !! loved this explanation !! 👏
@statquest
@statquest Жыл бұрын
Thank you! 😃!
@javadrahmannezhad9908
@javadrahmannezhad9908 Жыл бұрын
Definitely the best visual explanation of LSTM I have ever seen!! Can't wait for your video for Transformers.
@statquest
@statquest Жыл бұрын
Glad you liked it!
@javadrahmannezhad9908
@javadrahmannezhad9908 Жыл бұрын
@@statquest Do you have any timeline in mind for a video on Transformers?
@vishnuprasadj6511
@vishnuprasadj6511 Жыл бұрын
Finally, I understood LSTM. Clean and simple explanation. Probably the best one about LSTM.
@statquest
@statquest Жыл бұрын
Thank you! :)
@liuze9280
@liuze9280 11 ай бұрын
This is the best tutorial so far. Thank you for your clearly explanation! I watched every episode of your NN series. I am a CS student and building a voice cloning app for my honour project. Your tutorials are truly helpful!!!
@statquest
@statquest 11 ай бұрын
Thanks! I'm really glad my videos are helpful! :)
@sinarokhideh6794
@sinarokhideh6794 Жыл бұрын
Just WOW! Can't wait to see the third part of this series (Transformers). Thank you, Josh.
@statquest
@statquest Жыл бұрын
Thanks! :)
@brentcos9370
@brentcos9370 4 ай бұрын
Dr. Starmer, you're a rockstar! Your videos are a life-saver. I use your videos as supplementary training as I go through other ML/DL/AI courses. The visualizations are amazing and your explanations are equally amazing. 😎👊
@statquest
@statquest 4 ай бұрын
Glad to help!
@Kimuji402
@Kimuji402 Жыл бұрын
I have watched almost all of your videos from the beginning ... I found that your teaching skills and visualization skills become better and better in every single video. This is the best quality of a data scientist, which I do not find in many data scientists.
@statquest
@statquest Жыл бұрын
Wow, thanks!
@familywu3869
@familywu3869 11 ай бұрын
Thank you so much for all of your tutorials, Josh! Really clearly explained and very helpful!
@statquest
@statquest 11 ай бұрын
Glad you like them!
@Bramsmelodic
@Bramsmelodic Жыл бұрын
As usual, the best intuitive explanation i have seen for LSTM till now! I have banged my head on this topic in thousands of literature and videos who try to explain the same block diagrams over and over.. I got frustrated beyond a certain point. Thankfully Josh made this.. Atleast from a concept wise I am clear now..What Josh does to the community is commendable..
@statquest
@statquest Жыл бұрын
Thank you very much! :)
@ashfaqueazad3897
@ashfaqueazad3897 Жыл бұрын
Your videos should begin with "universities hate this guy, learn how you increase your knowledge with Josh" 😂
@statquest
@statquest Жыл бұрын
BAM! :)
@computerconcepts3352
@computerconcepts3352 Жыл бұрын
The university I'm in is hiring new professors, I wish Josh Starmer is my statistics professor, lol
@Ragnarok540
@Ragnarok540 Жыл бұрын
Universities actually love they can use these videos as material.
@juanpabloaschieri6336
@juanpabloaschieri6336 Жыл бұрын
Litterally got recomended the channel by my professor, so i would say that necessarilly
@picassoofai4061
@picassoofai4061 Жыл бұрын
@@Ragnarok540 Yes, they can afford giving poor classes because students will study on their own. Essentially making degrees useless.
@nischalpatel1583
@nischalpatel1583 Жыл бұрын
I am in Love with your videos!!!! I was going through hell understanding LSTM but now I can say, I have some grasp🙌🙌
@statquest
@statquest Жыл бұрын
Hooray! I'm glad they are helpful.
@yashsonune4391
@yashsonune4391 5 ай бұрын
Can't thank you enough! the dedication you put in this video is amazing. You are my guru (or shall I call it Yoda).
@statquest
@statquest 5 ай бұрын
Wow, thank you!
@MuddyRavine
@MuddyRavine Жыл бұрын
I'm taking an NLP class, we learned about LSTMs a couple weeks ago. I have already forgotten much. This was a very clear and well illustrated example of how they work. Hopefully the percentage of what I now know about LSTMs that is added to my long term memory is now approaching one. Thank you! I'm waiting, with great attention, for the transformer video!!!
@statquest
@statquest Жыл бұрын
Awesome! I'm glad to hear the video was helpful! :)
@otsogileonalepelo9610
@otsogileonalepelo9610 Жыл бұрын
Attention is all you need 😃😃
@statquest
@statquest Жыл бұрын
@@otsogileonalepelo9610 :)
@iamgauravnigam
@iamgauravnigam Жыл бұрын
So far the best explanantion for LSTM. Thanks a lot for this video. EAgerly waiting for the next stage 'Transformer'.
@statquest
@statquest Жыл бұрын
Thanks!
@juliank7408
@juliank7408 3 ай бұрын
Thank you very much! Complex, but clear I think I will need to rewatch your videos to really understand and remember
@statquest
@statquest 3 ай бұрын
Thanks!
@sidverma1888
@sidverma1888 Жыл бұрын
Thank you professor, you are the best!
@statquest
@statquest Жыл бұрын
Thanks!
@jinchengliu9586
@jinchengliu9586 Жыл бұрын
Amazingly explained! Can't wait to watch transformer!
@statquest
@statquest Жыл бұрын
Thank you! :)
@lima8919
@lima8919 Жыл бұрын
Excellent! StatQuest has explained XGB and DL mostly clearly I have ever seen. I can't wait for your new videos on attention and transformer.
@statquest
@statquest Жыл бұрын
Thank you!
@yousufahmed985
@yousufahmed985 Ай бұрын
HOLY SMOKES the concept is now crystal clear 🔥🔥🔥🔥🔥
@statquest
@statquest Ай бұрын
Hooray! :)
@ttominable
@ttominable Жыл бұрын
Im a native spanish speaker and when this video played speaking spanish my face was genuine horror, mainly because im used to josh’s voice. I’m glad i could switch it back
@statquest
@statquest Жыл бұрын
Ha! That's funny. Well, to be honest, one day my dream is to record my own Spanish overdubs. I'm still very far away from that dream coming true, but maybe one day it will happen.
@shoto6018
@shoto6018 Жыл бұрын
BAAAM, First. Gotta Thank Professor Josh before I even watch the video
@statquest
@statquest Жыл бұрын
bam! :)
@wevertonacolito
@wevertonacolito Жыл бұрын
Didática impressionante. Vi várias vídeos e esse foi o que mais deixou claro.
@statquest
@statquest Жыл бұрын
Muito obrigado!
@saikrishna-ie1xf
@saikrishna-ie1xf Жыл бұрын
great series of videos, please make some for "transformers" too!! Thanks in advance
@statquest
@statquest Жыл бұрын
I'm working on them.
@plafle-zi7mi
@plafle-zi7mi 3 ай бұрын
Thanks so much! It is really the best tutorial! However, I do have a tiny problem. I really appreciate it if you could give me some help. In 18:00, when using LSTM to predict company A, you said that the final short-term memory represents the predicted price on day 5. So, when you input the price on day 3 (which is 0.25), the short-term memory (which is -0.2) should represent the predicted price on day 4. However, the real price on day 4 is 1. There seems to be some problems.
@statquest
@statquest 3 ай бұрын
In order to keep this example as simple as possible (so I could illustrate it), this model was only trained to predict the value on day 5. It wasn't trained to predict the value on day 3 or any other day.
@plafle-zi7mi
@plafle-zi7mi 3 ай бұрын
Got it. Thanks for the swift and helpful reply! I'm truly grateful for your help and your tutorial!@@statquest
@gloriasegurini3957
@gloriasegurini3957 2 ай бұрын
I'm currently studying for my NLP exam. Sending all my gratitude from Italy for such a clear and in-depth explanation.
@statquest
@statquest 2 ай бұрын
Good luck! BAM! :)
@vrajmalvi7194
@vrajmalvi7194 6 ай бұрын
best explanation ever, i can't express how glad I am to found this channel. 100% better than the paid course I am doing right now. Thank you :).
@statquest
@statquest 6 ай бұрын
Glad you enjoy it! :)
@sohamborkar2117
@sohamborkar2117 16 күн бұрын
It was the most easy explaination of LSTM ever, Thank You So Much...
@statquest
@statquest 15 күн бұрын
Thanks!
@viratzz
@viratzz Ай бұрын
Truly a magical way of explaining such complex topics!
@statquest
@statquest Ай бұрын
Thank you!
@er.shashikantkumar9584
@er.shashikantkumar9584 Жыл бұрын
Sir, this is my extremely awaited topic.A lot of Thanks. i know after watching LSTM my doubt will be clear.
@statquest
@statquest Жыл бұрын
BAM! :)
@NJCLM
@NJCLM 9 ай бұрын
Thank you so much! I became a payed member. I wish you great success in your passion for teaching.
@statquest
@statquest 9 ай бұрын
Awesome, thank you!
@user-gx9hk8gt3k
@user-gx9hk8gt3k Жыл бұрын
Outstanding! Thank you for the LSTM video! It was of great help to me!
@statquest
@statquest Жыл бұрын
Great to hear!
@Murattheoz
@Murattheoz 8 ай бұрын
Your videos always puts a smile on my face, while learning.
@statquest
@statquest 8 ай бұрын
Hooray! :)
@PremKumar-ym3vh
@PremKumar-ym3vh 11 ай бұрын
This what Teaching should be. I have tried watching a bunch of videos in youtube almost all of them were technical jargon. Didnt understand the why part! Thank you Dr. Starmer for making such videos
@statquest
@statquest 11 ай бұрын
Thank you!
@user-im4vl3ko5h
@user-im4vl3ko5h 3 ай бұрын
Wow! These videos are absolutely incredible! What a presentation!
@statquest
@statquest 3 ай бұрын
Thank you!
@billy.n2813
@billy.n2813 11 ай бұрын
Thank you very much sir. I was hired as an undergraduate research assistant earlier this year, and took this opportunity to discover and learn about Deep Learning. I am currently learning about RNNs, and this video was of great value to me. Thank you very much for this.
@statquest
@statquest 11 ай бұрын
Glad it was helpful! :)
@mateuszsmendowski2677
@mateuszsmendowski2677 10 ай бұрын
The best explanation how LSTM cell works.
@statquest
@statquest 10 ай бұрын
Thank you!
@clemmensenwilliamson6520
@clemmensenwilliamson6520 Ай бұрын
Man!.. This video is awesome! .All of your videos are awesome! You are awesome!!!
@statquest
@statquest Ай бұрын
Glad you like them!
@FullStackAmigo
@FullStackAmigo Жыл бұрын
This was the best video about LSTMs that I've ever seen! Thanks!
@statquest
@statquest Жыл бұрын
Thank you! :)
@kc66
@kc66 Жыл бұрын
Hands down the best explanation for LSTM!
@statquest
@statquest Жыл бұрын
Wow, thanks!
@willw4096
@willw4096 8 ай бұрын
Agreed.
@CyberNet_inc
@CyberNet_inc Жыл бұрын
I swear to god I was searching videos about LSTM. I watched yours about Recurrent neural networks a few hours ago, but you didn't have any on LTSM. And now this is here!!! WTF? Time to watch it then.
@statquest
@statquest Жыл бұрын
bam! :)
@high_fly_bird
@high_fly_bird Жыл бұрын
omg i am so fond of these videos! Thank you so much for doing it!
@statquest
@statquest Жыл бұрын
Thanks!
@gheyathmustafa6467
@gheyathmustafa6467 Жыл бұрын
Well done.. more than clearly explained... really its highly appreciated your hard and great work here... to easy understanding...🙏🙏
@statquest
@statquest Жыл бұрын
Thank you very much! :)
@drramasubramaniam6724
@drramasubramaniam6724 8 ай бұрын
Excellent introduction to LSTMs. Thank you Josh
@statquest
@statquest 8 ай бұрын
Thank you!
@leejo5160
@leejo5160 11 ай бұрын
The best explanation on LSTM ever! Thank you so much!
@statquest
@statquest 11 ай бұрын
Glad it was helpful!
@leejo5160
@leejo5160 11 ай бұрын
@@statquest Thank you for your reply, Josh. One thing I am a little confused about is the difference between short term memory and prediction. At around 18:00 when you explain the day 5 prediction, you said that the final short term memory is day 5 prediction. Does that mean the input value is the actual price at a certain date and the short term memory is the price prediction at a certain date. If that's the case, then the short term memories should be very close to the input values but they are not (0, -0.1, -0.1 ,-0.2 vs 0, 0.25, 0.5, 1).
@statquest
@statquest 11 ай бұрын
@@leejo5160 The model was only trained to predict the output on day 5. And, as such, only makes good predictions for day 5. However, we could train it to predict every day if we wanted to. We'd probably need more data or a more complicated model (more layers or a fully connected network at the end).
@adityarajora7219
@adityarajora7219 6 ай бұрын
I have no clue why on earth such content is FREE!
@statquest
@statquest 6 ай бұрын
bam! :)
@emircagr3154
@emircagr3154 Жыл бұрын
I am making a comment on a video after a really really long time. And for me this is the best criteria to show myself how useful this video is. Thanks :)
@statquest
@statquest Жыл бұрын
Thank you very much! :)
@sanasaleh2750
@sanasaleh2750 Ай бұрын
Really grateful for your dedication..Perfect video like always..Yet I missed the last part in which you revise the whole concept
@statquest
@statquest Ай бұрын
I miss those parts too. But very few people watched them. :(
@sanasaleh2750
@sanasaleh2750 Ай бұрын
@@statquest 😥.. Those 2 mins are really helpfuk in grasping the essence of the complete video. Btw, I am glad I found your channel to make me understand the real stuff without getting confused in complex mathematical notations.
@hey-its-me239
@hey-its-me239 4 ай бұрын
Thank you so much for your videos! I never knew my brain could handle such THE COMPLICATED CONCEPTS! TRIPLE BAM!!!!!!!!! 🥰😍🤩
@statquest
@statquest 4 ай бұрын
Happy to help!
@MrRafaelFioretti
@MrRafaelFioretti 2 ай бұрын
Thanks for sharing such great content!!! I bought your book and it is outstanding. Looking forward to seeing one video related to Gated Recurrent Unit too, it would be triple Bam :) !! Thanks Josh!!
@statquest
@statquest 2 ай бұрын
Thank you so much for your support! BAM! :)
@beulahnarendrapurapu2029
@beulahnarendrapurapu2029 Жыл бұрын
You are the bestest teacher I've ever seen. I am a teacher my self, currently also a student taking AI course.
@statquest
@statquest Жыл бұрын
Thank you! :)
@calvindorosatyagraha7879
@calvindorosatyagraha7879 Жыл бұрын
this is really" good explanation IMO. I can't hold my finger not to click thumbs up. do really love your approach (analogy, story, visual, etc.) to explain sth complex, become easy to digest!!
@statquest
@statquest Жыл бұрын
Awesome, thank you!
@dgraym
@dgraym Жыл бұрын
You are absolutely slept on. I love how you talk to me like I'm an idiot but sometimes I think you're just being nice.
@statquest
@statquest Жыл бұрын
These videos are just how I teach myself a topic. So, any tone is directed towards myself.
@dgraym
@dgraym Жыл бұрын
@@statquest totally joking it's an awesome vid
@girmayberhe6127
@girmayberhe6127 11 ай бұрын
Great explanation!!! Now I understand LTSM. Thanks a lot !!! 🙏
@statquest
@statquest 11 ай бұрын
Thanks!
@rahultivarekar6768
@rahultivarekar6768 7 ай бұрын
Thank you once again for a wonderful knowledge sharing and presentation. 🙂 TRIPLE BAM!!!
@statquest
@statquest 7 ай бұрын
Thanks!
@Fahhne
@Fahhne 11 ай бұрын
Great video, helped me deeply understand each part of the LSTM, thanks a lot.
@statquest
@statquest 11 ай бұрын
Glad it helped!
@user-xk8zu3jb2z
@user-xk8zu3jb2z 4 ай бұрын
Amazing explanation. It just cannot be better.
@statquest
@statquest 4 ай бұрын
Glad you liked it!
@lancezhang892
@lancezhang892 5 ай бұрын
Finally, I understand the mechanism. Thanks, Josh!
@statquest
@statquest 5 ай бұрын
bam!
@tupaiadhikari
@tupaiadhikari 9 ай бұрын
Thank You professor. Now I can proudly say that I understand LSTM and can calculate the output of LSTM using Microsoft Excel
@statquest
@statquest 9 ай бұрын
Glad it was helpful!
@amanpreetchander7386
@amanpreetchander7386 9 ай бұрын
Your tutorials are amazing. I wish you a good luck for your future. Thank you for making such an amazing tutorials 🙂
@statquest
@statquest 9 ай бұрын
Glad you like them!
@shahriyarharis6752
@shahriyarharis6752 3 ай бұрын
I seldom comment on videos, but credit lies where it's due. Hands down the best video on LSTM I have watched
@statquest
@statquest 3 ай бұрын
Thank you!
@mahu1203
@mahu1203 9 ай бұрын
Thank you you are the best teacher, I have seen. 🎉🎉🎉 Hurray. I learn from you than from my actual teachers who just waste my time and break my nerves down .... Thank you 🙏🙏🙏🙏🙏🙏
@statquest
@statquest 9 ай бұрын
I'm glad my videos are helpful! :)
@nec1211986
@nec1211986 9 ай бұрын
i dont usually comment on yt but i have to put my appreciation here, thank you sir.
@statquest
@statquest 9 ай бұрын
Thank you!
@souranumaji4213
@souranumaji4213 Жыл бұрын
Probably the best and cleanest explanation of LSTM. Awesome!!. Could you please make a video on GRU?
@statquest
@statquest Жыл бұрын
I'll keep that in mind. However, right now I'm focusing more on attention and transformers.
@user-io5ee8rc2s
@user-io5ee8rc2s Жыл бұрын
Thank you for great lesson. I understand how each gate works.
@statquest
@statquest Жыл бұрын
Thanks!
@stefanoskarageorgiou25
@stefanoskarageorgiou25 Жыл бұрын
What an amazing video this was! Cannot wait for the transformers video. Keep up the great work!
@statquest
@statquest Жыл бұрын
Thank you! :)
@farhad6261
@farhad6261 5 ай бұрын
I wish you would discuss about hyper parameters and their role. I really enjoy your way of speaking. You are so great
@statquest
@statquest 5 ай бұрын
I talk about them in some of my "in python" videos. You can find all of these here: statquest.org/video-index/
@ninjanape
@ninjanape Жыл бұрын
Thank you so much for this, so well explained. MEGA BAM!
@statquest
@statquest Жыл бұрын
Glad you enjoyed it!
@minerodo
@minerodo 8 ай бұрын
You are the best explaining! Thanks!
@statquest
@statquest 8 ай бұрын
Glad you think so!
Word Embedding and Word2Vec, Clearly Explained!!!
16:12
StatQuest with Josh Starmer
Рет қаралды 242 М.
Recurrent Neural Networks (RNNs), Clearly Explained!!!
16:37
StatQuest with Josh Starmer
Рет қаралды 456 М.
ШЕЛБИЛАР | bayGUYS
24:45
bayGUYS
Рет қаралды 590 М.
КАРМАНЧИК 2 СЕЗОН 4 СЕРИЯ
24:05
Inter Production
Рет қаралды 653 М.
蜘蛛侠这操作也太坏了吧#蜘蛛侠#超人#超凡蜘蛛
00:47
超凡蜘蛛
Рет қаралды 48 МЛН
What is LSTM (Long Short Term Memory)?
8:19
IBM Technology
Рет қаралды 164 М.
Transformer Neural Networks, ChatGPT's foundation, Clearly Explained!!!
36:15
StatQuest with Josh Starmer
Рет қаралды 550 М.
LSTM explained simply | LSTM explained | LSTM explained with example.
33:18
Unfold Data Science
Рет қаралды 20 М.
The Chain Rule
18:24
StatQuest with Josh Starmer
Рет қаралды 226 М.
Sequence-to-Sequence (seq2seq) Encoder-Decoder Neural Networks, Clearly Explained!!!
16:50
StatQuest with Josh Starmer
Рет қаралды 150 М.
StatQuest: Principal Component Analysis (PCA), Step-by-Step
21:58
StatQuest with Josh Starmer
Рет қаралды 2,7 МЛН
ШЕЛБИЛАР | bayGUYS
24:45
bayGUYS
Рет қаралды 590 М.