Recurrent Neural Networks (RNNs), Clearly Explained!!!

Поділитися
Вставка
  • Опубліковано 27 гру 2024

КОМЕНТАРІ • 819

  • @statquest
    @statquest  2 роки тому +34

    To learn more about Lightning: github.com/PyTorchLightning/pytorch-lightning
    To learn more about Grid: www.grid.ai/
    Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/

    • @rathnakumarv3956
      @rathnakumarv3956 2 роки тому

      whether the book include LSTM and RNN for bi variate input time series data as well?

    • @statquest
      @statquest  2 роки тому

      @@rathnakumarv3956 Nope, just basic neural networks. My next book on deep learning will have more stuff about fancy neural networks.

    • @rathnakumarv3956
      @rathnakumarv3956 2 роки тому +2

      @@statquest
      please include CNN, RNN and LSTM for multivariate time series as input and continuous variable as out put - problems, these are very much useful in climate change studies.

    • @statquest
      @statquest  2 роки тому +1

      @Tech What time point, minutes and seconds, is confusing? And have you watched the entire series on Neural Networks before watching this one?

    • @Lyr00
      @Lyr00 Рік тому

      @statquest I have a question about the vanishing gradient problem. I understand that input1 from the first timestep is having less and less impact on the output the more steps we take but isn’t the gradient also relying on the new inputs of every timestep? I don’t understand why the gradient is vanishing if the new inputs aren’t that heavily discounted as the timesteps that are older. I imagined it’s more like the old inputs are less impactful and the network is more focused on the newer inputs but can still train normally. Is there something I’m missing?

  • @s0meus3r
    @s0meus3r 9 місяців тому +129

    The only place on the internet where you can actually grasp a complex topic before diving deeper into the topic. I am so grateful people like you exist. Thank you!

  • @wildpjah
    @wildpjah Рік тому +82

    I'm in a deep learning class right now and the amount of straight math that my teacher throws at me is overwhelming. Videos like yours are incredible and I'm so thankful for the help and the color coding and the fun that makes it worth watching! It is super helpful as I'm studying for my midterm and just want to get a more definite grasp of what all this math actually means without reading someone's Mathematics PhD dissertation or something

    • @statquest
      @statquest  Рік тому +5

      Good luck on your midterm! :)

  • @mohammadhamed-ro9tx
    @mohammadhamed-ro9tx Рік тому +20

    Everytime I watch on of your lessons, I become sooo happy, because you make all the subjects easy to be understood in magical way. Thank you for your effort

  • @jamesyoun1143
    @jamesyoun1143 2 роки тому +12

    One of the most underrated channels. Never once have I had trouble understanding the intuition of whatever you explain. I'd donate money to you if I weren't a broke college student.

  • @BrunoJr09
    @BrunoJr09 Рік тому +1

    OMG, Finally I understand Vanishing Exploding Gradient, Thank you StatQuest!

    • @statquest
      @statquest  Рік тому +1

      HOORAY!!! Thanks for supporting StatQuest!!! TRIPLE BAM! :)

  • @umar_muhammad_yaree
    @umar_muhammad_yaree 6 днів тому +1

    This is the best video I came across that explained RNN in details without leaving a single thing
    If my Teachers were to explained like this I will have understood better
    Thanks a lot

  • @artem_isakow
    @artem_isakow Рік тому +6

    Thanks to your series of videos on neural networks, I was able to pass the entrance exam for PhD program at St. Petersburg State University.

    • @statquest
      @statquest  Рік тому +5

      Congratulations!!! TRIPLE BAM!!! :)

  • @statquest
    @statquest  2 роки тому +3

    To learn more about Lightning: github.com/PyTorchLightning/pytorch-lightning
    To learn more about Grid: www.grid.ai/
    Support StatQuest by buying The StatQuest Illustrated Guide to Machine Learning!!!
    PDF - statquest.gumroad.com/l/wvtmc
    Paperback - www.amazon.com/dp/B09ZCKR4H6
    Kindle eBook - www.amazon.com/dp/B09ZG79HXC
    English
    This video has been dubbed using an artificial voice via aloud.area120.google.com to increase accessibility. You can change the audio track language in the Settings menu.
    Spanish
    Este video ha sido doblado al español con voz artificial con aloud.area120.google.com para aumentar la accesibilidad. Puede cambiar el idioma de la pista de audio en el menú Configuración.
    Portuguese
    Este vídeo foi dublado para o português usando uma voz artificial via aloud.area120.google.com para melhorar sua acessibilidade. Você pode alterar o idioma do áudio no menu Configurações.

  • @LuizHenrique-qr3lt
    @LuizHenrique-qr3lt 2 роки тому +79

    Josh!!!! I love u!!! I can't wait to learn about the Transformers!! thank you very much for your content

    • @statquest
      @statquest  2 роки тому +4

      Thank you!

    • @capyk5455
      @capyk5455 2 роки тому +4

      Josh teaching about transformers would be a blessing

    • @statquest
      @statquest  2 роки тому +4

      @@capyk5455 I'm looking forward to it!

    • @shaiguitar
      @shaiguitar 2 роки тому +1

      Transformers out yet or some ETA to expect?

    • @statquest
      @statquest  2 роки тому +9

      @@shaiguitar LSTMs comes out in the next week or so. Then I'll start working on transformers.

  • @elmehditalbi8972
    @elmehditalbi8972 Рік тому +3

    You can't understand how good this is. I've spent all of yesterday trying to understand these concepts but I couldn't grasp them. THANK YOU!!!

  • @kirannbhavaraju5978
    @kirannbhavaraju5978 2 роки тому +4

    This is the CLEAREST explanation of RNNs.

  • @toddgillies3380
    @toddgillies3380 Рік тому +27

    Never quite understood RNNs until I watched this video, thank you! A hand-calculated example of a one-to-one RNN is extremely hard to find online, so this was perfect. The only one out there, I believe.

  • @shivanshgupta934
    @shivanshgupta934 4 місяці тому +1

    wow, just wow! 2 days of headache solved by a 17 min video! thank you for existing.😊

  • @thecomputerpal221
    @thecomputerpal221 Рік тому +17

    Josh, I found your channel yesterday and have been binge watching. Incredible work in democratizing knowledge. Thankful for your work.

  • @sushankmishra53
    @sushankmishra53 9 місяців тому +1

    With this level of simplicity in teaching, even a high schooler could grasp these concepts, probably quicker than me!
    Scared of the future now....

  • @DavidBlayvas-wo4lj
    @DavidBlayvas-wo4lj Рік тому +2

    You're gonna carry me through my neural networks class, what a godsend

  • @Ahmad_Alhasanat
    @Ahmad_Alhasanat 2 роки тому +3

    I was looking for a small thing in RNN, but your way of explanation forced me to keep watching the entire video! and I subscribed to your channel!!

    • @statquest
      @statquest  2 роки тому +2

      Hooray! Thank you very much! :)

  • @samama251
    @samama251 4 місяці тому +1

    First time commenting on youtube video. You are a living legend. It has been two days I am trying to understand RNNs and came across your video and Baam. RNNs concept got cleared.

    • @statquest
      @statquest  4 місяці тому

      Glad I could help!

  • @svensvensson3679
    @svensvensson3679 7 місяців тому +1

    Our lecturer at the uni recommended us this video. I am amazed how simply it is put. Great job! Both funny and informative ❤

  • @lukastoral5059
    @lukastoral5059 9 місяців тому +1

    Thank you for making these videos! They are very helpful.

    • @statquest
      @statquest  9 місяців тому

      TRIPLE BAM!!! Thank you so much for supporting StatQuest!!! :)

  • @charlescoult
    @charlescoult Рік тому +3

    This explanation covers some very important points that were missed in several other lectures I've watched on this subject. Thank you for clearing things up for me.

    • @charlescoult
      @charlescoult Рік тому +2

      For example, the note at 10:31

    • @statquest
      @statquest  Рік тому +1

      Thank you! Yes, that little detail is important, but often glossed over.

  • @pixel_yeast
    @pixel_yeast 8 місяців тому +65

    i come to listen to " peep poop poop"

  • @CodingwithRayyan
    @CodingwithRayyan 7 місяців тому +2

    This is not fair, I literally am addicted to your style of teaching and find it quite hard to learn from other sources now.

    • @statquest
      @statquest  7 місяців тому +1

      Hopefully, in the long term, what you learn from these videos will make it easier to understand other sources. At least, that's starting to happen for me. It's still hard, though.

  • @santiagocalvo
    @santiagocalvo 9 місяців тому +1

    honestly your channel is one of if not the best channel on all youtube, thank you so much for this!

    • @statquest
      @statquest  9 місяців тому +1

      Wow, thank you!

  • @wongkitlongmarcus9310
    @wongkitlongmarcus9310 10 місяців тому +1

    Josh, you are the person who make ML theory so understandable!

  • @ZaidAlhusainy
    @ZaidAlhusainy Рік тому +7

    Your channel should be mandatory for all universities teaching AI 💖

  • @carleanoravelzawongso9786
    @carleanoravelzawongso9786 2 роки тому +48

    I'm just in love with your content. I've watched your neural network series and it was just so easy to understand. You really deserve more subs and views Josh!

    • @statquest
      @statquest  2 роки тому +3

      Thank you very much! :)

  • @v-sig2389
    @v-sig2389 2 роки тому +2

    Thank you so much 😭
    People like you are the real mvp of humanity !

  • @manishnarang6490
    @manishnarang6490 2 роки тому +31

    Really looking forward to your LSTM video.. You are a very good teacher !!

    • @statquest
      @statquest  2 роки тому +2

      Thank you!

    • @WonPeace94
      @WonPeace94 2 роки тому +5

      @@statquest when will you make the next vid ? i have exam in two weeks and i need your LSTM video

    • @statquest
      @statquest  2 роки тому +2

      @@WonPeace94 :)

  • @broccoli322
    @broccoli322 2 роки тому +1

    Im a simple man, I see statquest, I click like. Can't wait for the videos on transformers.

  • @waizwafiq9481
    @waizwafiq9481 2 роки тому +65

    Amazing video as always, professor! I cant wait for the video on LSTM

    • @statquest
      @statquest  2 роки тому +15

      You and me both!

    • @usamsersultanov689
      @usamsersultanov689 2 роки тому

      @@statquest when it comes to application of RNN the LSTM is sometimes a must to have:) that’s why it would be great to have clearly explanation of LSTM. But these are little things. In any case, thank you very much for the valuable knowledge that we can get here.

    • @statquest
      @statquest  2 роки тому +13

      @@usamsersultanov689 I hope to have a video on LSTMs soon.

    • @james199879
      @james199879 2 роки тому +5

      @@statquest One on Transformers and their variations would be even greater :D

    • @statquest
      @statquest  2 роки тому +13

      @@james199879 That's the master plan, but we'll get there one step at a time.

  • @TheChair610
    @TheChair610 4 місяці тому +2

    OH MY GOD THIS IS EXACTLY WHAT I WAS LOOKING FOR THANK YOU SO MUCH

  • @rw7154
    @rw7154 6 місяців тому +1

    StatQuest’s stylized scalar-based mumerical examples are amazing even for learning beyond the introductory level. To get the full vectorized-matrix version of the algorithms, I just mentally swap x, w, b etc with the corresponding vectors and matrices, then it’s golden!

  • @anonymousertugrul5858
    @anonymousertugrul5858 10 місяців тому +1

    I like the way how clearly and easily you explain concepts. Thank you very much!

    • @statquest
      @statquest  10 місяців тому

      You're very welcome!

  • @chaitanyasharma6270
    @chaitanyasharma6270 2 роки тому +9

    you definitely are the best teacher for machine learning and deep learning

  • @deepikasheshabutter4790
    @deepikasheshabutter4790 7 місяців тому +1

    i literally was having a menatal breakdown coz i was unable to understand things. your video helped me a lot and also brought a smile on my face :))

    • @statquest
      @statquest  7 місяців тому +1

      Glad I could help!

  • @solotop5916
    @solotop5916 8 місяців тому +1

    Dude that DOUBLE BAMM and TRIPLE BAMMM kills me. Actually fun way to get info. Also greate video very easy to understand

  • @anashaat95
    @anashaat95 2 роки тому +8

    Very high level explanation. Waiting for the next video on "Long-short Term Networks". Thank you so much.

  • @qwertz2167
    @qwertz2167 2 роки тому +2

    True Hero. I have an exam on 29th about rnns, lstms and transformers.

  • @gabbye165
    @gabbye165 2 роки тому +1

    12:22 is probably the cutest bam I've heard
    Also thank you for your videos! They have definitely been helping me get through my Bioinformatics grad course. You are AWESOME

    • @statquest
      @statquest  2 роки тому +1

      Thank you so much and good luck with your course! :)

  • @IsaacKLusuku
    @IsaacKLusuku 6 місяців тому +1

    Hey Josh...the way you made this so easy is mind blowing, I love you man, keep being awesome 😊

    • @statquest
      @statquest  6 місяців тому

      Thank you so much 😀!

  • @Marie-10-i1r
    @Marie-10-i1r Рік тому +1

    Excelente proyecto! no pense que con dibujos fuera tan entretenido e informativo. Definitivamente un muy buen video para comenzar!

  • @8bit-ascii
    @8bit-ascii 2 роки тому +1

    They way you explained RNNs made me so excited for LSTMs. Can‘t wait to see it!

  • @chrism3440
    @chrism3440 5 місяців тому +1

    Oh my gosh that was an amazing explanation. I'm quite literally flabbergasted. Thanks, mate!!

    • @statquest
      @statquest  5 місяців тому +1

      Glad you liked it!

  • @KayYesYouTuber
    @KayYesYouTuber 2 роки тому +2

    Hi Josh, You are the best. Nobody has explained exploding gradient like you have, Thank you

  • @saharshayegan
    @saharshayegan 2 роки тому +1

    This was the best explanation I've heard for RNNs!

  • @JulietNovember9
    @JulietNovember9 2 роки тому +1

    Oh man! This has been super tough for me to wrap my head around. I knew this was going to be a great weekend! Thank you for the drop! :D

  • @osamahabdullah3715
    @osamahabdullah3715 2 роки тому +1

    literally before I see your video, I made a like, that much I trust your information and knowledge , thank you for your time and effort to explain this to us

  • @AI_ML_DL_LLM
    @AI_ML_DL_LLM 2 роки тому +1

    Great video, you must become the President of the ClearlyExplainedLand

  • @sheltonsong6120
    @sheltonsong6120 2 роки тому +2

    Clearly explained the difference between RNN and normal network, gradient vanishing/exploding! Looking forward to the LSTM and Transformer videos!!!

  • @chriskong7418
    @chriskong7418 Рік тому +1

    Love the little embarrassing singings during the videos. Subscribed. Great videos!

  • @mermich
    @mermich Рік тому +1

    You graced upon us as a stats saviour :))) Send love from Australia

  • @zeljkobalanovic8900
    @zeljkobalanovic8900 2 роки тому +1

    That intro was sick. I smashed like button immediatelly :D

  • @brandonso5477
    @brandonso5477 Рік тому +1

    why are you master of everything???? I have been watching your video for two years through out my university course

  • @curiosityspace8635
    @curiosityspace8635 11 місяців тому

    Oh man i literally watch his videos like a web series its very fun and very easy to understand thank you very much sir !!!!😭😭

  • @luistalavera6392
    @luistalavera6392 Рік тому +1

    Man, this is awesome. I wasn't understanding anything about RNNs in my course but thanks to this video is all clear now.
    Thank you Josh Stamer :D

  • @Eman_sq
    @Eman_sq 2 роки тому +1

    Thank you

    • @statquest
      @statquest  2 роки тому

      DOUBLE BAM!!! Wow! I really appreciate the support!

  • @cat-a-lyst
    @cat-a-lyst Рік тому +1

    you are vry very very very very very brilliant teacher ! you are my low variance and low bias position.

  • @ai_station_fa
    @ai_station_fa 2 роки тому +1

    Best explanation I've seen from RNNs. Thanks.

  • @zytriesthings4540
    @zytriesthings4540 5 місяців тому +1

    Thank you brother, this was really intuitive and easy to understand

  • @ajaygupta6034
    @ajaygupta6034 20 днів тому +1

    This dude is funny and a great teacher. Triple BAM fosure

  • @CarlosCaetanoJr
    @CarlosCaetanoJr 2 роки тому +1

    Anxious for the LSTM, Transformers and Attention StatQuests!

    • @statquest
      @statquest  2 роки тому +1

      It's already available to early access patreon supporters and will be available to everyone else soon.

  • @huruynegash4847
    @huruynegash4847 Рік тому +1

    Hello Guys let's make this man happy always as he did for us!!!!!!!!!!!!! Nothing to say just thanks a lot.

  • @loreii1982
    @loreii1982 Рік тому +1

    I saw a light turning on my head! great video

  • @chelvynchristsonimmanuel1453
    @chelvynchristsonimmanuel1453 Рік тому +1

    Amazing explaination with simple, easy-absorb, attractive method and but still pursue clear concept. 🙂 Kabaam... nice job

  • @sinaro93
    @sinaro93 2 роки тому

    KA-BAAAM! Thank you for all these amazing videos. I wish you had different series about CNNs and RNNs separately.

    • @statquest
      @statquest  2 роки тому +1

      If you want to learn about CNNs, see: ua-cam.com/video/HGwBXDKFk9I/v-deo.html

    • @sinaro93
      @sinaro93 2 роки тому

      @@statquest How could I not have seen this?! By different series, I mean it would be great if you could create more videos covering each of these topics in more detail. But of course, you've already done so far, and I'm so grateful to you for sharing your knowledge in such a good way.

  • @exxzxxe
    @exxzxxe 2 роки тому +1

    Your professorial ability is only exceeded by your singing!!

    • @statquest
      @statquest  2 роки тому

      Thanks!

    • @exxzxxe
      @exxzxxe 2 роки тому +1

      @@statquest When are you going to release your, surely to be a best-selling, book on singing lessons?

    • @statquest
      @statquest  2 роки тому

      @@exxzxxe Just as soon as I win Eurovision.

  • @indusairaman2126
    @indusairaman2126 2 роки тому +2

    U have an amazing way of explaining with adlibs loved it and thank you so much as I was not able to understand at all but now it is very clear

  • @HEYTHERE-ko6we
    @HEYTHERE-ko6we 8 місяців тому +1

    Those tones won won bam double bam kaboom n d fun way of learning, opens up mind for grasping things real quick as well as we can think freely wdout bcming nervous. U lord🙌

  • @EntropyBeater
    @EntropyBeater 2 роки тому +1

    Thanks!

    • @statquest
      @statquest  2 роки тому

      Hooray!!! Thank you so much for supporting StatQuest! TRIPLE BAM! :)

  • @AhmadAbuNassar
    @AhmadAbuNassar 8 місяців тому +1

    Any darn fool can make something complex; it takes a genius to make something simple (" Albert Einstein"), and you made it very very simple. Thanks!

    • @statquest
      @statquest  8 місяців тому

      Thank you very much! :)

  • @CharlieYou823
    @CharlieYou823 8 місяців тому +1

    PENTA BAM!!! The best pre-course !

  • @TPLCompany
    @TPLCompany 2 роки тому +2

    Great video!! I can't wait for LSTM and transformer videos!

  • @Raulvic
    @Raulvic 2 роки тому +1

    Thank you for sharing 🙂 super excited for the transformers statsquest!

  • @harishbattula9881
    @harishbattula9881 2 роки тому +1

    Thanks a lot Josh. Every concept explained by you is a BAM!!!!!!!!!!

  • @Naveedahmed-bq5iz
    @Naveedahmed-bq5iz 2 роки тому +1

    Amazing, This is one best and coolest learning tutorial i have watched ever, great work Josh, keep it up. Thanks

  • @Tapsthequant
    @Tapsthequant 2 роки тому +1

    Been waiting and waiting, the waiting is BAM!!!

  • @mostafamarwanmostafa9975
    @mostafamarwanmostafa9975 2 роки тому +1

    Thank YOUUU Clearly explained !! I have been struggling with it !

  • @krishnaphanindra1841
    @krishnaphanindra1841 Рік тому +1

    Beautiful and succinct explanations!! So glad I found your channel....lots of love

  • @giorda77
    @giorda77 9 місяців тому +1

    Clear as day!!! Hooray!!!! Thank you Josh

  • @mohammadahmedbasri3067
    @mohammadahmedbasri3067 2 роки тому +3

    Thank you for this amazing explanation! Waiting for the video on LSTM! :)

  • @gabriellelin1302
    @gabriellelin1302 11 місяців тому +1

    谢谢!

    • @statquest
      @statquest  11 місяців тому

      Thank you so much for supporting StatQuest! TRIPLE BAM! :)

  • @tombyrne6543
    @tombyrne6543 5 місяців тому +1

    Thanks

    • @statquest
      @statquest  5 місяців тому

      TRIPLE BAM!!! Thank you very much for supporting StatQuest!!! :)

  • @fulcrumthewhite
    @fulcrumthewhite 2 роки тому +2

    Very hyped for the video transformers ! Keep up the good work, it's amazing how good it is!

  • @stephaniexu2853
    @stephaniexu2853 2 роки тому +1

    Such a great explanation!! Will be watching as many of your other videos as I can while we wait for the next one :))

  • @safiyajd
    @safiyajd 2 роки тому +1

    Josh, you are amazing! Thank God you exist

  • @WALID0306
    @WALID0306 Рік тому +1

    Gracias !! Estuvo excelente ✨✨✨✨ Bendiciones

  • @justLu__
    @justLu__ 11 місяців тому +1

    Hey, hopefully this will safe my Deep Learning exam. And... love the sound effects.

  • @ClemensPutz-ist-der-beste
    @ClemensPutz-ist-der-beste Рік тому +1

    I wish you were my math teacher! The whole class would have sang like you while calculating🤣

  • @maximus2978
    @maximus2978 11 місяців тому +1

    You are insane Man, very clear and understandable explaination!! Thanks a ton 🎉

  • @TheGibberingGoblin
    @TheGibberingGoblin Рік тому +1

    ... you sir are a timeless legend!

  • @mahu1203
    @mahu1203 Рік тому +1

    Thank you so much. You make great videos... Just great teaching. Thanks alot.

  • @AuthsKads
    @AuthsKads Рік тому +1

    u are king my friend
    perfect explanation with simple example

  • @yeohweixiangbenjy1983
    @yeohweixiangbenjy1983 2 роки тому +1

    All love. Looking forward to LSTM video.

    • @statquest
      @statquest  2 роки тому +1

      Thanks! The LSTM video should be out on Monday.

  • @sarahk13peace
    @sarahk13peace Рік тому +1

    OMG I love you for your teaching style

  • @felipela2227
    @felipela2227 Рік тому +1

    El video estuvo muy bien explicado, lo entendí facilmente. Gracias

  • @alekseishkurin4590
    @alekseishkurin4590 Рік тому +1

    Omg, that intro jingle is gold!

  • @kanisrini01
    @kanisrini01 6 місяців тому +1

    Great video & explanation 👏🌟. Thank you so much.

    • @statquest
      @statquest  6 місяців тому

      Glad it was helpful!

  • @NockyLucky
    @NockyLucky 9 місяців тому +1

    Really liked the video. Quite creative and straight to the point!