Momentum Optimizer in Deep Learning | Explained in Detail

Поділитися
Вставка
  • Опубліковано 28 жов 2024

КОМЕНТАРІ • 47

  • @anuranroy4638
    @anuranroy4638 2 роки тому +15

    This is EXACTLY HOW I needed to learn: Maths + Visualization with equations! Thank you so much!

  • @pranaysingh3950
    @pranaysingh3950 3 роки тому +10

    Very few of them had even explained what momentum is made up of, whats its equation, you just took 2 mins to add that explanation but it helped so much to understand rest 10 mins of the video without pausing. Great work. Please keep it up.

    • @CodingLane
      @CodingLane  3 роки тому

      Thank you Pranay! Glad to hear that you found the videos helpful

  • @bijoyroy6112
    @bijoyroy6112 3 роки тому +2

    Very few resources in the internet explain these concepts in this kind of depth and clearly. Either they are in depth but not understandable or clear but not in depth. Loved your explanation.

    • @CodingLane
      @CodingLane  3 роки тому

      Thank you so much! It means a lot to me

  • @minhnhat7011
    @minhnhat7011 2 роки тому +2

    Your lectures are very short and easy to understand. Hope you will make more videos like this about optimization algorithms in deep learning.Thank you very useful video

    • @CodingLane
      @CodingLane  2 роки тому

      Good to hear! I will keep uploading more videos

  • @redalamphd4505
    @redalamphd4505 2 роки тому +3

    Greatly explained ! Thank you !! ( I find it even better than Andrew's one on the momentum), Keep it up !!

    • @CodingLane
      @CodingLane  2 роки тому

      Thank you! Glad you found it valuable. Good to hear this!

  • @amirrezasadeghi5755
    @amirrezasadeghi5755 2 роки тому +1

    this was exactly what I was seeking for. Thanks a lot!!!!!!

  • @chinmaysoni4416
    @chinmaysoni4416 2 роки тому +1

    Very nice explanation, thank you....From scratch, mathematics is what I was looking for....This really helped!!

  • @aashwinsharma1859
    @aashwinsharma1859 2 роки тому +1

    Wonderful video. Made the concept look very easy...

  • @pranaysingh3950
    @pranaysingh3950 3 роки тому +1

    You're a great man dude! Thanks alot.

  • @melikakeshavarz6121
    @melikakeshavarz6121 2 роки тому +1

    oh my god, this was clearly explained, thanks for this perfect insight.

    • @CodingLane
      @CodingLane  2 роки тому

      Thank You. Glad it helped you!

  • @ghilesdjebara8066
    @ghilesdjebara8066 Рік тому

    This is the best explanation. Thank you

  • @mohamedmohudoom5473
    @mohamedmohudoom5473 3 роки тому +1

    very informative video brother,Thank you very much for the explanation,It was great

  • @OnTastySpots
    @OnTastySpots 2 роки тому

    Thank you for a detailed video! I'm not an expert in this area. Could you explain what are W and B? From my understanding, W is the vector of parameters in the cost function, e.g., we want to minimize f(W). Is that correct? If so, what is B? How is it different from W? Thanks!

    • @CodingLane
      @CodingLane  2 роки тому +2

      Hello... I think your understanding is not properly correct. I have explained W and B in this video: ua-cam.com/video/mlk0rddP3L4/v-deo.html
      Please have a look at the entire video and you might understand. Also, I have explained about W and B in my initial videos as well in Linear Regression Playlist. If you watch my playlists from the beginning, then you will get a more clear idea.
      Hope its helpful.

  • @careyshane3865
    @careyshane3865 6 місяців тому

    At 7:00 I think the difference formula is supposed to V(t) = Beta*Theta(t) + (1-Beta)*V(t-1) rather than V(t) = Beta*V(t-1) + (1-Beta)*Theta(t). Am I seeing that correctly?

  • @olgaptacek5393
    @olgaptacek5393 2 роки тому +1

    On 5:27 when computing V3, aren't you missing the factor (1-beta) from V2?

    • @CodingLane
      @CodingLane  2 роки тому

      Yea i missed writing it… thanks for letting me kno

  • @zshahlaie4740
    @zshahlaie4740 Рік тому

    u are so good but some of ur vudeos has no subtitle caption unavailabe please active that for all ur videos tnx a lot

  • @Vanilla102
    @Vanilla102 Рік тому

    Great video, thanks man

  • @anirbanrana9660
    @anirbanrana9660 11 місяців тому

    Very well explained sir. Can you please start a playlist of DSA for python?

  • @mamahuhu_one
    @mamahuhu_one Рік тому

    What would be the difference between this and adadelta?

  • @Ankit-hs9nb
    @Ankit-hs9nb 2 роки тому +2

    3:09 you are saying we give higher weightage to new points and low weightage to old points
    but at 7:47 , you are saying something opposite of it
    so a confusion in this
    I will appreciate if you can resolve this

    • @CodingLane
      @CodingLane  2 роки тому

      The words seems opposite, but if you try to observe it carefully, I am talking about 2 different things there.

    • @Ankit-hs9nb
      @Ankit-hs9nb 2 роки тому

      so at 3:09 you are talking about points but at 7:47 you are talking about average?
      did I understand correctly?

    • @CodingLane
      @CodingLane  2 роки тому +1

      @@Ankit-hs9nb at 7:47, lower weightage is still given to the older points compared to newer points, but in general.
      the weightage to the older points taking beta as 0.95 is greater than weightage to the older points taking beta as 0.6
      In general, both of them are giving more weightage to the newer points. I was just comparing the weightage for beta as 0.95 and 0.6 at 7:47

  • @shahomaghdid9591
    @shahomaghdid9591 5 місяців тому

    Thank you so much!

  • @santiagocalvo
    @santiagocalvo 2 роки тому +1

    You are a god! Thanks from Argentina!

    • @CodingLane
      @CodingLane  2 роки тому

      Hi Santiago.. Its great to see that people from different lands are learning from these videos. Thanks for the compliment 😇

  • @lochuynh6734
    @lochuynh6734 3 роки тому +1

    Thank you so much

  • @mah4816
    @mah4816 Рік тому

    Amazing

  • @option4fun
    @option4fun 2 роки тому +1

    you are best.. :-)

  • @mugomuiruri2313
    @mugomuiruri2313 11 місяців тому

    good

  • @alidakhil3554
    @alidakhil3554 3 роки тому +1

    I want to contact you for business work

    • @CodingLane
      @CodingLane  3 роки тому

      Hello Ali, here is my email address: codeboosterjp@gmail.com

    • @alidakhil3554
      @alidakhil3554 3 роки тому

      @@CodingLane I sent you an email