Gradient Descent From Scratch | End to End Gradient Descent | Gradient Descent Animation

Поділитися
Вставка
  • Опубліковано 16 лип 2024
  • This is a comprehensive guide to understanding Gradient Descent. We'll cover the entire process from scratch, providing an end-to-end view. Plus, witness a visual representation with a Gradient Descent animation.
    Code used: github.com/campusx-official/1...
    Google Tool used: developers.google.com/machine...
    ============================
    Do you want to learn from me?
    Check my affordable mentorship program at : learnwith.campusx.in/s/store
    ============================
    📱 Grow with us:
    CampusX' LinkedIn: / campusx-official
    CampusX on Instagram for daily tips: / campusx.official
    My LinkedIn: / nitish-singh-03412789
    Discord: / discord
    E-mail us at support@campusx.in
    ⌚Time Stamps⌚
    00:00 - Intro
    01:15 - Summary of Gradient Descent
    04:10 - What is gradient descent?
    05:22 - Plan of attack
    07:25 - Intuition for GD
    28:45 - Mathematical Formulation of Gradient Descent
    36:11 - Code Demo
    47:41 - Creating our own class and methods
    57:16 - Vizualizing our class
    01:05:05 - Effect of Learning Rate
    01:07:33 - Universality of GD
    01:10:23 - Performing Gradient Descent by adding 'm'
    01:14:15 - Vizualisation
    01:23:48 - Code Demo and Vizualization
    01:44:35 - Effect of Learning rate
    01:49:25 - Effects of Loss Function
    01:55:12 - Effect of Data

КОМЕНТАРІ • 413

  • @saptarshisanyal6738
    @saptarshisanyal6738 2 роки тому +272

    It is really shocking how pathetic are NPTEL Professor explaining this same topic. They are from IITs but all the time keep notes in their hand and explain the stuffs arbitrarily, and here is this guy - cool,calm, composed and confident. I am 42, and I guess I am atleast 12 years older than him but still I respect him like anything as a teacher.

    • @Ram_jagat
      @Ram_jagat Рік тому +8

      Every word is 💯 true. Such a great teacher he is..

    • @anonymous_4276
      @anonymous_4276 8 місяців тому +5

      I really enjoyed the explanation of a few IIT professors like Mitesh Khapra. I think the issue is that a strong grasp of mathematics is a prerequisite for those lectures.

    • @sciencewallah1306
      @sciencewallah1306 8 місяців тому

      You are Great

    • @Anomly300
      @Anomly300 7 місяців тому

      @@anonymous_4276 SAME HERE ONLY POINT TO ADD THAT FOR ML NPTEL NOBODY TOUGHT IN SAME WAY

    • @kindaeasy9797
      @kindaeasy9797 6 місяців тому +6

      iit mai teachers private college se bhi ghatiya hai , mai khud you tube se padh rha hu

  • @vaishnokmr
    @vaishnokmr 2 роки тому +78

    I'm just wandering here and there for clearing what is an actual gradient descent ..Wow explanation...I'm not bored a single minute. it's an addictive explanation...

  • @akash.deblanq
    @akash.deblanq 2 роки тому +63

    I really liked the last philosophy wala quote. I am really in a place in my employment journey that I don't personally like. I really want to get into ML and DS and trying my best to learn. Hopefully I'll reach the global minima soon.
    Thanks a ton for sacrificing so much for making these videos. I'll never forget you. Whoever asks me about starting ml and is Indian, the only playlist I suggest is yours.

  • @maniaccoder2678
    @maniaccoder2678 3 роки тому +36

    App jo kam kar rahe ho ye muje paid course me nahi mila sir... thank you sir

  • @amitbohra9283
    @amitbohra9283 Місяць тому +4

    Bhai mai generally comment karta nahi, but Sir ki ek baat mujhe sabse jyada passand hai, wo hai Sir kabhi ghaans nahi kaat te, aise nahi ki 99 pe chod diya, 100 poora karke hi padhayenge, example bola hai to example poora deke hi samjhayenge, code karke hi batayenge.
    Hats Off sir. Bohot late discover kiya aapko, but thank you for you effort.

  • @user-gt7fc6jt8z
    @user-gt7fc6jt8z 10 місяців тому +8

    Nitish Sir's CampusX channel is no less than a binge web series. The way he hooked up me with all his videos in 100 days of ML, no one else would have done that, and I know, lot of people with me are drawing inspirations from you and learning positively. Thanks a lot

  • @jatinakad
    @jatinakad Рік тому +12

    This channel is still underrated. Keep doing your excellent work Nitish and please don't let any big organisation buy you. Please try to make your courses accessible or affordable always. We need more teachers like you. Good Luck!

  • @akzork
    @akzork 2 роки тому +16

    Just finished the video. I have no words. I learned python through your " 100 days of python" playlist. I am in the middle of the "100 days of ML" playlist. I think this video without a doubt is your best work to date. What a beast of a teacher you are.

  • @yashshrivastava1612
    @yashshrivastava1612 Рік тому +19

    It is just awesome how not even paid courses could make me understand gradient descent in such easy manner, I'm Just flabbergasted by the way you teach because you've been in our shoes and you understand all the problems that we might face while understanding such topics.
    I can't Thank You enough Nitish.
    Can only pray that you achieve more than what you aspire for.

  • @shreyasur1534
    @shreyasur1534 18 днів тому +2

    The best video on gradient descent ever Nitish Sir!

  • @NabidAlam360
    @NabidAlam360 4 місяці тому +2

    Never stop teaching brother! You are making this an art!!!

  • @ZawaD.N
    @ZawaD.N 3 дні тому

    The tutorial is over, a long sigh. In this situation I could offer nothing but thanks.
    Thank You for your hard work.
    You are a GEUM in this field.

  • @harshadapatke885
    @harshadapatke885 2 роки тому +11

    Best Explanation of Gradient Descent I ever have, I will never forgot. Thank you so much for making this easy for us! Waiting for you Deep Learning Playlist.

  • @swatibansal4045
    @swatibansal4045 2 роки тому +19

    One of the best Gradient descent videos that I have seen on the internet.
    Amazing visualization, amazing code.
    Thank you once again for sharing such deep knowledge with your subscribers.

  • @zaedgtr6910
    @zaedgtr6910 8 місяців тому +2

    God giifted teacher of Data SCience.....appreciate your efforts.....there is no one as good as you in whole youtube platform who explain these things from the very basic...I am a commerce student and still able to understand the mathematical part just because of you. Thank you so much.

  • @anuragkothari8384
    @anuragkothari8384 7 днів тому

    Honestly i have't find anything better than you ML videos. Thanks

  • @arindammallik4974
    @arindammallik4974 11 місяців тому +3

    Exceptionally clear step by step explanation.

  • @sameerpandey5561
    @sameerpandey5561 2 роки тому +1

    The way you implement code behind the math of every algorithm makes it super easy ....

  • @arun5351
    @arun5351 2 роки тому +4

    Loved the philosophical angle you've given to Gradient Descent Nitish! :)
    One might be quite afar from his/her goal or the rightful place in life but even smallest consistent steps in the right direction will eventually takes us there.

  • @marselwidianto4387
    @marselwidianto4387 Рік тому +1

    Sir I really want to thank you.
    Can't express in words about the impact which you have put in my life

  • @bhanu0925
    @bhanu0925 2 роки тому

    I will never forget gradient descent. Awesome explanation. Thank You

  • @230489shraddha
    @230489shraddha 2 роки тому

    It is a brilliant tutorial on Gradient descent. Clears all the doubts. Salute to your hard work and dedication for teaching.

  • @prableen8755
    @prableen8755 Місяць тому

    WOW, the way you explained it....this can not get any simpler. SUPER GLAD I found your playlist. Thanks a lot.

  • @MrAmarSindol
    @MrAmarSindol Рік тому

    Watched it again.... excellent and extreme excellent !! sukoon milta hai kuch aisa content samajne me !!

  • @editor_india_2024
    @editor_india_2024 2 роки тому

    The best explanation of gradient descent using python ever I found. Thank you sir for making such a great videos!!

  • @somanshkumar1325
    @somanshkumar1325 Рік тому +1

    I really can't thank you enough for this amazing explanation. Hats off to you for putting so much effort in creating such a high-value content.

  • @flower88able
    @flower88able Рік тому +1

    Unbelievable explanation. Never ever seen a such detailed explanation. Amazing. Keep inspiring and going. Thanks a lot.

  • @dineshpandey7232
    @dineshpandey7232 Рік тому

    One of the best videos I found here. You have a really good command on the topic. In depth knowledge

  • @nikhitatripathi7728
    @nikhitatripathi7728 2 роки тому +1

    This was such an amazing explanation, I'm not from a Maths/Engineering background but I could pretty much follow everything because it was done so seamlessly. Looking forward to watching more videos, Kudos!

  • @sanaayakurup5453
    @sanaayakurup5453 Рік тому

    This video and channel needs millions of views. Thankyou, i never understoof GD but now its all clear

  • @manyagupta6375
    @manyagupta6375 10 місяців тому +3

    In everyone's life, there is atleast one teacher who changes the meaning of learning for them and you're just that for me.
    I feel so grateful for having come across your channel. Thabk you so much sir!! After so many months and tutorials, I am finally having fun learning ML.

  • @virajkaralay8844
    @virajkaralay8844 8 місяців тому

    Words are not enough for the efforts you have taken to make this explanation so seamless and at the same time so comprehensive. Thank you Nitish Sir.

  • @abhaykumaramanofficial
    @abhaykumaramanofficial Рік тому +2

    I have never seen such a teacher like you...I spent a long time to complete this video...and finally finished...thank you for providing such a great content

  • @kedarshiral6391
    @kedarshiral6391 Рік тому +1

    I have watched it 5 times... trust me it is a really addictive and nostalgic explanation that I have seen never before... you are amazing man ... hats off

  • @SaifaliKhan-zk6sh
    @SaifaliKhan-zk6sh 8 місяців тому

    what a depth of explanation on Gradient Descent in the whole history of UA-cam,, Thanks a lot sir

  • @manashjyotiborah530
    @manashjyotiborah530 11 місяців тому +2

    This is the best video I found for understanding gradient descent. You are one of the best teachers that I have ever learned from.

  • @aniketdas3359
    @aniketdas3359 2 роки тому +2

    Amazing Explaination
    Appreciate your hard work . This channel deserves million subscribers atleast

  • @rb4754
    @rb4754 Місяць тому +1

    You nailed it... How beautifully you explained it... with theory, graphs, codes.. this is a complete package...

  • @bhawna4766
    @bhawna4766 Рік тому

    Amazing video. Understood every single point just by watching it once. Really appreciate your efforts on doing so much research and making it so simple for beginners.

  • @chaitanyalarokar5308
    @chaitanyalarokar5308 Рік тому

    I think i would never forget this content. you are AMAZING!!

  • @yogeshsariya4259
    @yogeshsariya4259 Рік тому +2

    The introduction of topic, pace of teaching, concept clarification, demonstration everything is excellent.

  • @tusharshukla9361
    @tusharshukla9361 Рік тому

    watched this video from start to end without getting bored, lots of love and respect Sir 💖💖🙏🙏🙏🙏

  • @rijanpokhrel9281
    @rijanpokhrel9281 6 місяців тому

    best teacher I have ever met in my life...too good ..no words.....Love from Nepal

  • @akshaykadam4672
    @akshaykadam4672 Рік тому

    What a content, OMG, love it. Simply amazing! Such a awesome teacher.

  • @karthikiyer3396
    @karthikiyer3396 4 місяці тому +1

    The best explanation to the concept of Gradient Descent. Indeed the best data science concept video ever came across.

  • @AkshayRakate
    @AkshayRakate 2 роки тому

    Brilliantly Explained !! Cleared all remaining concept of GD.!! Visualiation part was amazing ! Thanks you so much for this amazing content !

  • @manya5466
    @manya5466 Рік тому

    Your passion to deliver the best is incredible. Lots of respect sir.

  • @rajeswarsingh256
    @rajeswarsingh256 Рік тому

    one of the best videos on youtube for gradient descent.👍👍

  • @ManavMSanger
    @ManavMSanger 7 днів тому

    These videos are pure gold. I cant tell you how good these videos are.

  • @bhargavsharma2716
    @bhargavsharma2716 2 роки тому +1

    Hats off to you, sir, for all the hard work you put in

  • @manaswinim7775
    @manaswinim7775 Рік тому

    Oh my God ! can anyone else make us understand such a difficult concept soooo simplified manner ?! Kudos and Respect to Nitish Sir . May God bless you.

  • @rahultekade6446
    @rahultekade6446 2 роки тому +1

    Hats off
    Thanks for your guidance 💐

  • @sunny739
    @sunny739 Рік тому

    what an amazing life lesson ! last two minutes.
    Loved the way explained GD..
    thank you so much sir , for such an extra ordinary explanation .

  • @qadirhussain7679
    @qadirhussain7679 Місяць тому

    The best explanation of gradient descent that I've ever seen

  • @ramanmaini1931
    @ramanmaini1931 Рік тому

    Great sir. you live long. God will bless you everything. Prayer from core of my heart. This is real humanity service.

  • @shubhamrawat5299
    @shubhamrawat5299 2 роки тому

    Thank you, Sir, For This Lovely Tutorial Video. With this many graphs and Practical implementation, I will never Forget Gradient Descent.

  • @Ravi-sl5ms
    @Ravi-sl5ms 2 роки тому

    You know well how to teach. Thanks for making this concept so easy to understand

  • @beenudhupar953
    @beenudhupar953 Рік тому

    Best content ever 👍. This channel is worth studying complex ML algorithms and associated concepts. Thank you for putting in so much hard work.

  • @Theoratorscorner
    @Theoratorscorner Місяць тому

    bro honestly you are a gem lots of love and success

  • @cybermascot
    @cybermascot 11 місяців тому +2

    You are a brilliant teacher. you just nailed the concept, I was searching step by step math behind GD and you elaborated every single step with such a fine detail. Earlier i was a bit confused but now i can nail it. Thanks a lot Guru.

  • @kamalchoudhary735
    @kamalchoudhary735 3 роки тому

    now i got the concept of GD clearly ,thank you so much ... you really explain well...

  • @karangupta3491
    @karangupta3491 Рік тому

    sir watching you is REALLYY worth it *IN TRUE SENSE*

  • @messi0510
    @messi0510 Рік тому +3

    1:08:00-->1:10:05 Gradient descent summary
    1:44:20-->1:56:45 Effect of learning rate , loss function and data on gradient descent
    1:56:50-->1:57:25 Philosophy 😊

  • @imusama
    @imusama Рік тому

    That was the best video I've ever watched on gradient descent. I was searching for just one video that could teach me what GD is, and I couldn't find any. Thank you for this thorough explanation, sir. If you were in front of me, I would have kissed your hands.

  • @PR-ud4fp
    @PR-ud4fp 2 роки тому

    Thank you for putting in all the effort. This is one of the best explanations of GD on YT 🙌

  • @dakshbhatnagar
    @dakshbhatnagar Рік тому

    I actually have no words to say how good this video is. 🔥

  • @KANTAMMOTGHARE
    @KANTAMMOTGHARE 9 місяців тому

    Hats off to your Efforts Sir!
    It much have taken days to complete all those graphs!
    The graphs surely do help

  • @GamerBoy-ii4jc
    @GamerBoy-ii4jc 2 роки тому

    Thank u so much Sir itni Struggle krny k lye.. sary concept clear kr dye apny..buhat hi acha smjhaya he shukrya Sir!

  • @priyanshugupta9192
    @priyanshugupta9192 Рік тому

    best video of the playlist ... shows lot of hard work and paitence 👏👏

  • @geetanshusinghnegi2672
    @geetanshusinghnegi2672 9 місяців тому

    Superb🎉 Explanation... Longest video ever i watched on youtube

  • @kumarmanishpradhan
    @kumarmanishpradhan Місяць тому

    One of the best videos in Machine Learning and the important concept like Gradient Descent. It's been a few days I was searching here and there but not found any profound understanding like this. Love you sir. You owe a lot of love and respect.

  • @aameenmd6659
    @aameenmd6659 5 місяців тому

    great work sir, still after 2 years your videos are the most relevant for DS and im in my training period of my ML engineer job and i think this will help me boost my career by far. love from delhi

  • @nazneenkhan8058
    @nazneenkhan8058 11 місяців тому +1

    I am a complete beginner to this field.. transitioning from my current job in construction to tech and I’ve been have a horrible time understanding from my “professional bootcamp” .. I was feeling completely lost before you and considered quitting .. I honestly cannot thank you enough for everything!

  • @diyapatel4446
    @diyapatel4446 Рік тому

    this is such an informative lecture. i am not a math functions person but i was so intrigued by this and i have understood it so well that i can even teach it to someone else. thank you so so much for all your efforts.

  • @suchiupadhyay4361
    @suchiupadhyay4361 Рік тому

    Thank you so much Sir for making this video. Needless to say we can realise how much efforts and time given by you to make this in understandable format. Kudos to you for this job. Keep it up. Than you.

  • @raghavagrawal6263
    @raghavagrawal6263 3 роки тому +2

    Best video And so much thanks from the bottom of my heart to cover this topic, sir. Now after watching this lecture I am seeming we are going to get the next Krish sir to teach in Hindi. Thank you, sir.

  • @user-xb8mk4ju4z
    @user-xb8mk4ju4z 9 місяців тому

    Its Awesome the way you've explained. Really loved it.

  • @shekharkausalye
    @shekharkausalye 2 роки тому +1

    What a great explanation. It actually fit in the mind and cleared the concepts. And yes I saw this one is the longest video. Thank you for this video as it has explained very imp point in very easy language, and definitely the efforts that you have taken behind this video paid off as we understood it easily. Thanks a lot.

  • @gauravmalik3911
    @gauravmalik3911 2 роки тому

    This is the best gradient descent explanation, great efforts

  • @deyslearning6198
    @deyslearning6198 Рік тому

    I have never seen such a video on UA-cam Thanks Sir ji

  • @siyays1868
    @siyays1868 Рік тому

    Truely Brilliant Animation of Gradient Descent!👏👏🙏🙏👍. Even paid classes also not able to give this quality content ; i said it bcz i did paid classes but after coming to this channel , concepts r really got cleared. I m truly & always be very greatful to u & ur No. 1 i n India ' Campus X ' channel. Thanku very very much...!

  • @UnpluggedSalman
    @UnpluggedSalman 2 місяці тому

    A heart ❤ for your hard work on the gradient descent video sir... Your explanation was the finest explanation i have got on this topic. .. Loved it sir

  • @khemrajpatil5683
    @khemrajpatil5683 2 роки тому

    Sir, you are amazing! You explained this topic greatly. Thank you much!😇

  • @bishalroy1186
    @bishalroy1186 Рік тому

    I don't know how to repay your deeds, the satisfaction it gave cannot be compared to anything, we are blessed to have you around us ❤️
    Thank You Very much for this video, it is actually more than a video for someone who is struggling with this concept.
    Just remember whatever i said is less, i feel there is no word that can be expressed to thank you enough.

  • @TheTiwary
    @TheTiwary 2 роки тому

    Highly appreciate your hardwork ....

  • @shivoham5939
    @shivoham5939 Рік тому +1

    You are trying
    to get to the lowest point of the mountain range. You can see the slope around
    you before you even take a step. You step in directions where the slope visibly goes
    downward. You take bigger steps for bigger slopes, and smaller steps for smaller
    slopes. Ultimately, you will find yourself at a low point where the slope is flat, a
    value of 0. Sounds pretty good, right? This approach with the flashlight is known as
    gradient descent, where we step in directions where the slope goes downward. superb explanation sir

  • @hammadfaheem5979
    @hammadfaheem5979 Рік тому

    I have been teaching Python Data Analytics and Machine Learning related subjects Internationally. I have been using your course work and following your way of teaching to them and students were like WOOWW how do learn that and appreciating my explanation. This all belongs to you, you are like live saver. So much respect from Pakistan Thank you.

  • @SimranCE-
    @SimranCE- 2 роки тому

    Finally found the best teacher,, really really very good content,,♥️

  • @alkamankar9813
    @alkamankar9813 Рік тому +1

    when I read Gradient Descent first time it was horror for me , but when I saw this video , I came to know it is not so difficult as I thought. Sir, You are very great teacher.Hats off to your hardwork. God bless you.
    When I found this channel, subscribed it immediately & also shared it with my friends. Lot of thanks from newcomers like us to this field.

  • @vishnujatav6329
    @vishnujatav6329 2 роки тому

    Bhut bhut bhut mast Nitish ji. Dil hi aa gya, main bnut darta tha Gradient Descent se, ab toisme mza aane lga hai

  • @ramsagar8977
    @ramsagar8977 7 місяців тому

    never seen such a Best explanation , Wow bro . I beacme fan of your Explaination

  • @maze2552
    @maze2552 24 дні тому

    what a amazing video sir! so much love from this side

  • @minhazuddin722
    @minhazuddin722 2 роки тому

    Damn perfect as it was from every aspects.

  • @EECVZONE
    @EECVZONE 2 роки тому

    Thank you so much sir. Ap ne bht ache way se smjhya hy. Thanks

  • @MuhammadAfzal-xl7wd
    @MuhammadAfzal-xl7wd 3 місяці тому

    thank u so much for this amazing information. and making it so simple to understand.

  • @mayankdubey4114
    @mayankdubey4114 2 роки тому +1

    One of your earliest subscriber and Big fan

  • @stevegabrial1106
    @stevegabrial1106 3 роки тому

    Amazing way to explain G D , I'm also afraid by Graphical neural network, and I Knew u clear all concepts . Thx for this video.

  • @descendantsoftheheroes_660
    @descendantsoftheheroes_660 11 місяців тому

    analytics vidhya k blog aur aapke video ..bomb h sir ..thanks a lot sir

  • @bhupendersharma0428
    @bhupendersharma0428 Рік тому

    Sir Brillient i have watched this video twice this the brillenit explanation i have share this video in my data science community hats off to sir

  • @VIJAYVIJAY-mj9jy
    @VIJAYVIJAY-mj9jy 2 роки тому +1

    You are awesome Sir.
    Your describing style is unique and easy to understand.
    Thankyou Sir for this !00 days ML playlist,
    thankyou from deep of my heart.
    I am enjoying a lot to learning ML.