Animated guide to Linear Regression

Поділитися
Вставка
  • Опубліковано 17 жов 2024
  • 🐶 Snyk is free forever. Sign up with my link snyk.co/pwnfun...
    ⭐ GitHub: github.com/Pwn...
    🐤 X: / pwnfunction
    🧰 Tools used are: tools.pwnfunct...
    🎵 Track: STRLGHT - Destination

КОМЕНТАРІ • 81

  • @Nulledx
    @Nulledx 7 місяців тому +4

    Dude, I can't stress enough how amazing I felt when I saw that you uploaded a video, it's been a while, hope you are doing great!

  • @mrnobody1286
    @mrnobody1286 8 місяців тому +73

    still breathing … good

  • @hellfishii
    @hellfishii 8 місяців тому +17

    This is the canonical problem of least squares in optimization theory, some lineal algebra can help us skip the iteration problems and find the best vector space of 1 or n dimension that fits the r^n -> 1 problem to optimize. Great video btw.

  • @arghosaha6994
    @arghosaha6994 8 місяців тому +9

    You are alive .
    Was waiting for you.....
    Welcome back😊

  • @fugoogle_was_already_taken
    @fugoogle_was_already_taken 8 місяців тому +9

    Linear regression is usually done with help of linear algebra methods for matrix factorizations, by methods of least squares. Gradient descent is usually used when no noniterative methods can be used -> like fitting ML models

  • @PwnFunction
    @PwnFunction  8 місяців тому +56

    how is the new outro?

    • @coder_rc
      @coder_rc 8 місяців тому +7

      Loving it, fantastic job

    • @Aditya_khedekar
      @Aditya_khedekar 8 місяців тому +1

      the intro is soo good!! dont change

    • @Aditya_khedekar
      @Aditya_khedekar 8 місяців тому

      and also thats not simple maths cz i don't remember anything

    • @HHHjb_
      @HHHjb_ 8 місяців тому

      is that what made you take so long?
      yes its good

    • @roschabdolaziz3828
      @roschabdolaziz3828 8 місяців тому

      dude i missed your videos

  • @maurolimaok
    @maurolimaok 5 місяців тому

    Don't let the channel die.
    I'm learning to code on Odin, and bookmarked it.
    Soon I'll be able to get it.

  • @HuangTim1018
    @HuangTim1018 8 місяців тому +7

    finally the penguin is back, need more content!

  • @uClash
    @uClash Місяць тому

    Woa, watching this before 8am... this was too much thinking for me this early :) needs a warning at the beginning hah! Oh man, just brings back memories from College. My nephew texted me the other day, asking if calculus was important for programming. I think you came up with a decent example of this in use. I've never had to use calculus in over 20 years of programming, but I do think that, depending on the job, some will use it. My best advice/guidance to him was that all of the math that I took in college really helped with problem solving, and really taught me to think at a very deep level.

  • @aidenpham2405
    @aidenpham2405 8 місяців тому +2

    What a great way to start a (lunar) new year! Welcome back!

  • @dan2te2
    @dan2te2 6 місяців тому

    200k subs! Congratulations!

  • @rodneynsubuga6275
    @rodneynsubuga6275 8 місяців тому +3

    Finally the man who taught me randomness is back

  • @vinayagarwal770
    @vinayagarwal770 8 місяців тому +1

    Please make more such videos, as you said covering gradient descent.
    I really wanna watch an explanation and application of Neural networks by you. I know it might be a long video, and hard to follow through, but just, train us, like bit by bit, teach us from the ground up. Keep this up. Also, can you please provide a list of topics that should be learned, to reach the complexity of neural networks? Like a roadmap for machine learning concepts like this, that would really help out.
    Thanks.
    Love your videos❤.

  • @Ciano56
    @Ciano56 8 місяців тому +1

    Love the simple explanation and visuals to explain these problems. Really helps!

  • @Walking_W
    @Walking_W 8 місяців тому +1

    its a good day when pwn uploads

  • @The_Great_Pietro
    @The_Great_Pietro 8 місяців тому

    Heyyy! Really nice to see you back bro! 😊

  • @lacno29
    @lacno29 8 місяців тому

    Hey! Welcome back! Nice to see you again.

  • @_abdul
    @_abdul 8 місяців тому

    Welcome Back Man. Was missing you.

  • @JeersNX
    @JeersNX 8 місяців тому +1

    babe, wake up, pwnfunction posted!

  • @psibarpsi
    @psibarpsi 8 місяців тому +1

    Yo! How do you make your videos? What software do you use? Where did you learn to use it? And, how much time did it take for you to actually learn it?

  • @hiimthelegend6644
    @hiimthelegend6644 5 місяців тому

    Hello, would you like to share the name of software you're using for editing videos? They looks quite awesome!

  • @iohasib1
    @iohasib1 8 місяців тому

    This bro is the real top G. You know man..

  • @adrian_sp6def
    @adrian_sp6def 8 місяців тому +13

    14:58 indent error line 57

  • @theonlyasher
    @theonlyasher 8 місяців тому +1

    damnn a video after a year, less gooo

  • @trevorhart4120
    @trevorhart4120 8 місяців тому +1

    Welcome back! 🎉

  • @josephseed3393
    @josephseed3393 8 місяців тому +2

    THE GOAT IS BACKKK

  • @LetsDark
    @LetsDark 8 місяців тому +2

    The UA-cam compression hates your gradiants and your axis

  • @beastnighttv
    @beastnighttv 8 місяців тому

    feels good seeing you alive

  • @wolfrevokcats7890
    @wolfrevokcats7890 8 місяців тому +1

    The legend is back

  • @qexat
    @qexat 8 місяців тому

    Hi Pwn, the link (and its label) in the description are from the previous video, you forgot to change them when pasting.

  • @kevinnyawakira4600
    @kevinnyawakira4600 8 місяців тому

    Woow...i thought i was dreaming. Welcome back

  • @qoobes
    @qoobes 8 місяців тому

    Amazing content, keep it up!

  • @violinsheetmusicblog
    @violinsheetmusicblog 8 місяців тому +1

    How did you know you had to subtract the learning_rate * dedm and learning_rate * dedb when adjusting m and b? Why not add?

  • @0xExploitXpErtz
    @0xExploitXpErtz 8 місяців тому

    Nice to see you're alive...

  • @Blendernoob14
    @Blendernoob14 8 місяців тому

    The legend is back!

  • @sankalpa02
    @sankalpa02 5 місяців тому

    please make more content like this

  • @deidara_8598
    @deidara_8598 8 місяців тому

    Using machine learning for linear extrapolation is like hunting ducks with a GAU-8 gatling gun

  • @nitrogenez
    @nitrogenez 8 місяців тому

    oh, so you're alive? cool

  • @shubhxms
    @shubhxms 8 місяців тому

    cool vid! whats that code theme?

  • @x1expert1x
    @x1expert1x 8 місяців тому

    you would be a great teacher

  • @AgentM124
    @AgentM124 8 місяців тому

    Any reason for 'm' instead of 'a'.
    I know
    y = ax+b
    Variable names are arbitrary?

  • @hakimmalik6995
    @hakimmalik6995 3 місяці тому

    Bringg more videosss

  • @levoganisian5852
    @levoganisian5852 8 місяців тому

    PWN STILL ALIVE!

  • @cyndaguy
    @cyndaguy 8 місяців тому

    I know elementary school linear regression but I'm lost immediately at 6:30 with this weird python notation. We're unpacking a list, zipping it together, and then casting it to a list again?

    • @d00dEEE
      @d00dEEE 8 місяців тому +2

      Think of zip as transpose. And since zip has lazy execution (it's a generator), the outer list forces it to run and actually produce the data.

  • @xahmi
    @xahmi 8 місяців тому +1

    long time no see bruh

  • @einsjannis
    @einsjannis 8 місяців тому

    sounds like least squares but overcomplicated for the sake of buzzwords

  • @antonaparin
    @antonaparin 8 місяців тому

    What happened to the intro? I liked it soo much

  • @danielnielsen24
    @danielnielsen24 8 місяців тому

    yooo he's back

  • @scliffbartoni9771
    @scliffbartoni9771 8 місяців тому

    Omg he's back

  • @Bloubz77
    @Bloubz77 8 місяців тому +1

    at 1:15 the line should rotate around x=0

  • @motyakskellington7723
    @motyakskellington7723 8 місяців тому

    quality content

  • @ContentYTpro
    @ContentYTpro 7 місяців тому

    Show me how to make such a model for casino crash games. Based on the time of the end of the rounds and its coefficient. We will be very grateful to you.

  • @ehrenmann69
    @ehrenmann69 8 місяців тому

    he back :D

  • @Masterix.
    @Masterix. 8 місяців тому +5

    I thought you were dead

  • @MithicSpirit
    @MithicSpirit 8 місяців тому +1

    There's no way my man just did gradient descent when there's a simple closed-form formula for linear regression lmao. Fair enough if you want a simple example, but I feel like this neither shows the power of gradient descent nor an efficient way to find a line of best fit.

  • @craftminerCZ
    @craftminerCZ 8 місяців тому +1

    pro tip for a beginner content creator :) don't do gradient background, the banding over yt bitrate is horrible ^^

  • @IsarEdits
    @IsarEdits 8 місяців тому +2

    Bro forgot indent at line 56 15:01

  • @userou-ig1ze
    @userou-ig1ze 2 місяці тому

    Why no new videos?

  • @AGASTRONICS
    @AGASTRONICS 8 місяців тому

    Where have you been?

  • @javidking63
    @javidking63 8 місяців тому

    you should keep the glasses. thats much better. 3:11

  • @Stdvwr
    @Stdvwr 8 місяців тому

    A video can have no sound effects or editing at all, but as soon as money is mentioned there got to be that cha-ching sound... At this point I suspect this is a UA-cam bug.

  • @coder_rc
    @coder_rc 8 місяців тому +3

    hi pwn

  • @xfxox
    @xfxox 8 місяців тому

    "y" is almost the same as "4" in this font

  • @pu239
    @pu239 8 місяців тому

    i was waiting for a pwning video :/

  • @zer0day463
    @zer0day463 6 місяців тому

    Missing the old voice bro, 😭

  • @edems131
    @edems131 8 місяців тому

  • @maxniederman9411
    @maxniederman9411 8 місяців тому

    Oh god... please don't use gradient descent for linear regression.

  • @madhavanand756
    @madhavanand756 8 місяців тому +2

    Fantastic job, its a wonderful content the kind of depth and clarity you have about concept is commendable and you ignited the curiosity of maths.
    If possible please make a video on how you learn things ond depth and breadth. Seriously wonderful job dude.
    🫡

  • @johanngambolputty5351
    @johanngambolputty5351 8 місяців тому

    Or you can just look at the principal eigenvector of the covariance matrix ;)
    Edit: actually, its way simpler (you can just analytically solve for d/dm = 0 straight away):
    m = y' . x'/ x' . x' (dot prod)
    b = - m
    where x' = x - and is the average of the vector.