Complete Statistical Theory of Learning (Vladimir Vapnik) | MIT Deep Learning Series

Поділитися
Вставка
  • Опубліковано 19 жов 2024

КОМЕНТАРІ • 61

  • @lexfridman
    @lexfridman  4 роки тому +66

    I really enjoyed this talk by Vladimir. Here's the outline:
    0:00 - Introduction
    0:46 - Overview: Complete Statistical Theory of Learning
    3:47 - Part 1: VC Theory of Generalization
    11:04 - Part 2: Target Functional for Minimization
    27:13 - Part 3: Selection of Admissible Set of Functions
    37:26 - Part 4: Complete Solution in Reproducing Kernel Hilbert Space (RKHS)
    53:16 - Part 5: LUSI Approach in Neural Networks
    59:28 - Part 6: Examples of Predicates
    1:10:39 - Conclusion
    1:16:10 - Q&A: Overfitting
    1:17:18 - Q&A: Language

  • @ephi124
    @ephi124 4 роки тому +27

    My master's thesis was forecasting using SVM. That was the first time I fell in love with machine learning and even Math. Thank you Vladimir for living.

  • @rodolfo_bandeira
    @rodolfo_bandeira 2 роки тому +6

    I'm studying SVM in my MCS program. I was so surprised to find this video with Dr. Vapnik. We live in such blessed times to have easy access to this level of high-quality content.
    Thank you!

  • @rezab314
    @rezab314 3 роки тому +3

    @Lex Fridman 1.5 years ago I listened to your first podcast with prof vapnik and was blown away. Great man, great story. I love it. Funny is that while pursuing the topic of machine learning and deep learning myself at the moment I hit the subject of learning curves, cross-validation and other methods to learn more efficient and remembered the podcast in which he mentioned his Complete Statistical Theory and as a former math major I appreciate his approach so much. Thx for this opportunity

  • @alchemication
    @alchemication 4 роки тому +37

    Huge respect for the gentleman (he is a legend for us, AI-Masters students in Ireland;) Thank you for uploading to UA-cam.

  • @SuperReminou
    @SuperReminou 4 роки тому +11

    I feel privileged to have the opportunity to watch this video. Thank you very much @Lex Fridman

  • @Anza_34832
    @Anza_34832 3 роки тому +2

    His concept of predicates is intriguing: Everything can be deconstructed to see what it is consisting of - the basic building blocks. With that, what is left to do is only one more step: analyzing the structure.
    Excellent concept!

  • @davidbellamy1388
    @davidbellamy1388 4 роки тому +5

    Lex, we are so grateful for the amazing lectures and conversations you provide to the Internet all assembled in one place, thank you!

  • @TheAIEpiphany
    @TheAIEpiphany 4 роки тому +5

    I think this lecture broke my mind. Legend!

  • @butterkaffee910
    @butterkaffee910 4 роки тому +16

    This envokes great memories to my university days! Working in applied ml is seldom as elegant as vc theory lol

  • @DiegoAToala
    @DiegoAToala 3 роки тому +1

    Thank you very much for this video. Watching a lecture from this gentleman is such an honor.

  • @prattzencodes7221
    @prattzencodes7221 4 роки тому +3

    It's an honor to see one of the living legends of Theoretical Machine Learning / and the father Statistical Learning Theory in flesh!

  • @StratosFair
    @StratosFair 3 роки тому +6

    Wow, being taught by the man himself, what an honor

  • @evankim4096
    @evankim4096 4 роки тому +2

    Amazing talk and amazing contributions to the field of statistical learning theory. This is definitely a piece of the puzzle that I feel like is very under represented today.

  • @kparag01
    @kparag01 4 роки тому +16

    Legend in statistical learning ❤️

  • @oudarjyasensarma4199
    @oudarjyasensarma4199 4 роки тому +4

    Thanks a lot!!! Very Informative!!!! And thanks for making all of this happen!!!!

  • @alexanderkonstantinidis7716
    @alexanderkonstantinidis7716 4 роки тому +2

    Thank you for offering us this possibility.

  • @oudarjyasensarma4199
    @oudarjyasensarma4199 4 роки тому +4

    HI Lex :) , Can you do a series/playlist on NLP research and where NLP is going after 2020 and its future? That'd be really helpful!!!!

  • @harryh2185
    @harryh2185 4 роки тому +58

    Funnily, UA-cam detects the language of the Video as Russian for subtitles

    • @lexfridman
      @lexfridman  4 роки тому +82

      Thanks for noticing that. I just paid for English captions to be created. It should be done in 30-40 hours. I'll update the video then. *Update:* The completed English captions are now added to the video.

    • @triangleenjoyer
      @triangleenjoyer 4 роки тому +2

      @@lexfridman Thank you!

    • @hunnyflash
      @hunnyflash 4 роки тому +14

      This video will be extremely difficult for someone without prior math knowledge to caption. God bless whoever is able to finish it.

    • @igorg4129
      @igorg4129 4 роки тому +1

      That's cause youtube probably doesn't use Vapnik's algorythms :)
      BTW I'm native Russian speaker, and for me his English is much clearer than US or British one :)

    • @NicholasKujawa
      @NicholasKujawa 4 роки тому

      @@thewiseturtle you can support him in other ways. It is likely easier for Lex to manage this in a transactional way as opposed to managing all the drama that goes with community involvement. And even though he is paying for a service, he is likely supporting an individual's small business, which is a wonderful way to share wealth with hard workers.

  • @Snipester230
    @Snipester230 4 роки тому +6

    He is a hero 😊

  • @l.3890
    @l.3890 3 роки тому +1

    I love you Vapnik!

  • @madtrade
    @madtrade 4 роки тому +2

    i use his invention every single day !

  • @nikre
    @nikre 4 роки тому +1

    so clear explanations. thanks.

  • @priapushk996
    @priapushk996 2 роки тому

    0:04 "co-inventor of supported vector machines". Lex invented the unsupported ones.

  • @mlliarm
    @mlliarm 3 роки тому +1

    What a legend !!!

  • @thefarmlab5441
    @thefarmlab5441 4 роки тому +4

    How does RBMK reactor....

  • @KatherineVVE
    @KatherineVVE Рік тому

    Спасибо большое за семинар и лекцию

    • @fedorzavs2351
      @fedorzavs2351 Рік тому

      Катерина, у вас интересные плей листы,у меня схожие интересы и я тоже люблю смотреть лекции которые вы считаете интересными.Давайте дружить?)

  • @nikhilpandey2364
    @nikhilpandey2364 4 роки тому +1

    Arriving here from the podcast, must say that horizontal expansion will give us the models that we need and yes, even after than it would be an imitation. Intelligence seems to be far from our reach as of now.

  • @anas.2k866
    @anas.2k866 Рік тому

    Thanks, I dot understand what are predicates formaly and when we use them

  • @maxsofronov
    @maxsofronov 4 роки тому +8

    great talk but for you guys out there let's hope it gets released in English

  • @rickharold7884
    @rickharold7884 4 роки тому +1

    Thx

  • @visavou
    @visavou 4 роки тому +7

    2 views and 6 upvotes! that is what i am talking about!

    • @pkr619
      @pkr619 4 роки тому +2

      youtube does not update "view" in real-time, and it's updated later than "upvotes". I guess.

  • @736939
    @736939 2 роки тому

    OK, and now, how to program it in Python?

  • @ankanmazumdar5000
    @ankanmazumdar5000 2 роки тому

    priveleged to see him, legendary persons are messengers of god

  • @madhurgarg4114
    @madhurgarg4114 2 роки тому

    can anyone tell the prerequisite maths for this book ?

  • @jamesli6168
    @jamesli6168 2 роки тому

    Great opening joke!😆

  • @chikorita5919
    @chikorita5919 4 роки тому +2

    Marvin Minsky says statistical learning won't work to build AGI.

    • @tobiasschafer9095
      @tobiasschafer9095 4 роки тому

      ...but it still can be a building block in a society-of-mind system.

  • @ynwicks7142
    @ynwicks7142 4 роки тому +1

    I thought it was just me but apparently his accent might be just a little bit hard to understand.

    • @dadpettit6663
      @dadpettit6663 4 роки тому

      all part of the university experience lol

  •  4 роки тому +7

    OMG is Vladimir Vapnik our Valentine!?

  • @inderjeet8659
    @inderjeet8659 3 роки тому +1

    rip i have no idea what's going on

  • @Toefuy
    @Toefuy 4 роки тому +1

    I think I would like to speak of AI. I m a sim ple man tho is there real ly such a thing... I think not.... so AM I !

  • @sifiso5055
    @sifiso5055 4 роки тому +6

    First🙌🙌🙀😃😃😃😃

  • @ichkaodko7020
    @ichkaodko7020 4 роки тому +5

    real soviet man, not your regular russkii :-P

  • @nikolaos9175
    @nikolaos9175 4 роки тому +8

    Can't understand a fooking thing he says.

  • @ra5332
    @ra5332 4 роки тому +1

    anyone else didn't understand it at all?

  • @z-America
    @z-America 4 роки тому +2

    Heavy russian accent is hard to tolerate, while the math is pretty basic

  • @burkebaby
    @burkebaby Рік тому +1

    My master's thesis was forecasting using SVM. That was the first time I fell in love with machine learning and even Math. Thank you Vladimir for living.