Singular Value Decomposition (SVD): Overview

Поділитися
Вставка
  • Опубліковано 19 січ 2025

КОМЕНТАРІ • 184

  • @aravindhvasu195
    @aravindhvasu195 5 років тому +65

    Oh my god, was going through the control bootcamp, hit a wall with SVD, the next day, series in SVD. Thanks a lot for these gorgeous lectures.

  • @philippbeer
    @philippbeer 4 роки тому +52

    This is a fantastic channel Dr. Brunton! I just stumbled across it searching for SVD and got hooked on the content. Your unpretentious, clear and thorough explanations are a delight. They way you've set up the board and screen projection is fantastic. I'm really impressed with this and want to say thank you to you and the team that made this production possible.

  • @Tggfredcsawsdfgbhhhhu
    @Tggfredcsawsdfgbhhhhu 4 роки тому +299

    "I'm gonna walk you through..."
    Dude has no legs and is still gonna walk. #Inspirational

    • @vaibhavsharma1634
      @vaibhavsharma1634 4 роки тому +5

      how do I like this twice

    • @sydlogan9300
      @sydlogan9300 4 роки тому +10

      He also seems to be able to apply a mirroring transformation allowing him to write backwards.

    • @ayoubsbai6339
      @ayoubsbai6339 3 роки тому

      I can't unsee that now lmao

    • @wzyjoseph7317
      @wzyjoseph7317 3 роки тому +1

      and write words in mirrow form omg

    • @glq-xz9de
      @glq-xz9de 4 місяці тому +1

      hahahaha!!! LMAO!

  • @itsgoubie
    @itsgoubie 4 роки тому +28

    It's really interesting to see how left-handedess works when mirrored. Quite an effect on the brain!

    • @danluba
      @danluba 4 роки тому +4

      Dude, I've been trying to figure out whether he's writing everything backwards, which side his parting is on, whether he's left-handed or right-handed, married or not...
      Do you understand what magic is this?!

    • @danluba
      @danluba 4 роки тому +1

      Haha... no worries - I've figured it out!

    • @aishaaijazahmad6184
      @aishaaijazahmad6184 3 роки тому

      @dan do tell because I have no idea how this video was made

    • @beastmode1647
      @beastmode1647 3 роки тому +8

      @@aishaaijazahmad6184 he writes normally on a piece of glass between him and the camera. Then, in editing, he mirrors the video
      It looks like he’s writing backwards with his right hand. In reality, he’s writing normally with his left hand

    • @evain4760
      @evain4760 2 роки тому

      @@beastmode1647 😂I was wondering how too ! Thank u

  • @pranavthiriveedhi8127
    @pranavthiriveedhi8127 4 роки тому +6

    hey, steve! just wanted to say that I am doing data science in college right now and it is really hard to learn when you don't understand why you are doing something but you make it really easy to understand why we do a certain thing and how it actually connects to data science. so thank you sm!

    • @PunmasterSTP
      @PunmasterSTP 2 роки тому

      Hey I just came across your comment and was curious. How have your studies in data science been going?

  • @jessysaintauret3615
    @jessysaintauret3615 5 років тому +26

    Wow ! Wasn’t expecting a new video, especially on that topic though !
    Great to see you back on lecturing! The new video aspect looks great with the black background.
    Thank you !

  • @ryanjones1704
    @ryanjones1704 4 роки тому +15

    Truly a remarkable series of lectures. Infinitely appreciative.

  • @Cidou_h
    @Cidou_h Рік тому

    Discovering this channel is one of the best things that happened to me. Thank you isn't enough to say how I feel. wow

  • @willw4096
    @willw4096 Рік тому +1

    Great video! My notes: 2:32 3:15 3:26 used to solve non-square that are non-invertible
    3:38 3:52 3:58 4:40 4:52 5:07 5:26

  • @Mechomittencaterpillar
    @Mechomittencaterpillar 11 місяців тому +1

    Machine Learning for Manufacturing Automation is a brand new course being offered at Missouri University of Science and Technology, and I am in the second class ever to go through it. Thanks for your videos, they’re very helpful to establish intuition!!

  • @Veptis
    @Veptis 3 роки тому +6

    Watched a lecture on SVD as part of a vector semantics course. Will watch the 2nd part and exercise tomorrow, but I added a few of your videos to my watch later and will watch them over night. Your rather visual explanations always help me to understand the concepts and see their use.

  • @manishamin7142
    @manishamin7142 3 роки тому +58

    is he filming through a mirror or writing backwards? or mirroring the video before posting? what is going on here, how is he writing backwards!?!

    • @charlieolivergomez2376
      @charlieolivergomez2376 3 роки тому +2

      it's called a lightboard, just google it

    • @fixed-point
      @fixed-point 3 роки тому +1

      "just google it". I guess some people can't help but be assholes

    • @charlieolivergomez2376
      @charlieolivergomez2376 3 роки тому +1

      @@fixed-point did i hurt your feelings little man? I think you need to grow up. I don't know much except that it is called a lightboard and google definitely knows more than me. It is an admission that I'm not an expert. Who's the asshole, asshole

    • @fixed-point
      @fixed-point 3 роки тому +10

      @@charlieolivergomez2376 looks like I hurt your feelings. I'm sorry 😢

    • @charlieolivergomez2376
      @charlieolivergomez2376 3 роки тому +2

      @@fixed-point No offense taken brother. It was my fault in the first place for not being clear

  • @markreichelt9281
    @markreichelt9281 9 місяців тому +1

    These videos are priceless. Thank you for such a clear exposition of an important topic.

  • @MsAlarman
    @MsAlarman 3 роки тому +1

    Really amazing how you introduce us to “mysterious” ways of manipulating our interests in such a crystal clear way!

  • @Qornv
    @Qornv 4 роки тому +2

    I love finding wonderful teachers unexpectedly

  • @EranM
    @EranM Годину тому

    does anyone appreciate how this guy writing everything in REVERSE so we can see it normally?

  • @nishantaswani8976
    @nishantaswani8976 4 роки тому +6

    Thank you so much for the effort you put in to help others. So grateful for the quality content. I'm very privileged to have access to this quality of teaching!

  • @andrewchen2349
    @andrewchen2349 5 років тому +6

    Thank you, Dr. Brunton! Really hope you can upload more videos!

  • @hdadeathly
    @hdadeathly 5 років тому +8

    Awesome videos - thanks so much for the easy-to-understand explanations. I just ordered the book and this greatly helps supplement!

  • @vermashwetank
    @vermashwetank 4 роки тому +3

    I am learning this because I saw this being used in Battery modelling for electric vehicles. I don't understand how it is used (which is why I am here) but you can add that to number of applications of SVD

  • @adricat59
    @adricat59 5 років тому +1

    Thank you! It is nice to have you back 😉

  • @yaoliu7034
    @yaoliu7034 5 років тому +10

    Excellent! Can you add numbers (in the series) so we know what order to watch them? Thanks

    • @Eigensteve
      @Eigensteve  4 роки тому +9

      I have put everything into playlists, so that should help with the ordering.

  • @aymenoulmi7672
    @aymenoulmi7672 3 місяці тому

    data driven generalization of the fourier transform OMG!!!
    this is why i love MATH

  • @VedJoshi..
    @VedJoshi.. 2 роки тому

    never realized that Prof Kutz was your colleague. he really is a legend.

  • @jyoti_4568
    @jyoti_4568 3 роки тому +2

    This series helped me immensely. Thanks a lot!

  • @wym247
    @wym247 Рік тому

    A big thanks to you Dr. Brunton !

  • @Mustafa51993
    @Mustafa51993 5 років тому +1

    Wow soo good to have you back 😃....Thank you

  • @YYchen713
    @YYchen713 3 роки тому

    Awesome lecture!!! Writing in mirror style and still be able to have great flow of thought, woow

  • @37047403
    @37047403 5 років тому +1

    Thank you! I was just studying Word2Vec and GloVe algorithms and really needed this kind of content!

  • @hecanyon2161
    @hecanyon2161 2 роки тому +1

    Super curious about how he writes in that direction with out hand writing flipped.😲

  • @GreenBean0222
    @GreenBean0222 10 місяців тому

    Thank you so much for this video series. It helped me a lot!

  • @malihareza4754
    @malihareza4754 4 роки тому

    Very very excited for the series. Thank you

  • @loden5677
    @loden5677 Рік тому

    Thanks so much for this series, I’m so excited to watch it! Just wondering if there are videos for all chapters of the book or only a select few?

  • @tanyapatel4130
    @tanyapatel4130 2 роки тому

    i really like the video presentation and clarity of topics, stayed and subscribed.

  • @PunmasterSTP
    @PunmasterSTP 2 роки тому

    SVD overview? More like "Super great information that everyone should view!" 👍

  • @charliehou9553
    @charliehou9553 3 роки тому +2

    Best lectures of SVD! BTW, Dr.Brunton looks like Filthy Frank (but more handsome than Papa Franku)

  • @ScottSummerill
    @ScottSummerill 4 роки тому +3

    Is there an order to all these videos? Difficult to discern. Except for the ones that begin, “Welcome back ...”.

    • @Eigensteve
      @Eigensteve  4 роки тому +2

      Here is the playlist: ua-cam.com/video/gXbThCXjZFM/v-deo.html

  • @sapertuz
    @sapertuz 4 роки тому +3

    Hey Steve. Silly question... Did you learn to write backward so you can do these videos or how do you achieve this? 😅

    • @and_jannis
      @and_jannis 4 роки тому

      mirror the video ;)

    • @musaerdemsevim
      @musaerdemsevim 4 роки тому

      @@and_jannis no it is not. He is actually writing from his right to left as backwards

    • @TEOGUN
      @TEOGUN 3 роки тому

      ua-cam.com/video/wCOuu0-o5YI/v-deo.html HE is probably shooting through a mirror

  • @prabalghosh2954
    @prabalghosh2954 3 роки тому

    Very, very nice explanation and presentation. Thank you!

  • @ehabnasr6925
    @ehabnasr6925 Рік тому

    Thank you so much for these videos I'm persuing the playlist and I really love it!

  • @hubstrangers3450
    @hubstrangers3450 5 років тому +2

    Hope the series could link to the colab, thanks for the content.

  • @akanhakan
    @akanhakan 4 роки тому

    Great lectures. I have ordered your book.

  • @sanjoybhattacharjee8261
    @sanjoybhattacharjee8261 3 роки тому +1

    I would have changed the series name, as you have said @ 5:33, to "Linear Algebra to make Money" :-). Thank you Professor for sharing the series of lectures - very thorough and extremely helpful.

  • @garrettdyess1110
    @garrettdyess1110 2 роки тому

    Which classes would be prerequisites for this content if it were to be presented in a class at a University?

  • @shubhamkumarsaurav5212
    @shubhamkumarsaurav5212 4 роки тому +1

    You like like "Harrison wells" character in the flash season 1. He was a great scientist and teacher in Reel life , You are same in real life.
    Very nice Videos, Thank you

  • @Mario112352
    @Mario112352 3 роки тому

    Can not access some of the function since they are in the Statistical Toolbox.

  • @shailshah5803
    @shailshah5803 2 роки тому

    are you writing backwards on a glass board or is this some kind of editing magic ... this keeps me up at night

  • @vlogs627
    @vlogs627 Рік тому

    Just surprised at the production logic behind the video. Had to think for solid 5 min to figure out how it was recorded and edited for us to be able to read those words.
    I got inner peace after figuring that out.

  •  5 років тому +28

    I always wondered how these videos are recorded. Is there a glass between you and the camera? Great content anyways!

    • @Sonnentau1
      @Sonnentau1 5 років тому +28

      Blind guess: Its glass and than they flip the video horizontally... Or Mr Brunton is not only a genius but is also able to write mirror font.
      I finde both equally likely

    • @jobleser
      @jobleser 4 роки тому +10

      @@Sonnentau1 Dr Brunton seems to be actually left-handed as per other videos; so the glass/flip-video hypothesis/trick seems likely. Neat.

    • @radarmaker1
      @radarmaker1 4 роки тому +2

      Wedding band on the "right" hand, so think he's left-handed and image flipped :)

    • @hariprasadhparthasarathy6360
      @hariprasadhparthasarathy6360 4 роки тому +8

      I have asked Prof brunton in another video about the exact same thing and he replied with 'years of practice' :)

    • @dylangomes3853
      @dylangomes3853 4 роки тому +2

      If there is glass, the writing is still backwards relative to the writer. I don't see how it matters if you flip it.

  • @ehabnasr6925
    @ehabnasr6925 Рік тому

    Where can I find -in the playlist- the "tailored" data-driven transforms part?

  • @justinli19901027
    @justinli19901027 4 роки тому +1

    love it, what a series, thank

  • @wentaowu3070
    @wentaowu3070 Рік тому

    I have to say: not only the lectures are really handsome, the man himself is also really handsome. hahaha. What a great educator!

  • @timanb2491
    @timanb2491 3 роки тому

    Hi, Steve! Nice lecture. Is there a exercise for this topic?

  • @woowooNeedsFaith
    @woowooNeedsFaith 5 років тому +1

    Why this video is available only in HD? It can be a bit problematic...

    • @mcmormus
      @mcmormus 5 років тому

      i have all the options from 144p up to 1080p...

    • @woowooNeedsFaith
      @woowooNeedsFaith 4 роки тому

      Strange. I still have only 1440p and 2160p options.

    • @Eigensteve
      @Eigensteve  4 роки тому

      Sorry about that. Newer videos will have this issue fixed.

  • @anondoggo
    @anondoggo 3 роки тому

    Concise and rich. Brilliant!

  • @blitzkringe
    @blitzkringe 3 роки тому

    I tried to get a tailored basis for my data using SVD, and it yielded the exact Fourier basis. :D

  • @trungkienngo6267
    @trungkienngo6267 2 роки тому

    The writing is trippy man. The words are not supposed to look like that if he’s facing the camera, it’s supposed to be from right to left and written backward. How does the writing looks like normal in the video? Unless the guy is writing backward

  • @EW-mb1ih
    @EW-mb1ih 3 роки тому

    What do that mean "Data-driven" generalization of FFT?

  • @kunalvshah
    @kunalvshah 3 роки тому

    Hi, is there any sequence I should follow to watch these videos ?

  • @videofountain
    @videofountain 4 роки тому

    Good Presentation. 👩🏽‍🏫. There is a book and .pdf listed above. Where can I find how correlated or not these documents are? Do these two documents work together? Does the .pdf document have an errata sheet? Thanks.

  • @aubinthomas
    @aubinthomas 4 роки тому

    I did high graduate school in engineering and I learned there how to hate mathematics. If only I had such a teacher, it would have been definitely different.

  • @AnqHuang
    @AnqHuang 4 місяці тому

    How can I make such an instructional video? This handwritten text feels like it is written upside down in the mirror.

  • @jezza10181
    @jezza10181 Рік тому

    Fantastic presentation. I only know what the SVD was, had no idea it had so many uses.

  • @flybekvc
    @flybekvc 4 роки тому +1

    Is there some video for each chapter of the book?

    • @Eigensteve
      @Eigensteve  3 роки тому

      Yes, we tried to break it down so each section has a video.

  • @ahmedgharieb5252
    @ahmedgharieb5252 Рік тому

    If I have a single time series.. Then what should i do to get eigenvalues?

  • @CSEVARUNKARTHICKP
    @CSEVARUNKARTHICKP Рік тому +2

    are you left or right handed?

  • @lacnguyen178
    @lacnguyen178 4 роки тому +1

    What application did you use to make this transparent board?

    • @Eigensteve
      @Eigensteve  3 роки тому

      We are using the lightboard

  • @jacobanderson5693
    @jacobanderson5693 5 років тому +1

    Thanks for posting these videos

  • @Tyler-pj3tg
    @Tyler-pj3tg 2 роки тому

    Amazing series!

  • @randythamrin5976
    @randythamrin5976 4 роки тому

    I've done watched the videos, till data visualization - buyer beware. Please tell me, should I watch another one playlist before watch this video? Like linear algebra or begining scientific computing? Thank you

  • @andrewalamban3632
    @andrewalamban3632 4 роки тому +3

    Thanks for the content! Also super impressive if it is the case that you're writing in reverse!

  • @naeimwtg
    @naeimwtg 4 роки тому

    Steve, thanks for sharing!
    Can you please clarify the how can combine results two or more singular value decomposition got from same object like multilayer matrix?

  • @phamhongvinh550
    @phamhongvinh550 5 років тому +2

    Thank you so much for the content.

  • @FrankGibbs-e7p
    @FrankGibbs-e7p 11 місяців тому

    What dry erase markers do you use?

  • @bediosoro7786
    @bediosoro7786 3 роки тому

    i understand clearly how to compute the SVD. but it seems like that i forgot something. if i have a matrix of nxn and i want to reduce the dimesion to rxr . how do i get the rxr matrix? if someone knows inform me i need it right away.

  • @Jean-BaptisteMalagnoux
    @Jean-BaptisteMalagnoux Рік тому

    Does someone now what marker pen this guys use ?

  • @mohamedelaminenehar333
    @mohamedelaminenehar333 3 роки тому

    Thank you ))
    Sir can you tell us the most important math lessons a student of automatic control and signals needs?
    😊😊😊😊

  • @all_bright
    @all_bright 3 роки тому

    Hi! Thank you so much for these vids. Realized yesterday that I couldn't make myself use SVD unless I understand the logic of it.
    Could someone possibly recommend the topics I should look into beforehand in order to understand it and subsequent topics? I don't have a foundation in Maths beyond High School Level.

    • @ronronn3148
      @ronronn3148 3 роки тому

      you should learn some linear algebra. you need a little calculus to do linear algebra sometimes, but it can mostly be done with integration and differentation. easy topics to look into, you're going to be using basic integration and differentiation. linear systems, manipulating them, understand matrices and how to manipulate them, how to find eigen values and eigenvectors, what eigenvalues and eigenvectors are. kinda gives you a base level for linear algebra.

    • @all_bright
      @all_bright 3 роки тому

      @@ronronn3148 Thank you so much! I think I know what all you've mentioned but I'm coming to realize that what I know generally isn't everything I'm supposed to know. I'll look up the mentioned topics in detail. :-D

    • @ronronn3148
      @ronronn3148 3 роки тому

      @@all_bright There's alot of stuff you're gonna be lost on and I think its important to write stuff down, or take mental note of what vocabulary and operations makes your mind blank. You look those words up, read about the topics, and fill in the blanks. alot of resources online.

    • @all_bright
      @all_bright 3 роки тому

      @@ronronn3148 Yes! Thank you for the suggestion. Will keep that in mind.

  • @supriyakm471
    @supriyakm471 3 роки тому

    Loved it content, presentation 💗💗💗

  • @KhanhDinh-l6k
    @KhanhDinh-l6k Місяць тому

    this is just gorgeous

  • @Falconoo7383
    @Falconoo7383 3 роки тому

    at 5:34... How we can make money from Linear Algebra?

  • @ulrikalundholm5458
    @ulrikalundholm5458 3 роки тому

    I love this, thank you!

  • @adinovitarini6173
    @adinovitarini6173 4 роки тому +1

    Hello Prof. I want to ask you something, is SVD have big impact on system identification of a dynamic system, if we combine with least square algorithm ? or it just useful enough for machine learning task ? Thanks you

  • @jacobwise7008
    @jacobwise7008 2 роки тому

    For the first 3 minutes and I was so confused and amazed by his incredible talent for mirror writing (it looked as good as my normal handwriting!) Then I realized he probably flipped the video 😅😆

  • @hoopssheaffer
    @hoopssheaffer 6 місяців тому

    How does he write backwards?

  • @hyperduality2838
    @hyperduality2838 4 роки тому

    Simple, linear = Predictable or syntropy
    The time domain is dual to the frequency domain
    Thesis (time) is dual to anti-thesis (frequency) -- the time independent Hegelian dialectic
    Predictability is dual to unpredictability, certainty is dual to uncertainty, syntropy is dual to increasing entropy, the fourth law of thermodynamics. Energy is dual to mass -- Einstein.
    Dark energy is dual to dark matter.

    • @dankons6578
      @dankons6578 4 роки тому

      what

    • @hyperduality2838
      @hyperduality2838 4 роки тому

      @@dankons6578 There is a 4th law of thermodynamics, syntropy is a dual process to that of increasing entropy.
      Teleological physics (syntropy) is dual to non-teleological physics (entropy).
      Certainty is dual to uncertainty -- the Heisenberg certainty/uncertainty principle.
      The conservation of duality is the 5th law of thermodynamics.
      Duality is energy, energy is duality.
      Potential energy is dual to kinetic energy.
      Apples fall to the ground because they are conserving duality.
      Action is dual to reaction -- Sir Isaac Newton.
      Positive charge is dual to negative charge -- electric fields.
      North poles are dual to south poles -- magnetic fields.
      Electro is dual to magnetic, electro magnetic energy (light) is dual.
      "Always two there are" -- Yoda.

    • @dankons6578
      @dankons6578 4 роки тому

      oh ok i get it now

    • @hyperduality2838
      @hyperduality2838 4 роки тому

      @@dankons6578 Gravitation is equivalent or dual to acceleration -- Einstein's happiest thought, the principle of equivalence (duality).
      There is a pattern of duality hardwired into the physics and also philosophy, mathematics, biology, control theory etc.
      This important fact is currently not appreciated by those who fund science.

  • @محدثهاحمدی-ق6ط
    @محدثهاحمدی-ق6ط 2 роки тому

    0:52 ! how it is possible? writing backward!!!

  • @nisbahmumtaz909
    @nisbahmumtaz909 2 роки тому

    Yo, how do you learn to write in reverse like that

  • @mehmetaydin3103
    @mehmetaydin3103 22 дні тому

    thanks man you are the best

  • @AvisShuff-e2v
    @AvisShuff-e2v 3 місяці тому

    Ortiz Stravenue

  • @HughOsborn-t1v
    @HughOsborn-t1v 3 місяці тому

    Anabel Orchard

  • @Dimpu82
    @Dimpu82 3 роки тому

    Great video.
    Wish my ADHD brain would stop focusing so much on the handwaving and the hows and why of the this weird otherworldly transparent glassboard/whiteboard

  • @LGURUGUBELLISAIKUMAR
    @LGURUGUBELLISAIKUMAR 3 роки тому

    nice explain how to interact with you

  • @afiqyahya3398
    @afiqyahya3398 4 роки тому

    Guess I'm late to the party. Just found out your channel. Damnnnnn

  • @mndhamod
    @mndhamod 3 роки тому

    You are left-handed. Gotcha!

  • @HowardWindsor-d6s
    @HowardWindsor-d6s 3 місяці тому

    Domingo Terrace

  • @kannakamuiedits
    @kannakamuiedits 3 роки тому +1

    Svd like when I be pulling out this Russian svd dragunov in the school

    • @WealthyInsuranceOfficial
      @WealthyInsuranceOfficial Рік тому

      D - Decomposition
      R - Rational
      A - Angle
      G - Geometry
      U - Unitary
      N - Numbers
      O - Obstacle
      V - Variation

  • @3ss3ns3
    @3ss3ns3 3 роки тому +1

    SVD is gangsta until Matrix: 1000000 x1000000 arrives!!

    • @Eigensteve
      @Eigensteve  3 роки тому +1

      Then hit it with randomized SVD!

  • @Plin34
    @Plin34 4 роки тому +1

    Thanks!

  • @alexandresibony1345
    @alexandresibony1345 3 роки тому

    The fact that you are left handed makes it even more confusing