Sam Levey
Sam Levey
  • 4
  • 41 157
The Matrix Transpose: Visual Intuition
Let's look at what the transpose of a matrix means intuitively. We'll understand how the transpose of a matrix is needed for trying to find pairs of vectors that have the same dot product before and after some linear transformation. We'll also use the Singular Value Decomposition to get a better geometric intuition for how these transformations appear geometrically. #linearalgebra #transpose #svd #SoMEpi
Correction: Around 13:20, when I say that Sigma-transpose = Sigma, this is only true if A (and therefore Sigma) are square matrices.
Prerequisites: you should already understand how matrices are linear transformations, matrix inverses and the identity matrix, and vector dot products. Knowing about the Singular Value Decomposition would help too, but isn't strictly required.
Some good background videos are the Essence of Linear Algebra series by 3Blue1Brown, especially chapters 3 and 9: ua-cam.com/play/PLZHQObOWTQDPD3MizzM2xVFitgF8hE_ab.html
Chapters:
0:00 Introduction
0:48 Prerequisites
1:19 How to Take the Transpose
1:50 Properties of the Transpose
3:56 Motivating Question
4:56 Linear Transformations Do Not Necessarily Preserve the Dot Product
6:21 Linear Transformations and Dot Products, Visually
7:04 How Can We Preserve the Dot Product?
8:30 Preserved Dot Products, Visually
9:41 Orthogonal Matrices
11:10 Singular Value Decomposition Introduction
12:39 Using the SVD on the Inverse-Transpose
15:28 Additional Examples with the SVD
16:31 What if A is not invertible?
18:25 Main Equation
19:13 Visualization Revisited
19:43 Transpose vs. Inverse
20:38 SVD of the Inverse and Transpose
21:39 SVD of Each Matrix, Visualized
23:34 Symmetric Matrices
24:30 Summary
Useful links for learning more:
en.wikipedia.org/wiki/Transpose
ua-cam.com/video/g4ecBFmvAYU/v-deo.htmlsi=j9HjN8ZvJH3Hola2
ua-cam.com/video/uGuZ-2jAigs/v-deo.html
ua-cam.com/video/QpNogWizbpw/v-deo.html
ua-cam.com/video/YCs_1qYxs2Q/v-deo.html
ua-cam.com/video/92SYFdjYsfQ/v-deo.html
ua-cam.com/play/PLWhu9osGd2dB9uMG5gKBARmk73oHUUQZS.html
ua-cam.com/video/Oshh9F-Rc3c/v-deo.html
ua-cam.com/video/NpsfSR1Ymdo/v-deo.html
ua-cam.com/video/0fbeZr8aGfk/v-deo.html
ua-cam.com/video/aG5tFA8GJ78/v-deo.htmlsi=UHx4LoCz_7IRmk8B
Music by Karl Casey @ White Bat Audio: karlcasey.bandcamp.com/
Made with Manim: www.manim.community/. The source code can be found at github.com/slevey087/transpose-video
Tips are appreciated! Tip me at: ko-fi.com/slevey
Переглядів: 36 304

Відео

Mixing "Gay or European" - Legally Blonde the Musical
Переглядів 208Рік тому
Mixing line-by-line audio for Legally Blonde the Musical, at the Starlight Theatre in Kansas City on 7/13/23. In line-by-line mixing, the goal is to have the minimum number of microphones on at any given time, often just the microphone on the person who's currently speaking. The faders in the center of the console are assigned to various performers (and snapshots change which people are on whic...
Modeling Monopoly Money - 2nd International MMT Conference
Переглядів 4703 роки тому
Briefly explaining the monopoly money (or "dual-price") model as found here: www.levyinstitute.org/pubs/wp_992.pdf). These models demonstrate two key MMT concepts: the state as the source of the price level and unemployment. The first part of the paper/presentation asks what would happen to the private price level if the state held hard to the prices it pays when it spends. The result: the priv...

КОМЕНТАРІ

  • @free_thinker4958
    @free_thinker4958 9 днів тому

    That's a masterpiece man ❤❤

  • @robertlbray
    @robertlbray 10 днів тому

    Very nice.

  • @idobenamram3743
    @idobenamram3743 18 днів тому

    this is really well done

  • @RaviKumar-do1ng
    @RaviKumar-do1ng 29 днів тому

    Please add xyz axes to understand how you are rotating the graph

  • @nb664rbk
    @nb664rbk Місяць тому

    I tried two years ago, but there was only a video ranting about dual spaces and covectors, and even with some basic theory I couldn't follow it because it was too messy. THIS. IS. GOLD. I loved it! Maybe just turn the music down a notch for the next time, but other than that I love it!!!!!

  • @manfredbogner9799
    @manfredbogner9799 Місяць тому

    Very good

  • @moacirfonseca6625
    @moacirfonseca6625 Місяць тому

    Keep the good work up! Amazing video! Thanks for sharing! My only suggestion would be lowering just a tiny bit the music in the background. The rest is amazing!

  • @TheFailedPhysicist
    @TheFailedPhysicist Місяць тому

    Beautiful!!!

  • @kinpan
    @kinpan Місяць тому

    Thankyou for making this great masterpiece! Absolutely mind blowing to see how delightful linear algebra is :D

  • @TheIllerX
    @TheIllerX 2 місяці тому

    This is a really clear and good explanation. The introduction of the transpose in basic courses is deceptively easy. Even a child could understand the definition of switching rows and columns. This hides the fact that the transpose is actually one of the deepest matrix operations, mathematically, you encounter in the first courses. You just don't typically realize it.

  • @AnilKumarnn
    @AnilKumarnn 2 місяці тому

    You made that transpose video for fun ? Legendary.

  • @AnilKumarnn
    @AnilKumarnn 2 місяці тому

    I am going to watch this again ❤

  • @techtana9268
    @techtana9268 2 місяці тому

    Is there a real-life situation when we want to find the M transformation that preserve the dot product? ... Super neat exploration and I'm trying to understand better. Thank you!

  • @martipardo.404
    @martipardo.404 2 місяці тому

    Simply amazing, it is by far the best video I've found about this topic.

  • @enchantularity
    @enchantularity 2 місяці тому

    The easiest looking matrix operation has the most difficult geometric intuition. A very good explanation indeed! Thank you

  • @hoaithanhnguyen7178
    @hoaithanhnguyen7178 2 місяці тому

    from my heart , i would like to say thank you , with high appreciate for all of your videos, i believe your video are helping alot of student are struggling with LA.😊😊😊

  • @frogstud
    @frogstud 2 місяці тому

    5:02 vTw is a 1 by 1 matrix and the dot product is a number so these don't seem to be the same thing

    • @nbooth
      @nbooth Місяць тому

      A 1×1 matrix is considered the same is its single element.

  • @layinglion
    @layinglion 2 місяці тому

    This is the most underrated video ever! It should have the same amount of views as 3Blue1Brown has

  • @itskarim7256
    @itskarim7256 2 місяці тому

    Truly a superb explanation!!

  • @tox1678
    @tox1678 2 місяці тому

    Wow, finally someone that explained it well! magnificant!

  • @cristianjetomo5884
    @cristianjetomo5884 2 місяці тому

    This is amazing! When you discussed how the dot product of x and v retains by applying different (but almost similar) matrix transformations in 15:11, a nice way to look at it also is through the formula of the dot product (x*v) = ||x|| ||v|| cos\theta. Since x and v are essentially applied with the same orthogonal matrices from the decomposition, theta will be unchanged. But scaling x using Sigma and scaling v using the Sigma inverse will tell that ||x|| is scaled "up" as much as ||v|| is scaled "down" and so the dot product is retained. regardless, great visual intuition! I'm loving the current YT community that teaches mathematics.

  • @evrimkeskin
    @evrimkeskin 2 місяці тому

    Perfect explanition doesn't exsi...

  • @colamity_5000
    @colamity_5000 2 місяці тому

    I wish you had shown what A transpose does to the output of A. I get that it isn't clean, but its also what we came here for.

  • @ClearerThanMud
    @ClearerThanMud 2 місяці тому

    Awesome -- thanks! Do you share your Manim (presumably) code on Github for other presenters to learn from?

  • @Bulbasauros
    @Bulbasauros 2 місяці тому

    +1 sub

  • @felix_alvarez
    @felix_alvarez 2 місяці тому

    didn't quite get it, i'll be referring back to this video a bunch of times in the future throughout my engineering degree. I don't even have to know this yet, but I find it extremely helpful to understand concepts instead of just memorizing the exercises that one must solve in order to pass the test. Thank you for putting this knowledge online <3

  • @AndrewNgo-x6x
    @AndrewNgo-x6x 3 місяці тому

    Thank you so much for this!

  • @tsunningwah3471
    @tsunningwah3471 3 місяці тому

    鼠疫

  • @tsunningwah3471
    @tsunningwah3471 3 місяці тому

    累人

  • @Robbie-nl4lb
    @Robbie-nl4lb 3 місяці тому

    So if I understand correctly, is a transpose sort of like an "inversion" for the reflection of Ax over the line y=x, which brings you back to x?

  • @sergiomensitieri
    @sergiomensitieri 3 місяці тому

    Man you f****ing Rock!!! 😮 the best video on the subject! And i have watched many…. Top notch explanation and video

  • @rodolfoassereto7626
    @rodolfoassereto7626 3 місяці тому

    11:48 Thank you.

  • @kasramoumeni6835
    @kasramoumeni6835 3 місяці тому

    Great explanation!

  • @prituladima
    @prituladima 3 місяці тому

    I came here from MIT ocw and this video is too good!!! Thank you.

  • @absenty7846
    @absenty7846 3 місяці тому

    Thank you.

  • @asfasdfsd8476
    @asfasdfsd8476 3 місяці тому

    Dunno what your occupation is but you clearly have an educator/ideas sharing talent.

    • @samlevey3263
      @samlevey3263 3 місяці тому

      Thank you! I am indeed an educator :)

  • @asfasdfsd8476
    @asfasdfsd8476 3 місяці тому

    Bro casually explained SVD in 20 seconds better than most can do while covering a different topic.

  • @bobsmithy3103
    @bobsmithy3103 4 місяці тому

    was doing some graphics programming and this clears things up. thank you!

  • @inverse_of_zero
    @inverse_of_zero 4 місяці тому

    hi there, fellow math educator :) this is my first time watching your channel. great visuals and explanations! my only criticism is that the music was a bit loud and distracting. at the very least i'd say reduce the music volume (or do away with it), and if you keep music, i'd choose music with much lower tempo. the choice for this video felt a bit too 'fast' personally. but otherwise, great content! i'm looking forward to future videos. best of luck :)

  • @ThuocGiamDau
    @ThuocGiamDau 4 місяці тому

    This video is so beautiful !

  • @roeetoledano6242
    @roeetoledano6242 4 місяці тому

    Such an amazing video. I'm shocked that you only have 924 subscribers. You explained this so well, and so elegantly, it really is truly amazing. Linear algebra is so beautiful. Thank you.

  • @SINxGREED
    @SINxGREED 4 місяці тому

    Thanks man i discovered retrosynthwave!! Have an icecream from my side!

  • @veraphine
    @veraphine 4 місяці тому

    Excellent exposition!!!

  • @SchienexKun
    @SchienexKun 4 місяці тому

    Can yu explain what is cofactor geometrically?..❤

  • @SchienexKun
    @SchienexKun 4 місяці тому

    Bro you're 2nd 3B1B! Keep going✨🔥

  • @mtirado
    @mtirado 4 місяці тому

    This was very well done!

  • @brandonklein1
    @brandonklein1 5 місяців тому

    As a graduate student in physics, this was very helpful in grounding the definition of unitary transformations, thanks so much and beautiful video!

    • @cristianjetomo5884
      @cristianjetomo5884 2 місяці тому

      I'd like to see what the visual intuition would be on unitary transformations as orthogonal matrices can be generalized to the complex numbers through unitary matrices.

  • @berkanc_1436
    @berkanc_1436 5 місяців тому

    underrated af

  • @00000ghcbs
    @00000ghcbs 5 місяців тому

    I remember asking my linear algebra teacher this exact thing and he just looked at me weird and said, "you just change rows and column". I stopped asking him stuff after that.

    • @roeetoledano2147
      @roeetoledano2147 4 місяці тому

      same with my professor. I'm so glad I came across this and 3b1b videos, they make me realize just how beautiful all of this is

  • @gowthamjothiramalingam6911
    @gowthamjothiramalingam6911 5 місяців тому

    You are going to blow up in millions very quickly...mark my words!! Commenting here to get atleast thousands of likes from million views😉😁