Convolutions are not Convoluted

Поділитися
Вставка
  • Опубліковано 22 жов 2024

КОМЕНТАРІ • 113

  • @BoZhaoengineering
    @BoZhaoengineering 3 роки тому +101

    This is the most understandable convolution interpretation I have ever seen on UA-cam. Just awesome.

    • @Michallote
      @Michallote 3 роки тому +2

      I went through university and this was way more understandable than whatever we were taught

  • @ZahidulIslamBayzid
    @ZahidulIslamBayzid 15 днів тому

    I'd pay real money to watch this video. This is amazing. It's like switches clicked in my brain watching this video. Thank you so much

  • @kartikvishaldeshpande7422
    @kartikvishaldeshpande7422 5 місяців тому +5

    Many hours put into understanding this concept during my undergraduate days, watching your 10-min video now provided far better understanding. Simple and to the point explanation. Thanks, and please keep updating with intuitive teachings. Great work !!!

  • @blisslen
    @blisslen 3 роки тому +49

    Wow, one of the best explanations I've heard of one of the trickier concepts in signals classes (one that you really need to understand going deeper into DSP or anything). Hope this was submitted to 3blue1brown's contest, this is definitely a contender.

    • @sigfyg8384
      @sigfyg8384  3 роки тому +11

      It was submitted to the contest, but I already know I'm not in the top 100 lol

  • @utkarshmishra7416
    @utkarshmishra7416 2 роки тому +1

    I was surprised to see only 565 subs, keep going, with the quality, i hit sub in like 30 seconds into the video. This is a major channel with millions of subs in the making if you keep makng. Keep up the good work

  • @janismikits
    @janismikits 3 місяці тому

    This is honestly the best explanation I've found so far.... and I've been searching for a while. Amazing video, thank you so much

  • @ghassanehajji7591
    @ghassanehajji7591 3 роки тому +12

    This is an excellent video, you have a real talent for explaining the intuition behind "convoluted"" ideas. Please continue making explainers. I'll be eagerly awaiting the next installment, and hopefully you'll make a series exploring the topics you listed at the end.

    • @kaemmili4590
      @kaemmili4590 2 роки тому

      yea please , its awesome, and feels like a nice fresh breath =)
      edit : the last sound effect made me hit the bell button .

  • @biffbum8221
    @biffbum8221 9 місяців тому +1

    This is the video that lighted the bulb 💡! Much appreciated keep going ❤

  • @TheRookieNerds
    @TheRookieNerds 3 роки тому +9

    Omg you are criminally underrated

  • @chrissysevigny2462
    @chrissysevigny2462 7 місяців тому

    I watched two other videos on convolution prior to this (one of them being the fairly notorious 3Blue1Brown), and I think this helped me understand the concept of convolution the best. It just seemed like it stripped away all of the (in my opinion) more challenging vocabulary, and brought it down to layman's terms. Thanks for sharing!

  • @Bravo_L
    @Bravo_L 3 роки тому +5

    Im in signals and systems and we doin this stuff rn -.-
    This is sooooo good btw kudos!!!!!!! Ee major here

  • @h2ogun26
    @h2ogun26 Рік тому +1

    some might say it's distracting, but the selection of back ground music was aesthetic and well reconciled.

    • @exoticcoder5365
      @exoticcoder5365 Рік тому

      I love the background music as well, it helped me focus

  • @johnangelo2000
    @johnangelo2000 2 місяці тому +1

    I got the gist of it first time... Awesome explaination...

  • @danielweber4917
    @danielweber4917 2 роки тому +1

    Love the phoenix wright background music; absolutely fits the tone!

  • @tymofei8586
    @tymofei8586 3 роки тому +3

    Very good and intuitive explanation. As a mechanical engineer who pursue into mastering control theory and systems,sometimes i find its math difficult to grasp intuitively but with those cookies you made it just so easy :D thanks

  • @4733R70
    @4733R70 2 роки тому +1

    man you just proved that maths can be much much easier if explained from people with your talent!! if you like it keep going with your videos!!!

  • @skatomort
    @skatomort 2 роки тому +1

    The only thing I'm convoluted atm is the number of subscribers ...
    Well done!

  • @skivvytv6229
    @skivvytv6229 3 місяці тому

    Understanding that infinite vectors representing function values are pretty much the same thing and doing these kind of matrix-function / matrix-vector operations is so useful and helps understand many problems
    I first came across it in quantum chemistry with the bra-ket notation, same effect there, it makes everything make sense
    Good video

    • @adammontgomery7980
      @adammontgomery7980 3 місяці тому

      My mind was blown the first time I realized that a matrix could be viewed as a function. I had seen bra-ket notation and was completely lost. I can't remember where I saw a video about quantum computing that went through what they meant. I immediately thought about array indexing in programming, where the bra and ket select the row and column in a quantum state matrix.

  • @kevinmathewson4272
    @kevinmathewson4272 9 місяців тому

    For anyone confused: at 7:36, each term in the c vector is really a summation. The first term, for example, should be read as "sum, for t values 0 through 6, of the expression: d(t) x b(-t)" where the x is a multiplication symbol. The second term should be read as "sum, for t values 0 through 6, of the expression: d(t) x b(-(t - 1))." And so on.

  • @thunderstriketrading
    @thunderstriketrading Рік тому +1

    This is underrated educational content! Great video!

  • @nabeelsherazi8860
    @nabeelsherazi8860 2 роки тому

    Holy shit the moment the meaning of linear time-invariant clicked for me... instant subscribe. I don't care if you never make videos again, I have NEVER understood linearity like that.

  • @apoorvvyas52
    @apoorvvyas52 3 місяці тому

    Great explanation by bakery example.

  • @adammontgomery7980
    @adammontgomery7980 3 місяці тому

    I've always (since 3b1b's video) thought about convolution as a measure of the correlation between a data stream, and some target sequence that you're looking for. Imagine holding some shape up in your field of view and scanning around. Whenever that shape perfectly eclipses some other shape in your environment, you get a high correlation value, and low everywhere else.

  • @smolboi9659
    @smolboi9659 2 роки тому +1

    Extra Question 1 and insight into Question 4:
    We can express polynomials in 2 ways:
    (1) (n+1) coefficients uniquely represent the polynomial of order n.
    (2) evaluating the polynomial at (n+1) points uniquely represent the polynomial (see lagrange polynomial).
    For example, 2 points uniquely define a line, 3 points uniquely determine a quadratic...
    In the coefficient representation, to multiply polynomials P and Q, we convolve the coefficients of P and Q to get the coefficients of the product.
    In the evaluation representation, we multiply the evaluation of P and the evaluation of Q to get the evaluation of the product.
    These 2 representations are fourier transforms of one another.

    • @sigfyg8384
      @sigfyg8384  2 роки тому +1

      Nice! I was actually thinking that if you treat use the fourier transform's discrete version, you can apply that to the convolution. You'll start to see the terms line up in a way that makes frequency multiply. I never expected it to connect back to question one.

  • @alexsere3061
    @alexsere3061 3 роки тому +1

    Subscribed after watching this and the linear algebra matrices, i'm gonna share it with all my engineering classmates

  • @TheFolkRevival
    @TheFolkRevival Рік тому +1

    I have never seen the output on the left in LA, the equation is usually written Ax = b in most literature

  • @Alexander-oh8ry
    @Alexander-oh8ry 2 роки тому +2

    The step from the finite to the infinite integral representation with infinitesemals is missing. This is a very good explanatio for beginner´s understanding, but without that last step it is heavily incomplete. Just show how the convolutions is the overlap of functions shifted by a different amount

  • @wellid5163
    @wellid5163 2 роки тому

    Finally, I found out that Background music is the reason why I am not interested in math.😆 Great video!

  • @MartinBurg0s
    @MartinBurg0s 3 роки тому +2

    Thanks for making this video, now I finally feel able to explain this to someone else!

  • @savingcaustic
    @savingcaustic 4 місяці тому

    Thanks, excellent presentation.

  • @sauravgupta92
    @sauravgupta92 2 роки тому

    The example is Gold!

  • @commonsenseinmathphysics3560
    @commonsenseinmathphysics3560 3 роки тому +4

    Great video! Really liked the humorous presentation;)

  • @perrosalchicho
    @perrosalchicho Рік тому +1

    when the convolution appeared i went "whoah"

  • @omaralamin1948
    @omaralamin1948 2 роки тому

    God bless you and others like you.

  • @xandersafrunek2151
    @xandersafrunek2151 3 роки тому +3

    In my entire study of linear algebra, I have never put the output on the left. But it looks good there, really!

    • @sigfyg8384
      @sigfyg8384  3 роки тому +2

      I'm used to putting it on the left because I use "state space representation" of diffeqs a lot. Also, when you assign a variable when programming software, the variable you want to assign goes on the left, and therefore, when you model these equations in code the outputs go on the left.

    • @xandersafrunek2151
      @xandersafrunek2151 3 роки тому

      @@sigfyg8384 Yeah. I like that notation because it reminds you that the matrix-vector product is just a vector. Or that a scalar product simplifies to a scalar value.

    • @holomurphy22
      @holomurphy22 2 роки тому +1

      I also put it on the right, never seen otherwise. I study math in France

  • @skardykats
    @skardykats 3 місяці тому

    This is a fun way to describe conv. I'm hungry for cookies now.

  • @briefcasemanx
    @briefcasemanx 5 місяців тому

    Excellent video on convolution! Maybe could use more explanation when talking about dot products and stuff.

  • @elyepes19
    @elyepes19 Рік тому

    A convoluted million thanks and subscribed! Thanks for the cookies as well

  • @mendelovitch
    @mendelovitch 2 роки тому

    For a little while there were no obnoxious memes, but then he had to add them. Alas.

  • @milenamijuskovic2340
    @milenamijuskovic2340 2 роки тому +2

    excuse me but where is the next video? PLEASE continue making these:D

    • @sigfyg8384
      @sigfyg8384  2 роки тому

      I might have a new one ready by the end of December.

  • @themightyquinn100
    @themightyquinn100 2 роки тому +2

    Great video. One thing that is confusing to me is how you are taking the dot product of d and b. d is defined as a 7 element vector and b is defined as a 4 element vector. How can you take the dot product of these two vectors if they're size is not the same?

  • @ВоробійВіталій

    Cool explanation, thanks

  • @praveenb9048
    @praveenb9048 3 роки тому +1

    Congratulations, Sir!

  • @blacklightning7227
    @blacklightning7227 7 місяців тому

    Thank you for making this.❤

  • @aadiduggal1860
    @aadiduggal1860 2 роки тому +1

    thank you bro, this was an excellent video.

  • @FinalDestinationAllah
    @FinalDestinationAllah Рік тому

    Best and Best video Love you So much❤

  • @sebastiansanfunas4674
    @sebastiansanfunas4674 3 роки тому +1

    This video is amazing, beautiful explanation: instant subscribe

  • @surendrabarsode8959
    @surendrabarsode8959 2 роки тому

    Brilliant. Very well explained!

  • @viniciusgoncalves1238
    @viniciusgoncalves1238 2 роки тому

    First off this is the best video about this ever.
    But I have one doubt, at 7:45, when you say c(t) can be written as d(t)*b(-t), it's weird because that doesn't depend on past imput. compying your first bakery, let's say d(4) (dollars given at day 4) is 1, and b(-t) (cookies given at time -4?) is zero. The result would be zero cookies yet you could've given a dollar before that is just now receiving cookies.

    • @sigfyg8384
      @sigfyg8384  2 роки тому +1

      It is not possible to receive cookies from the bakery on day 0 for a dollar you give on day 4, UNLESS the bakery can predict the future. Last I checked, bakeries do not have divination powers, so c(0) cannot depend on b(-4).
      Since the impulse response b(t) get's flipped around to b(-t), the negative sign actually refers to a point in the future.
      The LATEST part of the impulse response interacts with the EARLIEST part of the input signal, which is why you need the flip.

  • @aamirm
    @aamirm Рік тому

    Great explanation. Thanks!

  • @Speed001
    @Speed001 3 роки тому +2

    7:35 I don't really understand this step. I see the relationships, but why do you end up subtracting?

    • @sigfyg8384
      @sigfyg8384  3 роки тому +2

      f(-t) is f(t) but flipped around the vertical axis.
      f(t-1) is f(t) but shifted forward by one.
      Combine these two transforms, and you get f(-(t-1)), which is a flipped and shifted version of f(t).
      It's ok to be confused here. I suspect that the source of the confusion is trying to comprehend why the flip and the shift are not commutative. To see what I mean, compare f(-t-1) vs f(-(t-1)).
      f(-t-1) Flip first, Shift second
      f(-(t-1)) Shift first, Flip second
      When you switch the order of the transformations, you get two different results. Now you are thinking along the lines of Group Theory, where this question of commutating becomes important!
      Another note: I could've distributed the negative sign in and got f(-t+1) or f(1-t), but that makes it harder to see the flip and shift.
      Different representations of the same phenomena can tell two different stories. For example, a/b and a*(1/b) are mathematically equivalent, but they communicate two very different ideas. Similarly, f(-t+1) and f(1-t) don't communicate the idea I want to emphasize as clearly as f(-(t-1)).

  • @shimaalcarrim7949
    @shimaalcarrim7949 Рік тому

    Excellent 👌

  • @SDX9000
    @SDX9000 2 роки тому

    Outstanding video. Thank you.

  • @alfderbabybenz7092
    @alfderbabybenz7092 Рік тому

    our professor is using this to explain convolutions in our signals and systems course.

  • @lowlevelgamedev9330
    @lowlevelgamedev9330 Рік тому

    Very nice video

  • @X.C.11
    @X.C.11 Рік тому

    Great video sir

  • @radicalsaled5756
    @radicalsaled5756 Рік тому

    amazing video. please make more videos on sytems and signals

  • @MrPabloguida
    @MrPabloguida Рік тому

    Very good.

  • @ABSP5766
    @ABSP5766 3 роки тому +1

    The impulse function is b(t) or d(t)? Thanks. Great video.

    • @sigfyg8384
      @sigfyg8384  3 роки тому +2

      The impulse function/response is b(t). You could call d(t) the total response, which is made up of many impulse responses.

  • @martinsanchez-hw4fi
    @martinsanchez-hw4fi Рік тому

    Where do you make the animations?

  • @timurdosmurzayev6220
    @timurdosmurzayev6220 2 роки тому

    man, you are genius indeed!

  • @TheZ10Z
    @TheZ10Z 6 місяців тому

    Really good video

  • @ozif-csgo7746
    @ozif-csgo7746 Рік тому

    Awesome video

  • @miguelramirez187
    @miguelramirez187 2 роки тому

    Thank you so much

  • @ranam
    @ranam 3 роки тому +2

    Brother you are correct for linear time invariant systems that they stack and scales response but in filters ther are used to attenuate some frequency can you please explain them with an amplifier used in some filters using convulution

    • @ranam
      @ranam 2 роки тому

      Telling the application of convolution in terms of signal processing may help a part of people in the telecommunication and eee engineers but when convolution meets signal processing it also is used as a filter but my question is I have read convolution even it's useful for mechanical engineers such that in resonance when a failure occurs not due to massive force hitting an object results in large deformation could cause failure or an large impulsive force acting on it for a duration of time could cause failure but there is an another phenomenon where the natural frequency of any object is reached the energy builds in it very high and could cause a failure in this manner a small disturbance which accumulates over a time and causes a high energy to build in the system due to energy very high it causes stress and the system collapses this is highly different from stability perspective of control system being not stable does not mean it's accumulating energy inside it but in case of amplifier there is an capacitor or inductance device which causes the attenuation in the electrical signal and filters some frequencies but in other perspective amplifier amplifies the signal such that it stack ques and scales the signal but I don't know this is done by capacitor or am inductor but convolution is useful to both mechanical civil eee ece and every applied scientist and engineers hence it's used as a filter in an circuit or used to amplify but even transistor amplifies the signal without an capacitor or an inductor I guess also mechanical engineers can use it to model resonance hence the energy inside the system build high by periodic accumulation of the system reaching its natural frequency which leads to failure and I can also tell you that when amplifier filter or amplifies the signal it used convolution hence it's useful to every applied scientist and engineers but not to mention the pure Mathematicians use it of convolution of kernels thankyou guys some of my inference could be wrong if somebody or the author of the video is familiar with it please correct the above and educate me thank you for the wonderful video sir

    • @ranam
      @ranam 2 роки тому

      Brother I know mechanical engineers could find resonance but when I had a deep thought on this resonance Is an slow accumulation of energy which is accumulated very high in small installments when the frequencies match if you strike a turning fork of 50 hz you get the same frequency of vibration on another tuning fork so they both vibrate if you strike it harder the amplitude changes hence loudness is a human factor the frequency is the same the languages that human speak through out the world the sound only resonate your ear drum for few seconds my question is that the harmonics is the fundamental frequency and overtones are the frequency that follow it take a word in any language you spell it according to convolution the thing scales and ques and stack the signal so convolution can be used to model resonance so when your ear drum vibrates it vibrates so the electrical signals are carried to brain like tuning fork ear drums vibrate within the audible spectrum 20 hz to 20000 hz hence resonance is caused by the word we speak and within the audible range the ear drums vibrate and we make sense of words I have seen in one videos on UA-cam that due to harmonics in any sound causes resonance which could be modelled by convolution recalling the resonance its destructive because slow and steady accumulation of sound on the mass causes high stress and high energy to build inside and stress increase and the system fractures or collapses but our ear drum hearing the sound from human languages try to vibrate but why our ear drum when subjected to continuous exposure of sound does not fracture or rupture like a wine glass iam not telling about high loud sound higher than 80 db but a audible range sound within the frequency of 20 hz to 20000 hz under continuous exposure why it's not damaging it again not failure by high energy but low one in synchronisation on air . But I tried it in my students when I told them to be quite in class they did not listen to me so I took my phone and set an frequency 14000 hz and they told it was irritating the idea of resonance is "small effort but large destruction " just like Tacoma bridge where the wind just slowly accumulated energy on the bridge and it collapsed it so my conclusion is if an audible frequency at continuous exposure to an human ear can it cause bleeding again "small effort but great destruction" sorry for the long story I you are able to reach hear you must be as curious as me so still not finished the ear drum is shook by harmonics in the sound we make by the words( or )overtones in the sound we make by the words I know harmonics is the fundamental frequency and overtones are following it which under slow and steady accumulation of sound energy resonates and could damge the ear drums again "small effort but big destruction" not to mention we assume the person is in coma or brain dead hence when the sound irritates him he or she could not make a move so my question is so simple normally human ear responds to harmonics or overtones according to convolution which could be a disaster but with minimal effort 🙏🙏🙏🙏 at here I could be wrong because harmonics can also be used to construct sound so can it be destructive or the overtones which are the trouble makers and which one according to this gives a response curve when two signals convolved by harmonics or overtones which is destructive but with minimal effort and convolution happens when ear drums oscillate is by harmonics or the overtones or also the trouble makers there

  • @Mridul_Paul
    @Mridul_Paul 2 роки тому

    Great video man....

  • @bolhasani
    @bolhasani 2 роки тому

    Really helpful, thanks a lot.

  • @okal7706
    @okal7706 2 роки тому

    Great video!

  • @MrFischvogel
    @MrFischvogel 2 роки тому

    Thanks a lot !!

  • @subtlethingsinlife
    @subtlethingsinlife 3 роки тому +2

    3b1b recommended so I had to come

  • @pitiwatkittiwimonchai4656
    @pitiwatkittiwimonchai4656 2 роки тому

    excellent great sir (Thx for explain !!!!)

  • @albinjose8272
    @albinjose8272 Рік тому

    Wow😮...really get the idea

  • @TheJayenz
    @TheJayenz 3 роки тому

    Great job!

  • @tulio829
    @tulio829 3 роки тому +1

    Me focusing on the lesson
    Also me: isn't that ace attorny soundtrack?

  • @lounes9777
    @lounes9777 2 роки тому

    hey i am the 1000th subscriber !

  • @anishsharma6702
    @anishsharma6702 3 роки тому +1

    amazing , and my brain seems to get it

  • @lzh00
    @lzh00 Рік тому

    The beginning killed me😂😂

  • @fail_fast
    @fail_fast 3 роки тому

    Thanks!

  • @mariocolon95
    @mariocolon95 3 роки тому

    At 7:37 I think you made a mistake since c(t) should be reversed. For example c(0) should be d(t).b(-(t-6)) and c(6) should be d(t).b(-t)

    • @sigfyg8384
      @sigfyg8384  3 роки тому +1

      c(0) is supposed to be d(t).b(-t), as shown in the video. At t=0, the only part of the input d(t) that can have any impact on the output is d(0). When you suggest that c(0) should be d(t).b(-(t-6)), that means the system is somehow reading signals from the future!

    • @mariocolon95
      @mariocolon95 3 роки тому

      @@sigfyg8384 Yeah, I guess i got confused because you said you took the rows of the matrix to determine c(t) so for c(0) you use the first row which is b(-(t-6)) and for c(6) you use b(-t).

  • @CyberGamer1539
    @CyberGamer1539 2 роки тому

    yes they are

  • @Speed001
    @Speed001 3 роки тому

    Is this just matrix multiplication in a different form?

    • @sigfyg8384
      @sigfyg8384  3 роки тому +3

      What do you mean by "different form"? The addition 1+1 = 2 is technically a matrix multiplication of the vectors [1, 1] and [1, 1] transposed (so a 1x2 times a 2x1).
      Does this mean that 1+1=2 is just matrix multiplication but in a "different form"?
      Now, that's not a convenient way to represent 1+1=2, but in other scenarios turning something into a matrix multiplication is super useful. So matrix multiplication isn't really a "form" as much as it is a representation. Here's a blogpost I wrote that digs into this some more:
      sigfyg.medium.com/the-philosophy-of-linear-algebra-ac2d9ce14619

    • @Michallote
      @Michallote 3 роки тому +1

      @@sigfyg8384 thank you for the material!

  • @notsober2030
    @notsober2030 2 роки тому +2

    Lost it from the moment he said linear algebra

  • @mrpachotis
    @mrpachotis 3 роки тому

    nice

  • @marshall7253
    @marshall7253 Рік тому

    Thank you so much for this, you are a fuckin g

  • @nomercytv9733
    @nomercytv9733 2 роки тому

    the like and view ratio !!!

  • @hhehe24
    @hhehe24 2 роки тому +1

    nujabes.!

  • @olivertaltynov9220
    @olivertaltynov9220 2 роки тому

    I prefer the second bakery.

  • @brennanh7140
    @brennanh7140 3 роки тому

    Spooky music

  • @brockobama257
    @brockobama257 3 роки тому

    No linear algebra related class I’ve taken has the input, output on the right, left. I’ve only left, right. Are you smoking?

    • @sigfyg8384
      @sigfyg8384  3 роки тому

      Look up "state space representation". The derivative vector, which is the product of a matrix and the state vector, is written on the left side.

    • @sigfyg8384
      @sigfyg8384  3 роки тому +1

      Furthermore, when assigning a variable in software the variable you want to assign goes on the left. Therefore, if you want to write matrix multiplications in code, your output goes on the left.

  • @shahinrab
    @shahinrab 3 роки тому

    Do the 4 follow ups. I will pay you. Like seriously. Set up a Patreon page... now.