Convolutions are not Convoluted

  Рет қаралды 52,519

SigFyg

SigFyg

Күн бұрын

EXTRA NOTES:
-The convolution matrix is a Toeplitz matrix.
-If the bakery's impulse response was to give cookies periodically (e.g. giving cookies every week), you would get circular convolution.
-Another intuition of flipping the impulse response is that if you DIDN'T flip, the system would be using signals from the future input to calculate the present output, which is impossible in a time-dependent system.
- Fourier Transform video mentioned in footnote at 8:08: • The Linear Algebra of ...
- Origin and History of Convolutions: www.slideshare.net/Alexdfar/o...
Timestamps
0:00 Introduction
0:47 Bakery
1:38 Fancy Word #1: Impulse Response
2:13 Fancy Word #2: Time-Invariant
3:21 Fancy Word #3: Linear
4:12 pausing/replaying highly encouraged here
4:39 Linear Algebra
8:56 Fancy Word #4: Convolution
9:17 Practical Applications
Clips:
Oscilliscope Footage: • EEVblog #396 - Bode Pl...
Conv. NN Animation: • Convolutional Neural N...
Fourier Series Animation: • Fourier Series Animati...
Pascal's Triangle GIF: daugerresearch.com/vault/para...
Circuit Animation Website: www.falstad.com/circuit/
Tacoma Narrows Bridge Collapse: • Tacoma Narrows Bridge ...
Music:
Winter Lane (Remix) - Nujabes
Investigation Core 2001 - Ace Attorney
Sweet Mystery Galaxy - Super Mario Galaxy 2

Пікірлер: 105
@BoZhaoengineering
@BoZhaoengineering 2 жыл бұрын
This is the most understandable convolution interpretation I have ever seen on KZfaq. Just awesome.
@Michallote
@Michallote 2 жыл бұрын
I went through university and this was way more understandable than whatever we were taught
@blisslen
@blisslen 2 жыл бұрын
Wow, one of the best explanations I've heard of one of the trickier concepts in signals classes (one that you really need to understand going deeper into DSP or anything). Hope this was submitted to 3blue1brown's contest, this is definitely a contender.
@sigfyg8384
@sigfyg8384 2 жыл бұрын
It was submitted to the contest, but I already know I'm not in the top 100 lol
@TheRookieNerds
@TheRookieNerds 2 жыл бұрын
Omg you are criminally underrated
@kartikvishaldeshpande7422
@kartikvishaldeshpande7422 2 ай бұрын
Many hours put into understanding this concept during my undergraduate days, watching your 10-min video now provided far better understanding. Simple and to the point explanation. Thanks, and please keep updating with intuitive teachings. Great work !!!
@utkarshmishra7416
@utkarshmishra7416 2 жыл бұрын
I was surprised to see only 565 subs, keep going, with the quality, i hit sub in like 30 seconds into the video. This is a major channel with millions of subs in the making if you keep makng. Keep up the good work
@Bravo_L
@Bravo_L 2 жыл бұрын
Im in signals and systems and we doin this stuff rn -.- This is sooooo good btw kudos!!!!!!! Ee major here
@tymofei8586
@tymofei8586 2 жыл бұрын
Very good and intuitive explanation. As a mechanical engineer who pursue into mastering control theory and systems,sometimes i find its math difficult to grasp intuitively but with those cookies you made it just so easy :D thanks
@ghassanehajji7591
@ghassanehajji7591 2 жыл бұрын
This is an excellent video, you have a real talent for explaining the intuition behind "convoluted"" ideas. Please continue making explainers. I'll be eagerly awaiting the next installment, and hopefully you'll make a series exploring the topics you listed at the end.
@kaemmili4590
@kaemmili4590 2 жыл бұрын
yea please , its awesome, and feels like a nice fresh breath =) edit : the last sound effect made me hit the bell button .
@thunderstriketrading
@thunderstriketrading Жыл бұрын
This is underrated educational content! Great video!
@4733R70
@4733R70 2 жыл бұрын
man you just proved that maths can be much much easier if explained from people with your talent!! if you like it keep going with your videos!!!
@danielweber4917
@danielweber4917 Жыл бұрын
Love the phoenix wright background music; absolutely fits the tone!
@MartinBurg0s
@MartinBurg0s 2 жыл бұрын
Thanks for making this video, now I finally feel able to explain this to someone else!
@biffbum8221
@biffbum8221 5 ай бұрын
This is the video that lighted the bulb 💡! Much appreciated keep going ❤
@commonsenseinmathphysics3560
@commonsenseinmathphysics3560 2 жыл бұрын
Great video! Really liked the humorous presentation;)
@chrissysevigny2462
@chrissysevigny2462 3 ай бұрын
I watched two other videos on convolution prior to this (one of them being the fairly notorious 3Blue1Brown), and I think this helped me understand the concept of convolution the best. It just seemed like it stripped away all of the (in my opinion) more challenging vocabulary, and brought it down to layman's terms. Thanks for sharing!
@h2ogun26
@h2ogun26 Жыл бұрын
some might say it's distracting, but the selection of back ground music was aesthetic and well reconciled.
@exoticcoder5365
@exoticcoder5365 8 ай бұрын
I love the background music as well, it helped me focus
@blacklightning7227
@blacklightning7227 4 ай бұрын
Thank you for making this.❤
@surendrabarsode8959
@surendrabarsode8959 Жыл бұрын
Brilliant. Very well explained!
@praveenb9048
@praveenb9048 2 жыл бұрын
Congratulations, Sir!
@sebastiansanfunas4674
@sebastiansanfunas4674 2 жыл бұрын
This video is amazing, beautiful explanation: instant subscribe
@savingcaustic
@savingcaustic Ай бұрын
Thanks, excellent presentation.
@sauravgupta92
@sauravgupta92 2 жыл бұрын
The example is Gold!
@alexsere3061
@alexsere3061 2 жыл бұрын
Subscribed after watching this and the linear algebra matrices, i'm gonna share it with all my engineering classmates
@elyepes19
@elyepes19 Жыл бұрын
A convoluted million thanks and subscribed! Thanks for the cookies as well
@SDX9000
@SDX9000 2 жыл бұрын
Outstanding video. Thank you.
@nabeelsherazi8860
@nabeelsherazi8860 2 жыл бұрын
Holy shit the moment the meaning of linear time-invariant clicked for me... instant subscribe. I don't care if you never make videos again, I have NEVER understood linearity like that.
@aamirm
@aamirm Жыл бұрын
Great explanation. Thanks!
@user-vp6dd1fz6p
@user-vp6dd1fz6p 9 ай бұрын
Cool explanation, thanks
@skatomort
@skatomort 2 жыл бұрын
The only thing I'm convoluted atm is the number of subscribers ... Well done!
@aadiduggal1860
@aadiduggal1860 Жыл бұрын
thank you bro, this was an excellent video.
@mendelovitch
@mendelovitch Жыл бұрын
For a little while there were no obnoxious memes, but then he had to add them. Alas.
@Alexander-oh8ry
@Alexander-oh8ry Жыл бұрын
The step from the finite to the infinite integral representation with infinitesemals is missing. This is a very good explanatio for beginner´s understanding, but without that last step it is heavily incomplete. Just show how the convolutions is the overlap of functions shifted by a different amount
@perrosalchicho
@perrosalchicho Жыл бұрын
when the convolution appeared i went "whoah"
@omaralamin1948
@omaralamin1948 2 жыл бұрын
God bless you and others like you.
@kevinmathewson4272
@kevinmathewson4272 5 ай бұрын
For anyone confused: at 7:36, each term in the c vector is really a summation. The first term, for example, should be read as "sum, for t values 0 through 6, of the expression: d(t) x b(-t)" where the x is a multiplication symbol. The second term should be read as "sum, for t values 0 through 6, of the expression: d(t) x b(-(t - 1))." And so on.
@TheFolkRevival
@TheFolkRevival Жыл бұрын
I have never seen the output on the left in LA, the equation is usually written Ax = b in most literature
@bolhasani
@bolhasani 2 жыл бұрын
Really helpful, thanks a lot.
@FinalDestinationAllah
@FinalDestinationAllah Жыл бұрын
Best and Best video Love you So much❤
@smolboi9659
@smolboi9659 Жыл бұрын
Extra Question 1 and insight into Question 4: We can express polynomials in 2 ways: (1) (n+1) coefficients uniquely represent the polynomial of order n. (2) evaluating the polynomial at (n+1) points uniquely represent the polynomial (see lagrange polynomial). For example, 2 points uniquely define a line, 3 points uniquely determine a quadratic... In the coefficient representation, to multiply polynomials P and Q, we convolve the coefficients of P and Q to get the coefficients of the product. In the evaluation representation, we multiply the evaluation of P and the evaluation of Q to get the evaluation of the product. These 2 representations are fourier transforms of one another.
@sigfyg8384
@sigfyg8384 Жыл бұрын
Nice! I was actually thinking that if you treat use the fourier transform's discrete version, you can apply that to the convolution. You'll start to see the terms line up in a way that makes frequency multiply. I never expected it to connect back to question one.
@shimaalcarrim7949
@shimaalcarrim7949 9 ай бұрын
Excellent 👌
@radicalsaled5756
@radicalsaled5756 Жыл бұрын
amazing video. please make more videos on sytems and signals
@TheJayenz
@TheJayenz 2 жыл бұрын
Great job!
@Mridul_Paul
@Mridul_Paul 2 жыл бұрын
Great video man....
@okal7706
@okal7706 2 жыл бұрын
Great video!
@timurdosmurzayev6220
@timurdosmurzayev6220 2 жыл бұрын
man, you are genius indeed!
@ozif-csgo7746
@ozif-csgo7746 9 ай бұрын
Awesome video
@MrPabloguida
@MrPabloguida 9 ай бұрын
Very good.
@miguelramirez187
@miguelramirez187 Жыл бұрын
Thank you so much
@X.C.11
@X.C.11 Жыл бұрын
Great video sir
@lowlevelgamedev9330
@lowlevelgamedev9330 Жыл бұрын
Very nice video
@briefcasemanx
@briefcasemanx Ай бұрын
Excellent video on convolution! Maybe could use more explanation when talking about dot products and stuff.
@wellid5163
@wellid5163 Жыл бұрын
Finally, I found out that Background music is the reason why I am not interested in math.😆 Great video!
@themightyquinn100
@themightyquinn100 2 жыл бұрын
Great video. One thing that is confusing to me is how you are taking the dot product of d and b. d is defined as a 7 element vector and b is defined as a 4 element vector. How can you take the dot product of these two vectors if they're size is not the same?
@TheZ10Z
@TheZ10Z 2 ай бұрын
Really good video
@lounes9777
@lounes9777 Жыл бұрын
hey i am the 1000th subscriber !
@MrFischvogel
@MrFischvogel 2 жыл бұрын
Thanks a lot !!
@pitiwatkittiwimonchai4656
@pitiwatkittiwimonchai4656 2 жыл бұрын
excellent great sir (Thx for explain !!!!)
@albinjose8272
@albinjose8272 Жыл бұрын
Wow😮...really get the idea
@fail_fast
@fail_fast 2 жыл бұрын
Thanks!
@xandersafrunek2151
@xandersafrunek2151 2 жыл бұрын
In my entire study of linear algebra, I have never put the output on the left. But it looks good there, really!
@sigfyg8384
@sigfyg8384 2 жыл бұрын
I'm used to putting it on the left because I use "state space representation" of diffeqs a lot. Also, when you assign a variable when programming software, the variable you want to assign goes on the left, and therefore, when you model these equations in code the outputs go on the left.
@xandersafrunek2151
@xandersafrunek2151 2 жыл бұрын
@@sigfyg8384 Yeah. I like that notation because it reminds you that the matrix-vector product is just a vector. Or that a scalar product simplifies to a scalar value.
@holomurphy22
@holomurphy22 2 жыл бұрын
I also put it on the right, never seen otherwise. I study math in France
@alfderbabybenz7092
@alfderbabybenz7092 Жыл бұрын
our professor is using this to explain convolutions in our signals and systems course.
@lzh00
@lzh00 Жыл бұрын
The beginning killed me😂😂
@ranam
@ranam 2 жыл бұрын
Brother you are correct for linear time invariant systems that they stack and scales response but in filters ther are used to attenuate some frequency can you please explain them with an amplifier used in some filters using convulution
@ranam
@ranam 2 жыл бұрын
Telling the application of convolution in terms of signal processing may help a part of people in the telecommunication and eee engineers but when convolution meets signal processing it also is used as a filter but my question is I have read convolution even it's useful for mechanical engineers such that in resonance when a failure occurs not due to massive force hitting an object results in large deformation could cause failure or an large impulsive force acting on it for a duration of time could cause failure but there is an another phenomenon where the natural frequency of any object is reached the energy builds in it very high and could cause a failure in this manner a small disturbance which accumulates over a time and causes a high energy to build in the system due to energy very high it causes stress and the system collapses this is highly different from stability perspective of control system being not stable does not mean it's accumulating energy inside it but in case of amplifier there is an capacitor or inductance device which causes the attenuation in the electrical signal and filters some frequencies but in other perspective amplifier amplifies the signal such that it stack ques and scales the signal but I don't know this is done by capacitor or am inductor but convolution is useful to both mechanical civil eee ece and every applied scientist and engineers hence it's used as a filter in an circuit or used to amplify but even transistor amplifies the signal without an capacitor or an inductor I guess also mechanical engineers can use it to model resonance hence the energy inside the system build high by periodic accumulation of the system reaching its natural frequency which leads to failure and I can also tell you that when amplifier filter or amplifies the signal it used convolution hence it's useful to every applied scientist and engineers but not to mention the pure Mathematicians use it of convolution of kernels thankyou guys some of my inference could be wrong if somebody or the author of the video is familiar with it please correct the above and educate me thank you for the wonderful video sir
@ranam
@ranam 2 жыл бұрын
Brother I know mechanical engineers could find resonance but when I had a deep thought on this resonance Is an slow accumulation of energy which is accumulated very high in small installments when the frequencies match if you strike a turning fork of 50 hz you get the same frequency of vibration on another tuning fork so they both vibrate if you strike it harder the amplitude changes hence loudness is a human factor the frequency is the same the languages that human speak through out the world the sound only resonate your ear drum for few seconds my question is that the harmonics is the fundamental frequency and overtones are the frequency that follow it take a word in any language you spell it according to convolution the thing scales and ques and stack the signal so convolution can be used to model resonance so when your ear drum vibrates it vibrates so the electrical signals are carried to brain like tuning fork ear drums vibrate within the audible spectrum 20 hz to 20000 hz hence resonance is caused by the word we speak and within the audible range the ear drums vibrate and we make sense of words I have seen in one videos on KZfaq that due to harmonics in any sound causes resonance which could be modelled by convolution recalling the resonance its destructive because slow and steady accumulation of sound on the mass causes high stress and high energy to build inside and stress increase and the system fractures or collapses but our ear drum hearing the sound from human languages try to vibrate but why our ear drum when subjected to continuous exposure of sound does not fracture or rupture like a wine glass iam not telling about high loud sound higher than 80 db but a audible range sound within the frequency of 20 hz to 20000 hz under continuous exposure why it's not damaging it again not failure by high energy but low one in synchronisation on air . But I tried it in my students when I told them to be quite in class they did not listen to me so I took my phone and set an frequency 14000 hz and they told it was irritating the idea of resonance is "small effort but large destruction " just like Tacoma bridge where the wind just slowly accumulated energy on the bridge and it collapsed it so my conclusion is if an audible frequency at continuous exposure to an human ear can it cause bleeding again "small effort but great destruction" sorry for the long story I you are able to reach hear you must be as curious as me so still not finished the ear drum is shook by harmonics in the sound we make by the words( or )overtones in the sound we make by the words I know harmonics is the fundamental frequency and overtones are following it which under slow and steady accumulation of sound energy resonates and could damge the ear drums again "small effort but big destruction" not to mention we assume the person is in coma or brain dead hence when the sound irritates him he or she could not make a move so my question is so simple normally human ear responds to harmonics or overtones according to convolution which could be a disaster but with minimal effort 🙏🙏🙏🙏 at here I could be wrong because harmonics can also be used to construct sound so can it be destructive or the overtones which are the trouble makers and which one according to this gives a response curve when two signals convolved by harmonics or overtones which is destructive but with minimal effort and convolution happens when ear drums oscillate is by harmonics or the overtones or also the trouble makers there
@ABSP5766
@ABSP5766 2 жыл бұрын
The impulse function is b(t) or d(t)? Thanks. Great video.
@sigfyg8384
@sigfyg8384 2 жыл бұрын
The impulse function/response is b(t). You could call d(t) the total response, which is made up of many impulse responses.
@subtlethingsinlife
@subtlethingsinlife 2 жыл бұрын
3b1b recommended so I had to come
@anishsharma6702
@anishsharma6702 2 жыл бұрын
amazing , and my brain seems to get it
@martinsanchez-hw4fi
@martinsanchez-hw4fi Жыл бұрын
Where do you make the animations?
@mrpachotis
@mrpachotis 2 жыл бұрын
nice
@Speed001
@Speed001 2 жыл бұрын
7:35 I don't really understand this step. I see the relationships, but why do you end up subtracting?
@sigfyg8384
@sigfyg8384 2 жыл бұрын
f(-t) is f(t) but flipped around the vertical axis. f(t-1) is f(t) but shifted forward by one. Combine these two transforms, and you get f(-(t-1)), which is a flipped and shifted version of f(t). It's ok to be confused here. I suspect that the source of the confusion is trying to comprehend why the flip and the shift are not commutative. To see what I mean, compare f(-t-1) vs f(-(t-1)). f(-t-1) Flip first, Shift second f(-(t-1)) Shift first, Flip second When you switch the order of the transformations, you get two different results. Now you are thinking along the lines of Group Theory, where this question of commutating becomes important! Another note: I could've distributed the negative sign in and got f(-t+1) or f(1-t), but that makes it harder to see the flip and shift. Different representations of the same phenomena can tell two different stories. For example, a/b and a*(1/b) are mathematically equivalent, but they communicate two very different ideas. Similarly, f(-t+1) and f(1-t) don't communicate the idea I want to emphasize as clearly as f(-(t-1)).
@viniciusgoncalves1238
@viniciusgoncalves1238 Жыл бұрын
First off this is the best video about this ever. But I have one doubt, at 7:45, when you say c(t) can be written as d(t)*b(-t), it's weird because that doesn't depend on past imput. compying your first bakery, let's say d(4) (dollars given at day 4) is 1, and b(-t) (cookies given at time -4?) is zero. The result would be zero cookies yet you could've given a dollar before that is just now receiving cookies.
@sigfyg8384
@sigfyg8384 Жыл бұрын
It is not possible to receive cookies from the bakery on day 0 for a dollar you give on day 4, UNLESS the bakery can predict the future. Last I checked, bakeries do not have divination powers, so c(0) cannot depend on b(-4). Since the impulse response b(t) get's flipped around to b(-t), the negative sign actually refers to a point in the future. The LATEST part of the impulse response interacts with the EARLIEST part of the input signal, which is why you need the flip.
@milenamijuskovic2340
@milenamijuskovic2340 2 жыл бұрын
excuse me but where is the next video? PLEASE continue making these:D
@sigfyg8384
@sigfyg8384 2 жыл бұрын
I might have a new one ready by the end of December.
@tulio829
@tulio829 2 жыл бұрын
Me focusing on the lesson Also me: isn't that ace attorny soundtrack?
@CyberGamer1539
@CyberGamer1539 Жыл бұрын
yes they are
@Speed001
@Speed001 2 жыл бұрын
Is this just matrix multiplication in a different form?
@sigfyg8384
@sigfyg8384 2 жыл бұрын
What do you mean by "different form"? The addition 1+1 = 2 is technically a matrix multiplication of the vectors [1, 1] and [1, 1] transposed (so a 1x2 times a 2x1). Does this mean that 1+1=2 is just matrix multiplication but in a "different form"? Now, that's not a convenient way to represent 1+1=2, but in other scenarios turning something into a matrix multiplication is super useful. So matrix multiplication isn't really a "form" as much as it is a representation. Here's a blogpost I wrote that digs into this some more: sigfyg.medium.com/the-philosophy-of-linear-algebra-ac2d9ce14619
@Michallote
@Michallote 2 жыл бұрын
@@sigfyg8384 thank you for the material!
@hhehe24
@hhehe24 Жыл бұрын
nujabes.!
@mariocolon95
@mariocolon95 2 жыл бұрын
At 7:37 I think you made a mistake since c(t) should be reversed. For example c(0) should be d(t).b(-(t-6)) and c(6) should be d(t).b(-t)
@sigfyg8384
@sigfyg8384 2 жыл бұрын
c(0) is supposed to be d(t).b(-t), as shown in the video. At t=0, the only part of the input d(t) that can have any impact on the output is d(0). When you suggest that c(0) should be d(t).b(-(t-6)), that means the system is somehow reading signals from the future!
@mariocolon95
@mariocolon95 2 жыл бұрын
@@sigfyg8384 Yeah, I guess i got confused because you said you took the rows of the matrix to determine c(t) so for c(0) you use the first row which is b(-(t-6)) and for c(6) you use b(-t).
@nomercytv9733
@nomercytv9733 2 жыл бұрын
the like and view ratio !!!
@marshall7253
@marshall7253 Жыл бұрын
Thank you so much for this, you are a fuckin g
@brennanh7140
@brennanh7140 2 жыл бұрын
Spooky music
@notsober2030
@notsober2030 2 жыл бұрын
Lost it from the moment he said linear algebra
@olivertaltynov9220
@olivertaltynov9220 2 жыл бұрын
I prefer the second bakery.
@brockobama257
@brockobama257 2 жыл бұрын
No linear algebra related class I’ve taken has the input, output on the right, left. I’ve only left, right. Are you smoking?
@sigfyg8384
@sigfyg8384 2 жыл бұрын
Look up "state space representation". The derivative vector, which is the product of a matrix and the state vector, is written on the left side.
@sigfyg8384
@sigfyg8384 2 жыл бұрын
Furthermore, when assigning a variable in software the variable you want to assign goes on the left. Therefore, if you want to write matrix multiplications in code, your output goes on the left.
@shahinrab
@shahinrab 2 жыл бұрын
Do the 4 follow ups. I will pay you. Like seriously. Set up a Patreon page... now.
You've never seen imaginary numbers like this before
15:44
SigFyg
Рет қаралды 4,8 М.
But what is a convolution?
23:01
3Blue1Brown
Рет қаралды 2,5 МЛН
Wait for the last one! 👀
00:28
Josh Horton
Рет қаралды 130 МЛН
Пробую самое сладкое вещество во Вселенной
00:41
Smart Sigma Kid #funny #sigma #comedy
00:25
CRAZY GREAPA
Рет қаралды 11 МЛН
Introducing Convolutions: Intuition + Convolution Theorem
11:08
Faculty of Khan
Рет қаралды 113 М.
Why this puzzle is impossible
19:37
3Blue1Brown
Рет қаралды 3,1 МЛН
What is Jacobian? | The right way of thinking derivatives and integrals
27:14
Convolutions and Polynomial Approximation
12:13
kieransquared
Рет қаралды 12 М.
Do you understand IR Convolution Reverbs?
14:36
ALPHA SOUND
Рет қаралды 27 М.
Lecture 4, Convolution | MIT RES.6.007 Signals and Systems, Spring 2011
52:17
Convolution: The Secret Weapon Of Sound Design 🤫
20:17
Venus Theory
Рет қаралды 156 М.
Игровой Комп с Авито за 4500р
1:00
ЖЕЛЕЗНЫЙ КОРОЛЬ
Рет қаралды 1,8 МЛН
Мой инст: denkiselef. Как забрать телефон через экран.
0:54
Собери ПК и Получи 10,000₽
1:00
build monsters
Рет қаралды 2,1 МЛН