No video

MATH426: Householder QR

  Рет қаралды 68,402

Toby Driscoll

Toby Driscoll

Күн бұрын

Пікірлер: 67
@featuresky5084
@featuresky5084 6 жыл бұрын
Many many thanks to you. My Prof rushed through it in class while leaving me clueless. You made it clear and precise.
@TobyDriscoll
@TobyDriscoll 6 жыл бұрын
😎
@featuresky5084
@featuresky5084 3 жыл бұрын
@Ella Bottoni you forgot to change your account name bot.
@raba2d723
@raba2d723 2 жыл бұрын
same! instructor presented it like its somehow self-evident. This video is life saving.
@derendohoda3891
@derendohoda3891 4 жыл бұрын
Best explanation I've found on this, thanks a lot!
@isaacafariaddo834
@isaacafariaddo834 7 жыл бұрын
Thanks a lot Toby for the explanation. It has really helped me to understand the Householder method of decomposition.
@hmars_t
@hmars_t 4 жыл бұрын
Hervorragendes Video. Endlich Mal anschaulich und verständlich erklärt. Vielen Dank dafür.
@engineeringoyster6243
@engineeringoyster6243 Жыл бұрын
This is the clearest KZfaq video I've stumbled upon explaining the use of the Householder Transformation to generate the QR factorization. Many thanks. I've been struggling for almost a decade (very much part time) to understand exactly how this calculation works. But all my previous attempts have been stymied by the use of unexplained short hand notation. An excellent example of this is the Wikipedia page on the Householder Transformation. Shortly after the index of the article, the authors confuse the lay reader by using shorthand without providing any hint on the meaning of the nomenclature. Even in your video, it would have been more clear if you had enclosed the matrices in square brackets to clearly indicate that they are matrices. Similarly, use curly brackets around the vectors to clearly indicate vectors. Then the remaining variables would be numbers. Also, regarding the vectors, clarity would be improved is you could indicate if a vector is a column or row vector. I continue to wonder why teachers of Linear Algebra topics are so casual with their notation. The Wikipedia page on the Householder Transformation are very sloppy in this respect. About half way down the page, they work an example. But, in their worked example, they don't show their calculations of P1, P2, ... They do show all the iterations of A & Q. Also, they never calculate any of the R matrices. This shorthand is a significant barrier for a novice like me. One element that is missing in this video is a discussion on why it is useful to do a QR factorization. My interest is to calculate the matrix of Eigenvectors of an arbitrary, square matrix of real numbers since is common in engineering to study the Eigenvectors & Eigenvalues of a system matrix of a dynamics, state-space problem. Of course, most of the time, users will have access to MatLab or equivalent which provides user friendly access to LINPACK / LAPACK which includes efficient software for calculating these. But, understanding the fundamental algorithm can be a useful method to improve one's understanding of the process. Even with the clarity of this video, I remain baffled on the use of the terms, "mirror" and "reflector" to explain this. I've studied optics in college physics classes & certainly understand how light reflects off of a mirror. I can not see any analogy to optical reflection & this Householder "reflector." Because of your video, I now understand what I have to do to calculate the Q matrix in a QR factorization. But, I still don't understand why it works. At times in the past decade of so, I was under the impression that less than 1000 people in the world actually understand enough about calculating Eigenvectors efficiently to write their own code. Years ago I was browsing one of the Numerical Recipes books & noticed that the chapter on Eigensolutions contained a strong caution not to attempt to write your own software to calculate Eigen Solutions. These days, I think that maybe as many as 100000 people worldwide understand this topic.
@navonildeb3583
@navonildeb3583 7 жыл бұрын
Nice video. Each step was clarified and justified. Good job :)
@pabloarroniz9660
@pabloarroniz9660 5 жыл бұрын
Eres el cherif men me has salvado todo el curso gracias por alegrarme la vida
@renjieliang2947
@renjieliang2947 3 жыл бұрын
you do great job that show how and where P householder formal come from, and thank you
@danneedham6821
@danneedham6821 7 жыл бұрын
Thank you, very well explained!
@EdwardNusinovich
@EdwardNusinovich 7 жыл бұрын
Good explanation. This is much appreciated.
@jianliu5258
@jianliu5258 Жыл бұрын
So clear! Thanks!
@chiragsavaliya520
@chiragsavaliya520 8 жыл бұрын
Thanks Toby......................................keep it up.
@Targeryen2
@Targeryen2 5 жыл бұрын
Excelent job!! helped a lot
@paulj.murphy7447
@paulj.murphy7447 4 жыл бұрын
Bravo!
@tpat90
@tpat90 7 жыл бұрын
Good video, even though the step from Px to P is a bit short and looks a bit confusing. Even if you just use the symmetrical properties of the scalar product.
@reinerwilhelms-tricarico344
@reinerwilhelms-tricarico344 7 ай бұрын
Great presentation. Golub would be jealous.
@smitmandavia1787
@smitmandavia1787 5 жыл бұрын
excellent !!
@ericchristoffersen9355
@ericchristoffersen9355 4 жыл бұрын
Terrific explanation, simple and careful and simple steps to explain the essence. thank you so much for sharing. Wish id found this when i was learning this... i share this video to explain. You should make another to explain column pivoting tradeoffs. What i really want is a video to help me understsnd why qr iteration converges on eigenvalues...
@spellfox_
@spellfox_ Жыл бұрын
Great explanation, best I've found on youtube. I just can't understand how to get subsequent Qs after calculating Q1
@hassangharbi3687
@hassangharbi3687 3 жыл бұрын
Great explanation thanks for Morocco
@vshssvs7
@vshssvs7 8 жыл бұрын
Thank you Toby, for the clear explanation. This made the basic concept clear. I feel you didn't mention the relation between P's and Q's. I understood from a different source that Qi is obtained by placing Pi as a submatrix in a bigger Identity matrix (size equal to size of Qi). Thank again!
@TobyDriscoll
@TobyDriscoll 8 жыл бұрын
+vshssvs7 It gets even more complicated. Most of the time the Q is not formed. Instead the HH vectors are collected and then applied in order (or reverse order) to evaluate Q times a vector.
@vshssvs7
@vshssvs7 8 жыл бұрын
+Toby Driscoll Thank you Toby for clarification.
@robertcruikshank4501
@robertcruikshank4501 5 ай бұрын
Very nice. If I'm not mistaken, at 11:25, you change the order of xTv = vTx to pull out x on the right and factor it, not moving it like your little green arrow says.
@sargeras1478
@sargeras1478 5 ай бұрын
Ah thank you ! I was trying to understand how you could do this and you explanation made me understand
@aqua28paromita
@aqua28paromita 8 жыл бұрын
At 10:38-------> When you get Px, the numerator of the second term is 2*v*x'*v, and in the next step for P the numerator of the second term becomes v*v'. I am confused which is scalar and which is matrix and how v gets its transpose suddenly. It would be great if you could please clarify.
@TobyDriscoll
@TobyDriscoll 8 жыл бұрын
+Paromita Banerjee (x'v) is a scalar inner product, so it's the same as (v'x). You can then associate the v and v' terms, and finally separate out x on the right of the P*x expression.
@aqua28paromita
@aqua28paromita 8 жыл бұрын
+Toby Driscoll Makes complete sense, thanks a bunch!
@tpat90
@tpat90 7 жыл бұрын
To be fair the sketch in the video doesn't really help to clarify that very well ;)
@unknownBudy
@unknownBudy 6 жыл бұрын
thanks
@choungyoungjae8271
@choungyoungjae8271 5 жыл бұрын
I have a question: What does it mean that unstable in floating point? and why? Thank you for the explanation of princple in the Gram-Schmidt QR.
@TobyDriscoll
@TobyDriscoll 5 жыл бұрын
In floating point, all numbers and operations are perturbed slightly (in the 16th digit). G-S is unstable, meaning that the errors in the results will be orders of magnitude larger than those original perturbations. Mainly, the basis vectors end up being far from orthogonal.
@choungyoungjae8271
@choungyoungjae8271 5 жыл бұрын
@@TobyDriscoll Thank you for your answer. I understood. Thanks a lot :-)
@nshuang1009
@nshuang1009 4 жыл бұрын
@@TobyDriscoll For other methods, why don't they have the same problem that unstable in floating-point? They also use floating-point for calculation.
@TobyDriscoll
@TobyDriscoll 4 жыл бұрын
@@nshuang1009 Expressions that are equivalent for real numbers may not be so for floating point. Most often it's a subtraction that causes growth in error. If the computation can be rearranged to avoid such a step, it might avoid the growth in error.
@danielcunha3324
@danielcunha3324 3 жыл бұрын
Dear Toby, this is a wonderful video, thank you for your thoughtful explanation. I am digging deeper, and wondering, how do we compute v? I see in your code v = [-sign(z(1))*norm(z) - z(1)]; -z(2:end)]; Do mind replying a few sentences about this?
@spellfox_
@spellfox_ Жыл бұрын
Im wondering the same...
@iamjinse
@iamjinse 2 жыл бұрын
nice video sir
@foluobidare957
@foluobidare957 7 ай бұрын
Very nice explanation. I wish there was also a video on Givens rotations
@cvanaret
@cvanaret 6 ай бұрын
I found this one helpful: kzfaq.info/get/bejne/o9WEq82Yu6umlnU.html
@pilot615
@pilot615 3 ай бұрын
Super 🤩
@hritizgogoi3739
@hritizgogoi3739 Жыл бұрын
THANKS A ZILLION
@VivaldiHeroes
@VivaldiHeroes 8 жыл бұрын
why is the multiplication Q3Q2Q1 described as QT?
@TobyDriscoll
@TobyDriscoll 8 жыл бұрын
The product is an orthogonal matrix. We might call it Q, but in anticipation of making it look like the standard formula at the end, we choose to name it Q^T (which is also an orthogonal matrix).
@VivaldiHeroes
@VivaldiHeroes 8 жыл бұрын
uhuh, I see, thanks :) nice video btw
@prvizpirizaditweb2324
@prvizpirizaditweb2324 Жыл бұрын
where do you get v
@daryatikhonova5437
@daryatikhonova5437 5 жыл бұрын
Hello! I have one question. I am not sure that you are right concerning multiplication of matrices P_i. As Q = I *P1*P2*P3.... But, you are doing like Pn *.....* P2 * P1*I. Thank you for your video!
@TobyDriscoll
@TobyDriscoll 5 жыл бұрын
I'm not sure I know exactly which part you mean. But we have A=QR, so Q^T A = R. If we find Q^T as a product of matrices, then Q is the product in the opposite order.
@Gloox45
@Gloox45 4 жыл бұрын
It's a good video, but the norm of w can't be negative by definition so something must have went wrong there, I think I still understand but it confused me a bit at first, I think the minus sign comes from V and you should define V in the opposite direction
@TobyDriscoll
@TobyDriscoll 4 жыл бұрын
The norm can't be negative, but the vector is being mapped by the reflection to either +norm(z)*e1 or -norm(z)*e1, i.e., to a vector with positive or negative first element. The definition of v also flips in the first term depending on which target is chosen.
@lukeaaa1
@lukeaaa1 6 жыл бұрын
n^p for p = 2.376
@SnackPacks10
@SnackPacks10 7 жыл бұрын
This would have been much more helpful to me if you used an example with real numbers. Maybe that's just me personally since I'm an engineer and like to work with real things, but I'm still just having a really hard time understanding this.
@TobyDriscoll
@TobyDriscoll 7 жыл бұрын
You can look here: www.dropbox.com/sh/kxyc1on3k4f3sh0/AACnyHY2FmXgUpHmJvSYV6Qaa?dl=0&preview=TB_Lecture_10.html. It's brief, but does the job. The problem is that the numbers are either trivial or too ugly to do by hand.
@SnackPacks10
@SnackPacks10 7 жыл бұрын
Toby Driscoll Thanks so much! I have to do this by hand in my applied linear algebra class, so I've been pretty lost.
@chiboubamine5970
@chiboubamine5970 8 жыл бұрын
if it's possible i want a programme python and tanx for this amazing video :D
@TobyDriscoll
@TobyDriscoll 8 жыл бұрын
+Chiboub Amine Thanks for the compliment. I'm not much of a Python programmer, but numpy/scipy has a gateway to LINPACK, if you're doing serious work.
@chiboubamine5970
@chiboubamine5970 8 жыл бұрын
i do it already if you want to see it i'll send :D
@haoasakura1258
@haoasakura1258 3 жыл бұрын
who the fuck is e1?
@TobyDriscoll
@TobyDriscoll 3 жыл бұрын
Vector with first component 1, the rest 0. (I.e., standard basis vector.)
MATH426: Rootfinding introduction
15:15
Toby Driscoll
Рет қаралды 498
2-6 Householder transformation
46:35
Martijn Anthonissen
Рет қаралды 9 М.
Double Stacked Pizza @Lionfield @ChefRush
00:33
albert_cancook
Рет қаралды 117 МЛН
ПРОВЕРИЛ АРБУЗЫ #shorts
00:34
Паша Осадчий
Рет қаралды 7 МЛН
03.3.2 Householder transformations, part 1
6:35
Advanced LAFF
Рет қаралды 24 М.
QR decomposition (for square matrices)
14:12
The Bright Side of Mathematics
Рет қаралды 101 М.
Singular value decomposition
17:06
Toby Driscoll
Рет қаралды 25 М.
QR algorithm for eigenvalues
11:34
Toby Driscoll
Рет қаралды 36 М.
Applied Linear Algebra:  QR & Householder
46:31
Nathan Kutz
Рет қаралды 12 М.
QR Decomposition by Givens Rotations - Linear Algebra
11:39
Nick Space Cowboy
Рет қаралды 2,6 М.
QR decomposition
14:07
Dr Peyam
Рет қаралды 137 М.
Harvard AM205 video 2.9 - Householder triangularization
20:40
Chris Rycroft
Рет қаралды 3,8 М.
Applied Linear Algebra:  QR Decomposition
54:45
Nathan Kutz
Рет қаралды 8 М.