自从2018年关注了您，真的是醍醐灌顶，胜读十年书。

Finally, the good stuff!

Thank you. I have bought your book, its really interesting and learned a lot from it. I'm also interested by your work on PNAS about sparse sensing of insects' wings. Hope to see more followup papers on this topic.

Please make a MOOC on this!

At last you uploaded new one thanks professor

Thank you very much .. I've learned so much from you . Best wishes

This is pure gold 👏🏻👏🏻 Well done and thank you so much.

It would be really cool if you could talk some more about the extension to neural networks some more. My first thought is that you would apply it to the latent space representation? But that seems like it wouldn't save very much effort, since you would already have done the whole forward pass of all but one layer of the network. You could use it as a preprocessing step, and train a classifier on the reduced images, but optimizing for linearly separable data seems at odds with the strength of neural networks, which is finding patterns that go beyond linear separability.

Very interesting! One thing I'm curious about. I wonder if the SVD step can't be replaced with something more tailored to the downstream classification task? I'm thinking this b/c the SVD mapping to the low D space is determined for max-variance reasons. Maybe SVD is chosen b/c its fast? Or some other reason I'm not seeing?

thank you very much sir, for clear explanation!!

Whooaaa that moth thing is super cool! I wonder if this can be used to model the unpredictability of a housefly's seemingly random path.

Steve, when we are instead retrieving features by passing source data through neural network layers (as opposed to linear decomposition via PCA/SVD), how are the network architectures and neuron-level activation functions reflected in the sparse optimization problem?

Thank you for the presentation. What if our data matrix short and fat and instead of tall and skinny. Does QR apply in that case?

Thank you!

Fascinating

Awesome Thank you!

wow, its great!

Is sparsity robust to ood generalization

Thanks heaps! Can you post the links to your papers here??

great lecture as usual you are the best , i am waiting for how to code it in Matlab and python

Why is w a discriminant vector

Neurodivergent ppl produce better OOD generalization sensors

CIA might know what you are talking about