How I Understand Flow Matching

Рет қаралды 3,616

25 күн бұрын

Flow matching is a new generative modeling method that combines the advantages of Continuous Normalising Flows (CNFs) and Diffusion Models (DMs).
In this tutorial, I share my understanding of the basics of flow matching and provide an overview of how these ideas evolve over time.
Check out the resources below to learn more about this topic.
===== Paper/blog survey =====
[Papamakarios et al. 2021] Normalizing flows for probabilistic modeling and inference arxiv.org/abs/1912.02762
[Kobyzev et al. 2020] Normalizing Flows: An Introduction and Review of Current Methods arxiv.org/abs/1908.09257
[Tor Fjelde et al. 2024] An Introduction to Flow Matching
mlg.eng.cam.ac.uk/blog/2024/0...
[Jakub Tomczak] Flow Matching: Matching flows instead of scores
Blog: jmtomczak.github.io/blog/18/1...
Code example: github.com/jmtomczak/intro_dg...
===== Research talks =====
[Yaron Lipman] Flow Matching: Simplifying and Generalizing Diffusion Models
• Flow Matching: Simplif...
[Michael S Albergo] Building Normalizing Flows with Stochastic Interpolants
• Building Normalizing F...
[Alex Tong] Conditional Flow Matching
• TransferLab Seminar: C...
Thumbnail background image credit: unsplash.com/photos/a-close-u...

Пікірлер: 29

@plcrodrigues 5 күн бұрын

This is gold. Congrats for doing such a fun, pedagogical, and informative on a topic that can often be quite dry in the literature.

@jbhuang0604 4 күн бұрын

Thanks for your kind words!

@manuellecha 23 күн бұрын

Thank you very much! You did a really nice job! The video is clear, visual, and informative. It is consistent with the timeline and evolution of the field, and it effectively conveys the information along with the motivation for the development of these models.

@jbhuang0604 22 күн бұрын

Glad you liked it! It’s a lot of fun making this video!

@DimitrivonRutte 23 күн бұрын

Awesome to see easy-to-understand explanations of current research topics, keep up the great work!

@jbhuang0604 23 күн бұрын

Glad you liked it!

@catherineyang5199 23 күн бұрын

Thank you for the video! This is the most clear explanation of flow matching on the internet ❤

@jbhuang0604 23 күн бұрын

Thank you so much for your kind words!

@yeon6761 6 күн бұрын

perfect video! Thank you for your works.

@jbhuang0604 4 күн бұрын

You're very welcome!

@AnujZore-pe9mg 20 күн бұрын

Thanks once again for easy-to-understand explanation! Gonna miss CSMC 733 lectures :(

@jbhuang0604 19 күн бұрын

Glad you like them!

@r00t257 24 күн бұрын

Legend comeback 🙇! Your educational video is worth more than gold.💓🙏

@jbhuang0604 23 күн бұрын

Thanks a lot! Glad you like it!

@nathan_ca 18 күн бұрын

Thanks! This is amazing video to get students, like me, to re-engage with these topics that i haven't had a chance to explore more ❤

@jbhuang0604 16 күн бұрын

Thanks! Glad that this is helpful.

@jackshi7613 23 күн бұрын

excellent video!

@jbhuang0604 23 күн бұрын

Thanks for watching!

@amirhosseinraffiee8270 21 күн бұрын

Thanks for the video. Great way to explain a complex concept

@jbhuang0604 21 күн бұрын

Appreciate your comment! Thanks for watching the video. Hope you enjoyed it.

@ruoshiliu6024 17 күн бұрын

Amazing work Jia-Bin!! P.S. you should create a bibtex for this video so it can be cited in literature :P

@jbhuang0604 15 күн бұрын

Haha! Thanks! Too bad google scholar don’t include views of KZfaq videos.

@adrienforbu5165 23 күн бұрын

nice visuals, good job

@jbhuang0604 22 күн бұрын

Thanks a lot!

@julienblanchon6082 23 күн бұрын

This is brilliant !

@jbhuang0604 23 күн бұрын

Glad that you enjoyed the video!

@kvu207 23 күн бұрын

beautiful! May I ask how you made the animations for this video?

@jbhuang0604 22 күн бұрын

Most of the animations are from the “morph transition” in PowerPoint slides. The rest are from Adobe premier pro.

@Neo-kx3fe 13 күн бұрын

@10:55 with that local outgoingness on the left, why there is one additional term p_t(x_t) inside the d/dx bracket? This term seems to disappear in @11:18. Thanks.