Sparse Nonlinear Models for Fluid Dynamics with Machine Learning and Optimization

  Рет қаралды 35,908

Steve Brunton

Steve Brunton

Күн бұрын

Reduced-order models of fluid flows are essential for real-time control, prediction, and optimization of engineering systems that involve a working fluid. The sparse identification of nonlinear dynamics (SINDy) algorithm is being used to develop nonlinear models for complex fluid flows that balance accuracy and efficiency. We explore recent innovations related to several complex flow fields: bluff body wakes, cavity flows, thermal and electro convection, and magnetohydrodynamics.
Citable link for this video: doi.org/10.52843/cassyni.9kd3zp
Papers in order:
1. Original SINDy paper: www.pnas.org/content/113/15/3932
2. SINDy for PDEs: advances.sciencemag.org/conte...
3. SINDy + Autoencoders: www.pnas.org/content/116/45/2...
4. JC Loiseau's Galerkin Regression Paper: doi.org/10.1017/jfm.2017.823 ( arxiv: arxiv.org/abs/1611.03271 )
5. Loiseau, Noack, SLB, SINDy on Lift and Drag: arxiv.org/abs/1706.03531
6. Loiseau thermosyphon paper: arxiv.org/abs/1911.07920
7. Guan, SLB, Novosselov, electroconvection: arxiv.org/abs/2009.11862
8. Kaptanoglu, Morgan, Hansen, SLB, spheromak plasma: journals.aps.org/pre/abstract... ( arxiv.org/pdf/2004.10389.pdf )
9. Callaham, SLB, Loiseau, nonlinear correlations: arxiv.org/abs/2106.02409
10. Callaham, Rigas, Loiseau, SLB, Stochastic dynamics: royalsocietypublishing.org/do...
11. Callaham, Koch, B Brunton, Kutz, SLB, Dominant balance: www.nature.com/articles/s4146...
@eigensteve on Twitter
eigensteve.com
databookuw.com
This video was produced at the University of Washington
%%% CHAPTERS %%%
0:00 Introduction
3:14 Interpretable and Generalizable Machine Learning
8:04 SINDy Overview
11:16 Discovering Partial Differential Equations
12:37 Deep Autoencoder Coordinates
13:42 Modeling Fluid Flows with Galerkin Regression
21:00 Chaotic thermo syphon
22:14 Chaotic electroconvection
25:52 Magnetohydrodynamics
27:40 Nonlinear correlations
29:47 Stochastic SINDy models for turbulence
32:54 Dominant balance physics modeling

Пікірлер: 66
@js913
@js913 2 жыл бұрын
I wonder how lucky are we. Viewing world class lectures from Indian village. That too without any cost. Thank you
@Eigensteve
@Eigensteve 2 жыл бұрын
Thank you so much -- I feel very fortunate to be able to share these with you!
@pradyumnchiwhane2577
@pradyumnchiwhane2577 2 жыл бұрын
Same here. Thanks Steven.
@RaviKiranGoswami
@RaviKiranGoswami 2 жыл бұрын
@Steve Brunton @Arghya Jana , I'm grateful for these
@lahlouaziz695
@lahlouaziz695 2 жыл бұрын
@@Eigensteve god bless you we are learning the best way and in a unimaginable manner ! Hat down sir !
@frankdelahue9761
@frankdelahue9761 2 жыл бұрын
I am also watching it from village.
@tytuer
@tytuer 2 жыл бұрын
Thanks for the video. The concept introduced in 2016 is like using dictionaries for dynamical systems and the follow up papers extends this work. Great work.
@theodoreomtzigt7145
@theodoreomtzigt7145 Жыл бұрын
Wow, this is such a great lecture. Thank you. I came for RL but I am staying for interpretable and generalizable models.
@alaapsarkar
@alaapsarkar 2 жыл бұрын
One of the best videos I've seen! It's amazing!
@Janamejaya.Channegowda
@Janamejaya.Channegowda 2 жыл бұрын
Spectacular work, thank you for sharing.
@ashutoshsingh-et7vm
@ashutoshsingh-et7vm 2 жыл бұрын
Great Lecture sir, eagerly Waiting for Lagrangian coherent structure series
@sw-qn1ky
@sw-qn1ky 2 жыл бұрын
Very nice lecture
@yiyangwu1314
@yiyangwu1314 2 жыл бұрын
Thank you for your teaching, really good education for parametric architect, engineer like me, I really the chaos theory, Lorentz attractor & aerodynamics 👍👍👍🥂🦋✨
@d7ffab979
@d7ffab979 2 жыл бұрын
Oh god I absolute loved this!
@C720L
@C720L 2 жыл бұрын
Brilliant as always
@rb8049
@rb8049 2 жыл бұрын
Wow, I’ve done similar model fitting. Stepwise fitting does well to form a sparse model excluding parameters which are not physically involved. The challenge is identify the cutoff point where more parameters are not added.
@Eigensteve
@Eigensteve 2 жыл бұрын
Agreed, the cutoff is essential.
@frankdelahue9761
@frankdelahue9761 2 жыл бұрын
Although randomness had often been viewed as an obstacle and a nuisance for many centuries, in the 20th century computer scientists began to realize that the deliberate introduction of randomness into computations can be an effective tool for designing better algorithms. In some cases, such randomized algorithms even outperform the best deterministic methods.
@Eigensteve
@Eigensteve 2 жыл бұрын
Indeed, randomized algorithms are phenomenally interesting!
@frankdelahue9761
@frankdelahue9761 2 жыл бұрын
@@Eigensteve Do you use Samba Nova or Cerebras AI chips?
@morekaccino
@morekaccino 2 жыл бұрын
gotta be honest steve. I'm disappointed that you didn't start with "welcome back" that's half of the reason I watch your videos
@Eigensteve
@Eigensteve 2 жыл бұрын
Well then, from me to you, "Welcome back!" =)
@vitorbortolin6810
@vitorbortolin6810 2 жыл бұрын
Great video! I was waiting for it. But my major doubt with syndy is finding the right base. In the future, you could make a lecture focus in ways to find the bases because this look like the greatest challenge.
@Eigensteve
@Eigensteve 2 жыл бұрын
Thanks! I agree, finding the basis is one of the biggest challenges. I discuss this a little bit in the following two videos: kzfaq.info/get/bejne/gdOBnqeY2pO1oGQ.html and kzfaq.info/get/bejne/Z9yipqWYnpi8qqM.html
@jimlbeaver
@jimlbeaver 2 жыл бұрын
Really impressive and inspiring stuff! Thanks for sharing…it definitely stimulates ideas
@Eigensteve
@Eigensteve 2 жыл бұрын
Awesome, glad you liked it!
@hbb21st
@hbb21st 2 жыл бұрын
Very interesting novel application! Expect some more app for the coupled with PB ..... in future:)
@marc-andredesrosiers523
@marc-andredesrosiers523 2 жыл бұрын
Especially curious about the neuroscience applications. Maybe think also of other biological systems: immune system, virus evolution, ...
@Fyizze034
@Fyizze034 2 жыл бұрын
Thank you for this very interesting lecture ! I should be starting a PhD in Applied Maths for Hydrology in the next few months and I would really like to apply POD+constrained SINDy methods for solving inverse problems on St-Venant equations. Do you think the PySindy library can be used to build easy-to-invert models for data assimilation ? Thank you again for what you are doing, I’m a huge fan of your work ! Have a nice day.
@Eigensteve
@Eigensteve 2 жыл бұрын
Glad you like it! I think these methods definitely could be useful for this topic -- let me know how it goes!
@prajwol_poudel
@prajwol_poudel 2 жыл бұрын
How does sindy compare with genetic programming for system identification?
@Eigensteve
@Eigensteve 2 жыл бұрын
They are quite closely related in spirit, although they use different algorithms and representations. In general, genetic programming will represent a larger space of possible model functions, although it may be more expensive to find the model in this space (more data, more computation, etc.). Because SINDy is built on linear algebra (i.e., a simple generalized linear regression), it is more natural to extend in some ways (e.g., adding control, other regularizations, etc.).
@kevalan1042
@kevalan1042 2 жыл бұрын
Can these techniques be used for things like weather or climate simulations? Or are those too "chaotic" for sparse models to work?
@Eigensteve
@Eigensteve 2 жыл бұрын
In general chaos isn't really the problem, as there are plenty of chaotic systems that are also sparse (like the Lorenz 63 weather model). Multiscale dynamics (e.g., weather evolves over scales spanning thousands of kilometers down to sub-kilometer scales) are more challenging because the dimension of the representations are large.
@kevalan1042
@kevalan1042 2 жыл бұрын
@@Eigensteve I see - and do you have an intuition for why sparse models don't work well in multiscale situations?
@keithschaub7863
@keithschaub7863 2 жыл бұрын
@@kevalan1042 Have you seen the movie Twister? To begin, we'd need to have literally thousands, maybe millions, of sensors spread across miles/kms of 3D space. All of the data they show has temp at every x,y,z and at every delta t. So, I would guess that if we could do that on a massive scale, we could make forward progress
@justinsostre8470
@justinsostre8470 2 жыл бұрын
Please come speak at my school Rochester Institute of Technology. I am part of the Ph.D. program for Mathematical Modeling and it would be sick!
@paladinofjustice1107
@paladinofjustice1107 2 жыл бұрын
Hey Steve, is this just a shorter version of the talk you did for 'critical transitions with complex systems'?
@Eigensteve
@Eigensteve 2 жыл бұрын
I think there is a lot of overlap, but I actually made this youtube video a bit earlier.
@samferrer
@samferrer 2 жыл бұрын
Really interesting... do you have plans to apply sindy to telecom network traffic analytics?
@Eigensteve
@Eigensteve 2 жыл бұрын
Not yet, but that is a really cool idea! Would be interested to know how it goes if you apply to that area.
@samferrer
@samferrer 2 жыл бұрын
@@Eigensteve We will, but right now we will apply bernoulli since it is the simplest model. For what we want to achieve we will need to use an adaptive control approach ... and this is a very good method
@boffo25
@boffo25 2 жыл бұрын
Where is the link for the video on sindy + autoencoders
@hamidhamid5962
@hamidhamid5962 2 жыл бұрын
First of all, thank you very much for sharing your knowledge and your great presentations. I am interested in the problem of three cylinders (min 20) I could not find the papers you mentioned above. Please any reference to this work. Thank you in advance.
@Eigensteve
@Eigensteve 2 жыл бұрын
The key authors to search for on the topic of sparse modeling of the 3-cylinder configuration are Nan Deng, Luc Pastur, Marek Morzynski, and Bernd Noack. They have done a lot of neat work here, and I believe it is all on the arxiv for free.
@hamidhamid5962
@hamidhamid5962 2 жыл бұрын
@@Eigensteve Thanks you very much for your prompt reply; thanks for sharing your Knowledge
@anshulsuri5619
@anshulsuri5619 Жыл бұрын
FTLE video please 🙏
@manueljenkinjerome1107
@manueljenkinjerome1107 2 жыл бұрын
Hi professor, I’m a masters student currently learning convex optimisation, compressive sensing, and turbulence modelling (as separate courses/projects). Familiar with some signal processing, including wavelet transforms. Would like to know if there are any summer opportunities, where I could contribute to this/similar project?
@Eigensteve
@Eigensteve 2 жыл бұрын
Thanks for the question! I don't have well-defined summer opportunities in this area just yet, but if you start following the "PySINDy" github project, there might be areas to contribute here, and that could spark some ideas for larger projects.
@manueljenkinjerome1107
@manueljenkinjerome1107 2 жыл бұрын
@@Eigensteve thank you very much professor.
@claytonestey767
@claytonestey767 2 жыл бұрын
Are there extensions of this for stochastic differential equations?
@Eigensteve
@Eigensteve 2 жыл бұрын
Great question! Yes indeed there are. The first extension was by Boninsegna, Nuske, and Clementi (arxiv.org/abs/1712.02432), and we (Callaham, Loiseau, Rigas) followed up with a modification more suitable for turbulence (royalsocietypublishing.org/doi/full/10.1098/rspa.2021.0092). Recently, we demonstrated that this can be used on measurements from real turbulence experiments at high Reynolds numbers (arxiv.org/abs/2105.13990).
@ahmadsaeed9954
@ahmadsaeed9954 2 жыл бұрын
@@Eigensteve these links are not working. any reason
@CHRISTICAUTION
@CHRISTICAUTION 2 жыл бұрын
@@Eigensteve i'd like to check the papers but the links you provided unfortunately do not work
@Eigensteve
@Eigensteve 2 жыл бұрын
@@CHRISTICAUTION Sorry about that! They seem to work for me... any in particular that don't work? Most of them can be easily google searched too, and they are mostly open access.
@paladinofjustice1107
@paladinofjustice1107 2 жыл бұрын
@@Eigensteve I think it is just because the end parentheses being appended to the url
@leojack1225
@leojack1225 7 ай бұрын
Great video, but I am not sure it is possible to discover new laws of physics in this way.
@loki-oq1lj
@loki-oq1lj 2 жыл бұрын
Ultron and vission are near upcoming 30 years
@milanandesilic896
@milanandesilic896 2 жыл бұрын
Josh Proctor looks just like my gfs mechanic! Come to think of it, he looks like her plumber and doctor, and I'm pretty sure I've seen him work in the military too.
@loki-oq1lj
@loki-oq1lj 2 жыл бұрын
I think AI will give so much importance to truth and since he does not have desire so he will destroy all the machines and infrastructure reset the world back to zero. He will become conscious of creation and the truth act like God and whenever God arrive he doesn't listen anybody he start fixing things for the welfare of the universe.
@frankdelahue9761
@frankdelahue9761 2 жыл бұрын
The team at DeepMind has tested the programming skills of its AI programming tool AlphaCode against human programmer competitors and has found it tested in the top 54 percent of human coders. In their preprint article, the group at DeepMind suggests that its programming application has opened the door to future tools that could make programming easier and more accessible. The team has also posted a page on its blog site outlining the progress being made with AlphaCode. Research teams have been working steadily over the past several years to apply artificial intelligence to computer programming. The goal is to create AI systems that are capable of writing code for computer applications that are more sophisticated than those currently created by human coders. Barring that, many have noted that if computers were writing code, computer programming would become a much less costly endeavor. Thus far, most such efforts have been met with limited success, however, because they lack the intelligence needed to carry out the most difficult part of programming-the approach. When a programmer is asked to write a program that will perform a certain function, that programmer has to first figure out how such a problem might be solved. As an example, if the task is to solve any maze of a certain size, the programmer can take a brute-force approach or apply techniques such as recursion. The programmer makes a choice based on both real-world knowledge and lessons learned through experience. AI programs typically have little of either, and they also lack the sort of intelligence that humans possess. But it appears researchers are getting closer. DeepMind's AlphaCode is an AI system that is able to create code within the confines of a programming competition-a setting where simple problems are outlined and code is written within a few hours. The team at DeepMind tested their new tool against humans competing on Codeforces, a site that hosts programming challenges. Those that compete are rated on both their approach and their skills. AlphaCode took on 10 challenges with no assistance from human handlers. It had to read the outline that described what was to be done, develop an approach, and then write the code. After judging, AlphaCode was ranked in the top 54.3 percent of programmers who had taken the same challenges. DeepMind notes that this ranking puts the system in the top 28 percent of programmers who have competed in any event on the site over the prior six months.
Deep Learning for Turbulence Closure Modeling
22:28
Steve Brunton
Рет қаралды 38 М.
My little bro is funny😁  @artur-boy
00:18
Andrey Grechka
Рет қаралды 13 МЛН
I’m just a kid 🥹🥰 LeoNata family #shorts
00:12
LeoNata Family
Рет қаралды 20 МЛН
Мы никогда не были так напуганы!
00:15
Аришнев
Рет қаралды 4,9 МЛН
Kernel Learning for Robust Dynamic Mode Decomposition
21:04
Peter J. Baddoo
Рет қаралды 10 М.
What Is Turbulence?  Turbulent Fluid Dynamics are Everywhere
29:59
Steve Brunton
Рет қаралды 68 М.
17 - How to write an Eulerian fluid simulator with 200 lines of code.
12:05
Ten Minute Physics
Рет қаралды 284 М.
Fluid dynamics feels natural once you start with quantum mechanics
33:00
braintruffle
Рет қаралды 2,1 МЛН
The Anatomy of a Dynamical System
17:53
Steve Brunton
Рет қаралды 82 М.
Machine Learning for Fluid Dynamics: Models and Control
32:28
Steve Brunton
Рет қаралды 42 М.
cute mini iphone
0:34
승비니 Seungbini
Рет қаралды 6 МЛН