Curve Fitting in Python (2022)

  Рет қаралды 89,106

Mr. P Solver

Mr. P Solver

Күн бұрын

Check out my course on UDEMY: learn the skills you need for coding in STEM:
www.udemy.com/course/python-s...
In this video I show how to use the curvefit function in the scipy.optimize library. I also look at practical examples from physics.
Tutorial Playlist:
• The Full Python Tutorial
Code:
github.com/lukepolson/youtube...
Discord:
/ discord

Пікірлер: 101
@mikhailbandurist8652
@mikhailbandurist8652 Жыл бұрын
That's the scientific channel that we need. Good sound (which is the most important), good picture, Chad-looking science guy (in movies smart people are often nerds with big glasses) and a good explanation - this is really nice! Thank you for video!
@hakansert13
@hakansert13 2 жыл бұрын
Sometimes one may both know coding and physics but it becomes really exhausting to combine them together; you may not able to know where to start... You are directly attacking to that tricky intersection perfectly and that is exactly what is needed for lots of science students/academics! I just personally wanted to thank you for such great videos as a PhD student in physics who had worked with paper and pen for years but needed numerical computation eventually. Your videos are awesome and very informing! I hope you keep going.
@skilz8098
@skilz8098 Жыл бұрын
If you ever try your hand at 3D Graphics Programming and write the underlying core components of the 3D Rendering Engine where you implement a Physics Engine with basic kinematics, collision detection systems, A.I. Path Finding Algorithms, etc. then you get into doing Animations, Particle Effects, Rigid Bodies, Rag Dolls, Liquid or Water Animations, etc... by using advanced shaders for many various lighting, shading, shadow, and other special effects... That's one of the best ways to merge the two fields. Now, this kind of Physics programming is different from Data Science, Equation Solver type Physics system, but it's a great place to start and most of the topics and transitions would already be covered. A basic 3D Rendering Engine or 3D Game Engine uses mostly linear algebra and trigonometry, but there is still a bit of calculus here and there such as when basic integrals, performing interpolations of various kinds, using runge kutta as well as FFTs all come in handy. Especially FFTs when working with Audio Processing and 3D Sound Environments is another great benefit. You end up incorporating many mathematical and physics, (maybe even a little bit of chemistry, biology, and environmental systems depending on the context of your Engine and what you are going to build with it) concepts into your Engine that stem across many software engineering and program application development disciplines by using almost every kind of container and associated algorithm there are out there. Other key features would be file management and file parsers, you can end up writing your own scripting or run time interpreted language, if doing multiplayer over networking then multithreading and multiprocessing principles, compression and decompression algorithms, encryption and decryption algorithms come in handy. Then you have many other topics such as batch processing, Storage or Assets Memory Managers, Many Various Shaders with an accompanying Shader Manager, and so much more. This doesn't even include things such as GUIs, HUDs and Font Management... Now, once you have the Engine Built with all of its core components (and I don't mean using a 3D engine such as Unity or Unreal...) Then the fun begins when you start building your game that is seperate from then engine but requires it as a core underlying library to function properly. Now imagine building a game like Factorio or Minecraft... Both of those games are Turing Complete... or even a 2D with 3D layer slices such as in Oxygen Not Included or a semi-factory but defense tower game like Mindustry which are both Turing Complete... or something similar to those... Then I think you can build just about any kind of software application that you could imagine except maybe an actual robust compiler-debugger-linker suite, or an actual Operating System... Oh they could be done... but they're a challenge. I found it was actually a bit easier to learn how to build a Hardware Emulator in C++ with a focus on the 6502 for the NES... Now that was a fun project as well! So almost anything is possible to build but it does depend on the limitations of your hardware... This is just a summary of about a 20 year journey of independent studying purely self taught hobbyist and some of the many topics I've learned over the years! There's many other things that I didn't mention as this is starting to become quite long... It's been a great journey. Even watching Ben Eaters 8-Bit Breadboard CPU series was a delight! So much so, that I actually implemented it in Logisim.
@heera_ai
@heera_ai 2 жыл бұрын
Your initial guess was good enough 😂, great tutorial!
@alejandraacosta248
@alejandraacosta248 Жыл бұрын
Wow! You explain very clearly! I was fighting with my code since I did not understand how to work with curve_fit and you fell out of the sky! Thank you so much!
@otaviooliveira5157
@otaviooliveira5157 Жыл бұрын
The kind of detailed explanation i needed! The examples nailed it! Thanks a lot :)
@RutgerHaan
@RutgerHaan 2 жыл бұрын
Thanks a lot! This was a really thorough explanation which gave me everything I need to plot my data in a nice way :) Keep it up!
@moona5454
@moona5454 2 жыл бұрын
Great video. Especially focusing and repeating multiple times that our goal is the parameters and not just having a good fit! Parameters = Context = Reason why we're doing the fit
@swatibhargava4140
@swatibhargava4140 11 ай бұрын
Super helpful and so nicely explained! Thank you so much for making this video! The multiple examples helped me a lot and in fact covered what I was as looking for!
@crazyclown9914
@crazyclown9914 2 жыл бұрын
Two weeks ago I had a physics assignment involving this method, which was a absolute disaster. This is why I should watch your videos as soon as they show up. Anyway, Thanks for the amazing job!
@j.abrahamhernandez3629
@j.abrahamhernandez3629 2 жыл бұрын
dude your videos rock, i love the no-nonsense type of attitude when tackling things, cheers! (;
@dylanskinner6815
@dylanskinner6815 Жыл бұрын
Your videos are sweet! I found you earlier today and have already learned a ton. Thanks!
@maplesyrum
@maplesyrum 5 ай бұрын
This is excellent content. Clearly explained a problem I've been having trouble grasping for months. Thanks!
@vadympasko100
@vadympasko100 9 ай бұрын
Absolutely love this intro to SciPy's 'curve_fit' function! Suggest you to make a video on spline fitting, which is included into SciPy's 'interpolate' module. With splines it is possible to find best fit to a really complex data, including those presented in this tutorial.
@chayanikarabha8556
@chayanikarabha8556 2 жыл бұрын
Thank you so much for making such videos. Specifically in physics. It is of so much help. Please keep doing such videos.
@rainycloud10
@rainycloud10 Жыл бұрын
This is exactly the tutorial I needed given I had to perform many counting experiments . I wish I had found this channel sooner before going insane over tutorials that made zero sense to me.
@JarredDavidson
@JarredDavidson Жыл бұрын
Excellent video. Very clear unpacking of the logic. Thank you! I've subbed.
@abrahamdelacruz8389
@abrahamdelacruz8389 2 жыл бұрын
Dude! this video is so useful! Great explanation and great material!
@siddharthpachpor5928
@siddharthpachpor5928 Жыл бұрын
superb video with respect to physics and maths! Best application based explanation. Period. Please I request you to post such concepts with such physics based applications visualisation. I just feel blessed. Thanks a lot. tons
@laurenceturpin1409
@laurenceturpin1409 5 ай бұрын
Thank you for making this video I particularly liked that you gave more than one example.
@harveyjones5227
@harveyjones5227 Жыл бұрын
Amazing! Thank you. This has been perfect help with plotting an exponential curve to my data.
@gloryths
@gloryths Жыл бұрын
You give quality out there. Respect man.
@python4scientists
@python4scientists 2 жыл бұрын
Nice! Note that (in 19:40) you need to set absolute_sigma=True to get the absolute value errors on the parameters. A good example is using the known formulas to calculate the error on the parameters (A,B) of a strait line fit and compare with the results returning with absolute_sigma=False e absolute_sigma=True.
@boseongcho62
@boseongcho62 2 жыл бұрын
It's a good comment
@MrSpaceboyy
@MrSpaceboyy Жыл бұрын
This is great! Glad to find your channel
@datastako156
@datastako156 2 жыл бұрын
great videos! continue your greatwork bro! supporting from philippines here.
@vinrai09
@vinrai09 Жыл бұрын
Thanks for explaining this so well!! Super helpful!!
@loredo97
@loredo97 Жыл бұрын
Brilliant explanation of the covariance!
@boseongcho62
@boseongcho62 2 жыл бұрын
Thank you now I understood how the errors behave!
@MrAman47
@MrAman47 2 жыл бұрын
Great video, just a little correction, as the physicist in me is happy to show himself every now and then: It's actually Lennard-Jones potential, sometimes also called Van der Waals potentials (dipole-dipole potential) big brother. I don't think there's a thing called Leonard-Weibeck potential reguarding atomic repulsion, but if there is and it's related to the LJ potential, let me know!
@MrPSolver
@MrPSolver 2 жыл бұрын
Oh I might have misspoke! Thank you for this correction 😂
@ragibabsarramon7881
@ragibabsarramon7881 5 ай бұрын
Your Videos are really helping me. Thanks a lot.
@nathan6798
@nathan6798 8 ай бұрын
Hi, first off EXCELLENT VIDEO THANK YOU SO MUCH Just for those who need this video, there are a couple of clarifications (sorry if you made them and I didnt notice), but its popt, pcov = scipy.optimize.curve_fit not just curve_fit () . Unless you made a shortcut beforehand Other than that , thank you again so much help !
@raysu9853
@raysu9853 2 жыл бұрын
Great video, thank you. Hope to see you @ UBC some day :)
@iurialmeida8979
@iurialmeida8979 2 жыл бұрын
i found your videos about 10 minutes ago and mate, what an amazing content, you remind me of keith galli, he is awesome too
@chaitanyavarmamudunuri7270
@chaitanyavarmamudunuri7270 Жыл бұрын
Thank you for the content, I would like to see a video on hysteresis curvefitting with multiple conditions
@chaitanyavarmamudunuri7270
@chaitanyavarmamudunuri7270 Жыл бұрын
Thank you very much for such beautiful tutorials. Can you show fitting hysteresis models
@Raiden_Amani
@Raiden_Amani Жыл бұрын
Thank you so much !! You've been a really big help.
@ahmedalshemi955
@ahmedalshemi955 Жыл бұрын
Thanks a lot for this nice explanation! I wonder what you use to fix one or some of the fitted parameters using the Scipy curve fitting function?
@danteng5651
@danteng5651 6 ай бұрын
This is super clear!
@antonXPS
@antonXPS Жыл бұрын
excellent explanation, very detailed
@nothingisreal6345
@nothingisreal6345 Жыл бұрын
Like 25 years ago i wrote code to fit multiple gauss function to some spectrum comming from Cherenkov radiation emitted from cristals. Those days everythibg had to be done in C/C++. I use the "Numerical recipies in C" book and lib and the Marquard Levenberg algorithm. Took 3 weeks to progam that (including some GUI and other stuff). Today with Scipy maybe one or two days... Some stuff actually get's better.
@mis_llaneous
@mis_llaneous Жыл бұрын
I learnt a lot from thus vedio, thanks bro👍
@Bored_Trumpet
@Bored_Trumpet 7 ай бұрын
Was expecting a good description of what's going on with the curve-fitting functions, albeit with boring data. But actually I found exactly what I was looking for. Trying to get the photopeaks and their resolutions in a similar spectroscopy. Also the walking through cell-by-cell helps for digestion. Used to begrudingly use python, but after a semester I much more prefer it over finicky excel sheets.
@rinezaman492
@rinezaman492 2 жыл бұрын
These videos are really great
@DEChacker
@DEChacker 11 ай бұрын
awesome video as always. Learned a lot - especially the cov-Matrix was super helpful One note: It is the Lennard-Jones potential, not the Leonard Weibeck potential
@rostamr4096
@rostamr4096 5 ай бұрын
This is so very helpful...thank you
@colesmith2136
@colesmith2136 2 жыл бұрын
Really great video!
@andresderudder9950
@andresderudder9950 2 жыл бұрын
Great video ! I just finished a lab report last Saturday, this would been useful jajaja. I would like you to make a video about animations in python tool
@rainycloud10
@rainycloud10 Жыл бұрын
Same. I wish I had found this tutorial a couple of weeks ago for my lab reports. But better late than never.
@AJ-et3vf
@AJ-et3vf 9 ай бұрын
Great video! Thank you!
@philtoa334
@philtoa334 Жыл бұрын
Very good ,very Useful very : )
@yazito21
@yazito21 Жыл бұрын
Very helpful video...👍👍👍
@andrewjolly319
@andrewjolly319 2 жыл бұрын
Please consider doing some stuff on Bayesian inference using Markov Chains, maybe using the PyMC library?
@monenehmoneneh9561
@monenehmoneneh9561 11 ай бұрын
perfect please do more in physcis and more intuitive
@kapfox
@kapfox 2 жыл бұрын
You definitely making a good thing, killing a Matlab!
@LOL-vt8jh
@LOL-vt8jh 2 жыл бұрын
Good job!
@frederic-louissauser6945
@frederic-louissauser6945 Жыл бұрын
pretty nice explanation, thanks! would it give some sense to use R or Scilab to achieve this, would it be more efficient?
@romenaakter1042
@romenaakter1042 2 жыл бұрын
Simply WOW!
@joaovictorbalieirodasilva1430
@joaovictorbalieirodasilva1430 Жыл бұрын
Please, make a numba tutorial :) Your videos are awsome
@dominikrodak4204
@dominikrodak4204 Жыл бұрын
Hello, Thanks a lot for yours tutorials! They help me a lot. I have a question. How to use curve_fit (or how to cope with the problem) if I have a system of ODEs. How to use it as a model for curve_Fit function?
@carlosyordanocozdelacruz3370
@carlosyordanocozdelacruz3370 Жыл бұрын
good video. How would I estimate the data based on those parameters?
@minhangnguyen999
@minhangnguyen999 Жыл бұрын
OH GOD!!, thank you very much!!!!!
@sadaf6295
@sadaf6295 2 жыл бұрын
Sir, can u make video on Heisenberg spin chain and correlation between spins.
@preshitlimje6046
@preshitlimje6046 Жыл бұрын
Hello Mr. P Solver, First of all a great video on optimization. I have a question regarding the optimization and identification of values in a given curve. Since I am completely new to this, I am not much aware of reverse engineering. I have an experimental Time-Temperature curve of a heat transfer system and based on it I need to identify the convective heat transfer coefficient. Is it possible to make it? if yes could you please give me an example. Thanks in advance. With Regards, Preshit
@brucewernick6542
@brucewernick6542 2 жыл бұрын
The heatmap of the covariance is brilliant, I'm definitely going to experiment with that. You mentioned the importance of the diagonal, but what do the other values in the covariance matrix mean?
@librealgerien
@librealgerien 2 жыл бұрын
That’s how one parameter affects another if at all.
@ayushisuman4889
@ayushisuman4889 5 ай бұрын
Very helpful content. The error(as obtained from experiment) is sometimes not symmetric about the mean y position. Is it possible to encode that into curve_fit function?
@NaneRulz
@NaneRulz 2 жыл бұрын
Great video! In the given case that you want to work multiple samples, and perform simultaneous fits. Is that possible? It is something I use often in XPS.
@ender84
@ender84 2 жыл бұрын
Same question here. I have tried clustering without luck.
@odvutmanush3234
@odvutmanush3234 Жыл бұрын
could you please show how to add bound to parameter?
@senolkurt7864
@senolkurt7864 2 ай бұрын
Thanks for the great tutorial. Since in real life we have only the data, how can we find the best non-linear model function that fits to our data?
@STWNoman
@STWNoman Жыл бұрын
Perfect
@ssj_hamood5364
@ssj_hamood5364 Жыл бұрын
For the Gaussian fit again. If I add a +c factor at the end in the gauss_f definition, will the plot work if I expand popt with c_opt so that the measurement points are taken into account which do not look "parabolic"?
@ksrajavel
@ksrajavel Жыл бұрын
Amazing
@obliquesealray2188
@obliquesealray2188 2 жыл бұрын
great vid
@lospaturno
@lospaturno 2 жыл бұрын
Can you tell something about fitting multiple gaussians in a signal?
@ricardoferes9051
@ricardoferes9051 2 жыл бұрын
Hey could you do a tutorial for a CFD simulation in python?
@Path_k_pradeep
@Path_k_pradeep 2 жыл бұрын
Thanks 👏👏
@skilz8098
@skilz8098 Жыл бұрын
Have you done any videos on FFTs or any Runge Kutta methods?
@miszcz310
@miszcz310 Жыл бұрын
Hmmm i was expecting something more clicking this video. When you have object returned by the fit method it has method called plot. It shows data with fitted model as well as plots the residuals.
@Heisenberg20023
@Heisenberg20023 8 ай бұрын
I had a question, what if the function had constants in its definition that were an array that take certain values at specific points of xdata?
@lookaway8496
@lookaway8496 Жыл бұрын
Say I have a histogram plot with bars. I would like to do a skew norm fit to it. How do I proceed with this? can anyone help? like what initial data should I have
@gerrievanstaden3416
@gerrievanstaden3416 2 жыл бұрын
Is there a way to do R^2?
@03_bikramkesharipanda68
@03_bikramkesharipanda68 Жыл бұрын
Can we solve a multi-variable function through curve-fitting , for example - y = f(x1,x2,x3,x4)?
@KunalSingh-my5nd
@KunalSingh-my5nd Жыл бұрын
My values in y axis are all less than 1. So taking the sq root considering Poison statistics of photons gives very high error. What should I do ? Should i take some kind of scaling factor?
@MsJ0ni
@MsJ0ni Жыл бұрын
thank you..
@bavneetkaur979
@bavneetkaur979 Жыл бұрын
Hello Mr. P solver, is there a way to solve for a complex function- meaning that the function that I have defrined returns complex(both real and imaginary parts) simultaneously, I tried doing it this with Scipy.optimize.curve_fit() but does not help If you have any idea pls share, thanks :)
@Science4Ever
@Science4Ever 2 жыл бұрын
Great video as always! May I ask you to recommend some good books to dive further into this stuff? Maybe the ones you learned from, if any? It would be great! Keep doing these great videos, sir!
@jay89boy
@jay89boy 2 жыл бұрын
ye im also wondering how did he reach all that knowledge
@Science4Ever
@Science4Ever 2 жыл бұрын
@@jay89boy Same here, he might and actually should do a short video about giving some advices on how to dig deeper into the topic, especially book recommendations. He is a great guy and I think he will read this and respond in one way or another.
@rishiraj2548
@rishiraj2548 Жыл бұрын
👍💯
@mohamadyusuf847
@mohamadyusuf847 Жыл бұрын
how to get that sample data, if i need
@sarasachandrikabhavanivajj6592
@sarasachandrikabhavanivajj6592 9 ай бұрын
I am getting the following error. I tried multiple methods like using numpy.asarray, np.array...... Is there any other solution? setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions. The detected shape was (5,) + inhomogeneous part.
@khairulfahim
@khairulfahim Жыл бұрын
What is that algorith? I mean that is working in the background.
@yt-1161
@yt-1161 Жыл бұрын
where is the csv file ? @13:47
@amelieeee9692
@amelieeee9692 Жыл бұрын
you left out a 2 in the gaussian formula
@assassingamer9088
@assassingamer9088 5 ай бұрын
but when i plug in 2 it gives wrong answer. i tried it on my dataset. without it it gives right answer. why?
@bean217
@bean217 Жыл бұрын
This isn't at all related to the video content, but I have the same exact scar on my forehead
@TheGnarTube
@TheGnarTube Жыл бұрын
Your style annoys me but the content is good
@MultiMarty1987
@MultiMarty1987 2 жыл бұрын
Great content. Just some feedback, I feel it would be less distracting if you didn’t show yourself talking while showing content on screen.
How to: Monte Carlo Simulation in Python (Introduction)
27:23
Mr. P Solver
Рет қаралды 58 М.
SciPy curve_fit: What is "pcov"?
31:24
Mr. P Solver
Рет қаралды 12 М.
Khóa ly biệt
01:00
Đào Nguyễn Ánh - Hữu Hưng
Рет қаралды 20 МЛН
I’m just a kid 🥹🥰 LeoNata family #shorts
00:12
LeoNata Family
Рет қаралды 18 МЛН
ROCK PAPER SCISSOR! (55 MLN SUBS!) feat @PANDAGIRLOFFICIAL #shorts
00:31
NERF WAR HEAVY: Drone Battle!
00:30
MacDannyGun
Рет қаралды 21 МЛН
ChatGPT Vs. Stack Overflow Be Like...
3:26
Mr. P Solver
Рет қаралды 74 М.
How to: Import, Plot, Fit, and Integrate Data in Python
24:11
Grad School Be Like...
3:35
Mr. P Solver
Рет қаралды 96 М.
How To Interpolate Data In Python
15:21
Mr. P Solver
Рет қаралды 46 М.
You Should Be Using This For Work/Research in Python | OOP Tutorial
34:23
Unlock the Secret of Nonlinear Curve Fitting - Python LMFIT
18:18
How to fit non-linear equations in excel using solver
6:24
Taylor Sparks
Рет қаралды 250 М.
Modern Python logging
21:32
mCoding
Рет қаралды 156 М.
NumPy vs SciPy
7:56
IBM Technology
Рет қаралды 32 М.
Linear Least Squares to Solve Nonlinear Problems
12:27
The Math Coffeeshop
Рет қаралды 28 М.
Hisense Official Flagship Store Hisense is the champion What is going on?
0:11
Special Effects Funny 44
Рет қаралды 2,3 МЛН
Ждёшь обновление IOS 18? #ios #ios18 #айоэс #apple #iphone #айфон
0:57
Will the battery emit smoke if it rotates rapidly?
0:11
Meaningful Cartoons 183
Рет қаралды 34 МЛН
iOS 18 vs Samsung, Xiaomi,Tecno, Android
0:54
AndroHack
Рет қаралды 95 М.