Monte Carlo Integration In Python For Noobs

  Рет қаралды 150,511

Andrew Dotson

Andrew Dotson

6 жыл бұрын

Monte Carlo is probably one of the more straightforward methods of numerical Integration. It's not optimal if working with single-variable functions, but nonetheless is easy to use, and readily generalizes to multi-variable functions. In this video I motivate the method, then solve a one-dimensional integral using monte carlo. I then solve the integral a number of times, and histogram the results, showing the distribution of areas calculated.

Пікірлер: 167
@victorserras
@victorserras 6 жыл бұрын
This has been a fantastic introduction to Monte Carlo methods
@AndrewDotsonvideos
@AndrewDotsonvideos 6 жыл бұрын
Thanks a lot!
@shrinivasiyengar5799
@shrinivasiyengar5799 3 жыл бұрын
Great tutorial. It made a lot of theoretical concepts clear for me when implementing. I really wish that you make more videos on Monte Carlo Simulations. I read that these were first used to solve atomic simulations. I am not connected to the physics world, and it would be great to learn more about that. Once again, great job
@lukkymaths8349
@lukkymaths8349 4 жыл бұрын
@Andrew Dotson , I don't know if you read comments on older videos, but I just wanted to thank you. I missed the lecture on Monte Carlo and understood nothing of the example code we were given. I already subscribed to you for the awesome skits, but this was the perfect video for me. You explain the concept and what each part of the code does, without going too slow. (I am a noob at programming, ngl.) Thank you, and greetings from Finland.
@_nem
@_nem 4 жыл бұрын
This was so much better than my lecturer's explanation. Nice and concise and some coding thrown in too. Good job. Thanks Andrew!
@JagroopSingh-wd6kj
@JagroopSingh-wd6kj 4 жыл бұрын
I'm not sure if threads exist in Python, but in C there is a concept called threading, where you can run multiple functions at the same time, and in this case you'd be able to split the N operations among M threads, where M threads are computing N/M operations at the same time, which would result in a faster runtime. After a quick google search, it seems that Python does have threads, I'd recommend learning them so that you can optimize your code runtime whenever creating a new program, especially in a field such as physics where you would have situations in which you'd have to compute 10000+ points sometimes.
@eblocha
@eblocha 4 жыл бұрын
Threads “exist” in python, but only one thread can actually execute code at a time (because of the Global Interpreter Lock), so it’s best suited for I/O limited stuff, like networking. Using numpy array operations is the best way to speed up the code, since it calls C code under the hood, which is about 100x faster. Beyond that, there is multiprocessing, which creates multiple python processes at the same time.
@superuser8636
@superuser8636 Жыл бұрын
@@eblocha GIL has been updated but these two comments were spot on and are still relevant today
@gregorykafanelis5093
@gregorykafanelis5093 Жыл бұрын
@@superuser8636 what do you mean GIL has been updated?
@diobrando7642
@diobrando7642 8 күн бұрын
@@gregorykafanelis5093 GIL = Global Interpreter Lock
@grjesus9979
@grjesus9979 3 жыл бұрын
I've never been introduced to Monte Carlo integration this way. Thanks!
@caseykijk1412
@caseykijk1412 5 жыл бұрын
I've been meaning to learn this technique. Great introduction!!
@DavidAspden
@DavidAspden 5 жыл бұрын
Good video, straight into it, with results! Others would have dragged this out.
@AndrewDotsonvideos
@AndrewDotsonvideos 5 жыл бұрын
David Aspden thanks!
@InspirationofGenius
@InspirationofGenius 6 жыл бұрын
Hi! Thanks a lot for this video, this Python example helped me get a better idea of how to approach solving problems in Python. In my research, I have to calculate entrainment rates (the rate dry air mixes with clouds to dissipate them) in cloud fields and observe how these rates affect cloud size distributions. Dealing with atmospheric processes, most of my data is in 4 dimensional arrays, so I've been slowly getting acquainted with those. Though your example was general, showing how to solve that integral helped give me a couple of good ideas of how I can approach solving a couple of my unknown variables. Thanks again for the video, I wish you the best of luck in your QCD research! Keep up the awesome videos! -From an elightened Python noob 😊😜
@prashantjadhao22
@prashantjadhao22 6 ай бұрын
Great tutorial. Cleared my concept on MC integration. I was looking for this topic on KZfaq and found your video very helpful .
@pubgplayer1720
@pubgplayer1720 4 жыл бұрын
This was actually very very helpful! I mainly watch the comedic side of your channel, but this was just a great video.
@78anant420
@78anant420 3 жыл бұрын
Excellent video. In 1 video i learnt the basics of how to plot a histogram, generate random numbers, write for loops and use arrays in python. Excellent. Thanks! Please make more of such videos using python
@siddarthshivkumar5780
@siddarthshivkumar5780 3 жыл бұрын
This is my first video on Monte Carlo integration. Loved your explanation :) Thank you :)
@treebattery2901
@treebattery2901 3 жыл бұрын
Thanks, Andrew. Helped me a ton with understanding my lab on Monte Carlo Integration.
@iman_s.5217
@iman_s.5217 3 жыл бұрын
Hey Andrew! I just wanna say thank you for this video. I made a monte carlo maximum successive scattering simulator out of it and the program did work as intended.
@birdstheword5
@birdstheword5 5 жыл бұрын
Wha... thats absolutely genius! I was struggling to understand this but now its just clicked!
@viradeus4322
@viradeus4322 3 жыл бұрын
Yea after I watched a couple of videos on Monte Carlo Integration, it suddenly clicked! A beautiful concept ngl
@eduardopasseto2387
@eduardopasseto2387 4 жыл бұрын
many thanks! you are helping a lot of programmers around the world... (I´m from Brazil!)
@trigocuantico
@trigocuantico 6 жыл бұрын
Great production in this video 👏👏 thanks for the content
@melinasandoval2688
@melinasandoval2688 3 жыл бұрын
Hi Andrew, thank you very much for this explanation. Now I know how to propose the solution for my project. I feel like I'm going to have a lot of fun applying this method!
@stagmanson4155
@stagmanson4155 5 жыл бұрын
Thanks Andrew, I'm just getting into my calculus courses at my college. I'm trying to pick up programming along with it and this video is quite helpful. I haven't taken any statistic courses as my degree plan doesn't require them and so my question is, have you taken any statistic courses and if so which ones? Keep up the great work we all appreciate it.
@Harsimran_Singh_27
@Harsimran_Singh_27 3 жыл бұрын
What a fantastic and helpful video... Thanks a lot. You really made it very simple and easy to understand.
@satellite964
@satellite964 2 жыл бұрын
As a person who has trouble with math terminology and symbols, bless you for doing this in code.
@qwertyzxcv6
@qwertyzxcv6 3 жыл бұрын
This is great thank you! The way you teach is very clear!
@pilchu7978
@pilchu7978 4 жыл бұрын
Title: Monte Carlo Integration In Python For Noobs : : : First words: "What's goin' on smart people!" Great video, sub and respect (:
@shrinivasiyengar5799
@shrinivasiyengar5799 3 жыл бұрын
I came to the comments section to write exactly that 😂😂
@somasunders1902
@somasunders1902 3 жыл бұрын
Nice Explanation bro, Need more stuffs like this.
@Dinghly
@Dinghly 4 ай бұрын
I first watched this in my 1st year in college thinking oh this is non of my business. I did not know I would need this video so bad. Thank you for your hardwork into making this video. luv it
@koenkempeneers5507
@koenkempeneers5507 5 ай бұрын
Great, straight to the point wonderful tutorial!
@laurasudupemedinilla759
@laurasudupemedinilla759 3 жыл бұрын
Good introductory video for Montecarlo!
@aswinjose1185
@aswinjose1185 4 жыл бұрын
it was a good and simple intro to Monte Carlo Integration. helped a lot!!
@randomperson5817
@randomperson5817 5 жыл бұрын
Superb content sir 😎
@rfhp1710
@rfhp1710 5 жыл бұрын
Hey andrew, this is really nice !
@ProfessionalTycoons
@ProfessionalTycoons 5 жыл бұрын
clear to the point very good video.
@atamamed2712
@atamamed2712 2 жыл бұрын
Ahuyet! Thanks Andrew that was very cool!
@mengyutu7170
@mengyutu7170 5 жыл бұрын
Fantastic video!
@abbasfathiazar7179
@abbasfathiazar7179 2 жыл бұрын
Thank you for publishing such a great video.
@YounesLab
@YounesLab 9 ай бұрын
Amazing Video! Thank you
@schieflp9195
@schieflp9195 2 жыл бұрын
Great video!
@user-pb9cc8sv6r
@user-pb9cc8sv6r 8 ай бұрын
clicked because I am a noob, suddenly called "Smart People", subscribed.
@Dooyahha1212
@Dooyahha1212 6 жыл бұрын
Eyyy lmao, I'm gonna take a class on Monte Carlo Methods!
@Eric-jh5mp
@Eric-jh5mp Жыл бұрын
I needed this last week and KZfaq didn't recommend it when I googled it. Unlucky
@adrogoff
@adrogoff 2 жыл бұрын
Thank you for this tutorial! Very understandable and easy, while looking for smth simmilar in internet is so complexed(
@uchihamadara6024
@uchihamadara6024 6 жыл бұрын
really interesting stuff!
@berkalkan3382
@berkalkan3382 3 жыл бұрын
Great explanation, thank you
@dipburo
@dipburo 6 жыл бұрын
Loved it!
@porit1023
@porit1023 6 жыл бұрын
love me some Monte Carlo!
@calebwhales
@calebwhales 6 жыл бұрын
These videos are really interesting to watch. Seeing you suss things out in real-time with a not-so-super-fast entry into python is awesome. Out of interest, does the script break anywhere for different A's, B's or func(x)?
@AndrewDotsonvideos
@AndrewDotsonvideos 6 жыл бұрын
I suppose it might converge slower the wider the interval you integrate over. Meaning you'd need more points to get a solid representative random sample
@therollingjonicle
@therollingjonicle 9 ай бұрын
This is great, thank you very much!
@thekantor1964
@thekantor1964 5 жыл бұрын
i love you bro. you saved my butt. i owe you. edit: subbed
@felipeignaciofigueroa1792
@felipeignaciofigueroa1792 4 жыл бұрын
I actually started to get away from python but this video gave me life hahahaha, thanks!
@pipertripp
@pipertripp 4 жыл бұрын
nice one. Yeah, np arrays are way faster than lists. Interesting about the convergence for single variable functions. Got any recommendations for books on numerical methods in general (and Python in particular)?
@tommyshelby6277
@tommyshelby6277 5 ай бұрын
THANKS BRO I GOT IT CLEARED IN 5 minutes IN!!!
@sjgabhane
@sjgabhane 6 жыл бұрын
yaaaas, thank you for the video!
@mrinalrajak5526
@mrinalrajak5526 5 жыл бұрын
Thank you Sir...from India....
@aisak4753
@aisak4753 4 жыл бұрын
thank you!!!so helpful
@picosdrivethru
@picosdrivethru 5 жыл бұрын
dude, thank you!
@felipebanegas
@felipebanegas 4 жыл бұрын
Thank you bro for this video nice content
@aritraray2501
@aritraray2501 4 жыл бұрын
, how can I find the area inside a curve? I have data points for a hysteresis loop and I want to calculate the area inside the curve
@Galileosays
@Galileosays 4 жыл бұрын
Great presentation. It works well. You said it will become a delta function, but you probably mean a Gaussian distribution, since it yields an average and a standard deviation.
@debunkthis
@debunkthis Жыл бұрын
No it’s a delta function. As you push the number of points to infinity you yield a deviation of 0 and get a delta function.
@Galileosays
@Galileosays Жыл бұрын
​@@debunkthis Due to the randomness of chosen points, there will be a variation around an average value. The central limit theorem tells that this yields a Gaussian distribution. A delta function implies that all random points fall at the mean value.
@ludiProjects
@ludiProjects 10 ай бұрын
@@Galileosays The delta function can be defined as the limit of the gaussian distribution when the variance goes to 0. As more samples are taken, the variance will indeed tend towards 0.
@maurocruz1824
@maurocruz1824 5 жыл бұрын
Great video. Do have a tutorial for phyton installation?
@loganschumacher3870
@loganschumacher3870 3 жыл бұрын
So is there a way to turn this into something to show growth of investment portfolios? Like with the average growth and standard deviation?
@inakidb
@inakidb 5 жыл бұрын
Hi Andrew. if I look a mean for a cost. what formula apply?
@KM25263
@KM25263 2 жыл бұрын
Nice and impressive demonstration...the x axis should not be labeled as expected value instead of area?
@soyamiitb635
@soyamiitb635 Жыл бұрын
nice explanation❤❤❤❤❤❤❤❤❤❤
@marcinkovalevskij5820
@marcinkovalevskij5820 4 жыл бұрын
Thx, that helped me!
@betifransisca2248
@betifransisca2248 5 жыл бұрын
You, sir, are a fucking gangster for this tutorial!!! Exactly what I was after. #Sauce
@najwer23
@najwer23 3 жыл бұрын
Thank You very much!
@arghyakusumdey7248
@arghyakusumdey7248 5 жыл бұрын
How I put dots in required area.want to know the command in python for plotting
@marcotanzilli6510
@marcotanzilli6510 5 жыл бұрын
Thank you so much!
@George-lt6jy
@George-lt6jy 2 жыл бұрын
Two questions, first I notice that the histogram of the integrals looks like the normal distribution. Is this because of the central limit theorem? Also, there are two places where sampling occurs where the first is sampling for estimating the integral and the other is sampling integral calculations for taking the average. My question is about how each of these parameters impacts the result. For example what if I only used 100 samples for calculating a single integral but took the average of 10000 integrals?
@kritikakhanwal614
@kritikakhanwal614 3 жыл бұрын
hey andrew, can you make a vedio showcasing what all compuatational work you do in your research in theoretical nuclear physics?
@scatmanthefetish7474
@scatmanthefetish7474 3 жыл бұрын
Thoroughly disturbed by the way you write a.
@1q1q1q1q1q1q1qw
@1q1q1q1q1q1q1qw 2 жыл бұрын
super nice video
@mirageneos
@mirageneos 6 жыл бұрын
I'm using Monte Carlo to model electron transport through water for my thesis, nice to see some Monte-Carlo!
@AndrewDotsonvideos
@AndrewDotsonvideos 6 жыл бұрын
Sounds really cool!
@mirageneos
@mirageneos 6 жыл бұрын
I'm loving it so far! Thanks for sharing your experience through honours and beyond - it's been great!
@Rising._.Thunder
@Rising._.Thunder 5 жыл бұрын
Hey man I am working on a different project which is the Cryogenic Energy storage simulation by MCMC. Can you help me a little ?
@Ellasdssssss
@Ellasdssssss 6 жыл бұрын
Do you think you could show to take the gradient of a scalar field in python? Recently discovered your channel and love your videos!
@AndrewDotsonvideos
@AndrewDotsonvideos 6 жыл бұрын
That's an awesome idea!
@jongcheulkim7284
@jongcheulkim7284 2 жыл бұрын
Thank you very much.
@khangpham268
@khangpham268 4 жыл бұрын
How do you do it for 2 dimension or higher integral? Like let's say Sqrt(x + y)
@samairastewart91
@samairastewart91 5 жыл бұрын
Lol where was this last semester when I was working on this for my computational physics course?
@shashank8098
@shashank8098 Жыл бұрын
Nice introduction. Can you show a tutorial for monte carlo simulation of a honeycomb Ising lattice?
@naturfagstoff
@naturfagstoff Жыл бұрын
Nice idea with the histogam. Looks a bit low-slanted, though. Hard to include the last x-value in the x domain, as that interval is semi-open. But wonderful example, thank You!
@tyroelohim4462
@tyroelohim4462 2 жыл бұрын
Great explaination but I have one doubt like if they give two circles and told to find the intersection area whose radius is r1 = 2, r2 = 2. And random sampling is n = 100000. Then how to print estimated area? I am getting error while implementing this? Please someone help. Thank you.
@1q1q1q1q1q1q1qw
@1q1q1q1q1q1q1qw 2 жыл бұрын
one question why do i have to use random numbers. shouldnt it work if i use equdistant values in my integralinterval as well ?
@vladalex9556
@vladalex9556 2 жыл бұрын
I don't understand however why it is better to use random samples (even for higher dimensions). Wouldn't a sample of uniformily spaced values be basically as good as a uniform distribution as it can get since the order doesn't matter. So for example for a one dimensional integral you can choose numbers from a and then increment by a small delta untill you get to b, and for a bidimensional integral do something similar but in 2 dimensions (of course making shure that you keep the points evenly spaced). For some integrals it might be easier to just take random samples i get that but when it is easier to just increment by a delta my question is if that would yield as good a result as with random numbers?
@vigneshwarankannan4999
@vigneshwarankannan4999 5 жыл бұрын
can you please explain monte carlo method for multidimensional integration
@DmitryPesegov
@DmitryPesegov 4 жыл бұрын
same way if integration happens for multidimensional function, say, f(x,y,z). Just vectorize the space and use the Euclidean norm for term (b-a) that would be then L2normDist(b,a) where b and a are multidimensional points. Or go deeper and use packed M-integrals for M dimensions. And if you've get the understanding about this - then, probably, it's time to meet the functional integral over a random pathes (with gaussian subintegral in each patch) in a space filled with positive and negative probabilities potentials (the simplified version of "Feynman's path integral" - without complex part about quantum physics, just the space and +/- potentials regions)
@miguelestradarodriguez5378
@miguelestradarodriguez5378 2 жыл бұрын
How do you apply the trapezoidal rule to a dataframe instead of a function?
@nitishitankar4992
@nitishitankar4992 10 ай бұрын
Thanks Andrew
@athreyakb1
@athreyakb1 2 жыл бұрын
Could you help me with a monte carlo assignment I have for a more complex equation by any chance :(
@wankmaster69
@wankmaster69 6 жыл бұрын
Hey Andrew , please make a video on how to read a research paper and what research paper can an undergraduate can read.
@Paraboemba
@Paraboemba 5 жыл бұрын
Read the title, next the abstract, then all the section-titles and subsection-titles and then the conclusion. Then go back and read the contents of the introduction and all following sections.
@jimmyding335
@jimmyding335 4 жыл бұрын
@@Paraboemba that's actually how I approach most of the papers yeah. You concluded it pretty well hahahaha
@dustyMehul
@dustyMehul 3 жыл бұрын
Great work bro... 2 questions here... If anyone can help... 1) when you wrote the very first expression of , I think it should mean that avg of f(x) for x in [a, b]... And not for any value of X. 2) while we carry out the experiment of randomly generating value of x and then, finding f(x), we should not be bias and should pick any value of x in the domain [a, b]. But, I think, Random no generator will only generate numbers randomly between 0 and 1, and not 0 to pi. Not sure though how the result is perfect.
@bh-rf9dd
@bh-rf9dd 3 жыл бұрын
@dusty mehul 1. The definition of is the average of x in the region between a and b. You have x which is a random variable that can take on any value between a and b. 2. When he created the random number generator he chose for the generator to choose numbers between 0 and pi. Random number generators allow you to choose what range of numbers you want to sample from.
@importnumpyasnp6539
@importnumpyasnp6539 3 жыл бұрын
''Very nice out of 10'' got me laughing
@eyesburning
@eyesburning 3 жыл бұрын
Very nice / 10
@ruben9228
@ruben9228 3 жыл бұрын
Great video! How would you solve for an integral with infinite limits though?
@bh-rf9dd
@bh-rf9dd 3 жыл бұрын
It would depend on the nature of the function. For a function like the gaussian function which has bounds from -infinity to infinity, you could probably do the integration within 2 to 3 standard deviations of the mean to account for about 95-99% of the area. Moreover, if there exists any symmetry in the bounds you choose for the function, you could compute the integral on only one side of the function and then double the result. This should substantially reduce computational cost.
@Riteshbachhar
@Riteshbachhar 6 жыл бұрын
Hey Andrew can you tell me about your python journey?
@user-zd9cz1lq6b
@user-zd9cz1lq6b 3 жыл бұрын
Wouldn't the end distribution of areas end up approximating a normal distribution instead of the delta function as a result of the central limit theorem?
@TheDavid43121
@TheDavid43121 2 жыл бұрын
Only one thing is wrong. The distribution will never be a Dirac's delta. Because of the central limit theorem, the width of the normal distribution will grow as sqrt(N). (You can check the x tics with N=1000 and N=10000 and see the width is greater in the later).What will decrease as sqrt(N) is the standard deviation of the mean. Great video tho👍
@darkpikachu_.
@darkpikachu_. 4 жыл бұрын
What will the Julia equivalent of this code be?
@jessicachaves3666
@jessicachaves3666 3 жыл бұрын
THANK YOU!!
@MarcoACto
@MarcoACto 6 жыл бұрын
Do you know if there's a scenario where using Monte Carlo's method would be preferable over other numerical integration methods (such as trapezoidal rule or simpson's rule)? I ask this because, like you said, seems like a lot of computational effort to generate random numbers and then feed them into a function.
@AndrewDotsonvideos
@AndrewDotsonvideos 6 жыл бұрын
Marco Antônio if you start integrating function that depends on more than just x, it starts to be way more worth it to use monte carlo
@MarcoACto
@MarcoACto 6 жыл бұрын
Oh I see. Thanks for the answer!
@UmurCanKaya
@UmurCanKaya 5 жыл бұрын
In my graduation project I have to calculate the expectation value of some operators over many-body wavefunctions. In a 2D system and for 30 particles (my case) this means a 60 dimensional integral. I simply don't have any other choice beside Monte Carlo integration.
@ccuuttww
@ccuuttww 4 жыл бұрын
Wolverine is teaching map its cool!
@mihajlovucic8037
@mihajlovucic8037 4 жыл бұрын
What is the difference between taking the average of 1000 integration results each having N=10000 random points, and just 1 integration with N=1000*10000? Is the point of doing this just visualization with histograms?
@lernenmitrobin
@lernenmitrobin 4 жыл бұрын
didn't know to use the same variable e.g. i for index in nested for loops several times
Tensor Calculus For Physics Majors 003 | Two-Index Tensor Examples
25:45
Finding Zeros of Functions In Python (Bisection Method and Scipy)
15:26
Ouch.. 🤕
00:30
Celine & Michiel
Рет қаралды 28 МЛН
Задержи дыхание дольше всех!
00:42
Аришнев
Рет қаралды 3,8 МЛН
Monte Carlo Simulation
10:06
MarbleScience
Рет қаралды 1,4 МЛН
Integration in PYTHON (Symbolic AND Numeric)
15:20
Mr. P Solver
Рет қаралды 80 М.
Lessons Learned During My PhD So Far
13:05
Andrew Dotson
Рет қаралды 152 М.
Monte Carlo Methods : Data Science Basics
19:14
ritvikmath
Рет қаралды 118 М.
1st Year Calculus, But in PYTHON
32:13
Mr. P Solver
Рет қаралды 123 М.
Monte Carlo Simulation with Card Games
8:21
Normalized Nerd
Рет қаралды 50 М.
Numerical Integrals in Python
10:09
Mr. P Solver
Рет қаралды 10 М.
Ouch.. 🤕
00:30
Celine & Michiel
Рет қаралды 28 МЛН