I been in this field for years and this is by far one of the best explanations I seen. Thank you for this.
@Songfugel2 жыл бұрын
I would have to agree
@zh96642 жыл бұрын
i think you need join field english
@ultimateloser34112 жыл бұрын
Any advice on how to build a career in the field without a degree?
@Phoenix_Core2 жыл бұрын
@@ultimateloser3411 Take clinical psych classes, take classes on quantum physics, take classes on anthropology, take classes on game theory, take classes on python/lisp/lua/C ++/C #, learn unity and ue engines.
@ayushupadhyay8012 жыл бұрын
if you had enough data could NN learn anything ?
@NicholasRenotte2 жыл бұрын
This is such a brilliantly constructed explanation of NNs. Props to you man, this must’ve taken a ton of effort to create.
@Skynet_the_AI2 жыл бұрын
I agree. Nicely compiled points and explanation of information gathered.
@gerixxx12 жыл бұрын
This is the absolute best entry level explanation of AI an NN I have yet seen anywhere. This will surely get millions of views!
@pon12 жыл бұрын
Yeah, I think so too, the video was really good!
@truth.speaker Жыл бұрын
@@pon1 I couldn't understand it
@pon1 Жыл бұрын
@@truth.speaker What was it that you were having trouble with?
@SimoneBellomonte Жыл бұрын
Pretty close, it's sitting at 962k views right now.
@Diamcreeper2 жыл бұрын
The part where you combined a bunch of line equations was interesting, I've always heard that activation functions are important but I never quite understood what their role is.
@ScottBrown1242 жыл бұрын
ReLU specifically constructs a solution as a bunch of piecewise linear functions.
@Neoplasie19002 жыл бұрын
@@ScottBrown124 While this may be technically correct, had I just read your statement this would mean almost nothing for me. And I'm pretty sure this will be true for most people who did not persue an higher education in mathematics or a related field. Visually showing what this means with the inclusion of how things work without ReLU is what does the trick for a non-professional audience.
@lsacy8347 Жыл бұрын
I was always told that you need the combination of linearity and non-linearity to gain complexity. But this videos really did it.
@mertkaaner8622 Жыл бұрын
They break linearity in efficient ways and there is nothing much to them(lie). Even though this explains what they do “the why” part needs deeper insights.
@mertkaaner8622 Жыл бұрын
Without activation(or with linear activation) NN can approximate linear functions with any dimension. However, most of the subjects in real life are represented by non linear functions. So if NN has any chance of learning some meaningful data set it needs non-linearity at some point in its calculations. You can use any non-linear function but most wouldn’t be computationally efficient. ReLu is simple enough and non-linear to be widely used in many NN applications as the activation function. If you wish you can you use sin cos or polynomials or other functions and compare your results and performance with widely used activation functions. Who knows maybe you find the next best activation function :)
@ScottBrown1242 жыл бұрын
I'm glad you brought up the caveats to the universal approximation theorem. Available data, compute, and architecture drastically narrow the scope of problems that we can approximate to any real degree of success. Approximation errors, estimation errors, and optimization errors all compound to drastically limit the expressive power of neural networks.
@unh0lys0da16 Жыл бұрын
Tell that to the managers
@alexCh-ln2gw Жыл бұрын
@@unh0lys0da16 naw. elon musk still wants us to believe neural networks will solve driving. They are very far away from collecting the entire universe of driving data to train on.
@jazzhpatel5 ай бұрын
my man altman just walks in with a 7 trillion dollar pitch. hahaha
@marlin35762 жыл бұрын
Such a good video mate, Hope your channel grows exponentially.
@NKY52232 жыл бұрын
hehe jk
@user26344 Жыл бұрын
As technology advances, AI approaches neuroscience, which is what I find most fascinating about AI. Our brains are just sugar-driven neural networks, tuned to the inputs of everyday life on earth!
@activision41704 ай бұрын
I hope one day neuroscience is simulated with computer science. A joint of biological systems would be the construction of conscious things.
@Beerbatter1962 Жыл бұрын
I've recently become interested in neural networks, and AI in general. This video was spot on for providing a fundamental understanding. The piecewise activation function used to trace along the unknown function was eye opening. Really brought that idea home for me finally. Thanks. Your video is very nicely produced. Right at the top by today's YT standards.
@derekcobo1453 Жыл бұрын
This was so well explained. I love how you briefly dipped into the deep math just giving a taste to do our own searching yet still explaining in depth what is going on.
@naidoeshacks2 жыл бұрын
Absolutely love these 3blue1brown style videos! Keep it up man your channel is amazing.
@RCFreibott Жыл бұрын
What a marvelous video. I've been watching tutorials and reading books on machine learning for over a year, but I've never really understood the core concepts... Until now. Thank you
@Antagon6662 жыл бұрын
Just found this channel. Quality of your videos is supreme, and you cover really interesting topics, which I've been studying myself for the better part of last year. Thank you!
@officialbfi012 жыл бұрын
I’ve been binging your videos all night but this video has easily earned my subscription. An absolutely fantastic explanation that perfectly captures the essence of neural networks without being bogged down by the maths.
@MoritzWallis2 жыл бұрын
Wow, this wasn't anything new to me, but you did an amazing job of explaning the background and building intuition. Truly one of the best youtube videos i've seen.
@Vaikilli2 жыл бұрын
This was probably just an aside in the video, but you got me from just knowing the basic shape of the ReLU-Function to why one would use it in a NN really damn quickly.
@eli694462 жыл бұрын
High audio quality, slow and clear language, great presentation and most of all very informative! I'm glad this was recommended to me
@viky293 Жыл бұрын
One of the best videos that I watched, I knew nothing about neural networks before this video and now I feel like I act as one who understands the damn thing. Thank you for beautiful explaination.
@yusufsalk11362 жыл бұрын
What a simplicity! Looking forward to watch more explanations.
@miquelmoorrees60102 жыл бұрын
a great voice, a great presentation and a great explanation. you have everything to make it as a succesfull channel how this only has 4k views is beyond me edit: also great thumbnail and title
@balaganesh3440 Жыл бұрын
You got me when you said "A neural network is basically a Function approximator". No one could explain much simpler than this. This is byfar the best explanation of neural networks I have ever come across. Kudos mate!
@zeb48272 жыл бұрын
I think this is one of the most valuable videos i've watched about understanding what neural networks are actually doing. Neural networks are kind of built upon the union of two of the most fundamental ML algorithms- the linear regression draws the main function, and logistic regression bends the function. More layers, more bends, more nuance in the description of relationships- all now automatable through this recursive optimization process. It's quite beautiful really
@orchidchetiaphukan46582 жыл бұрын
It has been years in this field.....One of the best explanations I have seen till now....
@_parallax Жыл бұрын
Thank you for this. Your video is, by far, one of the best videos you can find to get an introduction into Neural Networks. Awesome!
@illustriouschin2 жыл бұрын
I was recommended this video and wow, great explanation. I hope your channel blows up because this is top quality neural network content.
@SO-th8gc2 жыл бұрын
Just came across your video from the feed. Dude, you've done an incredible job on propping up the basics. Huge appreciation. Waiting for your future videos.
@cornevanzyl58802 жыл бұрын
What you did here is nothing short of magical. Fantastic explanation, awesome visuals 👌
@qwerasdliop2810 Жыл бұрын
I didn't come here expecting to learn anything but this video was incredible! I learnt: Neural networks are universal approximators, turing complete, and how multiple layers actually work!
@grkuntzmd6 ай бұрын
I started writing neural networks for a research project when I was in medical school in the early 1990's. At the time, I struggled with explaining how they worked to my audience of medical professionals. I wish I had had this video to show them. It would have made things much easier. Bravo!
@brian_kirk2 жыл бұрын
Excellent layout of the topic from basic first principles -- well done! Hoping to find more videos like this on your channel :)
@olivergurney96222 жыл бұрын
Really interesting and highquality video. Keep it up!
@yvessoke85587 күн бұрын
You made complexe (almost) simple. Outstanding job, bravo and thank you very much 👏🏽
@jimmypk13532 жыл бұрын
FUNCTIONS Describe the WORLD! - Thomas Garrity Indeed the BEST explanation on you tube (even better than 3Blue1Brown; no disrespect intended, of course). This SINGLE describes so many concepts that usually require a series of videos. Also, his choice of words is IMPECCABLE!
@MrFujinko6 ай бұрын
If it describes everything then it describes nothing.
@Ou_dembele2 жыл бұрын
The best explanation I've seen
@Dante02d12 Жыл бұрын
This is the introduction to neural networks that I was ever hoping for. I'm an engineer, but sadly, neural networks weren't part of my learning program. But I am interested in learning, and this explanation is a perfect description to the concept of NNs, it really clears my mind about what this is. So a neural network is a function approximator, and due to the way it is "built", it can approximate _any_ existing function, no matter how complex, as long as we have enough processing power (and memory). The diagram with the function where we only see a few dots is a great view of what neural networks do. They have a set of data (a bunch of pictures, for example), and when you ask for a result that isn't in its set, it extrapolates it based on what it does know. EDIT : I was wondering how a neural network could, for example, study a set of images and return a brand new pic corresponding to its database. I have realized that an image is just a sum of pixels, and a pixel is just a sum of several colors (the famous RGB, with an alpha channel for transparency). So the "function of an image" looks like this : (Pixel 1, Color 1) + (Pixel 1, Color 2) + (Pixel 1, Color 3) + (Pixel 1, Alpha) + (Pixel 2, Color 1) + (Pixel 2, Color 2) + (Pixel 2, Color 3) + (Pixel 2, Alpha) + ................. So a neural network can be trained to recognize the "sum of pixels and colors" of images, and then return a similar result! And, of course, the various layers help recognize patterns, like a character in a pic, or the hair, or the hands, and so on...
@jakehu8733 Жыл бұрын
I'm sure this took time to create, but I would like to say that tensorflow playground is always 2-Dimensional. It is not represented in 3d and shown 2d. That last layer shown is actually a hidden layer. That is what connects to the 2 last neurons, which are unshown.
@shakeeb829011 ай бұрын
Nice video. May the creator of this video live long.
@jonathanherrera99562 жыл бұрын
Sometimes you may want to use a simpler approximation with a neural network instead of the complete known function, since the function is too complex and computational intensive. Like in the case of acoustic simulations.
@JordanMetroidManiac Жыл бұрын
Fluid dynamics is another example. Mandelbrot set rendering. Cayley graph (in group theory) diameter calculation and pathfinding (optimally solving a Rubik’s cube, for instance, can take several minutes). Markov decision processes. There are so many things that neural networks can help us to solve or understand better.
@betterbelle29 Жыл бұрын
This is actually a great point as well. There's a small set of research that has recently delved into using neural networks to approximate the solutions for NP-Hard problems. That's probably one of the most intuitive ones to think about; NP-Hard problems are quite literally defined as being complex and computationally intensive :P
@HansLemurson2 жыл бұрын
Great video! I liked how you made sure to talk about the major limitations of Neural Networks. The main thing holding NNs back is how long it takes to train, and how inefficient their computation is. But the thing is, that just turns it into a problem that can be solved by scaling up hardware, which is not something that you can do with genius programmers. With machine learning, you can potentially solve any problem by just throwing money at it.
@_.entropy._ Жыл бұрын
Brilliant job. One of the best videos introducing the basics of neural networks on KZfaq.
@Rikimkigsck2 жыл бұрын
This channel is a treasure. A person who knows how to explain things with great knowledge.
@yashtrivedi2717 Жыл бұрын
We need more videos like this. Most of the YT science videos are so in Layman's terms. This is more like learning real scientific explanation 🧬 🧠
@spicetea40602 жыл бұрын
I'm gonna use fuzzy logic
@burgerjointcity62672 жыл бұрын
Apart from clear explanation throughout, kudos 👏 on the important remark ( _deep breath_ ) at 8:31 to precisely mention when neural network cannot learn the function and when it _should not_ be used to learn the function
@Skynet_the_AI2 жыл бұрын
Right...!!
@xxsaivior96394 ай бұрын
Dude i learned so much from this video I was actually shocked like I’ve watched 30 min videos and was still left with so many questions but this one’s amazing ❤
@alonsomartinez9588 Жыл бұрын
Max, any chance you could do one on Transformer architecture? It’s the core of most modern machine learning and I haven’t seen an intuitive explanation. It’s increasingly that it has remained mostly unchanged and undefeated. It would be incredible to hear your breakdown on it!
@ingolf17 Жыл бұрын
Its not learning, its conforming to the result you want. Billions of small dials, controlled by a logic algorithm, Its no magic, just alot of numbers!
@Imbalanxd4 ай бұрын
Sounds the same as billions of small neurons, controlled by a genetic algorithm. Sounds like learning to me.
@ParthivShah3 ай бұрын
It's debatable.
@itdepartment31562 ай бұрын
So, What is the difference between learning ?
@breakdancerQ Жыл бұрын
The visualizations are brilliant. Easily one of the most clarifying video I've seen about nns, and I've seen many
@robertiancu7468 Жыл бұрын
Awesome! Good job, pal!
@dannyarcher63702 жыл бұрын
Fun fact: You can't learn everything.
@ivaroAI3 ай бұрын
Yes, but you can learn anything.
@ImJustAManBro2 ай бұрын
You can learn everything just has to be correct
@Sumpydumpert2 ай бұрын
Could u make since of it tho I’d love feedback on cosmo knowledge yt and Reddit grand unified theory
@CC-1.2 ай бұрын
No humans I think can learn anything (physical phenomenons) because of the nature of human brain Some neurons are isolated, some aren't, there are mini neural networks inside neural networks inside human brains Maybe
@jamieparker64652 ай бұрын
I’m glad someone finally said it. You can’t learn everything, there is only a small amount of things actually worth knowing.
@aspectreishauntingeurope2 жыл бұрын
great video! looks a lot like 3blue1brown :D
@raphaelcrespo37252 жыл бұрын
this is one of the best and clear explanations. thank you
@archanghosh76072 жыл бұрын
3 Years after getting in to ML and 2 years into Deep Learning. But this video is beyond amazing
@mastershooter642 жыл бұрын
can they learn how to train themselves and to modify their own code to make themselves better?
@hyperteleXii2 жыл бұрын
Sure, to a degree. Software can't fully optimize itself because a computer is a living ecosystem with dynamic properties. One moment you want to optimize for something, the next for something else. As learning takes time, it will always take *more* time to continously optimize than to brute force. That is to say, LEARNING only accelerates REPETITIVE PROBLEMS. "Become better all the time" sounds repetitive but isn't a well-defined *problem*. So there's a practical limit to self-optimization usefulness.
@alessandrorossi12942 жыл бұрын
Can't learn an XOR 😂😂😂
@dagmarski41335 ай бұрын
That’s not true, it’s even feasible to manually construct a neural network with just 3 nodes for such a simple task.
@willykitheka7618 Жыл бұрын
Truly one of the BEST VIDEOS I've watched on Neural Networks....so very well explained!
@mboosiri Жыл бұрын
Watching this video will clear all the doubts! Some other videos may try to explain the concept visually and with analogies, but that can often lead to over-fitting, i.e. after watching those videos, will only remember the analogies and not the actual concept. This one nails it!
@Raminber Жыл бұрын
wow, this video is realy deep. One of the best videos on this topic! Maybe even the best!
@zerotwo73192 жыл бұрын
I knew it would be turing complete. Thanks immensely for this
@self.__osman Жыл бұрын
This is literally the best explanation of neural networks on KZfaq
@adityaghai1702 Жыл бұрын
Hands Down. This is the best video on neural networks explanation.
@91allenstreet Жыл бұрын
Clear from start to finish.
@setoelkahfi8 ай бұрын
This is by far the best explanation of the subject. I remember trying so hard to grasp the concept at the university. Thanks for putting this one out.
@saikrishnasyamala57202 жыл бұрын
That’s a great way to explain a complex concept👏🏼
@kibarpro3 ай бұрын
This is awesome! Quality of your videos is supreme thanks!
@mariokotlar303 Жыл бұрын
Seen many such videos explaining how neural networks work over the years, but this is the first time I feel I actually understand it.
@waltuhputyourdaway65612 жыл бұрын
What a coincidence i was looking for how to approximate functions with anns but I couldn't find anything about it. Thanks for video.
@hsslay32378 ай бұрын
Didn’t have any prior knowledge on neural networks and it’s working but a high level overview like this makes it more sensible on how these neural networks works without involving too much background information in it just weights and bias with pre determined input and output to get the function that describes them by adding more and more neurons if that’s what needed for the approximation.This is fascinating id love to go deeper where veretasium talked about this concept but in a different approach.really fascinating stuff
@PeterParker-vi2nl2 жыл бұрын
This channel is gonna grow like crazy if the Emergent Garden keeps this up!
@chadkaczynski34132 жыл бұрын
For the past days, I've been thinking about how to explain a neural network, and realized that it's basically a really dumb and slow way of learning functions (that is, if you already know the function!) - the fact that this video introduces NNs exactly so is really affirming. Also, I finally understood what activation functions really are - they don't "activate" per se, but rather restrict activation in order to maintain complexity. So thank you for this video, this explanation of Neural Networks is by far the best I've ever come across.
@jordiwang Жыл бұрын
Man for real, the visual graphical representation of the piecewise functions sum left me speechless, so freaking good. For someone who has a bad foundation at math, that representation was just everything i need to understand perhaps one of the most pivotal foundation of complex neural network. I don't consider my self dumb, but I've watched several videos that all it does is to explain the concept from an abstract perspective, or if not, making assumptions that we already know some mathematical concepts. With that visual representation, I can finally tell me self that i have understand how really the inner world, the magic box works. Thank you
@pkrozie4 ай бұрын
Amazing video, such a intuitive way to explain NNs.
@aprocesss9 ай бұрын
The visuals you presented are the most eye oppening ive seen in all ML courses ive taken.
@TheNewton2 жыл бұрын
Subbed. That thumb of the tensorflow playground spiral is why I watched I've only dabbled in other tools or unfinished projects so I've never gotten the thing to cooperate and forgot all about it.
@abdelsamie.bousba2 жыл бұрын
WOW !!, truly amazing, I got to understand what I couldn't in many years of reading papers and watching tutorials, big thanks to you.
@jamescarter9147 Жыл бұрын
One of THE best explanations of neural networks and how they actually work.
@clearz3600 Жыл бұрын
I was watching videos about Transformers and accidentally clicked on this video. Very concise and enjoyable video on the topic of neural networks.
@keithwallace52773 ай бұрын
This is one of the greatest videos I ever watched, masterpiece
@zahid19092 жыл бұрын
I believe, now I got some fundamental ideas how and why the neural network works. Thanks a lot! A great video.
@zRedPlays2 жыл бұрын
Throughout the whole video, I thought this guy had at least 100k subs. Loved every second of this video.
@TheFinav2 жыл бұрын
What an absolutely wonderful, clear explanation. Thanks!
@TayyabAhmad007 Жыл бұрын
Damn it! What an explanation that was, love you bro from the bottom of my heart keep it up bro. This is so far the best explanation i have seen so far 🤩🤩😘😘😘😘😍😍😍😍😍😍😍😍
@nvs32212 жыл бұрын
beautiful explanation, and amazing presentation. this is of 3b1b quality of video. great work!
@AhmedSam2 жыл бұрын
The exact info i was looking for finally straightforward! Thank you!
@ryderbrooks17832 жыл бұрын
Change "learn (almost) anything" to "Learn anything (almost)" and I'm with you.
@HypnosisBear2 жыл бұрын
Amazing explanation! Thanks 👍 Neural networks are indeed incredible!!
@chabasik4831 Жыл бұрын
Неймовірний проект, відео і канал. Дякую!
@tnegras992 жыл бұрын
This is amazing, best explanation of neural Networks I've seen, saved it to watch it again and again, might need it
@WelchLabsVideo2 жыл бұрын
Loving the manim animations!
@xhinker2 жыл бұрын
The relu part is amazing, renewed my understanding of it, thanks!
@Mehrdadkh87 Жыл бұрын
I watched lot’s of clips and this one is awesome . NNs are function approximator
@scottterry2606 Жыл бұрын
From one educator to another, A+++ job!
@parijatbandyopadhyay80572 жыл бұрын
This is awesome! Simplest form of explanation ever seen but does not lack any detail. Kudos to you.
@BibhuArya2 жыл бұрын
I wish I could have seen this video when I just started learning Machine learning. Amazingly explained
@Nytex Жыл бұрын
best introdoctury video to neural networks by far!
@terryn9450 Жыл бұрын
Wow!!!! Out of all the videos I watched on deep learning, this video simplified it the best. Amazing work on making this idea easy to understand.!
@stas41122 жыл бұрын
Wow what a channel, just checked the rest of the videos and got excited for the upcoming weekend to sit down and take some notes on all your videos! Get ready for a lot of growth, looks like the algorithm picked you up!
@xreverse_f1ash Жыл бұрын
I haven't really known what neural networks were until I watched this video. Thanks for furthering my understanding!
@dasikalyan Жыл бұрын
I heard of ReLU a lot, but no one provided a good explanation... this was an aha! moment.. thank you for rectifying some linear units in my brain.. now I can dive deep into learning
@0xAV Жыл бұрын
most easy to grasp explanation i have come across till now sir. Thank You 🙏
@Femaiden Жыл бұрын
call me when they make a neural network that can learn the secrets to human immortality. . .